Abstract
Musculoskeletal conditions can change tissue elasticity. Knowledge of musculoskeletal elasticity could therefore aid clinical diagnosis and management. Sonoelastography is an ultrasound‐based system that examines the material properties of tissues, and it may be useful in musculoskeletal practice. Therefore, it is important to establish its clinimetric properties. This study aimed to explore the intra‐rater reliability and the smallest detectable changes of sonoelastography in examining musculoskeletal structures. A quantitative reliability design was used to examine 22 healthy participants using a compression sonoelastography system that produces color‐coded images. The deltoid, biceps brachii, brachioradialis, rectus femoris, gastrocnemius medius muscles, and Achilles tendon were examined twice at 1‐hr intervals to assess the intra‐rater reliability. The sonoelastography images were analyzed using the strain index, strain ratio, and color pixels. The intra‐rater reliability and the smallest detectable changes of each outcome variable were determined. The intra‐class correlation coefficient was used to quantify the repeatability of the measurements, and the smallest detectable changes were calculated to determine clinically important differences above the error of measurement. The intra‐rater reliability for the strain index, strain ratio, and color pixel analysis ranged from moderate to excellent (intra‐class correlation coefficients: .734–.950, .776–.921, and .754–.990, respectively), with color pixel analysis demonstrating the highest reliability. The smallest detectable changes were determined for all structures, including the Achilles tendon (0.11 for the higher boundary of the strain index, 1.80 for the strain ratio, and 2.90% for red pixels, representing soft tissues). Color pixel analysis may be more reliable for sonoelastography interpretation compared with the strain index and strain ratio. The calculated smallest detectable changes could be used to identify clinically important differences.
Keywords: elasticity, muscle, reliability, sonoelastography, strain, tendon
Sonoelastography image of the gastrocnemius medius muscle showing its degree of elasticity (red indicates soft tissues, green indicates intermediate elasticity, and blue indicates hard tissues).
1. INTRODUCTION
Knowledge of the material properties of human tissues can be important for understanding the underlying pathology and functional changes, and thereby optimizing clinical diagnosis and management. For example, knowledge of the stiffness of breast masses aids in the differentiation of malignant and benign tumors (Nariya et al., 2010; Regini et al., 2010), and liver stiffness has been correlated with liver fibrosis, aiding diagnosis as well as determination of the fibrosis grade (Yeh et al., 2002; Tatsumi et al., 2008). The pathological course of tendinopathy can cause tissue softening, degeneration or calcification, all of which significantly change the elasticity of the affected tissues (Chard et al., 1994; De Zordo et al., 2010; Arya & Kulig 2010). Generalized laxity of the musculoskeletal system, with a significant reduction in musculotendinous stiffness, is a dominant feature of connective tissue disorders and is associated with mutations in genes encoding collagen (Hakim and Grahame, 2003; Simmonds and Keer, 2007; Rombaut et al., 2012). Moreover, musculotendinous elasticity is essential for normal functioning. Elasticity is needed for energy storage, and for force transmission and release in the musculotendinous unit (Rabita et al., 2008). Changes in musculotendinous elasticity can cause deficiencies in the production and transmission of the forces needed to function (Bojsen‐Moller et al., 2005; Rabita et al., 2008; Arya and Kulig, 2010).
Compression sonoelastography (SEG), an ultrasound‐based technology that aims to quantify tissue elasticity by providing color‐coded images, has been recently introduced into musculoskeletal practice (Garra, 2007; Wu et al., 2012; Alsiri, 2017; Alsiri et al., 2019). Compression SEG creates sonographic images of strain by exploiting the principle that soft tissues display greater deformation and hard tissues less deformation when subjected to similar forces (Garra, 2007; Wu et al., 2012). The application of SEG in musculoskeletal practice is currently under exploration. Promising results have been reported, suggesting the potential value of SEG in detecting subclinical manifestations in the Achilles tendon (Drakonaki et al., 2009; De Zordo et al., 2010). We have demonstrated the potential of SEG to distinguish between patients with hypermobility spectrum disorders and healthy controls (Alsiri et al., 2019). However, several clinimetric properties of SEG, including its reliability and the smallest detectable change, need to be determined for various regions of the musculoskeletal system. The reliability of SEG has previously been explored in relation to a small number of specific structures. SEG has shown good inter‐ and intra‐rater reliability for examining the Achilles tendon, good inter‐rater reliability for examining the plantar fascia, and excellent intra‐rater reliability for examining the biceps brachii muscle (Drakonaki et al., 2009; Wu et al., 2011; Yanagisawa et al., 2011). However, most of the previous studies used qualitative methods for SEG image analysis. Only a few studies have introduced more quantitative analytical approaches for specific structures such as the biceps brachii muscle and the plantar fascia (Yanagisawa et al., 2011; Wu et al., 2012). We have previously explored the deltoid, biceps brachii, brachioradialis, rectus femoris, and gastrocnemius muscles, and the patellar and Achilles tendon using semiquantitative methods related to the strain index, strain ratio, and color pixel analysis (Alsiri et al., 2019). Such methods of incorporating the findings of the strain index and strain ratio with the objective results of the color pixel analysis could overcome the subjectivity in SEG assessment. In particular, color pixel analysis using imagej software can provide exact quantification of the percentages of each color in the SEG images, thereby enhancing its procedural reliability and optimizing its clinical use for purposes such as differential diagnosis (Wu et al., 2012). However, the additional clinimetric properties of such SEG outcome variables need to be established.
The aim of the current study was to explore the intra‐rater reliability and the smallest detectable change of SEG in examining a range of musculoskeletal structures in the upper and lower limbs by using an objective image analysis approach.
2. METHODS
2.1. Ethics
The research was conducted with the approval of the Research Ethics Committee of Kuwait Ministry of Health (ref: 571/2017). Informed consent was obtained from all participants. Voluntary participation, confidentiality, privacy, and dignity were explained and maintained.
2.2. Design and sample size
A quantitative reliability research design was employed by conducting two trial examinations (Walter et al., 1998). The GRRAS and COSMIN checklists for reporting and assessing the methodological quality of reliability studies were used (Mokkink et al., 2010; Kottner et al., 2011). The sample size for the intra‐rater reliability study was determined using the functional approximation proposed by Walter et al. (1998). The number of participants required to estimate the intra‐class correlation coefficient (ICC) was determined to be 15 at α = .05 and ß = .20, assuming the measurements were repeated twice (Walter et al., 1998). Twenty‐two participants were recruited to allow for potential attrition.
2.3. Recruitment and eligibility criteria
Healthy participants were recruited from among the staff at Al‐Razi Orthopedic Hospital, Kuwait, using a convenience sampling method. An advertising email was sent which detailed the eligibility criteria for participating. Participants who responded that they were willing to participate were contacted by the chief investigator to check their eligibility criteria and to arrange an examination appointment. The data collection started in June 2017 and ended in August 2017.
Healthy women and men aged ≥ 18 years were included. The exclusion criteria were as follows: injury in the upper or lower limbs during the previous 3 months, surgery on the upper or lower limbs during the previous 12 months; fracture in the upper or lower limbs during the previous 12 months; pregnancy and parturition during the previous 12 months (due to postpartum ligament laxity); connective tissue disorder; and conditions that might cause weakness in the upper or lower limbs. One female potential participant was excluded because of pregnancy and two because of parturition within the previous 12 months.
2.4. Instrumentation
Compression SEG (Voluson E8, General Electric Company) was used to assess the perpendicular resting elasticity of a range of musculoskeletal structures. As all the examined structures were superficial, a high frequency transducer was used (6–15 MHz) to penetrate 4–5 cm below the skin. B‐mode ultrasound image brightness was standardized using the default gain setting for musculoskeletal imaging. SEG is an ultrasonography‐based system that measures tissue displacement (strain) in the direction of the applied force by applying external mild compressions (stress) using a SEG probe (Sconfienza et al., 2010; Turan et al., 2013; Klauser et al., 2014). The resulting tissue displacement is calculated and then converted in real‐time into color‐coded images, where each color represents a different degree of elasticity (Figure 1) (Turan et al., 2013; Klauser et al., 2014). The elasticity index and ratio are strain measures generated by SEG to reflect the mechanical properties of the tissues semiquantitatively (Tan et al., 2013; Bamber et al., 2014). The strain ratio can be calculated from the elasticities of an area of interest and a reference area, usually subcutaneous fat (Bamber et al., 2014; Klauser et al., 2014). SEG is quick and practical to use (Hoyt et al., 2008; Turan et al., 2013).
Figure 1.
Longitudinal sonoelastography image of the gastrocnemius medius muscle (green rectangle) superimposed on a B‐mode ultrasound image. The color scale (highlighted with the yellow oval) shows the color range; red indicates soft tissues, green indicates intermediate elasticity, and blue indicates hard tissues. The display shows a six‐dot scale visual quality indicator to standardize the compression magnitude (highlighted with the red oval (Turan et al., 2013). With sufficient compressions, all six dots become green. Red dots, yellow dots, or less than six green dots indicate that compressions were insufficient to calculate tissue elasticity.
2.5. Data collection
Data collection began with measurement of the participants' height and weight. The dominant limbs (self‐declared by participants) were scanned in a resting position, starting with the upper limb and followed by the lower limb structures. Real‐time SEG was conducted to obtain real‐time SEG images by inducing local strain through compression and decompression with the SEG transducer. The color scale for the display was red for soft tissues, green for intermittent elasticity, and blue for hard tissues. The SEG system is equipped with a visual quality indicator to allow adjustment of the applied strain and to tell the user if the applied compression is sufficient to measure tissue elasticity (Figure 1) (Klauser et al., 2014). The SEG examination yielded a color map that was superimposed on a B‐mode ultrasound image (Figure 1). A single examiner (N.A.) independently conducted all SEG examinations. The examiner had four years' experience in using SEG. Three days of piloting supervised by an associate professor in radiology with 20 years' experience in ultrasonography, ensured smooth conduct of the procedures before undertaking the actual study.
The dominant deltoid, biceps brachii, brachioradialis, rectus femoris, and gastrocnemius medius muscles, and Achilles tendon were assessed using the higher and lower boundaries of the strain index and the strain ratio (Figure 1). The examined structures of the upper and lower limbs were selected both to be easily accessible and to aid in formulating a generalizable concept regarding the intra‐rater reliability of SEG in examining the musculoskeletal system. SEG examination was conducted in accordance with the guidelines of the European Federation of Societies for Ultrasound in Medicine and Biology (EFSUMB) (Bamber et al., 2014). The higher boundary of the strain index refers to the elasticity of the area of interest and was calculated by tracing the target muscle or tendon. The lower boundary of the strain index refers to the elasticity of the reference area and was calculated by tracing the subcutaneous fat (Bamber et al., 2014). The two boundaries are calculated automatically by the SEG device during the examination. The strain ratio is the ratio of elasticity, which was estimated from the ratio of the higher and lower boundaries of the strain index (Tan et al., 2013; Bamber et al., 2014; Griffith, 2015; Alsiri et al., 2019).
Following the method of Alsiri et al. (2019) the area of interest was selected by tracing an area encoding red pixels within the target muscle/tendon. An adjacent area of subcutaneous fat was selected as a reference. Following the assumption that compressions are uniformly distributed in SEG, as proposed by the European Federation of Societies for Ultrasound in Medicine and Biology (EFSUMB) (Bamber et al., 2014), the two selected areas were selected to be as adjacent and superficial as possible. The size of the traced areas ranged from 0.60 to 1.00 cm2.
The middle fibers of the deltoid muscle were longitudinally scanned with the participant in a sitting position, shoulder in a neutral position, and elbow joint at 900 flexion, with the forearm supinated on the participant's thigh (Backhaus, 2001). The biceps brachii and brachioradialis muscles were longitudinally scanned with the participant in a supine position, the shoulder positioned by the participant's trunk, and the forearm in a supinated position. The biceps brachii was scanned 5 cm above the elbow at the biceps common muscle belly, and the brachioradialis was scanned 5 cm below the elbow (Chen et al., 2017). The rectus femoris was scanned in a supine position, with the knee extended. Longitudinal images were obtained for the rectus femoris muscle 10 cm above the knee joint line. The gastrocnemius medius (longitudinal) and Achilles tendon (transverse) were examined while the participant was in a prone position with the knee extended and the foot hanging over the plinth edge in a relaxed position (De Zordo et al., 2009). The gastrocnemius medius was scanned at 30% of its proximal length, calculated from the midpoint of the popliteal fossa to the midpoint between the ankle malleoli (Kawakami et al., 1998; Chino et al., 2012). The examination position could affect the elasticity of the examined muscles and tendons, so the examination positions were carefully standardized to be as clinically replicable as possible.
To enhance the practicality of the study, the tests were not performed in random order, whereby six structures were examined with only two changes in examination position. Randomization would have increased the need for positional changes, increasing the procedural complexity and potentially compromising the resting elasticity of the examined musculoskeletal structures.
The examination procedure was repeated on the same day by the same examiner to assess intra‐rater reliability, with an interval of 1 hr between test and retest. A designated waiting area was available for the participants to rest between test and retest. Each data collection day was scheduled to examine two or three participants. The 1‐hr interval between the test and retest for each participant allowed the examination of one or two additional participants. This examination schedule offered the advantage of making it difficult for the examiner to remember the earlier results when performing the second examination on a given participant. A longer time interval between the examinations was not practical and repeating the examination on another day might have introduced the risk of changes in the results because of external factors such as the effects of exercises or fatigue. The same researcher conducted the data collection and analysis, but analyses were performed only after all images were acquired. Each structure was examined two to three times to ensure that a high‐quality image was captured, according to the sufficiency of the compression magnitude assessed by the SEG visual quality indicator and the inclusion of subcutaneous fat to serve as a reference. Once a high‐quality image was obtained, this was saved for later analysis. The SEG cycle length consisted of four compressions. To maintain blinding between examinations, each participant was assigned a unique code by the primary investigator, which was used to save the SEG images for later analysis. Images were saved for between 3 weeks and 3 months before analysis was undertaken.
Sonoelastography measures tissue elasticity semiquantitatively, in terms of strain index and strain ratio (Garra, 2007). Color pixels were analyzed using imagej, a Java‐based processor (U.S. National Institute of Health) with a downloaded plugin (color pixel counter) (Figure 2) (Pichette, 2010). imagej is an adaptable image analysis system that can be used for diverse purposes including medical imaging (Schneider et al., 2012). It was used to count the color pixels of each color of the SEG images (Pichette, 2010). As the cross‐sectional area of the examined structures varies between participants, the percentage of the color was calculated using the following formulae used by Richardson et al. (2007):
Figure 2.
Using imagej, the area of interest was cropped, including both the superficial and deep parts, and the surrounding structures were eliminated from the analysis using the ‘clear outside’ option. imagej counted pixels of the red, green, and blue colors. The percentages of each color were calculated to compensate for differences in the cross‐sectional area between participants
Total pixels = red mean pixels + green mean pixels + blue mean pixels
Red pixel percentage = red mean pixels/total pixels * 100
Green pixel percentage = green mean pixels/total pixels * 100
Blue pixel percentage = blue mean pixels/total pixels * 100
2.6. Statistical analysis
Statistical Package for Social Sciences (SPSS 23, IBM Corp.) was used for data analysis. ICC (3.1 type) (two‐way mixed effect model with absolute agreement) was used to assess the repeatability of the measurements (Cicchetti 2015; Koo and Li, 2016). The smallest detectable changes (SDC) were calculated for the strain index, strain ratio, and color pixels (Polit, 2014). The SDC was equal to 1.96 × the standard deviation of the difference between the measurements obtained at trial one and 1 hr later at trial two (Polit, 2014). Upper and lower limits of agreement and the mean difference between trials 1 and 2 were also calculated. The quality of the data was checked and successfully enhanced following good clinical practice and data management guidelines (Broeck et al., 2005). As an additional check to enhance the quality of the data before analysis, all SEG images were screened for the presence of artifacts and insufficient compression as suggested with the quality visual indicator, after which erroneous data were excluded before analysis (Broeck et al., 2005).
3. RESULTS
The demographic characteristics of the 22 participants who were examined by the same rater twice are summarized in Table 1. Images with artifacts were excluded, as well as images with insufficient compression, as determined by the visual quality indicator supplied with the SEG system (Figure 1). Table 1 shows the number of participants examined for each anatomical structure. The exclusions did not cause the study to be underpowered. The areas with the largest number of exclusions were the biceps brachii and brachioradialis muscles but, even for these, the sample size was 15 after the exclusions, which is equal to the essential sample size determined by the sample size calculation (Table 1). Six structures were examined for 22 participants, providing a potential 132 images for final analysis. However, 23.5% of the images (31/132 images) were excluded from seven participants because of ineligible elastograms. Bland and Altman plots of limits of agreement have been presented in this report for brevity. However, it can be confirmed that they did not display any obvious or consistent trends suggestive of bias between repeat examinations.
Table 1.
Demographic characteristics of the examined participants; mean (standard deviation) (n = 22)
Men and women (n = 22) |
Women (n = 18) |
Men (n = 4) |
|
---|---|---|---|
Age (years) | 34.72 (7.00) | 33.38 (6.41) | 40.75 (7.13) |
Height (cm) | 162.63 (7.80) | 160.61 (6.68) | 171.75 (6.13) |
Weight (kg) | 74.72 (15.41) | 70.50 (13.28) | 93.75 (8.50) |
Body mass index | 27.97 (4.27) | 27.26 (4.37) | 31.17 (1.65) |
The intra‐rater reliability of SEG for the lower boundary of the strain index ranged from moderate to excellent (ICCs ranged from 0.734 to 0.950) (Table 2). The reliability for the higher boundary of the strain index ranged from good (ICC 0.852 for the deltoid muscle) to excellent (ICC 0.943 for the brachioradialis muscle) (Table 2). The intra‐rater reliability for the strain ratio ranged from moderate (ICC 0.776 for the rectus femoris muscle) to excellent (ICC 0.921 for the deltoid muscle) (Table 2). The SDC ranged from 0.01 to 0.03 for the lower boundary of the strain index, 0.09 to 0.19 for the higher boundary of the strain index, and 1.80 to 4.93 for the strain ratio (Table 2). Table 2 summarizes the intra‐rater reliability and SDC values for all the examined structures.
Table 2.
Reliability of the sonoelastography strain index and strain ratio for measuring the elasticity of a range of musculoskeletal structures
Elasticity outcome measures |
Deltoid muscle (n = 17) |
Biceps brachii muscle (n = 15) |
Brachioradialis muscle (n = 15) |
Rectus femoris muscle (n = 16) |
Gastrocnemius medius muscle (n = 20) |
Achilles tendon (n = 18) |
|
---|---|---|---|---|---|---|---|
Lower boundary of strain index | Mean (SD) Trial 1 | 0.05 (0.01) | 0.08 (.02) | 0.08 (0.04) | 0.01 (0.03) | 0.07 (0.03) | 0.07 (0.02) |
Mean (SD) Trial 2 | 0.05 (0.00) | 0.07 (0.01) | 0.08 (0.04) | 0.09 (0.03) | 0.07 (0.03) | 0.07 (0.02) | |
ICC | 0.734 | 0.825 | 0.911 | 0.950 | 0.904 | 0.909 | |
95% CI | 0.279–0.903 | 0.496–0.941 | 0.732–0.970 | 0.848–0.983 | 0.756–0.962 | 0.762–0.966 | |
SDC | 0.01 | 0.01 | 0.03 | 0.01 | 0.03 | 0.01 | |
%SDC | 20 | 12.5 | 37.5 | 10 | 42.8 | 14.2 | |
MD | 0.00 (0.01) | 0.002 (0.00) | 0.00 (0.02) | −0.005 (0.01) | 0.00 (0.01) | 0.00 (0.01) | |
Upper, Lower LOA | 0.06, 0.03 | 0.03, −0.02 | 0.52, −0.52 | 0.03, −0.02 | 0.03, −0.03 | 0.03, −0.02 | |
Higher boundary of strain index | Mean (SD) Trial 1 | 0.49 (0.08) | 0.45 (0.08) | 0.64 (0.24) | 0.46 (0.09) | 0.58 (0.19) | 0.49 (0.12) |
Mean (SD) Trial 2 | 0.48 (0.08) | .45 (.11) | .60 (.22) | 0.44 (0.08) | 0.59 (0.18) | 0.47 (0.11) | |
ICC | 0.852 | 0.889 | 0.943 | 0.903 | 0.925 | 0.914 | |
95% CI | 0.600–0.946 | 0.668–0.963 | 0.833–0.981 | 0.724–0.966 | 0.809–0.970 | 0.776–0.968 | |
SDC | 0.11 | 0.11 | 0.19 | 0.09 | 0.19 | 0.11 | |
%SDC | 22.4 | 24.4 | 29.6 | 19.5 | 32.7 | 22.4 | |
MD | 0.01 (0.06) | −0.007 (0.06) | 0.03 (0.10) | 0.03 (0.04) | −0.01 (0.10) | 0.02 (0.06) | |
Upper, Lower LOA | 0.13, −0.10 | 0.11, −0.11 | 0.31, −0.27 | 0.12, −0.08 | 0.19, −0.19 | 0.15, −1.12 | |
Strain ratio a | Mean (SD) Trial 1 | 9.05 (2.03) | 5.62 (1.05) | 8.39 (2.59) | 4.88 (1.14) | 9.60 (4.00) | 6.46 (1.79) |
Mean (SD) Trial 2 | 8.81 (1.84) | 5.71 (1.08) | 8.87 (3.05) | 4.78 (1.26) | 10.25 (4.88) | 6.82 (2.10) | |
ICC | 0.921 | 0.839 | 0.827 | 0.776 | 0.893 | 0.824 | |
95% CI | 0.780–0.972 | 0.510–0.946 | 0.476–0.942 | 0.349–0.922 | 0.731–0.957 | 0.533 −0.934 | |
SDC | 2.72 | 2.17 | 3.84 | 1.90 | 4.93 | 1.80 | |
%SDC | 30.0 | 38.6 | 45.7 | 38.9 | 51.3 | 27.8 | |
MD | 0.24 (1.39) | −0.09 (1.11) | −0.47 (1.96) | −0.09 (0.97) | −0.65 (2.52) | −0.33 (0.92) | |
Upper, Lower LOA | 2.68, −2.67 | 2.08, −2.09 | 4.30, −4.71 | 1.73, −1.94 | 4.88, −5.75 | 2.70, −3.24 |
SDC = 1.96 × SDdiff; SDdiff refers to the standard deviation of the difference between the measurements attained at trial one and 1 hr later at trial two (Polit, 2014).
ICC < 0.5 indicates poor reliability, ICC between 0.5 and 0.75 indicates moderate reliability, ICC between 0.75 and 0.9 indicates good reliability, and ICC > 0.90 indicates excellent reliability (Portney and Watkins, 2008).
The ‘n’ in column one adjacent to each structure shows the number of participants considered for each structure after exclusions due to image artifacts or insufficient compressions.
Abbreviations: ICC, intra‐class correlation coefficient; ICI, confidence interval; LOA, limit of agreement; MD, mean difference; SD, standard deviation, SDC, smallest detectable change.
Strain ratio is the ratio of the area of interest and adjacent subcutaneous fat.
The intra‐rater reliability of the color pixel analysis ranged from moderate to excellent for the three colors (Table 3). For the analysis of red pixels (soft tissues), the ICC ranged from 0.839 to 0.990, indicating good to excellent reliability. The lowest reliability was observed for the biceps brachii muscle and the highest reliability for the Achilles tendon. The ICC for green pixels (intermediate elasticity) ranged from 0.754 to 0.933, indicating moderate to excellent reliability (Table 3). The ICC for green pixels was lowest for the deltoid muscle and highest for the rectus femoris muscle. The blue pixel analysis (hard tissues) showed good to excellent intra‐rater reliability, with ICC values ranging from 0.844 to 0.942 (Table 3). The lowest reliability was observed for the biceps brachii muscle and the highest reliability for the Achilles tendon (Table 3). The SDC values for color pixel analysis ranged from 2.90 to 22.95 (Table 3).
Table 3.
Reliability of sonoelastography for measuring the elasticity of a range of musculoskeletal structures with color pixel analysis
Elasticity outcome measures |
Deltoid muscle (n = 17) |
Biceps brachii muscle (n = 15) |
Brachioradialis muscle (n = 15) |
Rectus femoris muscle (n = 16) |
Gastrocnemius medius muscle (n = 20) |
Achilles tendon (n = 18) |
|
---|---|---|---|---|---|---|---|
Red pixel percentage a | Mean (SD) Trial 1 | 30.31 (7.32) | 26.88 (4.24) | 27.94 (10.64) | 30.91 (7.71) | 30.02 (9.11) | 5.64 (9.53) |
Mean (SD) Trial 2 | 28.35 (7.36) | 28.25 (3.62) | 25.89 (8.99) | 30.01 (8.26) | 28.96 (7.99) | 5.98 (10.01) | |
ICC | 0.916 | 0.839 | 0.963 | 0.912 | 0.0960 | .0990 | |
95% CI | 0.738–0.971 | 0.520–0.946 | 0.856–0.989 | 0.753–0.969 | 0.899–0.984 | 0.974–0.996 | |
SDC | 7.93 | 5.52 | 7.05 | 9.27 | 6.76 | 2.90 | |
%SDC | 26.16 | 20.53 | 25.23 | 29.99 | 22.51 | 51.41 | |
MD | 1.96 (3.78) | –1.36 (2.76) | 2.05 (3.26) | .90 (4.58) | 1.05 (3.29) | –.33 (1.96) | |
Upper, Lower LOA | 9.36, −5.44 | 4.04, −6.76 | 8.43, −4.33 | 9.87, −8.07 | 7.49, −5.39 | 3.51, −4.17 | |
Green pixel percentage a | Mean (SD) Trial 1 | 38.89 (3.72) | 42.97 (3.02) | 43.26 (5.99) | 43.78 (5.44) | 46.71 (3.16) | 38.88 (19.26) |
Mean (SD) Trial 2 | 40.57 (4.55) | 43.26 (2.83) | 41.42 (5.25) | 42.96 (5.02) | 46.50 (4.41) | 40.96 (20.47) | |
ICC | 0.754 | 0.878 | 0.850 | 0.933 | 0.800 | 0.914 | |
95% CI | 0.292–0.914 | 0.639–0.959 | 0.553–0.949 | 0.812–0.976 | 0.488–0.921 | 0.773–0.968 | |
SDC | 7.31 | 3.84 | 7.54 | 5.05 | 6.23 | 22.14 | |
%SDC | 18.32 | 8.93 | 17.42 | 11.53 | 13.33 | 56.94 | |
MD | –1.68 (3.73) | –.28 (1.96) | 1.83 (3.85) | .82 (2.58) | .21 (2.18) | –2.07 (11.30) | |
Upper, Lower LOA | 6.63, −7.98 | 3.55, −4.12 | 9.37, −5.71 | 5.87, −4.23 | 6.44, −6.02 | 20.07, −24.21 | |
Blue pixel percentage a | Mean (SD) Trial 1 | 29.79 (8.44) | 30.13 (5.28) | 28.78 (11.42) | 25.29 (10.33) | 23.26 (7.45) | 55.46 (23.53) |
Mean (SD) Trial 2 | 31.07 (6.85) | 28.48 (4.92) | 32.67 (10.88) | 27.01 (9.95) | 24.54 (7.21) | 53.05 (26.17) | |
ICC | 0.917 | 0.844 | 0.935 | 0.917 | 0.911 | 0.942 | |
95% CI | 0.770–0.971 | 0.540–0.947 | 0.584–0.983 | 0.769–0.971 | 0.780–0.965 | 0.848–0.978 | |
SDC | 8.21 | 6.99 | 8.33 | 10.83 | 8.03 | 22.95 | |
%SDC | 27.55 | 23.19 | 28.94 | 42.82 | 34.52 | 41.38 | |
MD | –1.28 (4.19) | 1.65 (3.57) | –3.88 (4.25) | –1.72 (5.53) | –1.27 (4.10) | 2.41 (11.71) | |
Upper, Lower LOA | 6.93, −9.49 | 8.64, −5.34 | 12.21, −4.45 | 9.11, −12.55 | 6.76, −9.30 | 25.36, −20.54 |
ICC < 0.5 indicates poor reliability, ICC between 0.5 and 0.75 indicates moderate reliability, ICC between 0.75 and 0.9 indicates good reliability, and ICC > 0.90 indicates excellent reliability (Portney and Watkins, 2008).
SDC = 1.96 × SDdiff; SDdiff refers to the standard deviation of the difference between the measurements attained at trial one and 1 hr later at trial two (Polit, 2014).
The ‘n’ in column one adjacent to each structure shows the number of participants considered for each structure after exclusions due to image artifacts or insufficient compressions.
Abbreviations: CI, confidence interval; ICC, intra‐class correlation coefficient; LOA, limit of agreement; MD, mean difference; SD: standard deviation; SDC, smallest detectable change.
The SEG colored images were analyzed with imagej software by counting the pixels of red, green, and blue colors. The percentage of each color pixel was then calculated.
4. DISCUSSION
The intra‐rater reliability of SEG in examining the musculoskeletal system was variable and dependent on the method of analysis and anatomical site. Analysis of the SEG images using the strain index, strain ratio, and color pixel analysis showed moderate to excellent intra‐rater reliability. Higher intra‐rater reliability was identified with color pixel analysis when compared with the strain ratio for all the examined structures. These findings highlight the impact of the image analysis approach on the intra‐rater reliability of SEG. Color pixel analysis can provide more accurate results, as it takes into account the entire area of interest, whereas calculation of strain index and ratio is limited to a selected area within the area of interest. Thus, the subjectivity in selecting the area for use in calculating the strain index and ratio might explain its slightly reduced intra‐rater reliability when compared with that of color pixel analysis. Color pixel quantification could enhance the clinical benefits of SEG for assessing the compression material properties. The smallest detectable changes could be used to determine clinically useful differences, above the level of measurement error, and ranged from 0.09 to 0.19 for the strain index, 1.80 to 4.93 for the strain ratio, 2.90% to 9.27% for the proportion of red pixels, 3.84% to 22.14% for green pixels, and 6.99% to 22.95% for blue pixels.
The current study introduced a semiquantitative analysis approach that considers the entire area of interest by using imagej software. This software counted the pixels of each color (red, green, and blue) in the SEG images, and the percentages of each color could then be calculated to compensate for between‐participant differences in the cross‐sectional areas of structures. The strain index and ratio are quick to determine and clinically accessible, but they might not provide precise quantification for the entire area of interest. Color pixel quantification using easily available software could enhance the clinical benefits of SEG.
The reliability of SEG was examined previously in relation to specific musculotendinous structures, such as the biceps brachii muscle and Achilles tendon. High intra‐rater reliability was shown for SEG examination of the biceps brachii muscle: the ICC ranged from 0.939 to 0.971 using the strain ratio, compared with 0.776 to 0.882 using a tissue hardness meter (Yanagisawa et al., 2011). In the current study, the intra‐rater reliability was relatively similar for examination of the biceps brachii muscle using the strain ratio (0.839 ICCs) and by color pixel analysis (0.839, 0.878, and 0.844 ICCs for the red, green, and blue pixels, respectively). A reference hydrogel material was used by Yanagisawa et al. (2011) to obtain the strain ratio, which could explain their higher intra‐rater reliability when compared with the current study. The current study used subcutaneous fat tissue as a reference to obtain the strain index and strain ratio. High test–retest reliability has been reported previously for Achilles tendon examination; ICCs 0.83–0.95 (Schneebeli et al., 2016), which is consistent with the ICC of 0.824 obtained in the current study.
The current findings suggest that SEG could be more reliable in some structures than in others. The analysis using the strain index showed the lowest intra‐rater reliability (moderate to good) for examining the deltoid and biceps brachii muscles. In contrast, excellent intra‐rater reliability was demonstrated for examining the brachioradialis muscle and the lower limb structures using the strain index. Similarly, the intra‐rater reliability of SEG using color pixel analysis showed the lowest values for the deltoid (green pixel analysis), biceps brachii (red, green, and blue pixel analysis), and brachioradialis (green pixel analysis), but predominantly excellent intra‐rater reliability for the lower limb structures, except for the gastrocnemius medius' green pixel analysis data, which showed good intra‐rater reliability. This could be related to differences in the structure size and morphology. One of the confounding factors in compression SEG is the lack of usable anatomical planes in the examined areas, which might result in slippage of the transducer during the examination, either anteriorly or within the area of interest (Bamber et al., 2014). Moreover, 82% of the participants in the current study were female, and the sizes of the examined structures in their upper limbs were relatively small. Thus, the applied vertical compression might not have been highly reproducible due to the small size of the structures, which might have made it slightly more difficult to apply uniform compressions. However, for the lower limb structures, the calculated reliability was higher. This could be related to the larger size of the examined areas and the presence of more usable anatomical planes, allowing uniformly perpendicular compressions.
Analysis of the red pixels showed the highest reliability (though only marginally), with ICCs ranging from 0.839 to 0.990, followed by the blue pixels (ICCs ranging from 0.844 to 0.942), and then green pixels (ICCs ranging from 0.754 to 0.933). The red colors in the current study indicated soft tissues that could easily be deformed by the compressions applied, which might explain their high reported reliability. The green and blue colors indicated intermediate and hard tissues, which were not so easily deformed. Color pixel analysis for all three colors showed predominantly good to excellent reliability, although the red pixels were the most reliable indicators of tissue elasticity. The highest SDC for colour pixels was 22.95 for the blue pixel percentage of the Achilles tendon.
Intra‐rater reliability studies can identify the capacity of the same rater to provide reproducible and consistent measurements, which is clinically important (Gwet, 2008). The SEG is a highly operator‐dependent system, so it is important to explore the consistency of the same rater for clinical follow‐up purposes. However, future studies should examine other clinimetric properties. The methodology and the findings of the current exploration can form a solid foundation for future studies.
One of the main strengths of the current research is introducing a software which can convert the subjective SEG images into objective numbers, allowing determination of the consistency of this image analysis approach. imagej has been used previously to quantify color‐coded SEG images, where this analysis method has successfully differentiated between normal and pathologic tissues (Elyas et al., 2017; Alsiri et al., 2019). The established smallest detectable changes can be used to identify the smallest amount of change that needs to be observed before determining an actual condition‐related change free from measurement error (Terwee et al., 2009). The established smallest detectable changes can help clinicians interpret results by having a benchmark of the expected measurement error and system variability (Terwee et al., 2009). Clinically, condition‐related differences can be only considered if the changes are larger than the measurement error estimated with the smallest detectable changes, which is also known as the minimal clinically important difference (Terwee et al., 2009). For example, the SDC for red pixel analysis for the Achilles tendon was established as 2.90% in the present investigation. In a separate investigation, we found a difference of 12.54% in the proportion of red pixels between people with hypermobility spectrum disorders and healthy controls, a difference that is much higher than might be expected through measurement errors (Alsiri et al., 2019). Future studies should examine the capacity of SEG to distinguish between health and other pathological tissues.
All the structures examined in the current exploration were superficial. Thus, caution should be exercised when examining deeper musculoskeletal structures, for which the reliability of SEG has not yet been examined. Presenting the higher and lower boundary of the strain index together with the strain ratio could provide more comprehensive information on tissue elasticity in cases of discrepancies in the force being absorbed by the subcutaneous fat and the area of interest. Additionally, force malabsorption by the examined areas can be detected as artifacts in the SEG images; therefore, artifacts in SEG images should be carefully excluded before analyzing them. SEG is a highly operator‐dependent device, and the use of very low or high compression can substantially change the results (Wu et al., 2012). This issue was minimized by using an on‐screen visual quality indicator. Increasing the compression magnitude changed the indicator from red (indicating insufficient compression) to green (indicating sufficient compression) but the indicator does not warn if excessive compression is applied. A numerical indicator might solve this issue. The established smallest detectable changes reflect the marginal error for examining normal musculoskeletal structures, which could be employed for clinical scenarios such as examination of pathological structures. However, future studies on pathological structures will be more clinically applicable. Inter‐rater reliability studies are recommended for future research.
The current study has several limitations. First, the participants were recruited from a government hospital, and their body mass indexes showed that, on average, they were overweight to obese. This factor might have produced the artifacts observed in some images, resulting in an inability to obtain eligible elastograms and consequent exclusion from analysis. In overweight/obese patients with thick subcutaneous fat layers, the probe compression force could have been absorbed mainly by the subcutaneous fat before reaching the area of interest, putting the reliability of SEG at risk. Data for between two (for the gastrocnemius medius muscle) and seven (for the biceps brachii and brachioradialis muscles) of the 22 participants were excluded for each musculoskeletal structure due to image artifacts and suboptimal elastograms. This could be controlled for in future research by adding body mass index to the inclusion or exclusion criteria. However, this approach could jeopardize the generalizability of the results. Second, the sitting position for examining the deltoid muscle might not be the optimal position to stabilize the participant for the examination, as there was movement in some cases. It is recommended to use a side‐lying position for deltoid muscle examination.
5. CONCLUSION
In conclusion, the current study indicates moderate to excellent intra‐rater reliability of SEG for examining a range of musculoskeletal structures, dependent on the image analysis approach and anatomical structures. Color pixel analysis is a more precise and reliable analysis method for SEG color‐coded images when compared with the strain ratio and strain index. Strain ratio and index can be extracted more quickly in real‐time but color pixel analysis considers the entire area of interest, and the additional 2–3 min taken may enhance the objectivity of SEG in musculoskeletal practice. The observed smallest detectable changes could be used to identify clinically important differences. Future studies are needed to establish the other clinimetric properties of SEG.
CONFLICT OF INTEREST
The authors declare no conflict of interest.
AUTHOR CONTRIBUTIONS
Dr. Najla Alsiri: contributions to concept/design, acquisition of data, data analysis/interpretation, drafting of the manuscript, critical revision of the manuscript and approval of the article. Prof. Saud Al‐Obaidi: contributions to concept/design, critical revision of the manuscript and approval of the article. Dr. Akram Asbeutah: contributions to concept/design, acquisition of data, data analysis/interpretation, and approval of the article. Prof. Shea Palmer: contributions to concept/design, data analysis/interpretation, drafting of the manuscript, critical revision of the manuscript and approval of the article.
Alsiri N, Al‐Obaidi S, Asbeutah A, Palmer S. Intra‐rater reliability and smallest detectable change of compression sonoelastography in quantifying the material properties of the musculoskeletal system. J. Anat.. 2020;237:74–84. 10.1111/joa.13183
DATA AVAILABILITY STATEMENT
Data available on request from the authors.
REFERENCES
- Alsiri, N. (2017) The impact of joint hypermobility syndrome in adults: a quantitative exploration of neuromuscular impairments, activity limitations and participation restrictions. Bristol: University of the West of England; https://eprints.uwe.ac.uk/secure/30112/ [Google Scholar]
- Alsiri, N. , Al‐Obaidi, S. , Asbeutah, A. , Almandeel, M. and Palmer, S. (2019) The impact of Hypermobility Spectrum Disorders on musculoskeletal tissue stiffness: an exploration using the strain elastography. Clinical Rheumatology, 38(1), 85–95. [DOI] [PubMed] [Google Scholar]
- Arya, S. and Kulig, K. (2010) Tendinopathy alters mechanical and material properties of the Achilles tendon. Journal of Applied Physiology, 108, 670–675. [DOI] [PubMed] [Google Scholar]
- Backhaus, M. (2001) Guidelines for musculoskeletal ultrasound in rheumatology. Annals of the Rheumatic Diseases, 60, 641–649. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bamber, J. , Cosgrove, D. and Dietrich, C. (2014) EFSUMB guidelines and recommendations on the clinical use of ultrasound elastography. Part 1: basic principles and technology. Ultraschall Medicine, 34, 169–184. [DOI] [PubMed] [Google Scholar]
- Bojsen‐Moller, J. , Magnusson, S. , Rasmussen, L. , Kjaer, M. and Aahaard, P. (2005) Muscle performance during maximal isometric and dynamic contractions is influenced by the stiffness of the tendinous structures. Journal of Applied Physiology, 99, 986–994. [DOI] [PubMed] [Google Scholar]
- Chard, M.D. , Cawston, T.E. , Riley, G.P. , Gresham, G.A. and Hazleman, B.L. (1994) Rotator cuff degeneration and lateral epicondylitis: a comparison histological study. Annals of the Rheumatic Diseases, 53, 30–34. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen, J. , O'Dell, M. , He, W. , Du, L. , Li, P. and Gao, J. (2017) Ultrasound shear wave elastography in the assessment of passive biceps brachii muscle stiffness: influence of sex and elbow position. Clinical Imaging, 45, 26–29. [DOI] [PubMed] [Google Scholar]
- Chino, K. , Akagi, R. , Dohi, M. , Fukashiro, S. and Takahashi, H. (2012) Reliability and validity of quantifying absolute muscle hardness using ultrasound elastography. PLOS One, 7(9), e45764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cho, N. , Moon, W.K. , Kim, H.Y. , Chang, J.M. , Park, S.H. and Lyou, C.Y. (2010) Sonoelastographic strain index for differentiation of benign and malignant nonpalpable breast masses. Journal of Ultrasound in Medicine, 29(1), 1–7. [DOI] [PubMed] [Google Scholar]
- Cicchetti, D.V. (2015) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment., 6(4), 284–290. [Google Scholar]
- De Zordo, T. , Fink, C. , Feuchtner, G. , Smekal, V. , Reindl, M. and Klauser, A. (2009) Real‐time sonoelastography findings in healthy Achilles tendon. American Journal of Roentgenology, 193(2), W134–W138. [DOI] [PubMed] [Google Scholar]
- De Zordo, T. , Chhem, R. , Smekal, V. , Feuchtner, G. , Reindl, M. , Fink, C. , Faschingbauer, R. , Jaschke, W. and Klauser, A. (2010) Real‐time sonoelastography: findings in patients with symptomatic Achilles tendon and comparison to healthy volunteers. Ultraschall in der Medizin, 31, 394–400. [DOI] [PubMed] [Google Scholar]
- Drakonaki, E. , Allen, G. and Wilson, D. (2009) Real‐time sonoelastography findings in healthy Achilles tendon: reproducibility and pattern description. Clinical Radiology, 64, 1196–1202. [DOI] [PubMed] [Google Scholar]
- Elyas, E. , Papaevangelou, E. , Alles, E.J. , Erler, J.T. , Cox, T.R. , Robinson, S.P. and Bamber, J.C. (2017) Correlation of ultrasound shear wave elastography with pathological analysis in a xenografic [sic] tumour model. Scientific Reports, 7(1), 165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garra, B. (2007) Imaging and estimation of tissue elasticity by ultrasound. Ultrasound Quarterly, 23, 255–268. [DOI] [PubMed] [Google Scholar]
- Griffith, J. (2015) Diagnostic Ultrasound: Musculoskeletal. Philadelphia: Elsevier. [Google Scholar]
- Gwet, K. (2008) Intrarater reliability Wiley Encyclopedia of Clinical Trials. Hoboken, NewJersey, UnitedStates: John Wiley and Sons Inc. [Google Scholar]
- Hakim, A. and Grahame, R. (2003) Joint hypermobility. Best Practice and Research Clinical Rheumatology, 17(6), 989–1004. [DOI] [PubMed] [Google Scholar]
- Hoyt, K. , Kneezel, T. , Castaneda, B. and Parker, K. (2008) Quantitative sonoelastography for the in vivo assessment of skeletal muscle viscoelasticity. Physics in Medicine and Biology, 53(15), 4063–4080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kawakami, Y. , Ichinose, Y. and Fukunaga, T. (1998) Architectural and functional features of human triceps surae muscle during contraction. Journal of Applied Physiology, 85, 398–404. [DOI] [PubMed] [Google Scholar]
- Klauser, A. , Miyamoto, H. , Bellmann‐Weiler, R. , Feuchtner, G. , Wick, M. and Jaschke, W. (2014) Sonoelastography: musculoskeletal applications. Radiology, 272(3), 622–633. [DOI] [PubMed] [Google Scholar]
- Koo, T. and Li, M. (2016) A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kottner, J. , Audige, L. , Brorson, S. , Donner, A. , Gajeweski, B. , Hrobjartsson, A. , Roberts, C. , Shoukri, M. and Streiner, D.L. (2011) Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Journal of Clinical Epidemiology, 64(1), 96–106. [DOI] [PubMed] [Google Scholar]
- Mokkink, L. , Terwee, C. , Patrick, D. , Alonso, J. , Stratford, P. , Knol, D.L. , Bouter, L.M. and de Vet, H.C.W. (2010) The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Quality of Life Research, 19(4), 539–549. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pichette, B. (2010). Color pixel counter. ImageJ Documentation Wiki. [online]. [Accessed 1 July 2016]. [Google Scholar]
- Polit, D. (2014) Getting serious about test‐retest reliability: a critique of retest research and some recommendations. Quality of Life Research, 23, 1713–1720. [DOI] [PubMed] [Google Scholar]
- Portney, L. and Watkins, M. (2008) Foundations of clinical research: Applications to practice, 2nd edition. Upper Saddle River: Prentice Hall. [Google Scholar]
- Rabita, G. , Couturier, A. and Lambertz, D. (2008) Influence of training background on the relationships between plantarflexor intrinsic stiffness and overall musculoskeletal stiffness during hipping. European Journal of Applied Physiology, 103, 163–171. [DOI] [PubMed] [Google Scholar]
- Regini, E. , Bagnera, S. , Tota, D. , Campanino, P. , Luparia, A. , Barisone, F. , Durando, M. , Mariscotti, G. and Gandini, G. (2010) Role of sonoelastography in characterising breast nodules. Preliminary experience with 120 lesions. La Radiologia Medica, 115(4), 551–562. [DOI] [PubMed] [Google Scholar]
- Richardson, A. , Jenkins, J. , Braswell, B. , Hollinger, D. , Ollinger, S. and Smith, M. (2007) Use of digital webcam images to track spring green‐up in a deciduous broadlead forest. Ecosystem Ecology, 152(2), 323–334. [DOI] [PubMed] [Google Scholar]
- Rombaut, L. , Malfait, F. , De Wandele, I. , Mahieu, N. , Thijs, Y. , Segers, P. , De Paepe, A. and Calders, P. (2012) Muscle‐tendon tissue properties in the hypermobility type Ehlers‐Danlos syndrome. Arthritis Care and Research, 64(5), 766–772. [DOI] [PubMed] [Google Scholar]
- Schneebeli, A. , Del Grande, F. , Vincenzo, G. , Cescon, C. , Clijsen, R. , Biordi, F. and Barbero, M. (2016) Real‐time sonoelastography using an external reference material: test‐retest reliability of healthy Achilles tendons. Skeletal Radiology, 45(8), 1045–1052. [DOI] [PubMed] [Google Scholar]
- Schneider, C. , Rasband, W. and Eliceiri, K. (2012) NIH Image to ImageJ: 25 years of image analysis. Nature Methods, 9(7), 671–675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sconfienza, L. , Silvestri, E. , Bartolini, B. , Garlaschi, G. and Cimmino, M. (2010) Sonoelastography may help in differential diagnosis between rheumatoid nodules and tophi. Clinical and Experimental Rheumatology, 28, 144–145. [PubMed] [Google Scholar]
- Simmonds, J. and Keer, R. (2007) Hypermobility and the hypermobility syndrome. Manual Therapy, 12, 298–309. [DOI] [PubMed] [Google Scholar]
- Tan, S. , Ozcan, M. , Tezcan, F. , Balci, S. , Karaoglanoglue, M. , Huddam, B. and Arslan, H. (2013) Real time elastography for distinguishing angiomyolipoma from renal cell carcinoma: preliminary observations. American Journal of Roentgenology, 200, 369–375. [DOI] [PubMed] [Google Scholar]
- Tatsumi, C. , Kudo, M. , Ueshima, K. , Kitai, S. , Takahashi, S. , Inoue, T. , Minami, Y. , Chung, H. , Maekawa, K. , Fujimoto, K. , Akiko, T. and Takeshi, M. (2008) Noninvasive evaluation of hepatic fibrosis using serum fibrotic markers, transient elastography (FibroScan) and real‐time tissue elastography. Intervirology, 51(suppl), 1. [DOI] [PubMed] [Google Scholar]
- Terwee, C. , Roorda, L. , Knol, D. , De Boer, M. and de Vet, H. (2009) Linking measurement error to minimal important change of patient‐reported outcomes. Journal of Clinical Epidemiology, 62, 1062–1067. 10.1016/j.jclinepi.2008.10.011. [DOI] [PubMed] [Google Scholar]
- Turan, A. , Tufan, A. , Mercan, R. , Teber, M. , Bitik, B. , Goker, B. and Haznedaroğlu, S. (2013) Real‐time sonoelastography of Achilles tendon in patients with ankylosing spondylitis. Skeletal Radiology, 42(8), 1113–1118. [DOI] [PubMed] [Google Scholar]
- Van den Broeck, J. , Cunningham, S. , Eeckels, R. and Herbst, K. (2005) Data cleaning: detecting, diagnosing, and editing data abnormalities. PLoS Medicine, 2(10), e267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walter, S. , Eliasziw, M. and Donner, A. (1998) Sample size and optimal designs for reliability studies. Statistics in Medicine, 17(1), 101–110. [DOI] [PubMed] [Google Scholar]
- Wu, C. , Chang, K. , Mio, S. , Chen, W.‐S. and Wang, T.‐G. (2011) Sonoelastography of the plantar fascia. Radiology, 259, 502–507. [DOI] [PubMed] [Google Scholar]
- Wu, C. , Chen, W. , Park, G. , Wang, T. and Lew, H. (2012) Musculoskeletal sonoelastography: A focused review of its diagnostic applications for evaluating tendons and fascia. Journal of Medical Ultrasound, 20, 79–86. [Google Scholar]
- Yanagisawa, O. , Niitsu, M. , Kurihara, T. and Fukubayashi, T. (2011) Evaluation of human muscle hardness after dynamic exercise with ultrasound real‐time tissue elastography: A feasibility study. Clinical Radiology, 66(9), 815–819. [DOI] [PubMed] [Google Scholar]
- Yeh, W. , Li, P. , Jeng, Y. , Hsu, H.‐C. , Kuo, P.‐L. , Li, M.‐L. , Yang, P.‐M. and Lee, P.H. (2002) Elastic modulus measurements of human liver and correlation with pathology. Ultrasound in Medicine and Biology, 28(4), 467–474. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data available on request from the authors.