Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2014 Feb 12;9(2):e88699. doi: 10.1371/journal.pone.0088699

Accuracy of Visual Scoring and Semi-Quantification of Ultrasound Strain Elastography – A Phantom Study

Jonathan Frederik Carlsen 1,*, Caroline Ewertsen 1, Adrian Săftoiu 2,3, Lars Lönn 1,4, Michael Bachmann Nielsen 1
Editor: Miklos S Kellermayer5
PMCID: PMC3922970  PMID: 24533138

Abstract

Purpose

The aim of this study was to evaluate the performance of strain elastography in an elasticity phantom and to assess which factors influenced visual scoring, strain histograms and strain ratios. Furthermore this study aimed to evaluate the effect of observer experience on visual scorings.

Materials and Methods

Two operators examined 20 targets of various stiffness and size (16.7 to 2.5 mm) in an elasticity phantom at a depth of 3.5 cm with a 5–18 MHz transducer. Two pre-settings were used yielding 80 scans. Eight evaluators, four experienced, four inexperienced, performed visual scorings. Cut-offs for semi-quantitative methods were established for prediction of target stiffness. Data was pooled in two categories allowing calculations of sensitivity and specificity. Statistical tests chi-square test and linear regression as relevant.

Results

Strain ratios and strain histograms were superior to visual scorings of both experienced and inexperienced observers (p = 0.025, strain histograms vs. experienced observers, p<0.001, strain histograms vs. inexperienced observers, p = 0.044 strain ratios vs. experienced observers and p = 0.002 strain ratios vs. inexperienced observers). No significant difference in predicting target stiffness between strain ratios and strain histograms (p = 0.83) nor between experienced and inexperienced observers (p = 0.054) was shown when using four categories. When pooling data in two groups (80 kPa/45 kPa vs. 14/8 kPa) the difference between the observers became significant (p<0.001). Target size had a significant influence on strain ratios measurements (p = 0.017) and on visual scorings (p<0.001) but not on the strain histograms(p = 0.358). Observer experience had significant effect on visual scorings(p = 0.003).

Conclusion

Strain ratios and strain histograms are superior to visual scoring in assessing target stiffness in a phantom. Target size had a significant impact on strain ratios and visual scoring, but not on strain histograms. Experience influenced visual scorings but the difference between experienced and inexperienced observers was only significant when looking at two classes of target stiffness.

Introduction

The principle of strain imaging was first reported in 1991 by Ophir and coworkers [1]. Strain elastography (SE) is one of several ultrasonography (US) based imaging modalities that estimate tissue stiffness [1][3]. SE has been suggested as a tool for predicting malignancy in focal lesions. Malignant lesions are in general stiffer than benign lesions, a feature well known from manual palpation of superficial tumors [4]. SE-measurements are not directly quantifiable, thus several qualitative and semi-quantitative methods have been proposed and investigated in clinical trials.

Strain is inversely proportional to lesion stiffness. In SE the calculated strain is color coded by the software and displayed as a transparent overlay on the gray scale ultrasonography images. Itoh et al. proposed a five point scoring system for evaluation of malignancy in breast tumors by assessing lesion color [5]. This qualitative scoring system and other similar visual scoring systems have been applied in studies on breast cancer diagnosis [6][8] as well as in lymph-node diagnosis [9], [10], thyroid nodule diagnosis [11], [12], and in the diagnosis of non-nodal neck masses [13]. Interobserver agreement of visual scoring has been investigated in different clinical fields and in a single phantom study [9], [11], [14], [15]. The interobserver agreements reported in these studies varied from average to very good. A method of semi-quantification applied in SE is the calculation of strain-ratios [3], [16]. Strain-ratios are calculated using two regions of interest (ROIs), one in the lesion and one in the surrounding tissue. Hard lesions have high strain-ratios (>1) and soft lesions have low strain-ratios (<1). Strain-ratios have been used in different applications such as, breast cancer diagnosis [17], [18], pancreatic mass evaluation [19], classification of liver fibrosis [20], and for the prediction of optimal biopsy targets in prostate cancer diagnosis [21]. Another method of SE semi-quantification, recently proposed by Săftoiu et al. [22], is hue-histogram analysis [3]. The hue-histogram or strain-histogram is an orderly depiction of the quantity of the 256 colors in the elastogram. Mean pixel color value corresponds to the overall stiffness of the lesion. Strain-histogram analysis has previously been evaluated in the diagnosis of pancreatic masses [23], steato-fibrosis [24], breast cancer [25], and enlarged gastrointestinal lymph nodes [22], [26].

The primary aim of this study was to evaluate the ability of visual scoring, strain-ratios and strain-histograms to predict the stiffness of cylinders of known stiffness in a commercially available elasticity tissue-mimicking phantom. Furthermore, the aim was to assess which factors influenced the results of the methods of SE-evaluation including the impact of evaluator experience for the visual scorings.

Materials and Methods

Phantom

We used an elasticity phantom (Elasticity QA, model 049A, CIRS (CIRS, Virginia, USA))(Figure 1a), which consisted of eight cylinders enclosed in a surrounding medium (Figure 1b). Both cylinders and surrounding medium were made from Zerdine®, a transparent polyacrylamide polymer (US. pat. 5.196.343, 1993). The cylinders were placed in two layers. We used only the superficial layer, with the center of the cylinders at 3.5 cms depth. Each cylinder had one of four different levels stiffness ranging from soft to hard (8, 14, 45 and 80 kPa). The background material had a stiffness of 25 kPa. The speed of sound was 1540 m/s and the attenuation was 0.5 dB/cm-MHz, the phantom characteristics thus being comparable to breast tissue [27]. The diameter of each cylinder decreased stepwise along the axis of the cylinder. We used the five largest diameters (16.7, 10.4, 6.5, 4.1 and 2.5 mm) of the phantom, as smaller diameters were impossible to discern in either B-mode or SE. This added up to 20 targets evaluated in this study.

Figure 1. The Elasticity Phantom.

Figure 1

1a. The study setup with the phantom and US transducer. (Elasticity QA, model 049A, CIRS (CIRS, Virginia, USA)). 1b. Schematic representation of the elasticity phantom used. (Elasticity QA, model 049A, CIRS (CIRS, Virginia, USA))

Ultrasonography

Two physicians (JFC, MBN) independently recorded all elastography examinations independently with a Hitachi Ascendus system (Hitachi, Tokyo, Japan) using an L75-probe with a bandwidth of 5-18 MHz. Scans were performed perpendicular to the phantom cylinder axes, and the transducer was coupled to the surface by ultrasound gel. Video clips of five seconds were stored for later analysis. All images were labeled with pre-assigned letter codes to facilitate the blinded operator evaluation. Two different elastography pre-settings, 1 and 2, which varied in their color distribution on the elastogram, were used. The differences in elastography parameters between the two settings can be seen in table 1. A manual compression rate of 100/minute was achieved by using a digital metronome. The compression quality was monitored by a strain-monitor on the scanner. Lesions covered a range of 25% to 50% of the elastography box except in the two smallest targets where this was impossible, thus the box was sized as small as possible. Absolute measures of the boxes were not recorded. The two physicians scanned all targets with one pre-setting at a time.

Table 1. An Overview of the Differences in Elasticity Parameters Between Pre-setting 1 and 2.

Pameter range Presetting 1* Presetting 2# Explanation of parameter
Elasticity Dynamic Range (eDR) 1–8 1 4 Changes the dynamic range of elastography images. Low levels yield a high-contrast image, with mainly red/blue colouring. Increasing eDR increases the number of intermediate colours displayed.
Frame rejection (FRe) 0–7 1 5 This function signifies at which signal-to-noise ratio, the whole frame is rejected. Higher levels of FRe signify more rejected frames.
Noise rejection (NRe) 0–7 1 3 This function signifies at which signal-to-noise ratio, an area within the frame is rejected. Higher levels of NRe signify more rejected frames.
Frame Rate (FR) Min, low, med, high, max High Low FR signifies how often data is collected for cross correlation between frames.
Persistence (Pe) 0–7 7 3 With increasing Pe the temporal resolution decreases, yielding a more constant elastogram with less changes from frame to frame.
Smoothing (Sm) 1–4 3 2 Sm averages pixel colours within the frame creating. By increasing Sm each pixel colour is more dependent on the neighbouring pixel colour.

Only the parameters that differ between the two settings are included in the table.*Derived from Havre et al. [15] # Breast presetting, predefined in the Hitachi RTE-software.

Evaluation of the elastograms

Evaluation of the elastograms was done by one qualitative and two semi-quantitative methods: visual scoring, strain-ratio measurements and strain-histogram analysis. The visual scoring was done by eight observers independently. Four of the observers (JFC, CE, AS, MBN) had earlier experience with SE, while the remaining four (LL, MT, RRW, CAL), had no prior experience with elastography. The phantom used consisted of cylinders of four different elasticities, therefor a four point scale was used for the analysis. Prior to the evaluation, the observers were shown images of the four levels of target stiffness for each of the two pre-settings analyzed (Figure 2). The evaluations were done blinded and the videos were shown in random order. Still frames were recorded for strain-ratio measurements. The region of interest (ROI) covered the entire lesion and the reference ROI was equally sized and placed in the same depth, according to previous work by Havre et al. [28] (Figure 3). Strain-ratios were calculated as average strain of the surrounding medium divided by the average strain of the target. For each lesion three strain-ratio measurements were performed concurrently with the scanning, as it could not be done off-line, and the mean was calculated. Strain-histograms were performed off-line on uncompressed video files using the free software ImageJ (downloaded at nih.gov) with a plug-in for hue-histogram analysis [29]. For strain histogram analysis ROIs were placed covering the entire target, blinded to the stiffness of the object (Figure 4). ROIs were placed guided by the elastogram and/or the B-mode image. After a ROI was placed, the hue-histogram analysis was performed on the entire video clip. Mean pixel color values were calculated for each frame and afterwards averaged for the entire video clip. One observer performed all calculations. Strain-ratio and strain-histogram analysis yielded continuous numerical data. To transform this into categorical data, optimal cut-offs between the different target stiffness were chosen after data acquisition. For the strain-histograms the cut-offs were changed stepwise with intervals of five units until the highest number of lesions in each group was correctly assessed. For the strain-ratios the intervals were 0.05 units. In a sub-analysis target stiffness was classified as either hard or soft (80 kPa/45 kPa vs. 14 kPa/8 kPa). This was done for comparability with a clinical setting where malignant lesions should be discerned from benign lesions.

Figure 2. Elastograms of Different Phantom Targets.

Figure 2

Elastograms of four different levels of target stiffness with pre-setting 1 and pre-setting 2 in the phantom. The targets are 16.7 mm in diameter. These elastograms were used as teaching examples for the two observers prior to the visual scoring.

Figure 3. Example of Strain-Ratio Measurement.

Figure 3

Placing of ROI A and B for calculation of strain ratios. The target displayed (ROI A) is a 16.7 mm diameter semi hard target assessed using pre-setting 2. Reference ROI (ROI B) is placed in the surrounding medium.

Figure 4. Example of Strain-Histogram Analysis.

Figure 4

Strain histogram of a 10.4 mm diameter semi hard target assessed using pre-setting 1, showing (a) the placing of the ROI on the elastogram and (b) the average strain histogram of all frames in the video recorded for the selected target. The x-axis shows the color scale of the elastogram, the y-axis shows the average number of pixels of each color in the elastogram-video.

Statistics

The statistical software SPSS version 20 (SPSS, IBM, Chicago, USA) was used for statistical analysis. For the data pooled in two categories, sensitivities and specificities for each method were calculated.

The difference between the methods regarding the number of correctly assessed lesions was calculated using a Chi square test. Linear regression was performed to analyze the impact of the setting, the operator performing the exmination, the size, and the stiffness for each of the three different methods. Backwards elimination of parameters was used until only significant parameters were left in the model. For the visual scorings experience of the observers was also included as an independent variable in the model. Observers were coded as either experienced or inexperienced. The significance level was set at 0.05.

Results

The optimal cut-offs between the four levels of target stiffness for both strain-ratios and strain-histograms are presented in Table 2. Box plots of the mean pixel values for strain-histograms and mean strain-ratios are displayed in Figure 5.

Table 2. A table of the cut-off values for the four levels of target stiffness.

Cut-offs between classes Strain-histograms * (Presetting 1) Strain-histograms * (Presetting 2) Strain-ratios # (Presetting 1) Strain-ratios # (Presetting 2)
1 and 2 55 95 0.55 0.55
2 and 3 125 120 0.75 0.85
3 and 4 165 145 1.20 1.30

* Strain histograms have mean pixel values ranging from 0 to 255. # Strain ratios range from 0 to ∞.

Figure 5. Boxplots of Mean Pixel Values and Mean Strain-Ratios.

Figure 5

Box plots of the mean pixel values, unit less (y-axis) of strain-histograms with pre-setting 1 (A) and 2 (B) and mean strain ratios, unit less (y-axis) for pre-setting 1 (C) and 2 (D) for different levels of target stiffness (x-axis). Lower and upper box levels are lower and upper quartiles respectively. The horizontal line within the box marks the median. Whiskers indicate the range.

The percentage of correctly assessed targets with visual scoring, strain-ratios, and strain-histograms is displayed in Figure 6. Figure 6b shows the number of correctly assessed targets when target diameter is larger or smaller than 5 mm respectively. When comparing evaluation of target stiffness with four classes visual score varied significantly from both strain-ratios (p = 0.044 for the experienced observers p = 0.002 for the inexperienced observers) and strain-histograms (p = 0.025 for the experienced observers, p<0.001 for the inexperienced observers) using a Chi-square test. No significant difference was shown when comparing strain-ratios and strain-histograms (p = 0.83) or when comparing the experienced and the inexperienced observers (p = 0.54).

Figure 6. Percentages of Correctly Assessed Targets for Each Method Used.

Figure 6

6a. Percentages of correctly assessed targets of all diameters. For strain ratios and strain histograms 80 evaluations were performed. For visual scorings 640 observations were performed, 320 by experienced observers, 320 by inexperienced observers respectively. # The bars show mean percentage of correctly assessed targets for each level of target stiffness, with each method of evaluation. * Bars show the mean percentage of correctly assessed targets for all levels of target stiffness for each method of evaluation used. 6b. Percentages of correctly assessed small and large targets for each method. For strain ratios and strain histograms 80 evaluations were performed. For visual scorings 640 observations were performed, 320 by experienced observers, 320 by inexperienced observers respectively. ** Bars show the mean percentage of correctly assessed targets for the three largest diameters diameters (6.5, 10.4 and 16.7 mm). ## Bars show the mean percentage of correctly assessed targets for the two smallest diameters (2.5 and 4.1 mm).

Table 3 reports the sensitivities and specificities of the three methods when using a binary scale (80 kPa/45 kPa vs. 14 kPa/8 kPa, equaling hard and soft). When data was pooled in these two categories, the difference in number of correctly assessed targets between experienced observers and strain ratios and experienced observers and strain histograms were insignificant (p = 0.053 for both) when doing a Chi-square test. The difference between visual scorings by inexperienced observers and strain ratios, and visual scorings by inexperienced observers and strain histograms was significant (p<0.001 for both). The difference between strain ratios and strain histograms was insignificant (p = 1.000), while there was significant difference between experienced and inexperienced observers (p<0.001) using a Chi-square test.

Table 3. Percentages of correctly assessed targets.

Visual scoring Visual scoring Strain-histograms Strain-ratios Total number of targets evaluated
Experienced observers (average values) § Inexperienced observers (average values) §
80 and 45 kPa (Sensitivities) 38.0 (92.5%) 33.5 (83.8%) 40 (100%) 40 (100%) 40 (100%)
14 and 8 kPa (Specificities) 36.5 (85.0%) 32.0 (80.0%) 39 (97.5%) 39 (97.5%) 40 (100%)
All four elasticities (Accuracies) 74.5 (93.1%) 65.5 (81.9%) 79 (98.8%) 79 (98.8%) 80 (100%)
Two smallest lesions* (All four elasticities) 30.3 (93.0%) 68.8 (71.9%) 31 (96.9%) 31 (96.9%) 32 (100%)
Three largest lesions# (All four elasticities) 44.8 (93.3%) 43.5 (90.6%) 48 (100.0%) 48 (100.0%) 48 (100%)

Numbers of correctly assessed targets when using two classes, 80 kPa/45 kPa vs. 14 kPa/8 kPa and corresponding sensitivities and specificities for each method.

*Diameters of 2.5 and 4.1 mm. # Diameters of 6.5, 10.4, and 16.7 mm. § There were four observers in each group yielding 320 evaluations in all for both experienced and inexperienced obsverers. Numbers listed are the average of the four observers in each group.

Linear regression showed that the presetting and the operator performing the elastography examination had no significant effect on any of the methods evaluated. For strain-histograms only the actual stiffness of the lesion influenced the evaluation (p<0.001). For strain-ratios both the size and stiffness of the target had an influence (p = 0.017 and p<0.001 respectively), as strain-ratios diminished significantly with increasing target diameter For visual scorings size, experience of the evaluator and stiffness had an influence (p<0.001, p = 0.003 and p<0.001 respectively). The inexperienced observers tended to assess the targets as harder than the experienced, while large targets tended to yield harder scorings than small targets.

Discussion

Our study is the first to report the ability of SE to predict target stiffness in an elasticity phantom. To our knowledge, no previous studies comparing the diagnostic performance of visual scoring with both strain-ratios and strain-histograms have been performed. We showed that strain ratios and histograms are superior to visual scoring in assessing target strain when using four categories of target stiffness. When assessing strain on a binary scale the difference between experienced observers and the semi quantitative methods was not significant.

In a meta-analysis of diagnostic accuracy of elastography in breast cancer diagnosis, strain-ratio analysis was inferior to visual scoring [30]. Our analysis showed that strain-ratios had a higher sensitivity and specificity than visual scoring in a phantom. In vivo, the tissues surrounding focal lesions are often quite heterogeneous. The positioning of the reference ROI, for the strain-ratio calculation, may therefore have a large influence on the assessment of stiffness. In our phantom, the surrounding medium was homogenous. This difference may be the reason why we find a better prediction of target stiffness for strain-ratio measurements than for visual scoring. The color scale in strain-histogram analysis is defined by the average strain in the elastography-box and not by a reference ROI. Strain-histograms may therefore provide a better diagnostic tool in inhomogeneous tissues. A meta-analysis of endoscopic SE of focal pancreatic masses showed higher diagnostic accuracy for semi-quantitative assessments (both strain-ratios and strain-histograms) than for visual scoring [31]. This corresponds well with our findings. In endoscopic US transducers and pre-settings differ however from the ones used in the present study which makes direct comparisons difficult.

As the cylinders in the phantom used in the present study had four different levels of stiffness, we applied a four point visual scale for visual scorings. A similar scale using five points has previously been proposed by Itoh et al. [5] and has been widely applied in clinical practice[8].

When the dichotomous stiffness scale was used, we found a significant difference in the sensitivity and specificity of experienced and inexperienced observers doing visual scorings. When using a four point scale, there was no significant difference. This finding may explain some of the variation between different observers reported in previous studies [9], [11], [14], [15]. To our knowledge no studies have investigated the effect of experience on visual scoring in SE previously.

Our phantom study has illustrated the impact of several parameters on three different methods of evaluation of strain elastography. These parameters must be taken into account, when performing elastography in a clinical setting.

In a study by Havre et al. the influence of different scan parameters on the elastogram quality was evaluated when using a visual scale on a phantom [15]. They concluded that a pre-setting corresponding to our pre-setting no. 1 was optimal in a phantom. We found no significant influence from the pre-settings on the prediction of target stiffness. Thus, in a phantom, the perceived visual quality may change to a certain degree without altering the prediction of target strain. Pre-setting no. 1, with a low elasticity dynamic range, correlates well with the phantom used because tissues are depicted as either hard (blue) or soft (red). Pre-setting no. 2, with higher elasticity dynamic range, may better depict the variance of stiffness within in-vivo tissue. No studies on the influence of elastography pre-setting on diagnostic performance have been published previously.

We were unable to visualize any of the four cylinders at their smallest diameters (1.6 mm). No studies have been conducted on SE resolution, though some studies have shown good diagnostic performance of SE in small breast tumors [32], [33]. Studies of enlarged lymph nodes in EUS elastography have shown that a trained observer has equal diagnostic performance as strain-histogram and strain-ratios, when lesions are large [22]. In agreement with this, we found a trend towards improvement of visual scoring in large targets compared with small targets. We also found that size influenced the assessment of target stiffness in visual scoring and in strain ratio assessments significantly.

The smaller phantom targets were difficult to localize on B-mode. This may have caused a lower prediction of target stiffness in the phantom than would have been the case in vivo, where lesions are normally first seen on B-mode. Strain-ratio measurements could not be done blinded to target strain, they may therefore show better diagnostic performance than if done blinded.

No studies comparing strain-based elastography with SWE or ARFI have been published. ARFI-measurements in a phantom have been studied [34], [35], but none has reported on diagnostic performance of either SWE or ARFI in a phantom.

In conclusion strain-histograms and strain-ratios are superior to visual scoring in assessing target stiffness in a phantom. Target size had a significant influence on strain-ratio assessments and visual scorings. There was no effect of target size on strain-histograms. A significant difference when comparing experienced and inexperienced observers was shown when assessing target stiffness using a binary scale. The pre-setting used had no significant influence on the scorings.

Acknowledgments

Drs. Rikke R. Winkel, Mikkel Taudorf and Carsten A. Lauritsen are acknowledged for their time spent as observers in the study.

Funding Statement

No external funding was used for this study.

References

  • 1. Ophir J, Céspedes I, Ponnekanti H, Yazdi Y, Li X (1991) Elastography: A quantitative method for imaging the elasticity of biological tissues. Ultrason Imaging 13: 111–134 10.1016/0161-7346(91)90079-W [DOI] [PubMed] [Google Scholar]
  • 2. Frey H (2003) Realtime-Elastographie. Radiol 43: 850–855 10.1007/s00117-003-0943-2 [DOI] [PubMed] [Google Scholar]
  • 3. Bamber J, Cosgrove D, Dietrich CF, Fromageau J, Bojunga J, et al. (2013) EFSUMB Guidelines and Recommendations on the Clinical Use of Ultrasound Elastography. Part 1: Basic Principles and Technology. Ultraschall Med Stuttg Ger 1980 34: 169–184 10.1055/s-0033-1335205 [DOI] [PubMed] [Google Scholar]
  • 4. Garra BS, Cespedes EI, Ophir J, Spratt SR, Zuurbier RA, et al. (1997) Elastography of breast lesions: initial clinical results. Radiology 202: 79–86. [DOI] [PubMed] [Google Scholar]
  • 5. Itoh A, Ueno E, Tohno E, Kamma H, Takahashi H, et al. (2006) Breast Disease: Clinical Application of US Elastography for Diagnosis1. Radiology 239: 341–350 10.1148/radiol.2391041676 [DOI] [PubMed] [Google Scholar]
  • 6. Wojcinski S, Farrokh A, Weber S, Thomas A, Fischer T, et al. (2010) Multicenter study of ultrasound real-time tissue elastography in 779 cases for the assessment of breast lesions: improved diagnostic performance by combining the BI-RADS®-US classification system with sonoelastography. Ultraschall Med Stuttg Ger 1980 31: 484–491 10.1055/s-0029-1245282 [DOI] [PubMed] [Google Scholar]
  • 7. Cho N, Jang M, Lyou CY, Park JS, Choi HY, et al. (2012) Distinguishing benign from malignant masses at breast US: combined US elastography and color doppler US—influence on radiologist accuracy. Radiology 262: 80–90 10.1148/radiol.11110886 [DOI] [PubMed] [Google Scholar]
  • 8. Carlsen J, Ewertsen C, Lönn L, Nielsen M (2013) Strain Elastography Ultrasound: An Overview with Emphasis on Breast Cancer Diagnosis. Diagnostics 3: 117–125 10.3390/diagnostics3010117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Bhatia KSS, Cho CCM, Yuen Y-H, Rasalkar DD, King AD, et al. (2010) Real-Time Qualitative Ultrasound Elastography of Cervical Lymph Nodes in Routine Clinical Practice: Interobserver Agreement and Correlation with Malignancy. Ultrasound Med Biol 36: 1990–1997 10.1016/j.ultrasmedbio.2010.08.016 [DOI] [PubMed] [Google Scholar]
  • 10. Dietrich CF, Ponnudurai R, Bachmann Nielsen M (2012) [Is there a need for new imaging methods for lymph node evaluation?]. Ultraschall Med Stuttg Ger 1980 33: 411–414 10.1055/s-0032-1325384 [DOI] [PubMed] [Google Scholar]
  • 11. Park SH, Kim SJ, Kim E-K, Kim MJ, Son EJ, et al. (2009) Interobserver Agreement in Assessing the Sonographic and Elastographic Features of Malignant Thyroid Nodules. Am J Roentgenol 193: W416–W423 10.2214/AJR.09.2541 [DOI] [PubMed] [Google Scholar]
  • 12. Moon HJ, Sung JM, Kim E-K, Yoon JH, Youk JH, et al. (2012) Diagnostic Performance of Gray-Scale US and Elastography in Solid Thyroid Nodules. Radiology 262: 1002–1013 10.1148/radiol.11110839 [DOI] [PubMed] [Google Scholar]
  • 13. Bhatia KSS, Rasalkar DD, Lee Y-P, Wong K-T, King AD, et al. (2010) Real-Time Qualitative Ultrasound Elastography of Miscellaneous Non-Nodal Neck Masses: Applications and Limitations. Ultrasound Med Biol 36: 1644–1652 10.1016/j.ultrasmedbio.2010.07.010 [DOI] [PubMed] [Google Scholar]
  • 14. Ragazzoni F, Deandrea M, Mormile A, Ramunni MJ, Garino F, et al. (2012) High Diagnostic Accuracy and Interobserver Reliability of Real-Time Elastography in the Evaluation of Thyroid Nodules. Ultrasound Med Biol 38: 1154–1162 10.1016/j.ultrasmedbio.2012.02.025 [DOI] [PubMed] [Google Scholar]
  • 15. Havre RF, Elde E, Gilja OH, Ödegaard S, Eide GE, et al. (2008) Freehand Real-Time Elastography: Impact of Scanning Parameters on Image Quality and In Vitro Intra- and Interobserver Validations. Ultrasound Med Biol 34: 1638–1650 10.1016/j.ultrasmedbio.2008.03.009 [DOI] [PubMed] [Google Scholar]
  • 16. Thomas A, Degenhardt F, Farrokh A, Wojcinski S, Slowinski T, et al. (2010) Significant differentiation of focal breast lesions: calculation of strain ratio in breast sonoelastography. Acad Radiol 17: 558–563 10.1016/j.acra.2009.12.006 [DOI] [PubMed] [Google Scholar]
  • 17. Kumm TR, Szabunio MM (2010) Elastography for the characterization of breast lesions: initial clinical experience. Cancer Control J Moffitt Cancer Cent 17: 156–161. [DOI] [PubMed] [Google Scholar]
  • 18. Zhi H, Xiao X-Y, Yang H-Y, Ou B, Wen Y-L, et al. (2010) Ultrasonic elastography in breast cancer diagnosis: strain ratio vs 5-point scale. Acad Radiol 17: 1227–1233 10.1016/j.acra.2010.05.004 [DOI] [PubMed] [Google Scholar]
  • 19. Itokawa F, Itoi T, Sofuni A, Kurihara T, Tsuchiya T, et al. (2011) EUS elastography combined with the strain ratio of tissue elasticity for diagnosis of solid pancreatic masses. J Gastroenterol 46: 843–853 10.1007/s00535-011-0399-5 [DOI] [PubMed] [Google Scholar]
  • 20. Xie L, Chen X, Guo Q, Dong Y, Guang Y, et al. (2012) Real-time elastography for diagnosis of liver fibrosis in chronic hepatitis B. J Ultrasound Med Off J Am Inst Ultrasound Med 31: 1053–1060. [DOI] [PubMed] [Google Scholar]
  • 21. Zhang Y, Tang J, Li Y, Fei X, Lv F, et al. (2012) Differentiation of prostate cancer from benign lesions using strain index of transrectal real-time tissue elastography. Eur J Radiol 81: 857–862 10.1016/j.ejrad.2011.02.037 [DOI] [PubMed] [Google Scholar]
  • 22. Săftoiu A, Vilmann P, Hassan H, Gorunescu F (2006) Analysis of endoscopic ultrasound elastography used for characterisation and differentiation of benign and malignant lymph nodes. Ultraschall Med Stuttg Ger 1980 27: 535–542 10.1055/s-2006-927117 [DOI] [PubMed] [Google Scholar]
  • 23. Săftoiu A, Vilmann P, Gorunescu F, Janssen J, Hocke M, et al. (2011) Accuracy of endoscopic ultrasound elastography used for differential diagnosis of focal pancreatic masses: a multicenter study. Endoscopy 43: 596–603 10.1055/s-0030-1256314 [DOI] [PubMed] [Google Scholar]
  • 24. Sãftoiu A, Săftoui A, Gheonea DI, Ciurea T (2007) Hue histogram analysis of real-time elastography images for noninvasive assessment of liver fibrosis. AJR Am J Roentgenol 189: W232–233 10.2214/AJR.07.2571 [DOI] [PubMed] [Google Scholar]
  • 25. Chung SY, Moon WK, Choi JW, Cho N, Jang M, et al. (2010) Differentiation of benign from malignant nonpalpable breast masses: a comparison of computer-assisted quantification and visual assessment of lesion stiffness with the use of sonographic elastography. Acta Radiol Stockh Swed 1987 51: 9–14 10.3109/02841850903273966 [DOI] [PubMed] [Google Scholar]
  • 26. Săftoiu A, Vilmann P, Ciurea T, Popescu GL, Iordache A, et al. (2007) Dynamic analysis of EUS used for the differentiation of benign and malignant lymph nodes. Gastrointest Endosc 66: 291–300 10.1016/j.gie.2006.12.039 [DOI] [PubMed] [Google Scholar]
  • 27. Kossoff G, Fry EK, Jellins J (1973) Average velocity of ultrasound in the human female breast. J Acoust Soc Am 53: 1730–1736 10.1121/1.1913526 [DOI] [PubMed] [Google Scholar]
  • 28.Havre RF, Waage JR, Gilja OH, Odegaard S, Nesje LB (2011) Real-Time Elastography: Strain Ratio Measurements Are Influenced by the Position of the Reference Area. Ultraschall Med Stuttg Ger 1980. doi:10.1055/s-0031-1273247. [DOI] [PubMed]
  • 29. Rasband WS (2012) ImageJ: Image processing and analysis in Java. Astrophys Source Code Libr -1: 06013. [Google Scholar]
  • 30. Gong X, Xu Q, Xu Z, Xiong P, Yan W, et al. (2011) Real-time elastography for the differentiation of benign and malignant breast lesions: a meta-analysis. Breast Cancer Res Treat 130: 11–18 10.1007/s10549-011-1745-2 [DOI] [PubMed] [Google Scholar]
  • 31. Hu D, Gong T, Zhu Q (2013) Endoscopic Ultrasound Elastography for Differential Diagnosis of Pancreatic Masses: A Meta-Analysis. Dig Dis Sci 58: 1125–1131 10.1007/s10620-012-2428-5 [DOI] [PubMed] [Google Scholar]
  • 32. Lee JH, Kim SH, Kang BJ, Choi JJ, Jeong SH, et al. (2011) Role and clinical usefulness of elastography in small breast masses. Acad Radiol 18: 74–80 10.1016/j.acra.2010.07.014 [DOI] [PubMed] [Google Scholar]
  • 33. Fu L, Wang Y, Wang Y, Huang Y (2011) Value of ultrasound elastography in detecting small breast tumors. Chin Med J (Engl) 124: 2384–2386. [PubMed] [Google Scholar]
  • 34. Tozaki M, Saito M, Joo C, Yamaguchi M, Isobe S, et al. (2011) Ultrasonographic tissue quantification of the breast using acoustic radiation force impulse technology: phantom study and clinical application. Jpn J Radiol 29: 598–603 10.1007/s11604-011-0591-9 [DOI] [PubMed] [Google Scholar]
  • 35.Chang S, Kim M-J, Kim J, Lee M-J (2012) Variability of Shear Wave Velocity using Different Frequencies in Acoustic Radiation Force Impulse (ARFI) Elastography: A Phantom and Normal Liver Study. Ultraschall Med Stuttg Ger 1980. doi:10.1055/s-0032-1313008. [DOI] [PubMed]

Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES