Abstract
Purpose
The aim of this study was to evaluate the imaging capabilities of Butterfly iQ with conventional ophthalmic (piezoelectric) ultrasound (COU) for ophthalmic imaging.
Methods
Custom phantom molds were designed and imaged with Butterfly iQ and COU to compare spatial resolution capabilities. To evaluate the clinical imaging performance of Butterfly iQ and COU, a survey containing pathological conditions from human subjects, imaged with both Butterfly iQ and COU probes, was given to three retina specialists and graded on image detail, resolution, quality, and diagnostic confidence on a ten-point Likert scale. Kruskal-Wallis analysis was performed for survey responses.
Results
Butterfly iQ and COU had comparable capabilities for imaging small axial and lateral phantom features (down to 0.1 mm) of high and low acoustic reflectivity. One of three retina specialists demonstrated a statistically significant preference for COU related to resolution, detail, and diagnostic confidence, but the remaining graders showed no significant preference for Butterfly iQ or COU across all sample images presented.
Conclusion
The emergence of portable ultrasound probes offers an affordable alternative to COU technologies with comparable qualitative imaging resolution down to 0.1 mm. These findings suggest the value to further study the use of portable ultrasound systems and their utility in routine eye care.
Introduction
Ophthalmic ultrasound is an important imaging modality for visualizing ocular anatomy. Recent advancements in ultrasound technology offer increased portability with decreased equipment costs, potentially expanding access to ultrasound imaging. Importantly, when leveraging modern-day ultrasound machines without the use of contrast agents, no known adverse events have been documented in humans [1]. Currently, ophthalmic ultrasound is used to evaluate anterior segment anatomy, intraocular anatomy when media opacity obscures optical examination, intraocular foreign bodies, solid tumors, and periocular anatomy in the orbit [2, 3]. Limited access to conventional ultrasound systems due to high costs and lack of portability poses significant challenges for providing basic ophthalmic care in low-income countries [4, 5]. Some portable ultrasound systems costing approximately $2,699 have emerged and introduce cost-effective competition to ophthalmic ultrasound systems costing $20,000–70,000 (Table 1).
Table 1. Comparisons of commercially available handheld ultrasound instruments.
Device | Manufacturer | Transducer | Base Unit Price (USD) | Yearly Subscription | System compatibility | Approved for ophthalmic use |
---|---|---|---|---|---|---|
iQ | Butterfly | CMUT | $2699 | $420/year | iOS/Android | Yes |
Vscan Extend R2 | GE | Piezoelectric | $4995 | - | Provided tablet | Yes |
L20 | Clarius | Piezoelectric | $6900 | - | iOS/Android | Yes |
iViz | Sonosite | Piezoelectric | Discontinued | - | Provided Tablet | L38V and L25v probe required |
300L | Healcerion | Piezoelectric | $4,995 | - | iOS/Android | No |
Lumify | Philips | Piezoelectric | $6,000 or subscription | $2388/year | iOS/Android | No |
Biim | Biim | Piezoelectric | $2000–5000 | - | iOS/Android | No |
L38-22 & | Kolo Medical | CMUT | $19,750 (L38-22v) | - | Requires Verasonic Vantage instrument | No |
L22-8 | $18,750 (L22-8v) | |||||
4Sight | Accutome | Piezoelectric | $20,000 | - | Provided Tablet | Yes |
ABSolu | Quantel Medical | Piezoelectric | $70,000 | - | Provided Tablet | Yes |
Prices adapted from manufacturer websites or representatives.
To better understand the potential impact of portable and cost-effective ultrasound systems on ophthalmic care, it is important to evaluate the spatial resolution capabilities of these devices. Spatial resolution is defined as a device’s ability to distinguish between two points at a particular depth and is central to an ultrasound system’s ability to visualize anatomical features. Spatial resolution of ultrasound images is comprised of two components: axial and lateral resolution. Axial resolution describes the minimum distance that can be differentiated between two reflectors located parallel to the direction of the ultrasound beam propagation. Lateral resolution is the minimum distance that can be distinguished between two reflectors that are separated perpendicular to the direction of the sound beam [6].
Some emerging portable ultrasound systems use a fundamentally different type of ultrasound technology compared to conventional ultrasound instruments. Ultrasound images are created by generating ultrasonic waves and reflecting them off tissue interfaces. The elapsed time between generating and detecting reflected sound waves is used to create a 2D gray-scale image [7, 8]. In conventional ultrasound instruments, ultrasonic waves are produced by applying a current to a piezoelectric crystal [8]. In contrast, the Butterfly iQ (Butterfly Network Inc, Guilford, CT) uses a unique silicon “ultrasound-on-a-chip” that contains a 2D array of 9,000 capacitive micromachined ultrasonic transducers (CMUTs) [9–11]. CMUT units are composed of a vacuum gap that separates a conductive plate or membrane over a substrate, thus acting like a capacitor [12]. When alternating current is applied, the unit begins to emit ultrasonic sound waves [10, 12]. Although largely explored in non-medical contexts, such as non-destructive testing in aerospace engineering, CMUTs are now being adapted for healthcare applications [12, 13].
Overall, large-scale changes in ultrasound technology have revolutionized its cost and adaptability. The incorporation of CMUT arrays has improved ultrasound resolution by maintaining a higher sensitivity and wider bandwidth for emission and detection [10–12, 14]. Additionally, CMUT instruments like the Butterfly iQ offer mobile device integration, with the ultrasound technology entirely housed within the handle and unattached to a display unit. These improvements have expanded the availability of ultrasonic devices and could lead to greater utility in many medical settings such as resource-limited communities [15]. Table 1 compares handheld and portable ultrasonic devices, including Butterfly iQ, though not all technologies listed are approved for ophthalmic use. This study systematically compares Butterfly iQ scans with scans from conventional ophthalmic ultrasound (COU) units: the 10MHz EyeCubed v3 (Ellex Inc., Adelaide, AUS) and 10MHz Accutome B-Scan Pro (Keeler, Malvern, PA). Fig 1 illustrates example images obtained from a healthy volunteer using the 10MHz EyeCubed v3 and Butterfly iQ devices.
Methods
To qualitatively compare the axial and lateral resolution of Butterfly iQ and COU, phantom models of high (polymer molds in gelatin) and low (gelatin imprints filled with water) acoustic reflectivity were designed and imaged. Designs of the polymer molds (Molds A, B, C, and D) and diagrams of the phantoms produced using the molds are demonstrated in Fig 2. Mold A was designed to assess lateral resolution with decreasing lateral feature separation. Mold B offers features with decreasing width to evaluate lateral resolution. To examine axial resolution, Mold C was created with decreasing feature heights. Finally, Mold D investigated the axial resolution by containing features with decreasing vertical separation. Polymer molds were printed with ultraviolet-cured resin (Form 3B, FormLabs, Somervile, MA). Polymer molds were submerged in Knox Gelatin (Treehouse Foods, Oak Brook, IL) that was mixed with a gelatin-water ratio of 5:1 by weight to approximate the acoustic properties of vitreous humor (Fig 2B) [16]. Gelatin imprints were created by removing encased polymer molds, leaving a negative imprint of the surface topography (Fig 2B). The gelatin imprints were subsequently submerged in water for imaging. To compare axial resolution between Butterfly iQ and COU when passing through multiple layers of attenuating media, additional phantoms were created containing three paper sheets attached with double-sided tape along the perimeter to compose a paper stack (S1 Fig) with separation between paper sheets. These paper stacks were submerged in Knox Gelatin, as described above, and imaged for qualitative comparison. All gelatin phantoms were refrigerated at 5°C for at least 10 hours.
The Butterfly iQ probe was connected to an iPad Pro (Apple Inc., Cupertino, CA) for live imaging and data collection. The Butterfly iQ ophthalmic imaging preset (Butterfly iQ-Oph) was used and compared against the 10MHz Eye Cubed v3 ophthalmic ultrasonography unit to image polymer molds and gelatin imprints. Ultrasound images of the phantoms were independently reviewed by the authors, comprised of a team including a retina specialist, two postdoctoral researchers, and three medical students. Phantom images were examined for identification of features designed to test for axial and lateral resolution.
For a clinical imaging comparison, Institutional Review Board (HS#2019–5254) approval was obtained from the University of California, Irvine, and the study was conducted in accordance with the Declaration of Helsinki. Seven study participants provided written informed consent, and the study was conducted in a HIPAA-compliant manner. The recruitment period for this study was from 4/1/2020 to 12/31/2020. Only patients with a clinical indication were imaged with both the Butterfly iQ and the Accutome 10MHz B-Scan Pro. Four imaging presets (Musculoskeletal (MSK), Musculoskeletal-Soft Tissue (MSK-ST), Nerve (N), and Pediatric Lung (PL)) were selected from the Butterfly iQ software library. The Butterfly iQ-Oph imaging preset was not available in the United States when conducting this clinical imaging experiment. Therefore, settings were optimized for other organ presets during clinical evaluation. During imaging, one minute video clips were taken using both ultrasound probes. Still images were then exported, de-identified, and cropped.
Randomized images from study participants were presented in a questionnaire to three different ophthalmologists at the University of California, Irvine, who were blinded to whether the images were captured with the Butterfly iQ or the conventional piezoelectric ultrasound Accutome-B Scan Pro. Physician graders rated images on a ten-point Likert scale according to resolution, detail, image quality, and diagnostic confidence. A score of 10 represents an image demonstrating the highest quality of the criterion being measured, whereas a score of 1 represents the lowest quality. Resolution was defined as “sharpness of the image and lack of haziness”; detail as “clarity of outlines, how well structures and boundaries are defined”; image quality as “overall image assessment (e.g., absence of noise, contrast between structures)”; and diagnostic confidence as “confidence in making clinical decisions based on image.” Pathologic conditions presented included repaired retinal detachment with silicon oil tamponade, vitreous hemorrhage, and tractional retinal detachment. Kruskal-Wallis analysis with Mann-Whitney U pairwise tests were utilized to compare survey responses between Butterfly iQ and COU. All statistical analyses were performed with SPSS Statistics 27 (IBM, Armonk, NY). P-values less than 0.05 were considered significant.
Results
Ultrasound images of polymer molds within gelatin, representing high acoustic reflectivity phantoms, and the corresponding gelatin imprints submerged in water after mold removal, representing low acoustic reflectivity phantoms are shown in Fig 3. The authors unanimously agreed on which phantom features were identified on imaging. Except for Mold A, both Butterfly iQ and COU successfully identified the smallest available phantom features, down to 0.1 mm, for all phantoms tested (Fig 3). Mold A contained features separated by lateral gaps of decreasing size, ranging from 1 mm to 0.1 mm (Fig 2). The 0.2 and 0.1 mm gaps in Mold A were not visualized by either ultrasound modality, with the smallest resolved gap being 0.4 mm (Fig 3A). Differences in visualizing Mold A’s 0.4 mm gap between Butterfly iQ and COU are highlighted by the red arrows in Fig 3A. While COU was able to resolve the openings of the 0.2 and 0.1 mm gaps of Mold A, the features were incompletely visualized. In addition, when Mold A was removed from its corresponding gelatin, the smallest features were not preserved. The red arrowheads in Fig 3D indicate the features that were damaged during mold removal and were unavailable for comparison.
For comparison of axial resolution when passing through multiple layers of attenuating media, phantoms created with paper stacks (S1 Fig) were imaged with both Butterfly iQ and COU. Qualitatively, Butterfly iQ and COU both identified all three layers of paper with similar image qualities, indicating comparable axial resolution performance in this setting.
To evaluate clinical performance of both ultrasound devices, three blinded retina specialists used a Likert scale (Fig 4B) to compare image characteristics of study participants (Fig 4A). Two graders reported no statistically significant differences between Butterfly iQ and COU for all image qualities surveyed (Table 2). Grader 2 showed consistent scoring of COU images higher than any Butterfly iQ preset regarding resolution, detail, and diagnostic confidence.
Table 2. Results of Kruskal-Wallis analysis on survey responses.
Grader 1 | Grader 2 | Grader 3 | |
---|---|---|---|
Resolution | 0.587 (2.826) | 0.047 (9.647) | 0.887 (1.147) |
Detail | 0.533 (3.148) | 0.022 (11.421) | 0.897 (1.085) |
Image Quality | 0.623 (2.619) | 0.608 (2.706) | 0.828 (1.493) |
Diagnostic Confidence | 0.726 (2.051) | 0.045 (9.723) | 0.968 (0.558) |
p-value (H statistic)
Four degrees of freedom
Values with statistically significant difference are in bold
Grader 2 maintained a statistically significant preference for COU’s resolution, detail, and diagnostic confidence, while not favoring either modality for image quality. Grader 1 and Grader 3 showed no statistically significant preference for Butterfly iQ or COU across all qualities surveyed.
Discussion
In this study, Butterfly iQ was compared with conventional piezoelectric ophthalmic ultrasonography. In our comparison, polymer and gelatin phantoms highlighted comparable imaging capabilities of both Butterfly iQ and COU in imaging the depth and width of small features (0.1 mm) of high and low acoustic reflectivity. However, further experimentation would be required to reliably form and image smaller tissues (<0.1 mm). Furthermore, the analysis of the survey demonstrated one of three retina specialists showing a higher preference for COU related to resolution, detail, and diagnostic confidence (Table 2). Remaining graders showed no difference amongst all modalities and imaging settings portrayed, demonstrating similar imaging quality between Butterfly iQ and COU. One grader consistently favoring COU may be a consequence of recognition bias as the graders could independently identify which ultrasound instrument produced each image based on image characteristics (note differences visible in Fig 4). One highlighted advantage of using Butterfly iQ is the ability to acquire an image in low density fluids like silicone oil, whereas the image quality in COU is well known to be dramatically diminished in the presence of intraocular silicone oil (Fig 4).
Our comparison of Butterfly iQ, a portable CMUT ultrasound technology, and conventional piezoelectric ultrasound used in ophthalmology revealed minor differences in phantom imaging and survey results. Early inquiries comparing the use of piezoelectric probes with research-grade CMUTs for medical imaging have shown similar imaging resolution capabilities [17]. Currently, Butterfly iQ is the only commercially available CMUT probe for clinical use since the L38-22v and L22-8v (Kolo Medical, San Jose, CA) probes (Table 1) require an interfacing system (Vantage System, Verasonics, Kirkland, WA), which does not have FDA clearance as a medical device.
Additionally, recent comparisons of Butterfly iQ to piezoelectric transducers have not compared modalities for ophthalmic use. Sabbadini et al. compared Butterfly iQ to Logiq S7 Expert (GE Healthcare, Chicago, IL) to assess the total time to complete the Ultrasound Hypotension Protocol (UHP) and conferred with licensed sonographers to determine that modalities were equivalent for diagnostic purposes [18]. Similarly, Dewar et al. assessed Butterfly iQ and Sparq (Phillips, Amsterdam, NL) equivalence in cardiac imaging for Rapid Ultrasound for Hypotension and Shock (RUSH) imaging. Though this study used three physician graders, the scoring sheet utilized in their study was also a binary answer choice (yes/no) for “adequate quality for interpretation” [19]. Instead of using a binary answer choice, our survey utilized a 10-point Likert scale to delineate fine score differences between physician graders.
Bennett et al. demonstrated insignificant differences between Butterfly iQ and Venue GO (GE Healthcare) point-of-care-ultrasound for lung aeration scoring (0–36) in infections due to Severe Acute Respiratory Syndrome Corona Virus 2 (SARS-CoV-2) [20]. This grading scale was a numerical score; however, it was a qualitative assessment of imaging capability as higher point values were assigned and added for worsening appearance of aeration in specific areas of the lung [20]. Additionally, the authors tested for agreement of scores derived from both ultrasound modalities, instead of specific criteria of images. In our study, the phantom models contained features with known dimensions that allowed for resolution comparison between both ultrasound technologies.
One of the limitations of this study is that we assumed comparable performance between two different COU instruments. We used the Ellex EyeCubed v3 on phantom models to characterize resolution and the Accutome B-scan Pro to acquire the clinical images included in the qualitative evaluation by physician graders. Further, we evaluated a small clinical sample and definitive conclusion of equivalence or non-inferiority between Butterfly iQ and COU would require a larger pool of disease states and expanded pool of blinded graders to quantify sensitivity and specificity when detecting pathology.
Conclusions
Our comparison of Butterfly iQ and COU demonstrated similar resolution in phantom imaging, with both modalities achieving qualitative imaging resolution down to 0.1 mm. In the context of clinical imaging, two out of three blinded retina specialists showed no statistically significant preference for COU over Butterfly iQ when presented with images of ophthalmic pathologies. These results underscore the significance of Butterfly iQ as a unique handheld alternative to COU. Butterfly iQ’s affordability and portability may lower the barrier to entry for ophthalmic ultrasound imaging and provide more comprehensive ophthalmic care in resource-limited communities. The findings in this study justify expanded clinical studies comparing Butterfly iQ and other CMUT devices with COU.
Supporting information
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
Research to Prevent Blindness Grant #: None Recipient: University of California Irvine Department of Ophthalmology BrightFocus Foundation Award#: M2021013N Recipient: Andrew W. Browne Arnold and Mabel Beckman Foundation Award#: None Recipient: University of California Irvine Department of Ophthalmology The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Abramowicz JS, Adhikari S, Dickman E, Estroff JA, Harris GR, Nomura J, et al. Ocular ultrasound: Review of bioeffects and safety, including fetal and point-of-care perspective. J Ultrasound Med. 2022;41(7):1609–1622. doi: 10.1002/jum.15864 [DOI] [PubMed] [Google Scholar]
- 2.Fledelius HC. Ultrasound in ophthalmology. Ultrasound in Medicine and Biology. 1997;23(3):365–375. doi: 10.1016/s0301-5629(96)00213-x [DOI] [PubMed] [Google Scholar]
- 3.Jung HC, Lee SY, Yoon CK, Park UC, Heo JW, Lee EK. Intraocular Foreign Body: Diagnostic Protocols and Treatment Strategies in Ocular Trauma Patients. Journal of Clinical Medicine. 2021;10(9):1861. doi: 10.3390/jcm10091861 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ngweme G, Bambi MTN, Lutete LF, Kilangalanga NJ, Hopkins A, Stachs O, et al. Ophthalmic Ultrasonography in Sub-Saharan Africa-A Kinshasa Experience. Diagnostics (Basel). 2021. Oct 28;11(11):2009. doi: 10.3390/diagnostics11112009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Becker DM, Tafoya CA, Becker SL, Kruger GH, Tafoya MJ, Becker TK. The use of portable ultrasound devices in low- and middle-income countries: a systematic review of the literature. Tropical Medicine & International Health. 2016;21(3):294–311. doi: 10.1111/tmi.12657 [DOI] [PubMed] [Google Scholar]
- 6.Ng A, Swanevelder J. Resolution in ultrasound imaging. Continuing Education in Anaesthesia Critical Care & Pain. 2011;11(5):186–192. doi: 10.1093/bjaceaccp/mkr030 [DOI] [Google Scholar]
- 7.Gururaja TR. Piezoelectric transducers for medical ultrasonic imaging. ISAF 1992: Proceedings of the 8th IEEE International Symposium on Applications of Ferroelectrics. 1992;259–265. doi: 10.1109/ISAF.1992.300680 [DOI] [Google Scholar]
- 8.Szabo TL, Lewin PA. Piezoelectric materials for imaging. J Ultrasound Med. 2007;26(3):283–288. doi: 10.7863/jum.2007.26.3.283 [DOI] [PubMed] [Google Scholar]
- 9.Clevert DA, Schwarze V, Nyhsen C, D’Onofrio M, Sidhu P, Brady AP. ESR statement on portable ultrasound devices. Insights into Imaging. 2019;10(1):1–9. doi: 10.1186/s13244-019-0775-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Liu JY, Xu J, Forsberg F, Liu J-B. CMUT/CMOS-based Butterfly iQ—A Portable Personal Sonoscope. Advanced Ultrasound in Diagnosis and Therapy. 2019;3(3):115–118. doi: 10.37015/audt.2019.190819 [DOI] [Google Scholar]
- 11.Manwar R, Kratkiewicz K, Avanaki K. Overview of ultrasound detection technologies for photoacoustic imaging. Micromachines. 2020;11(7):692. doi: 10.3390/mi11070692 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Khuri-Yakub BT, Oralkan Ö. Capacitive micromachined ultrasonic transducers for medical imaging and therapy. Journal of Micromechanics and Microengineering. 2011;21(5). doi: 10.1088/0960-1317/21/5/054004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Remillieux MC, Anderson BE, Ulrich T, Le Bas PY, Haberman MR, Zhu J. The future of nondestructive testing lies in the ability to efficiently generate waves in structures without contact. Acoustics Today. 2014;10(4):36–45. [Google Scholar]
- 14.Baribeau Y, Sharkey A, Chaudhary O, Krumm S, Fatima H, Mahmood F, et al. Handheld Point-of-Care Ultrasound Probes: The New Generation of POCUS. Journal of Cardiothoracic and Vascular Anesthesia. 2020;34(11):3139–3145. doi: 10.1053/j.jvca.2020.07.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Burleson SL, Swanson JF, Shufflebarger EF, Wallace DW, Heimann MA, Crosby JC, et al. Evaluation of a novel handheld point-of-care ultrasound device in an African emergency department. Ultrasound Journal. 2020;12(1). doi: 10.1186/s13089-020-00200-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Jafri F, Runde D, Saul T, Lewiss RE. An inexpensive and easy simulation model of ocular ultrasound that mimics normal anatomy as well as abnormal ophthalmologic conditions. J Ultrasound Med. 2011;30(4):569–573. doi: 10.7863/jum.2011.30.4.569 [DOI] [PubMed] [Google Scholar]
- 17.Legros M, Meynier C, Dufait R, Férin G, Tranquart F. Piezocomposite and CMUT arrays assessment through in vitro imaging performances. 2008 IEEE Ultrasonics Symposium. 2008;1142–1145. doi: 10.1109/ULTSYM.2008.0275 [DOI] [Google Scholar]
- 18.Sabbadini L, Germano R, Hopkins E, Haukoos JS, Kendall JL. Ultrasound Hypotension Protocol Time-motion Study Using the Multifrequency Single Transducer Versus a Multiple Transducer Ultrasound Device. Western Journal of Emergency Medicine. 2021;22(3):775–781. doi: 10.5811/westjem.2020.12.47862 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Dewar ZE, Wu J, Hughes H, Adnani A, Christiansen G, Ovedovitz L, et al. A comparison of handheld ultrasound versus traditional ultrasound for acquisition of RUSH views in healthy volunteers. Journal of the American College of Emergency Physicians Open. 2020;1(6):1320–1325. doi: 10.1002/emp2.12322 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Bennett D, De Vita E, Mezzasalma F, Lanzarone N, Cameli P, Bianchi F, et al. Portable Pocket-Sized Ultrasound Scanner for the Evaluation of Lung Involvement in Coronavirus Disease 2019 Patients. Ultrasound in Medicine and Biology. 2021;47(1):19–24. doi: 10.1016/j.ultrasmedbio.2020.09.014 [DOI] [PMC free article] [PubMed] [Google Scholar]