Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2024 May 13;19(5):e0300451. doi: 10.1371/journal.pone.0300451

Imaging performance of portable and conventional ultrasound imaging technologies for ophthalmic applications

Jack O Thomas 1,2,#, Josiah K To 1,#, Anderson N Vu 1,#, David Horton 3, Ermin Dzihic 3, Andrew W Browne 1,4,5,*
Editor: Bing Xu6
PMCID: PMC11090327  PMID: 38739643

Abstract

Purpose

The aim of this study was to evaluate the imaging capabilities of Butterfly iQ with conventional ophthalmic (piezoelectric) ultrasound (COU) for ophthalmic imaging.

Methods

Custom phantom molds were designed and imaged with Butterfly iQ and COU to compare spatial resolution capabilities. To evaluate the clinical imaging performance of Butterfly iQ and COU, a survey containing pathological conditions from human subjects, imaged with both Butterfly iQ and COU probes, was given to three retina specialists and graded on image detail, resolution, quality, and diagnostic confidence on a ten-point Likert scale. Kruskal-Wallis analysis was performed for survey responses.

Results

Butterfly iQ and COU had comparable capabilities for imaging small axial and lateral phantom features (down to 0.1 mm) of high and low acoustic reflectivity. One of three retina specialists demonstrated a statistically significant preference for COU related to resolution, detail, and diagnostic confidence, but the remaining graders showed no significant preference for Butterfly iQ or COU across all sample images presented.

Conclusion

The emergence of portable ultrasound probes offers an affordable alternative to COU technologies with comparable qualitative imaging resolution down to 0.1 mm. These findings suggest the value to further study the use of portable ultrasound systems and their utility in routine eye care.

Introduction

Ophthalmic ultrasound is an important imaging modality for visualizing ocular anatomy. Recent advancements in ultrasound technology offer increased portability with decreased equipment costs, potentially expanding access to ultrasound imaging. Importantly, when leveraging modern-day ultrasound machines without the use of contrast agents, no known adverse events have been documented in humans [1]. Currently, ophthalmic ultrasound is used to evaluate anterior segment anatomy, intraocular anatomy when media opacity obscures optical examination, intraocular foreign bodies, solid tumors, and periocular anatomy in the orbit [2, 3]. Limited access to conventional ultrasound systems due to high costs and lack of portability poses significant challenges for providing basic ophthalmic care in low-income countries [4, 5]. Some portable ultrasound systems costing approximately $2,699 have emerged and introduce cost-effective competition to ophthalmic ultrasound systems costing $20,000–70,000 (Table 1).

Table 1. Comparisons of commercially available handheld ultrasound instruments.

Device Manufacturer Transducer Base Unit Price (USD) Yearly Subscription System compatibility Approved for ophthalmic use
iQ Butterfly CMUT $2699 $420/year iOS/Android Yes
Vscan Extend R2 GE Piezoelectric $4995 - Provided tablet Yes
L20 Clarius Piezoelectric $6900 - iOS/Android Yes
iViz Sonosite Piezoelectric Discontinued - Provided Tablet L38V and L25v probe required
300L Healcerion Piezoelectric $4,995 - iOS/Android No
Lumify Philips Piezoelectric $6,000 or subscription $2388/year iOS/Android No
Biim Biim Piezoelectric $2000–5000 - iOS/Android No
L38-22 & Kolo Medical CMUT $19,750 (L38-22v) - Requires Verasonic Vantage instrument No
L22-8 $18,750 (L22-8v)
4Sight Accutome Piezoelectric $20,000 - Provided Tablet Yes
ABSolu Quantel Medical Piezoelectric $70,000 - Provided Tablet Yes

Prices adapted from manufacturer websites or representatives.

To better understand the potential impact of portable and cost-effective ultrasound systems on ophthalmic care, it is important to evaluate the spatial resolution capabilities of these devices. Spatial resolution is defined as a device’s ability to distinguish between two points at a particular depth and is central to an ultrasound system’s ability to visualize anatomical features. Spatial resolution of ultrasound images is comprised of two components: axial and lateral resolution. Axial resolution describes the minimum distance that can be differentiated between two reflectors located parallel to the direction of the ultrasound beam propagation. Lateral resolution is the minimum distance that can be distinguished between two reflectors that are separated perpendicular to the direction of the sound beam [6].

Some emerging portable ultrasound systems use a fundamentally different type of ultrasound technology compared to conventional ultrasound instruments. Ultrasound images are created by generating ultrasonic waves and reflecting them off tissue interfaces. The elapsed time between generating and detecting reflected sound waves is used to create a 2D gray-scale image [7, 8]. In conventional ultrasound instruments, ultrasonic waves are produced by applying a current to a piezoelectric crystal [8]. In contrast, the Butterfly iQ (Butterfly Network Inc, Guilford, CT) uses a unique silicon “ultrasound-on-a-chip” that contains a 2D array of 9,000 capacitive micromachined ultrasonic transducers (CMUTs) [911]. CMUT units are composed of a vacuum gap that separates a conductive plate or membrane over a substrate, thus acting like a capacitor [12]. When alternating current is applied, the unit begins to emit ultrasonic sound waves [10, 12]. Although largely explored in non-medical contexts, such as non-destructive testing in aerospace engineering, CMUTs are now being adapted for healthcare applications [12, 13].

Overall, large-scale changes in ultrasound technology have revolutionized its cost and adaptability. The incorporation of CMUT arrays has improved ultrasound resolution by maintaining a higher sensitivity and wider bandwidth for emission and detection [1012, 14]. Additionally, CMUT instruments like the Butterfly iQ offer mobile device integration, with the ultrasound technology entirely housed within the handle and unattached to a display unit. These improvements have expanded the availability of ultrasonic devices and could lead to greater utility in many medical settings such as resource-limited communities [15]. Table 1 compares handheld and portable ultrasonic devices, including Butterfly iQ, though not all technologies listed are approved for ophthalmic use. This study systematically compares Butterfly iQ scans with scans from conventional ophthalmic ultrasound (COU) units: the 10MHz EyeCubed v3 (Ellex Inc., Adelaide, AUS) and 10MHz Accutome B-Scan Pro (Keeler, Malvern, PA). Fig 1 illustrates example images obtained from a healthy volunteer using the 10MHz EyeCubed v3 and Butterfly iQ devices.

Fig 1. Diagrams of the 10MHz EyeCubed v3 and Butterfly iQ devices and example images.

Fig 1

Images obtained from a healthy volunteer with the 10MHz EyeCubed v3 and Butterfly iQ devices are outlined in orange and blue respectively.

Methods

To qualitatively compare the axial and lateral resolution of Butterfly iQ and COU, phantom models of high (polymer molds in gelatin) and low (gelatin imprints filled with water) acoustic reflectivity were designed and imaged. Designs of the polymer molds (Molds A, B, C, and D) and diagrams of the phantoms produced using the molds are demonstrated in Fig 2. Mold A was designed to assess lateral resolution with decreasing lateral feature separation. Mold B offers features with decreasing width to evaluate lateral resolution. To examine axial resolution, Mold C was created with decreasing feature heights. Finally, Mold D investigated the axial resolution by containing features with decreasing vertical separation. Polymer molds were printed with ultraviolet-cured resin (Form 3B, FormLabs, Somervile, MA). Polymer molds were submerged in Knox Gelatin (Treehouse Foods, Oak Brook, IL) that was mixed with a gelatin-water ratio of 5:1 by weight to approximate the acoustic properties of vitreous humor (Fig 2B) [16]. Gelatin imprints were created by removing encased polymer molds, leaving a negative imprint of the surface topography (Fig 2B). The gelatin imprints were subsequently submerged in water for imaging. To compare axial resolution between Butterfly iQ and COU when passing through multiple layers of attenuating media, additional phantoms were created containing three paper sheets attached with double-sided tape along the perimeter to compose a paper stack (S1 Fig) with separation between paper sheets. These paper stacks were submerged in Knox Gelatin, as described above, and imaged for qualitative comparison. All gelatin phantoms were refrigerated at 5°C for at least 10 hours.

Fig 2. Designs of the polymer molds and diagrams of the phantoms produced.

Fig 2

a) Polymer mold designs and side profile images of the printed polymers. Mold A was designed to compare lateral resolution with decreasing feature lateral separation. Mold B also compared lateral resolution but with decreasing feature width. Mold C examined axial resolution with decreasing feature heights. Mold D also investigated axial resolution by decreasing vertical separation of features. b) Diagrams of phantoms produced using the polymer molds. The molds were embedded in gelatin and imaged as high acoustic reflectivity phantoms. The molds were subsequently removed from the gelatin, leaving a gelatin imprint of the mold. Gelatin imprints from each mold were submerged in water and imaged as low acoustic reflectivity phantoms. *Correspond to features that were not preserved during removal of the polymer mold and were therefore unavailable for comparison.

The Butterfly iQ probe was connected to an iPad Pro (Apple Inc., Cupertino, CA) for live imaging and data collection. The Butterfly iQ ophthalmic imaging preset (Butterfly iQ-Oph) was used and compared against the 10MHz Eye Cubed v3 ophthalmic ultrasonography unit to image polymer molds and gelatin imprints. Ultrasound images of the phantoms were independently reviewed by the authors, comprised of a team including a retina specialist, two postdoctoral researchers, and three medical students. Phantom images were examined for identification of features designed to test for axial and lateral resolution.

For a clinical imaging comparison, Institutional Review Board (HS#2019–5254) approval was obtained from the University of California, Irvine, and the study was conducted in accordance with the Declaration of Helsinki. Seven study participants provided written informed consent, and the study was conducted in a HIPAA-compliant manner. The recruitment period for this study was from 4/1/2020 to 12/31/2020. Only patients with a clinical indication were imaged with both the Butterfly iQ and the Accutome 10MHz B-Scan Pro. Four imaging presets (Musculoskeletal (MSK), Musculoskeletal-Soft Tissue (MSK-ST), Nerve (N), and Pediatric Lung (PL)) were selected from the Butterfly iQ software library. The Butterfly iQ-Oph imaging preset was not available in the United States when conducting this clinical imaging experiment. Therefore, settings were optimized for other organ presets during clinical evaluation. During imaging, one minute video clips were taken using both ultrasound probes. Still images were then exported, de-identified, and cropped.

Randomized images from study participants were presented in a questionnaire to three different ophthalmologists at the University of California, Irvine, who were blinded to whether the images were captured with the Butterfly iQ or the conventional piezoelectric ultrasound Accutome-B Scan Pro. Physician graders rated images on a ten-point Likert scale according to resolution, detail, image quality, and diagnostic confidence. A score of 10 represents an image demonstrating the highest quality of the criterion being measured, whereas a score of 1 represents the lowest quality. Resolution was defined as “sharpness of the image and lack of haziness”; detail as “clarity of outlines, how well structures and boundaries are defined”; image quality as “overall image assessment (e.g., absence of noise, contrast between structures)”; and diagnostic confidence as “confidence in making clinical decisions based on image.” Pathologic conditions presented included repaired retinal detachment with silicon oil tamponade, vitreous hemorrhage, and tractional retinal detachment. Kruskal-Wallis analysis with Mann-Whitney U pairwise tests were utilized to compare survey responses between Butterfly iQ and COU. All statistical analyses were performed with SPSS Statistics 27 (IBM, Armonk, NY). P-values less than 0.05 were considered significant.

Results

Ultrasound images of polymer molds within gelatin, representing high acoustic reflectivity phantoms, and the corresponding gelatin imprints submerged in water after mold removal, representing low acoustic reflectivity phantoms are shown in Fig 3. The authors unanimously agreed on which phantom features were identified on imaging. Except for Mold A, both Butterfly iQ and COU successfully identified the smallest available phantom features, down to 0.1 mm, for all phantoms tested (Fig 3). Mold A contained features separated by lateral gaps of decreasing size, ranging from 1 mm to 0.1 mm (Fig 2). The 0.2 and 0.1 mm gaps in Mold A were not visualized by either ultrasound modality, with the smallest resolved gap being 0.4 mm (Fig 3A). Differences in visualizing Mold A’s 0.4 mm gap between Butterfly iQ and COU are highlighted by the red arrows in Fig 3A. While COU was able to resolve the openings of the 0.2 and 0.1 mm gaps of Mold A, the features were incompletely visualized. In addition, when Mold A was removed from its corresponding gelatin, the smallest features were not preserved. The red arrowheads in Fig 3D indicate the features that were damaged during mold removal and were unavailable for comparison.

Fig 3. Diagrams of phantoms and images taken with Butterfly iQ and COU.

Fig 3

High acoustic reflectivity polymer molds (designs listed in Fig 1) were embedded in gelatin and compared in rows a-c. Low acoustic reflectivity gelatin imprints, created by removing the molds, are compared in rows d-g. White arrowheads indicate the horizontal positions of phantom features on the diagrams and corresponding ultrasound images. The red arrowheads in row a highlight the differences observed in the 0.4 mm lateral feature separation in Mold A between Butterfly iQ (blue) and COU (orange). The red arrowheads in row d indicate gelatin features that were not preserved upon removing Mold A from its embedded gelatin.

For comparison of axial resolution when passing through multiple layers of attenuating media, phantoms created with paper stacks (S1 Fig) were imaged with both Butterfly iQ and COU. Qualitatively, Butterfly iQ and COU both identified all three layers of paper with similar image qualities, indicating comparable axial resolution performance in this setting.

To evaluate clinical performance of both ultrasound devices, three blinded retina specialists used a Likert scale (Fig 4B) to compare image characteristics of study participants (Fig 4A). Two graders reported no statistically significant differences between Butterfly iQ and COU for all image qualities surveyed (Table 2). Grader 2 showed consistent scoring of COU images higher than any Butterfly iQ preset regarding resolution, detail, and diagnostic confidence.

Fig 4. Example images and Likert scale featured in the survey.

Fig 4

a) Select images of pathologies featured in the survey, including intraocular silicone oil and tractional retinal detachment. COU images are seen in the orange outline, whereas Butterfly iQ images with the PL, MSK-ST, MSK, and N presets are displayed with the blue outline. b) Likert scale used by graders to evaluate images for resolution, detail, image quality, and diagnostic confidence.

Table 2. Results of Kruskal-Wallis analysis on survey responses.

Grader 1 Grader 2 Grader 3
Resolution 0.587 (2.826) 0.047 (9.647) 0.887 (1.147)
Detail 0.533 (3.148) 0.022 (11.421) 0.897 (1.085)
Image Quality 0.623 (2.619) 0.608 (2.706) 0.828 (1.493)
Diagnostic Confidence 0.726 (2.051) 0.045 (9.723) 0.968 (0.558)

p-value (H statistic)

Four degrees of freedom

Values with statistically significant difference are in bold

Grader 2 maintained a statistically significant preference for COU’s resolution, detail, and diagnostic confidence, while not favoring either modality for image quality. Grader 1 and Grader 3 showed no statistically significant preference for Butterfly iQ or COU across all qualities surveyed.

Discussion

In this study, Butterfly iQ was compared with conventional piezoelectric ophthalmic ultrasonography. In our comparison, polymer and gelatin phantoms highlighted comparable imaging capabilities of both Butterfly iQ and COU in imaging the depth and width of small features (0.1 mm) of high and low acoustic reflectivity. However, further experimentation would be required to reliably form and image smaller tissues (<0.1 mm). Furthermore, the analysis of the survey demonstrated one of three retina specialists showing a higher preference for COU related to resolution, detail, and diagnostic confidence (Table 2). Remaining graders showed no difference amongst all modalities and imaging settings portrayed, demonstrating similar imaging quality between Butterfly iQ and COU. One grader consistently favoring COU may be a consequence of recognition bias as the graders could independently identify which ultrasound instrument produced each image based on image characteristics (note differences visible in Fig 4). One highlighted advantage of using Butterfly iQ is the ability to acquire an image in low density fluids like silicone oil, whereas the image quality in COU is well known to be dramatically diminished in the presence of intraocular silicone oil (Fig 4).

Our comparison of Butterfly iQ, a portable CMUT ultrasound technology, and conventional piezoelectric ultrasound used in ophthalmology revealed minor differences in phantom imaging and survey results. Early inquiries comparing the use of piezoelectric probes with research-grade CMUTs for medical imaging have shown similar imaging resolution capabilities [17]. Currently, Butterfly iQ is the only commercially available CMUT probe for clinical use since the L38-22v and L22-8v (Kolo Medical, San Jose, CA) probes (Table 1) require an interfacing system (Vantage System, Verasonics, Kirkland, WA), which does not have FDA clearance as a medical device.

Additionally, recent comparisons of Butterfly iQ to piezoelectric transducers have not compared modalities for ophthalmic use. Sabbadini et al. compared Butterfly iQ to Logiq S7 Expert (GE Healthcare, Chicago, IL) to assess the total time to complete the Ultrasound Hypotension Protocol (UHP) and conferred with licensed sonographers to determine that modalities were equivalent for diagnostic purposes [18]. Similarly, Dewar et al. assessed Butterfly iQ and Sparq (Phillips, Amsterdam, NL) equivalence in cardiac imaging for Rapid Ultrasound for Hypotension and Shock (RUSH) imaging. Though this study used three physician graders, the scoring sheet utilized in their study was also a binary answer choice (yes/no) for “adequate quality for interpretation” [19]. Instead of using a binary answer choice, our survey utilized a 10-point Likert scale to delineate fine score differences between physician graders.

Bennett et al. demonstrated insignificant differences between Butterfly iQ and Venue GO (GE Healthcare) point-of-care-ultrasound for lung aeration scoring (0–36) in infections due to Severe Acute Respiratory Syndrome Corona Virus 2 (SARS-CoV-2) [20]. This grading scale was a numerical score; however, it was a qualitative assessment of imaging capability as higher point values were assigned and added for worsening appearance of aeration in specific areas of the lung [20]. Additionally, the authors tested for agreement of scores derived from both ultrasound modalities, instead of specific criteria of images. In our study, the phantom models contained features with known dimensions that allowed for resolution comparison between both ultrasound technologies.

One of the limitations of this study is that we assumed comparable performance between two different COU instruments. We used the Ellex EyeCubed v3 on phantom models to characterize resolution and the Accutome B-scan Pro to acquire the clinical images included in the qualitative evaluation by physician graders. Further, we evaluated a small clinical sample and definitive conclusion of equivalence or non-inferiority between Butterfly iQ and COU would require a larger pool of disease states and expanded pool of blinded graders to quantify sensitivity and specificity when detecting pathology.

Conclusions

Our comparison of Butterfly iQ and COU demonstrated similar resolution in phantom imaging, with both modalities achieving qualitative imaging resolution down to 0.1 mm. In the context of clinical imaging, two out of three blinded retina specialists showed no statistically significant preference for COU over Butterfly iQ when presented with images of ophthalmic pathologies. These results underscore the significance of Butterfly iQ as a unique handheld alternative to COU. Butterfly iQ’s affordability and portability may lower the barrier to entry for ophthalmic ultrasound imaging and provide more comprehensive ophthalmic care in resource-limited communities. The findings in this study justify expanded clinical studies comparing Butterfly iQ and other CMUT devices with COU.

Supporting information

S1 Fig. Diagram and ultrasound images of paper phantom model.

a) Diagram of model with three papers (black) each separated by three layers of tape (white) and gelatin (yellow). b) COU imaging is outlined in orange and Butterfly iQ imaging is outlined in blue.

(TIF)

pone.0300451.s001.tif (227.8KB, tif)
S1 Data. Polymer phantom CAD file.

CAD file for the 3D printed structure used to generate Molds A, B, and C (Figs 2 and 3).

(STL)

pone.0300451.s002.stl (15.5KB, stl)
S2 Data. Polymer phantom CAD file.

CAD file for the 3D printed structure used to generate Mold D (Figs 2 and 3).

(STL)

pone.0300451.s003.stl (181.4KB, stl)
S1 Dataset. Clinical survey results and statistical analysis.

(XLSX)

pone.0300451.s004.xlsx (29.3KB, xlsx)
S1 File. Questionnaire used to survey three retina specialists comparing clinical images from Butterfly iQ and COU.

(PDF)

pone.0300451.s005.pdf (2.1MB, pdf)

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

Research to Prevent Blindness Grant #: None Recipient: University of California Irvine Department of Ophthalmology BrightFocus Foundation Award#: M2021013N Recipient: Andrew W. Browne Arnold and Mabel Beckman Foundation Award#: None Recipient: University of California Irvine Department of Ophthalmology The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Abramowicz JS, Adhikari S, Dickman E, Estroff JA, Harris GR, Nomura J, et al. Ocular ultrasound: Review of bioeffects and safety, including fetal and point-of-care perspective. J Ultrasound Med. 2022;41(7):1609–1622. doi: 10.1002/jum.15864 [DOI] [PubMed] [Google Scholar]
  • 2.Fledelius HC. Ultrasound in ophthalmology. Ultrasound in Medicine and Biology. 1997;23(3):365–375. doi: 10.1016/s0301-5629(96)00213-x [DOI] [PubMed] [Google Scholar]
  • 3.Jung HC, Lee SY, Yoon CK, Park UC, Heo JW, Lee EK. Intraocular Foreign Body: Diagnostic Protocols and Treatment Strategies in Ocular Trauma Patients. Journal of Clinical Medicine. 2021;10(9):1861. doi: 10.3390/jcm10091861 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Ngweme G, Bambi MTN, Lutete LF, Kilangalanga NJ, Hopkins A, Stachs O, et al. Ophthalmic Ultrasonography in Sub-Saharan Africa-A Kinshasa Experience. Diagnostics (Basel). 2021. Oct 28;11(11):2009. doi: 10.3390/diagnostics11112009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Becker DM, Tafoya CA, Becker SL, Kruger GH, Tafoya MJ, Becker TK. The use of portable ultrasound devices in low- and middle-income countries: a systematic review of the literature. Tropical Medicine & International Health. 2016;21(3):294–311. doi: 10.1111/tmi.12657 [DOI] [PubMed] [Google Scholar]
  • 6.Ng A, Swanevelder J. Resolution in ultrasound imaging. Continuing Education in Anaesthesia Critical Care & Pain. 2011;11(5):186–192. doi: 10.1093/bjaceaccp/mkr030 [DOI] [Google Scholar]
  • 7.Gururaja TR. Piezoelectric transducers for medical ultrasonic imaging. ISAF 1992: Proceedings of the 8th IEEE International Symposium on Applications of Ferroelectrics. 1992;259–265. doi: 10.1109/ISAF.1992.300680 [DOI] [Google Scholar]
  • 8.Szabo TL, Lewin PA. Piezoelectric materials for imaging. J Ultrasound Med. 2007;26(3):283–288. doi: 10.7863/jum.2007.26.3.283 [DOI] [PubMed] [Google Scholar]
  • 9.Clevert DA, Schwarze V, Nyhsen C, D’Onofrio M, Sidhu P, Brady AP. ESR statement on portable ultrasound devices. Insights into Imaging. 2019;10(1):1–9. doi: 10.1186/s13244-019-0775-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Liu JY, Xu J, Forsberg F, Liu J-B. CMUT/CMOS-based Butterfly iQ—A Portable Personal Sonoscope. Advanced Ultrasound in Diagnosis and Therapy. 2019;3(3):115–118. doi: 10.37015/audt.2019.190819 [DOI] [Google Scholar]
  • 11.Manwar R, Kratkiewicz K, Avanaki K. Overview of ultrasound detection technologies for photoacoustic imaging. Micromachines. 2020;11(7):692. doi: 10.3390/mi11070692 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Khuri-Yakub BT, Oralkan Ö. Capacitive micromachined ultrasonic transducers for medical imaging and therapy. Journal of Micromechanics and Microengineering. 2011;21(5). doi: 10.1088/0960-1317/21/5/054004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Remillieux MC, Anderson BE, Ulrich T, Le Bas PY, Haberman MR, Zhu J. The future of nondestructive testing lies in the ability to efficiently generate waves in structures without contact. Acoustics Today. 2014;10(4):36–45. [Google Scholar]
  • 14.Baribeau Y, Sharkey A, Chaudhary O, Krumm S, Fatima H, Mahmood F, et al. Handheld Point-of-Care Ultrasound Probes: The New Generation of POCUS. Journal of Cardiothoracic and Vascular Anesthesia. 2020;34(11):3139–3145. doi: 10.1053/j.jvca.2020.07.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Burleson SL, Swanson JF, Shufflebarger EF, Wallace DW, Heimann MA, Crosby JC, et al. Evaluation of a novel handheld point-of-care ultrasound device in an African emergency department. Ultrasound Journal. 2020;12(1). doi: 10.1186/s13089-020-00200-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Jafri F, Runde D, Saul T, Lewiss RE. An inexpensive and easy simulation model of ocular ultrasound that mimics normal anatomy as well as abnormal ophthalmologic conditions. J Ultrasound Med. 2011;30(4):569–573. doi: 10.7863/jum.2011.30.4.569 [DOI] [PubMed] [Google Scholar]
  • 17.Legros M, Meynier C, Dufait R, Férin G, Tranquart F. Piezocomposite and CMUT arrays assessment through in vitro imaging performances. 2008 IEEE Ultrasonics Symposium. 2008;1142–1145. doi: 10.1109/ULTSYM.2008.0275 [DOI] [Google Scholar]
  • 18.Sabbadini L, Germano R, Hopkins E, Haukoos JS, Kendall JL. Ultrasound Hypotension Protocol Time-motion Study Using the Multifrequency Single Transducer Versus a Multiple Transducer Ultrasound Device. Western Journal of Emergency Medicine. 2021;22(3):775–781. doi: 10.5811/westjem.2020.12.47862 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Dewar ZE, Wu J, Hughes H, Adnani A, Christiansen G, Ovedovitz L, et al. A comparison of handheld ultrasound versus traditional ultrasound for acquisition of RUSH views in healthy volunteers. Journal of the American College of Emergency Physicians Open. 2020;1(6):1320–1325. doi: 10.1002/emp2.12322 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Bennett D, De Vita E, Mezzasalma F, Lanzarone N, Cameli P, Bianchi F, et al. Portable Pocket-Sized Ultrasound Scanner for the Evaluation of Lung Involvement in Coronavirus Disease 2019 Patients. Ultrasound in Medicine and Biology. 2021;47(1):19–24. doi: 10.1016/j.ultrasmedbio.2020.09.014 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Ireneusz Grulkowski

3 Oct 2023

PONE-D-23-27765Imaging performance of portable and conventional ultrasound imaging technologies for ophthalmic applicationsPLOS ONE

Dear Dr. Thomas,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Nov 17 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ireneusz Grulkowski, PhD

Academic Editor

PLOS ONE

Journal Requirements:

1. When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We suggest you thoroughly copyedit your manuscript for language usage, spelling, and grammar. If you do not know anyone who can help you do this, you may wish to consider employing a professional scientific editing service. 

Whilst you may use any professional scientific editing service of your choice, PLOS has partnered with both American Journal Experts (AJE) and Editage to provide discounted services to PLOS authors. Both organizations have experience helping authors meet PLOS guidelines and can provide language editing, translation, manuscript formatting, and figure formatting to ensure your manuscript meets our submission guidelines. To take advantage of our partnership with AJE, visit the AJE website (http://aje.com/go/plos) for a 15% discount off AJE services. To take advantage of our partnership with Editage, visit the Editage website (www.editage.com) and enter referral code PLOSEDIT for a 15% discount off Editage services. If the PLOS editorial team finds any language issues in text that either AJE or Editage has edited, the service provider will re-edit the text for free.

Upon resubmission, please provide the following:

  

The name of the colleague or the details of the professional service that edited your manuscript

A copy of your manuscript showing your changes by either highlighting them or using track changes (uploaded as a *supporting information* file)

A clean copy of the edited manuscript (uploaded as the new *manuscript* file).

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I would like to congratulate the authors on completing this study and well-written manuscript. Overall, this is an interesting pilot or proof-of-concept study evaluating the Butterfly iQ compared to a conventional ultrasound device, specifically for ocular applications.

Some specific comments:

I suggest changing the terminology to focus more specifically on the Butterfly iQ itself rather than CMUT in general, since that is the only one tested, and the only one currently approved for ocular use.

Line 44 – take out the second “technology”, perhaps “increased portability with decreased equipment cost”

Reconsider the use ofthe abbreviation BiQ. Have never seen that used.

Move the sentence starting on line 63 “These… 2D gray-scale image” to the second sentence of the same paragraph because all ultrasound waves, regardless of generating technique, function this way. Then contrast how the waves are produced.

Materials and Methods

The authors went into great detail describing the making of the phantoms, but then didn’t really describe how they were to be systematically evaluated. Then they are discussed again in the results, but it is still unclear who did the evaluating, or by what standards.

The results paragraph regarding the phantoms and corresponding Figure 3 are difficult to interpret.

I would also consider re-writing the conclusion section. This is a very generic conclusion that could have been made without the study. I would include statements addressing the similar imaging resolution on the custom phantoms, and the statistical agreement between 2/3 blinded reviewers

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 May 13;19(5):e0300451. doi: 10.1371/journal.pone.0300451.r002

Author response to Decision Letter 0


30 Nov 2023

We thank the reviewers for their efforts in helping us improve our manuscript. A detailed, point-by-point reply to each of the comments made by the reviewers is enclosed in our attached file "Response to Reviewers".

Attachment

Submitted filename: Response to Reviewers.docx

pone.0300451.s006.docx (18.6KB, docx)

Decision Letter 1

Bing Xu

12 Feb 2024

PONE-D-23-27765R1Imaging performance of portable and conventional ultrasound imaging technologies for ophthalmic applicationsPLOS ONE

Dear Dr. Thomas,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

As you can see from the enclosed reviews, the reviewers find your manuscript potentially suitable for publication in PLoS One. However, one of them raised a specific issue that must be addressed before the final acceptance of your manuscript. Therefore, I am requesting that you submit a revised version of this manuscript to address the comments. To help me expedite processing, please explicitly address the questions raised by the reviewer in your cover letter and also indicate the changes made in the manuscript.

Please submit your revised manuscript by Mar 28 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Bing Xu, PhD

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have successfully implemented the recommendations and improvements suggested in the first round of edits. The paper is improved in clarity and presentation.

Reviewer #2: The manuscript by To et al. assessed the imaging performance of the Butterfly iQ (BiQ), a portable ultrasound probe, in comparison to conventional ophthalmic ultrasound (COU) for ophthalmic imaging. Custom phantom molds were created by the researchers, and both BiQ and COU were used to capture images for a spatial resolution comparison. Additionally, a survey involving three retina specialists was conducted to evaluate images of pathological conditions from human subjects obtained with both probes. The findings indicated that BiQ and COU exhibited similar imaging capabilities for small axial and lateral phantom features. While one specialist favored COU, the overall preference did not significantly lean towards either probe. This study suggests that portable ultrasound probes, like BiQ, present a cost-effective alternative to COU, offering comparable imaging resolution and indicating their potential usefulness in routine eye care. I support the acceptance of this manuscript after the authors address the following issues.

1. The primary issue lies in the study's small sample size and limited clinical assessment. With only seven participants and three retina specialists included, the findings may not be representative to a wider population. It is suggested that the authors provide rationale for their choice of sample size.

2. As for the clinal evaluation, it would be beneficial if the authors incorporate analysis using image processing software in addition to the specialists' ratings.

3. The authors should provide the full names for the abbreviations, such as PL, MSK-ST, MSK, and N.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 May 13;19(5):e0300451. doi: 10.1371/journal.pone.0300451.r004

Author response to Decision Letter 1


20 Feb 2024

We have uploaded a detailed, point-by-point response to the reviewers in our letter "Response to Reviewers".

Attachment

Submitted filename: Response to Reviewers.docx

pone.0300451.s007.docx (16.1KB, docx)

Decision Letter 2

Bing Xu

28 Feb 2024

Imaging performance of portable and conventional ultrasound imaging technologies for ophthalmic applications

PONE-D-23-27765R2

Dear Dr. Thomas,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Bing Xu, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Bing Xu

30 Apr 2024

PONE-D-23-27765R2

PLOS ONE

Dear Dr. Thomas,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Bing Xu

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Diagram and ultrasound images of paper phantom model.

    a) Diagram of model with three papers (black) each separated by three layers of tape (white) and gelatin (yellow). b) COU imaging is outlined in orange and Butterfly iQ imaging is outlined in blue.

    (TIF)

    pone.0300451.s001.tif (227.8KB, tif)
    S1 Data. Polymer phantom CAD file.

    CAD file for the 3D printed structure used to generate Molds A, B, and C (Figs 2 and 3).

    (STL)

    pone.0300451.s002.stl (15.5KB, stl)
    S2 Data. Polymer phantom CAD file.

    CAD file for the 3D printed structure used to generate Mold D (Figs 2 and 3).

    (STL)

    pone.0300451.s003.stl (181.4KB, stl)
    S1 Dataset. Clinical survey results and statistical analysis.

    (XLSX)

    pone.0300451.s004.xlsx (29.3KB, xlsx)
    S1 File. Questionnaire used to survey three retina specialists comparing clinical images from Butterfly iQ and COU.

    (PDF)

    pone.0300451.s005.pdf (2.1MB, pdf)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0300451.s006.docx (18.6KB, docx)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pone.0300451.s007.docx (16.1KB, docx)

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES