In the last decade, the use of point-of-care lung ultrasound (POC-LUS) has substantially increased and in some intensive care units has largely replaced the routine use of chest X-rays tests [1]. While POC-LUS is highly efficient, it requires expertise, and when wrongfully interpreted may badly influence the treating physician's decision-making. Due to the logistic and medical equipment limitations in quarantined zones in which COVID-19 patients are treated, the importance of POC-LUS increased [2]. We aimed to assess the reliability of a newly designed POC-LUS machine-integrated tool for automatic-real-time bedside quantification of B-lines among critical COVID-19 patients.
We assessed all patients admitted to the COVID-19 intensive-care unit in Soroka University Medical Center (SUMC) in Beersheva between February 2, 2020, and June 23, 2020. POC-LUS was performed daily during the routine medical rounds using VenueTM ultrasound machine, General Electric.
Intensive care specialists acquired data in the COVID-19 ICU by placing the probe longitudinally in the intercostal space and prospectively recording for four seconds. The 4-second time-frame allowed the shortest acquisition time with high sensitivity to detect B-lines [3]. All clips were reviewed and blindly assessed for B-lines quantification by two experienced physician operators (GT, 5 years and LF, 9 years). Separately, post hoc automatic analyses were performed using the VenueTM integrated auto-B-lines tool.
VenueTM-auto-B-lines tool provides a grade between zero to ≥ five B-lines, detected only as lines reaching the bottom of the screen. Since the estimation of ≥ 3 B-lines in LUS screening of the lungs' independent zones is considered pathological [4], we also divided the B-lines score to "dry" (≤ 3 B-lines) or "wet" (≥ 4 B-lines).
Each clip was considered an independent observation point. We divided the B-lines assessment into three severity groups: (1) ≤ 2 (non-pathologic), (2) 3–4, and (3) ≥ 5 (severe-ARDS). To assess the agreement between the automatic and physician-assessed quantifications, we performed Cohen's-Kappa tests. A two-sided p-value ≤ 0.05 was considered statistically significant. All analyses were performed using SPSS 26.0 (Armonk, NY, USA).
During the study, 153 clips were acquired from ten patients. All clips were interpretable and included in the analysis. Patients were primarily males (90%), with a mean age of 61.0 ± 8.0 and a mean body mass index of 24.5 ± 10.5. The mean-p/f-ratio was 203.7 ± 83.2, and 70% of patients were mechanically ventilated.
When assessed by physician, 104 observations were classified as group 3, 33 as group 2, and 16 as group 1. In automatic analysis, 18 observations were classified as group 1, 33 as group 2, and 102 as group 3. An example of automatic-POC-LUS assessment across the spectrum of SARS-CoV2-ARDS severity is illustrated in Fig. 1. The weighted Cohen's-Kappa for agreement between the automatic and physician quantifications was 0.734 (95% CI 0.641, 0.826; p < 0.001). When divided into "dry" (≤ 3 B-lines) vs. "wet" (≥ 4 B-lines), the weighted Cohen's-Kappa was 0.822 (95% CI 0.716, 0.928; p < 0.001).
Fig. 1.

Automatic POC-LUS assessment across the spectrum of ARDS severity. “Dry-lung”: A 0 B-lines; B 2 B-lines; C 3 B-lines. "Wet-lung": D 4 B-lines; E 5 B-lines
In conclusion, we found that the machine-integrated VenueTM-auto-B-lines tool is highly reliable among severe COVID-19 ICU patients. To our knowledge, this is the first study to validate a machine-integrated automatic-B-lines quantification tool with high reliability among COVID-19 patients. The small number of patients included in this feasibility trial should be acknowledged as a limitation; thus, further research to validate the results of this study is warranted. Previously, a non-integrated automatic B-lines detection application has shown good overall reliability while also stressing the difference in assessment reliability dependent on the operator experience [5]. The current study's results may help better interpret POC-LUS assessments performed by less-experienced operators and reduce inter-operator variability. This tool may provide technological infrastructure for future telemedicine, even in non-experienced hands or for self-assessment by patients. The VenueTM-auto-B-lines tool may reduce the medical staff's exposure time and promote more accurate and standardized LUS assessment methods.
Acknowledgements
We thank the medical staff of the internal medicine division in SUMC and the nursing staff of the medical intensive care unit in SUMC for their valuable contribution to this study.
Authors' contributions
GT and LF conceived and designed the study, performed post hoc sonographic analyses, and wrote the paper. GT performed statistical analyses. LF, OG, YU, and YA acquired the data. GT and LF are the guarantors of this paper and take responsibility for the work's integrity, from inception to publication of the article. All authors read and approved the manuscript.
Funding
This study was funded by General Electric. The sponsor was not involved in the study design, data interpretation and processing, data analysis, drafting of the manuscript or in the decision to publish the results.
Availability of supporting data
All supporting data are available upon request and pending the corresponding author's (LF) approval.
Declarations
Ethical approval and consent to participate
The study was approved by the SUMC institutional review board (#2020-0050-17). As this was a retrospective analysis of existing data, participants were not required to supply informed consent.
Consent for publication
All authors have read and reviewed the manuscript and consent to the publication of the manuscript.
Competing interests
LF serves as a medical consulter for General Electric.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Bouhemad B, Zhang M, Lu Q, Rouby JJ. Clinical review: bedside lung ultrasound in critical care practice. Crit Care. 2007;11:205. doi: 10.1186/cc5668. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Buonsenso D, Pata D, Chiaretti A. COVID-19 outbreak: less stethoscope, more ultrasound. Lancet Respir. 2020;8:e27. doi: 10.1016/S2213-2600(20)30120-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Platz E, Pivetta E, Merz AA, Peck J, Rivero J, Cheng S. Impact of device selection and clip duration on lung ultrasound assessment in patients with heart failure. Am J Emerg Med. 2015;33:1552. doi: 10.1016/j.ajem.2015.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Dietrich CF, Mathis G, Blaivas M, Volpicelli G, Seibel A, Wastl D, et al. Lung B-line artefacts and their use. J Thorac Dis. 2016;8:1356–65. doi: 10.21037/jtd.2016.04.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Pičuljan A, Šustić M, Brumini G, Kuharić J, Šustić A. Reliability of B-line quantification by different-level observers and a software algorithm using point-of-care lung ultrasound. J Clin Monit Comput. 2020;34:1259–64. doi: 10.1007/s10877-019-00440-7. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All supporting data are available upon request and pending the corresponding author's (LF) approval.
