Abstract
Study objective
Accurate diagnostic testing to identify severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is critical. Although highly specific, SARS-CoV-2 reverse transcriptase–polymerase chain reaction (RT-PCR) has been shown in clinical practice to be affected by a noninsignificant proportion of false-negative results. This study seeks to explore whether the integration of lung ultrasonography with clinical evaluation is associated with increased sensitivity for the diagnosis of coronavirus disease 2019 pneumonia, and therefore may facilitate the identification of false-negative SARS-CoV-2 RT-PCR results.
Methods
This prospective cohort study enrolled consecutive adult patients with symptoms potentially related to SARS-CoV-2 infection who were admitted to the emergency department (ED) of an Italian academic hospital. Immediately after the initial assessment, a lung ultrasonographic evaluation was performed and the likelihood of SARS-CoV-2 infection, based on both clinical and lung ultrasonographic findings (“integrated” assessment), was recorded. RT-PCR SARS-CoV-2 detection was subsequently performed.
Results
We enrolled 228 patients; 107 (46.9%) had SARS-CoV-2 infection. Sensitivity and negative predictive value of the clinical–lung ultrasonographic integrated assessment were higher than first RT-PCR result (94.4% [95% confidence interval {CI} 88.2% to 97.9%] versus 80.4% [95% CI 71.6% to 87.4%] and 95% [95% CI 89.5% to 98.2%] versus 85.2% [95% CI 78.3% to 90.6%], respectively). Among the 142 patients who initially had negative RT-PCR results, 21 tested positive at a subsequent molecular test performed within 72 hours. All these false-negative cases were correctly identified by the integrated assessment.
Conclusion
This study suggests that, in patients presenting to the ED with symptoms commonly associated with SARS-CoV-2 infection, the integration of lung ultrasonography with clinical evaluation has high sensitivity and specificity for coronavirus disease 2019 pneumonia and it may help to identify false-negative results occurring with RT-PCR.
Editor’s Capsule Summary.
What is already known on this topic
Reverse transcriptase–polymerase chain reaction testing has high specificity but imperfect sensitivity.
What question this study addressed
Does lung ultrasonography combined with initial clinical examination increase the sensitivity for diagnosing coronavirus disease 2019?
What this study adds to our knowledge
In this prospective study of 228 patients (47% positive rate), lung ultrasonography combined with clinical examination had a higher sensitivity than the initial reverse transcriptase–polymerase chain reaction test (94% versus 80%).
How this is relevant to clinical practice
Lung ultrasonography combined with clinical examination may help identify cases missed on initial reverse transcriptase–polymerase chain reaction testing.
Introduction
Background
Accurate diagnostic testing to identify individuals presenting with symptoms associated with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is critical not only for appropriate patient management but also for effective and judicious implementation of infection prevention and control strategies.1, 2, 3 A test unable to accurately identify individuals affected by coronavirus disease 2019 (COVID-19) (ie, false-negative result) would generate a significant risk of disease transmission and further propagation of the infection in the community and health care settings,1 , 4 , 5 As SARS-CoV-2 tests become more available, understanding how they perform in actual settings (eg, busy emergency departments [EDs]) and developing integrated diagnostic pathways able to identify or minimize false-negative results represent a priority as we prepare for a second wave of infection.1 , 5
Importance
Currently, the most commonly used diagnostic test for the diagnosis of SARS-CoV-2 infection is reverse transcriptase–polymerase chain reaction (RT-PCR) performed with nasopharyngeal swabs.3 , 6, 7, 8 Although highly specific, this test has been shown in clinical practice to be affected by a noninsignificant proportion of false-negative results,1 , 9 potentially related to insufficient viral copies, deficient sampling, inappropriate timing in relation to illness onset, or different location of viral replication (eg, lower respiratory tract).9 , 10 Considering the unsatisfactory results obtained with RT-PCR,3 , 9 many experts recommend continuing to isolate patients with a high clinical suspicion for disease,11, 12, 13 an intervention often problematic, given limitations in appropriate isolation spaces and shortages in personal protective equipment; and also recommend conducting further testing, which can be either time consuming (eg, serial RT-PCR tests) or logistically challenging (eg, bronchoscopy for bronchoalveolar lavage, chest computed tomographic [CT]) scan10).
Lung ultrasonography is a noninvasive bedside tool that has been shown to be useful for the assessment of patients presenting with acute respiratory failure,14 as well as for the diagnosis of several pleural and pulmonary diseases, including acute heart failure, pleural effusion, pneumonia, and pneumothorax.15, 16, 17 Preliminary reports have been published on the use of lung ultrasonography in the evaluation of patients with SARS-CoV-2 infection.18, 19, 20
Goals of This Investigation
In this study, we sought to explore, in a population of adult patients presenting to the ED with symptoms potentially related to SARS-CoV-2 infection, whether the integration of lung ultrasonography with the initial clinical evaluation was associated with increased sensitivity for the diagnosis of COVID-19 pneumonia, therefore facilitating the identification of false-negative RT-PCR results.
Materials and Methods
Study Design and Setting
This was a prospective cohort study held at the ED of the Città della Salute e della Scienza di Torino University Hospital, Turin, Italy, an urban university-affiliated ED with an approximate annual volume of 75,000 visits per year and main site of the University of Turin Emergency Medicine Residency Program. The protocol was approved by the Città della Salute e della Scienza di Torino institutional review board. All patients or their substitute decisionmakers provided informed consent and all data were immediately deidentified. The study was conducted in accordance with the principles of the Declaration of Helsinki for clinical research involving human subjects.
Selection of Participants
We considered eligible all adult patients (≥18 years) who, at triage, screened positive for acute symptoms commonly associated with SARS-CoV-2 infection (ie, fever, dyspnea, new or worsening cough, sore throat, diarrhea, ageusia, anosmia, and asthenia) during the study period. Screening-positive patients were assigned to cohorts in a dedicated area of the ED and subsequently evaluated and approached for study enrollment by the treating physician, regardless of their primary language. Patients known to be infected by SARS-CoV-2, requiring an urgent psychiatric assessment, or already intubated at ED arrival were excluded. Conversely, patients who required noninvasive mechanical ventilation were included in the study. Availability of an attending physician with expertise in lung ultrasonography (ie, completion of a lung ultrasonographic training course accredited by the Italian Society of Emergency Medicine21 and performance and interpretation of at least 40 lung ultrasonographic examinations) was also required for enrollment. All physicians received a training module describing study, scanning protocol, and COVID-19/viral pneumonia lung ultrasonographic findings known at study initiation.18
Measurements
Immediately after the initial clinical evaluation (ie, medical history, history of present illness, physical examination, and ECG, but not laboratory analyses and chest radiography), the treating physician (ie, the attending physician responsible for the patient care) postulated and recorded in a brief case report form the likelihood of SARS-CoV-2 pneumonia, expressed as a dichotomous result (SARS-CoV-2 pneumonia yes/no22). As soon as possible after this initial assessment, the same physician performed a lung ultrasonographic examination and recorded a new diagnostic hypothesis on COVID-19 status (SARS-CoV-2 pneumonia yes/no), based on both clinical and lung ultrasonographic findings (“integrated” assessment). At this point, neither RT-PCR nor chest radiography or CT scan results were available yet. On the contrary, for 143 of 228 patients, the results of arterial blood gas tests were available (Table E1, available online at http://www.annemergmed.com).
For the lung ultrasonographic examination, either a curvilinear transducer (5 to 3 MHz) or a cart-based ultrasonographic system (Esaote Mylab5, Genova, Italy) with abdominal preset or a handheld device (Butterfly IQ; Butterfly Network Inc., Guiford, CT) with lung preset (3 MHz) was used. We implemented a 12-zone (6 areas per hemithorax) scanning protocol, as previously described23 (Figure 1 ). Briefly, we divided each hemithorax into anterior, lateral, and posterior zones, and upper and lower zones (divided by the internipple line); anterior aspect of the chest was identified by the anterior axillary line, lateral aspect of the chest by the anterior and posterior axillary lines, and posterior aspect of the chest by the posterior axillary line and the spine, not including the scapular area.16 , 24 , 25 Because sonographic findings of SARS-CoV-2 pneumonia had been described in only small cohorts of patients18 , 26 and no validated diagnostic criteria have been published to our knowledge, we decided to use a pragmatic approach, without stringent sonographic definitions for SARS-CoV-2–related pneumonia patterns. In agreement with previously published descriptions of viral pneumonia on lung ultrasonography, presence of focal or diffuse interstitial syndrome associated with spared areas, subpleural consolidations, and irregular or thickened pleural line was considered suggestive of SARS-CoV-2–related pneumonia (Figure E1, available online at http://www.annemergmed.com).18 , 26, 27, 28 After completion of the lung ultrasonographic examination, all patients also underwent chest imaging (chest radiography, CT, or both) according to clinical indication.
Figure 1.
Lung ultrasonographic scanning protocol. Areas 1, 2, 5, and 6 represent right and left anterior superior and inferior zones, respectively; areas 3, 4, 7, and 8, right and left lateral superior and inferior zones, respectively; and areas 9, 10, 11, and 12, right and left posterior superior and inferior zones, respectively.
As part of study protocol, the treating physician was asked to record in the case report form the time between the end of the clinical evaluation and the beginning of lung ultrasonography, and the time required to complete the 12-zone lung ultrasonographic scanning.
Outcomes
For all patients, SARS-CoV-2 detection was performed at first on nasopharyngeal swab samples; briefly, after purification with a QIA symphony DSP virus/pathogen kit (QIAGEN, Venlo, the Netherlands), RT-PCR was performed with the GeneFinder 2019 nCoVRealAmp Kit (Elitech, Puteaux, France) or the Simplexa COVID-19 Direct kit (Diasorin Molecular, Cypress, CA), following manufacturer’s instructions. All RT-PCR–positive cases were considered true positive.29 In patients with a negative RT-PCR result, a second nasopharyngeal swab was repeated when clinical, sonographic, laboratory, or imaging evaluations were suspicious for SARS-CoV-2 infection. In addition, in some of these inconclusive cases, other diagnostic tests such as RT-PCR for other respiratory viruses, urinary antigens for Streptococcus pneumoniae and Legionella pneumophila, bronchoalveolar lavage microbiological studies (including SARS-CoV-2 RT-PCR), and chest CT (if not yet performed) were also performed according to the clinician’s indication. Patients with an initial SARS-CoV-2 RT-PCR–negative result were classified as COVID-19 positive if a second RT-PCR test (performed within 72 hours from the initial assessment), either on a nasopharyngeal swab or bronchoalveolar lavage, yielded a positive result. Conversely, patients with results for initial SARS-CoV-2 RT-PCR and all other tests (ie, clinical evaluation, lung ultrasonography, laboratory, and imaging) concordantly negative were classified as having a true COVID-19–negative case and had no further microbiological testing. For all patients, follow-up was performed at 30 days after the initial assessment either by telephone (if patients had been discharged) or in person (for patients still hospitalized).
Analysis
Descriptive results are presented as median and interquartile range (IQR) for continuous data, or as number and percentage for ordinal data.
The diagnostic accuracies of clinical evaluation alone, clinical–lung ultrasonographic integrated assessment, and first RT-PCR test were calculated through sensitivity, specificity, positive predictive values and negative predictive values, positive and negative likelihood ratios, and area under the receiver operating characteristic curve.30 We compared the difference in accuracies by using McNemar’s test for paired data.31 Net reclassification index32 was used to evaluate the clinical usefulness of the different assessments and diagnostic tests.
We estimated that a sample size of 228 patients was necessary to achieve a power of 90% to observe an absolute difference of 8% in sensitivity between clinical–lung ultrasonographic integrated evaluation and RT-PCR, with 1% α error (one-sided test).
Data were collected with an Excel (version 16.43; Microsoft, Redmond, WA) spreadsheet, and analyses were conducted with Stata (version 13.0/SE; StataCorp, College Station, TX).
Results
Between April 1 and April 20, 1,376 consecutive patients presented to the ED of the Città della Salute e della Scienza di Torino University Hospital; 451 patients were considered eligible, and 223 fulfilled exclusion criteria; 228 provided informed consent and were enrolled in the study (Figure 2 ). Tables 1 and E1 (available online at http://www.annemergmed.com) summarize baseline characteristics of enrolled patients by infection status. Twenty physicians participated in the study, enrolling a median number of 12 patients each (IQR 5 to 13 patients) (Table E2, available online at http://www.annemergmed.com).
Figure 2.
Standards for Reporting Diagnostic Accuracy diagram of enrolled patients, grouped by COVID-19 infection status according to clinical and integrated assessments and RT-PCR results. C-LUS, Clinical–lung ultrasonographic integrated assessment.
Table 1.
Baseline characteristics and ED outcome of enrolled patients according to COVID-19 infection status.
No COVID-19 (N=121) | COVID-19 (N=107) | Total (N=228) | |
---|---|---|---|
Age, median (IQR), y | 50.3 (38.9–63.3) | 62.8 (50.5–77.6) | 57.7 (43.3–71.2) |
Men, No. (%) | 52 (43.7) | 59 (54.1) | 111 (48.7) |
Women, No. (%) | 67 (56.3) | 50 (45.9) | 117 (51.3) |
Days from onset of symptoms, median (IQR) | 4 (2–10) | 6 (3–7) | 6 (2–8) |
ED outcome, No. (%) | |||
Home discharge | 95 (78.5) | 27 (25.2) | 122 (53.5) |
Ward admission | 25 (20.7) | 65 (60.8) | 90 (39.5) |
ICU/HDU admission | 1 (0.8) | 8 (7.5) | 9 (3.9) |
ED death | 0 | 7 (6.5) | 7 (3.1) |
Symptoms, No. (%) | |||
Ageusia | 8 (6.6) | 15 (14.0) | 23 (10.1) |
Anosmia | 6 (5.0) | 12 (11.2) | 18 (7.9) |
Cough | 53 (43.8) | 53 (49.5) | 106 (46.5) |
Diarrhea | 26 (21.5) | 15 (14.0) | 41 (18.0) |
Fatigue | 22 (18.3) | 27 (25.2) | 49 (21.6) |
Fever | 68 (56.2) | 79 (73.8) | 147 (64.5) |
Headache | 9 (7.4) | 2 (1.9) | 11 (4.8) |
Shortness of breath | 40 (33.6) | 40 (37.4) | 80 (35.1) |
Sore throat | 21 (17.4) | 5 (4.7) | 26 (11.4) |
Comorbidities, No. (%) | |||
Atrial fibrillation/flutter | 9 (7.4) | 15 (14) | 24 (10.5) |
Asthma | 7 (5.8) | 2 (1.9) | 9 (4) |
CAD | 8 (6.6) | 18 (16.8) | 26 (11.4) |
Cancer∗ | 13 (10.7) | 18 (16.8) | 31 (13.8) |
Cerebrovascular disease | 10 (8.3) | 8 (7.5) | 18 (7.9) |
Chronic kidney disease | 2 (1.7) | 5 (4.7) | 7 (3.1) |
COPD | 8 (6.6) | 12 (11.2) | 20 (8.8) |
Diabetes mellitus | 5 (4.1) | 19 (17.8) | 24 (10.5) |
DVT/PE | 2 (1.7) | 4 (3.8) | 6 (2.6) |
Hypertension | 31 (25.6) | 49 (45.8) | 80 (35.1) |
Smoking history | |||
Active | 16 (13.2) | 8 (7.5) | 24 (10.5) |
Inactive | 14 (11.6) | 17 (15.9) | 31 (13.6) |
HDU, High dependency unit; ICU, Intensive Care Unit; CAD, coronary artery disease; COPD, chronic obstructive pulmonary disease; DVT, deep venous thrombosis; PE, pulmonary embolism.
Patients were considered as having suspected COVID-19 infection when reporting at least one of the following symptoms: fever, dyspnea, cough, sore throat, diarrhea, ageusia, anosmia, or asthenia.
History of active or inactive solid or hematologic neoplasm.
The median time between the end of the clinical evaluation and start of lung ultrasonography was 10 minutes for all cases (IQR 5 to 10 minutes and 5 to 15 minutes for SARS-CoV-2–negative and –positive patients, respectively).
The diagnostic accuracies of the clinical evaluation alone, clinical–lung ultrasonographic integrated assessment, and RT-PCR are shown in Tables 2 and 3 . As described in the “Materials and Methods” section, RT-PCR was considered the reference test in the case of a positive result. Therefore, by protocol, this test did not provide false-positive results (ie, RT-PCR–positive patients were considered to have true-positive cases). The clinical–lung ultrasonographic integrated assessment had higher sensitivity than the first nasopharyngeal RT-PCR (94.4% [95% confidence interval {CI} 88.2% to 97.9%] versus 80.4% [95% CI 71.6% to 87.4%]); the clinical–lung ultrasonographic integrated assessment also demonstrated excellent specificity (95% [95% CI 89.5% to 98.2%]).
Table 2.
Two-by-two table of clinical–lung ultrasonographic integrated evaluation and RT-PCR.
C-LUS Integrated | Positive | Negative | Total | RT-PCR | Positive | Negative | Total |
---|---|---|---|---|---|---|---|
COVID-19 | 101 | 6 | 107 | COVID-19 | 86 | 21 | 107 |
Non–COVID-19 | 6 | 115 | 121 | Non–COVID-19 | 0 | 121 | 121 |
Total | 107 | 121 | 228 | Total | 86 | 142 | 228 |
Table 3.
Diagnostic accuracy of clinical evaluation only, clinical evaluation integrated with lung ultrasonographic findings, and RT-PCR.
Sensitivity (95% CI) | Specificity (95% CI) | Positive Predictive Value (95% CI) | Negative Predictive Value (95% CI) | Positive Likelihood Ratio (95% CI) | Negative Likelihood Ratio (95% CI) | |
---|---|---|---|---|---|---|
Clinical evaluation only | 81.3 (72.6–88.2) | 63.6 (54.4–72.2) | 66.4 (57.6–74.4) | 79.4 (70–86.9) | 2.24 (1.7–2.9) | 0.29 (0.19–0.45) |
C-LUS integrated assessment | 94.4 (88.2–97.9) | 95 (89.5–98.2) | 94.4 (88.2–97.9) | 95 (89.5–98.2) | 19 (8.7–41.6) | 0.06 (0.03–0.13) |
RT-PCR | 80.4 (71.6–87.4) | 100∗ | 100∗ | 85.2 (78.3–90.6) | NA | 0.20 (0.13–0.29) |
NA, Not applicable.
RT-PCR specificity was 100% by study design (no CIs estimated).
Figure 2 shows the distribution of patients according to the clinical evaluation alone, the clinical evaluation integrated with lung ultrasonography, the results of the first RT-PCR test, and the final COVID-19 status.
Of the 142 patients who tested negative at the first nasopharyngeal RT-PCR, 51 had a second RT-PCR test, either on nasopharyngeal swab or bronchoalveolar lavage, when clinical, sonographic, laboratory, or imaging evaluation results were suspicious for SARS-CoV-2 infection. Twenty-one patients (14.8%) of those who tested negative at the first nasopharyngeal RT-PCR test had a positive result at a subsequent molecular test performed within 72 hours, and were therefore classified as having false-negative cases. All of them were correctly identified by the integrated clinical–lung ultrasonographic assessment. In particular, 17 patients were identified as highly likely to be SARS-CoV-2 positive by both clinical alone and clinical–lung ultrasonographic integrated assessments; for another 4 patients, the clinical–lung ultrasonographic integrated assessment but not the clinical assessment alone correctly suggested COVID-19 infection.
On the other hand, the integrated evaluation falsely identified 6 patients as possibly infected by SARS-CoV-2 (false-positive result) and 6 other infected patients as unlikely to have COVID-19 pneumonia (false-negative result). The clinical characteristics, final diagnoses, and lung ultrasonographic findings of the 6 patients identified as false positives at the integrated clinical-lung ultrasonographic evaluation are reported in the Table E3, available online at http://www.annemergmed.com.
In addition, for some of the patients who tested negative at the first nasopharyngeal RT-PCR test and for whom the clinical suspicion of SARS-CoV-2 infection remained high, other diagnostic tests such as RT-PCR for other respiratory viruses (n=13), urinary antigens for S pneumoniae and L pneumophila (n=32), and chest CT (if not yet performed; n=39) were also performed according to the clinician’s indication.
The patients with initial RT-PCR and all other tests (ie, clinical evaluation, lung ultrasonography, laboratory, and imaging) not suggestive of SARS-CoV-2 infection were classified as having true COVID-19–negative cases. We were able to follow up all enrolled patients at 30 days. Among those patients classified in the ED as being SARS-CoV-2 negative, no one received a diagnosis of infection or reported symptoms or events consistent with it.
Net reclassification index for positive COVID-19 infections was 14.0% (95% CI 8.1% to 22.1%), whereas that for negative cases was –4.9% (95% CI –1.9% to 10.7%); this estimate is an upper bound of the magnitude of the net reclassification index because, by design, there were no false-positive results for RT-PCR.
The median duration of the lung ultrasonographic evaluation was 5 minutes (IQR 5 to 8 minutes and 5 to 10 minutes for patients with SARS-CoV-2–negative and –positive results, respectively).
Limitations
The absence of a true criterion standard for the diagnosis of SARS-CoV-2 infection is a limitation of our study. We assumed that patients who tested positive at RT-PCR had true-positive cases because only occasional false-positive results have been described.8 , 33 However, as previously discussed, false-negative results with RT-PCR are not uncommon. In our study, an incorporation bias (and possibly a verification bias) may have occurred for patients with negative results for RT-PCR and clinical–lung ultrasonographic integrated assessment and for whom further investigations were not pursued. We could not perform multiple RT-PCR analyses or lung CT scans in patients with lower clinical suspicion, laboratory results not suggestive of SARS-CoV-2 pneumonia, and normal chest radiography results. However, because the bias occurred for both RT-PCR and clinical–lung ultrasonographic integrated assessment, it might have overestimated both sensitivities but was unlikely to affect one more than the other. Moreover, at the 30-day follow-up, none of the patients with negative cases reported symptoms or events consistent with SARS-CoV-2 infection.
Several factors may have led to an overestimation of the diagnostic accuracy of the clinical–lung ultrasonographic integrated assessment in our study or to limitations in its generalizability. First was institutional and provider expertise. The study was conducted in a tertiary academic hospital with extensive experience in the use of point-of-care ultrasonography in the ED; also, the presence of a physician expert in lung ultrasonography (>40 studies) was essential for enrollment. Although lung ultrasonographic evaluation is rapidly increasing in the ED, many centers have not systematically implemented its use in their diagnostic algorithms. Moreover, 12-zone lung ultrasonography is a relatively advanced and time-consuming scanning protocol. The diagnostic accuracy of our clinical–lung ultrasonographic integrated assessment may therefore not be as high in centers less experienced and comfortable with this technique. However, lung ultrasonography has already been shown to be easy to learn and to require a relatively small number of studies to achieve competency.34 , 35 Second was the “unique” recruitment period. Our study was conducted during a short (20-day), single-season, and epidemiologically unparalleled period. Therefore, the utility of lung ultrasonography for the diagnosis of SARS-CoV-2 infection and other viral pneumonias27 outside an outbreak scenario (characterized by high prevalence of a single type of infection) needs to be evaluated in further studies encompassing longer recruitment periods. Third was the cohort strategy. All enrolled patients were evaluated in a dedicated area of the ED to minimize the risk of cross-contamination. This cohort strategy may have led to an overestimation of physicians’ clinical suspicion for SARS-CoV-2 infection. In addition, performance of the initial clinical assessment and lung ultrasonography by the same physician could have introduced a behavioral confirmation bias (ie, tendency to look for and interpret one’s prior belief). Fourth was the lack of prespecified lung ultrasonographic diagnostic criteria. At the performance of the study, limited description of sonographic findings of SARS-CoV-2 pneumonia was available18 , 26 and therefore we decided not to use stringent sonographic definitions. Paradoxically, this pragmatic approach may become a limitation to generalizability when one considers that many ED providers do not have the same experience and expertise in lung ultrasonography as our group has. Fifth was the risk of verification bias. The present reference test for evaluating accuracy of the clinical assessment alone and integrated with lung ultrasonographic evaluation is a test known to be imperfect; specifically, for ruling out COVID-19 infection. In the subgroup of patients with an initially negative result with RT-PCR, we added additional tests in case of a high suspicion of disease to reduce the possible number of true-positive cases classified as false-positive ones. Moreover, we also followed up enrolled patients to confirm disease status. Sixth, our population included only adult patients. Although our results cannot be directly translated to the pediatric population in the absence of further studies, feasibility of lung ultrasonography in children with COVID-19 infection has been reported.36
Discussion
Our study demonstrates that, in adult patients presenting to the ED with symptoms potentially related to SARS-CoV-2 infection, an integrated clinical and pulmonary sonographic approach has high sensitivity and specificity for COVID-19 pneumonia and may therefore help to identify false-negative results occurring with nasopharyngeal specimens analyzed with RT-PCR. To our knowledge, this is the first study to demonstrate, in a cohort of patients with suspected SARS-CoV-2 infection, an improvement of sensitivity with the implementation of lung ultrasonography with clinical evaluation.
Although in laboratory settings SARS-CoV-2 RT-PCR has been shown to be extremely sensitive and specific,33 actual clinical sensitivity of RT-PCR has been reported to be significantly lower,5 likely related to multiple factors, including sampling errors or inappropriate timing of sample collection (either too early or too late in the clinical course of the disease33 , 37). In our study, clinical sensitivity was similar to or even higher than that previously reported,5 , 37 , 38 although a recently published meta-analysis comparing chest CT and initial RT-PCR sensitivity suggested higher sensitivity (89% [95% CI 81% to 94%]).39 However, in this meta-analysis, substantial heterogeneity was identified (I 2=90%), most of the studies had retrospective design, details on RT-PCR procedures were not provided, and often the reference standard was considered the RT-PCR itself.38 Nevertheless, even with RT-PCR sensitivity as high as 89%,39 the number of false-negative results could be unacceptable,5 with substantial risk of disease transmission and further propagation of the infection in the community and health care settings.1 , 40 For example, in our cohort of patients, with prevalence of COVID-19 infection of 46.9% and RT-PCR sensitivity of 80.4%, a negative RT-PCR result would still carry a posttest probability of having the infection of 15%,5 whereas the clinical–lung ultrasonographic integrated assessment, with a sensitivity of 94.4%, would reduce it to 4.9%.
The use of a clinical–lung ultrasonographic integrated approach may be able to improve current limitations of molecular diagnostic testing in patients presenting to the ED with COVID-19 symptoms. Our data demonstrate that our integrated approach improves the sensitivity of the first RT-PCR test performed on the nasopharyngeal sample collected at assessment in the ED, and allows the correct reclassification of nearly 15% of patients who otherwise would have been wrongly identified as having a negative result by RT-PCR. Still, the diagnostic accuracy of the clinical–lung ultrasonographic integrated assessment, although high, cannot justify its use as the sole diagnostic tool to rule out SARS-CoV-2 infection in patients presenting to the ED with symptoms compatible with COVID-19 pneumonia. The smaller, but not negligible, number of false-negative results (n=6) observed with this approach would have exposed other patients and health care workers or people in the community to a considerable risk of disease transmission. Therefore, we suggest the use of the proposed clinical and sonographic integrated approach as a method to better identify potential false-negative nasopharyngeal swab RT-PCR results. Patients with symptoms associated with SARS-CoV-2 infection and lung ultrasonographic findings of viral pneumonia should have further investigations in the presence of negative RT-PCR result at the nasopharyngeal swab, and isolation precautions should be maintained.
In our study, the integrated clinical–lung ultrasonographic evaluation falsely identified 6 patients as possibly infected by SARS-CoV-2 (false positive) and 6 other infected patients as unlikely to have COVID-19 pneumonia (false negative). False-negative cases could have been missed because it was too early in the course of the disease or because the patients did not develop pneumonia. On the contrary, false-positive cases, whose clinical characteristics, final diagnoses, and lung ultrasonographic findings are detailed in Table E3 (available online at http://www.annemergmed.com), were all affected by diseases that could mimic the pathologic findings detected by lung ultrasonography in COVID-19 patients, leading the treating physician, during the pandemic outbreak, to choose COVID-19 as the most likely final diagnosis. It is well known that lung ultrasonography alone is able to discriminate neither different forms of diffuse interstitial syndrome (eg, interstitial lung disease, acute decompensate heart failure, acute respiratory distress syndrome, interstitial pneumonia) nor of lung parenchymal consolidations. On the contrary, the integration of lung ultrasonography with clinical data would increase its diagnostic accuracy in all these conditions.15 , 24 The ability to perform lung ultrasonography at the bedside, the short time required to complete it, the lower costs, and the absence of radiation exposure represent other significant strengths of our integrated approach when compared with other proposed diagnostic strategies, such as integration with chest CT scan.10 , 41
In our study, the median duration of lung ultrasonographic evaluation was 5 minutes (IQR 5 to 8 minutes and 5 to 10 minutes for SARS-CoV-2–negative and –positive patients, respectively). This duration is consistent with what has been reported in other studies.34 , 35 However, providers with limited expertise may take longer to perform the 12-zone lung ultrasonographic examination.
In conclusion, the results of our study suggest that, in patients presenting to the ED with symptoms potentially related to SARS-CoV-2 infection, the integration of lung ultrasonography with clinical evaluation has high sensitivity and specificity for the diagnosis of COVID-19 pneumonia, and it may help to identify false-negative RT-PCR results.
Acknowledgments
The authors acknowledge Butterfly Network Inc (New York, NY) for supporting their ED during the SARS-CoV-2 pandemic with 4 Butterfly iQ devices.
Footnotes
Please see page 386 for the Editor’s Capsule Summary of this article.
Supervising editor: Michael Gottlieb, MD. Specific detailed information about possible conflict of interest for individual editors is available at https://www.annemergmed.com/editors.
Author contributions: EP, AG, MMM, and EL conceived the study. EP, AG, LR, MMM, and EL contributed to the study design, wrote the first draft of the article, and prepared figures and tables. EP, LR, and MMM contributed to the statistical analyses. All authors contributed to data acquisition and interpretation of the results and provided critical input into article drafting and revisions. EP takes responsibility for the paper as a whole.
All authors attest to meeting the four ICMJE.org authorship criteria: (1) Substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data for the work; AND (2) Drafting the work or revising it critically for important intellectual content; AND (3) Final approval of the version to be published; AND (4) Agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Funding and support: By Annals policy, all authors are required to disclose any and all commercial, financial, and other relationships in any way related to the subject of this article as per ICMJE conflict of interest guidelines (see www.icmje.org). The authors have stated that no such relationships exist. The authors received no specific funding for this work.
Readers: click on the link to go directly to a survey in which you can provide feedback to Annals on this particular article.
A podcast for this article is available at www.annemergmed.com.
Contributor Information
Molinette MedUrg Group on Lung Ultrasound:
Federico Baldassa, Paolo Baron, Giordano Bianchi, Busso V, Andrea Conterno, Paola Del Rizzo, Paolo Fascio Pecetto, Francesca Giachino, Andrea Iannaccone, Patrizia Ferrera, Franco Riccardini, Claudia Sacchi, Michela Sozzi, Silvia Totaro, Pasqualina Visconti, Francesca Risi, Francesca Basile, Denise Baricocchi, Alessia Beux, Valentina Beux, Paolo Bima, Irene Cara, Liliana Chichizola, Francesca Dellavalle, Federico Grosso, Giulia Labarile, Matteo Oddi, Marco Ottino, Ilaria Pia, Virginia Scategni, and Astrid Surra
Appendix
Molinette MedUrg Group on Lung Ultrasound
Federico Baldassa, MD, Paolo Baron, MD, Giordano Bianchi, MD, Busso V, Andrea Conterno, MD, Paola Del Rizzo, MD, Paolo Fascio Pecetto, MD, Francesca Giachino, MD, Andrea Iannaccone, MD, Patrizia Ferrera, MD, Franco Riccardini, MD, Claudia Sacchi, MD, Michela Sozzi, MD, Silvia Totaro, MD, Pasqualina Visconti, MD, Francesca Risi, MD, Francesca Basile, MD, Denise Baricocchi, MD, Alessia Beux, MD, Valentina Beux, MD, Paolo Bima, MD, Irene Cara, MD, Liliana Chichizola, MD, Francesca Dellavalle, MD, Federico Grosso, MD, Giulia Labarile, MD, Matteo Oddi, MD, Marco Ottino, MD, Ilaria Pia, MD, Virginia Scategni, MD, Astrid Surra, MD.
Supplementary Data
Vital signs and laboratory results of enrolled patients according to COVID-19 infection status. Abbreviations: IQR, interquartile range; LDH, lactate dehydrogenase; SpO2/FiO2, peripheral blood oxygen saturation/fraction of inspired oxygen.
Table E2. Physicians participating in the study and number of cases they evaluated. Abbreviations: TP, true positives; TN, true negatives; FP, false positives; FN, false negatives
Table E3. Features of patients identified as false positive by the clinical evaluation integrated with lung ultrasound (LUS). Abbreviations: HFpEF, heart failure with preserved ejection fraction; COPD, Chronic obstructive pulmonary disease; COVID-19: coronavirus disease of 2019.
Figure E1.
LUS findings in COVID-19 positive patients. Panel A: irregular and thickened pleural line (arrow); Panel B: multiple small, subpleural consolidations (arrow); Panel C: B-lines and vertical artifacts (asterisks), they might be present in separate and coalescent forms and arising from a peripheral consolidations and/or from pleural points (Peng QY et al, Intensive Care Med, 2020; Volpicelli G et al, Ultrasound J, 2020).
References
- 1.West C.P., Montori V.M., Sampathkumar P. COVID-19 testing: the threat of false-negative results. Mayo Clin Proc. 2020;95:1127–1129. doi: 10.1016/j.mayocp.2020.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sharfstein J.M., Becker S.J., Mello M.M. Diagnostic testing for the novel coronavirus. JAMA. 2020;323:1437–1438. doi: 10.1001/jama.2020.3864. [DOI] [PubMed] [Google Scholar]
- 3.Cheng M.P., Papenburg J., Desjardins M. Diagnostic testing for severe acute respiratory syndrome–related coronavirus 2: a narrative review. Ann Intern Med. 2020;172:726–734. doi: 10.7326/M20-1301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Marcotte L.M., Liao J.M. Incorporating test characteristics into SARS-CoV-2 testing policy—sense and sensitivity. https://jamanetwork.com/channels/health-forum/fullarticle/2764750 Available at: [DOI] [PubMed]
- 5.Woloshin S., Patel N., Kesselheim A.S. False negative tests for SARS-CoV-2 infection—challenges and implications. N Engl J Med. 2020;383:e38. doi: 10.1056/NEJMp2015897. [DOI] [PubMed] [Google Scholar]
- 6.COVID-19: EU recommendations for testing strategies. https://ec.europa.eu/info/sites/info/files/covid19_-_eu_recommendations_on_testing_strategies_v2.pdf Available at:
- 7.European Centre for Disease Prevention and Control An overview of the rapid test situation for COVID-19 diagnosis in the EU/EEA: technical report, April 1st, 2020. https://www.ecdc.europa.eu/sites/default/files/documents/Overview-rapid-test-situation-for-COVID-19-diagnosis-EU-EEA.pdf Available at:
- 8.Sethuraman N., Jeremiah S.S., Ryo A. Interpreting diagnostic tests for SARS-CoV-2. JAMA. 2020;323:2249–2251. doi: 10.1001/jama.2020.8259. [DOI] [PubMed] [Google Scholar]
- 9.Winichakoon P., Chaiwarith R., Liwsrisakun C. Negative nasopharyngeal and oropharyngeal swabs do not rule out COVID-19. J Clin Microbiol. 2020;58 doi: 10.1128/JCM.00297-20. e00297-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Xie X., Zhong Z., Zhao W. Chest CT for typical 2019-nCoV pneumonia: relationship to negative RT-PCR testing. Radiology. 2020;296:E41–E45. doi: 10.1148/radiol.2020200343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Centers for Disease Control and Prevention Algorithm to assist in the interpretation of influenza testing results and clinical decision-making during periods when influenza viruses are circulating in the community. https://www.cdc.gov/flu/professionals/diagnosis/algorithm-results-circulating.htm Available at:
- 12.Centers for Disease Control and Prevention Interim infection prevention and control recommendations for patients with suspected or confirmed coronavirus disease 2019 (COVID-19) in healthcare settings. https://www.cdc.gov/coronavirus/2019-ncov/hcp/infection-control-recommendations.html Available at: Updated April 13, 2020. Accessed May 2, 2020.
- 13.Centers for Disease Control and Prevention Discontinuation of transmission-based precautions and disposition of patients with COVID-19 in healthcare settings (interim guidance) https://www.cdc.gov/coronavirus/2019-ncov/hcp/disposition-hospitalized-patients.html Available at:
- 14.Lichtenstein D., MéZièRe G., Biderman P. The comet-tail artifact: an ultrasound sign of alveolar-interstitial syndrome. Am J Respir Crit Care Med. 1997;156:1640–1646. doi: 10.1164/ajrccm.156.5.96-07096. [DOI] [PubMed] [Google Scholar]
- 15.Pivetta E., Goffi A., Nazerian P. Lung ultrasound integrated with clinical assessment for the diagnosis of acute decompensated heart failure in the emergency department: a randomized controlled trial. Eur J Heart Fail. 2019;21:754–766. doi: 10.1002/ejhf.1379. [DOI] [PubMed] [Google Scholar]
- 16.Volpicelli G., Elbarbary M., Blaivas M. International evidence-based recommendations for point-of-care lung ultrasound. Intensive Care Med. 2012;38:577–591. doi: 10.1007/s00134-012-2513-4. [DOI] [PubMed] [Google Scholar]
- 17.Maw A.M., Hassanin A., Ho P.M. Diagnostic accuracy of point-of-care lung ultrasonography and chest radiography in adults with symptoms suggestive of acute decompensated heart failure: a systematic review and meta-analysis. JAMA Netw Open. 2019;2 doi: 10.1001/jamanetworkopen.2019.0703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Peng Q.-Y., Wang X.-T., Zhang L.-N. Chinese Critical Care Ultrasound Study Group (CCUSG). Findings of lung ultrasonography of novel corona virus pneumonia during the 2019-2020 epidemic. Intensive Care Med. 2020;46:849–850. doi: 10.1007/s00134-020-05996-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Xing C., Li Q., Du H. Lung ultrasound findings in patients with COVID-19 pneumonia. Crit Care. 2020;24:174. doi: 10.1186/s13054-020-02876-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Poggiali E., Dacrema A., Bastoni D. Can lung US help critical care clinicians in the early diagnosis of novel coronavirus (COVID-19) pneumonia? Radiology. 2020;295:E6. doi: 10.1148/radiol.2020200847. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Italian Society of Emergency Medicine Regolamento attività formative - versione del 14/03/2015. http://www.simeu.it/download/articoli/famiglie/249/Regolamento Formazione SIMEU 14Mar2015.pdf Available at:
- 22.Moors G. Exploring the effect of a middle response category on response style in attitude measurement. Qual Quant. 2008;42:779–794. doi: 10.1007/s11135-006-9067-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Bouhemad B., Brisson H., Le-Guen M. Bedside ultrasound assessment of positive end-expiratory pressure–induced lung recruitment. Am J Respir Crit Care Med. 2011;183:341–347. doi: 10.1164/rccm.201003-0369OC. [DOI] [PubMed] [Google Scholar]
- 24.Volpicelli G., Mussa A., Garofalo G. Bedside lung ultrasound in the assessment of alveolar-interstitial syndrome. Am J Emerg Med. 2006;24:689–696. doi: 10.1016/j.ajem.2006.02.013. [DOI] [PubMed] [Google Scholar]
- 25.Jambrik Z., Monti S., Coppola V. Usefulness of ultrasound lung comets as a nonradiologic sign of extravascular lung water. Am J Cardiol. 2004;93:1265–1270. doi: 10.1016/j.amjcard.2004.02.012. [DOI] [PubMed] [Google Scholar]
- 26.Lomoro P., Verde F., Zerboni F. COVID-19 pneumonia manifestations at the admission on chest ultrasound, radiographs, and CT: single-center study and comprehensive radiologic literature review. Eur J Radiol Open. 2020;7:100231. doi: 10.1016/j.ejro.2020.100231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Zhang Y., Li J., Yang J. Lung ultrasonography for the diagnosis of 11 patients with acute respiratory distress syndrome due to bird flu H7N9 infection. Virol J. 2015;12:176. doi: 10.1186/s12985-015-0406-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Peris A., Zagli G., Barbani F. The value of lung ultrasound monitoring in H1N1 acute respiratory distress syndrome. Anaesthesia. 2010;65:294–297. doi: 10.1111/j.1365-2044.2009.06210.x. [DOI] [PubMed] [Google Scholar]
- 29.WHO Global Surveillance for human infection with coronavirus disease (COVID-19) https://www.who.int/publications-detail/global-surveillance-for-human-infection-with-novel-coronavirus-(2019-ncov) Available at:
- 30.DeLong E.R., DeLong D.M., Clarke-Pearson D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–845. [PubMed] [Google Scholar]
- 31.McNemar Q. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika. 1947;12:153–157. doi: 10.1007/BF02295996. [DOI] [PubMed] [Google Scholar]
- 32.Pencina M.J., D’Agostino R.B., D’Agostino R.B. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–172. doi: 10.1002/sim.2929. discussion 207-212. [DOI] [PubMed] [Google Scholar]
- 33.SARS-CoV-2 molecular assay evaluation: results. https://www.finddx.org/covid-19/sarscov2-eval-molecular/molecular-eval-results/ Available at:
- 34.See K.C., Ong V., Wong S.H. Lung ultrasound training: curriculum implementation and learning trajectory among respiratory therapists. Intensive Care Med. 2016;42:63–71. doi: 10.1007/s00134-015-4102-9. [DOI] [PubMed] [Google Scholar]
- 35.Rouby J.-J., Arbelot C., Gao Y. Training for lung ultrasound score measurement in critically ill patients. Am J Respir Crit Care Med. 2018;198:398–401. doi: 10.1164/rccm.201802-0227LE. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Musolino A.M., Supino M.C., Buonsenso D. Lung ultrasound in children with COVID-19: preliminary findings. Ultrasound Med Biol. 2020;46:2094–2098. doi: 10.1016/j.ultrasmedbio.2020.04.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Wang W., Xu Y., Gao R. Detection of SARS-CoV-2 in different types of clinical specimens. JAMA. 2020;323:1843–1844. doi: 10.1001/jama.2020.3786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Long C., Xu H., Shen Q. Diagnosis of the coronavirus disease (COVID-19): rRT-PCR or CT? Eur J Radiol. 2020;126:108961. doi: 10.1016/j.ejrad.2020.108961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Kim H., Hong H., Yoon S.H. Diagnostic performance of CT and reverse transcriptase–polymerase chain reaction for coronavirus disease 2019: a meta-analysis. Radiology. 2020;296:E145–E155. doi: 10.1148/radiol.2020201343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Bai Y., Yao L., Wei T. Presumed asymptomatic carrier transmission of COVID-19. JAMA. 2020;323:1406–1407. doi: 10.1001/jama.2020.2565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Tavare A.N., Braddy A., Brill S. Managing high clinical suspicion COVID-19 inpatients with negative RT-PCR: a pragmatic and limited role for thoracic CT. Thorax. 2020;75:537–538. doi: 10.1136/thoraxjnl-2020-214916. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Vital signs and laboratory results of enrolled patients according to COVID-19 infection status. Abbreviations: IQR, interquartile range; LDH, lactate dehydrogenase; SpO2/FiO2, peripheral blood oxygen saturation/fraction of inspired oxygen.
Table E2. Physicians participating in the study and number of cases they evaluated. Abbreviations: TP, true positives; TN, true negatives; FP, false positives; FN, false negatives
Table E3. Features of patients identified as false positive by the clinical evaluation integrated with lung ultrasound (LUS). Abbreviations: HFpEF, heart failure with preserved ejection fraction; COPD, Chronic obstructive pulmonary disease; COVID-19: coronavirus disease of 2019.