Table 2.
Diagnostic performance for each patient among COVIDNet and eight radiologists on the secondary test cohort.
| Accuracy | Sensitivity | Specificity | PPV | NPV | F1-score | |
|---|---|---|---|---|---|---|
| COVIDNet | 94.3% (92.1–96.1%) | 93.1% (89.7–96.2%) | 95.1% (92.5–97.5%) | 93.9% (90.6–96.8%) | 94.5% (91.7–96.9%) | 93.5% (91.1–95.7%) |
| COVID-19 radiologists* | ||||||
| Radiologist A (6 year) | 82.1% | 76.4% | 86.8% | 82.4% | 82.0% | 79.2% |
| Radiologist B (8 year) | 85.1% | 80.7% | 88.6% | 85.1% | 85.1% | 82.8% |
| Radiologist C (13 year) | 83.3% | 73.8% | 91.0% | 86.8% | 81.2% | 79.7% |
| Radiologist D (18 year) | 85.2% | 75.1% | 93.4% | 90.2% | 82.3% | 81.9% |
| Average | 83.9% | 76.5% | 90.0% | 86.1% | 79.7% | 80.9% |
| non-COVID-19 radiologists§ | ||||||
| Radiologist E (10 year) | 78.4% | 82.4% | 75.1% | 72.7% | 84.1% | 77.2% |
| Radiologist F (11 year) | 81.0% | 64.8% | 94.1% | 89.9% | 76.9% | 75.3% |
| Radiologist G (21 year) | 72.4% | 45.5% | 94.1% | 86.2% | 68.2% | 59.5% |
| Radiologist H (23 year) | 83.9% | 79.9% | 87.2% | 83.4% | 84.3% | 81.6% |
| Average | 78.9% | 68.2% | 87.6% | 83.1% | 78.4% | 73.4% |
Four radiologists were from COVID-19 designated hospitals and the others were not. For COVID-19 radiologists, radiologist A-D had chest CT image trained experience of 6, 8, 13, and 18 years, respectively. Meanwhile, for the non-COVID-19 radiologist, radiologist E–H had 10, 11, 21, and 23 years of experience, respectively. PPV positive predictive value, NPV negative predictive value. *COVID-19 radiologists: radiologists working at the COVID-19 designated hospitals; §non-COVID-19 radiologists: radiologists not working at the COVID-19 designated hospitals.