Table 2.
Classification of subjects in the test dataset using the curriculum learning-based and baseline models.
| AMC | SNUBH | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUC | Acc | Sen | Spe | PPV | NPV | AUC | Acc | Sen | Spe | PPV | NPV | ||
| Nodule | Baseline | 86.7 | 83.8 | 83.9 | 83.5 | 97.9 | 35.7 | 79.3 | 70.6 | 69.1. | 77.4. | 92.6 | 37.7 |
|
Curriculum learning |
92.8 | 96.1 | 98.2 | 75.8 | 97.4 | 82.1 | 82.7 | 85.3 | 89.9 | 66.5 | 91.7 | 61.6 | |
| Consolidation | Baseline | 87.3 | 90.8 | 92.2 | 68.9 | 97.9 | 37.4 | 84.5 | 77.7 | 77.2 | 80.4 | 95.7 | 38.4 |
|
Curriculum learning |
89.3 | 95.3 | 98.1 | 54.6 | 97.0 | 65.7 | 91.2 | 89.7 | 94.5 | 62.6 | 93.5 | 66.7 | |
|
Interstitial opacity |
Baseline | 97.5 | 98.1 | 98.4 | 88.5 | 99.7 | 60.5 | 98.9 | 96.1 | 96.5 | 94.4 | 98.4 | 88.0 |
|
Curriculum learning |
98.2 | 98.7 | 99.2 | 80.8 | 99.5 | 75.0 | 99.8 | 97.7 | 98.0 | 96.6 | 99.0 | 93.0 | |
|
Pleural effusion |
Baseline | 99.1 | 97.6 | 98.2 | 94.4 | 99.0 | 89.8 | 97.7 | 93.1 | 92.6 | 95.4 | 98.9 | 73.9 |
|
Curriculum learning |
99.3 | 98.1 | 98.6 | 94.8 | 99.1 | 92.1 | 98.9 | 95.3 | 95.1 | 96.4 | 99.2 | 81.1 | |
| Pneumothorax | Baseline | 94.8 | 97.2 | 97.9 | 80.0 | 99.3 | 57.8 | 97.1 | 95.6 | 96.4 | 91.4 | 98.2 | 84.3 |
|
Curriculum learning |
95.3 | 99.3 | 99.9 | 81.5 | 99.3 | 96.4 | 99.1 | 98.3 | 99.2 | 94.1 | 98.8 | 96.2 | |
| Abnormalities | Baseline | 96.7 | 92.2 | 80.2 | 98.8 | 97.5 | 90.2 | 99.9 | 98.2 | 98.4 | 99.5 | 99.9 | 92.8 |
|
Curriculum learning |
99.0 | 94.7 | 85.4 | 99.8 | 99.7 | 92.5 | 100.0 | 98.3 | 97.9 | 100.0 | 100.0 | 92.0 | |
*Paired t-test; overall abnormalities: p < 2.667e-10, nodule[s]: p < 5.705e-05, consolidation: p < 0.002456, interstitial opacity: p < 0.01225, pleural effusion: p < 0.04229, and pneumothorax: p < 0.01329.
Abbreviations: AMC, Asan Medical Center; SNUBH, Seoul National University Bundang Hospital.