Table 3.
Dataset | Training strategy | Cardiomegaly | Pleural effusion | Pneumonia | Atelectasis | Consolidation | Pneumothorax | No abnormality | Average |
---|---|---|---|---|---|---|---|---|---|
VinDr-CXR | Local | 95.0 ± 0.5 | 97.2 ± 0.8 | 90.6 ± 0.9 | 86.9 ± 1.7 | 91.1 ± 1.7 | 87.7 ± 3.9 | 90.7 ± 0.6 | 91.3 ± 3.9 |
Collaborative | 96.9 ± 0.3 | 98.4 ± 0.5 | 91.2 ± 1.0 | 92.8 ± 1.1 | 96.2 ± 0.7 | 98.1 ± 0.8 | 93.8 ± 0.5 | 95.3 ± 2.6 | |
P value | 0.001 | 0.018 | 0.699 | 0.001 | 0.001 | 0.003 | 0.001 | 0.001 | |
ChestX-ray14 | Local | 88.1 ± 0.5 | 81.4 ± 0.3 | 69.5 ± 1.0 | 75.3 ± 0.4 | 73.6 ± 0.5 | 84.3 ± 0.4 | 72.3 ± 0.3 | 77.8 ± 6.4 |
Collaborative | 90.2 ± 0.4 | 82.3 ± 0.3 | 73.2 ± 1.0 | 76.9 ± 0.4 | 75.3 ± 0.5 | 86.7 ± 0.3 | 72.5 ± 0.3 | 79.6 ± 6.4 | |
P value | 0.001 | 0.001 | 0.001 | 0.001 | 0.001 | 0.001 | 0.919 | 0.001 | |
CheXpert | Local | 87.7 ± 0.3 | 87.6 ± 0.2 | 76.8 ± 0.9 | 68.8 ± 0.4 | 75.1 ± 0.5 | 86.3 ± 0.3 | 87.7 ± 0.3 | 81.4 ± 7.2 |
Collaborative | 87.1 ± 0.3 | 88.3 ± 0.2 | 74.9 ± 1.0 | 69.3 ± 0.4 | 75.1 ± 0.5 | 86.6 ± 0.3 | 87.8 ± 0.3 | 81.3 ± 7.3 | |
P value | 0.001 | 0.001 | 0.002 | 0.039 | 0.471 | 0.946 | 0.802 | 0.175 | |
MIMIC-CXR | Local | 81.5 ± 0.2 | 90.8 ± 0.1 | 74.4 ± 0.5 | 81.6 ± 0.2 | 82.4 ± 0.4 | 86.8 ± 0.4 | 85.4 ± 0.2 | 83.3 ± 4.8 |
Collaborative | 79.2 ± 0.2 | 91.1 ± 0.1 | 73.6 ± 0.5 | 81.5 ± 0.2 | 82.0 ± 0.4 | 87 ± 0.4 | 84.8 ± 0.2 | 82.7 ± 5.2 | |
P value | 0.001 | 0.001 | 0.001 | 0.264 | 0.077 | 0.686 | 0.001 | 0.001 | |
PadChest | Local | 91.9 ± 0.3 | 95.3 ± 0.3 | 83.0 ± 0.7 | 81.6 ± 0.6 | 88.1 ± 0.8 | 89.5 ± 1.3 | 84.3 ± 0.3 | 87.7 ± 4.7 |
Collaborative | 92.8 ± 0.2 | 96.0 ± 0.3 | 84.5 ± 0.6 | 85.1 ± 0.6 | 91.0 ± 0.6 | 92.6 ± 1.3 | 85.4 ± 0.3 | 89.6 ± 4.3 | |
P value | 0.001 | 0.001 | 0.002 | 0.001 | 0.001 | 0.009 | 0.001 | 0.001 |
See Table 2 for further details on table organizaiton.