Table 2.
Diagnostic performances of computer-aided diagnosis (CAD) systems and radiology reports
| Readers | AUC | AUPRC | Sensitivity | Specificity | PPV | NPV |
|---|---|---|---|---|---|---|
| Diagnosing pneumothorax | ||||||
| Detection-based CAD system | 0.940 (0.907–0.967) | 0.833 (0.775–0.884) | 0.687 (0.598–0.776) | 0.991 (0.984–0.996) | 0.892 (0.823–0.954) | 0.966 (0.955–0.977) |
| Segmentation-based CAD system | 0.979 (0.963–0.991) | 0.910 (0.863–0.948) | 0.926 (0.874–0.972) | 0.926 (0.909–0.942) | 0.584 (0.510–0.657) | 0.991 (0.985–0.997) |
| Radiology reports | 0.953 (0.927–0.976) | 0.866 (0.802–0.923) | 0.914 (0.862–0.961) | 0.992 (0.986–0.997) | 0.936 (0.889–0.976) | 0.989 (0.981–0.995) |
| Diagnosing large pneumothorax | ||||||
| Detection-based CAD system | 0.997 (0.993-1.000) | 0.950 (0.895–0.987) | 0.946 (0.861-1.000) | 0.991 (0.984–0.996) | 0.788 (0.659–0.903) | 0.998 (0.995-1.000) |
| Segmentation-based CAD system | 0.999 (0.998-1.000) | 0.977 (0.933-1.000) | 1.000 (1.000–1.000) | 0.926 (0.909–0.942) | 0.336 (0.248–0.426) | 1.000 (1.000–1.000) |
| Radiology reports | 0.996 (0.993–0.998) | 0.820 (0.697–0.927) | 1.000 (1.000–1.000) | 0.992 (0.985–0.997) | 0.820 (0.697–0.927) | 1.000 (1.000–1.000) |
| Diagnosing medium pneumothorax | ||||||
| Detection-based CAD system | 0.947 (0.880–0.991) | 0.779 (0.630–0.907) | 0.763 (0.600-0.917) | 0.991 (0.984–0.996) | 0.718 (0.556–0.864) | 0.993 (0.987–0.998) |
| Segmentation-based CAD system | 0.976 (0.925–0.999) | 0.897 (0.792–0.973) | 0.967 (0.889-1.000) | 0.926 (0.909–0.942) | 0.290 (0.203–0.381) | 0.999 (0.997-1.000) |
| Radiology reports | 0.996 (0.993–0.998) | 0.791 (0.657–0.923) | 1.000 (1.000–1.000) | 0.992 (0.985–0.997) | 0.791 (0.657–0.923) | 1.000 (1.000–1.000) |
| Diagnosing small pneumothorax | ||||||
| Detection-based CAD system | 0.886 (0.822–0.943) | 0.478 (0.326–0.637) | 0.407 (0.257–0.565) | 0.991 (0.985–0.996) | 0.652 (0.462–0.833) | 0.975 (0.965–0.985) |
| Segmentation-based CAD system | 0.964 (0.942–0.981) | 0.636 (0.476–0.778) | 0.833 (0.711–0.941) | 0.926 (0.909–0.942) | 0.330 (0.242–0.420) | 0.992 (0.986–0.998) |
| Radiology reports | 0.984 (0.955–0.998) | 0.818 (0.698–0.911) | 0.975 (0.917-1.000) | 0.992 (0.986–0.996) | 0.837 (0.723–0.923) | 0.999 (0.997-1.000) |
Data expressed as point estimates (95% confidence intervals)
AUC, area under receiver operating characteristics curve; AUPRC, area under precision-recall curve; NPV, negative predictive value; PPV, positive predictive value