Table 3.
Localization performances of computer-aided diagnosis (CAD) systems and annotators
| Annotations | Detection-based CAD system | Segmentation-based CAD system | ||||
|---|---|---|---|---|---|---|
| Prediction-ground truth TP-Dice | Inter-annotator TP-Dice | p-value | Prediction-ground truth TP-Dice | Inter-annotator TP-Dice | p-value | |
| Pneumothorax | 0.758 (0.707–0.806) | 0.717 (0.665–0.766) | < 0.001 | 0.681 (0.642–0.721) | 0.669 (0.653–0.654) | < 0.001 |
| Large pneumothorax | 0.883 (0.840–0.921) | 0.767 (0.690–0.836) | < 0.001 | 0.769 (0.715–0.823) | 0.756 (0.739–0.741) | < 0.001 |
| Medium pneumothorax | 0.708 (0.625–0.798) | 0.677 (0.574–0.771) | < 0.001 | 0.693 (0.628–0.757) | 0.639 (0.651–0.653) | < 0.001 |
| Small pneumothorax | 0.574 (0.446–0.701) | 0.686 (0.596–0.771) | > 0.99 | 0.558 (0.489–0.627) | 0.616 (0.589–0.591) | > 0.99 |
Data expressed as point estimates (95% confidence intervals)
Prediction-ground truth TP-Dice, coefficient indicating agreement between predicted and ground-truth results; inter-annotator TP-Dice, coefficient indicating agreement between two annotators