Table 4.
The comparison of diagnostic performance between HT-CAD and senior or junior radiologists
| Accuracy(95%CI) | Sensitivity(95%CI) | Specificity(95%CI) | PPV | NPV | AUC | F1(avg) | κ value | |
|---|---|---|---|---|---|---|---|---|
| Performance | ||||||||
| CNN model | 0.892 (0.881-0.902) | 0.890 (0.868-0.911) | 0.895 (0.874-0.913) | 0.904 | 0.880 | 0.940 | 0.892 | 0.784 |
| Radiologists | ||||||||
| Senior | 0.801 (0.784-0.818) | 0.805 (0.786-0.822) | 0.797 (0.778-0.814) | 0.805 | 0.797 | 0.801 | 0.805 | 0.602 |
| Junior | 0.654 (0.639-0.667) | 0.660 (0.644-0.676) | 0.647 (0.626-0.667) | 0.662 | 0.646 | 0.654 | 0.661 | 0.308 |
| P-value | ||||||||
| Senior vs CNN model | <0.001 | <0.001 | <0.001 | |||||
| Junior vs CNN model | <0.001 | <0.001 | <0.001 | |||||
| Senior vs junior | <0.001 | <0.001 | <0.001 |
Abbreviations: PPV, positive predictive value; NPV, negative predictive value; AUC, area under the curve; κ value, Fleiss’s κ value; CNN, convolutional neural networks.