Table 3.
Diagnostic performance of human readers and the AI system.
| Sensitivity | Specificity | AUC (95% CI) | |
|---|---|---|---|
| AI | 0.926 | 0.828 | 0.925 (0.878–0.971) |
| Reader 1 | 0.833 | 0.836 | 0.872 (0.811–0.933) |
| Reader 1 with AI system | 0.889 | 0.802 | 0.893 (0.837–0.948) |
| Reader 2 | 0.889 | 0.776 | 0.904 (0.849–0.959) |
| Reader 2 with AI system | 0.907 | 0.759 | 0.915 (0.863–0.967) |
| Reader 3 | 0.833 | 0.853 | 0.876 (0.816–0.936) |
| Reader 3 with AI system | 0.874 | 0.844 | 0.893 (0.847–0.956) |
| Reader 4 | 0.862 | 0.833 | 0.887 (0.829–0.945) |
| Reader 4 with AI system | 0.889 | 0.845 | 0.902 (0.847–0.956) |
| All Human Readers | 0.847 | 0.841 | 0.884 (0.854–0.920) |
| All Human Readers with AI system | 0.889 | 0.823 | 0.899 (0.872–0.929) |
Cutoff value was defined as 2%. AI: artificial intelligence; AUC: area under the receiver operating characteristic curve; CI: confidence interval.