Table 1.
Site | Total No. of Cases | Original Radiologist Reports/AI Analysis | Original Radiologist Reports/AI Analysis | |||||||
---|---|---|---|---|---|---|---|---|---|---|
TP | FP | TN | FN | Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | NPV (95% CI) | Accuracy (95% CI) | ||
A | 106 | 7/11 | 2/4 | 72/69 | 25/22 | 21.9 (9.3, 40)/ 33.3 (18, 51.8) |
97.3 (90.6, 99.7)/ 94.5 (86.6, 98.5) |
77.8 (43.5, 94.1)/ 73.3(48.6, 88.9) |
74.2 (70.5, 77.6)/ 75.8 (71, 80.1) |
74.5 (65.1, 82.5)/ 75.5 (66.1, 83.3) |
B | 269 | 17/51 | 11/14 | 172/167 | 69/37 | 19.8 (12, 29.8)/ 58 (47, 68.4) |
94 (89.5,97)/ 92.3 (87.4, 95.7) |
60.7 (43.1, 75.9)/ 78.5(68.1, 86.1) |
71.4 (69, 73.6)/ 81.9 (77.9, 85.3) |
70.3 (64.4, 75.7)/ 81.0 (75.8, 85.5) |
C | 135 | 6/11 | 4/8 | 105/99 | 20/17 | 23 (9, 43.6)/ 39.3 (21.5, 59.4) |
96.3 (90.9, 99)/ 92.5 (85.8, 96.7) |
60 (31.3, 83.1)/ 57.9 (38, 75.6) |
84 (80.9, 86.7)/ 85.3 (81.4, 88.7) |
82.2 (74.7, 88.3)/ 81.5 (73.9, 87.6) |
All sites | 510 | 30/73 | 17/26 | 349/335 | 114/76 | 20.8 (14.5, 28.4)/ 49 (40.7, 57.3) |
95.4 (92.7,97.3)/ 92.8 (89.6, 95.2) |
63.8 (50.1, 75.6)/ 73.7 (65.2, 80.8) |
75.4 (73.7, 77)/ 81.5 (79, 83.8) |
74.3 (70.3, 78.1)/ 80.3 (76.3, 83.4) |
TP, true positive; FP, false positive; TN, true negative; FN, false negative; PPV, positive predictive value; and NPV, negative predictive value. Numbers in brackets represent the 95% confidence interval.