Table 6.
Area under the ROC-curve (AUC) on the test data for the participating algorithms that computed probabilistic outputs. CI = 95% confidence interval estimated with bootstrapping.
| Rank | Algorithm | AUC [%] (CI) | AUCCN [%] (CI) | AUCMCI [%] (CI) | AUCAD [%] (CI) |
|---|---|---|---|---|---|
| 1.5 | Sørensen-equal | 78.8 (75.6 – 82.0) | 86.3 (81.8 – 89.3) | 63.1 (56.6 – 68.3) | 87.5 (83.4 – 91.1) |
| 1.5 | Sørensen-optimized | 78.8 (75.5 – 82.1) | 86.3 (81.9 – 89.3) | 62.7 (56.8 – 68.4) | 86.7 (82.3 – 90.4) |
| 3 | Abdulkadir | 77.7 (74.2 – 81.0) | 85.6 (81.4 – 89.0) | 59.9 (54.1 – 66.4) | 86.7 (82.3 – 90.3) |
| 4 | Wachinger-enetNorm | 77.0 (73.6 – 80.3) | 83.3 (78.5 – 87.0) | 59.4 (52.9 – 65.5) | 88.2 (83.8 – 91.4) |
| 5 | Ledig-ALL | 76.7 (73.6 – 79.8) | 86.6 (82.7 – 89.8) | 59.7 (53.3 – 65.1) | 84.9 (79.7 – 88.7) |
| 6 | Ledig-GRAD | 75.4 (72.4 – 78.6) | 85.6 (81.5 – 88.9) | 60.3 (53.9 – 66.5) | 81.7 (76.3 – 86.1) |
| 7 | Ledig-MBL | 75.2 (72.0 – 78.1) | 82.5 (77.8 – 86.0) | 57.3 (50.9 – 63.6) | 86.4 (81.4 – 89.9) |
| 8 | Wachinger-step1 | 74.6 (70.8 – 78.1) | 79.1 (73.5 – 83.1) | 55.0 (48.5 – 61.4) | 89.2 (85.3 – 92.3) |
| 9.5 | Wachinger-step1Norm | 74.3 (70.5 – 77.9) | 79.3 (74.1 – 83.5) | 55.5 (48.5 – 61.6) | 87.7 (83.7 – 91.1) |
| 9.5 | Wachinger-man | 74.3 (70.9 – 77.9) | 80.6 (75.7 – 84.9) | 56.3 (49.7 – 63.0) | 86.1 (81.7 – 90.0) |
| 11 | Sensi | 73.8 (70.2 – 77.5) | 81.7 (77.1 – 85.8) | 55.0 (48.8 – 61.0) | 83.9 (78.8 – 87.7) |
| 12 | Ledig-CORT | 73.7 (69.9 – 77.2) | 79.6 (75.0 – 84.2) | 58.9 (52.9 – 64.9) | 82.4 (76.7 – 87.3) |
| 13 | Wachinger-step2 | 72.7 (68.9 – 76.4) | 79.3 (74.0 – 83.5) | 51.9 (45.3 – 58.7) | 86.5 (81.9 – 90.3) |
| 14 | Ledig-VOL | 68.4 (64.5 – 72.5) | 75.7 (70.3 – 81.0) | 50.1 (44.1 – 56.4) | 79.0 (73.3 – 83.5) |
| 15 | Amoroso | 67.2 (63.3 – 71.3) | 73.4 (67.8 – 78.7) | 56.0 (49.7 – 61.9) | 72.3 (66.2 – 77.5) |
| 16 | Tangaro | 67.1 (63.2 – 71.0) | 73.1 (67.8 – 78.0) | 52.6 (45.9 – 58.6) | 75.8 (70.2 – 80.6) |
| 17 | Dolph | 63.0 (59.6 – 67.2) | 66.2 (61.3 – 70.3) | 55.4 (50.0 – 60.0) | 65.8 (60.6 – 71.3) |
| 18 | Cárdenas-Peña | 55.9 (51.2 – 59.9) | 57.8 (51.6 – 63.4) | 50.0 (43.9 – 57.1) | 59.8 (53.5 – 65.7) |
| 19 | Smith | 50.4 (46.7 – 54.6) | 54.1 (48.0 – 60.0) | 50.6 (45.0 – 57.1) | 46.6 (40.0 – 53.6) |