Table 6.
Annotation performance in terms of AUC, macro F1, micro F1, sensitivity, and specificity for image groups in stage range 13–16.
Measure | # of terms | MLLS | SVM | PMKSIFT | PMKcomp |
AUC | 10 | 87.72 ± 0.37 | 86.66 ± 0.35 | 82.51 ± 0.43 | 82.53 ± 0.62 |
20 | 84.61 ± 0.35 | 83.25 ± 0.35 | 76.62 ± 0.41 | 77.09 ± 0.55 | |
30 | 82.92 ± 0.45 | 81.13 ± 0.46 | 73.13 ± 0.61 | 74.05 ± 0.68 | |
40 | 77.25 ± 0.40 | 79.56 ± 0.32 | 70.37 ± 0.43 | 71.48 ± 0.45 | |
50 | 79.38 ± 0.50 | 78.17 ± 0.38 | 68.52 ± 0.50 | 69.15 ± 0.73 | |
60 | 78.11 ± 0.55 | 77.18 ± 0.46 | 67.41 ± 0.68 | 68.24 ± 0.48 | |
macro F1 | 10 | 64.91 ± 0.82 | 62.97 ± 0.68 | 54.51 ± 0.88 | 58.42 ± 0.94 |
20 | 49.90 ± 0.75 | 50.45 ± 0.62 | 31.61 ± 0.99 | 41.02 ± 0.72 | |
30 | 42.57 ± 0.78 | 41.92 ± 0.76 | 21.28 ± 0.62 | 31.04 ± 0.82 | |
40 | 32.26 ± 0.57 | 35.26 ± 0.63 | 15.75 ± 0.39 | 23.78 ± 0.48 | |
50 | 29.13 ± 0.66 | 29.74 ± 0.45 | 12.65 ± 0.40 | 19.22 ± 0.53 | |
60 | 25.18 ± 0.68 | 25.49 ± 0.55 | 10.56 ± 0.31 | 16.13 ± 0.48 | |
micro F1 | 10 | 68.27 ± 0.52 | 66.67 ± 0.45 | 60.98 ± 0.69 | 62.07 ± 0.90 |
20 | 57.62 ± 0.51 | 55.66 ± 0.65 | 48.75 ± 0.61 | 50.56 ± 0.59 | |
30 | 53.02 ± 0.68 | 48.11 ± 0.90 | 42.88 ± 0.66 | 45.48 ± 0.82 | |
40 | 46.92 ± 0.55 | 44.26 ± 0.92 | 39.77 ± 0.43 | 42.55 ± 0.67 | |
50 | 48.76 ± 0.53 | 43.53 ± 0.77 | 38.55 ± 0.69 | 41.07 ± 0.89 | |
60 | 48.02 ± 0.61 | 42.84 ± 0.76 | 37.77 ± 0.57 | 40.65 ± 0.49 | |
Sensitivity | 10 | 70.14 ± 1.39 | 70.21 ± 1.53 | 51.20 ± 0.97 | 67.21 ± 1.30 |
20 | 52.99 ± 1.57 | 61.45 ± 1.22 | 28.55 ± 0.98 | 46.84 ± 1.05 | |
30 | 44.46 ± 1.26 | 55.56 ± 1.17 | 19.02 ± 0.60 | 35.43 ± 0.75 | |
40 | 34.04 ± 1.18 | 48.94 ± 1.78 | 14.07 ± 0.38 | 27.93 ± 0.63 | |
50 | 29.51 ± 0.94 | 40.45 ± 1.20 | 11.25 ± 0.39 | 24.04 ± 0.63 | |
60 | 25.25 ± 0.92 | 34.53 ± 1.04 | 9.36 ± 0.30 | 21.28 ± 0.51 | |
Specificity | 10 | 85.89 ± 0.61 | 83.65 ± 0.87 | 89.31 ± 0.50 | 84.17 ± 0.86 |
20 | 90.32 ± 0.56 | 86.31 ± 0.67 | 94.69 ± 0.22 | 91.16 ± 0.48 | |
30 | 92.93 ± 0.31 | 87.65 ± 0.67 | 96.78 ± 0.15 | 94.38 ± 0.37 | |
40 | 93.88 ± 0.36 | 89.38 ± 0.78 | 97.64 ± 0.12 | 95.84 ± 0.21 | |
50 | 95.62 ± 0.23 | 91.50 ± 0.52 | 98.18 ± 0.10 | 96.59 ± 0.29 | |
60 | 96.38 ± 0.19 | 92.74 ± 0.38 | 98.50 ± 0.08 | 97.23 ± 0.12 |
See the caption of Table 2 for detailed explanations.