Table III.
Average performance comparison of eight competing algorithms on three data sets in terms of average AUC, Macro F1, and Micro F1. See the caption of Table II for detailed explanations.
| Data (n, d, m) | Science (6345, 24002,22) | MediaMill1 (8000, 120, 80) | MediaMill2 (8000, 120, 100) | |
|---|---|---|---|---|
| Average AUC | MixedNorm | 75.746 ± 1.423 | 72.571 ± 0.363 | 65.932 ± 0.321 |
| MTRL | 73.389 ± 0.417 | 71.447 ± 0.185 | 64.980 ± 0.522 | |
| MTL(Ω&Σ) | 75.165 ± 0.439 | 70.625 ± 0.570 | 64.303 ± 0.241 | |
| TraceNorm | 71.478 ± 0.293 | 69.469 ± 0.425 | 60.882 ± 1.239 | |
| ASO | 75.535 ± 1.591 | 71.067 ± 0.315 | 65.444 ± 0.424 | |
| OneNorm | 74.456 ± 1.076 | 70.453 ± 0.762 | 64.219 ± 0.566 | |
| IndSVM | 70.220 ± 0.065 | 67.088 ± 0.231 | 57.437 ± 0.594 | |
| RidgeReg | 69.177 ± 0.863 | 66.284 ± 0.482 | 56.605 ± 0.709 | |
| Macro F1 | MixedNorm | 38.281 ± 0.011 | 9.706 ± 0.229 | 7.981 ± 0.011 |
| MTRL | 36.320 ± 0.421 | 8.625 ± 0.507 | 7.112 ± 0.303 | |
| MTL(Ω&Σ) | 38.198 ± 0.348 | 8.225 ± 0.108 | 6.785 ± 0.624 | |
| TraceNorm | 36.447 ± 0.055 | 8.562 ± 0.027 | 6.765 ± 0.039 | |
| ASO | 36.278 ± 0.183 | 8.023 ± 0.196 | 6.150 ± 0.023 | |
| OneNorm | 37.981 ± 0.200 | 8.579 ± 0.157 | 6.447 ± 0.133 | |
| IndSVM | 35.175 ± 0.177 | 6.207 ± 0.410 | 5.175 ± 0.177 | |
| RidgeReg | 35.066 ± 0.196 | 7.724 ± 0.190 | 5.066 ± 0.096 | |
| Micro F1 | MixedNorm | 52.619 ± 0.042 | 61.426 ± 0.062 | 60.117 ± 0.019 |
| MTRL | 51.212 ± 0.165 | 60.217 ± 0.311 | 59.443 ± 0.508 | |
| MTL(Ω&Σ) | 52.612 ± 1.192 | 59.578 ± 0.631 | 59.848 ± 1.140 | |
| TraceNorm | 49.124 ± 0.409 | 59.090 ± 0.117 | 58.317 ± 1.010 | |
| ASO | 49.616 ± 0.406 | 59.415 ± 0.005 | 59.079 ± 1.720 | |
| OneNorm | 52.733 ± 0.394 | 60.594 ± 0.026 | 59.221 ± 0.390 | |
| IndSVM | 48.574 ± 0.265 | 57.825 ± 0.272 | 56.525 ± 0.317 | |
| RidgeReg | 47.454 ± 0.255 | 57.752 ± 0.210 | 56.982 ± 0.455 | |