Table 5.
Detailed performance measures of InSight when tested and trained with raw data dropouts. Operating points were chosen according to the same procedure as in Table 4.
|
|
InSight, 0 hour, 0% dropout |
InSight, 0 hour, 10% dropout |
InSight, 0 hour, 20% dropout |
InSight, 0 hour, 40% dropout |
InSight, 0 hour, 60% dropout |
InSight, 4 hour, 0% dropout |
InSight, 4 hour, 60% dropout |
| AUROCa | 0.89 (SD 0.010) | 0.87 (SD 0.006) | 0.84 (SD 0.011) | 0.83 (SD 0.012) | 0.78 (SD 0.013) | 0.75 (SD 0.008) | 0.73 (SD 0.010) |
| APRb | 0.60 (SD 0.022) | 0.57 (SD 0.015) | 0.54 (SD 0.022) | 0.49 (SD 0.021) | 0.40 (SD 0.015) | 0.27 (SD 0.012) | 0.27 (SD 0.009) |
| Sensitivity | 0.80 | 0.80 | 0.80 | 0.80 | 0.80 | 0.80 | 0.80 |
| Specificity | 0.82 | 0.78 | 0.72 | 0.68 | 0.59 | 0.55 | 0.52 |
| F1c | 0.49 | 0.45 | 0.40 | 0.37 | 0.32 | 0.30 | 0.29 |
| DORd | 17.90 | 14.14 | 10.23 | 8.31 | 5.76 | 4.95 | 4.38 |
| LR+e | 4.37 | 3.62 | 2.85 | 2.46 | 1.95 | 1.79 | 1.67 |
| LR-f | 0.24 | 0.26 | 0.28 | 0.30 | 0.34 | 0.36 | 0.38 |
| Accuracy | 0.82 | 0.78 | 0.73 | 0.69 | 0.61 | 0.58 | 0.55 |
aAUROC: area under the receiver operating characteristic curve.
bAPR: area under the precision-recall curve.
cF1: harmonic mean of precision and recall.
dDOR: diagnostic odds ratio.
eLR+: positive likelihood ratio.
fLR-: negative likelihood ratio.