Table 3.
Performance Metrics for the FEP Classifier Trained on Athens and Tested on Copenhagen
| Model Aelection (Inner Loop Train and Validate) – Athens: 5 Repeats of 10-fold CV | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Athens | AUC | BAC | Acc | Sens | Spec | PPV | NPV | PLR | NLR | DOR |
| 78.52 | 59.33 | 58.1 | 41.95 | 76.7 | 75.64 | 53.76 | 1.80 | 0.76 | 2.38 | |
| Testing – outer loop 10-Fold CV | ||||||||||
| Athens | AUC | BAC | Acc | Sens | Spec | PPV | NPV | PLR | NLR | DOR |
| 71.45 | 60.39 | 60.05 | 55.09 | 65.00 | 62.86 | 50.26 | -0.86 | -0.83 | 1.03 | |
| Independent test –Copenhagen (full sample) | ||||||||||
| Copenhagen | AUC | BAC | Acc | Sens | Spec | BPPV | BNPV | PLR | NLR | DOR |
| 67.74 | 63.53 | 59.41 | 74.19 | 52.86 | 67.60 | 60.71 | 1.57 | 0.49 | 3.22 | |
Metric abbreviations: AUC: area-under-the-curve, BAC: balanced accuracy, Acc: accuracy, Sens: sensitivity, Spec: specificity, PPV: positive predictive value, NPV: negative predictive value, BPPV: Bayes positive predictive value, NPPV: Bayes negative predictive value, PLR: positive likelihood ratio, NLR: negative likelihood ratio, DOR: diagnostic odds ratio.