Table 5.
Measurements of area under curve (AUC), sensitivity (Sens), specificity (Spec) and balanced accuracy (BalAcc) at a specific threshold (kT) for the staging obtained with EBM and DEBM methods on training and test data sets not containing missing values.
EBM |
DEBM |
p-value | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
kT | Sens | Spec | BalAcc | AUC | kT | Sens | Spec | BalAcc | AUC | ||
Training set | |||||||||||
AD vs CN | 8 | 0.98 | 0.95 | 0.97 | 0.97 | 3 | 0.86 | 0.99 | 0.92 | 0.95 | 3.10 10−2 |
AD vs MCI | 8 | 0.70 | 0.95 | 0.83 | 0.83 | 7 | 0.66 | 0.76 | 0.71 | 0.76 | 0.104 |
MCI vs CN | 5 | 0.89 | 0.51 | 0.70 | 0.72 | 3 | 0.86 | 0.58 | 0.72 | 0.73 | 1.99 10−8 |
Test set | |||||||||||
AD vs CN | 4 | 0.88 | 0.94 | 0.91 | 0.95 | 3 | 0.91 | 0.91 | 0.91 | 0.94 | 0.332 |
AD vs MCI | 4 | 0.57 | 0.94 | 0.76 | 0.80 | 5 | 0.63 | 0.87 | 0.75 | 0.79 | 1.65 10−2 |
MCI vs CN | 4 | 0.88 | 0.43 | 0.66 | 0.66 | 3 | 0.91 | 0.52 | 0.71 | 0.70 | 0.296 |
P-values of Delong test performed to compare AUCs of EBM and DEBM methods are reported in the last column. In DEBM and EBM AUCs of the training set were not significantly different to their corresponding AUCs in the test set (p-values of DeLong test always >0.05).