TABLE 2.
Results of feature selection
| Model | SP‐ECog | CBB | N | AUC, mean (SD) | Sens. | Spec. | PPV | NPV | AUC (n = 148), mean (SD) |
|---|---|---|---|---|---|---|---|---|---|
| RF | No | No | 664 | 0.5871 (0.0641) | 64.82% | 49.16% | 60.97% | 53.53% | 0.5574 (0.1836) |
| Yes | 361 | 0.5192 (0.0901) | 49.84% | 53.34% | 50.25% | 52.57% | 0.5019 (0.1554) | ||
| Yes | No | 264 | 0.6244 (0.1198) | 75.59% | 42.22% | 70.00% | 48.84% | 0.5970 (0.1294) | |
| Yes | 148 | 0.5790 (0.1467) | 65.37% | 44.76% | 61.11% | 49.00% | 0.5708 (0.1734) | ||
| SVM | No | No | 664 | 0.5864 (0.0659) | 75.37% | 37.44% | 59.49% | 56.11% | 0.4750 * (0.1699) |
| Yes | 361 | 0.4856 (0.0845) | 48.12% | 52.84% | 50.74% | 51.37% | 0.4499 (0.1615) | ||
| Yes | No | 264 | 0.6034 (0.1201) | 88.70% | 19.33% | 65.94% | 52.71% | 0.6606 (0.1215) | |
| Yes | 148 | 0.5138 (0.1326) | 79.77% | 22.22% | 57.36% | 48.37% | 0.4013* (0.1427) |
Final column (labeled as n = 148) reports scores generated using a data set consisting only of the 148 subjects with data for all 12 features. Values marked with * are significantly different (P < .05) from the corresponding means in the fifth column. Abbreviations: RF, random forest; SVM, support vector machine; SP‐ECog, study partner–assessed Everyday Cognition score; CBB, Cogstate Brief Battery score; AUC, area under the receiver‐operating characteristic curve, measured by 10‐fold cross‐validation; SD, standard deviation; Sens., sensitivity; Spec., specificity; PPV, positive predictive value; NPV, negative predictive value.