Table 7.
Learner | Features | Accuracy | Sensitivity | Specificity | Precision | F-score | AUC |
---|---|---|---|---|---|---|---|
Average performance | |||||||
RFC | Ling | 0.70 | 0.78 | 0.59 | 0.73 | 0.75 | 0.69 |
SVM | Ling | 0.72 | 0.80 | 0.61 | 0.74 | 0.77 | 0.70 |
RFC | Cov | 0.74 | 0.83 | 0.61 | 0.75 | 0.79 | 0.72 |
SVM | Cov | 0.73 | 0.86 | 0.56 | 0.73 | 0.79 | 0.71 |
RFC | Phon | 0.59 | 0.79 | 0.31 | 0.61 | 0.69 | 0.55 |
SVM | Phon | 0.61 | 0.81 | 0.33 | 0.62 | 0.70 | 0.57 |
RFC | Cov + Ling | 0.76 | 0.84 | 0.66 | 0.77 | 0.81 | 0.75 |
SVM | Cov + Ling | 0.78 | 0.85 | 0.68 | 0.78 | 0.82 | 0.76 |
RFC | Best∗ | 0.77 | 0.82 | 0.69 | 0.78 | 0.80 | 0.75 |
SVM | Best∗ | 0.75 | 0.82 | 0.65 | 0.76 | 0.79 | 0.73 |
Best model | |||||||
RFC | Ling | 0.78 | 0.80 | 0.76 | 0.83 | 0.81 | 0.78 |
SVM | Ling | 0.87 | 0.87 | 0.86 | 0.90 | 0.88 | 0.87 |
RFC | Cov | 0.83 | 0.87 | 0.77 | 0.84 | 0.85 | 0.82 |
SVM | Cov | 0.83 | 0.90 | 0.73 | 0.82 | 0.86 | 0.81 |
RFC | Phon | 0.67 | 0.90 | 0.36 | 0.66 | 0.76 | 0.63 |
SVM | Phon | 0.65 | 0.90 | 0.29 | 0.64 | 0.75 | 0.59 |
RFC | Cov + Ling | 0.85 | 0.87 | 0.82 | 0.87 | 0.87 | 0.84 |
SVM | Cov + Ling | 0.85 | 0.87 | 0.82 | 0.87 | 0.87 | 0.84 |
RFC | Best∗ | 0.87 | 0.87 | 0.86 | 0.90 | 0.88 | 0.87 |
SVM | Best∗ | 0.83 | 0.83 | 0.82 | 0.86 | 0.85 | 0.83 |
Abbreviations: AD, Alzheimer's disease; AUC, area under the curve of receiver operating characteristics; HCs, healthy elderly controls; RFC, Random Forests Classifier; SVM, Support Vector Machine classifier; Ling, set of all linguistic features; Cov, set of all information coverage features; Phon, set of all phonetic features; Cov + Ling, a combination of all linguistic and information coverage features; MCI, mild cognitive impairment.
NOTE. The best results are indicated in bold.
A combination of all features with P value < .001 when correlating with cognitive impairment.