Table 3.
Validity of Mindstreams tests in discriminating mild cognitive impairment (MCI; N = 20) from cognitively healthy elderly (N = 15) as compared with traditional paper-based tests of the same cognitive domains.
| Cognitive Domain | Mindstreams Test (outcome parameter) | AUC | SE | Asymptotic Significance | 95% CI | Traditional Measure | AUC | SE | Asymptotic Significance | 95% CI |
| MEMORY | Verbal Memory (accuracy, first repetition trial) | 0.848 | 0.066 | 0.001 | 0.719–0.977 | WMS-III Logical Memory I | 0.800 | 0.076 | 0.003 | 0.650–0.950 |
| Verbal Memory (accuracy, second repetition trial) | 0.831 | 0.071 | 0.001 | 0.692–0.971 | WMS-III Logical Memory II | 0.885 | 0.055 | 0.000 | 0.778–0.992 | |
| Verbal Memory (accuracy, third repetition trial) | 0.720 | 0.089 | 0.031 | 0.547–0.894 | RAVLT Immediate Recall A | 0.632 | 0.096 | 0.188 | 0.443–0.820 | |
| Verbal Memory Accuracy (accuracy, final repetition trial) | 0.752 | 0.086 | 0.014 | 0.583–0.920 | RAVLT Total | 0.833 | 0.068 | 0.001 | 0.701–0.966 | |
| Verbal Memory (accuracy, all repetition trials) | 0.894 | 0.056 | 0.000 | 0.785–1.000 | RAVLT Immediate Recall B | 0.688 | 0.091 | 0.06 | 0.510–0.866 | |
| Verbal Memory (accuracy, delayed recognition) | 0.748 | 0.085 | 0.015 | 0.582–0.914 | RAVLT Short Term Retention | 0.874 | 0.062 | 0.000 | 0.752–0.995 | |
| Non-Verbal Memory (accuracy, first repetition trial) | 0.654 | 0.097 | 0.127 | 0.464–0.844 | RAVLT Delayed Recall | 0.846 | 0.073 | 0.001 | 0.702–0.990 | |
| Non-Verbal Memory (accuracy, second repetition trial) | 0.681 | 0.095 | 0.074 | 0.494–0.867 | RAVLT Recognition | 0.823 | 0.073 | 0.001 | 0.680–0.965 | |
| Non-Verbal Memory (accuracy, third repetition trial) | 0.642 | 0.097 | 0.160 | 0.453–0.831 | ||||||
| Non-Verbal Memory Accuracy (accuracy, final repetition trial) | 0.686 | 0.093 | 0.066 | 0.505–0.867 | ||||||
| Non-Verbal Memory (accuracy, all repetition trials) | 0.719 | 0.090 | 0.030 | 0.542–0.897 | ||||||
| Non-Verbal Memory (accuracy, delayed recognition) | 0.684 | 0.094 | 0.069 | 0.499–0.869 | ||||||
| EXECUTIVE FUNCTION | Go-NoGo (accuracy) | 0.742 | 0.088 | 0.019 | 0.570–0.915 | Clock Drawing | 0.680 | 0.092 | 0.072 | 0.499–0.861 |
| Go-NoGo (performance index) | 0.840 | 0.069 | 0.001 | 0.705–0.976 | Trail Making Test A | 0.660 | 0.092 | 0.11 | 0.479–0.841 | |
| Problem Solving (accuracy) | 0.685 | 0.098 | 0.077 | 0.492–0.877 | WAIS-III Digit Symbol | 0.729 | 0.091 | 0.03 | 0.550–0.908 | |
| WMS-III Mental Control | 0.706 | 0.092 | 0.05 | 0.525–0.888 | ||||||
| VISUAL SPATIAL | Visual Spatial Imagery (accuracy) | 0.778 | 0.079 | 0.007 | 0.622–0.934 | WAIS-III Block Design | 0.599 | 0.102 | 0.347 | 0.400–0.798 |
| VERBAL | Verbal Function (accuracy, naming) | 0.777 | 0.085 | 0.009 | 0.610–0.944 | Boston Naming Test | 0.747 | 0.082 | 0.014 | 0.585–0.908 |
| Verbal Function (accuracy, rhyming) | 0.837 | 0.070 | 0.001 | 0.700–0.973 | COWA FS | 0.768 | 0.081 | 0.008 | 0.609–0.928 | |
| COWA A | 0.739 | 0.086 | 0.018 | 0.570–0.907 | ||||||
| COWA Animals | 0.711 | 0.088 | 0.037 | 0.538–0.883 | ||||||
| WAIS-III Similarities | 0.553 | 0.11 | 0.618 | 0.337–0.768 | ||||||
Mindstreams outcome parameters with insufficient data (<13 data points per group) due to failed practice sessions (see Methods) were excluded. AUC = area under the curve WMS-III = Wechsler Memory Scale, 3rd edition SE = standard error RAVLT = Rey Auditory Verbal Learning Test, Version 1 CI = confidence interval WAIS-III = Wechsler Adult Intelligence Scale, 3rd Edition RT = reaction time COWA = Controlled Oral Word Association