Skip to main content
Alzheimer's & Dementia : Diagnosis, Assessment & Disease Monitoring logoLink to Alzheimer's & Dementia : Diagnosis, Assessment & Disease Monitoring
. 2016 May 26;4:47–55. doi: 10.1016/j.dadm.2016.05.003

Cognitive variability—A marker for incident MCI and AD: An analysis for the Alzheimer's Disease Neuroimaging Initiative

Eric D Anderson a,, Michelle Wahoske b,c, Mary Huber a, Derek Norton d, Zhanhai Li d, Rebecca L Koscik e, Emre Umucu f, Sterling C Johnson b,c,e,g, Jana Jones h, Sanjay Asthana b,c,g, Carey E Gleason b,c,g,∗∗, for the Alzheimer's Disease Neuroimaging Initiative
PMCID: PMC4961828  PMID: 27489880

Abstract

Introduction

The potential of intra-individual cognitive variability (IICV) to predict incident mild cognitive impairment (MCI) or Alzheimer's disease (AD) was examined and compared to well-established neuroimaging and genetic predictors.

Methods

IICV was estimated using four neuropsychological measures for n = 1324 Alzheimer's Disease Neuroimaging Initiative (ADNI) participants who were cognitively healthy or diagnosed with MCI at baseline. IICV was used to predict time to incident MCI or AD, and compared to hippocampal volume loss and APOE ε4 status via survival analysis.

Results

In survival analyses, controlling for age, education, baseline diagonosis, and APOE ε4 status, likelihood ratio tests indicate that IICV is associated with time to cognitive status change in the full sample (P < .0001), and when the sample was restricted to individuals with MCI at baseline (P < .0001).

Discussion

These findings suggest IICV may be a low-cost, noninvasive alternative to traditional AD biomarkers.

Keywords: Cognitive variability, Cognitive biomarker, Biomarker, Alzheimer's disease, Mild cognitive impairment, MCI, Alzheimer's disease neuroimaging initiative, ADNI

1. Introduction

The prevalence of Alzheimer's disease (AD) is rising, creating an urgency to develop effective interventions [1], [2]. Current strategies include: (1) intervention during the protracted presymptomatic or preclinical stages; and (2) development of practical and effective means to prevent the disease-associated suffering and untenable costs. A prevention-focused approach necessitates the identification of biological indicators of disease process, that is, biomarkers [3], [4].

Major efforts, including the Alzheimer's Disease Neuroimaging Initiative [5] (ADNI) and the Australian Imaging, Biomarkers and Lifestyle [6] (AIBL) Study of Aging, have expanded our understanding of preclinical and subclinical stages of AD and what biomarkers might be used to detect disease processes well before the onset of clinical symptoms. The most promising biomarkers are obtained from cerebrospinal fluid and brain imaging [7]. However, given the difficulties in disseminating collection methods outside of research centers, and the arduous and invasive nature of some collection procedures, there is a desire to develop noninvasive, convenient markers [8], [9]. The development of a cognitive marker, once established and validated, would offer an alternative for individuals unable or unwilling to submit to the collection of traditional biomarkers.

One such proposed cognitive marker, intra-individual cognitive variability (IICV), estimates variability between cognitive domains measured at one time-point. Overall, researchers have used two conceptual methods to investigate the prognostic value of cognitive variability. The first method being an examination of variability across domains at one time (dispersion) [10], [11], [12], [13], [14], and the second being variability across trials (inconsistency) administered either in one session or over time [15], [16], [17], [18], [19], [20] or both dispersion and inconsistency [17], [19].

Holtzer et al. [10] and many others [13], [14], [20] have examined the usefulness of a dispersion-based IICV to predict cognitive decline and incident AD. This approach is not new. For example, significant disparity between verbal and performance intelligence quotients (IQs) is a long-established correlate with underlying neuropathology [21], [22]. In Holtzer et al. [10], IICV was estimated as the degree to which an individual's test scores differed from their mean standardized test performance. The investigators found greater variability in performance (dispersion) was associated with increased risk for dementia a decade later. This suggested IICV, like traditional biomarkers, might co-occur with preclinical brain alterations.

We hypothesized that IICV would predict incident AD and mild cognitive impairment (MCI), and that IICV would demonstrate strong criterion validity, estimated by comparing IICV with an established neuroimaging biomarker, hippocampal volume loss (HVL), and with apolipoprotein ε4 allele (APOE ε4) a genetic risk marker. Our overall goal was to explore the utility of IICV as a potential marker of preclinical cognitive changes and examine whether baseline IICV predicted subsequent incident cognitive endpoints, including MCI and AD.

2. Methods

2.1. Study design

Using an ex-post facto design and using an estimate of IICV used by Holtzer et al. [10] as our primary predictor, we examined the association of IICV and conversion to MCI or AD in an ADNI sample, including adults who were cognitively healthy or diagnosed with MCI at baseline. We repeated our analyses with an MCI sub-sample. Finally, we examined the contribution of IICV as a predictor of incident MCI and AD when HVL and a genetic risk factor, APOE ε4 status, were also included in the models.

2.2. ADNI

Data used in the preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). ADNI was launched in 2003 as a public-private partnership, led by PI Michael W. Weiner, MD. The primary goal of ADNI has been to test whether serial magnetic resonance imaging (MRI), positron emission tomography, other biological markers, and clinical and neuropsychological assessment can be combined to measure the progression of MCI and early AD (adni-info.org [23]).

2.3. Participants

Data were collected at ADNI study centers and clinics across the United States and Canada from three ADNI funding cycles (ADNI 1, ADNI 2, and ADNI GO) [5], [24], [25]. ADNI eligibility criteria included the following: age 55 to 90 years; English or Spanish language speakers; no diagnosis of depression; and baseline diagnosis of early AD, MCI, or cognitively normal (CN). Cognitive status was confirmed with designated cut off scores for the Clinical Dementia Rating Scale, mini-mental state examination, and Wechsler Memory Scale Logical Memory II. A complete account of ADNI exclusion criteria can be found at www.adni-info.org [23]. Evaluations were repeated every 6 months (ranging from 6 to 72 months), with a mean total follow-up time of 30.81 months (SD = 23.85). The results of cognitive assessments, physical examinations, and MRI scans were considered in determining diagnostic status [24], [25]. Supplementary Material describes how our primary outcome, diagnostic conversion was determined.

Before application of exclusion criteria in our study, the total subject pool included 1729 participants. We excluded subjects if they completed fewer than two visits, had incomplete or missing neuropsychological data, or carried a diagnosis of AD at baseline. After exclusionary criteria were applied, 1324 participants remained in the sample (see Fig. 1). For the MCI subgroup analyses, individuals who were CN at baseline were excluded, resulting in a sample of 825 individuals.

Fig. 1.

Fig. 1

CONSORT diagram. The terms ADNI 1, ADNI GO, and ADNI 2 each refers to groups of participants who were compiled into one group and included in the study from different funding cycles of the Alzheimer's disease neuroimaging initiative abbreviations. The term converters are those who were noted as changing in diagnosis from either cognitively normal (CN) or mild cognitive impairment (MCI) to MCI or Alzheimer's disease (AD) over the course of the study. Nonconverters are those who did not change in diagnosis over the course of the study.

2.4. Estimate of cognitive variability

We sampled the following cognitive domains to determine IICV: Attention, processing speed, executive functioning, working memory, and verbal memory. In total, four index scores from three tests were used to calculate participants' IICV score. Specific indices included: Rey Auditory Verbal Learning Test, Total of Learning Trials, American National Adult Reading Test (ANART), and Trail Making Test (TMT) A and B. Because lower scores on TMT A and B are indicative of better functioning (faster performance), scores were reversed before z transforming them.

The single time-point IICV index was calculated per a published algorithm [10]. Briefly, individual test scores were standardized using score distributions based on the sample obtained after inclusion and exclusion criteria were applied (n = 1324). For each participant, individual test z-transformed scores were compared to their mean test z-score, resulting in a summation of cross-test variability. Consistency between test scores, regardless of value, will demonstrate low levels of IICV, whereas extreme differences between test scores will result in high IICV.

IICV was examined both as a continuous and categorical variable. To derive categories of IICV, the continuum of IICV scores was divided into tertiles representing low IICV (0.0415–0.4955, n = 437), moderate IICV (0.4956–0.7876, n = 437), and high IICV (0.7877–3.732, n = 437).

2.5. Hippocampal volume loss

Measurements of hippocampal volume were conducted per ADNI protocols [25]. HVL represented the absolute difference between bilateral baseline volume measurement and the measurement occurring closest to time of conversion, if subject converted, or at the last available measurement if subject did not convert. The value was divided by time between measurements. This rate of volume loss was divided by baseline intracranial volume to adjust for individual differences. Thus, in models presented here, HVL represents an estimate of the proportional rate of HVL adjusted for intracranial volume.

2.6. Statistical analysis

Baseline demographic characteristics of converters and nonconverters were compared using t tests for continuous variables and chi-square tests for categorical variables, using SPSS Statistics for Windows, version 23.0. Cox proportional hazard survival models were used to investigate associations between IICV and time-to-conversion, controlling for age, education, APOE ε4 status, stratifying on baseline diagnosis (MCI or CN), and using a likelihood ratio test (LRT) comparing survival models with and without IICV. IICV tertile survival curves were estimated by including tertiles as the only covariate in the model. To investigate relative performance of IICV versus APOE ε4 status and HVL, two methods were used. First, concordance increases over a “base” survival model (age, education, and stratified baseline diagnosis) was examined when adding IICV, APOE ε4 status, or HVL. Second, in a model including all the “base” items, regression coefficient estimates were compared. Survival model analyses were conducted using R for Windows, version 3.2.3, and “survival” package, version 2.38–3.

The above analyses were performed for both the full group and an MCI subgroup. This was done to investigate if the association between IICV and conversion was markedly different when the sample was restricted to a subgroup (MCI). Additionally, all analyses were performed for both continuous variables of IICV and HVL, and tertiles of IICV and HVL, to assess effects of discretizing these variables. For continuous IICV and HVL, both were standardized (mean of 0, standard deviation of 1) before inclusion into models.

To support assumptions of proportionality, the MCI-subgroup survival models incorporated education as a discrete covariate with three categories: <12 years (category 1), 12 years to <16 years (category 2), and ≥16 years (category 3). In survival models with both MCI and CN, education was included as a continuous covariate. Given concern for nonproportionality in models with HVL tertiles, analyses focused on models where IICV and HVL were continuous covariates. Both continuous and tertiles of IICV and conformed well to proportionality assumptions.

3. Results

For all participants, mean age at baseline was 73.66 (standard deviation [SD] = 7.01). Of the total, 589 were women (44.49%). Average education was 16.09 years (SD = 2.80). See Table 1. Of the individuals for whom e4 status was available (n = 1320), 564 (42.72%) were APOE ε4 positive. Most participants were white, n = 1226 (92.60%) and non-Hispanic n = 1121 (96.5%). Of the n = 499 CN participants, n = 430 (86.17%) were nonconverters and n = 69 (13.83%) converted diagnostically (n = 12 to AD). Of the 825 subjects with MCI, n = 507 (61.5%) remained MCI, and n = 279 (33.8%) converted to a diagnosis of AD. See Table 2 for demographic information categorized by IICV tertile.

Table 1.

Participant characteristics

Analytic sample CN subgroup n = 499 MCI subgroup n = 825 Total sample N = 1324
Mean age at baseline, y (SD) 74.43 (5.85) 73.20 (7.60) 73.66 (7.01)
Women, n (%) 255 (51.10) 334 (40.48) 589 (44.49)
Education years (SD) 16.38 (2.69) 15.92 (2.86) 16.09 (2.80)
APOE ε4 positive, n (%) 140 (28.06) 424 (51.39) 564 (42.59)
Race
 African American, n (%) 32 (6.41) 24 (2.91) 56 (4.23)
 American Indian/Alaskan Native, n (%) 1 (0.20) 2 (0.24) 3 (0.23)
 Asian American, n (%) 9 (1.80) 14 (1.69) 23 (1.74)
 Native Hawaiian/Pacific Islander, n (%) 0 (0.00) 1 (0.12) 1 (0.08)
 White, n (%) 452 (90.58) 774 (93.81) 1226 (92.59)
 More than one, n (%) 5 (0.1.00) 7 (0.85) 12 (0.91)
 Unknown, n (%) 0 (0.00) 3 (0.36) 3 (0.23)
Ethnicity
 Non-Hispanic, n (%) 477 (95.59) 644 (78.1) 1121 (84.67)
 Hispanic, n (%) 16 (3.20) 18 (2.18) 34 (2.57)
 Unknown, n (%) 4 (0.80) 3 (0.36) 7 (0.53)
Final diagnosis
 Cognitively healthy, n (%) 424 (84.97) 39 (4.73) 463 (34.96)
 MCI, n (%) 63 (12.63) 507 (61.5) 570 (43.05)
 AD, n (%) 12 (2.40) 279 (33.8) 291 (21.97)
Diagnostic converters, n (%) 69 (13.83) 276 (33.45) 345 (26.05)
Diagnostic reverters, n (%) 1 (0.20) 51 (6.18) 52 (3.93)

Abbreviations: AD, Alzheimer's disease; MCI, mild cognitive impairment; APOE, apolipoprotein E.

NOTE. Percentiles were calculated using the sample size for that group (i.e., CN, MCI, or Total Sample).

Table 2.

Participant characteristics by tertile of IICV

Lowest IICV tertile, n = 437 Middle IICV tertile, n = 437 Highest IICV tertile, n = 437
Education, y (SD) 16.59 (2.52) 16.09 (2.80) 16.09 (2.80)
Mean age at baseline, n (SD) 72.64 (7.02) 73.66 (7.01) 73.66 (7.01)
Women, n (%) 205 (46.91) 198 (45.03) 180 (41.18)
APOE ε4 positive, n (%) 167 (38.21) 187 (42.79) 207 (47.36)
Baseline diagnosis
 Cognitively healthy, n (%) 201 (45.99) 168 (38.44) 127 (29.06)
 MCI, n (%) 236 (54.00) 269 (61.55) 310 (70.93)

Abbreviations: MCI, mild cognitive impairment; APOE, apolipoprotein e4; IICV, intra-individual cognitive variability.

NOTE. Total n = 1311 across tertiles. Percentiles were calculated using the sample size in each tertile (n = 437).

Product-limit survival curve estimates comparing time to conversion between IICV tertiles for individuals who were CN or diagnosed with MCI at baseline (n = 1311) revealed that the group with the smallest magnitude of IICV had an estimated median survival time >96 months (CI unavailable). Individuals in a moderate IICV range had an estimated median survival time of >96 months also (95% lower CI limit 84 months; upper limit unavailable). Individuals with the highest degree of IICV had an estimated median survival time of 48 months (95% CI, 36–72 months). Survival times among the IICV tertiles differed as indicated by a log-rank test (χ2 = 71, df = 2, P < .0001). Fig. 2 portrays product-limit survival estimate curves for the full group analysis. LRTs were used to examine the association of survival time with the covariates education and age after accounting for continuous IICV and APOE ε4 status. Education (χ2 = 0.0004, df = 1, P = .9814) was not statistically significant, whereas age (χ2 = 5.892, df = 1, P = .0152) and IICV (χ2 = 42.6, df = 1, P < .0001) both were statistically significant.

Fig. 2.

Fig. 2

Survival model including individuals who were cognitively healthy or diagnosed with MCI at baseline.

We found similar results when the survival analysis was repeated in a sample restricted to individuals with MCI at baseline. Survival analysis revealed that for this subgroup, participants with the lowest level of IICV had an estimated median survival time >96 months (95% lower CI limit: 84 months, upper limit unavailable); those with a moderate level of IICV had an estimated median of 72 months (95% lower CI limit: 48 months, upper limit unavailable); and subjects with the highest variability index had an estimated median of 36 months (95% CI, 36–48 months). Survival times between IICV tertiles were statistically different, (χ2 = 67.6, df = 2, P < .0001) by a log-rank test. See product-limit survival estimate curve in Fig. 3. In addition, LRTs showed that age (χ2 = 3.6305, df = 1, P = .1668) and education (χ2 = 0.3714, df = 2, P = .8305) were not statistically significant in the MCI subgroup after accounting for continuous IICV and APOE ε4 status; IICV (χ2 = 49.3, df = 1, P < .0001) remained significant.

Fig. 3.

Fig. 3

Survival model including individuals who were diagnosed with MCI at baseline.

We examined how predictive IICV is after accounting for all other variables for the full sample. IICV was significantly associated with conversion. The hazard ratio (HR) for 1 standard deviation (SD) increase in IICV is 1.20 (95% CI, 1.08–1.35; P = .0010), compared to a HR for a 1 SD increase in HVL of 1.97 (95% CI, 1.72–2.26; P < .0001), and a HR of 1.83 (95% CI, 1.37–2.46; P = .0005) for APOE ε4 positive status compared to negative. The “base” model for the full group has a concordance of 0.542. In comparison, adding continuous IICV to the base in a separate model increases concordance to 0.645, adding continuous HVL to the base as a separate model instead increased it to 0.714, and adding APOE ε4 status to the base model increased concordance to 0.637. Table 3 includes beta weights, HRs, and CIs for IICV tertile, HVL tertile, and APOE ε4 status.

Table 3.

Point estimates and confidence intervals of hazard ratios (for full sample group model and for MCI subgroup model)

Variable Hazard ratio point estimate 95% confidence interval (lower) 95% confidence interval (upper)
Full group model, including IICV and HVL as standardized continuous variables. APOE ε4 status, age, education, and baseline diagnosis
 IICV (increase of 1 SD) 1.20 1.08 1.35
 HVL (increase of 1 SD) 1.97 1.72 2.26
 APOE ε4 positive (vs negative) 1.83 1.37 2.46
Analytic sample restricted to subjects with MCI at baseline including IICV, HVL, APOE ε4 status, age, and education
 IICV (increase of 1 SD) 1.21 1.08 1.36
 HVL (increase of 1 SD) 1.99 1.73 2.29
 APOE ε4 positive (vs negative) 1.78 1.28 2.48

Abbreviations: MCI, mild cognitive impairment; IICV, intra-individual cognitive variability; HVL, hippocampal volume loss.

NOTE. Full group model denotes all participants with either CN or MCI at baseline. “Base” survival model included age, education, and stratified baseline diagnosis. Additional models added IICV, APOE ε4 status, or HVL to the “base”.

An examination of a subgroup whose baseline diagnosis was MCI revealed similar findings when all variables were entered into the model simultaneously. The HR for 1 SD increase in IICV was 1.21 (CI, 1.08–1.36; P = .0015) compared to HR for 1 SD increase in HVL = 1.99 (CI, 1.73–2.29, P < .0001), and positive APOE ε4 status HR of 1.78 (CI, 1.28–2.48, P = .0007). All were strongly associated with incident AD. The “base” model for the MCI subgroup's concordance was 0.526. In comparison, adding continuous IICV to the base model increased concordance to 0.663; adding continuous HVL to the base model instead increased it to 0.732; and adding APOE ε4 status to the base model instead increased it to 0.636. See Table 3 for beta weights, HRs, and CIs for the model restricted to individuals whose initial diagnosis was MCI. All analyses were conducted with IICV included as a categorical variable and a continuous variable. Results were highly similar in either case. Discrete variable results are provided in Supplementary Table 1.

4. Discussion

Overall, we found IICV estimates obtained from a single evaluation predicted incident MCI and AD in a large sample of well-characterized older adults enrolled in ADNI studies. Specifically, we found individuals exhibiting the highest level of variability in performance on three neuropsychological measures (IICV) demonstrated shorter times to conversion in cognitive status compared to individuals in the lowest tertile of variability. Differences in conversion rates emerged approximately 30 months after initial testing and remained evident through the last available observation, approximately 5 years after IICV was measured at baseline. Log-rank survival analyses indicated that after accounting for age, education, HVL, and APOE ε4 status, the association between IICV and time to conversion remained statistically significant. Altogether, these data provide support for this practical and noninvasive cognitive AD marker.

At present, researchers rely on resource-intense biomarkers, which are well validated but invasive [26], [27]. For example, amyloid beta 1–42 (Aβ1–42), total tau protein (t-tau) and phosphorylated tau (P-tau) are robust biomarkers of disease pathology and clinical course [28], [29]. These predictors can only be obtained with a lumbar puncture (LP) or neuroimaging of cerebral amyloid plaques, requiring injection of a radioactive compound, and access to unique scanning expertise [30]. At minimum, other biomarkers entail specialized neuroimaging and often require longitudinal follow-up [8], [9]. For example, MRI measurement of HVL is highly accurate in predicting conversion from MCI to AD [31], [32]; however, volume loss can only be measured with repeated evaluations. Altogether, traditional AD biomarkers are inarguably important, but prohibitively expensive; often dependent on repeated evaluations; contraindicated for some subjects [33]; and cumbersome to implement, especially in nonacademic centers. Data from the present study suggest that IICV is among the possible utilitarian alternatives to traditional biomarkers.

When determining which neuropsychological indices to include in our IICV estimate, care was taken to detect expected dissociations between fluid intelligence (e.g., executive function) and crystallized intelligence (e.g., semantic knowledge), and early impairments in hippocampal-based learning to maximize the assessment of patterns relevant for AD. For example, the ANART reflects crystallized intelligence, and is typically stable with aging and in the presence of early to mid-stage disease [34]. In contrast, the AVLT, a measure of verbal memory, is sensitive to hippocampal-based learning, reflecting a very early cognitive change in AD [35], [36]. Although Salthouse and Soubelet [14] cautioned against the use of measures reflecting cognitive abilities acquired in early life, e.g., vocabulary, we intentionally selected a test used to assess baseline intelligence so it could be contrasted against a score reflecting disease-related changes. Given that a change from baseline performance is a diagnostic criteria for dementia due to AD [7] and early changes are often in the domain of memory, we sought to detect when hippocampally based memory markedly differed from one's estimated baseline abilities, believing this may be an early subtle sign of disease. Additionally, tests such as Trails A and B were chosen as contrasting measures of executive function. Individuals with AD and MCI often demonstrate a characteristic dissociation in performance between Trails A and Trails B. Specifically, Trails A performance generally remains relatively well-preserved, being dependent on intact motor speed, visual scanning, and simple attention. On the other hand, the more challenging Trails B reveals even subtle executive dysfunction, with its additional demands on working memory and dual-task performance [37]. Thus, measures were selected based on their sensitively to AD-related performance variations, that is, the peaks and valleys of a cognitive profile occurring early in the disease process. Certain measures sensitive to AD-related cognitive changes (e.g., category fluency, digit symbol tasks) were excluded if they did not have an obvious contrasting task. For example, Trails A is contrasted to Trails B. This was done in an effort to minimize the number of measures needed to estimate variability and support dissemination.

Holtzer et al. [10] and a number of others have examined the utility of cognitive variability [11], [12], [20], [38]. Although methods for estimating the scatter or dispersion of cognitive test scores vary, previous analyses point toward the conclusion that variability across test indices is a marker for brain dysfunction, be it due to increasing dementia severity [39], mental illness [40], or head injury [41]. Some have speculated that intra-individual variability is related to disease-associated disruptions in neural networks and functional connectivity [42], whereas others relate the association to reductions in the ability to sustain mental efforts, especially executive functioning [43].

Our study replicated and expanded previous findings. In particular, our inclusion of APOE ε4 status and HVL provides unique insights. Not surprisingly, APOE ε4 status and HVL predicted conversion in our models. Importantly, IICV remained a significant predictor of time to conversion even after accounting for the influence of APOE ε4 status and HVL. Altogether, IICV provided unique predictive information.

There were limitations to the study. First, subjects enrolled in ADNI are predominantly non-Hispanic and white. In addition, the ADNI sample reflects only those individuals who were able and willing to have a complete set of invasive biomarkers measured. Altogether, this limits the generalizability of findings. Another limitation is that IICV, by diagnostic definition, would be greater for individuals with MCI, which presents with a greater risk for conversion to AD than CN status. In an attempt to address the potential confound, we (1) adjusted for baseline diagnosis and (2) conducted a second analysis, restricted to subjects with MCI at baseline. Given the low rate of conversion in the CN sample, it was not possible to examine an exclusively CN sample. Another potential limitation was our operationalization of IICV. We used a dispersion model to compare multiple domains at one time-point in an attempt to investigate the potential of a clinically relevant marker specific to AD. This may limit the ability to use the marker in more heterogeneous samples where mixed dementia may be common.

Although validation in other populations and cohorts is needed to corroborate our findings, IICV could provide a practical alternative to traditional biomarkers. Many emerging prevention strategies rely on an assessment of risk to identify individuals likely to benefit from early intervention, necessitating collection of biomarkers before drug administration. Consequently, if replicated, the findings would have a number of research and clinical practice implications. For example, IICV could offer an alternative or adjunct to traditional biomarkers in settings and groups not amenable to LPs and neuroimaging. In rural settings, a cognitive marker could be widely disseminated with minimal time and equipment demands. Furthermore, there are cultural groups who mistrust medical procedures based on historical maltreatment and discrimination, for example, African Americans [44], for whom cognitive testing may be more acceptable than the collection of traditional biomarkers, including LP. Overall, IICV could be considered an alternative to relying on more invasive biomarkers to identify target populations and a low-cost, easily administered means to assess risk for incident MCI and AD, allowing for a broader ability to identify at-risk individuals than traditional biomarkers.

5. Conclusions

Although these findings require replication and further validation, this study provides support for the use of IICV as a novel predictor of incident MCI and AD and practical alternative to traditional AD biomarkers. IICV is particularly appealing in that it could be widely disseminated with minimal time and equipment demands.

Research in context.

  • 1.

    Systematic review: A review of the literature was completed by searching PUBMED, PsychInfo, and MEDLINE, focusing specifically on previously published articles. APOE ε4 allele status and hippocampal volume loss (HVL) are well-established predictors of Alzheimer's disease (AD) risk. While preliminary, the published evidence suggests that intra-individual cognitive variability (IICV) may predict AD risk. One challenge in interpreting the literature is the divergent methods of estimating IICV.

  • 2.

    Interpretation: The results of this study suggest that cognitive variability in neuropsychological test scores, derived from a single testing session and quantified as the intra-individual difference in cognitive test scores was predictive of incident mild cognitive impairment (MCI) or AD.

  • 3.

    Future directions: This study gives support for further exploration of IICV as a noninvasive, easily obtained cognitive marker. Additional research is needed to verify the results, but the advent of a cognitive marker of disease risk could facilitate earlier identification of at-risk individuals.

Acknowledgments

This article is an update and expansion of E. Anderson's dissertation. As such he would like to thank the following: The University of Wisconsin-Madison, as well as Dr. Ruth Lynch, Dr. Fong Chan, and Dr. David Rosenthal, all of whom served on his committee. There are no known conflicts to report. Each of the authors in this study is paid a salary by their respective institutions and/or universities; this study was conducted without any additional funding from grants or outside sources. Contributions by coauthors, S.C.J. and N.M.D., and senior author C.E.G. are supported by funding from the NIH-NIA for the Wisconsin Alzheimer's Disease Center (P50 AG033514).

Data collection and sharing for this project was funded by the Alzheimer's Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer's Association; Alzheimer's Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer's Disease Cooperative Study at the University of California, San Diego. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California.

This is GRECC manuscript number: 2016-001.

Footnotes

Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at: http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf.

Supplementary data related to this article can be found at http://dx.doi.org/10.1016/j.dadm.2016.05.003.

Contributor Information

Eric D. Anderson, Email: eric.anderson@wright.edu.

Carey E. Gleason, Email: ceg@medicine.wisc.edu.

Supplementary data

Supplementary Material
mmc1.docx (34.2KB, docx)

References

  • 1.Alzheimer's Association 2015 Alzheimer's disease facts and figures. Alzheimers Dement. 2015;11:332–384. doi: 10.1016/j.jalz.2015.02.003. [DOI] [PubMed] [Google Scholar]
  • 2.Plassman B.L., Langa K.M., Fisher G.G., Heeringa S.G., Weir D.R., Ofstedal M.B. Prevalence of dementia in the United States: the aging, demographics, and memory study. Neuroepidemiology. 2007;29:125–132. doi: 10.1159/000109998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Gandy S., DeKosky S.T. Toward the treatment and prevention of Alzheimer's disease: rational strategies and recent progress. Annu Rev Med. 2013;64:367–383. doi: 10.1146/annurev-med-092611-084441. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Jack C.R., Jr., Knopman D.S., Jagust W.J., Petersen R.C., Weiner M.W., Aisen P.S. Tracking pathophysiological processes in Alzheimer's disease: an updated hypothetical model of dynamic biomarkers. Lancet Neurol. 2013;12:207–216. doi: 10.1016/S1474-4422(12)70291-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Weiner M.W., Veitch D.P. Introduction to special issue: Overview of Alzheimer's Disease Neuroimaging Initiative. Alzheimers Dement. 2015;11:730–733. doi: 10.1016/j.jalz.2015.05.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ellis K.A., Bush A.I., Darby D., De Fazio D., Foster J., Hudson P. The Australian Imaging, Biomarkers and Lifestyle (AIBL) study of aging: methodology and baseline characteristics of 1112 individuals recruited for a longitudinal study of Alzheimer's disease. Int Psychogeriatr. 2009;21:672–687. doi: 10.1017/S1041610209009405. [DOI] [PubMed] [Google Scholar]
  • 7.McKhann G.M., Knopman D.S., Chertkow H., Hyman B.T., Jack C.R., Jr., Kawas C.H. The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011;7:263–269. doi: 10.1016/j.jalz.2011.03.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Fletcher L.C., Burke K.E., Caine P.L., Rinne N.L., Braniff C.A., Davis H.R. Diagnosing Alzheimer's disease: are we any nearer to useful biomarker-based, non-invasive tests? GMS Health Technol Assess. 2013;9:Doc01. doi: 10.3205/hta000107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Ma S.L., Lam L.C. Panel of genetic variations as a potential non-invasive biomarker for early diagnosis of Alzheimer's disease. Clin Psychopharmacol Neurosci. 2011;9:54–66. doi: 10.9758/cpn.2011.9.2.54. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Holtzer R., Verghese J., Wang C., Hall C.B., Lipton R.B. Within-person across-neuropsychological test variability and incident dementia. JAMA. 2008;300:823–830. doi: 10.1001/jama.300.7.823. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hilborn J.V., Strauss E., Hultsch D.F., Hunter M.A. Intraindividual variability across cognitive domains: investigation of dispersion levels and performance profiles in older adults. J Clin Exp Neuropsychol. 2009;31:412–424. doi: 10.1080/13803390802232659. [DOI] [PubMed] [Google Scholar]
  • 12.Ownby R.L., Loewenstein D.A., Schram L., Acevedo A. Assessing the cognitive abilities that differentiate patients with Alzheimer's disease from normals: single and multiple factor models. Int J Geriatr Psychiatry. 2004;19:232–242. doi: 10.1002/gps.1056. [DOI] [PubMed] [Google Scholar]
  • 13.Vaughan L., Leng I., Dagenbach D., Resnick S.M., Rapp S.R., Jennings J.M. Intraindividual variability in domain-specific cognition and risk of mild cognitive impairment and dementia. Curr Gerontol Geriatr Res. 2013;2013:495793. doi: 10.1155/2013/495793. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Salthouse T.A., Soubelet A. Heterogeneous ability profiles may be a unique indicator of impending cognitive decline. Neuropsychology. 2014;28:812–818. doi: 10.1037/neu0000100. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Dixon R.A., Lentz T.L., Garrett D.D., MacDonald S.W., Strauss E., Hultsch D.F. Neurocognitive markers of cognitive impairment: Exploring the roles of speed and inconsistency. Neuropsychology. 2007;21:381–399. doi: 10.1037/0894-4105.21.3.381. [DOI] [PubMed] [Google Scholar]
  • 16.MacDonald S.W., Hultsch D.F., Dixon R.A. Performance variability is related to change in cognition: Evidence from the victoria longitudinal study. Psychol Aging. 2003;18:510–523. doi: 10.1037/0882-7974.18.3.510. [DOI] [PubMed] [Google Scholar]
  • 17.Hultsch D.F., MacDonald S.W., Dixon R.A. Variability in reaction time performance of younger and older adults. J Gerontol B Psychol Sci Soc Sci. 2002;57:P101–P115. doi: 10.1093/geronb/57.2.p101. [DOI] [PubMed] [Google Scholar]
  • 18.Bielak A.A., Hultsch D.F., Strauss E., MacDonald S.W., Hunter M.A. Intraindividual variability is related to cognitive change in older adults: Evidence for within-person coupling. Psychol Aging. 2010;25:575–586. doi: 10.1037/a0019503. [DOI] [PubMed] [Google Scholar]
  • 19.Mella N., Fagot D., Lecerf T., de Ribaupierre A. Working memory and intraindividual variability in processing speed: A lifespan developmental and individual-differences study. Mem Cognit. 2015;43:340–356. doi: 10.3758/s13421-014-0491-1. [DOI] [PubMed] [Google Scholar]
  • 20.Gao J.L., Cheung R.T., Chan Y.S., Chu L.W., Lee T.M. Increased prospective memory interference in normal and pathological aging: different roles of motor and verbal processing speed. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 2013;20:80–100. doi: 10.1080/13825585.2012.672948. [DOI] [PubMed] [Google Scholar]
  • 21.Miles W.R. Age and human ability. Psychol Rev. 1933;40:99–123. [Google Scholar]
  • 22.Sorenson H. Mental ability over a wide range of adult ages. J Appl Psychol. 1933;17:729–741. [Google Scholar]
  • 23.Alzheimer's Disease Neuroimaging Initiative . 2006. ADNI Procedures Manual. [Google Scholar]
  • 24.Aisen P.S., Petersen R.C., Donohue M., Weiner M.W., Alzheimer's Disease Neuroimaging Initiative Alzheimer's Disease Neuroimaging Initiative 2 clinical core: Progress and plans. Alzheimers Dement. 2015;11:734–739. doi: 10.1016/j.jalz.2015.05.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Aisen P.S., Petersen R.C., Donohue M.C., Gamst A., Raman R., Thomas R.G. Clinical core of the Alzheimer's disease neuroimaging initiative: Progress and plans. Alzheimers Dement. 2010;6:239–246. doi: 10.1016/j.jalz.2010.03.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Blennow K., Hampel H. CSF markers for incipient Alzheimer's disease. Lancet Neurol. 2003;2:605–613. doi: 10.1016/s1474-4422(03)00530-1. [DOI] [PubMed] [Google Scholar]
  • 27.Klunk W.E., Engler H., Nordberg A., Wang Y., Blomqvist G., Holt D.P. Imaging brain amyloid in Alzheimer's disease with Pittsburgh Compound-B. Ann Neurol. 2004;55:306–319. doi: 10.1002/ana.20009. [DOI] [PubMed] [Google Scholar]
  • 28.Okonkwo O.C., Mielke M.M., Griffith H.R., Moghekar A.R., O'Brien R.J., Shaw L.M. Cerebrospinal fluid profiles and prospective course and outcome in patients with amnestic mild cognitive impairment. Arch Neurol. 2011;68:113–119. doi: 10.1001/archneurol.2010.334. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Sunderland T., Linker G., Mirza N., Putnam K.T., Friedman D.L., Kimmel L.H. Decreased beta-amyloid1-42 and increased tau levels in cerebrospinal fluid of patients with Alzheimer disease. JAMA. 2003;289:2094–2103. doi: 10.1001/jama.289.16.2094. [DOI] [PubMed] [Google Scholar]
  • 30.Johnson K.A., Minoshima S., Bohnen N.I., Donohoe K.J., Foster N.L., Herscovitch P. Appropriate use criteria for amyloid PET: A report of the Amyloid Imaging Task Force, the Society of Nuclear Medicine and Molecular Imaging, and the Alzheimer's Association. J Nucl Med. 2013;54:476–490. doi: 10.2967/jnumed.113.120618. [DOI] [PubMed] [Google Scholar]
  • 31.Costafreda S.G., Dinov I.D., Tu Z.W., Shi Y.G., Liu C.Y., Kloszewska I. Automated hippocampal shape analysis predicts the onset of dementia in mild cognitive impairment. Neuroimage. 2011;56:212–219. doi: 10.1016/j.neuroimage.2011.01.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Jack C.R., Wiste H.J., Vemuri P., Weigand S.D., Senjem M.L., Zeng G.A. Brain beta-amyloid measures and magnetic resonance imaging atrophy both predict time-to-progression from mild cognitive impairment to Alzheimer's disease. Brain. 2010;133:3336–3348. doi: 10.1093/brain/awq277. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Health NIo . 2013. MRI Safety. [Google Scholar]
  • 34.Horn J.L. Psychometric studies of aging and intelligence. Psychopharmacol Bull. 1975;11:44–45. [PubMed] [Google Scholar]
  • 35.Creasey H., Rapoport S.I. The aging human brain. Ann Neurol. 1985;17:2–10. doi: 10.1002/ana.410170103. [DOI] [PubMed] [Google Scholar]
  • 36.Schmidt M. Western Psychological Services; Los Angeles, CA: 1996. Rey Auditory and Verbal Learning Test: A handbook. [Google Scholar]
  • 37.Strauss E., Sherman E.M., Spreen O., Spreen O. 3rd ed. Oxford University Press; Oxford; New York: 2006. A compendium of neuropsychological tests: administration, norms, and commentary. [Google Scholar]
  • 38.Matarazzo J.D., Daniel M.H., Prifitera A., Herman D.O. Inter-Subtest Scatter in the Wais-R Standardization Sample. J Clin Psychol. 1988;44:940–950. [Google Scholar]
  • 39.Reckess G.Z., Varvaris M., Gordon B., Schretlen D.J. Within-person distributions of neuropsychological test scores as a function of dementia severity. Neuropsychology. 2014;28:254–260. doi: 10.1037/neu0000017. [DOI] [PubMed] [Google Scholar]
  • 40.Shin Y.S., Kim S.N., Shin N.Y., Jung W.H., Hur J.W., Byun M.S. Increased intra-individual variability of cognitive processing in subjects at risk mental state and schizophrenia patients. PLoS One. 2013;8 doi: 10.1371/journal.pone.0078354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Rabinowitz A.R., Arnett P.A. Intraindividual cognitive variability before and after sports-related concussion. Neuropsychology. 2013;27:481–490. doi: 10.1037/a0033023. [DOI] [PubMed] [Google Scholar]
  • 42.Kelly A.M., Uddin L.Q., Biswal B.B., Castellanos F.X., Milham M.P. Competition between functional brain networks mediates behavioral variability. Neuroimage. 2008;39:527–537. doi: 10.1016/j.neuroimage.2007.08.008. [DOI] [PubMed] [Google Scholar]
  • 43.West R., Murphy K.J., Armilio M.L., Craik F.I., Stuss D.T. Lapses of intention and performance variability reveal age-related increases in fluctuations of executive control. Brain Cogn. 2002;49:402–419. doi: 10.1006/brcg.2001.1507. [DOI] [PubMed] [Google Scholar]
  • 44.Benkert R., Hollie B., Nordstrom C.K., Wickson B., Bins-Emerick L. Trust, mistrust, racial identity and patient satisfaction in Urban African American Primary Care Patients of Nurse Practitioners. J Nurs Scholarsh. 2009;41:211–219. doi: 10.1111/j.1547-5069.2009.01273.x. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material
mmc1.docx (34.2KB, docx)

Articles from Alzheimer's & Dementia : Diagnosis, Assessment & Disease Monitoring are provided here courtesy of Wiley

RESOURCES