Abstract
We investigated subjective cognitive complaints (SCCs), as well as physical and mental health factors, including positive and negative psychological traits/states, in adults and older adults. U.S. residents (N=2,962) were recruited via the Amazon Mechanical Turk platform and completed a 90-item survey. Overall, 493/1930 (25.5%) of younger adults and 278/1032 (26.9%) of older adults endorsed SCCs. Analyses revealed worse physical and mental health characteristics in the SCC+ compared to the SCC- group, with primarily medium (Cohen’s d=0.50) to large (0.80) effect sizes. Age did not moderate relationships between SCCs and physical/mental health. Results suggest that SCCs are associated with a diverse set of negative health characteristics such as poor sleep and high body mass index, and lower levels of positive factors, including happiness and wisdom. Effect sizes of psychological correlates were at least as large as those of physical correlates, indicating that mental health is critical to consider when evaluating SCCs.
Keywords: Amazon’s Mechanical Turk, online labor market, subjective health, cognition, psychological well-being, emotions, aging, mental health, physical health
Subjective cognitive complaints (SCCs) are common in older adults with and without objective cognitive deficits, with prevalence rates of approximately 27 to 43% of people in their 60s and 70s (Reid & MacLullich, 2006). A growing literature examines the utility of SCCs as an indicator of underlying pathological age-associated cognitive decline years before the onset of the objective, measurable symptoms identifiable in mild cognitive impairment and dementia (Jessen et al, 2014). However, evidence for SCCs as a risk factor for future cognitive decline is still inconclusive (Jessen, 2020) and SCCs have clinical relevance outside of their predictive validity for later cognitive decline. That is, SCCs in the absence of objective cognitive symptoms are associated with worse physical health (Comijs et al., 2002), subjective and objective sleep disturbance (Lauriola et al., 2017; Miley-Akerstedt et al., 2018; Stenfors et al., 2013), and psychiatric symptom severity (Balash et al., 2013; Comijs et al., 2002; Slavin et al., 2010; Stenfors et al., 2013). Overall, it is important to investigate non-cognitive correlates of SCCs in order to better elucidate the full clinical syndrome and appropriately direct physical and mental healthcare resources.
Although SCCs are typically investigated in older adults, they are reported with equal frequency across the adult lifespan (Begum et al., 2014; Derouesné et al., 1999; Ginó et al., 2010; Ponds et al., 1997; Ponds & Van Boxel, 2000). In comparison to older adults, who more frequently attribute SCCs to intrinsic, age-associated cognitive decline, younger and middle-aged adults are more likely to ascribe SCCs to extrinsic, modifiable causes such as stress, multitasking, and concentration problems (Derouesné et al., 1999; Ponds et al., 1997; Vestergren & Nilsson, 2011). Studies that recruit both non-clinical younger and older adults find correlates of SCCs to be similar across the two age groups, underscoring the importance of stress, sleep disturbance, and psychiatric symptom severity in SCCs across the adult lifespan (Derouesné et al., 1999; 28; Ponds et al., 1997; Stenfors et al., 2013; Ponds & Van Boxel, 2000).
Most of the studies in the exiguous lifespan SCC literature have been conducted in geographically restricted areas (e.g., Paris suburb: Derouesné et al., 1999; Portugal: Ginó et al., 2010; Korea: Lee et al., 2020), with no prior investigations in large, demographically diverse samples. Moreover, no adult lifespan studies to our knowledge have examined multiple physical health correlates of SCCs and no studies have reported on associations with psychological constructs such as wisdom, resilience, and loneliness, which may shed light on potential risk and protective factors. As such, the purpose of the current study was to comprehensively characterize physical and mental health correlates of SCCs, including positive and negative psychological traits/states, across the adult lifespan, in a large, demographically diverse sample. Participants were recruited using Amazon’s Mechanical Turk (AMT), an online labor market allowing for the rapid acquisition of high quality data at low cost (Buhrmester et al., 2011; Hara et al., 2018; Litman et al., 2015; Mason & Suri, 2012; Sprouse, 2011). A prior study from our research group examined loneliness using the same AMT database (Nguyen et al. 2021); SCC was not investigated in the previous paper. In the current study, we hypothesized that, compared to participants who did not endorse SCCs (SCC-), those who did endorse SCCs (SCC+) would report worse physical and mental health. Additionally, because of the well-known impact of aging on cognition, the moderating effect of age on the relationship between SCC status and mental/physical health was explored.
Methods
Participants
A sample of 3,407 people, aged 18 to 81, was recruited from AMT (see Table 1). Participants completed a 90-item online survey during a five week period in the spring of 2019. The description of the survey, visible on AMT read, “We are looking for people to answer questions about a variety of topics, including age, gender, mood, wisdom, and sleep, among others.” We presented the survey in general terms to reduce sampling bias and enhance generalizability. Interested participants consented to the study by selecting a hyperlink, which routed them to the questionnaire, presented via SurveyGizmo. Each participant received $1.00 for survey completion. Inclusion criteria were the following: 1) ≥18 years old, 2) English speaking, 3) residing in the U.S., and 4) a Human Intelligence Task Approval rate >90% (Mason & Suri, 2012). Only AMT participants meeting these criteria were able to view the survey. Initially, 2,289 participants were recruited; however, the age distribution was skewed toward younger adults. Consequently, an additional 250 participants aged 35–45, 500 participants aged 45–55, and 368 participants aged 55+ were included to balance the sample with respect to age, leading to a preliminary sample size of 3,407.
Table 1.
Demographic Characteristics, Physical Health, Mental Health, and Positive and Negative Psychological Traits/States by Group.
SCCs (n = 771) | No SCCs (n = 2191) | |||||
---|---|---|---|---|---|---|
Mean (SD)/Percentage | Mean (SD)/Percentage | t or χ2 | p | FDR-adjusted p | Cohen’s d or Cramer’s V | |
Demographic Characteristics | ||||||
| ||||||
Age | 43.16 (12.97); range=18–73 | 43.44 (13.47); range=18–81 | 0.50 | .62 | .64 | 0.02 |
Sex (% Female) | 482/769 (63%) | 1186/2187 (54%) | 18.93 | < .001 | < .001 | .08 |
Years of Education | n = 768 | n = 2185 | 5.00 | < .001 | < .001 | 0.21 |
Less than a high school diploma | 4 (<1%) | 19 (<1%) | ||||
High school degree or equivalent | 392 (51%) | 845 (39%) | ||||
Bachelor’s degree | 272 (35%) | 963 (44%) | ||||
Master’s or doctorate | 100 (13%) | 358 (16%) | ||||
Race | n = 766 | n = 2180 | 3.82 | .43 | .47 | .04 |
African American | 66 (9%) | 156 (7%) | ||||
American Indian/Alaska Native | 10 (1%) | 12 (<1%) | ||||
Asian | 40 (5%) | 155 (7%) | ||||
Multi-Racial | 20 (3%) | 63 (3%) | ||||
Native Hawaiian or Pacific Islander | 3 (<1%) | 6 (<1%) | ||||
Other | 6 (<1%) | 20 (<1%) | ||||
White | 621 (81%) | 1768 (81%) | ||||
Latinx origin (% endorsed) | 79/762 (10.4%) | 196/2175 (9.0%) | 1.22 | .27 | .29 | .02 |
Income (per year) | n = 762 | n = 2165 | 3.20 | .001 | .001 | 0.14 |
< $35,000 | 397 (52%) | 965 (44%) | ||||
$35,000 – $74,000 | 254 (33%) | 834 (38%) | ||||
≥ $75,000 | 111 (14%) | 366 (17%) | ||||
Married or a marriage-like relationship (%endorsed) | 427/771 (55%) | 1225/2191 (56%) | .064 | .80 | .80 | .01 |
Employment status | n = 762 | n = 2178 | 9.05 | .03 | .04 | .03 |
Employed full time | 462 (60%) | 1394 (64%) | ||||
Employed part-time | 118 (15%) | 332 (15%) | ||||
Unemployed/unable to work | 87 (11%) | 172 (8%) | ||||
Other | 95 (12%) | 280 (13%) | ||||
| ||||||
Physical Health | ||||||
| ||||||
BMI | 28.33 (7.72) | 27.15 (6.51) | 3.83 | < .001 | < .001 | 0.30 |
Medications for medical conditions (% endorsed) | 398/771 (52%) | 712/2191 (32%) | 89.02 | < .001 | < .001 | .17 |
SF-12 Physical Health | 44.41 (10.75) | 49.32 (9.44) | 11.26 | < .001 | < .001 | 0.49 |
PROMIS Sleep Disturbances | 54.03 (8.66) | 49.01 (8.92) | 13.72 | < .001 | < .001 | 0.57 |
Sleep apnea item (% endorsed) | 104/771 (13%) | 158/2191 (7%) | 27.88 | < .001 | < .001 | .10 |
| ||||||
Mental Health/Psychological Traits/States | ||||||
| ||||||
SF-12 Mental Health | 39.72 (11.83) | 47.87 (11.15) | 16.70 | < .001 | < .001 | 0.71 |
CDRS-2 Total | 4.95 (1.68) | 5.76 (1.64) | 11.70 | < .001 | < .001 | 0.49 |
PHQ-2 Total | 2.51 (1.84) | 1.21 (1.55) | 17.54 | < .001 | < .001 | 0.76 |
GAD-2 Total | 2.59 (1.88) | 1.35 (1.64) | 16.25 | < .001 | < .001 | 0.70 |
UCLA Loneliness 4-item | 9.76 (2.55) | 8.39 (2.59) | 12.64 | < .001 | < .001 | 0.53 |
CES-D Happiness Scale | 6.47 (3.36) | 8.71 (3.23) | 16.31 | < .001 | < .001 | 0.68 |
SD-WISE Total | 3.54 (0.49) | 3.78 (0.49) | 11.34 | < .001 | < .001 | 0.49 |
Decisiveness | 3.13 (0.90) | 3.59 (0.87) | 12.47 | < .001 | < .001 | 0.52 |
Emotional Regulation | 3.00 (0.82) | 3.56 (0.82) | 16.53 | < .001 | < .001 | 0.68 |
Pro-Social Behaviors | 3.82 (0.65) | 4.01 (0.64) | 7.22 | < .001 | < .001 | 0.29 |
Social Advising | 3.57 (0.71) | 3.68 (0.63) | 4.26 | < .001 | < .001 | 0.16 |
Tolerance for Divergent Values | 3.84 (0.67) | 3.88 (0.63) | 1.44 | .15 | .17 | 0.06 |
Social Self-Efficacy | 12.85 (3.43) | 13.86 (3.27) | 7.28 | < .001 | < .001 | 0.30 |
Note. BMI = body mass index; CDRS = Connor Davidson Resilience Scale-2 item; CES-D = Center for Epidemiologic Studies-Depression scale; GAD-2 = Generalized Anxiety Disorder scale, 2-item; PHQ-2 = Patient Health Questionnaire, 2-item; PROMIS = Patient-Reported Outcomes Measurement Information System; SCC = subjective cognitive decline; SD-WISE = San Diego Wisdom Scale; UCLA = University of California Los Angeles.
Although AMT participants provide high quality data overall (Buhrmester et al., 2011; Coppock, 2019; Hauser & Schwarz, 2016; Horton et al., 2010; Litman et al., 2015; Mortensen & Hughs, 2018; Peer et al., 2014; Sprouse, 2011), a subset may be inattentive or may provide invalid data for other reasons. To address this issue, participants who provided impossible or highly improbable answers to survey items were excluded. Specifically, participants who, 1) completed the survey in <270 seconds (n=104), 2) reported values for height and weight leading to a body mass index (BMI)<16 (n=165), 3) reported fewer total close friends than the number of close friends seen at least once per month (n=252), 4) reported their height at <3 feet (0.9 meters) or >7 feet (2.1 meters; n=42), 5) reported living with ≥20 people in their household (n=12), and/or 6) reported owning ≥40 pets (n=3) were excluded. Overall, 336 participants provided one invalid response, 86 participants provided two invalid responses, 22 participants provided three invalid responses, and 1 participant provided four invalid responses. Applying these exclusion criteria resulted in 445 (13.1%) participants being excluded, leaving a final sample of 2,962 participants for analysis.
This project, including a request for a waiver of documented consent, was reviewed through the University of California San Diego Human Research Protections Program by an IRB Chair and/or the IRB Chair’s designee and certified as exempt from IRB review under 45 CFR 46.104(d), Category 2.
Materials
Within the 90-item survey, SCCs were measured with a single item (“Have you noticed a decline in your memory and thinking that is worrisome to you? [Yes/No]”). One goal of the research team was to minimize the survey length as much as possible. Consequently, empirically supported abbreviated versions of all measures were selected, with the exception of the San Diego Wisdom Scale (SD WISE), which does not have a short form. Multiple sociodemographic characteristics were measured including age, sex, education, race, annual income, marital status, and employment status. To assess physical health, the survey included two items measuring height and weight to calculate body mass index (BMI), one item asking whether or not any medications are taken for medical conditions, the 12-item Medical Outcomes Survey Short Form (assessing physical and mental health related quality of well being; 39), the 4-item Patient Reported Outcomes Measurement Information System (PROMIS) Sleep Disturbance short form (Cella et al., 2010), and the 1-item PROMIS sleep apnea question (Cella et al., 2010). Depression was measured with the 2-item Patient Health Questionnaire (PHQ 2) (Kroenke, Spitzer, & Williams, 2003) and anxiety was assessed with the 2-item version Generalized Anxiety Disorder scale (Kroenke et al., 2007). Loneliness was measured with the 4-item version of the UCLA Loneliness Scale (Russell et al., 1980), using the anchors from the third edition of the UCLA scale, never, rarely, sometimes, and always, rather than those of Russel et al. (1980), never, rarely, sometimes, and often. Measures of positive psychological factors included the 24-item SD WISE (Thomas et al., 2019), the 2 item Connor Davidson Resilience Scale (Davidson, 2018), and the 4-item Happiness Factor from the Center for Epidemiologic Studies Depression scale (Fowler & Christakis, 2008). The SD WISE includes the following subscales: Decisiveness, Emotional Regulation, Pro Social Behaviors, Social Advising, and Tolerance for Divergent Values. Social self-efficacy was assessed using four items, with minor wording modifications, from the Social Self Efficacy Scale (Muris, 2002; Zullig et al., 2011) that was originally developed for use with adolescents. These four items were selected for age appropriateness and included: (1) “How well can you become friends with other people?” (2) “How well can you have a chat with an unfamiliar person?” (3) “How well can you tell other people that they are doing something you don’t like?” and (4) “How well can you succeed in preventing quarrels with other people?”
Statistical Analysis
Data were analyzed using SPSS 26.0. The distributional characteristics of all continuous variables were examined. For those that were highly skewed, appropriate nonparametric tests were used. Next, the hypothesis was tested with SCC group as the between subjects predictor (“independent”) variable and physical and mental health scores as outcome (“dependent”) variables. An omnibus multivariate analysis of variance (MANOVA) was conducted, followed by independent samples t tests for each continuous variable; due to low missing data rates (<1% for all variables), the classic MANOVA procedure was used rather than the generalized estimating equations procedure. For the two categorical outcome variables (presence or absence of medications and sleep apnea), χ2 tests were conducted. With regard to the exploratory analysis, 2-group (SCC+ versus SCC-) × 2-age cohort (older: 50+ versus younger: 18 to 49) ANOVAs were conducted on the physical and mental health variables listed in Table 1 to examine the possible moderating effect of age. Age was dichotomized into two groups in order to contrast younger adults with older adults, given that the majority of the current SCC literature exists in aging populations. Although some researchers define older adults beginning in the 60s, this study focused on “young-old” adults because our sample of “old-old” adults, recruited via an internet-based data collection platform (AMT), was small. Additionally, age was also examined as a continuous variable in the moderation of the relationship between SCC group and physical and mental health. This supplemental analysis was undertaken in order to capitalize on the full extent of variability in age as a possible moderator (see Hayes, 2018).
Appropriate effect sizes are reported for all statistical tests, which include partial η2 for the MANOVA, Cohen’s d for t tests, and Cramer’s V for χ2 tests. The False Discovery Rate was used to control for Type I error, with alpha set at p<.05. The False Discovery Rate predicts and controls individual false positive results, while simultaneously maintaining a high level of statistical power relative to familywise error rate methods such as the Bonferroni correction (Benjamin & Hochberg, 1995). All statistical tests were two-tailed.
Results
Overall, 493/1930 (25.5%) of younger adults (ages 18 to 49) and 278/1032 (26.9%) of older adults (50 or older) endorsed the SCC item, χ2(1)=.68, p=.41. For continuous variables with non-normal distributions, results from non-parametric tests (Mann Whitney Us) mirrored those from parametric statistics. For ease of interpretation, the parametric results are presented for all continuous variables. Of the demographic variables, sex, education, employment status, and annual income differed significantly across the two groups; however, when these variables were added to the models as covariates, results did not differ. For ease of interpretation, unadjusted parameters are presented.
With respect to the hypothesis that the SCC+ group would report worse physical and mental health compared to the SCC- group, the MANOVA was statistically significant, F(11, 2937)=46.47, p<.001, λ=0.85, =.15. In univariate analyses, all physical and mental health variables differed in the hypothesized direction, with the exception of SD WISE Tolerance for Diverging Values subscale. Specifically, compared to the SCC- group, the SCC+ group reported higher BMI, greater rate of taking medications for medical conditions, worse overall self-reported physical health, higher rates of self-reported sleep disturbance and sleep apnea, worse overall mental health, higher rates of depression, anxiety, and loneliness, and lower scores on scales for resilience, happiness, wisdom, and self-efficacy (see Table 1). Moreover Cohen’s d effect sizes were primarily in the medium (0.50) to large (0.80) range. When the sample was split by age (18 to 49 and 50+) for the exploratory analysis, interaction terms for the 2-SCC group X 2-Age group ANOVAs were all non-significant. Similarly, when age was included as a continuous variable in the moderation analyses, the interaction terms were nonsignificant. These results suggest that age did not moderate the relationship between SCC and physical or mental health.
Discussion
Most research efforts to investigate SCCs have focused on understanding their relationship to objective cognitive decline (Kielb et al., 2017; Koppara et al., 2015) and their importance as an early risk factor for pathological cognitive decline in older adults (Jessen et al., 2020; Snitz et al., 2018). Although the literature on SCCs as a marker of early cognitive decline in older adults is growing rapidly, much less is known about SCCs as a general construct, especially their physical and mental health correlates in non-clinical populations across the adult lifespan. The present study evaluated self-reported physical and psychological correlates of SCCs in a large survey sample of adults aged 18 to 81. As hypothesized, both younger and older adults who endorsed SCCs exhibited worse self-reported physical health symptoms and psychological traits/states compared to those who did not endorse SCCs. Compared to the SCC- group, the SCC+ group had higher mean BMI, were more likely to take medications for medical conditions and were more likely to have sleep apnea or other sleep disturbances. They also reported worse physical well-being, worse mental well-being, higher depression and anxiety symptoms, greater loneliness, and lower levels of resilience, happiness, wisdom, and self-efficacy. Age did not moderate the relationship between SCCs and either physical or psychological functioning. Overall, the findings are consistent with previous literature suggesting that SCCs are associated with worse subjective and objective sleep disturbance (Lauriola et al., 2017; Miley-Akerstedt et al., 2018; Stenfors et al., 2014), and psychiatric symptom severity (Balash, et al., 2013; Comijs et al., 2002; Slavin et al., 2010; Stenfors et al., 2014), and that SCC correlates are similar across the lifespan in both younger and older adults (Derouesné et al., 1999; Lee et al., 2020; Ponds & Van Boxtel, 2000). To the authors’ knowledge, this study is the first large scale investigation of SCC rates to include a non-clinical sample of demographically diverse older and younger adults.
Symptoms of depression and anxiety showed the strongest relationships to SCCs, with moderate to large (Cohen’s d ≥ 0.70) effect sizes. This finding adds to earlier studies, which suggest that the association between SCCs and depression and anxiety is complex. Depression moderates the relationship between SCCs and objective cognitive impairment (Reid et al., 2012; Stenfors et al., 2014). Moreover, although depression and anxiety are closely related and highly comorbid, they are associated with different risk factors; pure anxiety tends to be associated with a wide range of stress-related factors, none of which are associated with pure depression (Beekman et al., 2000). One factor common to both is personal mastery, or perceived behavioral control, which may be a cognitive psychological marker of trait vulnerability for both depression and anxiety (Beekman et al., 2000). Depression interacts with personal mastery and general self-efficacy such that the association between depressive symptoms and SCCs may be stronger in participants with higher feelings of perceived mastery and social self-efficacy (Comijs et al., 2002). Data from the current study revealed that participants who endorsed SCCs exhibited lower levels of self-efficacy.
Current study results also showed strong associations between SCCs and negative/positive psychological factors, including loneliness, resilience, happiness, and wisdom (Cohen’s d ≥ 0.30). In each case, SCCs were related to higher levels of negative and lower levels of positive psychological factors, and effect sizes of psychological correlates were as large as (or larger) than those of physical correlates, suggesting that psychological features may be particularly relevant to the experience of cognitive problems in everyday life. These results highlight important associations that encourage future research. For example, future investigators could examine possible causal relationships between SCCs and negative/positive psychological factors in order to directly inform later interventions. That is, if initial subjective appraisals of one’s own cognitive functioning lead to higher resilience/happiness and lower loneliness, then treatments to reduce SCCs could have positive downstream effects on resilience, happiness, and loneliness. Conversely, if positive/negative psychological variables are “upstream” factors that influence the development of later SCCs, then interventions to improve psychological functioning may reduce distressing SCCs. Importantly, these two possibilities are not mutually exclusive (i.e., bidirectional relationships are possible), and we leave it to future investigators to conduct longitudinal research that can begin to disentangle causal associations.
Wisdom is a complex, multidimensional psychological trait that is comprised of several specific components, including pro social behaviors such as empathy and compassion, emotional regulation, self-reflection or insight, acceptance of divergent values, decisiveness, and social advising (Jeste & Lee, 2019; Meeks & Jeste, 2009; Thomas et al., 2019). Although it is often conflated with intelligence, wisdom encompasses cognitive, affective, and reflective dimensions (Ardelt & Jeste, 2018). Among the wisdom subscales of the SD WISE, the cognitive (decisiveness) and affective (emotional regulation) components of wisdom were the strongest correlates of SCCs. The decisiveness component entails the cognitive abilities and dispositional qualities related to making decisions. The emotional regulation component pertains to the ability to maintain emotional homeostasis. Although the latter can be reflective of psychological distress, one of the items (e.g., I cannot filter my negative emotions) also involves an aspect impulse control related to frontal executive functions – specifically, response inhibition (Ardelt & Jeste, 2018). Thus, it is not surprising that individuals with SCCs would exhibit lower decisiveness and emotional regulation. At the same time, it is worth stressing that positive traits are potentially modifiable. There is growing literature on interventions designed to enhance levels of positive traits such as resilience and components of wisdom including emotional regulation (Lee et al., 2020; Treichler et al., 2020).
Participants endorsing SCCs in the current study also reported greater loneliness than the comparison group. Loneliness has been previously identified as a major risk factor for adverse mental and physical health outcomes, including cognitive decline and dementia (Boss et al., 2015; Hawkley & Cacioppo, 2010; Tilvis et al., 2004; Wilson et al., 2007). A more detailed description of loneliness results within this AMT sample is presented in a companion paper (Nguyen et al., 2020).
With regard to physical functioning, SCCs had the strongest relationship with self-reported sleep disturbances and overall physical well-being, consistent with previous literature (Lee et al., 2020). Disrupted sleep can contribute to both subjective and objective experiences of cognitive impairment (Alhola & Polo-Kantola, 2007; Lauriola et al., 2017). In addition to general sleep disturbances, we also showed higher rates of obstructive sleep apnea (OSA) in the SCC+ group compared to the SCC- group. Although cognitive deficits have been well documented in patients with OSA, the relationship between SCCs and objective impairment in OSA remains unclear (Vaessen et al., 2015). Importantly, SCCs in combination with subjective sleep disturbances and OSA may represent early prodromal signs for developing mild cognitive impairment or dementia (Yaffe et al., 2011).
The present study has notable strengths. Analyzes included nearly 3,000 adults across the adult lifespan, with sociodemographic diversity in terms of gender, race, and socioeconomic status. Utilization of the AMT online crowdsourcing marketplace allowed for access to thousands of research participants from demographically varied backgrounds from across the US, without geographic restrictions (Buhrmester et al., 2011). Importantly, recruitment through internet samples may reduce biases from traditional samples (Gosling et al., 2004) and better approximate U.S. census data (Berkinsky et al, 2012; Casler et al., 2013; Eriksson & Simpson, 2010; Johnson & Borden, 2012). Moreover, the precaution of describing the survey in general terms likely decreased sampling bias and enhanced generalizability. Although the unsupervised nature of data collection potentially reduces reliability and validity, a large number of studies have shown that AMT data quality is equivalent to that acquired in controlled settings (Buhrmester et al., 2011; Johnson & Borden, 2012; Litman et al., 2015; Mason & Suri, 2012; Peer et al., 2014; Sprouse, 2011) and participants who provided impossible or highly implausible responses to survey items were excluded to ensure validity of results. Furthermore, this study included a comprehensive assessment of physical and mental health factors, including positive and negative psychological traits/states, which, to the authors’ knowledge, have never been simultaneously investigated in the context of SCCs. Overall, these findings provide a more comprehensive understanding of the physical and psychological characteristics associated with SCC, above and beyond strict neuropsychiatric diagnoses.
Nevertheless, this investigation was limited in several respects. First, the presence of SCCs was determined using a single yes/no question rather than a more detailed method of inquiry or standardized measure; this prevented the assessment of SCC severity and our ability to capture complaints in specific cognitive domains (e.g., attention, memory, executive functions; Hill et al., 2015). Many self-report measures have been used to investigate SCCs (Rabin et al., 2015), but there is no established gold standard method of assessment (Molinuevo et al., 2017). Moreover, the single item mode of assessment is more pragmatic and consistent with typical clinical practice, meaning that results from the current study may generalize to some clinical settings where SCCs are measured as part of patient care (e.g., neuropsychological evaluations). Second, due to restrictions of the AMT platform, all data are self-report, which has well known limitations due to recall and response bias (Janssens & Kraft, 2012; Stone et al., 1999). Although the assessment of SCCs requires self-report by definition, this represents a limitation with regard to reports of physical health and functioning. Relatedly, performance-based cognitive tests to determine objective cognitive impairment were not administered. Therefore, the presence of cognitive disorders cannot be ruled out in a subset of this sample, and the Jessen et al. (2014) exclusion criterion of mild cognitive impairment and dementia cannot be assessed. Third, although the sample was diverse across multiple demographic characteristics, representation in terms of racial minority groups and people of low socioeconomic status was lower than anticipated. Relatedly, a group of participants recruited through AMT cannot generalize perfectly to the larger U.S. population, given that some level of technological familiarity and comfort is required to use the platform. Consequently, the external validity of this study was limited in that regard. Finally, the cross sectional design limits the ability to draw causal inferences regarding SCCs and their correlates, and future prospective longitudinal studies are needed to clarify these relationships.
Conclusions
Notwithstanding these limitations, the current study contributes to important research aimed at a better understanding the non-cognitive aspects of SCCs. These findings help characterize the wide range of physical and psychological correlates of SCCs. Notably, the effect sizes of psychological correlates of SCC were as large as (or larger) than those of physical correlates, indicating that mental health and psychological features are critical to consider when evaluating SCCs in adults of all ages.
Acknowledgements:
The authors thank all the study participants for their contributions to this work.
Funding: Funding for this study was provided, in part, by the National Institute of Mental Health T32 Geriatric Mental Health Program (grant MH019934 to DVJ [PI]), by the Stein Institute for Research on Aging at the University of California, San Diego, and by the K23 MH118435 to TTN [PI].
Footnotes
Declaration of interest: None
References
- Alhola P, & Polo-Kantola P (2007). Sleep deprivation: Impact on cognitive performance. Neuropsychiatric Disease and Treatment, 3(5), 553–567. [PMC free article] [PubMed] [Google Scholar]
- Ardelt M, & Jeste DV (2018). Wisdom and hard times: The ameliorating effect of wisdom on the negative association between adverse life events and well-being. The Journals of Gerontology. Series B: Psychological Sciences and Social Sciences, 73(8), 1374–1383. 10.1093/geronb/gbw137 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Au A, Cheng C, Chan I, Leung P, Li P, & Heaton RK (2008). Subjective memory complaints, mood, and memory deficits among HIV/AIDS patients in Hong Kong. Journal of Clinical and Experimental Neuropsychology, 30 (3), 338–348. 10.1080/13803390701416189 [DOI] [PubMed] [Google Scholar]
- Balash Y, Mordechovich M, Shabtai H, Giladi N, Gurevich T, & Korczyn AD (2013). Subjective memory complaints in elders: Depression, anxiety, or cognitive decline? Acta Neurologica Scandinavica, 127(5), 344–350. 10.1111/ane.12038 [DOI] [PubMed] [Google Scholar]
- Beck C, Cody M, Souder E, Zhang M, & Small GW (2000). Dementia diagnostic guidelines: Methodologies, results, and implementation costs. Journal of the American Geriatrics Society, 48(10), 1195–1203. 10.1111/j.1532-5415.2000.tb02590.x [DOI] [PubMed] [Google Scholar]
- Beekman ATF, de Beurs E, van Balkom AJLM, Deeg DJH, van Dyck R, & van Tilburg W (2000). Anxiety and depression in later life: Co-Occurrence and communality of risk factors. American Journal of Psychiatry, 157(1), 89–95. 10.1176/ajp.157.1.89 [DOI] [PubMed] [Google Scholar]
- Begum A, Dewey M, Hassiotis A, Prince M, Wessely S, & Stewart R (2014). Subjective cognitive complaints across the adult life span: A 14-year analysis of trends and associations using the 1993, 2000 and 2007 English Psychiatric Morbidity Surveys. Psychological Medicine, 44(9), 1977–1987. 10.1017/S0033291713002444 [DOI] [PubMed] [Google Scholar]
- Benjamini Y, & Hochberg Y (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B, 57(1), 289–300. [Google Scholar]
- Berinsky AJ, Huber GA, & Lenz GS (2012). Evaluating online labor markets for experimental research: Amazon.com’s Mechanical Turk. Political Analysis, 20(3), 351–368. 10.1093/pan/mpr057 [DOI] [Google Scholar]
- Boss L, Kang D-H, & Branson S (2015). Loneliness and cognitive function in the older adult: A systematic review. International Psychogeriatrics, 27(4), 541–553. 10.1017/S1041610214002749 [DOI] [PubMed] [Google Scholar]
- Buhrmester M, Kwang T, & Gosling SD (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6(1), 3–5. 10.1177/1745691610393980 [DOI] [PubMed] [Google Scholar]
- Casler K, Bickel L, & Hackett E (2013). Separate but equal? A comparison of participants and data gathered via Amazon’s MTurk, social media, and face-to-face behavioral testing. Computers in Human Behavior, 29(6), 2156–2160. 10.1016/j.chb.2013.05.009 [DOI] [Google Scholar]
- Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S, Cook K, DeVellis R, DeWalt D, Fries J, Gershon R, Hahn E, Pilkonis P, Revicki D, Rose M, … Hays R (2010). Initial item banks and first wave testing of the Patient–Reported Outcomes Measurement Information System (PROMIS) network: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. 10.1016/j.jclinepi.2010.04.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Comijs HC, Deeg DJH, Dik MG, Twisk JWR, & Jonker C (2002). Memory complaints; the association with psycho-affective and health problems and the role of personality characteristics. A 6-year follow-up study. Journal of Affective Disorders, 72(2), 157–165. 10.1016/s0165-0327(01)00453-0 [DOI] [PubMed] [Google Scholar]
- Coppock A (2019). Generalizing from survey experiments conducted on mechanical turk: A replication approach. Political Science Research and Methods, 7(3), 613–628. 10.1017/psrm.2018.10 [DOI] [Google Scholar]
- Davidson J (2018). Connor-Davidson Resilience Scale (CDRISC) Manual Unpublished. [Google Scholar]
- Derouesné C, Lacomblez L, Thibault S, & Leponcin M (1999). Memory complaints in young and elderly subjects. International Journal of Geriatric Psychiatry, 14(4), 291–301. [DOI] [PubMed] [Google Scholar]
- Edmonds EC, Delano-Wood L, Galasko DR, Salmon DP, & Bondi MW (2014). Subjective cognitive complaints contribute to misdiagnosis of mild cognitive impairment. Journal of the International Neuropsychological Society, 20(8), 836–847. 10.1017/S135561771400068X [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eriksson K, & Simpson B (2010). Emotional reactions to losing explain gender differences in entering a risky lottery. Judgment and Decision Making, 5(3), 5. [Google Scholar]
- Fowler JH, & Christakis NA (2008). Dynamic spread of happiness in a large social network: Longitudinal analysis over 20 years in the Framingham Heart Study. BMJ, 337(dec04 2), a2338. 10.1136/bmj.a2338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garcia-Ptacek S, Cavallin L, Kareholt I, Kramberger MG, Winblad B, Jelic V, & Eriksdotter M (2014). Subjective cognitive impairment subjects in our clinical practice. Dementia and Geriatric Cognitive Disorders Extra, 4(3), 419–430. 10.1159/000366270 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gell NM, Rosenberg DE, Demiris G, LaCroix AZ, & Patel KV (2015) Patterns of technology use among older adults with and without disabilities. Gerontologist, 55(3), 412–421. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ginó S, Mendes T, Maroco J, Ribeiro F, Schmand BA, de Mendonça A, & Guerreiro M (2010). Memory complaints are frequent but qualitatively different in young and elderly healthy people. Gerontology, 56(3), 272–277. 10.1159/000240048 [DOI] [PubMed] [Google Scholar]
- Gosling SD, Vazire S, Srivastava S, & John OP (2004). Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. The American Psychologist, 59(2), 93–104. 10.1037/0003-066X.59.2.93 [DOI] [PubMed] [Google Scholar]
- Hara K, Adams A, Milland K, Savage S, Callison-Burch C, & Bigham JP (2018). A data-driven analysis of workers’ earnings on Amazon Mechanical Turk. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ‘18, 1–14. 10.1145/3173574.3174023 [DOI] [Google Scholar]
- Hauser DJ, & Schwarz N (2016). Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behavior Research Methods, 48(1), 400–407. 10.3758/s13428-015-0578-z [DOI] [PubMed] [Google Scholar]
- Hawkley LC, & Cacioppo JT (2010). Loneliness matters: A theoretical and empirical review of consequences and mechanisms. Annals of Behavioral Medicine, 40(2), 218–227. 10.1007/s12160-010-9210-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hessen E, Eckerström M, Nordlund A, Selseth Almdahl I, Stålhammar J, Bjerke M, Eckerström C, M. Göthlin, Fladby T, Reinvang I, & Wallin A (2017). Subjective cognitive impairment is a predominantly benign condition in memory clinic patients followed for 6 Years: The Gothenburg-Oslo MCI Study. Dementia and Geriatric Cognitive Disorders Extra, 7(1), 1–14. 10.1159/000454676 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hollands S, Buckley R, Pietrzak RH, Snyder PJ, Ames D, Ellis KA, Harrington K, Lautenschlager N, Martins RN, Masters CL, Villemagne VL, Rowe CC, & Maruff P (2014). Amyloid-β related memory decline is not associated with subjective or informant rated cognitive impairment in healthy adults. Journal of Alzheimer’s Disease, 43(2), 677–686. 10.3233/JAD-140678 [DOI] [PubMed] [Google Scholar]
- Horton JJ, Rand DG, & Zeckhauser RJ (2010). The online laboratory: Conducting experiments in a real labor market. Experimental Economics,14(3), 399–425. 10.1007/s10683-011-9273-9 [DOI] [Google Scholar]
- Janssens ACJW, & Kraft P (2012). Research conducted using data obtained through online communities: Ethical implications of methodological limitations. PLoS Medicine, 9(10), e1001328. 10.1371/journal.pmed.1001328 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jessen F, Amariglio RE, Buckley RF, Rodriguez-Gomez O, Saykin AJ, Sikkes SAM, Smart CM, Wolfsgruber S, & Wagner M (2020). The characterization of subjective cognitive decline. The Lancet. Neurology, 19(3), 271–278. 10.1016/S1474-4422(19)30368-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jessen F, Amariglio RE, van Boxtel M, Breteler M, Ceccaldi M, Chételat G, Dubois B, Dufouil C, Ellis KA, van der Flier WM, Glodzik L, van Harten AC, de Leon MJ, McHugh P, Mielke MM, Molinuevo JL, Mosconi L, Osorio RS, Perrotin A, … Subjective Cognitive Decline Initiative (SCD-I) Working Group. (2014). A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer’s disease. Alzheimer’s & Dementia, 10(6), 844–852. 10.1016/j.jalz.2014.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jeste DV, & Lee EE (2019). The emerging empirical science of wisdom: Definition, measurement, neurobiology, longevity, and interventions. Harvard Review of Psychiatry, 27(3), 127–140. 10.1097/HRP.0000000000000205 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson DR, & Borden LA (2012). Participants at your fingertips: Using Amazon’s Mechanical Turk to increase student–faculty collaborative research. Teaching of Psychology, 39(4), 245–251. 10.1177/0098628312456615 [DOI] [Google Scholar]
- Kielb S, Rogalski E, Weintraub S, & Rademaker A (2017). Objective features of subjective cognitive decline in a United States national database. Alzheimer’s & Dementia, 13(12), 1337–1344. 10.1016/j.jalz.2017.04.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koppara A, Wagner M, Lange C, Ernst A, Wiese B, König H-H, Brettschneider C, Riedel-Heller S, Luppa M, Weyerer S, Werle J, Bickel H, Mösch E, Pentzek M, Fuchs A, Wolfsgruber S, Beauducel A, Scherer M, Maier W, & Jessen F (2015). Cognitive performance before and after the onset of subjective cognitive decline in old age. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring, 1(2), 194–205. 10.1016/j.dadm.2015.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kroenke K, Spitzer RL, & Williams JBW (2003). The Patient Health Questionnaire-2: Validity of a two-item depression screener. Medical Care, 41(11)1284–1292. 10.1097/01.MLR.0000093487.78664.3C [DOI] [PubMed] [Google Scholar]
- Kroenke Kurt, Spitzer RL, Williams JBW, Monahan PO, & Löwe B (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146(5), 317–325. 10.7326/0003-4819-146-5-200703060-00004 [DOI] [PubMed] [Google Scholar]
- Lauriola M, Esposito R, Delli Pizzi S, de Zambotti M, Londrillo F, Kramer JH, Rabinovici GD, & Tartaro A (2017). Sleep changes without medial temporal lobe or brain cortical changes in community-dwelling individuals with subjective cognitive decline. Alzheimer’s & Dementia, 13(7), 783–791. 10.1016/j.jalz.2016.11.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee E, Bangen KJ, Avanzino JA, Hou B, Ramsey M, Eglit G, Liu J, Tu XM, Paulus M, & Jeste DV (2020). Outcomes of randomized clinical trials to enhance social, emotional, and spiritual components of wisdom: A systematic review and meta-analysis. JAMA Psychiatry, 77(9), 925–935. doi: 10.1001/jamapsychiatry.2020.0821 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee JE, Ju YJ, Park E-C, & Lee SY (2020). Effect of poor sleep quality on subjective cognitive decline (SCD) or SCD-related functional difficulties: Results from 220,000 nationwide general populations without dementia. Journal of Affective Disorders, 260, 32–37. 10.1016/j.jad.2019.08.082 [DOI] [PubMed] [Google Scholar]
- Litman L, Robinson J, & Rosenzweig C (2015). The relationship between motivation, monetary compensation, and data quality among US- and India-based workers on Mechanical Turk. Behavior Research Methods, 47(2), 519–528. 10.3758/s13428-014-0483-x [DOI] [PubMed] [Google Scholar]
- Mason W, & Suri S (2012). Conducting behavioral research on Amazon’s Mechanical Turk. Behavior Research Methods, 44(1), 1–23. 10.3758/s13428-011-0124-6 [DOI] [PubMed] [Google Scholar]
- Meeks TW, & Jeste DV (2009). Neurobiology of wisdom: A literature overview. Archives of General Psychiatry, 66(4), 355. 10.1001/archgenpsychiatry.2009.8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miley-Akerstedt A, Jelic V, Marklund K, Walles H, Åkerstedt T, Hagman G, & Andersson C (2018). Lifestyle factors are important contributors to subjective memory complaints among patients without objective memory impairment or positive neurochemical biomarkers for Alzheimer’s Disease. Dementia and Geriatric Cognitive Disorders Extra, 8(3), 439–452. 10.1159/000493749 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mol MEM, van Boxtel Martin. P. J., Willems D, & Jolles J (2006). Do subjective memory complaints predict cognitive dysfunction over time? A six-year follow-up of the Maastricht Aging Study. International Journal of Geriatric Psychiatry, 21(5), 432–441. 10.1002/gps.1487 [DOI] [PubMed] [Google Scholar]
- Molinuevo JL, Rabin LA, Amariglio R, Buckley R, Dubois B, Ellis KA, Ewers M, Hampel H, Klöppel S, Rami L, Reisberg B, Saykin AJ, Sikkes S, Smart CM, Snitz BE, Sperling R, van der Flier WM, Wagner M, Jessen F, & Subjective Cognitive Decline Initiative (SCD-I) Working Group. (2017). Implementation of subjective cognitive decline criteria in research studies. Alzheimer’s & Dementia, 13(3), 296–311. 10.1016/j.jalz.2016.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mortensen K, & Hughes TL (2018). Comparing Amazon’s Mechanical Turk platform to conventional data collection methods in the health and medical research literature. Journal of General Internal Medicine, 33(4), 533–538. 10.1007/s11606-017-4246-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muris P (2002). Relationships between self-efficacy and symptoms of anxiety disorders and depression in a normal adolescent sample. Personality and Individual Differences, 32(2), 337–348. 10.1016/S0191-8869(01)00027-7 [DOI] [Google Scholar]
- Nguyen TT, Lee EE, Daly RE, Wu TC, Tang Y, Tu X, ... & Palmer BW (2020). Predictors of loneliness by age decade: study of psychological and environmental factors in 2,843 community-dwelling Americans aged 20–69 years. The Journal of Clinical Psychiatry, 81(6). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peer E, Vosgerau J, & Acquisti A (2014). Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods, 46(4), 1023–1031. 10.3758/s13428-013-0434-y [DOI] [PubMed] [Google Scholar]
- Ponds RWHM, Commissaris KJAM, & Jolles J (1997). Prevalence and covariates of subjective forgetfulness in a normal population in the netherlands. The International Journal of Aging and Human Development, 45(3), 207–221. 10.2190/MVQ1-WB58-875H-Y4X0 [DOI] [PubMed] [Google Scholar]
- Ponds RWHM & Van Boxtel MPH (2000). Age-related changes in subjective cognitive functioning. Educational Gerontology, 26(1), 67–81. 10.1080/036012700267402 [DOI] [Google Scholar]
- Rabin LA, Crane PK, Amariglio RE, Berman LM, Boada M, Buckley RF, Chételat G, Dubois B, Ellis KA, Gifford KA, Jefferson AL, Jessen F, Katz MJ, Lipton RB, Luck T, Maruff P, Mielke MM, Molinuevo JL, Naeem F, … Sikkes SAM (2015). Subjective cognitive decline in older adults: An overview of self-report measures used across 19 international research studies. Journal of Alzheimer’s Disease, 48(s1), S63–S86. 10.3233/JAD-150154 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rayner G, Wrench J, & Wilson S (2010). Differential contributions of objective memory and mood to subjective memory complaints in refractory focal epilepsy. Epilepsy and Behavior, 19(3), 359–364. 10.1016/j.yebeh.2010.07.019 [DOI] [PubMed] [Google Scholar]
- Reid LM, & MacLullich AMJ (2006). Subjective memory complaints and cognitive impairment in older people. Dementia and Geriatric Cognitive Disorders, 22(5–6), 471–485. 10.1159/000096295 [DOI] [PubMed] [Google Scholar]
- Reid M, Parkinson L, Gibson R, Schofield P, D’Este C, Attia J, Tavener M, & Byles J (2012). Memory Complaint Questionnaire performed poorly as screening tool: Validation against psychometric tests and affective measures. Journal of Clinical Epidemiology, 65(2), 199–205. 10.1016/j.jclinepi.2011.06.006 [DOI] [PubMed] [Google Scholar]
- Rodríguez-Gómez O, Abdelnour C, Jessen F, Valero S, & Boada M (2015). Influence of sampling and recruitment methods in studies of subjective cognitive decline. Journal of Alzheimer’s Disease, 48(s1), S99–S107. 10.3233/JAD-150189 [DOI] [PubMed] [Google Scholar]
- Russell D, Peplau LA, & Cutrona CE (1980). The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. Journal of Personality and Social Psychology, 39(3), 472–480. 10.1037/0022-3514.39.3.472 [DOI] [PubMed] [Google Scholar]
- Slavin MJ, Brodaty H, Kochan NA, Crawford JD, Trollor JN, Draper B, & Sachdev PS (2010). Prevalence and predictors of “subjective cognitive complaints” in the Sydney Memory and Ageing Study. The American Journal of Geriatric Psychiatry, 18(8), 701–710. 10.1097/JGP.0b013e3181df49fb [DOI] [PubMed] [Google Scholar]
- Snitz BE, Wang T, Cloonan YK, Jacobsen E, Chang C-CH, Hughes TF, Kamboh MI, & Ganguli M (2018). Risk of progression from subjective cognitive decline to mild cognitive impairment: The role of study setting. Alzheimer’s & Dementia, 14(6), 734–742. 10.1016/j.jalz.2017.12.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sprouse J (2011). A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behavior Research Methods, 43(1), 155–167. 10.3758/s13428-010-0039-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steinberg SI, Negash S, Sammel MD, Bogner H, Harel BT, Livney MG, McCoubrey H, Wolk DA, Kling MA, & Arnold SE (2013). Subjective memory complaints, cognitive performance, and psychological factors in healthy older adults. American Journal of Alzheimer’s Disease & Other Dementiasr, 28(8), 776–783. 10.1177/1533317513504817 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stenfors CUD, Marklund P, Magnusson Hanson LL, Theorell T, & Nilsson L-G (2013). Subjective cognitive complaints and the role of executive cognitive functioning in the working population: A case-control study. PLoS ONE, 8(12), e83351. 10.1371/journal.pone.0083351 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stone A, Bachrach C, Jobe J, Kurtzman H, & Cain V (1999). The science of self-report: Implications for research and practice Psychology Press. [Google Scholar]
- Thomas M, Bangen K, Palmer B, Martin A, Avanzino J, Depp C, Glorioso D, Daly R, & Jeste D (2019). A new scale for assessing wisdom based on common domains and a neurobiological model: The San Diego Wisdom Scale (SD-WISE). Journal of Psychiatric Research, 108, 40–47. 10.1016/j.jpsychires.2017.09.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas ML, Bangen KJ, Palmer BW, Sirkin Martin A, Avanzino JA, Depp CA, Glorioso D, Daly RE, & Jeste DV (2019). A new scale for assessing wisdom based on common domains and a neurobiological model: The San Diego Wisdom Scale (SD-WISE). Journal of Psychiatric Research, 108, 40–47. 10.1016/j.jpsychires.2017.09.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tilvis RS, Kahonen-Vare MH, Jolkkonen J, Valvanne J, Pitkala KH, & Strandberg TE (2004). Predictors of cognitive decline and mortality of aged people over a 10-year period. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 59(3), 268–274. 10.1093/gerona/59.3.M268 [DOI] [PubMed] [Google Scholar]
- Treichler EBH, Glorioso D, Lee EE, Wu T-C, Tu XM, Daly R, O’Brien C, Smith JL, & Jeste DV (2020). A pragmatic trial of a group intervention in senior housing communities to increase resilience. International Psychogeriatrics, 32(2), 173–182. 10.1017/S1041610219002096 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vaessen T, Overeem S, & Sitskoorn M (2015). Cognitive complaints in obstructive sleep apnea. Sleep Medicine Reviews, 19, 51–58. 10.1016/j.smrv.2014.03.008 [DOI] [PubMed] [Google Scholar]
- Vestergren P, & Nilsson L-G (2011). Perceived causes of everyday memory problems in a population-based sample aged 39–99. Applied Cognitive Psychology, 25(4), 641–646. 10.1002/acp.1734 [DOI] [Google Scholar]
- Visser PJ, Verhey F, Knol DL, Scheltens P, Wahlund L-O, Freund-Levi Y, Tsolaki M, Minthon L, Wallin ÅK, Hampel H, Bürger K, Pirttila T, Soininen H, Rikkert MO, Verbeek MM, Spiru L, & Blennow K (2009). Prevalence and prognostic value of CSF markers of Alzheimer’s disease pathology in patients with subjective cognitive impairment or mild cognitive impairment in the DESCRIPA study: A prospective cohort study. The Lancet Neurology, 8(7), 619–627. 10.1016/S1474-4422(09)70139-5 [DOI] [PubMed] [Google Scholar]
- Weis J, Poppelreuter M, & Bartsch H (2009). Cognitive deficits as long-term side-effects of adjuvant therapy in breast cancer patients: ‘Subjective’ complaints and ‘objective’ neuropsychological test results. Psychooncology, 18, 775–782. 10.1002/pon.1472 [DOI] [PubMed] [Google Scholar]
- Wilson RS, Krueger KR, Arnold SE, Schneider JA, Kelly JF, Barnes LL, Tang Y, & Bennett DA (2007). Loneliness and risk of Alzheimer Disease. Archives of General Psychiatry, 64(2), 234. 10.1001/archpsyc.64.2.234 [DOI] [PubMed] [Google Scholar]
- Yaffe K, Laffan AM, Harrison SL, Redline S, Spira AP, Ensrud KE, Ancoli-Israel S, & Stone KL (2011). Sleep-disordered breathing, hypoxia, and risk of mild cognitive impairment and dementia in older women. JAMA, 306(6), 613–619. 10.1001/jama.2011.1115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zullig K, Teoli D, & Valois R (2011). Evaluating a brief measure of social self-efficacy among US adolescents. Psychological Reports, 109(3), 907–920. 10.2466/02.09.PR0.109.6.907-920 [DOI] [PubMed] [Google Scholar]