Abstract
Background
Cognitive decline and Alzheimer’s disease often affect older adults with Down syndrome (DS) much earlier than those in the general population. There is also growing evidence of the effects of negative life events on the mental health and behavior of individuals with intellectual disability. However, to our knowledge, this is the first study investigating objective cognitive decline following bereavement in aging individuals with DS.
Objective
The objective of this study was to determine whether cognitive decline correlates with bereavement following the recent loss of a caregiver or with behavioral changes in a sample of adult individuals with DS who do not meet the criteria for dementia or depression, using the longitudinal assessment of the Cambridge Cognitive Examination (CAMCOG), together with the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE).
Methods
We evaluated 18 subjects at baseline and over a follow-up period of 14–22 months, attempting to determine whether cognitive decline correlates with bereavement following the recent loss of the main caregiver or with behavioral changes (as assessed with the Neuropsychiatric Inventory).
Results
The mean rate of change in CAMCOG was −1.83 (standard deviation 4.51). Behavioral changes had a significant direct influence on cognitive decline. When bereavement was accompanied by behavioral changes, the probability of cognitive decline was 87% (odds ratio 3.82).
Conclusion
The occurrence of behavioral changes attributed to bereavement following the loss of the primary caregiver significantly increases the probability of cognitive decline in individuals with DS. Longitudinal comparison of the CAMCOG and use of the IQCODE appear to enrich the analysis of cognitive decline in individuals with DS. Further studies involving larger samples are needed in order to corroborate and expand upon our findings, which can have implications for the clinical management of older adults with DS.
Keywords: cognitive decline, Down syndrome, bereavement, behavioral changes, Cambridge Cognitive Examination, Informant Questionnaire on Cognitive Decline in the Elderly
Introduction
The genetic relationship between Down syndrome (DS) and the early development of neuropathological characteristics of Alzheimer’s disease (AD), attributed to overexpression of β-amyloid precursor protein on chromosome 21, is well documented.1–4 Although dementia is considered the major problem faced by aging individuals with DS,5 there is a lack of data regarding the distinctions between cognitive decline related to the normal aging process and that characteristic of early indicators of neurodegenerative aspects of the syndrome.6,7 Although it is believed that, after reaching the age of 40 years, all individuals with DS have the neuropathological features of AD,4 it remains unclear why only some of them show early clinical evidence of the disease. In addition, the precursors that hasten cognitive decline and trigger the clinical symptoms of AD in such individuals have yet to be identified.
With the increase in life expectancy, individuals with DS are now more likely to experience the bereavement that follows the loss of a parent or caregiver. However, family members and caregivers still underestimate the extent of the bereavement process in such individuals.8–10 There is considerable scientific evidence regarding the negative effects of stressful events on the physical and mental health of the population in general,11–13 regarding the association between depressive symptoms and a progressive decline in cognitive function14 and, more specifically, regarding bereavement as a risk factor for health problems in the elderly.15–17 It is also broadly hypothesized that intellectual disability (ID) is a predictor of mental health problems following bereavement.9,18–21 Nevertheless, there have been few prospective, population-based studies of this topic.22–24 In addition, we were unable to identify any studies using objective cognitive measures to determine the effects that bereavement or other negative life events have on cognition in aging individuals with DS or other etiologies of ID. The recently developed concept of complicated grief (also referred to as prolonged grief disorder, traumatic grief, or persistent complex bereavement disorder) indicates the need for further investigations of the pathological grief response, in order to predict long-term functional impairments, especially in vulnerable populations.12,25–27 The DSM-V (Diagnostic and Statistical Manual of Mental Disorders, 5th Edition) includes persistent complex bereavement disorder in Conditions for Further Study,28 encouraging new research that would enable its inclusion with robust criteria in the next edition. The risk of persistent complex bereavement disorder is heightened by increased dependency on the deceased person.28 According to the ICD-10 (Tenth Revision of the International Classification of Diseases),29 symptoms of normal grief occur within 1 month of the death and do not persist for more than 6 months. According to the DSM-V,28 normal grief does not persist for more than 12 months in adults and 6 months in children. The Diagnostic Manual-Intellectual Disability (DM-ID): A Textbook of Diagnosis of Mental Disorders in Persons with Intellectual Disability30 offers no adaptation for symptoms considered as part of normal grief in people with ID to those seen in the general population in the text revised edition of the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM-IV).31,32 There is mounting evidence that the onset of grief is delayed and its duration is prolonged in individuals with ID.22,23,33
Many authors had pointed out that individuals with ID are vulnerable to development of pathological responses to the death of a loved one and negative life events, such responses including aberrant behavior and disease.9,18,19,21,24,33 In a study investigating changes in health status, functional ability, and behavior among individuals with ID, parental death was associated with a behavioral change persisting for more than 2 years.23 There is also evidence that changes in the personality and behavior of adult individuals with DS often indicate prodromal (early stages of) AD,34–39 underscoring the importance of investigating the relationships between bereavement, behavioral changes, and cognitive decline.
The instruments used for detection of cognitive decline and dementia in the general population are not well adapted for use in individuals with ID.30,40,41 AD remains one of the most commonly diagnosed and misdiagnosed mental disorders in adults with DS.33 Screening instruments, such as the Mini-Mental State Examination (MMSE)42 and neuropsychological assessment tests, identify signs of dementia by evaluating various cognitive functions but do not take into account pre-existing intellectual deficits, which can negatively affect the performance of individuals on such tests. A recent systematic review showed that, although numerous instruments are used in order to screen for dementia in individuals with ID, the majority of them are not well adapted for use in this population.43 Some adapted instruments have recently been shown to produce consistent results in this population.35,40,41,44,45 However, in many countries, such instruments have yet to be validated, which makes it difficult to assess cognitive decline and to diagnose dementia. This also impedes the referral of patients for pharmacological and psychosocial treatment to mitigate or delay the consequences of progression of the disease. Given the difficulties in assessing dementia and cognitive decline in such individuals, longitudinal comparison of individual performance has proven useful in their clinical evaluation.39,46–49 In heterogeneous populations, such as the population with ID, the use of a cognitive assessment instrument and a scale applied to the informant has proven to be more effective in detecting early and moderate cases of dementia, as well as cognitive decline, than is the use of a single instrument.50 Examples of such instruments include the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE) and the Cambridge Cognitive Examination (CAMCOG).51,52
Our hypothesis was that a behavioral change associated with bereavement would increase the probability of cognitive decline in individuals with DS. Therefore, the objective of the present study was to investigate the correlations between cognitive decline, bereavement, and behavioral changes in adult individuals with DS not meeting the criteria for dementia or depression. To that end, we applied the IQCODE and (for longitudinal comparison) the CAMCOG.
Subjects and methods
Subjects
All the subjects were enrolled in the Aging Support Service of the Association of Parents and Friends of Individuals with Intellectual Disability of São Paulo. The service has an interdisciplinary team approach and assists people with ID over the age of 35 years focusing on health and quality of life. Physical, corporal, and artistic activities are offered to enhance cognitive and functional abilities. In 2011, from among 49 individuals with DS over 35 years of age, all enrolled in that service and none meeting the criteria for dementia, we randomly selected 21 subjects. After baseline evaluation, the selected subjects were followed for 14–22 months (mean 18.33, standard deviation [SD] 3.06). The sample size of 21 and the differences in the length of follow-up were determined by limitations related to time constraints and lack of funding, the assessments being performed by one neuropsychologist from the institution who had other responsibilities within the facility, as well as to absences on the part of the subjects (for vacation and convalescence) or loss to follow-up. The diagnosis of DS was confirmed by cytogenetic analysis and by identification of phenotypic characteristics of DS. The level of ID was not analyzed, because none of the instruments designed to assess the degree of moderate and severe disabilities have yet been validated for use in Brazil. Therefore, in Brazil, the level of ID is determined by clinical evaluation, the results of which are often inconclusive or debatable. In the baseline evaluation, a diagnosis of dementia, according to the ICD-10 and DSM-IV criteria, was one of the exclusion criteria. Of the 21 selected subjects, two were suspected of having AD in the baseline evaluation, and that suspicion was confirmed during the follow-up period, and another subject was taking antidepressant medication during follow-up. Those three subjects were therefore excluded from the analyses, and the final sample was composed of 18 individuals. By follow-up, the sample was divided in two groups: six patients with DS who experienced bereavement, and 12 patients with DS who did not. For those who experienced bereavement, the mean length of follow-up was 18.5 (SD 3.09) months compared with 18.16 (SD 3.03) months for the 12 remaining subjects.
The baseline assessments were performed at the facilities of the Aging Support Service of the Association of Parents and Friends of Individuals with Intellectual Disability of São Paulo. During the follow-up period, the majority of subjects and informants were evaluated at the same institution, except for three who were no longer enrolled in the program and were assessed in their homes.
The study was approved by the research ethics committee of the Federal University of São Paulo. All subjects and their legal guardians gave their written informed consent.
Demographic data
Of the 18 subjects, 12 were male and six were female. All were living in private residences with family members, except for one who was living alone with family supervision. The age at baseline ranged from 35 to 55 years (mean 42.44, SD 6.11). Fourteen of the subjects were illiterate. One subject had never attended school. The remaining subjects had studied in schools specialized in educating individuals with ID, although one subject had attended regular school up to the fourth grade.
Health status
The diagnosis of dementia or depression was made by a geriatrician through clinical analysis based on the criteria established in the ICD-10 and the DSM-IV.29,32 The attending physician was blinded to the results of the neuropsychological assessments and the cognition scores. None of the subjects met the criteria for a diagnosis of depression. Eight of the subjects had comorbidities: hypothyroidism, in eight; heart disease, in two; pulmonary hypertension, in one; digestive disorder, in one; coagulation disorder, in one; gout, in one; and high cholesterol, in one. Four subjects had only one comorbidity, whereas two had two, one had three, and one had four comorbidities. All cases with hypothyroidism were effectively treated at baseline and follow-up.
Of the 18 subjects, eight were using some type of medication. Of those eight, one was taking a neuroleptic, a medication that affects the central nervous system. The latter subject had not been recently bereaved.
Longitudinal neuropsychological evaluation
CAMCOG
The CAMCOG is a brief neuropsychological battery that is part of the Cambridge Examination for Mental Disorders of the Elderly interview.52 The CAMCOG offers a wide possibility of scores, covering several cognitive functions, as well as incorporating the MMSE. The test has subscales for orientation, language, memory, attention, praxis, calculation, abstract thinking, and perception.
The CAMCOG has been applied in the general population, and it has been shown that there are significant differences between the population without dementia and that of those with early-stage or intermediate-stage dementia, in terms of the total CAMCOG score and each of the subscale scores.53 The CAMCOG has been validated for use in Brazil.54,55 The CAMCOG longitudinal comparison has been investigated by various researchers, who achieved good results for evaluation of normal and pathological declines in the general population.56–58 Researchers in England adapted the CAMCOG for use in individuals with ID,35 and a recent study involving the application of the CAMCOG for DS validated it for use in the ID population of Spain.44
In the present study, longitudinal comparison of neuropsychological performance involved application of the CAMCOG at baseline and after 14–22 months of follow-up. The CAMCOG was administered by a professional properly trained in the use of the instrument and blinded to any previous results. As comparison data for measuring cognitive decline, we employed the results of CAMCOG longitudinal comparisons obtained in studies of populations without DS, including those conducted by Cullum et al57 who reported an annual decline of 1.6 points per year; Brayne et al56 who observed a normal decline of 4.7 points in 5 years; and Jonker et al58 who reported an annual decline of 1.4 points for carriers of the apoE4 allele and 0.4 points for noncarriers. Although we recognize the fact that there are major differences among the studies, in terms of subject ages and sample sizes, we considered it important to cite these studies, because we were unable to identify any reference values for normal cognitive decline in aging individuals with DS. The cognitive decline observed in our study sample was quantified and correlated with the other variables evaluated.
IQCODE
The IQCODE is a widely used instrument that is easily applied to heterogeneous, uneducated populations,51,58,60 as well as being an instrument that is applied to the informant. The IQCODE is a rating scale of cognitive and functional decline that compares the current performance of the subject with that of 10 years ago. By making this comparison over time, the instrument does not take into account a standard of behavior, but rather the standard of functionality achieved by each individual during adulthood. Therefore, the IQCODE is easily adapted for use in individuals with different levels of education or disability. The IQCODE consists of 26 items that are simple and easy to understand. It has been validated for use in Brazil, where it has been shown to be sensitive and specific in screening for dementia in the elderly.60,61
We found no studies using the IQCODE specifically for individuals with DS, although the 16-item short form IQCODE59 was used in one study evaluating individuals with ID.62 The authors concluded that the short form IQCODE probably needs to be modified for use in this population, although they acknowledged that some study limitations might have resulted in suboptimal estimates and made their findings questionable. As the authors pointed out, there are many important methodological limitations, such as limited contact between the informant and subject and variations in the time frame of caregiver–subject contact (2–10 years), that is not in accordance with the procedures outlined for the IQCODE, which state that the informant (the primary caregiver) must have had daily contact with the subject for at least 10 years. In our study, we aimed to avoid the same missteps. Certain social and cultural aspects of our sample allow us to hypothesize that the IQCODE could be a suitable tool for use in our population, because individuals with DS in Brazil often live with their families, rather than being institutionalized.
In the present study, the IQCODE was administered by a trained professional. All informants who completed the questionnaire had daily contact with the subject, relationships established at least 10 years prior, and were the primary caregivers at the time of evaluation. To categorize the degree of decline, as investigated by the IQCODE, we used a total IQCODE score >3 (any cognitive decline) and the cut-off scores for dementia of ≥3.16 reported for the Brazilian population by Perroco et al.60
Medication use and comorbidities
The study protocol involved collecting data related to the use of medications at baseline and during follow-up and identifying comorbidities, especially hypothyroidism.
Behavioral changes
During the follow-up period, reports of behavioral changes in the last 2 years, as measured by the Neuropsychiatric Inventory,63,64 were collected from the staff of the institution and from family members. In our analysis, behavioral changes were defined as any type of behavioral change identified by the Neuropsychiatric Inventory (delusions, hallucinations, dysphoria, anxiety, agitation/aggression, euphoria, disinhibition, irritability/lability, apathy, or aberrant motor activity).
Bereavement
We collected information regarding the deaths of primary caregivers during the 2 years prior to follow-up. All of our assessments were made at least 6 months after those deaths. The length of time between bereavement and the follow-up assessment tests for each patient was 24, 18, 12, 6, 12, and 24 months (n=6, mean 16, SD 6.63). The information was obtained from the individual who was the primary caregiver at the time of evaluation.
Statistical analysis
Assumptions of homogeneity between groups of demographic features were verified with the Chi-square test. We observed a heterogeneous sex distribution only for the variables ΔCAMCOG score and IQCODE cut-off score of 3.16. Therefore, for those variables, we used backward stepwise logistic regression adjusted for sex to determine the relevance of the other variables, calculating odds ratios and estimated probabilities.
To identify differences between the baseline and final evaluations, in terms of the CAMCOG subscale scores, we used the nonparametric Wilcoxon test.
We constructed receiver operating characteristic curves (ROC curves) in order to determine the relevance of the IQCODE score in relation to the degree of cognitive decline determined with the CAMCOG. For the equivalence of mean difference in CAMCOG with other studies, we used one-sample t-tests and confidence intervals.
All selected data were analyzed using Statistical Package for the Social Sciences version 14.0 software for Windows (SPSS Inc., Chicago, IL, USA). The level of statistical significance was set at 5%.
Results
Measures of cognitive decline
CAMCOG scores
Of the 18 subjects included in the study, eleven showed some degree of cognitive decline during the 14–22 months of follow-up, as evidenced by the difference between the baseline and final evaluations, in terms of the ΔCAMCOG score (mean −4.63, SD 3.17). Of the seven subjects who showed no cognitive decline, six actually showed some improvement in cognitive function and one remained the same (mean ΔCAMCOG score for the subgroup 2.57, SD 1.98). The mean ΔCAMCOG score for the sample as a whole was −1.83 points (SD 4.51, 95% confidence interval [CI] −4.07 to 0.41). This value is comparable with the −1.88 (95% CI −2.36 to −1.36, P=0.966), −2.7 (95% CI −3.58 to 1.82, P=0.427), and −3.2 (95% CI −4.0 to −2.2, P=0.216) reported for the general elderly population in a linear estimation of 2 years by Brayne et al,56 Jonker et al,58 and Cullum et al,57 respectively.
The areas of greatest cognitive decline on the CAMCOG scale, as measured by the Wilcoxon test, were the domains of language (P=0.025), abstract thinking (P=0.046), and perception (P=0.034). Of the 18 subjects, eleven (61%) exhibited some decline in the language domain, mainly in comprehension (P=0.020).
IQCODE scores
Eleven of the 18 informants had observed a functional decline in some area, as measured by the IQCODE, within the last 10 years. In our box-plot analysis of the mean IQCODE scores, we identified three outliers indicating a functional gain (IQCODE score <2). When those three outliers were excluded, the mean IQCODE score was 3.12 (n=16, 95% CI 3.02–3.22).
CAMCOG versus IQCODE
The receiver operating characteristic curve in which the dependent variable was CAMCOG-determined cognitive decline showed that the IQCODE discriminates well between groups (ROC curve area 0.734, 95% CI 0.498–0.970).
Responses indicative of worsening on the IQCODE items related to memory (items 1–10, 15, 16, and 21) and were found to correlate significantly with a decline in the CAMCOG memory subscale score (P=0.013).
The IQCODE items that had the highest rates of “not applicable” responses were items 24 (mean 0.83, 95% CI 0.64–1.02), 23 (mean 0.72, 95% CI 0.49–0.95), 20 (mean 0.61, 95% CI 0.36–0.86), and 21 (mean 0.56, 95% CI 0.30–0.81). Table 1 shows which IQCODE items had the greatest influence on the decline in the total IQCODE score, the distribution of responses by item, and the relative risk of positive response in each item, stratified by the IQCODE score (≥3.16).
Table 1.
IQCODE item | Combined frequency of response (worsened) | Chi-square for IQCODE score ≥3.16
|
|||
---|---|---|---|---|---|
% of positive responses
|
Relative risk | P-value | |||
<3.16 | ≥3.16 | ||||
4. Remembering things that have happened recently | 22.2% | 7.1% | 75% | 10.5 | 0.019 |
6. Forgetting what he/she wanted to say in the middle of a conversation | 27.8% | 14.3% | 75% | 5.2 | 0.044 |
11. Adjusting to any change in his/her day-to-day routine | 27.8% | 14.3% | 75% | 5.2 | 0.044 |
14. Learning new things in general | 27.8% | 14.3% | 75% | 5.2 | 0.044 |
22. Making decisions on everyday matters | 33.3% | 14.3% | 100% | 6.9 | 0.005 |
Note: We have listed only the IQCODE items for which there was a statistically significant correlation with cognitive decline.
Abbreviation: IQCODE, Informant Questionnaire on Cognitive Decline in the Elderly.
Behavioral changes, bereavement, and cognitive change
None of our 18 subjects exhibited delusions, hallucinations, or aberrant motor activity. A total of eleven subjects exhibited at least one behavioral change, six exhibited only one, four exhibited two, and one exhibited four. Three of the subjects exhibited agitation/aggression, one exhibited euphoria, one exhibited anxiety, two exhibited apathy, two exhibited dysphoria, four exhibited disinhibition, and five exhibited irritability/lability. Six subjects lost their primary caregiver during the study period, and all of them exhibited behavioral changes after the loss.
We found that behavioral changes had a direct influence on cognitive decline (P=0.049). For the eleven subjects who exhibited behavioral changes, the mean ΔCAMCOG score was −3.81 (SD 3.78), compared with 1.28 (SD 3.90) for the seven remaining subjects (P=0.035), indicating that the subjects exhibiting no behavioral changes also showed no cognitive decline.
Six subjects had recently gone through a period of bereavement after the death of their primary caregiver, and all of those subjects exhibited subsequent behavioral changes, compared with only half of the subjects who had not recently been bereaved. Five of those six subjects (83%) also showed a decline in their CAMCOG score. For those who experienced bereavement, the mean ΔCAMCOG was −4.16 (SD 4.41, 95% CI −8.43, −0.10), compared with −0.66 (SD 4.07, 95% CI −3.47, 2.14) for the 12 remaining subjects (comparison not considered statistically significant). Figure 1 shows the differences in the subscale scores after follow-up between the two groups, and Table 2 describes the differences including demographic characteristics, length of follow-up time, CAMCOG total score, and subscale scores, as well as behavioral changes.
Table 2.
Not bereaved (n=12)
|
Bereaved (n=6)
|
Differences between groups
|
|||
---|---|---|---|---|---|
Mean | SD | Mean | SD | P-value (by Mann–Whitney test) | |
Age at baseline, years | 43.75 | 6.76 | 39.83 | 3.82 | 0.397 |
Age at follow-up, years | 44.83 | 6.78 | 41.33 | 4.03 | 0.452 |
Follow-up period (months) | 18.33 | 3.06 | 18.33 | 3.39 | 0.850 |
Baseline scores | |||||
Orientation | 7.33 | 2.10 | 7.17 | 1.84 | 0.811 |
Language total | 16.00 | 4.13 | 16.33 | 3.93 | 0.887 |
Comprehension | 4.42 | 1.62 | 4.17 | 0.98 | 0.885 |
Expression | 11.58 | 2.81 | 12.33 | 2.81 | 0.887 |
Memory total | 11.50 | 4.36 | 12.67 | 5.13 | 0.573 |
Long-term memory | 1.08 | 0.79 | 1.33 | 0.82 | 0.514 |
Short-term memory | 2.50 | 1.17 | 1.50 | 0.84 | 0.078 |
Learning | 7.92 | 3.68 | 10.00 | 4.34 | 0.202 |
Attention | 0.17 | 0.58 | 0.00 | 0.00 | 0.480 |
Praxis | 7.92 | 1.38 | 8.00 | 1.10 | 0.810 |
Calculation | 0.17 | 0.39 | 0.17 | 0.41 | 1.000 |
Abstract thought | 2.25 | 1.36 | 2.67 | 2.66 | 0.809 |
Perception | 7.25 | 1.14 | 8.00 | 1.55 | 0.337 |
CAMCOG total | 52.58 | 11.63 | 54.17 | 11.62 | 0.850 |
MMSE | 15.17 | 3.86 | 13.67 | 4.41 | 0.451 |
Follow-up scores | |||||
Follow-up period (months) | 18.33 | 3.06 | 18.33 | 3.39 | 0.850 |
Orientation | 7.00 | 2.00 | 5.83 | 3.37 | 0.538 |
Language total | 14.92 | 3.32 | 14.50 | 4.14 | 0.814 |
Comprehension | 3.50 | 1.24 | 3.00 | 1.79 | 0.382 |
Expression | 11.42 | 2.61 | 11.67 | 2.66 | 0.962 |
Memory total | 12.17 | 4.69 | 10.83 | 6.08 | 0.572 |
Long-term memory | 1.08 | 0.79 | 1.17 | 0.98 | 0.955 |
Short-term memory | 2.92 | 1.00 | 1.50 | 1.38 | 0.034 |
Learning | 8.58 | 3.63 | 8.17 | 4.75 | 0.963 |
Attention | 0.08 | 0.29 | 0.00 | 0.00 | 0.480 |
Praxis | 8.08 | 1.00 | 8.33 | 0.82 | 0.652 |
Calculation | 0.17 | 0.39 | 0.00 | 0.00 | 0.303 |
Abstract thought | 1.83 | 1.75 | 1.17 | 1.33 | 0.408 |
Perception | 7.58 | 1.51 | 9.17 | 1.47 | 0.054 |
CAMCOG total | 51.92 | 11.87 | 50.00 | 14.31 | 0.639 |
MMSE | 14.83 | 4.24 | 13.67 | 4.93 | 0.638 |
IQCODE | 3.05 (n=9)† | 0.11 (n=9)† | 3.23 | 0.22 | 0.027 |
n | % | n | % | P-value (by Fisher’s exact test) | |
Sex (male) | 7 | 58.3 | 5 | 83.3 | 0.600 |
Literacy (illiterate) | 8 | 66.7 | 6 | 100.0 | 0.245 |
Comorbidity (without) | 6 | 50.0 | 4 | 66.7 | 0.638 |
IQCODE >3.16 | 1 | 8.3 | 3 | 50.0 | 0.083 |
Any change in behavior | 5 | 41.7 | 6 | 100.0 | 0.038 |
Kind of behavior change | |||||
Agitation/aggression | 1 | 8.3 | 2 | 33.3 | 0.245 |
Euphoria | 0 | 0 | 1 | 16.7 | 0.333 |
Anxiety | 0 | 0 | 1 | 16.7 | 0.333 |
Apathy | 0 | 0 | 2 | 33.3 | 0.098 |
Dysphoria | 0 | 0 | 2 | 33.3 | 0.098 |
Disinhibition | 3 | 25.0 | 1 | 16.7 | 1 |
Irritability/lability | 3 | 25.0 | 2 | 33.3 | 1 |
Note:
Excluded three outliers (identified by box-plot analysis).
Abbreviations: MMSE, Mini-Mental State Examination; CAMCOG, Cambridge Cognitive Examination; IQCODE, Informant Questionnaire on Cognitive Decline in the Elderly; SD, standard deviation; n, number of subjects.
Using the Kolmogorov–Smirnov test, we found that the IQCODE data did not follow a normal distribution. Therefore, to assess the relevance of the variables to the IQCODE score, we stratified the results into two categories: worse performance (IQCODE score >3) and the same or better performance (IQCODE score ≤3). Using logistic regression in which the dependent variable was an IQCODE score >3, the independent variables being behavioral change and bereavement, we found that behavioral changes worsened IQCODE performance. When there was a behavioral change, the probability of a cognitive decline, as measured by the IQCODE, was 48% in the absence of bereavement (odds ratio 16.00, 95% CI 1.13–12.93, P=0.030) compared with 87% in the presence of bereavement (odds ratio 3.82, 95% CI 1.31–194.62, P=0.031).
Additional variables
Age and the MMSE score showed no statistically significant correlation with the CAMCOG scores or with a worsening of the IQCODE score. Cognitive change, whether determined by IQCODE, CAMCOG, or MMSE, was not found to correlate significantly with the length of the follow-up period, literacy, sex, medication use, or comorbid hypothyroidism.
Discussion
The major finding of this study is that behavioral changes associated with death of the primary caregiver significantly increased the probability of cognitive decline in adult individuals with DS. Our results suggest that clinicians should take behavior and bereavement into consideration when dealing with aging individuals with DS. Because of the small size of our study sample, this finding should be interpreted with caution. Further studies are needed in order to corroborate our results, warranting replication and representing encouragement on future investigation of the intersection of DS with aging and thanatology, a small but growing field in terms of the interest shown by researchers.65 In addition, the investigation of bereavement in individuals with DS or other forms of ID could also aggregate knowledge to further the understanding of persistent complex bereavement disorder, as proposed in the DSM-V.28
Another important finding of the present study is that behavioral change was identified as a major variable in relation to occurrence of cognitive decline as measured by CAMCOG and IQCODE. On the basis of this finding and the observation that a lack of behavioral change appeared to correspond with a lack of cognitive decline, we believe that, in individuals with DS, behavioral changes precede or occur concomitantly with cognitive decline, in agreement with the results of other cross-sectional and longitudinal studies involving larger samples.13,35–39 Nevertheless, DM-ID30 calls attention to the fact that there is need for more research to better define which behaviors are related to cognitive decline and dementia. Cognitive change measured by IQCODE was significantly different between the bereaved and not bereaved groups, indicating a greater decline for those who were bereaved. Although the difference in CAMCOG was not significantly different between the groups, it is possible to observe that the range interval for those who were bereaved is always negative, while for the remaining subjects the interval is centered at zero, suggesting that results with larger samples could reach significance.
Due to their ID, our subjects performed poorly on some of the CAMCOG subscales in the initial and final evaluations, which confirms the appropriateness of adaptation of the instrument to the specifics of the population of individuals with ID.35 Similarly, we observed that there was a high rate of “does not apply” responses to the IQCODE items related to handling money and dealing with finances (items 23 and 24), which had no impact on the total IQCODE score, but suggests that the instrument should be modified for use in this population. Although longitudinal analyses using tools adapted to this population might be more sensitive to detailed analysis of cognition of adults with DS, we can conclude that the use of the CAMCOG and the IQCODE would be useful to complement assessment of cognitive decline and assist in the diagnosis of dementia.
The fact that none of our subjects were diagnosed with depression (as defined in the ICD-10 and DSM-IV), together with the evidence that cognitive decline is associated with bereavement and behavioral changes, raises the question of whether the diagnostic criteria for depression are appropriate and sufficient for use in this population, since assessment of mood is considered a challenge when dealing with patients with ID.30,33
The main limitations of our study were its small sample size and failure to assess the degree of ID prior to inclusion of the subjects. In addition, the lack of instruments adapted for use in the target population can be considered a limitation, as can the lack of validated quantitative instruments to examine in detail the experience of bereavement in the subjects themselves, rather than solely on the basis of information obtained from the primary caregiver. It is also important to consider that although we were careful about length of time between bereavement and assessment according to ICD-10 and DSM-IV criteria, there is no consensus about the length of time needed to capture changes after bereavement in people with ID. Some authors point to the possibility that the normal bereavement period could be extended22 and its consequences can often appear after years of loss through other triggers.33 Because of this, future research with constant follow-up could allow a better understanding of the duration of grief and its expression in cognition.
Considering the complexity of the theme investigated, we can state that our study raised many questions that merit further investigation. Should individuals with ID be considered at risk for developing persistent complex bereavement disorder? Can the cognitive decline associated with bereavement be considered a reversible feature caused by reactive depression in individuals with DS? Does the use of the current diagnostic criteria result in depression being underdiagnosed in individuals with DS? Is it possible to distinguish the effects of grief from those of dealing with structural changes following the death of a primary caregiver? Is bereavement truly a risk factor for dementia in aging individuals with DS?
Future longitudinal cognitive studies in larger samples could be useful in estimating the average expected cognitive decline in individuals with DS at various ages, in comparison with the general population, establishing criteria for differentiating between normal and pathological processes, and broadening our understanding of the mild cognitive impairment concept for this population.
Acknowledgments
The authors thank the Association of Parents and Friends of Individuals with Intellectual Disability of São Paulo for their partnership and contribution to the study, as well as all subjects and their families. This study was supported by Fundacao de Amparo a Pesquisa do Estado de São Paulo (grant 2013/11571-9) and Conselho Nacional de Desenvolvimento Cientifico e Tecnologico (grant 2010/305512).
Footnotes
Disclosure
The authors report no conflicts of interest in this work.
References
- 1.Kimura R, Kamino K, Yamamoto M, et al. The DYRK1A gene, encoded in chromosome 21 Down syndrome critical region, bridges between beta-amyloid production and tau phosphorylation in Alzheimer disease. Hum Mol Genet. 2007;16:15–23. doi: 10.1093/hmg/ddl437. [DOI] [PubMed] [Google Scholar]
- 2.Stanton LR, Coetzee RH. Down syndrome and dementia. Adv Psychiatr Treat. 2004;10:50–57. [Google Scholar]
- 3.Zigman WB. Atypical aging in Down syndrome. Dev Disabil Res Rev. 2013;18:51–67. doi: 10.1002/ddrr.1128. [DOI] [PubMed] [Google Scholar]
- 4.Wisniewski KE, Wisniewski HM, Wen GY. Occurrence of neuropathological changes and dementia of Alzheimer disease in Down’s syndrome. Ann Neurol. 1985;17:278–282. doi: 10.1002/ana.410170310. [DOI] [PubMed] [Google Scholar]
- 5.Coppus A, Evenhuis H, Verberne GJ, et al. Dementia and mortality in persons with Down syndrome. J Intellect Disabil Res. 2006;50:768–777. doi: 10.1111/j.1365-2788.2006.00842.x. [DOI] [PubMed] [Google Scholar]
- 6.Krinsky-McHale SJ, Silverman W. Dementia and mild cognitive impairment in adults with intellectual disability: issues of diagnosis. Dev Disabil Res Rev. 2013;18:31–42. doi: 10.1002/ddrr.1126. [DOI] [PubMed] [Google Scholar]
- 7.Silverman WP, Zigman WB, Krinsky-McHale SJ, Ryan R, Schupf N. Intellectual disability, mild cognitive impairment, and risk for dementia. J Policy Pract Intellect Disabil. 2013;10:245–251. doi: 10.1111/jppi.12042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Clute MA, Kobayashi R. Looking within and reaching out: bereavement counselor perceptions of grieving adults with ID. Am J Hosp Palliat Care. 2012;29:583–590. doi: 10.1177/1049909112439617. [DOI] [PubMed] [Google Scholar]
- 9.Dowling S, Hubert J, White S, Hollins S. Bereaved adults with intellectual disabilities: a combined randomized controlled trial and quantitative study of two community-based interventions. J Intellect Disabil Res. 2006;50:277–287. doi: 10.1111/j.1365-2788.2005.00759.x. [DOI] [PubMed] [Google Scholar]
- 10.McRitchie R, McKenzie K, Quayle E, Harlin M, Neumann K. How adults with an intellectual disability experience bereavement and grief: a qualitative exploration. Death Stud. 2014;38:179–185. doi: 10.1080/07481187.2012.738772. [DOI] [PubMed] [Google Scholar]
- 11.Chao LL, Yaffe K, Samuelson K, Neylan TC. Hippocampal volume is inversely related to PTSD duration. Psychiatry Res. 2014;222:119–123. doi: 10.1016/j.pscychresns.2014.03.005. [DOI] [PubMed] [Google Scholar]
- 12.Shear MK. Getting straight about grief. Depress Anxiety. 2012;29:461–464. doi: 10.1002/da.21963. [DOI] [PubMed] [Google Scholar]
- 13.Holland JM, Neimeyer RA, Boelen PA, Prigerson HG. The underlying structure of grief: a taxometric investigation of prolonged and normal reactions to loss. J Psychopathol Behav Assess. 2009;31:190–201. [Google Scholar]
- 14.Magari F, Sicolo M, Spinelli L, et al. Aggressive behavior, cognitive impairment, and depressive symptoms in elderly subjects. Neuropsychiatr Dis Treat. 2012;8:347–353. doi: 10.2147/NDT.S33745. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Carey IM, Shah SM, Dewilde S, Harris T, Victor CR, Cook DG. Increased risk of acute cardiovascular events after partner bereavement: a matched cohort study. JAMA Intern Med. 2014;174:598–605. doi: 10.1001/jamainternmed.2013.14558. [DOI] [PubMed] [Google Scholar]
- 16.Grimby A. Bereavement among elderly individuals: grief reactions, post-bereavement hallucinations and quality of life. Acta Psychiatr Scand. 1993;87:72–80. doi: 10.1111/j.1600-0447.1993.tb03332.x. [DOI] [PubMed] [Google Scholar]
- 17.Xavier FM, Ferraz MP, Trentini CM, Freitas NK, Moriguchi EH. Bereavement-related cognitive impairment in an oldest-old community-dwelling Brazilian sample. J Clin Exp Neuropsychol. 2002;24:294–301. doi: 10.1076/jcen.24.3.294.983. [DOI] [PubMed] [Google Scholar]
- 18.Brickell C, Munir K. Grief and its complications in individuals with intellectual disability. Harv Rev Psychiatry. 2008;16:1–12. doi: 10.1080/10673220801929786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Dodd P, Dowling S, Hollins S. A review of the emotional, psychiatric and behavioural responses to bereavement in individuals with intellectual disabilities. J Intellect Disabil Res. 2005;49:537–543. doi: 10.1111/j.1365-2788.2005.00702.x. [DOI] [PubMed] [Google Scholar]
- 20.Dodd PC, Guerin S. Grief and bereavement in individuals with intellectual disabilities. Curr Opin Psychiatry. 2009;22:442–446. doi: 10.1097/YCO.0b013e32832e2a08. [DOI] [PubMed] [Google Scholar]
- 21.Hulbert-Williams L, Hastings RP. Life events as a risk factor for psychological problems in individuals with intellectual disabilities: a critical review. J Intellect Disabil Res. 2008;5:883–895. doi: 10.1111/j.1365-2788.2008.01110.x. [DOI] [PubMed] [Google Scholar]
- 22.Bonell-Pascual E, Huline-Dickens S, Hollins S, et al. Bereavement and grief in adults with learning disabilities. A follow up study. Br J Psychiatry. 1999;175:348–350. doi: 10.1192/bjp.175.4.348. [DOI] [PubMed] [Google Scholar]
- 23.Esbensen AJ, Seltzer MM, Krauss MW. Stability and change in health, functional abilities, and behavior problems among adults with and without Down syndrome. Am J Ment Retard. 2008;113:263–277. doi: 10.1352/0895-8017(2008)113[263:SACIHF]2.0.CO;2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hulbert-Williams L, Hastings R, Owen DM, et al. Exposure to life events as a risk factor for psychological problems in adults with intellectual disabilities: a longitudinal design. J Intellect Disabil Res. 2014;58:48–60. doi: 10.1111/jir.12050. [DOI] [PubMed] [Google Scholar]
- 25.Maercker A, Brewin CR, Bryant RA, et al. Diagnosis and classification of disorders specifically associated with stress: proposals for ICD-11. World Psychiatry. 2013;12:198–206. doi: 10.1002/wps.20057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Prigerson HG, Horowitz MJ, Jacobs SC, et al. Prolonged grief disorder: psychometric validation of criteria proposed for DSM-V and ICD-11. PLoS Med. 2009;6:8. doi: 10.1371/journal.pmed.1000121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Simon NM. Treating complicating grief. JAMA. 2013;310:416–423. doi: 10.1001/jama.2013.8614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Washington, DC, USA: American Psychiatric Association; 2013. [Google Scholar]
- 29.World Health Organization . ICD-10 International Statistical Classification of Diseases and Related Health Problems. Geneva, Switzerland: World Health Organization; 1992. [Google Scholar]
- 30.Fletcher R, Loschen E, Stavrakaki C, First M. Diagnostic Manual-Intellectual Disability: A Text Book of Diagnosis of Mental Disorders in Persons with Intellectual Disability. New York, NY, USA: NAAD Press/National Association for the Dually Diagnosed NADD; 2007. [Google Scholar]
- 31.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. Fourth Edition. Washington, DC, USA: American Psychiatric Association; 2000. Text Revision. [Google Scholar]
- 32.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington, DC, USA: American Psychiatric Association; 1994. [Google Scholar]
- 33.McGuire D, Chicoine B. Mental Wellness in Adults with Down Syndrome: A Guide to Emotional and Behavioral Strengths and Challenges. Bethesda, MD, USA: Woodbine House; 2006. [Google Scholar]
- 34.Akahoshi K, Matsuda H, Funahashi M, Hanaoka T, Suzuki Y. Acute neuropsychiatric disorders in adolescents and young adults with Down syndrome: Japanese case reports. Neuropsychiatr Dis Treat. 2012;8:339–345. doi: 10.2147/NDT.S32767. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Ball SL, Holland AJ, Huppert FA, Treppner P, Watson P, Hon J. The modified CAMDEX informant interview is a valid and reliable tool for use in the diagnosis of dementia in adults with Down’s syndrome. J Intellect Disabil Res. 2004;48:611–620. doi: 10.1111/j.1365-2788.2004.00630.x. [DOI] [PubMed] [Google Scholar]
- 36.Ball SL, Holland AJ, Hon J, Huppert FA, Treppner P, Watson PC. Personality and behaviour changes mark the early stages of Alzheimer’s disease in adults with Down’s syndrome: findings from a prospective population-based study. Int J Geriatr Psychiatry. 2006;21:661–673. doi: 10.1002/gps.1545. [DOI] [PubMed] [Google Scholar]
- 37.Ball SL, Holland AJ, Watson PC, Huppert FA. Theoretical exploration of the neural bases of behavioural disinhibition, apathy and executive dysfunction in preclinical Alzheimer’s disease in individuals with Down’s syndrome: potential involvement of multiple frontal-subcortical neuronal circuits. J Intellect Disabil Res. 2010;54:320–336. doi: 10.1111/j.1365-2788.2010.01261.x. [DOI] [PubMed] [Google Scholar]
- 38.Deb S, Hare M, Prior L. Symptoms of dementia among adults with Down’s syndrome: a qualitative study. J Intellect Disabil Res. 2007;51:726–739. doi: 10.1111/j.1365-2788.2007.00956.x. [DOI] [PubMed] [Google Scholar]
- 39.Holland AJ, Hon J, Huppert FA, Stevens F. Incidence and course of dementia in individuals with Down’s syndrome: findings from population-based study. J Intellect Disabil Res. 2000;44:138–146. doi: 10.1046/j.1365-2788.2000.00263.x. [DOI] [PubMed] [Google Scholar]
- 40.Deb S, Hare M, Prior L, Bhaumik S. Dementia screening questionnaire for individuals with intellectual disabilities. Br J Psychiatry. 2007;190:440–444. doi: 10.1192/bjp.bp.106.024984. [DOI] [PubMed] [Google Scholar]
- 41.Prasher V, Farooq A, Holder R. The Adaptive Behaviour Dementia Questionnaire (ABDQ): screening questionnaire for dementia in Alzheimer’s disease in adults with Down syndrome. Res Dev Disabil. 2004;25:385–397. doi: 10.1016/j.ridd.2003.12.002. [DOI] [PubMed] [Google Scholar]
- 42.Folstein MF, Folstein SE, McHugh PR. Mini-mental state. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–198. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
- 43.Zeilinger EL, Stiehl KA, Weber G. A systematic review on assessment instruments for dementia in person with intellectual disabilities. Res Dev Disabil. 2013;34:3962–3977. doi: 10.1016/j.ridd.2013.08.013. [DOI] [PubMed] [Google Scholar]
- 44.Esteba-Castillo S, Dalmau-Bueno A, Ribas-Vidal N, Vila-Alsina M, Novell-Alsina R, Garcia-Alba J. Adaptation and validation of CAMDEX-DS (Cambridge Examination for Mental Disorders of Older Individuals with Down’s Syndrome and Others with Intellectual Disabilities) in Spanish population with intellectual disabilities. Rev Neurol. 2013;57:337–346. Spanish. [PubMed] [Google Scholar]
- 45.Evenhuis HM. Evaluation of a screening instrument for dementia in ageing mentally retarded persons. J Intellect Disabil Res. 1992;36:337–347. doi: 10.1111/j.1365-2788.1992.tb00532.x. [DOI] [PubMed] [Google Scholar]
- 46.Das JP, Mishra RK. Assessment of cognitive decline associated with aging: a comparison of individuals with Down syndrome and other etiologies. Res Dev Disabil. 1995;16:11–25. doi: 10.1016/0891-4222(94)00032-5. [DOI] [PubMed] [Google Scholar]
- 47.Margallo-Lana ML, Moore PB, Kay DW, et al. Fifteen-year follow up of 92 hospitalized adults with Down’s syndrome: incidence of cognitive decline, its relationship to age and neuropathology. J Intellect Disabil Res. 2007;51:463–477. doi: 10.1111/j.1365-2788.2006.00902.x. [DOI] [PubMed] [Google Scholar]
- 48.McKensie K, Muray G, McKensie S, Munir J. A prospective, longitudinal study of functional decline in individuals with Down’s syndrome. J Intellect Disabil. 1998;2:98–104. [Google Scholar]
- 49.McCarron M, McCallion P, Reilly E, Mulryan N. A prospective 14-year longitudinal follow up of dementia in persons with Down syndrome. J Intellect Disabil Res. 2014;58:61–70. doi: 10.1111/jir.12074. [DOI] [PubMed] [Google Scholar]
- 50.Bottino CM, Zevallos-Bustamante SE, Lopes MA, et al. Combined instruments for the screening of dementia in older individuals with low education. Arq Neuropsiquiatr. 2009;67:185–190. doi: 10.1590/s0004-282x2009000200003. [DOI] [PubMed] [Google Scholar]
- 51.Jorm AF, Jacomb PA. The Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms. Psychol Med. 1989;19:1015–1022. doi: 10.1017/s0033291700005742. [DOI] [PubMed] [Google Scholar]
- 52.Roth M, Tym E, Mountjoy CO, Huppert H, Verma S, Goddard R. CAMDEX: a standardized instrument for the diagnosis of mental disorders in the elderly with special reference to the early detection of dementia. Br J Psychiatry. 1986;149:698–709. doi: 10.1192/bjp.149.6.698. [DOI] [PubMed] [Google Scholar]
- 53.Huppert FA, Jorm AF, Brayne C, et al. Psychometric properties of the CAMCOG and its efficacy in the diagnosis of dementia. Neuropsychol Dev Cogn B Aging Neuropsychol Cogn. 1996;3:201–214. [Google Scholar]
- 54.Bottino CM, Almeida OP, Tamai S, Forlenza OV, Scalco MZ, Carvalho IA. CAMDEX: The Cambridge Examination for Mental Disorders of the Elderly. São Paulo, Brazil: Instituto de Psiquiatria; 1999. Portuguese. [Google Scholar]
- 55.Bottino CM, Stoppe A, Jr, Scalco AZ, Ferreira RC, Hototian SR, Scalco MZ. Validade e confiabilidade da versão brasileira do CAMDEX [Validity and Reliability of the Brazilian version of CAMDEX] Arq Neuropsiquiatr. 2001;59:20. Portuguese. [Google Scholar]
- 56.Brayne C, Best N, Muir M, Richards SJ, Gill C. Five-year incidence and prediction of dementia and cognitive decline in a population sample of women aged 70–79 at baseline. Int J Geriatr Psychiatry. 1997;12:1107–1118. doi: 10.1002/(sici)1099-1166(199711)12:11<1107::aid-gps695>3.0.co;2-9. [DOI] [PubMed] [Google Scholar]
- 57.Cullum S, Huppert F, McGee M, et al. Decline across different domains of cognitive function in normal ageing: results of a longitudinal population-based study using CAMCOG. Int J Geriatr Psychiatry. 2000;15:853–862. doi: 10.1002/1099-1166(200009)15:9<853::aid-gps211>3.0.co;2-t. [DOI] [PubMed] [Google Scholar]
- 58.Jonker C, Schmand B, Lindeboom J, Haveskes LM, Launer LJ. Association between apolipoprotein e4 and the rate of cognitive decline in community-dwelling elderly individuals with and without dementia. Arch Neurol. 1998;55:1065–1069. doi: 10.1001/archneur.55.8.1065. [DOI] [PubMed] [Google Scholar]
- 59.Jorm AF. A short form of the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): socio-demographic and cross-validation. Psychol Med. 1994;24:145–153. doi: 10.1017/s003329170002691x. [DOI] [PubMed] [Google Scholar]
- 60.Perroco TR, Bustamante SE, Moreno MP, et al. Performance of Brazilian long and short IQCODE on the screening of dementia in elderly people with low education. Int Psychogeriatr. 2009;21:531–538. doi: 10.1017/S1041610209008849. [DOI] [PubMed] [Google Scholar]
- 61.Sanchez MA, Lourenço RA. Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE): adaptação transcultural para uso no Brasil [Transcultural Adaptation for the Brazilian Population] Cad Saude Publica. 2009;25(7):1455–1465. doi: 10.1590/s0102-311x2009000700003. Portuguese. [DOI] [PubMed] [Google Scholar]
- 62.Shults JM, Aman MG, Rojahn J. Psychometric evaluation of a measure of cognitive decline in elderly individuals with mental retardation. Res Dev Disabil. 1998;19:63–71. doi: 10.1016/s0891-4222(97)00029-2. [DOI] [PubMed] [Google Scholar]
- 63.Cummings JL, Mega M, Gray K, Rosenberg-Thompson S, Carusi BS, Gornbein J. The Neuropsychiatric Inventory: comprehensive assessment of psychopathology in dementia. Neurology. 1994;44:2308–2314. doi: 10.1212/wnl.44.12.2308. [DOI] [PubMed] [Google Scholar]
- 64.Camozzato AL, Kochhann R, Simeoni C, Konrath CA, Carvalho A, Chaves ML. Reliability of the Brazilian Portuguese version of the Neuropsychiatric Inventory (NPI) for patients with Alzheimer’s disease and their caregivers. Int Psychogeriatr. 2008;20:383–393. doi: 10.1017/S1041610207006254. [DOI] [PubMed] [Google Scholar]
- 65.Todd S, Bernak J, Forrester-Jones R. Death, dying and intellectual disability research. J Appl Res Intellect Disabil. 2013;26:183–185. doi: 10.1111/jar.12027. [DOI] [PubMed] [Google Scholar]