Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 Jan 27.
Published in final edited form as: J Psychosom Res. 2010 Mar 31;70(1):73–97. doi: 10.1016/j.jpsychores.2010.01.012

Are the available apathy measures reliable and valid? A review of the psychometric evidence

Diana E Clarke 1, Jean Y Ko 2, Emily A Kuhl 3, Robert van Reekum 4, Rocio Salvador 5, Robert S Marin 6
PMCID: PMC3902773  NIHMSID: NIHMS193892  PMID: 21193104

Abstract

Objective

Apathy is highly prevalent among neuropsychiatric populations and is associated with greater morbidity and worse functional outcomes. Despite this, it remains understudied and poorly understood, primarily due to lack of consensus definition and clear diagnostic criteria for apathy. Without a gold standard for defining and measuring apathy, the availability of empirically sound measures is imperative. This paper provides a psychometric review of the most commonly used apathy measures and provides recommendations for use and further research.

Methods

Pertinent literature databases were searched to identify all available assessment tools for apathy in adults aged 18 and older. Evidence of the reliability and validity of the scales were examined. Alternate variations of scales (e.g., non-English versions) were also evaluated if the validating articles were written in English.

Results

Fifteen apathy scales or subscales were examined. The most psychometrically robust measures for assessing apathy across any disease population appear to be the Apathy Evaluation Scale and the apathy subscale of the Neuropsychiatric Inventory based on the criteria set in this review. For assessment in specific populations, the Dementia Apathy Interview and Rating for patients with Alzheimer’s dementia, the Positive and Negative Symptom Scale for schizophrenia populations, and the Frontal System Behavior Scale for patients with fronto-temporal deficits are reliable and valid measures.

Conclusion

Clinicians and researchers have numerous apathy scales for use in broad and disease-specific neuropsychiatric populations. Our understanding of apathy would be advanced by research that helps build a consensus as to the definition and diagnosis of apathy, and further refine the psychometric properties of all apathy assessment tools.

Keywords: Apathy, amotivational, assessment, psychometric properties, reliability, validity

Introduction

A comprehensive review of the literature on apathy found that this neurobehavioral syndrome is common across a large variety of neurological, psychiatric, and medical conditions (1). For example, the average point prevalence of apathy in outpatients with Alzheimer’s disease (AD) was roughly 60%, which was similar for adults who had suffered a traumatic brain injury (TBI; 61%) or a focal frontal lesion (60%). Patients with dementia with Lewy bodies (LBD), fronto-temporal dementia (FTD), basal ganglia lesions (e.g. Parkinson’s disease [PD]), and supranuclear palsy (PSP) also develop apathy at high rates but lower than those seen in disorders involving cortical dysfunction, such as AD and TBI (28). Apathy is also common in patients with thalamic lesions (9), vascular dementia (1012), cerebrovascular accidents (CVA) (13;14), anoxic brain injury (13;14), multiple sclerosis (MS) (15;16), myotonic dystrophy (17;18), human immunodeficiency virus (19), major depressive disorder (18;20), and mild cognitive impairment (MCI) (21;22), especially when accompanied by extrapyramidal signs (1;8;16;23;24). The highest point prevalence rate found (84.1%) relate to nursing home residence (1;23).

Apathy is associated with decreased functioning (10;18;25;2530), caregiver distress (31), cognitive decline (5;27;32;33), poor illness outcomes and response to treatments (18;25;26), and chronic apathy (10;18;21;25;26;31;34;35). There is limited data on the effectiveness of treatment for apathy. However, preliminary evidence showed partial benefits with amphetamines (36;37), dopaminergic agents (38), cholinesterase inhibitors (39;40), atypical antipsychotic medications, particularly in patients with schizophrenia, whose negative symptoms strongly resemble apathy (41;42), and recreation (43) and music therapies (44). Hence, apathy is clinically relevant and potentially amenable to treatment. Accurate assessment is important to improve our understanding and management of apathy and associated conditions. To accomplish this, clear definition and consensus diagnostic criteria for apathy are needed.

Definition and Diagnosis of apathy

The concept of apathy is found in various sections of the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) and in disorders of many types, as shown in Table 1, albeit the use of various terms such as “lack or loss of interest”, “avolition”, “affective flattening”, “social withdrawal”, and “indifference”. This is likely due to the lack of definition of apathy in the DSM. In fact, apathy appears as a symptom rather than a separate diagnostic entity in the DSM. Clinicians and researchers have indicated that although apathy can be experienced as a symptom secondary to mood disorder, altered level of consciousness or cognitive impairment, it is also a distinguishable syndrome (4548), as it is common, not always present with other neurological/psychiatric or medical conditions, and also associated with a number of adverse outcomes which require separate treatment consideration. Apathy has also been found in some elderly and adolescent persons who are otherwise normal individuals (45;47;49;50.) For example, apathy has been reported in institutionalized elderly persons, prisoners, and immigrants who are prone to adapt a ‘why try’ response to environments that are lacking in reward/opportunities for control (45.) In some cases, such individuals do not become depressed but simply inactive (i.e. absence of goal-directedness/interest, etc.) because their attributions are global ('nothing I do is going to make a difference) and also external ('it's not because of me, it's because of this place/them'). Furthermore, recognition of apathy as a maladaptive consequence of psychiatric, medical, and neurological disorders lowers the risk of failing to recognize the disorders, failing to treat the disorders, or losing an opportunity to understand the psychological and neurological mechanisms that mediate this loss of goal-directedness/interest or motivation. However, consensus on its definition in the field is still lacking. Marin conceptualized apathy as a loss of motivation not attributable to emotional distress, cognitive impairment, or diminished level of consciousness(4547;51), while Stuss and colleagues (48) conceptualized apathy as an absence of responsiveness to stimuli (external or internal) as characterized by a lack of self-initiated action. Although consensus on the definition of apathy is still lacking, there is some agreement that loss of motivation and lack of initiative and self-generated actions are important features of the neurobehavioral syndrome (52). There is also agreement that the syndrome of apathy is reflected by acquired changes in affect (mood), behavior, and cognition and requires its own diagnosis and treatment (45;48). Stuss et al (48) also proposed that apathy may not be a single syndrome, but rather may be separable states depending on which neural system is involved and which affective, behavioral, or cognitive response is affected. However, this hypothesis requires further work.

Table 1.

Reference to apathy across disorders in the DSM-IV-TR.

Dx Criterion Context Page
Schizophrenia:
  295.30-Paranoid Type;
  295.10-Disorganized Type;
  295.20-Catatonic Type;
  295.90-Undifferentiated Type;
  295.60-Residual Type
Criterion A Affective flattening, alogia, avolition, apathy, apathetic immobility, and social withdrawal. p. 301, 304, 308, 312
Schizophreniform Disorder (295.40) Criterion A Affective flattening, alogia, avolition, apathy, apathetic immobility, and social withdrawal p. 319
Major Depressive Episode, Major Depressive Disorder (single episode or recurrent) Criterion A Loss of interest or pleasure; markedly diminished interest or pleasure in all, or almost all, activities; apathy; less interest in hobbies; “not caring anymore”; social withdrawal; neglect of pleasurable avocations; reduction from previous levels of sexual interest or desire p. 349, 356, 375-6
Dysthymic Disorder (300.4) Criterion A & H Generalized loss of interest or pleasure; social withdrawal; decreased activity, effectiveness or productivity p. 378, 380-1
Mood Disorder due to General Medical Condition (293.83) Criterion A Diminished interest or pleasure in all, or almost all, activities p. 404
Mental Disorders due to General Medical Conditions: Personality Changes due to General Medical Condition (310.1) Criterion A&E Apathy and indifference; Affective instability p. 187–188
Schizoid Personality disorder (301.20) Criterion A Detachment from social relationships; neither desires or enjoys close relationships; almost always chooses solitary activities; little, if any, desire in having sexual experience with another person; pleasure in few, if any activities; lacks close friends or confidants other than first-degree relatives; indifference to praise or criticism of others; emotional coldness, detachment, or flattened affectivity p. 697
Schizotypal Personality disorder (301.22) Criterion A Lacks close friends or confidants other than first-degree relatives; inappropriate or constricted affect p. 701
Autistic Disorder (299.00) Criterion A Lack of spontaneous seeking to share enjoyment, interests, or achievements with other people p. 75
Rett’s Disorder (299.80) Criterion B Loss of social engagement; Interest in social environment diminishes p. 76, 77
Childhood Disintegrative Disorder (299.10) Criterion C Inability to initiate of sustain a conversation p. 79
Asperger’s Disorder (299.80) Criterion A Lack of spontaneous seeking to share enjoyment, interests, or achievements with other people p. 84
Post Traumatic Stress Disorder (309.81) Criterion C Diminished interest or participation in significant activities; social withdrawal; impaired relationships with others; constriction of affect p. 465-6, 468

Arriving at diagnostic criteria for apathy has been the goal of a number of research groups (10;47;52). These efforts stem from the seminal paper, “Differential diagnosis and classification of apathy”, in which Marin (47) proposed that the diagnosis of apathy be based on its distinction from “the overt behavioral, cognitive, and emotional concomitants of goal-directed behavior”. Marin’s (47) criteria for apathy were later operationalized by Starkstein and colleagues (10) in which an individual was considered to have apathy if he/she experienced (self-report or observation by others) a) a lack of motivation relative to his/her previous level of functioning or the standards for his/her age and culture, b) accompanied by at least one symptom in each of three domains described as i) diminished goal-directed behaviour, ii) diminished goal-directed cognition and iii) diminished concomitants of goal-directed behaviours with resulting c) clinically significant distress and/or impairment in social, occupational, or other important areas of functioning. Importantly, the symptoms should not be a result of d) diminished level of consciousness or the direct physiological effects of a substance. These diagnostic criteria for apathy have been further revised by Robert and colleagues (52) with changes specifically to the B criterion. The revised criteria specified that along with the lack or loss of motivation from previous level of functioning or what is expected given the individual’s age and culture, only changes in two of the three domains are required but that these changes should be present for a period of at least four weeks and must be present most of the time with resulting c) clinically significant distress and/or impairment in social, occupational, or other important areas of functioning and the symptoms should not be a result of d) diminished level of consciousness or the direct physiological effects of a substance (52). However, given the clinical significance of apathy induced by illicit drug abuse and commonly used medications, this criterion may deserve reconsideration. Robert and colleagues (52) stated that “confusion remains regarding the essential features of apathy,” and that, inarguably, the need for consistent definitions is high. Nonetheless, their derived criteria specify as core features lack of motivation, reduced self-initiation, and emotional blunting – all of which are consistent with Marin (47) and Starkstein and colleagues (10) approaches. Consensus on these revised diagnostic criteria has still not been reached (personal communication with Marin and van Reekum who are part of a working group of apathy researchers currently putting together diagnostic criteria for submission to the DSM-V Taskforce for consideration in DSM-V).

Most of the clinical research to date has classified apathy on the basis of scores on various assessment tools. The development of these measures has been greatly facilitated and promoted by the existing conceptualization of apathy as a syndrome with loss or lack of motivation and self-initiated action as its prominent features and the diagnostic criteria proposed by Marin (46;47) with further modifications or refinement by other research groups (10;18;48;53) (52). With this in mind, the current paper reviews the reliability and validity of the available apathy measures, identifies measures that show good reliability and validity, and discusses future research needs in this field.

Methods

Pubmed, PsycInfo, Medline and Embase, and Cinahl literature databases were searched to identify all available assessment tools for apathy in adults aged 18 and older. Reviewed measures were limited to full apathy scales or scales in which an apathy subscale was available. The search terms apathy, lack of interest, amotivational, emotional indifference, lack of motivation, lack of initiative, negative symptoms, asociality, anhedonia, measures, assessment tools, validity, reliability, psychometrics, and measurement properties were used in various combinations to identify relevant articles. Articles were limited to those published in English from 1980–2008. The criteria for good reliability and validity were based on those used by Lloyd and colleagues (54). More specifically, the reliability of the instruments was assessed by means of their internal consistency, test-retest reliability and inter-rater reliability and validity was assessed by means of the scales’ convergent, divergent and predictive validities. Given the lack of consensus definition and diagnostic criteria for apathy, criterion validity was not set as a main criterion for good validity. However, if information was available on the criterion validity of the scales this would add to the determination of its psychometric robustness if sensitivity and specificity were greater than or equal to 80%. Per Lloyd and colleagues (54), adequate internal consistency was set at Cronbach’s alpha of greater than or equal to 0.80 for the scale total or if the apathy measure was a single item or the subscale of a larger scale the Cronbach’s alpha coefficient for the item, range of items or subscale had to at least 0.80. The test-retest and inter-rater reliabilities of the scales had to be greater than or equal to 0.70, which demonstrates moderate reliability (55). The criterion for convergent reliability was set at 0.50 or higher(54) but the criterion for divergent validity was set at less than 0.50, which was slightly different from Lloyd and colleagues (54).

Results

The number of unique articles retrieved from the search terms and their respective literature database were: Pubmed (212 articles), Psychinfo (3 articles), Embase and Medline (29 articles), and Cinahl (0 articles). From these unique articles, 15 scales that were developed to ascertain and quantify apathy were identified (see Table 2). Of these, seven were full apathy scales and eight were apathy subscales embedded in larger scales. The Apathy Evaluation Scale (AES) and the Neuropsychiatric Inventory (NPI) are the most widely used scales to assess apathy. Frontal Lobe Personality Scale (FLOPS), now known as the Frontal Systems Behavior Scale (FrSBe), has been moderately cited in the literature since its development. A number of scales had high-to-moderate use within specific populations for which they were validated, i.e., Scale for the Assessment of Negative Symptoms (SANS), Brief Psychiatric Rating Scale (BPRS), Positive and Negative Symptom Scale (PANSS), Unified Parkinson’s Disease Rating Scale (UPDRS), Lille Apathy Rating Scale (LARS), and the Dementia Apathy Interview and Rating (DAIR). Fewer studies incorporated the use of the Irritability-Apathy Scale (IAS), Key Behavior Change Inventory (KBCI), and the Apathy Inventory (AI) beyond the scales’ original developers. The above-mentioned scales are available in English, per the “English only” inclusion criteria for this review. Where the scales are available in other languages these are indicated in Table 2, however, citations are not provided for these translated articles as they did not meet the current study’s inclusion criteria (i.e., written in English). The scales are copyrighted and most are available from their developers (see footnotes in Table 2).

Table 2.

Final summary of the psychometric properties of the reviewed apathy scales.

Reference
(#)
Name of
Scale
Number of items
& Time frame
Self or Rater
Administered
Time to
complete
Reliability Psychometric Properties

Validity
Apathy Evaluation Scale – Subject, Informant and Clinician Versions (AES-S/I/C)
46 Apathy Evaluation Scale - Self (AES-S); Informant (AES-I); & Clinician (AES-C) versions; Available in German Arabic Chinese Russian translations 18-item scale capturing symptomatology over last 4 weeks Same 18 core items.
AES-S = self- report
AES-I = informant-based AES-C = semi-structured clinician administered
10–20 minutes for a trained interviewer Internal consistency:
Cronbach’s α = 0.86 to 0.94 for the three versions of the AES.
Test-retest reliability:
25.4 days apart: α = 0.76 to 0.94
Inter-rater reliability:
High inter-rater reliability: ICC = 0.94
Convergent validity:
Assessed by examining the correlation between the three versions of the AES (i.e., self, clinician, and informant): r = 0.43** to 0.72**
Discriminant validity:
Assessed by examining the correlation between apathy and depression (for self-rated (r = 0.43) and informant-rated (r=0.27**)) and anxiety (for the clinician (r = 0.35**) and self-ratings (r = 0.42)).
49 Apathy Evaluation Scale - Self (AES-S); Informant (AES-I); & Clinician (AES-C) versions As indicated above As indicated above As indicated above Internal consistency:
Cronbach’s α = 0.76 to 0.94 for the three versions of the AES.
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
54 Apathy Evaluation Scale - Self (AES-S); Informant (AES-I); & Clinician (AES-C) versions As indicated above As indicated above 10–20 minutes for greater than Bachelor-level trained interviewer but up to 30 minutes if only Bachelor-level trained. Internal consistency:
Cronbach’s α = 0.86 to 0.94 for the three versions of the AES.
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Assessed by examining the correlation between the three versions of the AES (i.e., self, clinician, and informant) and apathy as measured by the apathy subscale of the NPI:
Self-rated: r = 0.22*
Clinician-rated: r = 0.27**
Informant-rated: r = 0.49**
AES-C-apathy factor: r =0.27**
AES-I-apathy factor : r = 0.48**
Discriminant validity:
Assessed by examining the correlation between apathy and depression (for self-rated (r = 0.23*) and informant-rated (r=0.20)) and anxiety (for the clinician (r = 0.12) and self-ratings (r = 0.12)).
56 Apathy Evaluation Scale (AES) and the Positive and Negative Syndrome Scale (PANSS) As indicated above As indicated above Internal consistency:
Total score on the AES-C as well as the Apathy factor of the AES-C (i.e., 12 of the 18 items) found to have high Cronbach alphas (i.e., α = 0.87 and α = 0.90 respectively)
Corrected mean item-total correlation = 0.49 for the AES-C total score and 0.62 for the total score on the Apathy Factor indicating that the apathy factor could be a stand alone scale.
Test-retest reliability:
Not assessed.
Inter-rater reliability:
AES-C: ICC = 0.98*
Convergent validity:
Statistically significant and moderate to strong correlations between the AES-C total score and with the PANSS negative factor → r = 0.59*** specifically:
Emotional withdrawal: r=0.61***
Apathetic social withdrawal: r=0.54***
Lack of flow: r=0.45***
Similarly, statistically significant and moderate to strong correlations were found between the Apathy factor of the AES-C and the PANSS negative factor → r = 0.58*** specifically:
Emotional withdrawal: r=0.62***
Apathetic social withdrawal: r=0.52***
Lack of flow: r=0.45***
Discriminant validity:
The AES-C total score had a statistically significant but weak correlation with the PANSS positive factor → r = 0.28** and poorly with most of the items the make up the positive factor (i.e., r = −0.04 for excitement to r = 0.28** for hallucinations).
Similar correlations were found between the AES-C Apathy factor and the PANSS positive factor (r = 0.21) and its respective items (r = −0.01 for grandiosity and r = 0.29** for hallucinations).
Variations of Marin’s Apathy Evaluation Scale
51 Apathy Scale (AS) 14-items: 8 positively and 6 negatively worded items capturing symptomatology over past 4 weeks Interviewer-administered Not assessed Internal consistency:
Cronbach’s α = 0.76
Test-retest reliability:
Subset of 11 PD patients used to assess 1-week test-retest reliability: r = 0.81**
Inter-rater reliability:
A second subset of 11 PD patients used to assess inter-rater reliability (independent ratings on 2 different days): r = 0.90**
Convergent validity:
Not assessed.
Criterion validity:
Using an independent neurologists blind clinical assessment of apathy as the “gold” standard: sensitivity = 66% and specificity = 100% for a cut-point of 14 on the AS.
Discriminant validity:
Not assessed.
59 Abridged version of the AES 5 of the original items and 2 newly developed items plans/goals for the future 7-item scale Clinician administered to formal caregiver. Period prior to hospitalization <20 minutes Internal consistency:
á = 0.67 good for a measure with few items (Nunnally and Bernstein, 1994)
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
AES-18 and the 7-item AS highly correlated (r=0.87)
AS-7 significant, but low, correlation with PI as assessed by nurse (r=0.36)*, physical therapist (r=0.39), and the occupational therapist (r=0.42)* and depression (r=0.45**) GDS.
Predictive validity:
AS-7 predictive of functional performance at discharge (lower scores = greater functional performance (â =−0.22**)
Discriminant validity:
Not assessed
The Apathy Inventory (AI)
33 Apathy Inventory (AI)-Caregiver and patient-based versions 3-item scale (emotional blunting, lack of interest, & lack of initiative) Assess change in symptomatology since the onset of the illness but can also be used to assess changes in frequency and severity of symptoms over a specified time period Caregiver/informan t-rated Not assessed Internal consistency:
Cronbach’s α= 0.84
Test-retest reliability:
Test-retest reliability (kappa = 0.99, 0.97 and 0.99 for emotional blunting, lack of initiative and lack of interest respectively and 0.96 overall)
Inter-rater reliability:
Inter-rater reliability (kappa = 0.99)
Construct validity:
Correlation between the lack of initiative (r=0.23)** and lack of interest (r=0.63)*** items and the NPI apathy subscale score. Convergent validity: Not assessed
Discriminant validity:
AI caregiver distinguish AD patients and controls, with AD patients having significantly higher score on lack of initiative and global score than control
Dementia Apathy Interview and Rating (DAIR)
61 Dementia Apathy Interview and Rating (DAIR) 16 items capturing symptomatology over past month
Follow up question determines behavioral changes
Clinician administered structured interview to caregivers. Not assessed Internal consistency:
Overall: α = 0.89
In-person: α = 0.91
Telephone: α = 0.94
Test-retest reliability:
Assessed using 20 randomly selected caregivers with assessments on average 56 days apart: r = 0.85***
Inter-rater reliability:
Inter-rater reliability determined by a second rater’s rating of 10 audio-taped interviews: r = 1.00**
Convergent validity:
Correlation between apathy score and an independent clinician’s blind assessment of apathy on a 10-point Likert-like scale: 0=very uncharacteristic to 10=very characteristic: r = 0.31* to 0.46**
Criterion validity:
Optimal cut-points and associated sensitivity and specificity not determined.
Discriminant validity:
Very poor correlation between apathy score and depression: r=0.08.
Lille Apathy Rating Scale (LARS)
57 Lille Apathy Rating Scale (LARS) & Apathy Evaluation Scale (AES) 33 items representing 9 domains capturing symptomatology over past four weeks A structured clinician-administered scale based on patient’s self-report. Not assessed Internal consistency:
Cronbach’s á = 0.80 (items) & á = 0.74 (subscales)
Split half reliability: á = 0.73** & á = 0.84** (after Spearman Brown “Prophecy Formula”)
Test-retest reliability:
4-month test-retest assessed using a subset of 35 patients: r = 0.95***
Inter-rater reliability:
Inter-rater reliability between 2 clinicians assessed using a subset of 32 patient: intraclass correlation coefficient (ICC)= 0.98***
Convergent validity:
Strong correlation between AES & LARS total scores (r = 0.87**); AES & LARS Intellectual Curiosity subscale (r = 0.84**); AES & LARS Action Initiation subscale (r = 0.65**).
Criterion validity:
Expert blind classification of patients as severely apathetic vs. non- or mildly-apathetic as the “gold standard” provided good sensitivities (0.87 to 0.94 using cut-off scores of −15 to −17) & specificities (0.87 to 0.93 using on cut-off scores of −17 to −15).
Discriminant validity:
No interaction between apathy (LARS) & depression (MDARS) indicated good Discriminant validity.
58 Lille Apathy Rating Scale (LARS-I and C) & Apathy Evaluation Scale (AES-I and C) As indicated above Informant-completed Not assessed Internal consistency:
Cronbach’s á = 0.88 (items) & á = 0.83 (subscales)
Split half reliability: á = 0.90 & á = 0.79 (after Spearman Brown “Prophecy Formula”)
Test-retest reliability:
test-retest assessed a few days later using a subset of 29 patients: r = 0.96
Inter-rater reliability:
Inter-rater reliability between 2 clinicians assessed using a subset of 34 patient: intraclass correlation coefficient = 0.99
Convergent validity:
Strong correlation between the informant and clinician version of the LARS: r = 0.814***
Strong correlation between the informant versions of the LARS and the AES: r = 0.85***
Criterion validity:
An independent experienced neurologist’s classification of patients as severely apathetic vs. non- or mildly-apathetic as the “gold standard” using 23 patients and ROC curve analysis showed area under the curve (AUC) for the LARS-C = 0.98***; for the LARS-I = 0.93***
AUC difference between the LARS-I and AES-I = 0.05; p>0.19.
Discriminant validity:
Significantly higher apathy score (LARS-I) in demented PD patients compared to non-demented PD patients
Brief Psychiatric Rating Scale (BPRS)
65 BPRS-negative symptom (NS) scale; Available in Czech Estonian Italian German Polish Hebrew, and Russian translations. The items emotional withdrawal, depressive mood, motor retardation, and blunted affect loaded onto the same factor comprising the negative symptom subscale
Captures symptomatology from previous 2–3 days
Clinician-administered Not assessed Internal consistency:
BPRS-NS-subscale/factor found to have high internal consistency (α = 0.85).
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Not assessed
Discriminant validity:
The BPRS-NS-subscale poorly correlated with:
The agitation factor: r=0.13
Cognitive dysfunction factor: r=0.26
Hostile suspiciousness factor: r=0.16
Psychotic Distortion factor: r=−0.07
63 (Review) BPRS-negative symptom scale Negative symptoms subscale comprised of emotional withdrawal, motor retardation, and blunted affect items Clinician-administered Not assessed Internal consistency:
Ranging from 0.73 to 0.86 for individual items of the BPRS-NS.
Sum score: r=0.87 Test-retest reliability:
Ranging from 0.80 to 0.87 for BPRS-NS items
Inter-rater reliability:
Not assessed
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
66 BPRS-negative symptom (NS) subscale Negative symptoms subscale comprised of emotional withdrawal, uncooperativeness, motor retardation, disorientation and blunted affect items Clinician-administered Not assessed Internal consistency:
BPRS-NS-subscale: α = 0.68
Test-retest reliability:
Not assessed
Inter-rater reliability:
ICC for the individual items of the BPRS-NS-subscale were r=0.71*** (blunted affect), r=0.52*** (emotional withdrawal), r=0.74*** (motor retardation), uncooperativeness (r=0.61**) and r=0.87*** (disorientation). For the overall BPRS-NS-subscale the ICC was very high (r=0.90***)
Convergent Validity:
BPRS-NS-subscale vs. the PANSS-NS-subscale: r=0.82***
Discriminant validity:
Not assessed
Predictive validity:
BPRS-NS-subscale significantly but weakly correlated with work skills (r=0.27**), personal presentation (r=0.18**), work quality (r=0.21**) and social skills (r=0.39***). BPRS-NS-subscale was not statistically related work motivation and work conformance.
64 BPRS-negative symptom scale Negative symptoms subscale comprised of emotional withdrawal, motor retardation, and blunted affect items Clinician-administered Not assessed Internal consistency:
Not reported for each subscale
Test-retest reliability:
Not assessed
Inter-rater reliability:
ICC for the individual items of the BPRS-NS-subscale were r=0.36*** (blunted affect), r=0.55*** (emotional withdrawal), r=0.68*** (motor retardation) and r=0.74*** (depressive mood).
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
67 BPRS-negative Symptom scale Negative symptoms subscale comprised of emotional withdrawal, motor retardation, and blunted affect items Clinician-administered Not assessed Internal consistency:
Not assessed
Test retest reliability:
Not assessed
Inter-rater reliability:
Inter-rater reliability for blunted affect (r=0.46) and motor retardation (r=0.44) indicate fair reliability. Inter-rater reliability was said to vary depending on the discipline of the raters (i.e. nurse/social worker versus physician/social worker pairs). Reliability coefficient for the other items that comprise the BPRS-NS-subscale not given but indicated to be higher than that given for blunted affect and motor retardation. Note, statistical significance of the correlation coefficients Not assessed.
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
Scale for the Assessment of Negative Symptoms (SANS)
68 Scale for the Assessment of Negative Symptoms (SANS) 30 negative symptoms representing 5 domains. 5 items for apathy over the past month. Captures symptomatology over past month. Clinician-administered Not assessed. Internal consistency:
High internal consistency for the SANS-avolition/apathy subscale (α = 0.799).
Test-retest reliability:
Not assessed.
Inter-rater reliability:
High inter-rater reliability across items that comprised the SANS-apathy subscale (ICC = 0.701 – 0.918); global rating of apathy (ICC = 0.763) and the subscale score (ICC = 0.864).
Convergent validity:
Not assessed.
Discriminant validity:
Not assessed.
69 Scale for the Assessment of Negative Symptoms (SANS) As indicated above As indicated above Not assessed Internal consistency:
Not assessed
Test-retest reliability:
6 months (0.44 to 0.59)***
Inter-rater reliability:
Not assessed
Convergent validity:
Fair correlation with the PANSS-NS subscale (r=0.43**)
Discriminant validity:
Poorly correlated with the Positive symptom subscale of DPRS (r=0.16) but had fair and significant correlation with the Ham-D (r=0.50**), which is confounded by the lack of interest item in the Ham-D score. Weaker correlation with Depression, r=0.32** as measured by PANSS scale.
Positive and Negative Syndrome Scale (PANSS)
66 PANSS-negative syndrome scale; Available in Swedish and Spanish translations 30-item scale 7 items comprise the negative symptom scale
Captures symptoms over past week for acute, chronic, and long-term chronic phases of schizophrenia
Clinician-administered 30–50 minutes semi-structured interview Internal consistency:
Good internal consistency for the PANSS-NS-subscale: α=0.69
Test-retest reliability:
Not assessed
Inter-rater reliability:
Overall PANSS-NS-subscale score: r= 0.94***
ICC reliability coefficient for the individual items of the PANSS-NS-subscale ranged from 0.63–0.90. For example, 0.88 for Blunted affect
0.84 for Emotional Withdrawal
0.79 for Passive Withdrawal
Convergent validity:
Correlation between the PANSS-NS-subscale and the BPRS-NS-subscale items ranged from 0.11 to 0.74.
PANSS-NS-subscale and BPRS-NS-subscales highly correlated: r=0.82**
Discriminant validity
Not assessed
Predictive validity:
PANSS-NS-subscale significantly but weakly correlated with work skills (r=0.35**), work conformance (r=0.15*), work motivation (r=0.24*) and personal presentation (r=0.23**). Stronger correlations observed between the PANSS-NS-subscale and social skills (r=0.54***) and work quality (r=0.55***).
71 (Review) PANSS-negative syndrome scale As indicated above Clinician-administered 30–50 minutes semi-structured interview Internal consistency:
Good internal consistency for the PANSS-NS-subscale: α =0.85
Test-retest reliability:
Substantial test-retest reliability observed for the PANSS-NS-subscale: r=0.68**
Inter-rater reliability:
Good inter-rater reliability observed for the PANSS-NS-subscale: r=0.85**
Convergent Validity:
Good correlation between the PANSS-NS-subscale and SANS: r= 0.77***
Substantial correlation between the PANSS-NS-subscale and PANSS-General Psychopathology Subscale (GPS): r= 0.60***
Discriminant validity:
Weak correlation between the PANSS-NS and the PANSS-PS-subscales: r=0.27**, which reduced to r=−0.23* when the GPS effects were partial out)
70 PANSS-negative syndrome scale As indicated above Clinician-administered 30–50 minutes semi-structured interview Internal consistency:
Not assessed.
Test-retest reliability:
Not assessed.
Inter-rater reliability:
Inter-rater reliability using sets of 3 assessors (comprised of 2 psychiatrist and 1 psychologist) for PANSS-NS-subscale (r=0.70 to 0.89***) with a mean value of r=0.78***.
Convergent validity:
Strong correlation between the PANSS-NS-subscale and the SANS (r=0.77***).
Discriminant validity:
Weak correlation between the PANSS-NS-subscale and Scale for the Assessment of Positive Symptoms (r=0.25**).
75 PANSS-negative syndrome scale As indicated above Clinician-administered 30–50 minutes semi-structured interview Internal consistency:
Alpha coefficient for the PANSS-NS-subscale (α=0.68) indicated acceptable internal reliability.
Test-retest reliability:
Good test-retest reliability observed for the PANSS-NS-subscale (r=0.92***).
Inter-rater reliability:
Not assessed
Convergent validity:
Weak but statistically significant correlation (r=0.29*) between the PANSS-NS-subscale and the negative speech/behavior subscale of the Psychiatric Assessment Schedule – Adults with Developmental Disability (PAS-ADD). Similar correlation was observed between the PANSS-NS-subscale and the informant rating of depression in the patients using the PAS-ADD (r=0.34**)
Discriminant validity:
Weak but statistically significant correlations between the PANSS-NS and PANSS-PS subscales (r=0.28*).
Weak and non-statistically significant correlation between the PANSS-NS-subscale and the delusion (r=−0.11) and the auditory hallucination (r=−0.001) subscales of the Psychotic Symptom Rating Scale (PSYRATS).
73 PANSS-negative syndrome scale As indicated above Clinician-administered 30–50 minutes semi-structured interview Internal consistency:
Strong and statistically significant reliability coefficients for the PANSS-NS-subscale in acute (α=0.87), chronic (α=0.78), and long-term care (LTC: α=0.82) patients with schizophrenia. Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
In multiple regression analyses, a great amount of the variance in the prediction of PANSS-NS-subscale was explained by affective impairment as measured by the Manifest Affect Rating Scale in acute (r2=0.70), chronic (r2=0.55) and LTC (r2=0.55) patients with schizophrenia.
Discriminant validity:
Weak and non-statistically significant correlations between the PANSS-NS and PANSS-PS subscales in acute (r=0.07), chronic (r=0.27), and LTC (r=0.23) patients with schizophrenia.
74 PANSS-negative syndrome scale As indicated above Clinician-administered 30–50 minutes semi-structured interview Internal consistency:
Strong and statistically significant reliability coefficients for the PANSS-NS-subscale: (α=0.83).
Test-retest reliability:
3–6 month test-retest reliability coefficient (r=0.68**) indicated substantial reliability.
Inter-rater reliability:
Not assessed
Convergent validity:
Statistically significant but weak correlation between then PANSS-NS-subscale and the motor retardation (r = 0.22*).
The PANSS-NS-subscale accounted for chiefly by general affective impairment as measured by the Manifest Affect Rating Scale (MARS) including impoverished thought content (r=0.52**), lack of insight (r=0.50**) and active social withdrawal (r=0.32–0.64**).
Discriminant validity:
Weak but statistically significant correlations between the PANSS-NS and PANSS-PS subscales (r=0.27**), which decreased slightly once the shared variance from the general psychopathology subscale was removed (r=0.23*).
Weak and non-significant correlation between the PANSS-NS subscale and unspecified psychosis (r=0.29) and major affective disorder (r=−0.21)
76 PANSS & PANSS-S (i.e., the Spanish version) As indicated above Clinician-administered Not assessed Internal consistency:
Not assessed
Test-retest reliability:
Not assessed
Inter-rater reliability:
PANSS-NS-subscale r= 0.84***
PANSS-S-NS-subscale r= 0.74***
Convergent validity
High correlation between the PANSS-NS and the PANSS-S-NS subscales: r=0.83***
Substantial to high correlations between the individual items on the PANSS-NS and on PANSS-S-NS subscales: r= 0.64 to 0.90**
Discriminant validity:
Not assessed
Unified Parkinson’s Disease Rating Scale (UPDRS)
78 Unified Parkinson’s Disease Rating Scale; Available in Dutch French, and German translations A single item meant to screen motivation and/ or initiative in elective (non-routine) or day-to-day (routine) activities Assess change in symptomatology since the onset of PD. Clinician-administered Not assessed. Internal consistency:
Not assessed
Test-retest reliability:
Not assessed.
Inter-rater reliability:
Not assessed.
Convergent validity:
Correlation between:
UPDRS apathy and apathy per diagnostic schema by independent clinician : r = 0.27*
UPDRS apathy and MADRS loss of interest: r = 0.62***
Criterion validity:
Using apathy per diagnostic schema by independent clinician:
Score ≥1→ 80% sensitivity
  → 23% specificity
Optimal cut-point
Score ≥2 → 70% sensitivity
  → 75% specificity
  → AUC = 0.70*
Discriminant validity:
Correlation between:
UPDRS apathy and UPDRS depression: r = 0.22
UPDRS apathy and MADRS depression: r = 0.07
77 Unified Parkinson’s Disease Rating Scale As indicated above As indicated above As indicated above Internal consistency:
Not assessed
Test-retest reliability:
Not assessed.
Inter-rater reliability:
Not assessed.
Concurrent validity:
Highly correlated with the total score on the AS-14: r = 0.55***
Criterion validity:
Using the diagnostic schema to ascertain apathy status (gold standard):
Score ≥1→ 91% sensitivity
  → 46% specificity
  → AUC = 0.72***
Score ≥2→ 73% sensitivity (5984)
  → 65% specificity (6574)
  → AUC = 0.76***
Discriminant validity:
Difference between AUC for UPDRS apathy and UPDRS depression = 0.10* indicate significant and higher accuracy of the UPDRS to detect clinical apathy.
Irritability-Apathy Scale (IAS)
79 Irritability-Apathy Scale (IAS) 10 item scale, 5 items tap into apathy
Items capture behavior changes since onset of illness
Clinician-administered to a knowledgeable informant Not assessed Internal consistency:
IAS-apathy: α = 0.78
Test-retest reliability:
IAS-apathy: r = 0.76
Inter-rater reliability:
IAS-apathy: r = 0.85
Convergent validity: Not assessed
Discriminant validity:
No significant correlation between apathy and premorbid traits (i.e., being “good tempered,” “bad tempered,” “happy” or a “worrier.”
Construct validity:
IAS apathy subscale differentiated between controls and AD, and controls and HD.*
Frontal Lobe Personality Scale (FLOPS) now known as the Frontal Systems Behavior Scale (FrSBe)
81 FLOPS/FrSBe 46 items with 3 subscales: Apathy, disinhibition, and executive function.
Captures symptoms and behavioral changes pre- and post- lesion of the frontal lobe, as well as symptoms in past two weeks for healthy controls
3 different modes of administration: patient, family and staff forms. Not assessed Internal consistency:
Item-total correlation for the apathy items (r=0.87)
Test-Retest reliability:
Not assessed
Inter-rater reliability:
Normative sample of family (r=0.78) and self
Convergent validity:
Not assessed
Discriminant validity:
Not assessed.
85 FLOPS/FrSBe As indicated above As indicated above Not assessed Internal consistency:
Not assessed
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Only fair correlation between the FrSBe-Apathy and NPI-Apathy: (r=0.37*)
Discriminant validity:
Not assessed
87 FLOPS/FrSBe As indicated above As indicated above Not assessed Internal consistency:
Not assessed
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Not assessed
Discriminant validity:
FrSBe – Apathy and Depression (GDS-short form) not significantly correlated.
84 FLOPS/FrSBe As indicated above As indicated above <10 minutes Internal consistency:
Cronbach’s α for the apathy subscale = 0.88
Test-retest reliability:
Apathy subscale: r = 0.65*** 3 month
Inter-rater reliability:
Cronbach’s α ranged from 0.79 for to 0.92
Convergent validity:
FrSBe-apathy highly correlated with emotional withdrawal (r = 0.51***), motor retardation (r = 0.47***), blunted affect (r = 0.55***), and retardation factor (r = 0.62***) from the BPRS.
Criterion validity:
Scores on the FrSBe apathy distinguish between controls (21.94 (6.16)) and patients with schizophrenia (39.26 (9.08))***
Discriminant validity:
Very poor correlation between apathy score and depression: r=0.13
Weak correlation with disinhibition (r=0.30)
Predictive validity:
Apathy per FrSBe negatively correlated with functional performance (−0.59 to −0.47)***
86 FLOPS/FrSBe As indicated above As indicated above Not assessed Internal consistency:
Not assessed
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
FrSBe Apathy and loss of interest/reactivity item (r=0.54**)
Discriminant validity:
FrSBe-Apathy vs. Cornell-Scale for depression (r=0.47*)
FrSBe Apathy and negative mood (depression and anxiety) no significant correlation (r = −0.27)
Key Behavior Change Inventory (KBCI)
88 Key Behavior Change Inventory (KBCI)
Apathy Subscale
8 apathy items (4 positively and 4 negatively worded items) Items capture behavior change post-injury Completed by an informant Not assessed Internal consistency
Internal consistency for KBCI ranged from 0.82
to 0.91 with an alpha coefficient of 0.89 for the apathy subscale.
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Construct validity:
Construct validity was assessed using TBI and MS patients and neurologically intact controls
The ratings for those with TBI and MS were significantly higher than controls on all the subscales of the KBCI***
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
89 Key Behavior Change Inventory (KBCI)
Apathy Subscale
As indicated above As indicated above Not assessed Internal consistency:
Not assessed
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Demonstrated by statistically significant correlation with measures of executive functioning (COWA: −0.24*; semantic fluency: −0.32*; D span back: −0.23*)
Discriminant validity:
Demonstrated by non-significant correlation with measures of language, visuospatial memory and global cognitive functioning.
Neuropsychiatric Inventory (NPI)
90 Neuropsychiatric Inventory (NPI); Available in Afrikaans Chinese Croatian Czech Danish Dutch Estonian Finnish French German Greek Hebrew Hungarian Italian Japanese Korean Norwegian Polish Portuguese Russian Slovak Spanish Swedish, and Thai 12-subscales on commonly-observed behaviors in dementia. The NPI-apathy subscale consists of the screen question, which is rated on a NO vs. YES basis. If the screen question is answered YES then 7 sub-questions are administered followed by overall frequency and severity questions
Items capture behavioural change during past month or since the last evaluation
Administration: Clinician-administered to a knowledgeable informant using a structured interview Not assessed Internal consistency:
NPI-apathy: α = 0.87– 0.88
Test-retest reliability:
NPI-apathy:
0.74*** for frequency and 0.68*** for severity
Inter-rater reliability:
NPI-apathy:
0.98 for frequency and 0.89 for severity
Content validity:
Panel of international experts used (Delphi Panel) to rate screening questions and subquestions; all question groups except “troublesome behavior” received a score of less than 2, indicating “high content validity”. “Troublesome behavior” was reformulated as “aberrant motor behavior”
Convergent validity:
Not assessed for the NPI-apathy subscale.
Discriminant validity:
Not assessed for the NPI-apathy subscale.
92 Korean version of Neuropsychia tric Inventory (K-NPI) As indicated above, with Korean translation As indicated above Not assessed Internal consistency: Cronbach’s α = 0.85 for total score (0.81 for frequency, 0.82 for severity)
Test-retest reliability:
Test-retest was 0.76*** for frequency score and 0.75*** for severity score
Inter-rater reliability:
Not assessed
Convergent validity:
Not assessed
Discriminant validity:
Discriminate between mild and severe** and between moderate and severe* cognitively impaired groups
95 Brief version (NPI-Q) 12 symptom domains derived from the NPI’s core symptom manifestations Informants self-rate; asked to circle yes or no responses; rates symptom severity on a 1–3 scale; frequency not rated. Caregiver distress rated on a 0–5 scale identical to NPI. Approximately 5 minutes Internal consistency:
Interscale correlations for symptoms ratings (range 0.71–0.93)*** and caregiver distress ratings (range 0.71–0.97)*** were strongest for euphoria, disinhibition, and delusions, and weakest for agitation and depression
Test-retest reliability:
For severity and distress were 0.80*** and 0.94*** respectively
NPI-total = Not assessed
NPI-Apathy = Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Interscale correlation with total score on NPI was 0.91*** Interscale correlation on distress was 0.92.*** Interscale item correlations for severity and either NPI Total or NPI severity were “virtually identical”
NPI-Q vs. NPI = 0.84***
NPI-Q-Apathy vs NPI-Apathy = 0.86***
Discriminant validity:
Not assessed
98 C-NPI (Chinese version of the NPI) See Cummings et al., 1994 See Cummings et al., 1994 See Cummings et al., 1994 Internal consistency:
C-NPI overall: α = 0.84
Frequency α = 0.86
Severity α = 0.79
Internal consistency not assessed for the C-NPI-Apathy and other subscales
Test-retest reliability:
Not assessed.
Inter-rater reliability:
C-NPI apathy:
Frequency: r = 0.89
Severity: r = 1.00
Convergent validity:
Not assessed for the C-NPI-apathy subscale.
Discriminant validity:
Not assessed for the C-NPI-apathy subscale.
96 Nursing home version (NPI-NH) Same as NPI but with addition of degree of disruption (i.e. extra stress and workload) to the nursing staff caused by the presenting symptoms. Completed by nursing home caregiver Not assessed Internal consistency:
Not assessed
Test-retest reliability:
Test-retest correlation for total score was 0.76; individual scales ranged from 0.55 to 0.88
NPI-Total = 0.76
NPI-Apathy = 0.71
Inter-rater reliability:
Not assessed
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
93 Hellenic version (H-NPI) Not assessed Not assessed Not assessed Internal consistency:
Cronbach’s for total H-NPI was 0.76 (from 0.69–0.76)
NPI-Apathy = between 0.69–0.76
Test-retest reliability:
Not assessed
Inter-rater reliability:
Not assessed
Convergent validity:
Compared scores to Brief Psychotic Rating Scale (BPRS) and Caregiver Emotional Distress Scale (EDS); H-NPI total score significantly correlated with EDS score (r= 0.42*).
EDS total score and individual H-NPI scores were delusions (r = .55**), aggression (r=0.57**), apathy (r= −0.67***) and irritability (r=0.482**)
H-NPI Apathy vs. BPRS – Withdrawn/Negative = 0.48***
Discriminant validity:
Not assessed
97 P-NPI (Brazilian/Po Rtuguese version of the NPI) Not assessed Not assessed Not assessed Internal consistency:
NPI-Total = 0.70
NPI-Apathy = not assessed
Inter-rater reliability:
NPI-Total = 0.98***
ICC NPI-Apathy =0.67***
Test-retest reliability:
NPI=.82**
NPI-Apathy =.53**
Convergent validity:
Not assessed
Discriminant validity:
Not assessed
*

p<0.05

**

p<0.01

***

p <0.001

AES, AS-7, AS-10, AS-14, AI, DAIR, IAS, NPI, SANS and KBCI : Items listed in the original article. Copy can be obtained from author or publisher.

Apathy Evaluation Scale (AES)

The AES was developed to ascertain and quantify apathy within the month prior to the time of the assessment (46;47). The definition of apathy as “a syndrome of loss of motivation as reflected by acquired changes in affect (mood), behavior and cognition,” as formulated from the literature and extensive clinical experience (46;47), was used to guide the development of the scale. The scale comprises 18 core items that assess and quantify the affective, behavioral, and cognitive domains of apathy but with phrasing varying by rater (i.e., self [AES-S], informant [AES-I], or clinician [AES-C]). In addition, the AES-C incorporates a semi-structured open-ended interview with some guidelines and probes, in which the clinician elicits information from the patient about his/her typical day from the time he/she wakes up until he/she goes to bed, and about his/her usual activities or hobbies or interests including things that he/she would like to do but is physically unable to do. This information is intended to aid the clinician in providing his/her own rating of the individual’s level of apathy on each item, which is rated on a 4-point response scale (0=not at all true/characteristic to 3=very much true/characteristic). Higher scores indicate more severe apathy (46). The AES-C is said to take between 10–20 minutes to complete by a trained interviewer (46;47), but particularly if the interviewer has a minimum of a masters-level training and at least one year of experience with this clinical population or bachelor-level training and three or more years of clinical experience (56;57). The AES items have been shown to load onto three factors, with most items loading onto the apathy factor and accounting for the majority of the variance (46;57;58).

Reliability

The internal consistency of the AES ranges from 0.86–0.94 for the self-rated to the clinician versions with replication in individuals with right or left CVA, AD and major depressive disorder (46;47;51); community-dwelling older adults with memory complaints (57) and first episode psychosis (58). These findings indicate good reliability for the scale. The AES-I and AES-C have been shown to have good test-retest reliabilities with assessments 25.4 days apart (46;47), but replication is needed. Good inter-rater reliabilities have been demonstrated in two studies for the AES-C (46;58).

Validity

The high rate of use of the AES-I and AES-C in various populations (e.g., normal controls, outpatient with cognitive complaints, PD, and schizophrenia) lend support to their face and construct validity. Statistically significant and fair to high correlation between the AES-I and AES-C and other measures of apathy (e.g., NPI-apathy subscale (57), the Lille Apathy Rating Scale [LARS] (59;60), and the PANSS-negative symptom (NS) subscale, particularly the emotional withdrawal item (58) indicated fair to good convergent validity. Understandably, the AES-I was also correlated highly with scores on the 7-item Apathy Scale (AS-7) (61) that was validated in a geriatric rehabilitation inpatients and the 10-item Apathy Scale (AS-10) (62) that was validated in geriatric nursing home residents given seven or more common items. Good discriminant validity was also demonstrated for the AES-I and AES-C as evident by low correlations with depression and anxiety measures (46;47;57) and the positive factor of the PANSS (58). The convergent and discriminant validities of the AES-S were not as favorable (57).

Variations of the AES

Starkstein et al’s 14-item Apathy Scale (AS-14) (53) is based on a preliminary version of the AES and therefore has 6 items in common. Resnick et al’s AS-7 (61) and Leuken et al’s AS-10 (62) represent truncated versions of the AES that result from removal of some items that were determined to be redundant (53;61) or inappropriate for the group being assessed (62). Judgment of redundancy was based on factor analyses (53;61) whereas inappropriateness was judged by experts with special knowledge of the population being assessed (61;62). The intent of these abridged versions of the AES was to better capture apathy in the respective populations with reliable and valid measures while possibly requiring less time although not explicitly stated. These abridged apathy scales are based on informant report of the patient’s behavior. As with the original scale, each item is rated a 4-point scale. The total scores range from 0–21 for the AS-7 (61), 0–30 for the AS-10 (62), and 0–42 for the AS-14 (53), with higher scores indicating more severe apathy.

Reliability

The alpha coefficients for the AS-7 (α=0.67) and AS-14 (α=0.76) were below the criterion set for adequate reliability. On the other hand, very good internal consistency was demonstrated for the AS-10 (α= 0.92). However, good one-week test-retest (r=0.90) and inter-rater reliabilities (r=0. 81) have been demonstrated for the AS-14 as validated in a patients with PD. Studies that attempt to replicate these findings are lacking but warranted. Test-retest and inter-rater reliabilities were not assessed for the AS-7 (61) and the AS-10 (62).

Validity

A cut-point of 14 on the AS-14 using an independent neurologists blind classification of apathy status as the “gold standard” had 66% sensitivity and 100% specificity in categorizing individuals as apathetic versus not apathetic (53). The convergent and discriminant validity of the AS-14 was not assessed. The AS-10, intended for assessment of apathy in nursing home residents, was strongly correlated with the original 18-item AES (r=0.91) and the Neuropsychiatric Inventory (NPI) apathy subscale (r=0.62), which was above the criterion set for moderate convergent validity. The scale also demonstrated good discriminant validity as indicated by any poor correlation with the scores on the depression subscale of the NPI (r=0.09).

The AS-7 was strongly correlated (r=0.87) with the AES-C (61), as would be expected given the common items in the measures. Since higher scores on the AS-7 indicate increasing level of apathy, the level of correlation between the AS-7 and the measure of willingness to participate in rehabilitation efforts (r=0.37–0.42) and depression (r=0.45) indicated, at most, acceptable level of discriminant validity. This level of correlation between the AS-7 and depression is likely due to the inclusion of the loss of interest item in the measure of depression and hence confounding. The AS-7 was found to be significantly predictive of functional performance at discharge (beta estimate = −0.22) in older adults in rehabilitation inpatient care (61), but have not been tested in other studies.

Apathy Inventory (AI)

Robert and colleagues (33) developed the 3-item AI to identify and quantify apathy and validated in individuals with MCI. The items included in the AI (i.e., emotional blunting, lack of interest, and lack of initiative) were based on the conceptualization of apathy as a lack of emotional response, self-initiated actions, and interest in things (4648). The AI involves a clinician-administered interview to either the caregiver (AI-caregiver) or the patient (AI-patient). In the AI-caregiver interview, the presence or absence of the three items is initially rated. If present, frequency (4-point scale) and severity (3-point scale) are then assessed. The AI-caregiver score ranged from 0–36 with higher score indicating greater apathy. In the AI-patient interview, patients are asked about the presence or absence of the three items of the AI. If an AI item is rated as present, the patient is asked to estimate its intensity on a 12-point Likert-type scale “from mild at the left-hand end of the scale, to severe at the right-hand end,” thereby giving a range of score from 0–36 with higher scores indicating more severe apathy. The length of time required to complete the AI-caregiver and AI-patient was not indicated. Validation of the scales was carried out in a mixed sample consisting of normal controls, MCI, and AD patients.

Reliability

Good reliabilities have been demonstrated for the caregiver but not the patient version of the AI using a sample of normal, MCI, AD, and PD patients and their caregivers. The AI-caregiver had an internal consistency of 0.84, but this statistic was not reported for the AI-patient. Very good inter-rater reliability (r=0.99) was observed for the AI-caregiver, using independent clinicians to rate videotaped caregiver interviews. Test-retest reliability exceeding the criterion set for moderate reliability (r=0.97, 0.99, 0.99 for lack of initiative, lack of interest, and emotional blunting, respectively) were reported for the caregiver version of the AI. The two assessments were completed by different interviewers with the same caregivers on the same day. The high probability of the caregivers still remembering their earlier rating of the patients’ apathy level in the second interview given the short time interval might explain the high test-retest reliability coefficient observed. Independent assessment of the test-retest reliability of the AI using a different time frame for the second interview would be useful.

Validity

More favorable validity information was observed for the AI-caregiver than the AI-patient. Convergent validity, as indicated by correlation with the NPI-apathy subscale, was moderate for the AI-caregiver lack of interest item (r=0.66) but only fair for its lack of initiative item (r=0.23). However, convergent validity of the AI-patient was poor. The AI-caregiver score discriminated controls from patients with AD. Specifically, caregivers rated patients with AD at significantly higher scores on lack of initiative and global apathy compared to controls. On the AI-patient, the PD group had higher lack of initiative and global apathy scores compared to controls. On both cases, the lack of interest item did not show good discriminant properties.

Dementia Apathy Interview and Rating (DAIR)

The DAIR is a 16-item clinician administered scale that was developed and validated in females with possible and probable AD (63). Items were generated based on clinical observation and interview with AD patients and their caregivers, as well as evidence from the existing literature on apathy. The scale is administered to a knowledgeable caregiver using a structured interview with inquiry about apathy in the patient over the past month. Each item is scored on a 4-point scale (0=no or almost never to 3=yes or almost always) with higher scores representing greater severity of apathy. Only items representing a change in behavior are included in the final apathy score. The average time to complete the scale is not indicated.

Reliability

The DAIR has very good internal consistency whether it is conducted as an in-person or telephone interview (α =0.89–0.94) (63). The two-month test-retest reliability (r=0.85) and the inter-rater reliability (r=1.00) were also shown to be very good (63).

Validity

Statistically significant correlations (r=0.31–0.46) were observed between the DAIR total score and apathy as rated on a 12-point Likert-like scale completed by an independent clinician who was blind to the participants’ DAIR score, thus indicating only fair convergent validity (63). The researchers also found poor correlation between DAIR and the caregivers’ report of depression as rated by the depression subscale of the Consortium to Establish a Registry for Alzheimer’s Disease Behavior Rating Scale for Dementia (r=0.08) (63) showing good discriminant validity.

Lille Apathy Rating Scale (LARS)

The LARS represents a 33-item apathy scale with nine domains that is clinician-administered using a structured interview (59;60). The scale was developed to ascertain and quantify apathy in the month prior to the assessment and validated in individuals with PD. Items and domains were generated from the apathy literature, Marin and colleagues’ (46;47) and Stuss et al’s (48) conceptualization of apathy as well as clinical experience with patients with apathy. The first three items of the LARS are scored on a 5-point Likert-like scale (0–4) and the remaining 30 items are scored on a no-versus-yes basis. Scores on the scale range from −36 to +36 with higher and more positive score indicating greater severity of apathy. Guidelines for the scoring method were not found in the available literature.

Reliability

Internal consistency of the LARS was found to be good (α=0.80). The 4-month test-retest reliability was very good (r=0.95), as was the inter-rater reliability between two clinicians (ICC=0.98) (59). Similarly, good internal consistency, test-retest, and inter-rater reliabilities were observed by Dujardin et al (60) for the informant and clinician versions of the LARS in PD patients and controls.

Validity

The validity of the LARS for assessing the presence and severity of apathy has been demonstrated in patients with PD (59;60). Cut-off scores of −15 to −17 showed good sensitivities (0.87–0.94) and specificities (0.87–0.94) (59;60). In the original study, the correlation between the LARS and the AES total scores was 0.87, indicating very good convergent validity (59). Similarly, good discriminant validity was demonstrated by a lack of significant interaction between apathy as measured by the LARS and depression as determined by the MDARS (59). These findings were replicated by Dujardin and colleagues (60).

Brief Psychiatric Rating Scale (BPRS)

The BPRS is an international and widely used 18-item scale developed by Overall and Gorham (64) to assess psychosis in patients with schizophrenia. Fourteen of the 18 items were derived from factor and cluster analytic studies involving the Lorr’s Multidimensional Scale for Rating Psychiatric Patients and the Inpatient Multidimensional Psychiatric Scale (65). Each item is rated on a 0-to-4-point scale with higher score indicating greater severity of problems (65;66). Consistently, the emotional withdrawal, motor retardation, and blunted affect items have been found to comprise the BPRS-NS subscale with variations in some of the other items.

Reliability

The reported internal consistency for the BPRS-NS-subscale (or withdrawn-depression factor) ranges for substantial to very high (65;67;68). Good inter-rater reliability coefficients were also demonstrated for the sum score (r=0.87–0.90) of the BPRS-NS-subscale across studies (65;66;69). The inter-rater reliability for the same items, as observed by Andersen and colleagues, (66) was fair to substantial (r=0.36–0.68). The average test-retest reliabilities for the items of the BPRS-NS subscale across the studies reviewed by Hedlund and Vieweg (65) were good (r=0.80–0.87).

Validity

The BPRS-NS subscale items had poor-to-good convergent validity (range 0.11–0.74) and the subscale as a whole had good convergent validity (r=0.82) when compared to the PANSS-NS subscale (63). Good discriminant (67) and predictive (68) validities were also reported for the scale.

Scale for the Assessment of Negative Symptoms (SANS)

The SANS is a clinician-administered scale that was developed to ascertain and quantify negative symptoms in inpatients and outpatients with schizophrenia. The items were generated from extensive clinical experience with patients with schizophrenia (70). The SANS comprises 30 negative symptoms representing five domains including affective flattening, emotional blunting/alogia, avolition/apathy, anhedonia/asociality and attentional impairment. Each item is scored on a 6-point scale (0 to 5) with higher scores indicating greater severity of negative symptoms. Five items comprised the avolition/apathy subscale (SANS-apathy).

Reliability

The SANS-apathy subscale was observed to have good internal consistency (α=0.80) (70). The inter-rater reliability was also good (r=0.86) with reliability coefficients ranging from 0.70 to 0.92 for its five items. Test-retest reliability was not assessed by Andearsen and colleagues (70) but found to be fair (r=0.44–0.59) by McAdams et al (71), which is below the criterion for at least moderate test-retest reliability for this review.

Validity

McAdams et al (71) observed that the SANS-apathy subscale had good discriminant validity as indicated by poor correlation with the positive symptoms on the BPRS (r=0.16). The fairly high correlation between the SANS-apathy subscale and the HAM-D score is likely confounded by the inclusion of the “lack of interest item in work and activities” in the HAM-D, which is a significant symptom in apathy. Fair convergent validity was indicated by statistically significant but weak correlation between the SANS-apathy subscale and the negative symptoms of the BPRS (71). Good convergent validity was demonstrated by strong correlation between the SANS and Negative Subscale of the PANSS (r=0.77) (72;73).

Positive and Negative Symptom Scale (PANSS)

The PANSS is 30-item clinician-administered measure that assesses positive (e.g., hallucinations, delusions), negative (e.g., blunt affect, apathetic social withdrawal), and general psychiatric (e.g., depressed mood, anxiety) symptoms of schizophrenia. Eighteen items were derived from the Brief Psychiatric Rating Scale (BPRS) (64) and 12 items from the Psychopathology Rating Scale (74) and all are rated on a 7-point scale. PANSS is available in many languages. The 7-item PANSS-NS subscale has been used to measure apathy and apathy-related behaviors in schizophrenia.

Reliability

Substantial to good internal consistencies (0.68–0.83) were reported for the PANSS-NS subscale (72;73;7577). This was also demonstrated in acute (α=0.87), chronic (α=0.78) and long-term care (α=0.82) patients with schizophrenia (75). The test-retest (r=0.68) (76) and inter-rater reliability for the this apathy measure was substantial (r=0.68) (72;73) to very good (r=0.94) (68) even for its individual items (i.e., 0.63–0.90) (68). Inter-rater reliability coefficients for the Spanish version of the scale ranged from 0.66–0.98, with a mean of 0.81(78).

Validity

Compared to the BPRS, Bell and colleagues (68) found that only three items on the PANSS had Kappa weights ≥0.75 (i.e., blunted affect, hallucinations, and grandiosity). The PANSS-NS and BPRS-NS items had low-to-good correlation (range 0.11–0.74). However, correlation between the entire negative syndrome subscales on both scales was high (r=0.82). These results indicated acceptable to very good convergent validity for the individual items and very good convergent validity for the entire PANSS-NS subscale (68). High and low scores on the PANSS-NS and BPRS-NS subscales had a Kappa of 0.72, with nearly 86% agreement between them. PANSS-NS scores were highly predictive of work performance, with the greatest relationship demonstrated in Negative Total Score predicting social skills (Adj R2 = 0.54, p<0.001) and work quality (Adj R2 = 0.55, p<0.001). There was no significant association between PANSS-NS score and measure of depression (r=0.22) indicating good discriminant validity. Correlation between total score and individual items of the PANSS-S and PANSS negative scales was strong (r =0.66–0.90) (78).

Unified Parkinson’s Disease Rating Scale (UPDRS)

The single apathy item included in UPDRS is a quick and easy screen for apathy by neurologist in a busy clinic setting for patients with PD (79;80). The item is scored on a 5-point scale from 0–4 with higher score indicating greater severity of apathy. The item (and scale) is clinician administered.

Reliability

The test-retest and inter-rater reliabilities of the UPDRS-apathy item has not been established.

Validity

Research studies have demonstrated the criterion, convergent and discriminant validities of the UPDRS-apathy item (79;80). The optimal cut-off for the UPDRS-apathy item was greater than or equal to 2, with sensitivity and specificity of 70% and 65% (79) and 73% and 75% (80), which is lower than the validity criteria set in this review. The UPDRS-apathy item was highly correlated with the loss of interest item of the MADRS (80) and the scores on the AS-14 scale (79), indicating good convergent validity. Poor correlation with the UPDRS-depression item (79;80) and the MADRS depression score (80) showed that the UPDRS-apathy item has good discriminant validity.

Irritability-Apathy Scale (IAS)

The IAS was developed to measure irritability and apathy and was validated in patients with Huntington’s disease and AD (81). The scale is clinician-administered to a knowledgeable informant and consists of 10 items and two subscales. The IAS-apathy subscale is comprised of five items, rated each on a 5-point Likert scale (1 = much more interest to 5 = much less interest). Higher scores on the IAS-apathy subscale indicate more severe apathy.

Reliability

The IAS-apathy subscale was shown to be a reliable measure of apathy (81). The observed internal consistency (α=0.78) was considered good for a scale with few items (82) but slightly below the criterion set in this review. Good test-retest and inter-rater reliabilities were also observed (81).

Validity

The validity of the IAS-apathy subscale was demonstrated by Burns and colleagues (81) but has not been replicated elsewhere. More specifically, the IAS-apathy subscale was shown to have good discriminant validity and construct validity (81).

Frontal Lobe Personality Scale (FLOPS; now the Frontal System Behavior Scale [FrSBe])

The FLOPS (now FrSBe) is a 46-item scale that was developed to assess and quantify behavioral disturbances associated with damages to the frontal lobe and frontal-subcortical brain circuits, such as apathy, disinhibition, and executive function(83;84). The FrSBe has three different versions: self, informant, and clinician-rated. Rating in the three domains is based on behaviors prior to the onset of dementia (“before” scores) and current behaviours (“after” scores). The scale was initially validated in outpatients or research participants with a “wide range of neurological disorders” (83) and later in patients with schizophrenia. The length of time taken to complete each version of the FrSBe is not indicated. The FrSBe-apathy subscale consists of 14 items each rated on a 5-point scale ranging from 1–5.

Reliability

A number of studies have reported fair to high internal consistency for the FrSBe-apathy subscales with alpha coefficients ranging from 0.72–0.88 (8486). Grace and Malloy (84) also reported a high internal consistency for the apathy measure (α=0.78) in a normative sample using the self-report form that was slightly lower than specified in this study. Velligan et al (86) also observed that the FrSBe-apathy had high test-retest reliability when used to measure apathy in individuals with schizophrenia.

Validity

Norton and colleagues (87) demonstrated that the FrSBe-apathy subscale had fair convergent validity by its significant but somewhat weak correlation with NPI-apathy subscale in patients with dementia. However, Ready et al (88), using a mixed sample of individuals with AD and MCI, found a statistically significant and stronger correlation between the FrSBe-apathy subscale and the loss of interest/reactivity item of the Cornell Depression Scale (r=0.53) indicating good convergent validity. Velligan and colleagues (86) also observed statistically significant and stronger correlations between the FrSBe-apathy subscale score and the emotional withdrawal and blunted affect items on the BPRS in a sample of individuals with schizophrenia. These results indicated that the FrSBe-apathy subscale had good convergent validity.

The FrSBe-apathy subscale also demonstrated good discriminant validity in samples with MCI, AD, PD, and schizophrenia. The FrSBe-apathy had little or no correlation with depression regardless of the diagnostic composition of the study sample (86;88;89). These findings supported the notion that apathy and depression are distinguishable constructs.

Key Behavior Change Inventory (KBCI)

The KBCI is a 64-item measure designed to assess behavioural changes following TBI with validation in both TBI (90) and AD (91) samples. The KBCI has an apathy subscale with four positively and four negatively worded items each rated on a 4-point Likert scale (false or not at all true, slightly true, mainly true, and very true). The scale, and hence its apathy subscale, is clinician-administered. The time taken to complete the apathy assessment with the KBCI-apathy subscale is not indicated.

Reliability

The KBCI-apathy subscale has high internal consistency (α=0.89) in a TBI sample (90). Test-retest and inter-rater reliabilities were not assessed in the validation studies found (90;91). Studies that assess the reliability of the KBCI-apathy are needed.

Validity

Scores on the KBCI-apathy subscale were found to be higher among patients with TBI and those with MS compared to normal controls, and also higher in TBI than in those with MS thus providing evidence of the construct validity of the subscale (90). Non-significant correlations between scores on the KBCI-apathy subscale and measures of language, visuospatial memory, and global cognitive functioning in individuals with AD have been interpreted as evidence of the discriminant validity of the subscale (91).

Neuropsychiatric Inventory (NPI)

The NPI was developed to assess and quantify neurobehavioral disturbances in dementia patients and to quantify caregiver distress caused by such behaviors (92;93). The NPI has an apathy subscale, which consist of a general screen item rated on a yes-versus-no basis. If the symptom is found to be present, 7 additional apathy questions are administered and scored on a yes-versus-no basis. The overall frequency (rated as 1–4) and severity (rated as 1–3) of apathy is then rated. Scores on the NPI apathy subscale range from 0–12 with higher scores indicating more severe apathy (92;93). The NPI, and hence the NPI-apathy subscale, is widely used and has been validated in many different samples such as ambulatory patients with dementia, outpatients with AD, multicultural samples, and nursing home residents. The scale has been translated into many languages such as Korean (94), Hellenic (43;95), and Dutch (96) and validated in normal and clinical inpatient and outpatient samples from the respective countries. A shorter version of the scale (NPI-Q) that takes only 5 minutes to complete has also been developed in which the screen items are rated first on a presence-versus-absence basis followed by the assessment of frequency (14) and severity (13), resulting in a range of scores from 0–60 (97). Scores on the NPI-Q apathy item range from 0–12 with higher scores indicating greater severity of apathy. A nursing home version of the scale (NPI-NH) has also been developed with a NPI-NH-apathy subscale (98). Scores for the NPI-NH-apathy subscale range from 0–12 with increasing scores indicative of increasing severity of apathy. The NPI-apathy subscale has been used in many studies to determine the convergent validity of other apathy measures such as the AI-caregiver (33), the three versions of the AES (57), and the AS-10 (62).

Reliability

The NPI and its subscales, including apathy, have been validated in many studies. This includes the English, Chinese, Hellenic, Korean, and Portuguese as well as the nursing home versions of the scale (92;94;97100). Cummings and colleagues (92) reported good internal consistency (α=0.87–0.88), and test-retest (r=0.74 for frequency), and inter-rater reliabilities (r=0.89 for severity and r=0.98 for frequency) for the NPI-apathy subscale. Similarly, high test-retest reliability has been reported for apathy subscale of the nursing home (98) and Korean (94) versions. The test-retest reliability for the Portuguese version of the NPI-apathy subscale was not as high (99). High inter-rater reliability for the NPI-apathy subscale was also observed by Cummings et al (92) and Leung et al (100), while a lower value was reported by Camozzato and colleagues (99). Although the reliability of the total NPI-Q scale has been examined (97), this was not done for the apathy subscale.

Validity

Cummings and colleagues (92) assessed the content validity of the NPI and its subscales, including the apathy subscale, by using ratings from a panel of international experts in the assessment and treatment of neurobehavioral disturbances in the dementias. Other studies that have used the NPI-apathy subscale in the validation of other scales have provided information on its convergent validity. For example, Clarke et al (57), using a sample of community-dwelling individuals with memory complaints, found that the NPI-apathy subscale had statistically significant and fair correlations with the informant version but not the clinician version of the AES (AES-C, r=0.30; AES-I, r=0.50). Statistically significant and even stronger correlations between the NPI-apathy subscale and the AS-10 that was validated in nursing home residents (r=0.61 and 0.62) (62) and the NPI-apathy subscale and the AI-caregiver that was validated in MCI patients (r=0.66) (33) were observed. Politis et al (43;95) only demonstrated fair convergent validity between the Hellenic versions of the NPI-apathy subscale and the withdrawn/negative subscale of the BPRS (r=0.48). Leung et al (100) observed that the C-NPI-apathy subscale distinguish mild/moderate and severe dementia groups. Work on the discriminant validity of the NPI-apathy subscale is needed to further support its use as a valid measure of apathy in demented groups across many cultures.

Discussion

The prevalence and incidence of apathy varies across neurological and psychiatric populations. As well, the associated clinical features tend to vary across diagnoses (i.e., Parkinsonian apathy is associated with motor changes and slowing; AD apathy is associated with cognitive impairments; FTD apathy is associated with impulsivity). As such, the suitability of the measure is highly important for accurate detection and treatment planning, and a single universal measure may not be appropriate for all neuropsychiatric patients. As reviewed above, there are a large number of well-structured, valid, and reliable measures, per the criteria set for this review, for assessing apathy across a range of populations. These measures, to some extent, are grounded in the conceptualization of apathy as a loss or lack of motivation, lack of self-initiated actions or emotional blunting. Disease-specific measures, such as the DAIR (apathy in AD) and UPDRS (apathy in PD Disease), are sensitive to symptom change and population treatment differences, making them important for understanding clinical course and prognosis.

Some apathy measures, such as the FrSBe and KBCI, are not disease-specific per se but provide tailored assessment for specific injury populations (fronto-corticol damage and TBI, respectively). Conversely, the NPI, AES and its variations (AS-7, AS-10 and AS-14), and AI are validated for broad application across dementia and cognitively impaired populations. The availability of specific and broad measures of apathy means clinicians have greater flexibility in assessing all patients, irrespective of symptomatology or diagnosis. It is possible that broad apathy measures may not sufficiently detect subtle, disease-specific variations in the presentation of apathy in certain populations (e.g., in patients with dysexecutive syndromes such as FTD; in patients with schizophrenia) but this line of inquiry requires further research. Lack of a unified definition and conceptual operationalization of “apathy” may be the foremost barrier to extending the current literature in this area. Promisingly, work is currently underway by apathy researchers to rectify these shortcomings in the field.

That apathy has no universally-accepted definition in medicine makes the availability of these measures even more important because clinicians and researchers have no gold standard upon which they can draw guidance. Clinicians and researchers do not consistently use the same terminology, with descriptors such as “flattened affect,” “amotivation,” or “avolition” given in place of or in relation to the term apathy. This lack of consensus has important implications for research and the interpretability of data from apathy measures. Naturally, when developers of assessment tools do not have a precisely defined construct around which they can base their instrument, bias can more easily occur. Those who view apathy as a symptom of other problems (e.g., dementia) may construct a scale differently and include different items than a measure constructed from the viewpoint that apathy is its own syndrome. This underscores the importance of clearly demonstrating good discriminant and convergent validity between measures, which was the method used to demonstrate the validity of majority of the apathy measures reviewed. This technique reflects the reliance on theoretical constructs to infer validity, which is a viable option in the measurement field when there is a lack of gold standard to demonstrate criterion validity. However, the assumption inherent in using one scale to validate another is that the former measure is valid, which could be erroneous and lead to incorrect interpretations. Therefore, vigilance is needed when choosing the measures to use to demonstrate the convergent and divergent validity of apathy measures with clear rationale for the choice of measure/s. Without a gold standard on which to validate an instrument, predictive validity is also seen as a viable option, as was done by Marin and colleagues (46) in the development and validation of the AES. Lack of clarity about the definition of apathy also has the unfortunate consequence of making it easier for clinicians and researchers to disregard apathy altogether. Indeed, apathy is only mentioned 15 times in DSM-IV, and it is absent from the International Classification of Diseases-10.

Future research should focus primarily on building a consensus about apathy as a construct so that a gold standard assessment tool can be developed. In the absence of this, though, the most psychometrically robust and widely-used measures for assessing apathy broadly appear to be the AES and NPI, although the NPI might have slight preference, especially in busy clinical practices, given its ease of use. Modified versions of the AES (e.g., the AS-10 and AS-14) have shown promise in terms of ease of use but their observed psychometric properties have not been replicated in independent studies. Among specific populations, the DAIR for patients with AD, SANS and PANSS for schizophrenia populations, and the FrSBe for patients with fronto-temporal deficits all demonstrate promising psychometric properties. More data is needed to further establish reliability and validity characteristics across the remaining apathy measures (e.g., UPDRS, KBCI-apathy, and BPRS). For the AI, very good internal consistency, test-retest and inter-rater reliabilities have been demonstrated by the scale’s developer but replication studies are needed. In addition, further study on its validity is needed to support its use as a reliable and valid apathy measure.

So far as apathy remains a somewhat elusive and ill-defined concept, proper assessment becomes decidedly more complicated– and important. The wide availability of empirically-supported measures increases the likelihood that, when used, accurate detection and treatment can occur. Inappropriate selection of measurement can lead to inaccurate interpretation of research data and flawed conclusions, which stymies research progress in neuropsychiatry as a whole. However, when measures are used more appropriately, improved patient and caregiver quality of life is more likely.

Conclusion

Though no gold standard apathy assessment tool exists, there are several well-validated, empirically-reliable measures for general (e.g., NPI, AES) and diagnosis-specific apathy (e.g., DAIR, PANSS, FrSBe). When used in conjunction with other clinical assessment tools (e.g., mood, history), these can provide a fuller picture of prognosis and clinical course, as well as informing treatment decision-making, response, and outcome. The measures described herein provide a range of options for assessing apathy in a variety of populations, with the goal of reducing morbidity. Future research needs to focus on further establishing psychometric properties of current apathy measures. Researchers and clinicians must make it a priority to build a consensus as to the definition of apathy, which will assist in future studies of apathy treatment and assessing the impact of treatment on course of illness.

Acknowledgements

Aside from the main funding source of the American Psychiatric Association (Dr. Diana E. Clarke, Dr. Emily A. Kuhl, and Ms. Rocio Salvador), Ms. Jean Y. Ko is a Ph.D. candidate (abd) in the Department of Mental Health at Johns Hopkins Bloomberg School of Public Health and is supported by NIA F31AG030908-02. Drs. van Reekum and Marin have no additional support.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Contributor Information

Diana E. Clarke, Division of Research, American Psychiatric Association, , Arlington, Virginia, USA and Department of Mental Health, Johns Hopkins University School of Public Health, Baltimore, Maryland, USA.

Jean Y. Ko, Department of Mental Health, Johns Hopkins University School of Public Health, Baltimore, Maryland, USA.

Emily A. Kuhl, Division of Research, American Psychiatric Association, Arlington, Virginia, USA.

Robert van Reekum, Institute of Medical Science and the Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada.

Rocio Salvador, Psychopathology Program Coordinator, Division of Research, American Psychiatric Association, Arlington, Virginia, USA.

Robert S. Marin, Medical Director, Hill Satellite Center; Associate Director, Center for Public Service Psychiatry, Western Psychiatric Institute and Clinic, Pittsburgh, Pennsylvania, USA.

Reference

List

  • 1.van Reekum R, Stuss DT, Ostrander L. Apathy: why care? J Neuropsychiatry Clin Neurosci. 2005;17(1):7–19. doi: 10.1176/jnp.17.1.7. [DOI] [PubMed] [Google Scholar]
  • 2.Clarke DE, van Reekum R, Simard M, Streiner DL, Conn D, Cohen T, et al. Apathy in dementia: clinical and sociodemographic correlates. J Neuropsychiatry Clin Neurosci. 2008;20(3):337–347. doi: 10.1176/jnp.2008.20.3.337. [DOI] [PubMed] [Google Scholar]
  • 3.Borroni B, Agosti C, Padovani A. Behavioral and psychological symptoms in dementia with Lewy-bodies (DLB): frequency and relationship with disease severity and motor impairment. Arch Gerontol Geriatr. 2008 Jan;46(1):101–106. doi: 10.1016/j.archger.2007.03.003. [DOI] [PubMed] [Google Scholar]
  • 4.Borroni B, Turla M, Bertasi V, Agosti C, Gilberti N, Padovani A. Cognitive and behavioral assessment in the early stages of neurodegenerative extrapyramidal syndromes. Arch Gerontol Geriatr. 2008 Jul;47(1):53–61. doi: 10.1016/j.archger.2007.07.005. [DOI] [PubMed] [Google Scholar]
  • 5.Dujardin K, Sockeel P, Devos D, Delliaux M, Krystkowiak P, Destee A, et al. Characteristics of apathy in Parkinson’s disease. Mov Disord. 2007 Apr 30;22(6):778–784. doi: 10.1002/mds.21316. [DOI] [PubMed] [Google Scholar]
  • 6.Kirsch-Darrow L, Fernandez HH, Marsiske M, Okun MS, Bowers D. Dissociating apathy and depression in Parkinson disease. Neurology. 2006 Jul 11;67(1):33–38. doi: 10.1212/01.wnl.0000230572.07791.22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Diehl-Schmid J, Pohl C, Perneczky R, Forstl H, Kurz A. Behavioral disturbances in the course of frontotemporal dementia. Dement Geriatr Cogn Disord. 2006;22(4):352–357. doi: 10.1159/000095625. [DOI] [PubMed] [Google Scholar]
  • 8.Srikanth S, Nagaraja AV, Ratnavalli E. Neuropsychiatric symptoms in dementia-frequency, relationship to dementia severity and comparison in Alzheimer's disease, vascular dementia and frontotemporal dementia. J Neurol Sci. 2005 Sep 15;236(1–2):43–48. doi: 10.1016/j.jns.2005.04.014. [DOI] [PubMed] [Google Scholar]
  • 9.Guilleminault C, Quera-Salva MA, Goldberg MP. Pseudo-hypersomnia and pre-sleep behaviour with bilateral paramedian thalamic lesions. Brain. 1993 Dec;116(Pt 6):1549–1563. doi: 10.1093/brain/116.6.1549. [DOI] [PubMed] [Google Scholar]
  • 10.Starkstein SE, Petracca G, Chemerinski E, Kremer J. Syndromic validity of apathy in Alzheimer's disease. Am J Psychiatry. 2001 Jun;158(6):872–877. doi: 10.1176/appi.ajp.158.6.872. [DOI] [PubMed] [Google Scholar]
  • 11.Roman GC, Erkinjuntti T, Wallin A, Pantoni L, Chui HC. Subcortical ischaemic vascular dementia. Lancet Neurol. 2002 Nov;1(7):426–436. doi: 10.1016/s1474-4422(02)00190-4. [DOI] [PubMed] [Google Scholar]
  • 12.Moretti R, Torre P, Antonello RM, Cazzato G. Behavioral alterations and vascular dementia. Neurologist. 2006 Jan;12(1):43–47. doi: 10.1097/01.nrl.0000186806.54314.e8. [DOI] [PubMed] [Google Scholar]
  • 13.Andersson S, Krogstad JM, Finset A. Apathy and depressed mood in acquired brain damage: relationship to lesion localization and psychophysiological reactivity. Psychol Med. 1999 Mar;29(2):447–456. doi: 10.1017/s0033291798008046. [DOI] [PubMed] [Google Scholar]
  • 14.Finset A, Andersson S. Coping strategies in patients with acquired brain injury: relationships between coping, apathy, depression and lesion location. Brain Inj. 2000 Oct;14(10):887–905. doi: 10.1080/026990500445718. [DOI] [PubMed] [Google Scholar]
  • 15.Diaz-Olavarrieta C, Cummings JL, Velazquez J, Garcia de la CC. Neuropsychiatric manifestations of multiple sclerosis. J Neuropsychiatry Clin Neurosci. 1999;11(1):51–57. doi: 10.1176/jnp.11.1.51. [DOI] [PubMed] [Google Scholar]
  • 16.Figved N, Klevan G, Myhr KM, Glad S, Nyland H, Larsen JP, et al. Neuropsychiatric symptoms in patients with multiple sclerosis. Acta Psychiatr Scand. 2005 Dec;112(6):463–468. doi: 10.1111/j.1600-0447.2005.00624.x. [DOI] [PubMed] [Google Scholar]
  • 17.Rubinsztein JS, Rubinsztein DC, Goodburn S, Holland AJ. Apathy and hypersomnia are common features of myotonic dystrophy. J Neurol Neurosurg Psychiatry. 1998 Apr;64(4):510–515. doi: 10.1136/jnnp.64.4.510. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Starkstein SE, Jorge R, Mizrahi R, Robinson RG. A prospective longitudinal study of apathy in Alzheimer’s disease. J Neurol Neurosurg Psychiatry. 2006 Jan;77(1):8–11. doi: 10.1136/jnnp.2005.069575. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Castellon SA, Hinkin CH, Wood S, Yarema KT. Apathy, depression, and cognitive performance in HIV-1 infection. J Neuropsychiatry Clin Neurosci. 1998;10(3):320–329. doi: 10.1176/jnp.10.3.320. [DOI] [PubMed] [Google Scholar]
  • 20.Lavretsky H, Lesser IM, Wohl M, Miller BL, Mehringer CM. Clinical and neuroradiologic features associated with chronicity in late-life depression. Am J Geriatr Psychiatry. 1999;7(4):309–316. [PubMed] [Google Scholar]
  • 21.Onyike CU, Sheppard JM, Tschanz JT, Norton MC, Green RC, Steinberg M, et al. Epidemiology of apathy in older adults: the Cache County Study. Am J Geriatr Psychiatry. 2007 May;15(5):365–375. doi: 10.1097/01.JGP.0000235689.42910.0d. [DOI] [PubMed] [Google Scholar]
  • 22.Turro-Garriga O, Lopez-Pousa S, Vilalta-Franch J, Turon-Estrada A, Pericot-Nierga I, Lozano-Gallego M, et al. [A longitudinal study of apathy in patients with Alzheimer's disease] Rev Neurol. 2009 Jan 1;48(1):7–13. [PubMed] [Google Scholar]
  • 23.Glodzik-Sobanska L, Slowik A, Kieltyka A, Kozub J, Sobiecka B, Urbanik A, et al. Reduced prefrontal N-acetylaspartate in stroke patients with apathy. J Neurol Sci. 2005 Nov 15;238(1–2):19–24. doi: 10.1016/j.jns.2005.06.004. [DOI] [PubMed] [Google Scholar]
  • 24.Rozzini L, Chilovi BV, Bertoletti E, Conti M, Delrio I, Trabucchi M, et al. Mild parkinsonian signs and psycho-behavioral symptoms in subjects with mild cognitive impairment. Int Psychogeriatr. 2008 Feb;20(1):86–95. doi: 10.1017/S1041610207006163. [DOI] [PubMed] [Google Scholar]
  • 25.Hama S, Yamashita H, Shigenobu M, Watanabe A, Kurisu K, Yamawaki S, et al. Post-stroke affective or apathetic depression and lesion location: left frontal lobe and bilateral basal ganglia. Eur Arch Psychiatry Clin Neurosci. 2007 Apr;257(3):149–152. doi: 10.1007/s00406-006-0698-7. [DOI] [PubMed] [Google Scholar]
  • 26.Hama S, Yamashita H, Shigenobu M, Watanabe A, Hiramoto K, Kurisu K, et al. Depression or apathy and functional recovery after stroke. Int J Geriatr Psychiatry. 2007 Oct;22(10):1046–1051. doi: 10.1002/gps.1866. [DOI] [PubMed] [Google Scholar]
  • 27.Landes AM, Sperry SD, Strauss ME. Prevalence of apathy, dysphoria, and depression in relation to dementia severity in Alzheimer's disease. J Neuropsychiatry Clin Neurosci. 2005;17(3):342–349. doi: 10.1176/jnp.17.3.342. [DOI] [PubMed] [Google Scholar]
  • 28.Tam CW, Lam LC, Lui VW, Chan WC, Chan SS, Chiu HF, et al. Clinical correlates of functional performance in community-dwelling Chinese older persons with mild cognitive impairment. Int Psychogeriatr. 2008 Oct;20(5):1059–1070. doi: 10.1017/S1041610208007345. [DOI] [PubMed] [Google Scholar]
  • 29.Freels S, Cohen D, Eisdorfer C, Paveza G, Gorelick P, Luchins DJ, et al. Functional status and clinical findings in patients with Alzheimer's disease. J Gerontol. 1992 Nov;47(6):M177–M182. doi: 10.1093/geronj/47.6.m177. [DOI] [PubMed] [Google Scholar]
  • 30.Lechowski L, Benoit M, Chassagne P, Vedel I, Tortrat D, Teillet L, et al. Persistent apathy in Alzheimer's disease as an independent factor of rapid functional decline: the REAL longitudinal cohort study. International Journal of Geriatric Psychiatry. 2008;24(4):341–346. doi: 10.1002/gps.2125. [DOI] [PubMed] [Google Scholar]
  • 31.de Vugt ME, Riedijk SR, Aalten P, Tibben A, Van Swieten JC, Verhey FR. Impact of behavioural problems on spousal caregivers: a comparison between Alzheimer's disease and frontotemporal dementia. Dement Geriatr Cogn Disord. 2006;22(1):35–41. doi: 10.1159/000093102. [DOI] [PubMed] [Google Scholar]
  • 32.Robert PH, Berr C, Volteau M, Bertogliati C, Benoit M, Mahieux F, et al. Neuropsychological performance in mild cognitive impairment with and without apathy. Dement Geriatr Cogn Disord. 2006;21(3):192–197. doi: 10.1159/000090766. [DOI] [PubMed] [Google Scholar]
  • 33.Robert PH, Clairet S, Benoit M, Koutaich J, Bertogliati C, Tible O, et al. The apathy inventory: assessment of apathy and awareness in Alzheimer's disease, Parkinson's disease and mild cognitive impairment. Int J Geriatr Psychiatry. 2002 Dec;17(12):1099–1105. doi: 10.1002/gps.755. [DOI] [PubMed] [Google Scholar]
  • 34.Aalten P, de Vugt ME, Jaspers N, Jolles J, Verhey FR. The course of neuropsychiatric symptoms in dementia. Part I: findings from the two-year longitudinal Maasbed study. Int J Geriatr Psychiatry. 2005 Jun;20(6):523–530. doi: 10.1002/gps.1316. [DOI] [PubMed] [Google Scholar]
  • 35.Duffy J. Apathy and Related Disroders of Diminished Motivation. In: C Coffey, T McAllister, J Silver., editors. Guide to Neuropsychiatric Therapeutics. Philadelphia. Philadelphia: Lippincott Williams & Wilkins; 2006. pp. 1–13. [Google Scholar]
  • 36.Marin RS, Fogel BS, Hawkins J, Duffy J, Krupp B. Apathy: a treatable syndrome. J Neuropsychiatry Clin Neurosci. 1995;7(1):23–30. doi: 10.1176/jnp.7.1.23. [DOI] [PubMed] [Google Scholar]
  • 37.Padala PR, Petty F, Bhatia SC. Methylphenidate may treat apathy independent of depression. Ann Pharmacother. 2005 Nov;39(11):1947–1949. doi: 10.1345/aph.1G352. [DOI] [PubMed] [Google Scholar]
  • 38.Roth RM, Flashman LA, McAllister TW. Apathy and its treatment. Curr Treat Options Neurol. 2007 Sep;9(5):363–370. [PubMed] [Google Scholar]
  • 39.Mega MS, Masterman DM, O'Connor SM, Barclay TR, Cummings JL. The spectrum of behavioral responses to cholinesterase inhibitor therapy in Alzheimer disease. Arch Neurol. 1999 Nov;56(11):1388–1393. doi: 10.1001/archneur.56.11.1388. [DOI] [PubMed] [Google Scholar]
  • 40.Rockwood K, Mintzer J, Truyen L, Wessel T, Wilkinson D. Effects of a flexible galantamine dose in Alzheimer’s disease: a randomised, controlled trial. J Neurol Neurosurg Psychiatry. 2001 Nov;71(5):589–595. doi: 10.1136/jnnp.71.5.589. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Bodkin JA, Siris SG, Bermanzohn PC, Hennen J, Cole JO. Double-blind, placebo-controlled, multicenter trial of selegiline augmentation of antipsychotic medication to treat negative symptoms in outpatients with schizophrenia. Am J Psychiatry. 2005 Feb;162(2):388–390. doi: 10.1176/appi.ajp.162.2.388. [DOI] [PubMed] [Google Scholar]
  • 42.Buchanan RW, Ball MP, Weiner E, Kirkpatrick B, Gold JM, McMahon RP, et al. Olanzapine treatment of residual positive and negative symptoms. Am J Psychiatry. 2005 Jan;162(1):124–129. doi: 10.1176/appi.ajp.162.1.124. [DOI] [PubMed] [Google Scholar]
  • 43.Politis AM, Vozzella S, Mayer LS, Onyike CU, Baker AS, Lyketsos CG. A randomized, controlled, clinical trial of activity therapy for apathy in patients with dementia residing in long-term care. Int J Geriatr Psychiatry. 2004 Nov;19(11):1087–1094. doi: 10.1002/gps.1215. [DOI] [PubMed] [Google Scholar]
  • 44.Raglio A, Bellelli G, Traficante D, Gianotti M, Ubezio MC, Villani D, et al. Efficacy of music therapy in the treatment of behavioral and psychiatric symptoms of dementia. Alzheimer Dis Assoc Disord. 2008 Nov;Apr;22(2):158–162. doi: 10.1097/WAD.0b013e3181630b6f. [DOI] [PubMed] [Google Scholar]
  • 45.Marin RS. Differential diagnosis and classification of apathy. Am J Psychiatry. 1990 Jan;147(1):22–30. doi: 10.1176/ajp.147.1.22. [DOI] [PubMed] [Google Scholar]
  • 46.Marin RS, Biedrzycki RC, Firinciogullari S. Reliability and validity of the Apathy Evaluation Scale. Psychiatry Res. 1991 Aug;38(2):143–162. doi: 10.1016/0165-1781(91)90040-v. [DOI] [PubMed] [Google Scholar]
  • 47.Marin RS. Apathy: a neuropsychiatric syndrome. J Neuropsychiatry Clin Neurosci. 1991;3(3):243–254. doi: 10.1176/jnp.3.3.243. [DOI] [PubMed] [Google Scholar]
  • 48.Stuss D, van Reekum R, Murphy K. Apathy states. In: J Borod., editor. Neuropsychology of Emotion. Oxford University Press; 2000. [Google Scholar]
  • 49.Havighurst RJ. Personality and patterns of aging. Gerontologist. 1968;8:20–23. doi: 10.1093/geront/8.1_part_2.20. [DOI] [PubMed] [Google Scholar]
  • 50.Brodaty H, Altendorf A, Withall A, Sachdev P. Do people become more apathetic as they grow older? A longitudinal study in healthy individuals. International Psychogeriatrics. 2009:1–11. doi: 10.1017/S1041610209991335. First View. [DOI] [PubMed] [Google Scholar]
  • 51.Marin RS, Firinciogullari S, Biedrzycki RC. The sources of convergence between measures of apathy and depression. J Affect Disord. 1993 Jun;28(2):117–124. doi: 10.1016/0165-0327(93)90040-q. [DOI] [PubMed] [Google Scholar]
  • 52.Robert P, Onyike CU, Leentjens AF, Dujardin K, Aalten P, Starkstein S, et al. Proposed diagnostic criteria for apathy in Alzheimer's disease and other neuropsychiatric disorders. Eur Psychiatry. 2009 Mar;24(2):98–104. doi: 10.1016/j.eurpsy.2008.09.001. [DOI] [PubMed] [Google Scholar]
  • 53.Starkstein SE, Mayberg HS, Preziosi TJ, Andrezejewski P, Leiguarda R, Robinson RG. Reliability, validity, and clinical correlates of apathy in Parkinson's disease. J Neuropsychiatry Clin Neurosci. 1992;4(2):134–139. doi: 10.1176/jnp.4.2.134. [DOI] [PubMed] [Google Scholar]
  • 54.Lloyd S, Streiner D, Shannon S. Predictive validity of the emergency physician and global job satisfaction instruments. Acad Emerg Med. 1998 Mar;5(3):234–241. doi: 10.1111/j.1553-2712.1998.tb02619.x. [DOI] [PubMed] [Google Scholar]
  • 55.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977 Mar;33(1):159–174. [PubMed] [Google Scholar]
  • 56.Clarke DE, van Reekum R, Patel J, Simard M, Gomez E, Streiner DL. An appraisal of the psychometric properties of the Clinician version of the Apathy Evaluation Scale (AES-C) Int J Methods Psychiatr Res. 2007;16(2):97–110. doi: 10.1002/mpr.207. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Clarke DE, van Reekum R, Simard M, Streiner DL, Freedman M, Conn D. Apathy in dementia: an examination of the psychometric properties of the apathy evaluation scale. J europsychiatry Clin Neurosci. 2007;19(1):57–64. doi: 10.1176/jnp.2007.19.1.57. [DOI] [PubMed] [Google Scholar]
  • 58.Faerden A, Nesvag R, Barrett EA, Agartz I, Finset A, Friis S, et al. Assessing apathy: the use of the Apathy Evaluation Scale in first episode psychosis. Eur Psychiatry. 2008 Jan;23(1):33–39. doi: 10.1016/j.eurpsy.2007.09.002. [DOI] [PubMed] [Google Scholar]
  • 59.Sockeel P, Dujardin K, Devos D, Deneve C, Destee A, Defebvre L. The Lille apathy rating scale (LARS), a new instrument for detecting and quantifying apathy: validation in Parkinson's disease. J Neurol Neurosurg Psychiatry. 2006 May;77(5):579–584. doi: 10.1136/jnnp.2005.075929. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Dujardin K, Sockeel P, Delliaux M, Destee A, Defebvre L. The Lille Apathy Rating Scale: validation of a caregiver-based version. Mov Disord. 2008 Apr 30;23(6):845–849. doi: 10.1002/mds.21968. [DOI] [PubMed] [Google Scholar]
  • 61.Resnick B, Zimmerman SI, Magaziner J, Adelman A. Use of the Apathy Evaluation Scale as a measure of motivation in elderly people. Rehabil Nurs. 1998 May;23(3):141–147. doi: 10.1002/j.2048-7940.1998.tb01766.x. [DOI] [PubMed] [Google Scholar]
  • 62.Lueken U, Seidl U, Volker L, Schweiger E, Kruse A, Schroder J. Development of a short version of the Apathy Evaluation Scale specifically adapted for demented nursing home residents. Am J Geriatr Psychiatry. 2007 May;15(5):376–385. doi: 10.1097/JGP.0b013e3180437db3. [DOI] [PubMed] [Google Scholar]
  • 63.Strauss ME, Sperry SD. An informant-based assessment of apathy in Alzheimer disease. Neuropsychiatry Neuropsychol Behav Neurol. 2002 Sep;15(3):176–183. [PubMed] [Google Scholar]
  • 64.Overall JE, Gorham DR. The Brief Psychiatric Rating Scale. Psychological Reports. 1962;10:790–812. [Google Scholar]
  • 65.Hedlund JL, Vieweg BW. The Brief Psychiatric Rating Scale (BPRS): a comprehensive review. Journal of Operational Psychiatry. 1980;11:48–65. [Google Scholar]
  • 66.Andersen J, Larsen JK, Korner A, Nielsen BM, Schultz V, Behnke K, et al. The brief psychiatric rating scale:schizophrenia, reliability and validity studies. Nordic Journal of Psychiatry. 1986;40:135–138. Ref Type: Generic. [Google Scholar]
  • 67.Overall JE, Beller SA. The Brief Psychiatric Rating Scale (BPRS) in geropsychiatric research: I. Factor structure on an inpatient unit. J Gerontol. 1984 Mar;39(2):187–193. doi: 10.1093/geronj/39.2.187. [DOI] [PubMed] [Google Scholar]
  • 68.Bell M, Milstein R, Beam-Goulet J, Lysaker P, Cicchetti D. The Positive and Negative Syndrome Scale and the Brief Psychiatric Rating Scale. Reliability, comparability, and predictive validity. J Nerv Ment Dis. 1992 Nov;180(11):723–728. doi: 10.1097/00005053-199211000-00007. [DOI] [PubMed] [Google Scholar]
  • 69.Ligon J, Thyer BA. Interrater reliability of the Brief Psychiatric Rating Scale used at a community-based inpatient crisis stabilization unit. J Clin Psychol. 2000 Apr;56(4):583–587. doi: 10.1002/(sici)1097-4679(200004)56:4<583::aid-jclp12>3.0.co;2-u. [DOI] [PubMed] [Google Scholar]
  • 70.Andreasen NC. Negative symptoms in schizophrenia. Definition and reliability. Arch Gen Psychiatry. 1982 Jul;39(7):784–788. doi: 10.1001/archpsyc.1982.04290070020005. [DOI] [PubMed] [Google Scholar]
  • 71.McAdams LA, Harris MJ, Heaton SC, Bailey A, Fell R, Jeste DV. Validity of specific subscales of the positive and negative symptom scales in older schizophrenia outpatients. Schizophr Res. 1997 Oct 30;27(2–3):219–226. doi: 10.1016/S0920-9964(97)00066-2. [DOI] [PubMed] [Google Scholar]
  • 72.Kay SR, Opler LA, Lindenmayer JP. Reliability and validity of the positive and negative syndrome scale for schizophrenics. Psychiatry Res. 1988 Jan;23(1):99–110. doi: 10.1016/0165-1781(88)90038-8. [DOI] [PubMed] [Google Scholar]
  • 73.Kay SR, Opler LA, Lindenmayer JP. The Positive and Negative Syndrome Scale (PANSS): rationale and standardisation. Br J Psychiatry Suppl. 1989 Nov;(7):59–67. [PubMed] [Google Scholar]
  • 74.Singh MM, Kay SR. comparative study of haloperidol and chlorpromazine in terms of clinical effects and therapeutic reversal with benztropine in schizophrenia. Theoretical implications for potency differences among neuroleptics. Psychopharmacologia. 1975 Aug 21;43(2):103–113. doi: 10.1007/BF00421012. [DOI] [PubMed] [Google Scholar]
  • 75.Kay SR, Fiszbein A, Lindenmayer JP, Opler LA. Positive and negative syndromes in schizophrenia as a function of chronicity. Acta Psychiatr Scand. 1986 Nov;74(5):507–518. doi: 10.1111/j.1600-0447.1986.tb06276.x. [DOI] [PubMed] [Google Scholar]
  • 76.Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull. 1987;13(2):261–276. doi: 10.1093/schbul/13.2.261. [DOI] [PubMed] [Google Scholar]
  • 77.Hatton C, Haddock G, Taylor JL, Coldwell J, Crossley R, Peckham N. The reliability and validity of general psychotic rating scales with people with mild and moderate intellectual disabilities: an empirical investigation. J Intellect Disabil Res. 2005 Jul;49(Pt 7):490–500. doi: 10.1111/j.1365-2788.2005.00696.x. [DOI] [PubMed] [Google Scholar]
  • 78.Kay SR, Fiszbein A, Vital-Herne M, Fuentes LS. The Positive and Negative Syndrome Scale--Spanish adaptation. J Nerv Ment Dis. 1990 Aug;178(8):510–517. [PubMed] [Google Scholar]
  • 79.Starkstein SE, Merello M. The Unified Parkinson's Disease Rating Scale: validation study of the mentation, behavior, and mood section. Mov Disord. 2007 Nov 15;22(15):2156–2161. doi: 10.1002/mds.21521. [DOI] [PubMed] [Google Scholar]
  • 80.Pedersen KF, Larsen JP, Aarsland D. Validation of the Unified Parkinson’s Disease Rating Scale (UPDRS) section I as a screening and diagnostic instrument for apathy in patients with Parkinson's disease. Parkinsonism Relat Disord. 2008;14(3):183–186. doi: 10.1016/j.parkreldis.2007.07.015. [DOI] [PubMed] [Google Scholar]
  • 81.Burns A, Folstein S, Brandt J, Folstein M. Clinical assessment of irritability, aggression, and apathy in Huntington and Alzheimer disease. J Nerv Ment Dis. 1990 Jan;178(1):20–26. doi: 10.1097/00005053-199001000-00004. [DOI] [PubMed] [Google Scholar]
  • 82.Nunnally J. Psychometric theory. New York: McGraw-Hill; 1978. [Google Scholar]
  • 83.Grace J, Stout JC, Malloy PF. Assessing frontal lobe behavioral syndromes with the frontal lobe personality scale. Assessment. 1999 Sep;6(3):269–284. doi: 10.1177/107319119900600307. [DOI] [PubMed] [Google Scholar]
  • 84.Grace J, Malloy PF. Frontal Systems Behavior Scale (FrSBe): Professional Manual. Psychological Assessment Resources. 2001 [Google Scholar]
  • 85.Stout JC, Ready RE, Grace J, Malloy PF, Paulsen JS. Factor analysis of the frontal systems behavior scale (FrSBe) Assessment. 2003 Mar;10(1):79–85. doi: 10.1177/1073191102250339. [DOI] [PubMed] [Google Scholar]
  • 86.Velligan DI, Ritch JL, Sui D, DiCocco M, Huntzinger CD. Frontal Systems Behavior Scale in schizophrenia: relationships with psychiatric symptomatology, cognition and adaptive function. Psychiatry Res. 2002 Dec 30;113(3):227–236. doi: 10.1016/s0165-1781(02)00264-0. [DOI] [PubMed] [Google Scholar]
  • 87.Norton LE, Malloy PF, Salloway S. The impact of behavioral symptoms on activities of daily living in patients with dementia. Am J Geriatr Psychiatry. 2001;9(1):41–48. [PubMed] [Google Scholar]
  • 88.Ready RE, Ott BR, Grace J, Cahn-Weiner DA. Apathy and executive dysfunction in mild cognitive impairment and Alzheimer disease. Am J Geriatr Psychiatry. 2003 Mar;11(2):222–228. [PubMed] [Google Scholar]
  • 89.Cahn-Weiner DA, Grace J, Ott BR, Fernandez HH, Friedman JH. Cognitive and behavioral features discriminate between Alzheimer's and Parkinson’s disease. Neuropsychiatry Neuropsychol Behav Neurol. 2002 Jun;15(2):79–87. [PubMed] [Google Scholar]
  • 90.Kolitz BP, Vanderploeg RD, Curtiss G. Development of the Key Behaviors Change Inventory: a traumatic brain injury behavioral outcome assessment instrument. Arch Phys Med Rehabil. 2003 Feb;84(2):277–284. doi: 10.1053/apmr.2003.50100. [DOI] [PubMed] [Google Scholar]
  • 91.Belanger HG, Brown LM, Crowell TA, Vanderploeg RD, Curtiss G. The Key Behaviors Change Inventory and executive functioning in an elderly clinic sample. Clin Neuropsychol. 2002 Aug;16(3):251–257. doi: 10.1076/clin.16.3.251.13848. [DOI] [PubMed] [Google Scholar]
  • 92.Cummings JL, Mega M, Gray K, Rosenberg-Thompson S, Carusi DA, Gornbein J. The Neuropsychiatric Inventory: comprehensive assessment of psychopathology in dementia. Neurology. 1994 Dec;44(12):2308–2314. doi: 10.1212/wnl.44.12.2308. [DOI] [PubMed] [Google Scholar]
  • 93.Cummings JL. The Neuropsychiatric Inventory: assessing psychopathology in dementia patients. Neurology. 1997 May;48(5 Suppl 6):S10–S16. doi: 10.1212/wnl.48.5_suppl_6.10s. [DOI] [PubMed] [Google Scholar]
  • 94.Choi SH, Na DL, Kwon HM, Yoon SJ, Jeong JH, Ha CK. The Korean version of the neuropsychiatric inventory: a scoring tool for neuropsychiatric disturbance in dementia patients. J Korean Med Sci. 2000 Dec;15(6):609–615. doi: 10.3346/jkms.2000.15.6.609. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Politis AM, Mayer LS, Passa M, Maillis A, Lyketsos CG. Validity and reliability of the newly translated Hellenic Neuropsychiatric Inventory (H-NPI) applied to Greek outpatients with Alzheimer's disease: a study of disturbing behaviors among referrals to a memory clinic. Int J Geriatr Psychiatry. 2004 Mar;19(3):203–208. doi: 10.1002/gps.1045. [DOI] [PubMed] [Google Scholar]
  • 96.Zuidema SU, de Jonghe JF, Verhey FR, Koopmans RT. Neuropsychiatric symptoms in nursing home patients: factor structure invariance of the Dutch nursing home version of the neuropsychiatric inventory in different stages of dementia. Dement Geriatr Cogn Disord. 2007;24(3):169–176. doi: 10.1159/000105603. [DOI] [PubMed] [Google Scholar]
  • 97.Kaufer DI, Cummings JL, Ketchel P, Smith V, MacMillan A, Shelley T, et al. Validation of the NPI-Q, a brief clinical form of the Neuropsychiatric Inventory. J Neuropsychiatry Clin Neurosci. 2000;12(2):233–239. doi: 10.1176/jnp.12.2.233. [DOI] [PubMed] [Google Scholar]
  • 98.Iverson GL, Hopp GA, DeWolfe K, Solomons K. Measuring change in psychiatric symptoms using the Neuropsychiatric Inventory: Nursing Home version. Int J Geriatr Psychiatry. 2002 May;17(5):438–443. doi: 10.1002/gps.617. [DOI] [PubMed] [Google Scholar]
  • 99.Camozzato AL, Kochhann R, Simeoni C, Konrath CA, Pedro FA, Carvalho A, et al. Reliability of the Brazilian Portuguese version of the Neuropsychiatric Inventory (NPI) for patients with Alzheimer’s disease and their caregivers. Int Psychogeriatr. 2008 Apr;20(2):383–393. doi: 10.1017/S1041610207006254. [DOI] [PubMed] [Google Scholar]
  • 100.Leung VP, Lam LC, Chiu HF, Cummings JL, Chen QL. Validation study of the Chinese version of the neuropsychiatric inventory (CNPI) Int J Geriatr Psychiatry. 2001 Aug;16(8):789–793. doi: 10.1002/gps.427. [DOI] [PubMed] [Google Scholar]

RESOURCES