Skip to main content
Journal of Patient-Reported Outcomes logoLink to Journal of Patient-Reported Outcomes
. 2020 Apr 23;4:26. doi: 10.1186/s41687-020-00189-7

What are the optimal measures to identify anxiety and depression in people diagnosed with head and neck cancer (HNC): a systematic review

Chindhu Shunmugasundaram 1,2, Claudia Rutherford 3,4, Phyllis N Butow 1,2, Puma Sundaresan 5,6, Haryana M Dhillon 1,2,
PMCID: PMC7181465  PMID: 32328839

Abstract

Background

A cancer diagnosis is potentially life-threatening, likely causing distress and uncertainty, which may be psychologically debilitating. Depression and anxiety are commonly underdiagnosed and undertreated in cancer patients. Head and neck cancer (HNC) patients face particular challenges that may contribute to distress. This review aims to: i) identify patient reported outcome measures (PROMs) designed to assess anxiety and depression in HNC; and ii) determine their suitability for use in research and clinical practice to screen patients.

Methods

We searched five electronic databases between July 2007 to July 2019 for studies assessing anxiety and depression in HNC patients. Searches were limited to this period to account for advances in cancer treatment. Records were screened for eligibility by one reviewer and 10% cross-checked by a second across all stages of the review. In addition to the electronic searches, PROM databases were searched for additional measures of anxiety and depression. All retrieved PROMs were mapped against Diagnostic and Statistical Manual-5 criteria for anxiety and depression to assess content coverage. Then, their psychometric properties appraised against the COSMIN checklist.

Results

Electronic searches identified 98 records, from which five anxiety and eight depression measures were retrieved. PROM database searches retrieved an additional four anxiety and four depression measures; a total of nine anxiety and 12 depression measures were appraised. Content coverage of anxiety measures ranged from 50% to 75% and depression measures from 42% to 100%. Demonstration of psychometric properties against COSMIN criteria ranged from 57% to 71% for anxiety measures (three PROMs > 70%) and from 29% to 86% for depression measures (nine PROMs > 70%). Three anxiety and seven depression measures had established clinical cut-offs in cancer populations.

Conclusions

The Patient Health Questionnaire-9, Zung Self-rating Depression and Zung Self-rating Anxiety Scales demonstrated good content coverage along with excellent psychometric properties, and thus were considered the most suitable PROMs to assess psychological distress in HNC populations. It is important to have PROMs assessing psychological distress that capture a comprehensive set of subjective symptoms. The identified PROMs will help researchers and health professionals in clinical-decision making, thereby potentially improving quality of life in HNC patients.

Keywords: Anxiety, Depression, Psychological distress, Head and neck cancer, Systematic review, Patient reported outcome measures

Background

Diagnosis of any life-threatening illness can result in multiple emotional and psychological reactions. A cancer diagnosis can evoke existential distress, and necessitate an acceptance of uncertainty. Of all people with cancer, those diagnosed with head and neck cancer (HNC) experience high rates of depression and anxiety during and after treatment [1, 2], due to the location of the cancer and its impact on appearance and critical functions. HNCs affect body parts visible to the outside world and are responsible for the most fundamental, life sustaining functions such as speech, eating, swallowing and breathing. The physical effects of these cancers may result in social withdrawal and poor emotional expression rendering HNC patients more prone to depression or anxiety than those with other cancers [38].

Depression and anxiety in people with cancer are commonly underdiagnosed and undertreated despite health professionals knowing the prevalence [9]. Psychological morbidity could impact patients’ Health Related Quality of Life (HRQoL), limit their social activities, increase their hospital stay, delay their return to work, and influence their ability to care for themselves [10, 11]. Indeed, one consistent factor impacting HRQoL is clinical depression [12, 13]. If severe, depression can diminish cancer patients’ decision making capacity related to their treatment, resulting in reduced acceptance of adjuvant therapies and more unplanned breaks in treatment, compromising survival [14]. Studies have also shown that depressed cancer patients are more likely to have disease recurrence and poorer survival [15], making it critically important to recognise and treat depression when it occurs.

Screening for and diagnosing anxiety and depression have been priorities for the psycho-oncology community for at least a decade, with calls for distress to be promoted as the sixth vital sign [16]. In addition to screening, assessing diagnostic criteria are critically important. The main diagnostic criteria of depression, according to DSM-5 are disturbed sleep and appetite, fatigue, depressed mood, agitation, difficulty concentrating, self-esteem issues and suicidal thoughts [17]. While the main diagnostic criteria of clinical anxiety are: constant worry, restlessness, panic, worry, nervousness, disturbing thoughts, poor concentration, irritability, fatigue or loss of energy, muscle tension and sleep disturbances [17].

Prevalence rates of clinical levels of depression and anxiety vary by cancer type, its severity, and impact of treatment on structural and functional deficits [18, 19]. Apart from cancer and its treatment, other factors including personality traits, coping skills, pain, prognosis, substance usage or dependence, body image disturbance, previous history of psychiatric illness and social support may be related to depression in patients with HNC [10]. The most common factors triggering anxiety during and after HNC treatment are fear of cancer recurrence, reduced communication abilities, dysphagia, changes in appearance, and adapting to dysfunction [20]. A study of surgically treated HNC patients described high levels of anxiety and depression with dominating anxiety symptoms when assessed using the Hospital Anxiety and Depression scale [21]. Studies report a prevalence of 25–33% for anxiety and depression in HNC populations post-treatment [22, 23].

There is strong evidence that psychosocial interventions improve psychological outcomes in cancer patients with varying cancer diagnoses. However, to effectively improve outcomes, interventions must be tailored to the target populations. To design tailored interventions and evaluate them, appropriate measures are necessary. Patient reported outcome measures (PROMs) assessing anxiety and depression in HNC patients should have items that are sensible, appropriate and relevant to that population. However, while a number of reviews have collated and summarised measures of anxiety and depression in cancer settings, none has considered their use with HNC patients and survivors. Hence, we conducted a systematic review of anxiety and depression PROMs in HNC.

Our specific aims were to:

1. Identify available PROMs assessing anxiety and depression in the HNC setting;

2. Map items against anxiety and depression criteria adapted from DSM-5 to assess conceptual coverage;

3. Appraise their psychometric properties to determine clinically robust and disease-specific PROMs able to screen for and detect anxiety and depression in HNC populations.

Methods

This study was part of a larger systematic review registered under ID CRD42018080677 with PROSPERO. A search was carried out using five online databases - CINAHL, Medline, EMBASE, Web of Science and PsycInfo - to locate all studies relevant to the aims of this review. The search strategy included a broad set of terms for ‘anxiety’, ‘depression, and ‘head and neck cancer’ developed by the authors for Medline and PsycInfo (via Ovid) and adapted for other databases (see Additional file 1 for search strategy developed for Medline and PsycInfo via Ovid). Searches were limited to studies reported between July 2007 to January 2020 (current) to reflect treatment advances in that decade. Language restrictions were applied, and only studies published in English were screened. To supplement electronic searches, we searched online PROM databases (PROQOLID, Psycho-oncology database (POD) and Grid-enabled Measures Database (GEM)) for additional measures of anxiety and depression.

Study selection

Titles and abstracts from retrieved studies were screened against the following inclusion and exclusion criteria by one reviewer (CS).

Inclusion criteria:

  • i.

    Papers including at least one PROM assessing either anxiety, depression, or both.

  • ii.

    Sample included patients or survivors of any type of HNC (oral cavity, hypopharyngeal, oropharyngeal, laryngeal, nasal and sinus gland, salivary gland and nasopharyngeal) except thyroid, either as sole or mixed tumour groups (where HNC was included as a sub-group with results reported separately), aged 18 years or older.

  • iii.

    Responses obtained directly from HNC patients about their anxiety and depression (screening, extent, or severity)

  • iv.

    Primary research

We excluded systematic reviews, conference abstracts, letters to the editor, discussion papers, notes, case studies and conference proceedings, and non-English papers. A second reviewer (HD) screened 10% of all titles, abstracts and full text of articles. Measures from online PROM databases were included if they assessed either anxiety, depression or both in cancer patients and reports of their development and validation were available.

Extraction

Study title, aims, rationale, PROM(s) used, sample demographics and characteristics, study design, methods, results, limitations and conclusions were extracted by one reviewer. A second reviewer extracted 10% of all full texts and reviewed all extractions for errors and accuracy.

Analysis

The analysis consisted of two phases – content mapping and appraisal of psychometric properties of identified PROMs. Items from identified PROMs were mapped to DSM-5 criteria for depression and anxiety, as DSM-5 is a widely used and recognised authoritative guide containing descriptions, symptoms and criteria for diagnosing mental disorders such as depression and anxiety. DSM-5 is an evidence-based manual developed from scientific research and collective knowledge of clinicians and experts in medical and mental health disciplines [17]..

Mapping was done by three reviewers (CS, HD and PB) to ensure accuracy of content mapping and to assess the extent of content coverage. A few minor disagreements were resolved through group discussion until consensus was achieved. Percentage of content coverage was calculated for all PROMs to determine their relevance to anxiety and depression.

All PROMs’ psychometric properties were assessed against the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist [24] including: item generation, item reduction, validity, reliability, hypothesis testing, responsiveness, clinical cut-off and clinical cut-off for cancer populations.

Results

A total of 2703 articles were retrieved from electronic searches. After screening for duplicates and eligibility, 107 studies were retained. A total of five anxiety and eight depression measures were identified across these studies. Online PROM database searches identified an additional 140 anxiety and 114 depression measures. After screening against our eligibility criteria, 15 anxiety and 20 depression measures were retained. In total, from included studies and online PROMs databases, a total of nine anxiety and 12 depression measures were retained for further analysis (Fig. 1 details the PRISMA flow diagram).

Fig. 1.

Fig. 1

Prisma flow diagram describing unmet needs measures search

All PROMs other than QIDS-SR, MASQ, Duke-AD, MDI and CDS had been tested for relevance to patients with cancer [2539]. Ten of the 21 PROMs identified had established clinical cut off scores for anxiety and/or depression in cancer populations. Content mapping of each anxiety and depression PROM are summarized below and presented in Tables 1 and 2 respectively. Appraisals of their development and psychometric validation characteristics are summarized below and presented in Tables 3 and 4 respectively.

Table 1.

Patient reported outcome measures of anxiety: content mapping

Anxiety (adapted from DSM-5) HADS STAI SAS BAI MASQ DASS 21 Duke-AD BSI-18 GAD-7
Restlessness
Fatigue
Concentration
Irritability
Muscle tension
Sleep disturbances
Disturbing thoughts
Worry
Number domains covered 4 6 6 4 4 5 5 4 5

- Present

HADS Hospital anxiety and depression scale; STAI State trait anxiety inventory, SAS Zung self-rating anxiety scale, BAI Beck Anxiety inventory, MASQ Mood and anxiety symptom questionnaire, DASS 21 Depression anxiety stress scale −21, Duke-AD Duke anxiety depression scale, BSI-18 Brief symptom inventory − 18, GAD-7 Generalized anxiety disorder – 7

Table 2.

Patient reported outcome measures of depression: content mapping

Depression (adapted from DSM-5) HADS QIDS-SR SDS BDI CES-D PHQ-9 GDS-SF BSI-18 Duke-AD MDI CDS DASS 21
Depressed mood
Lowered interest or pleasure in all
Change in weight
Change in sleep
Psychomotor agitation/restlessness
Fatigue/Loss of energy
Feelings of worthlessness or guilt
Indecisiveness/diminished ability to think
Suicidal ideation
Concentration
Low self-esteem
Number domains covered 5 11 10 9 7 9 9 7 5 9 11 5

- Present

HADS Hospital anxiety and depression scale, QIDS-SR Quick inventory of Depressive Symptomatology self-report, SDS Zung self-rating depression scale, BDI Beck Depression inventory, CES-D Center for Epidemiologic Studies Depression Scale, PHQ-9 Patient Health Questionnaire −9, GDS-SF Geriatric Depression Scale – Short form, BSI-18 Brief symptom inventory − 18, Duke-AD Duke anxiety depression scale, MDI Major depression inventory, CDS Carroll Rating Scale for Depression, DASS 21 Depression anxiety stress scale − 21

Table 3.

Patient reported outcome measures of anxiety: measurement properties

Methoda HADS STAI SAS BAI MASQ DASS 21 Duke-AD BSI-18 GAD-7
Item generation Literature
Patient/person interviews
Clinician interviews/Expert opinion
Item reduction Missing data for summary scores
Missing item data
Factor Analysis
Psychometric analyses Cronbach’s α
Test-retest reliability
Content validity
Item total correlations
Convergent/discriminant (or divergent) validity
Hypothesis testing
Translated into other languages
Cut off points Responsiveness
Clinical cut-off
Clinical cut-off for cancer

HADS Hospital anxiety and depression scale, STAI State trait anxiety inventory, SAS Zung self-rating anxiety scale, BAI Beck Anxiety inventory, MASQ Mood and anxiety symptom questionnaire, DASS 21 Depression anxiety stress scale −21, Duke-AD Duke anxiety depression scale, BSI-18 Brief symptom inventory − 18, GAD-7 Generalized anxiety disorder – 7

aCriteria based on the COSMIN checklist; ✓ - Present

Table 4.

Patient reported outcome measures of depression: measurement properties

Methoda HADS QIDS-SR SDS BDI CES-D PHQ-9 GDS-SF BSI-18 DUKE-AD MDI CDS DASS 21
Item generation Literature
Patient/person interviews
Clinician interviews/Expert opinion
Item reduction Missing data for summary scores
Missing item data
Factor Analysis
Psychometric analyses Cronbach’s α
Test-retest reliability
Content validity
Item total correlations ✓ ✓
Convergent/discriminant (or divergent) validity
Hypothesis testing
Translated into other languages
Cut off points Responsiveness
Clinical cut-off
Clinical cut-off for cancer

HADS Hospital anxiety and depression scale, QIDS-SR Quick inventory of Depressive Symptomatology self-report, SDS Zung self-rating depression scale, BDI Beck Depression inventory, CES-D Center for Epidemiologic Studies Depression Scale, PHQ-9 Patient Health Questionnaire −9, GDS-SF Geriatric Depression Scale – Short form, BSI-18 Brief symptom inventory −18, Duke-AD Duke anxiety depression scale, MDI Major depression inventory, CDS Carroll Rating Scale for Depression, DASS 21 Depression anxiety stress scale −21

aCriteria based on the COSMIN checklist; ✓ - Present

More data on which PROMs had been used in HNC settings, the reasons for exclusion and final selection are presented in Table 5.

Table 5.

PROMs used in HNC studies, reasons for inclusion and exclusion

PROMs Used in HNC studies? Reason for exclusion Reason for selection
Anxiety PROMs
 HADS Average content coverage
 STAI Failed to differentiate participants with or without anxiety disorders
 SAS Excellent content coverage and good psychometrics
 BAI Average content coverage
 MASQ No Average content coverage
 DASS 21 Average content coverage
 Duke-AD No Average content coverage
 BSI-18 Average content coverage
 GAD-7 Average content coverage
Depression PROMs
 HADS Poor content coverage
 QIDS-SR No clinical cut-off for cancer patients
 SDS Excellent content coverage and psychometrics
 BDI Items on body image and hypochondriasis which could confound with effects from treatment
 CES-D Average content coverage
 PHQ-9 Excellent content coverage and psychometrics
 GDS-SF No clinical cut-off for cancer patients
 BSI-18 Average content coverage
 Duke-AD No Poor content coverage
 MDI No No clinical cut-off for cancer patients
 CDS No Poor psychometrics
 DASS 21 Poor content coverage

- Yes

HADS Hospital anxiety and depression scale, STAI State trait anxiety inventory, SAS Zung self-rating anxiety scale, BAI Beck Anxiety inventory, MASQ Mood and anxiety symptom questionnaire, DASS 21 Depression anxiety stress scale −21, Duke-AD Duke anxiety depression scale, BSI-18 Brief symptom inventory −18, GAD-7 Generalized anxiety disorder – 7

QIDS-SR Quick inventory of Depressive Symptomatology self-report, SDS Zung self-rating depression scale, BDI Beck Depression inventory, CES-D Center for Epidemiologic Studies Depression Scale, PHQ-9 Patient Health Questionnaire −9, GDS-SF Geriatric Depression Scale – Short form, MDI Major depression inventory; CDS Carroll Rating Scale for Depression

Anxiety

Of the nine anxiety measures, five demonstrated average content coverage when mapped against DSM-5 criteria for anxiety (Table 1) and five demonstrated adequate psychometric properties (Table 3). All nine anxiety measures identified are discussed below to provide sufficient information to enable each measure to be considered by readers.

Hospital anxiety and depression scale (HADS)

The HADS is a 14-item self-report measure with seven items measuring anxiety [40, 41]. It has been specifically designed for use in the in-patient setting with people who are physically ill, thus it excludes symptoms of anxiety and/or depression that may reasonably be thought associated with being physically unwell. Cronbach’s alpha for HADS was 0.83 [41, 42]. HADS has established clinical cut-off scores for general patients with clinical anxiety and cancer patients [43], making it easier for administration, scoring and diagnosis. When mapped against DSM-5 criteria for anxiety, HADS covered only 50% of content relevant to anxiety and was missing items assessing fatigue, concentration, irritability, and sleep disturbances.

State trait anxiety inventory (STAI)

The STAI is a 40-item self-report anxiety measure with 20 items measuring state anxiety and 20 items measuring trait anxiety [44]. STAI assesses the intensity of a person’s anxious feelings and has demonstrated a Cronbach’s alpha of 0.89 [4446]. Cut-off points for each of the following populations have been established: general patients with clinical anxiety, a psychiatric sample, chronically ill patients, and patients before and after surgery (not restricting to any illness) [4648]. When mapped against DSM-5 criteria for anxiety, STAI covered 75% of content, failing to include items examining fatigue and sleep disturbances.

Zung self-rating anxiety scale (SAS)

Zung Self-Rating Anxiety Scale is a self-rated measure with 20 items [49]. It assesses affective and somatic symptoms of anxiety making it a measurement of anxiety as a clinical entity. SAS has a Cronbach’s alpha of 0.82 [4951]. Cut-off points for anxiety in non-clinical populations and those with a clinical diagnosis have been established [52]. When mapped against DSM-5 criteria for anxiety, SAS covered 75% content but did not contain items examining concentration and irritability.

Beck’s anxiety inventory (BAI)

Beck’s Anxiety Inventory is a 21-item self-rating symptom measure to detect the severity of anxiety in a population with psychiatric problems [53]. A Cronbach’s alpha of 0.92 demonstrated internal consistency [53, 54]. Cut-off points to detect clinical anxiety have been established but no literature supports clinical cut-off points for anxiety in cancer patients or chronically ill patients [55]. When mapped against DSM-5 criteria for anxiety, BAI had 50% content coverage, missing items examining sleep disturbance, irritability, concentration and fatigue.

Mood and anxiety symptom questionnaire (MASQ)

Mood and Anxiety Symptom Questionnaire is a 90-item self-report measure developed to assess depression and anxiety symptoms ([56, 57]; Watson D, Clark LA: The mood and anxiety symptom questionnaire, Unpublished). The Cronbach’s alpha of MASQ ranged from 0.78 to 0.93 ([58]; Watson D, Clark LA: The mood and anxiety symptom questionnaire, Unpublished). Clinical cut-off points have been established for non-clinical samples but not for cancer populations [58]. When mapped against DSM-5 criteria for anxiety, MASQ had only 50% content coverage, missing items examining sleep disturbance, irritability, concentration and fatigue.

Depression anxiety stress scale 21 (DASS 21)

DASS 21 is a 21-item self-report measure assessing the intensity of negative emotional states such as depression, anxiety and stress [35]. A Cronbach’s alpha of 0.84 for the anxiety construct was achieved, indicating good internal consistency [35, 59, 60]. In DASS-21, cut-off points for clinical patients, cancer patients, and non-clinical populations have been established separately [61]. When mapped against DSM-5 criteria for anxiety, DASS-21 covered 63% of content, missing items assessing irritability, sleep disturbances and muscle tension.

Duke anxiety depression scale (Duke-AD)

Duke AD is a seven-item self-report measure used to assess anxiety and depression [62]. Duke AD’s Cronbach’s alpha is 0.69 [63]. Cut-off points for primary care patients and non-clinical subjects have been established [62, 63]. When mapped against DSM-5 criteria for anxiety, Duke-AD covered 63% of content, missing items assessing muscle tension, disturbing thoughts and worry.

Brief symptom inventory – 18 (BSI-18)

Brief Symptom Inventory is an 18-item self-report measure used to measure the psychological distress of psychiatric and medical patients and of non-clinical samples [64]. Cronbach’s alpha of all domains in BSI-18 ranged from 0.71 to 0.85 [65]. Cut-off points for clinical patients, mixed cancer groups, survivors, palliative patients and healthy populations have been separately established [64, 65]. When mapped against DSM-5 criteria for anxiety, BSI-18 covered 50% content, missing items measuring fatigue, concentration, irritability and sleep disturbance.

Generalized anxiety disorder – 7 (GAD – 7)

GAD-7 is a seven-item self-report measure used to assess generalized anxiety disorder and to measure the extent of symptom severity [66]. Cronbach’s alpha of GAD-7 has been demonstrated as 0.92 [66]. Cut-off points have been established for patients with clinical anxiety or generalized anxiety disorder and non-clinical populations [66, 67]. When mapped against DSM-5 criteria for anxiety, GAD-7 had 63% content coverage, missing items assessing fatigue, concentration and muscle tension.

Depression

Of the 12 depression measures, seven demonstrated average to good content coverage when mapped against DSM-5 criteria for depression (Table 2) and nine demonstrated adequate psychometric properties (Table 4). All 12 depression measures identified are discussed below to provide sufficient information to enable each measure to be considered by readers.

Hospital anxiety and depression scale (HADS)

The HADS is a 14-item self-report measure with seven items measuring depression [40, 41]. Cronbach’s alpha for HADS was 0.83 [41, 42]. HADS has established clinical cut-off scores for general patients with clinical depression and cancer patients [43], allowing for easy administration, scoring and diagnosis. When mapped against DSM-5 criteria for depression, HADS covered only 42% of content relevant to depression, not including items assessing change in weight, change in sleep, feelings of worthlessness/guilt, indecisiveness, suicidal ideation, concentration and appetite.

Quick inventory of depressive symptomatology self-report (QIDS-SR)

The QIDS-SR is a 16-item self-report measure used to assess the severity of depressive symptoms [68]. The Cronbach’s Alpha of the measure was reported to be 0.86 [68]. Clinical cut-off points have been established for non-clinical subjects and patients with major depressive disorder [68, 69]. When mapped against DSM-5 criteria for depression, QIDS-SR had 100% content coverage, including all items needed to assess depression.

Zung self-rating depression scale (SDS)

Zung Self-Rating Depression Scale is a 20-item measure developed to assess depression in patients with depressive disorders [70, 71]. The internal consistency of the measure ranged between 0.88 and 0.93 [72]. Clinical cut-off points have been established for non-clinical populations, patients with depression and cancer patients [72, 73]. When mapped against DSM-5 criteria for depression, the SDS had 92% content coverage, missing out an item assessing concentration.

Beck’s depression inventory (BDI)

Beck’s Depression Inventory is a 21-item self-report measure developed to measure the severity of depression [74, 75]. The measures’ Cronbach’s Alpha ranged from 0.92 to 0.93 [74, 76]. Clinical cut-off points have been established for psychiatric outpatients, medical patients, non-clinical populations and cancer patients [74, 76, 77]. When mapped against DSM-5 criteria for depression, the BDI had 83% content coverage, lacking items assessing psychomotor agitation/restlessness and concentration.

Center for Epidemiologic Studies Depression Scale (CES-D)

CES-D is a 20-item self-report measure developed to assess the frequency and severity of depressive symptoms [78]. Cronbach’s Alpha of CES-D ranged from 0.84–0.85 [7880]. Clinical cut-off points have been established for non-clinical, psychiatric, and cancer and cancer survivor populations [80, 81]. When mapped against DSM-5 criteria for depression, the CES-D had only 67% content coverage, not consisting of items measuring change in weight, psychomotor agitation/restlessness, indecisiveness and suicidal ideation.

Patient health questionnaire – 9 (PHQ-9)

PHQ-9 is a nine-item self-report measure developed to assess depressive disorders, functional impairment and psychosocial stressors [82]. Cronbach’s Alpha of PHQ-9 was demonstrated to be 0.89 [82]. Clinical cut-off points have been established for non-clinical and cancer populations [83]. When mapped against DSM-5 criteria for depression, the PHQ-9 had 83% content coverage, lacking items measuring change in weight and indecisiveness.

Geriatric depression scale -Short form (GDS-SF)

GDS-SF is a 15-item self-report measure developed to measure depressive symptoms in the geriatric populations [84]. Cronbach’s alpha was reported to range between 0.74–0.86 [85]. Clinical cut-off points have been established for older adults [86]. When mapped against DSM-5 criteria for depression, the GDS-SF had 75% content coverage, lacking items measuring change in weight, change in sleep and appetite.

Brief symptom inventory 18 (BSI-18)

Brief Symptom Inventory is an 18-item self-report instrument used to measure the psychological distress of psychiatric and medical patients and of non-clinical populations [64]. Cronbach’s alpha for all domains in BSI-18 ranged from 0.71 to 0.85 [65]. Cut-off points have been established for clinical patients, mixed cancer groups, survivors, palliative patients and healthy populations [64, 65]. When mapped against DSM-5 criteria for depression, BSI-18 had only 58% content coverage, lacking items measuring change in weight, change in sleep, indecisiveness, concentration and appetite.

Duke-anxiety depression scale (Duke-AD)

Duke AD is a seven-item self-report measure used to assess anxiety and depression [62]. Duke AD’s Cronbach’s alpha is 0.69 [63]. Cut-off points have been established for primary care patients and non-clinical subjects [62, 63]. When mapped against DSM-5 criteria for depression, Duke-AD covered only 42% of content, missing items measuring feelings of worthlessness or guilt, indecisiveness, suicidal ideation, low self-esteem and appetite.

Major depression inventory (MDI)

Major Depression Inventory is a 10-item self-report measure developed to assess the severity of depressive states [87]. Cronbach’s Alpha of MDI was reported to be 0.90 [88]. Clinical cut-off points have been established for patients with major depressive disorder and other depressive states [89]. When mapped against DSM-5 criteria for depression, MDI covered 83% of content, lacking items measuring change in weight and indecisiveness.

Carroll rating scale for depression (CDS)

Carroll Rating Scale for Depression is a 52-item self-report measure developed to assess behavioural and somatic manifestations of depression in psychiatric patients [90]. Cronbach’s Alpha of CDS was found to be 0.80 [90]. Clinical cut-off points have been established for patients with clinical depression [90]. When mapped against DSM-5 criteria for depression, CDS covered 92% of content, missing items assessing appetite.

Depression anxiety stress scale 21 (DASS 21)

DASS 21 is a 21-item self-report measure used to assess the intensity of negative emotional states such as depression, anxiety and stress [35]. Depression subscale Cronbach’s alpha was reported to be 0.94 [35, 59, 60]. Cut-off points have been established for clinical patients, cancer patients, and non-clinical populations [61]. When mapped against DSM-5 criteria for depression, DASS 21 covered only 42% of content, lacking items covering change in weight, change in sleep, fatigue/loss of energy, indecisiveness, suicidal ideation, concentration and appetite.

All PROMs identified other than MASQ, Duke-AD, MDI and CDS (measures obtained from PROMs databases) had been used in HNC populations. Based on content mapping and appraisal of psychometric properties, SAS, SDS and PHQ-9 were considered most suitable for usage in HNC population to assess anxiety and depression.

Discussion

Optimal outcomes for cancer patients necessitate that not only disease specific and treatment morbidity related outcomes are addressed but also HRQoL outcomes as reported by the patients through use of appropriate PROMs. Given the prevalence of anxiety and depression in cancer patients, in particular HNC, adopting measures of anxiety and depression appropriate for use in the HNC populations is critical for accurate detection of and intervention for anxiety and depression. We identified nine anxiety and 12 depression PROMs used to assess psychological distress in HNC populations and mapped them against DSM-5 criteria for depression and anxiety. While DSM-5 criteria for anxiety and depression are established on the premise that the target population is physically well, we chose this model to appraise conceptual coverage of PROMs in this study for two reasons: (1) mental health disorders are said to occur in about 40% of patients diagnosed with cancer [91, 92] and the DSM is an evidence-based guide to the diagnosis of mental disorders; and, (2) most depression and anxiety measures identified have been developed and validated based on DSM criteria.

The content covered by these measures varied in terms of their relevance and appropriateness to HNC. Most anxiety measures focused on restlessness, muscle tension, disturbing thoughts and worry. Content areas not adequately addressed in identified measures included sleep disturbance (covered only by Duke-AD), fatigue, concentration and irritability. Similarly, depression measures revealed great content disparity. All identified measures addressed ‘depressed mood’ but only a few addressed ‘change in weight’.

For patients diagnosed with HNC, anxiety and depression extends beyond the completion of their treatment as side effects impact their everyday functioning [8]. Neurovegetative symptoms used to denote depression in non-cancer populations, such as change in weight, sleep disturbances and loss of appetite, are likely to be disease- or treatment-related in people diagnosed with cancer, and therefore not good indicators of depression in this population [93]. Hence, cognitive symptoms such as worthlessness or guilt, low self-esteem, depressed mood, concentration or indecisiveness need to be monitored to detect depression. Therefore, PROMs such as PHQ-9 and MDI, which have no or few items assessing neurovegetative symptoms may be more relevant and appropriate for use in HNC populations. For anxiety, one symptom that may confound HNC and its treatment is fatigue. As fatigue is an important indicator of clinical anxiety, it is essential to consider when reviewing content coverage of anxiety measures. Of the anxiety measures, SAS and STAI had the greatest content coverage against the diagnostic standard DSM-5 criteria. While we acknowledge avoiding symptoms potentially due to illness, we sought the most comprehensive coverage of anxiety and depression symptoms to ensure maximum sensitivity in detecting anxiety and depression, with the proviso that these would need to be clinically assessed to judge causation. Therefore we chose measures which included fewer neurovegetative symptoms, excellent conceptual coverage and good psychometric properties.

Appraisal of PROM psychometric properties determined the MDI and CDS had inadequate psychometric properties, and the QIDS-SR does not have established clinical cut-off scores for cancer populations. Hence, for depression, PHQ-9 and SDS are recommended for use in the HNC setting due to their comprehensive content coverage relevant to HNC and robust psychometric properties. For anxiety, the STAI has questionable predictive accuracy, discriminant and factorial validity, and failed to effectively differentiate between subjects with and without anxiety disorders [94, 95]. Furthermore, the primary purpose of this measure was to assess the severity of state and trait anxiety, with the trait scale overlapping with symptoms of depression [94, 96]. Hence, the SAS, which has good content coverage and psychometric properties, is recommended for use in the HNC setting to assess anxiety.

All PROMs identified in this study were developed to either measure anxiety or depression or both. Purposes of these measures varied only in the extent of assessment – whether they were developed as a screening tool or to assess the extent or severity of anxiety and depression. All measures had established clinical cut-off points for anxiety and depression for the general population, but only three anxiety measures and seven depression measures had cut-off points for cancer. Clinical cut-off scores have been determined using data from populations with severe emotional disorders and healthy subjects to classify the extent of a mental disorder based on a screening or outcome measure. However, these cut-off scores may not be appropriate for cancer populations where anxiety and depression can be a normal response to a traumatic life event. To differentiate clinical levels of anxiety and depression in cancer populations, distinct cut-off points need to be established in these populations [97]. Some depression measures (such as QIDS-SR, GDS-SF, Duke-AD, MDI and CDS) and anxiety measures (STAI, SAS, BAI, MASQ, Duke-AD, GAD-7) failed to report clinical cut-offs specifically for cancer populations. Clinical cut-off points ascertained exclusively for cancer populations would better discriminate between the presence and absence of clinical anxiety and depression, reducing the number of false positives in practice. This will enable healthcare providers to effectively assess the mental health of people with cancer under their care, identifying those requiring clinical intervention, and making appropriate referals.

According to previous studies, PROMs assessing anxiety and depression most commonly used in HNC populations were HADS, BDI, CES-D and QIDS-SR [10, 98]. However, all other identified measures except MASQ, Duke-AD, MDI and CES-D have been used in HNC populations at least once. Evaluation of criterion validity (determined using receiver operating characteristic curve) has been reported so far for CES-D, BDI and HADS [8, 27, 99, 100] with HNC populations.

Limitations and implications

This systematic review was rigorously conducted, but has some limitations. First, only primary research published in English was included. Second, development and validation studies were hand-searched; it is possible some publications were missed. Third, the quality of individual studies was not reviewed, however, the focus of this systematic review was on PROMs and not primary study design and reporting quality.

This systematic review summarises available HNC-specific measures for assessing anxiety and depression, and provides a reliable source of evidence to guide measurement selection for research and clinical practice. Literature shows that there is a need for cross-cultural language translations of PROMs [101] and findings from this study offer a starting point in determining which PROMs may be suitable for cultural adaption and validation in HNC populations.

Conclusions

To summarize, based on content mapping and appraisal of psychometric properties, SAS, SDS and PHQ-9 were considered most suitable for use in HNC populations to assess anxiety and depression. It is important to use PROMs for assessing anxiety and depression that capture a comprehensive set of subjective symptoms. This review highlights the importance of establishing disease-specific clinical cut-offs for common psychological variables such as anxiety and depression, to facilitate accurate diagnoses in cancer patients. It also explains how some symptoms of anxiety and depression can be confounded by those caused by the disease and its treatment.

Supplementary information

Additional file 1. (19.4KB, docx)

Acknowledgements

We thank Rhiannon Ashleigh for her assistance with data extraction.

Abbreviations

HNC

Head and neck cancer

PROM

Patient-reported outcome measure

DSM

Diagnostic and Statistical Manual

HRQOL

Health Related Quality of Life

COSMIN

COnsensus-based Standards for the selection of health Measurement Instruments

POD

Psycho-oncology database

GEM

Grid-enabled Measures Database

HADS

Hospital Anxiety and Depression Scale

STAI

State trait Anxiety Inventory

SAS

Zung Self Rating Anxiety Scale

BAI

Beck’s Anxiety Inventory

MASQ

Mood and Anxiety Symptom Questionnaire

DASS 21

Depression Anxiety Stress Scale 21

Duke-AD

Duke Anxiety Depression Scale

BSI-18

Brief Symptom Inventory – 18

GAD – 7

Generalized Anxiety Disorder – 7

QIDS-SR

Quick inventory of Depressive Symptomatology self-report

SDS

Zung Self-Rating Depression Scale

BDI

Beck’s Depression Inventory

CES-D

Center for Epidemiologic Studies Depression Scale

PHQ-9

Patient Health Questionnaire – 9

GDS-SF

Geriatric Depression Scale -Short Form

MDI

Major Depression inventory

CDS

Carroll Rating Scale for Depression

Authors’ contributions

All authors read and approved the final manuscript. All authors conceived of the presented idea. HD, PB, CR and PS encouraged CS to conduct this systematic review and supervised the findings of this work. All authors discussion the results and contributed to the final manuscript. CS carried out the review, HD was the second reviewer (analyzing 10% of all searches). CS, PB and HD analysed conceptual coverage of all PROMs against the criteria. HD, PB, CR and PS contributed to the discussion and to the writing of the manuscript.

Funding

No funding supported this systematic review.

Availability of data and materials

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Ethics approval and consent to participate

Considering the type of work presented (a systematic review of literature) neither patient informed consent nor approval from ethical committees were necessary for this study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary information accompanies this paper at 10.1186/s41687-020-00189-7.

References

  • 1.Lydiatt WM, Moran J, Burke WJ. A review of depression in the head and neck cancer patient. Clinical Advances in Hematology and Oncology. 2009;7(6):397–403. [PubMed] [Google Scholar]
  • 2.Sehlen S, Lenk M, Herschbach P, Aydemir U, Dellian M, Schymura B, Hollenhorst H, Dühmke E. Depressive symptoms during and after radiotherapy for head and neck cancer. Head & Neck: Journal for the Sciences and Specialties of the Head and Neck. 2003;25(12):1004–1018. doi: 10.1002/hed.10336. [DOI] [PubMed] [Google Scholar]
  • 3.Verdonck-de Leeuw IM, Eerenstein SE, Van der Linden MH, Kuik DJ, de Bree R, Leemans CR. Distress in spouses and patients after treatment for head and neck cancer. Laryngoscope. 2007;117(2):238–241. doi: 10.1097/01.mlg.0000250169.10241.58. [DOI] [PubMed] [Google Scholar]
  • 4.Dropkin MJ. Anxiety, coping strategies, and coping behaviors in patients undergoing head and neck cancer surgery. Cancer Nursing. 2001;24(2):143–148. doi: 10.1097/00002820-200104000-00010. [DOI] [PubMed] [Google Scholar]
  • 5.Haisfield-Wolfe ME, McGuire DB, Soeken K, Geiger-Brown J, De Forge BR. Oncology nursing forum. 2009. Prevalence and correlates of depression among patients with head and neck cancer: A systematic review of implications for research. [DOI] [PubMed] [Google Scholar]
  • 6.Kelly C, Paleri V, Downs C, Shah R. Deterioration in quality of life and depressive symptoms during radiation therapy for head and neck cancer. Otolaryngology and Head and Neck Surgery. 2007;136(1):108–111. doi: 10.1016/j.otohns.2006.06.1278. [DOI] [PubMed] [Google Scholar]
  • 7.Neilson K, Pollard A, Boonzaier A, Corry J, Castle D, Smith D, Trauer T, Couper J. A longitudinal study of distress (depression and anxiety) up to 18 months after radiotherapy for head and neck cancer. Psycho-Oncology. 2013;22(8):1843–1848. doi: 10.1002/pon.3228. [DOI] [PubMed] [Google Scholar]
  • 8.Neilson KA, Pollard AC, Boonzaier AM, Corry J, Castle DJ, Mead KR, Gray MC, Smith DI, Trauer T, Couper JW. Psychological distress (depression and anxiety) in people with head and neck cancers. The Medical Journal of Australia. 2010;193:S48–S51. doi: 10.5694/j.1326-5377.2010.tb03928.x. [DOI] [PubMed] [Google Scholar]
  • 9.de Leeuw JRJ, de Graeff A, Ros WJ, Blijham GH, Hordijk GJ, Winnubst JA. Prediction of depression 6 months to 3 years after treatment of head and neck cancer. Head & Neck: Journal for the Sciences and Specialties of the Head and Neck. 2001;23(10):892–898. doi: 10.1002/hed.1129. [DOI] [PubMed] [Google Scholar]
  • 10.Frampton M. Psychological distress in patients with head and neck cancer. The British Journal of Oral & Maxillofacial Surgery. 2001;39(1):1–4. doi: 10.1054/bjom.2000.0547. [DOI] [PubMed] [Google Scholar]
  • 11.Pandey M, Devi N, Thomas BC, Vinod Kumar S, Krishnan R, Ramdas K. Distress overlaps with anxiety and depression in patients with head and neck cancer. Psycho-Oncology: Journal of the Psychological, Social and Behavioral Dimensions of Cancer. 2007;16(6):582–586. doi: 10.1002/pon.1123. [DOI] [PubMed] [Google Scholar]
  • 12.Hammerlid E, Ahlner-Elmqvist M, Bjordal K, Biörklund A, Evensen J, Boysen M, Jannert M, Kaasa S, Sullivan M, Westin T. A prospective multicentre study in Sweden and Norway of mental distress and psychiatric morbidity in head and neck cancer patients. British Journal of Cancer. 1999;80(5–6):766. doi: 10.1038/sj.bjc.6690420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hammerlid E, Mercke C, Sullivan M, Westin T. A prospective quality of life study of patients with oral or pharyngeal carcinoma treated with external beam irradiation with or without brachytherapy. Oral Oncology. 1997;33(3):189–196. doi: 10.1016/S0964-1955(96)00069-3. [DOI] [PubMed] [Google Scholar]
  • 14.Hindmarch T, Hotopf M, Owen GS. Depression and decision-making capacity for treatment or research: A systematic review. BMC Medical Ethics. 2013;14(1):54. doi: 10.1186/1472-6939-14-54. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Lazure KE, Lydiatt WM, Denman D, Burke WJ. Association between depression and survival or disease recurrence in patients with head and neck cancer enrolled in a depression prevention trial. Head & Neck: Journal for the Sciences and Specialties of the Head and Neck. 2009;31(7):888–892. doi: 10.1002/hed.21046. [DOI] [PubMed] [Google Scholar]
  • 16.Bultz BD, Johansen C. Screening for distress, the 6th vital sign: Where are we, and where are we going? Psycho-Oncology. 2011;20(6):569–571. doi: 10.1002/pon.1986. [DOI] [PubMed] [Google Scholar]
  • 17.Association AP . Diagnostic and statistical manual of mental disorders (DSM-5®) 2013. [DOI] [PubMed] [Google Scholar]
  • 18.Pasquini M, Biondi M. Depression in cancer patients: A critical review. Clinical Practice and Epidemiology in Mental Health. 2007;3(1):2. doi: 10.1186/1745-0179-3-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Stark D, Kiely M, Smith A, Velikova G, House A, Selby P. Anxiety disorders in cancer patients: Their nature, associations, and relation to quality of life. Journal of Clinical Oncology. 2002;20(14):3137–3148. doi: 10.1200/JCO.2002.08.549. [DOI] [PubMed] [Google Scholar]
  • 20.Howren MB, Christensen AJ, Karnell LH, Funk GF. Psychological factors associated with head and neck cancer treatment and survivorship: Evidence and opportunities for behavioral medicine. Journal of Consulting and Clinical Psychology. 2013;81(2):299. doi: 10.1037/a0029940. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Jones E, Lund V, Howard D, Greenberg M, McCarthy M. Quality of life of patients treated surgically for head and neck cancer. The Journal of Laryngology and Otology. 1992;106(3):238–242. doi: 10.1017/S0022215100119152. [DOI] [PubMed] [Google Scholar]
  • 22.Hassanein KA-AM, Musgrove BT, Bradbury E. Psychological outcome of patients following treatment of oral cancer and its relation with functional status and coping mechanisms. Journal of Cranio-Maxillofacial Surgery. 2005;33(6):404–409. doi: 10.1016/j.jcms.2005.05.005. [DOI] [PubMed] [Google Scholar]
  • 23.Rogers S, Miller R, Ali K, Minhas A, Williams H, Lowe D. Patients’ perceived health status following primary surgery for oral and oropharyngeal cancer. International Journal of Oral and Maxillofacial Surgery. 2006;35(10):913–919. doi: 10.1016/j.ijom.2006.07.017. [DOI] [PubMed] [Google Scholar]
  • 24.Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, De Vet HC. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Quality of Life Research. 2010;19(4):539–549. doi: 10.1007/s11136-010-9606-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Dugan W, McDonald MV, Passik SD, Rosenfeld BD, Theobald D, Edgerton S. Use of the Zung self-rating depression scale in cancer patients: Feasibility as a screening tool. Psycho-Oncology: Journal of the Psychological, Social and Behavioral Dimensions of Cancer. 1998;7(6):483–493. doi: 10.1002/(SICI)1099-1611(199811/12)7:6<483::AID-PON326>3.0.CO;2-M. [DOI] [PubMed] [Google Scholar]
  • 26.Ell K, Xie B, Quon B, Quinn DI, Dwight-Johnson M, Lee P-J. Randomized controlled trial of collaborative care management of depression among low-income patients with cancer. Journal of Clinical Oncology. 2008;26(27):4488. doi: 10.1200/JCO.2008.16.6371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Katz MR, Kopek N, Waldron J, Devins GM, Tomlinson G. Screening for depression in head and neck cancer. Psycho-Oncology: Journal of the Psychological, Social and Behavioral Dimensions of Cancer. 2004;13(4):269–280. doi: 10.1002/pon.734. [DOI] [PubMed] [Google Scholar]
  • 28.Kroenke K, Wu J, Yu Z, Bair MJ, Kean J, Stump T, Monahan PO. The patient health questionnaire anxiety and depression scale (PHQ-ADS): Initial validation in three clinical trials. Psychosomatic Medicine. 2016;78(6):716. doi: 10.1097/PSY.0000000000000322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Passik SD, Lundberg JC, Rosenfeld B, Kirsh KL, Donaghy K, Theobald D, Lundberg E, Dugan W. Factor analysis of the Zung self-rating depression scale in a large ambulatory oncology sample. Psychosomatics. 2000;41(2):121–127. doi: 10.1176/appi.psy.41.2.121. [DOI] [PubMed] [Google Scholar]
  • 30.Reilly TJ, MacGillivray SA, Reid IC, Cameron IM. Psychometric properties of the 16-item quick inventory of depressive symptomatology: A systematic review and meta-analysis. Journal of Psychiatric Research. 2015;60:132–140. doi: 10.1016/j.jpsychires.2014.09.008. [DOI] [PubMed] [Google Scholar]
  • 31.Saracino RM, Weinberger MI, Roth AJ, Hurria A, Nelson CJ. Assessing depression in a geriatric cancer population. Psycho-oncology. 2017;26(10):1484–1490. doi: 10.1002/pon.4160. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Thekkumpurath P, Walker J, Butcher I, Hodges L, Kleiboer A, O'Connor M, Wall L, Murray G, Kroenke K, Sharpe M. Screening for major depression in cancer outpatients: The diagnostic accuracy of the 9-item patient health questionnaire. Cancer. 2011;117(1):218–227. doi: 10.1002/cncr.25514. [DOI] [PubMed] [Google Scholar]
  • 33.Van Wilgen C, Dijkstra P, Stewart R, Ranchor A, Roodenburg J. Measuring somatic symptoms with the CES–D to assess depression in cancer patients after treatment: Comparison among patients with oral/oropharyngeal, gynecological, colorectal, and breast cancer. Psychosomatics. 2006;47(6):465–470. doi: 10.1176/appi.psy.47.6.465. [DOI] [PubMed] [Google Scholar]
  • 34.Walker J, Postma K, McHugh GS, Rush R, Coyle B, Strong V, Sharpe M. Performance of the hospital anxiety and depression scale as a screening tool for major depressive disorder in cancer patients. Journal of Psychosomatic Research. 2007;63(1):83–91. doi: 10.1016/j.jpsychores.2007.01.009. [DOI] [PubMed] [Google Scholar]
  • 35.Lovibond PF, Lovibond SH. The structure of negative emotional states: Comparison of the depression anxiety stress scales (DASS) with the Beck depression and anxiety inventories. Behaviour Research and Therapy. 1995;33(3):335–343. doi: 10.1016/0005-7967(94)00075-U. [DOI] [PubMed] [Google Scholar]
  • 36.Howard RA, Harvey PG. A longitudinal study of psychological distress in women with breast symptoms. Journal of Health Psychology. 1998;3(2):215–226. doi: 10.1177/135910539800300205. [DOI] [PubMed] [Google Scholar]
  • 37.Ke Y, Ng T, Yeo HL, Shwe M, Gan YX, Chan A. Psychometric properties and measurement equivalence of the English and Chinese versions of the Beck anxiety inventory in patients with breast cancer. Support Care Cancer. 2017;25(2):633–643. doi: 10.1007/s00520-016-3452-3. [DOI] [PubMed] [Google Scholar]
  • 38.Sharpley CF, Christie DR. An analysis of the psychometric profile and frequency of anxiety and depression in Australian men with prostate cancer. Psycho-Oncology: Journal of the Psychological, Social and Behavioral Dimensions of Cancer. 2007;16(7):660–667. doi: 10.1002/pon.1118. [DOI] [PubMed] [Google Scholar]
  • 39.Love A. The identification of psychological distress in women with breast Cancer [electronic resource] 2004. [Google Scholar]
  • 40.Snaith R, Zigmond A. The hospital anxiety and depression scale. British Medical Journal (Clinical Research Ed.) 1986;292(6516):344. doi: 10.1136/bmj.292.6516.344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica. 1983;67(6):361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x. [DOI] [PubMed] [Google Scholar]
  • 42.Cameron IM, Crawford JR, Lawton K, Reid IC. Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care. The British Journal of General Practice. 2008;58(546):32–36. doi: 10.3399/bjgp08X263794. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Singer S, Kuhnt S, Götze H, Hauss J, Hinz A, Liebmann A, Krauss O, Lehmann A, Schwarz R. Hospital anxiety and depression scale cutoff scores for cancer patients in acute care. British Journal of Cancer. 2009;100(6):908. doi: 10.1038/sj.bjc.6604952. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Spielberger CD. State-trait anxiety inventory. The Corsini encyclopedia of psychology. 2010. p. 1. [Google Scholar]
  • 45.Grös DF, Antony MM, Simms LJ, McCabe RE. Psychometric properties of the state-trait inventory for cognitive and somatic anxiety (STICSA): Comparison to the state-trait anxiety inventory (STAI) Psychological Assessment. 2007;19(4):369. doi: 10.1037/1040-3590.19.4.369. [DOI] [PubMed] [Google Scholar]
  • 46.Knight RG, Waal-Manning HJ, Spears GF. Some norms and reliability data for the state-trait anxiety inventory and the Zung self-rating depression scale. The British Journal of Clinical Psychology. 1983;22(4):245–249. doi: 10.1111/j.2044-8260.1983.tb00610.x. [DOI] [PubMed] [Google Scholar]
  • 47.Kaneda Y, Fujii A. The relation between anxiety and depressive symptoms in normal subjects and patients with anxiety and/or mood disorders. Journal of Medical Investigation. 2000;47(1/2):14–18. [PubMed] [Google Scholar]
  • 48.Auerbach SM. Trait-state anxiety and adjustment of surgery. Journal of Consulting and Clinical Psychology. 1973;40(2):264. doi: 10.1037/h0034538. [DOI] [PubMed] [Google Scholar]
  • 49.Zung WW. A rating instrument for anxiety disorders. Psychosomatics: Journal of Consultation and Liaison Psychiatry. 1971. [DOI] [PubMed] [Google Scholar]
  • 50.Dunstan, D. A., & Scott, N. (2018). Assigning clinical significance and symptom severity using the Zung scales: Levels of misclassification arising from confusion between index and raw scores. Depression Research and Treatment, p. 13. [DOI] [PMC free article] [PubMed]
  • 51.Dunstan DA, Scott N, Todd AK. Screening for anxiety and depression: Reassessing the utility of the Zung scales. BMC Psychiatry. 2017;17(1):329. doi: 10.1186/s12888-017-1489-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Zung WW. How normal is anxiety? Upjohn: Company; 1980. [Google Scholar]
  • 53.Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology. 1988;56(6):893. doi: 10.1037/0022-006X.56.6.893. [DOI] [PubMed] [Google Scholar]
  • 54.Halfaker, D. A., Akeson, S. T., Hathcock, D. R., Mattson, C., & Wunderlich, T. L. (2011). Psychological aspects of pain. In Pain procedures in clinical practice (pp. 13-22). Philadephia: Hanley & Belfus.
  • 55.Carney CE, Moss TG, Harris AL, Edinger JD, Krystal AD. Should we be anxious when assessing anxiety using the Beck anxiety inventory in clinical insomnia patients? Journal of Psychiatric Research. 2011;45(9):1243–1249. doi: 10.1016/j.jpsychires.2011.03.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Watson D, Clark LA, Weber K, Assenheimer JS, Strauss ME, McCormick RA. Testing a tripartite model: II. Exploring the symptom structure of anxiety and depression in student, adult, and patient samples. Journal of Abnormal Psychology. 1995;104(1):15. doi: 10.1037/0021-843X.104.1.15. [DOI] [PubMed] [Google Scholar]
  • 57.Watson D, Weber K, Assenheimer JS, Clark LA, Strauss ME, McCormick RA. Testing a tripartite model: I. evaluating the convergent and discriminant validity of anxiety and depression symptom scales. Journal of Abnormal Psychology. 1995;104(1):3. doi: 10.1037/0021-843X.104.1.3. [DOI] [PubMed] [Google Scholar]
  • 58.Buckby JA, Yung AR, Cosgrave EM, Killackey EJ. Clinical utility of the mood and anxiety symptom questionnaire (MASQ) in a sample of young help-seekers. BMC Psychiatry. 2007;7(1):50. doi: 10.1186/1471-244X-7-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Norton PJ. Depression anxiety and stress scales (DASS-21): Psychometric analysis across four racial groups. Anxiety, Stress, and Coping. 2007;20(3):253–265. doi: 10.1080/10615800701309279. [DOI] [PubMed] [Google Scholar]
  • 60.Tran TD, Tran T, Fisher J. Validation of the depression anxiety stress scales (DASS) 21 as a screening instrument for depression and anxiety in a rural community-based cohort of northern Vietnamese women. BMC Psychiatry. 2013;13(1):24. doi: 10.1186/1471-244X-13-24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Lovibond SH, Lovibond PF. Manual for the depression anxiety stress scales. 1996. [Google Scholar]
  • 62.Parkerson Jr., G. R., Broadhead, W., & Tse, C.-K. J. (1990). The Duke health profile: A 17-item measure of health and dysfunction. Medical Care, 28(11), 1056–1072. [DOI] [PubMed]
  • 63.Parkerson GR, Jr, Broadhead WE, Chiu-Kit JT. Anxiety and depressive symptom identification using the Duke health profile. Journal of Clinical Epidemiology. 1996;49(1):85–93. doi: 10.1016/0895-4356(95)00037-2. [DOI] [PubMed] [Google Scholar]
  • 64.Derogatis LR, Spencer P (1993) Brief symptom inventory: BSI. Pearson Upper Saddle River,
  • 65.Derogatis LR, Melisaratos N. The brief symptom inventory: An introductory report. Psychological Medicine. 1983;13(3):595–605. doi: 10.1017/S0033291700048017. [DOI] [PubMed] [Google Scholar]
  • 66.Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine. 2006;166(10):1092–1097. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
  • 67.Löwe B, Decker O, Müller S, Brähler E, Schellberg D, Herzog W, Herzberg PY. Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Medical Care. 2008;46(3):266–274. doi: 10.1097/MLR.0b013e318160d093. [DOI] [PubMed] [Google Scholar]
  • 68.Rush AJ, Giles DE, Schlesser MA, Fulton CL, Weissenburger J, Burns C. The inventory for depressive symptomatology (IDS): Preliminary findings. Psychiatry Research. 1986;18(1):65–87. doi: 10.1016/0165-1781(86)90060-0. [DOI] [PubMed] [Google Scholar]
  • 69.Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, Markowitz JC, Ninan PT, Kornstein S, Manber R. The 16-item quick inventory of depressive symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): A psychometric evaluation in patients with chronic major depression. Biological Psychiatry. 2003;54(5):573–583. doi: 10.1016/S0006-3223(02)01866-8. [DOI] [PubMed] [Google Scholar]
  • 70.Zung WW. A self-rating depression scale. Archives of General Psychiatry. 1965;12(1):63–70. doi: 10.1001/archpsyc.1965.01720310065008. [DOI] [PubMed] [Google Scholar]
  • 71.Zung WW, Richards CB, Short MJ. Self-rating depression scale in an outpatient clinic: Further validation of the SDS. Archives of General Psychiatry. 1965;13(6):508–515. doi: 10.1001/archpsyc.1965.01730060026004. [DOI] [PubMed] [Google Scholar]
  • 72.Gabrys JB, Peters K. Reliability, discriminant and predictive validity of the Zung self-rating depression scale. Psychological Reports. 1985;57(3_suppl):1091–1096. doi: 10.2466/pr0.1985.57.3f.1091. [DOI] [PubMed] [Google Scholar]
  • 73.Passik SD, Kirsh KL, Donaghy KB, Theobald DE, Lundberg JC, Holtsclaw E, Dugan WM., Jr An attempt to employ the Zung self-rating depression scale as a “lab test” to trigger follow-up in ambulatory oncology clinics: Criterion validity and detection. Journal of Pain and Symptom Management. 2001;21(4):273–281. doi: 10.1016/S0885-3924(00)00264-5. [DOI] [PubMed] [Google Scholar]
  • 74.Beck AT, Steer RA, Carbin MG. Psychometric properties of the Beck depression inventory: Twenty-five years of evaluation. Clinical Psychology Review. 1988;8(1):77–100. doi: 10.1016/0272-7358(88)90050-5. [DOI] [Google Scholar]
  • 75.Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Archives of General Psychiatry. 1961;4(6):561–571. doi: 10.1001/archpsyc.1961.01710120031004. [DOI] [PubMed] [Google Scholar]
  • 76.Craven JL, Rodin G, Littlefield C. The Beck depression inventory as a screening device for major depression in renal dialysis patients. The International Journal of Psychiatry in Medicine. 1989;18(4):365–374. doi: 10.2190/M1TX-V1EJ-E43L-RKLF. [DOI] [PubMed] [Google Scholar]
  • 77.Mystakidou K, Tsilika E, Parpa E, Smyrniotis V, Galanos A, Vlahos L. Beck depression inventory: Exploring its psychometric properties in a palliative care population of advanced cancer patients. European Journal of Cancer Care. 2007;16(3):244–250. doi: 10.1111/j.1365-2354.2006.00728.x. [DOI] [PubMed] [Google Scholar]
  • 78.Radloff LS. The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement. 1977;1(3):385–401. doi: 10.1177/014662167700100306. [DOI] [Google Scholar]
  • 79.Weissman MM, Sholomskas D, Pottenger M, Prusoff BA, Locke BZ. Assessing depressive symptoms in five psychiatric populations: A validation study. American Journal of Epidemiology. 1977;106(3):203–214. doi: 10.1093/oxfordjournals.aje.a112455. [DOI] [PubMed] [Google Scholar]
  • 80.Hann D, Winter K, Jacobsen P. Measurement of depressive symptoms in cancer patients: Evaluation of the Center for Epidemiological Studies Depression Scale (CES-D) Journal of Psychosomatic Research. 1999;46(5):437–443. doi: 10.1016/S0022-3999(99)00004-5. [DOI] [PubMed] [Google Scholar]
  • 81.Brown KW, Levy AR, Rosberger Z, Edgar L. Psychological distress and cancer survival: A follow-up 10 years after diagnosis. Psychosomatic Medicine. 2003;65(4):636–643. doi: 10.1097/01.PSY.0000077503.96903.A6. [DOI] [PubMed] [Google Scholar]
  • 82.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine. 2001;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Hinz A, Mehnert A, Kocalevent R-D, Brähler E, Forkmann T, Singer S, Schulte T. Assessment of depression severity with the PHQ-9 in cancer patients and in the general population. BMC Psychiatry. 2016;16(1):22. doi: 10.1186/s12888-016-0728-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Yesavage JA. Geriatric depression scale. Psychopharmacology Bulletin. 1988;24(4):709–711. [PubMed] [Google Scholar]
  • 85.Friedman B, Heisel MJ, Delavan RL. Psychometric properties of the 15-item geriatric depression scale in functionally impaired, cognitively intact, community-dwelling elderly primary care patients. Journal of the American Geriatrics Society. 2005;53(9):1570–1576. doi: 10.1111/j.1532-5415.2005.53461.x. [DOI] [PubMed] [Google Scholar]
  • 86.Smarr KL, Keefer AL. Measures of depression and depressive symptoms: Beck depression inventory-II (BDI-II), Center for Epidemiologic Studies Depression Scale (CES-D), geriatric depression scale (GDS), hospital anxiety and depression scale (HADS), and patient health Questionnaire-9 (PHQ-9) Arthritis Care & Research. 2011;63(S11):S454–S466. doi: 10.1002/acr.20556. [DOI] [PubMed] [Google Scholar]
  • 87.Bech P, Rasmussen N-A, Olsen LR, Noerholm V, Abildgaard W. The sensitivity and specificity of the major depression inventory, using the present state examination as the index of diagnostic validity. Journal of Affective Disorders. 2001;66(2–3):159–164. doi: 10.1016/S0165-0327(00)00309-8. [DOI] [PubMed] [Google Scholar]
  • 88.Olsen L, Jensen D, Noerholm V, Martiny K, Bech P. The internal and external validity of the major depression inventory in measuring severity of depressive states. Psychological Medicine. 2003;33(2):351–356. doi: 10.1017/S0033291702006724. [DOI] [PubMed] [Google Scholar]
  • 89.Bech P, Timmerby N, Martiny K, Lunde M, Soendergaard S. Psychometric evaluation of the major depression inventory (MDI) as depression severity scale using the LEAD (longitudinal expert assessment of all data) as index of validity. BMC Psychiatry. 2015;15(1):190. doi: 10.1186/s12888-015-0529-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Carroll BJ, Feinberg M, Smouse PE, Rawson SG, Greden JF. The Carroll rating scale for depression I. development, reliability and validation. The British Journal of Psychiatry. 1981;138(3):194–200. doi: 10.1192/bjp.138.3.194. [DOI] [PubMed] [Google Scholar]
  • 91.Brintzenhofe-Szoc KM, Levin TT, Li Y, Kissane DW, Zabora JR. Mixed anxiety/depression symptoms in a large cancer cohort: Prevalence by cancer type. Psychosomatics. 2009;50(4):383–391. doi: 10.1176/appi.psy.50.4.383. [DOI] [PubMed] [Google Scholar]
  • 92.Mitchell AJ, Chan M, Bhatti H, Halton M, Grassi L, Johansen C, Meader N. Prevalence of depression, anxiety, and adjustment disorder in oncological, haematological, and palliative-care settings: A meta-analysis of 94 interview-based studies. The Lancet Oncology. 2011;12(2):160–174. doi: 10.1016/S1470-2045(11)70002-X. [DOI] [PubMed] [Google Scholar]
  • 93.Rackley S, Bostwick JM. Depression in medically ill patients. Psychiatria Clinica. 2012;35(1):231–247. doi: 10.1016/j.psc.2011.11.001. [DOI] [PubMed] [Google Scholar]
  • 94.Julian LJ. Measures of anxiety: State-trait anxiety inventory (STAI), Beck anxiety inventory (BAI), and hospital anxiety and depression scale-anxiety (HADS-A) Arthritis Care & Research. 2011;63(S11):S467–S472. doi: 10.1002/acr.20561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Kabacoff RI, Segal DL, Hersen M, Van Hasselt VB. Psychometric properties and diagnostic utility of the Beck anxiety inventory and the state-trait anxiety inventory with older adult psychiatric outpatients. Journal of Anxiety Disorders. 1997;11(1):33–47. doi: 10.1016/S0887-6185(96)00033-3. [DOI] [PubMed] [Google Scholar]
  • 96.Bieling PJ, Antony MM, Swinson RP. The state--trait anxiety inventory, trait version: Structure and content re-examined. Behaviour Research and Therapy. 1998;36(7–8):777–788. doi: 10.1016/S0005-7967(98)00023-0. [DOI] [PubMed] [Google Scholar]
  • 97.Jacobson NS, Truax P. Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology. 1991;59(1):12. doi: 10.1037/0022-006X.59.1.12. [DOI] [PubMed] [Google Scholar]
  • 98.Hutton J, Williams M. An investigation of psychological distress in patients who have beentreated for head and neck cancer. The British Journal of Oral & Maxillofacial Surgery. 2001;39(5):333–339. doi: 10.1054/bjom.2001.0645. [DOI] [PubMed] [Google Scholar]
  • 99.Mitchell AJ, Meader N, Symonds P. Diagnostic validity of the hospital anxiety and depression scale (HADS) in cancer and palliative settings: A meta-analysis. Journal of Affective Disorders. 2010;126(3):335–348. doi: 10.1016/j.jad.2010.01.067. [DOI] [PubMed] [Google Scholar]
  • 100.Vodermaier A, Linden W, Siu C. Screening for emotional distress in cancer patients: A systematic review of assessment instruments. Journal of the National Cancer Institute. 2009;101(21):1464–1488. doi: 10.1093/jnci/djp336. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Bernier R, Halpin E, Staffa SJ, Benson L, DiNardo JA, Nasr VG. Inclusion of non-English-speaking patients in research: A single institution experience. Pediatric Anesthesia. 2018;28(5):415–420. doi: 10.1111/pan.13363. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1. (19.4KB, docx)

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.


Articles from Journal of Patient-Reported Outcomes are provided here courtesy of Springer

RESOURCES