Skip to main content
Health and Quality of Life Outcomes logoLink to Health and Quality of Life Outcomes
. 2021 Nov 2;19:249. doi: 10.1186/s12955-021-01883-w

Instruments to assess quality of life in people with mental health problems: a systematic review and dimension analysis of generic, domain- and disease-specific instruments

F C W van Krugten 1,, K Feskens 1, J J V Busschbach 2, L Hakkaart-van Roijen 1, W B F Brouwer 1
PMCID: PMC8561965  PMID: 34727928

Abstract

Objectives

The importance of economic evaluations of mental healthcare interventions is increasingly recognized. Despite the multitude of available quality of life instruments, concerns have been raised regarding the content validity of these instruments, and hence suitability for use in mental health. The aim of this paper, therefore, was to assess the content validity and the suitability of existing quality of life instruments for use in economic evaluations in mental health problems.

Methods

In order to identify available quality of life instruments used in people with mental health problems, a systematic review was performed using the Embase, Medline and PsycINFO databases (time period January 2012 to January 2018). Two reviewers independently assessed study eligibility and executed data extraction. The evaluation framework of Connell and colleagues was used to assess whether the identified quality of life instruments cover the dimensions valued highly by people with mental health problems. Two reviewers independently mapped the content of each identified instrument onto the evaluation framework and indicated the extent to which the instrument covered each of the dimensions of the evaluation framework.

Results

Searches of databases yielded a total of 5727 references. Following duplicate removal and double-independent screening, 949 studies were included in the qualitative synthesis. A total of 44 unique quality of life instruments were identified, of which 12 were adapted versions of original instruments. The best coverage of the dimensions of the evaluation framework of Connell and colleagues was by the WHOQOL-100, S-QoL, SQLS, EDQoL, QLI and the IMHQOL, but none fully covered all dimensions of the evaluation framework.

Conclusions

The results of this study highlight the multitude of available quality of life instruments used in people with mental health problems and indicate that none of the available quality of life instruments fully cover the dimensions previously found to be important in people with mental health problems. Future research should explore the possibilities of refining or expanding existing instruments as well as the development and testing of new quality of life instruments to ensure that all relevant quality of life dimensions for people with mental health problems are covered in evaluations.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12955-021-01883-w.

Keywords: Quality of life, Patient-reported outcome measures, Mental health, Systematic review, Cost-effectiveness, QALY

Introduction

In the context of scarce resources and rising demands for healthcare, the importance of economic evaluations of healthcare interventions to aid decision makers in allocating healthcare resources is increasingly recognized [1, 2]. Such compare the costs and benefits of healthcare interventions, relative to a relevant comparator, in order to assess their value for money. While costs are typically expressed in monetary terms in such evaluations, benefits are usually expressed in quality-adjusted life-years (QALYs). QALYs comprise changes in both length and quality of life, with the latter typically being measured by generic health-related quality of life instruments, which facilitates comparisons across conditions and interventions [3, 4]. Given the importance of quality of life measurement and valuation in economic evaluations, it is vital to ensure that the instruments used are comprehensive and psychometrically sound.

In the mental health field, the need to assess the relative value for money of different interventions, to inform healthcare resource allocation decisions at different levels, has also been recognised. However, in that context, there is an ongoing debate about how and with which instruments the benefits of mental healthcare interventions could be adequately measured and valued [5, 6]. This topic is particularly relevant for mental health interventions, since alleviating symptoms and improving quality of life are common goals of mental health interventions, rather than prolonging length of life. The adequacy of often used generic health-related quality of life instruments, such as the EuroQol five-dimensional (EQ-5D) questionnaire and the 36-item Short-Form Health Survey (SF-36), has been questioned in the context of (parts of) mental healthcare [5, 6]. More specifically, some have suggested that these instruments, in certain situations, lack the sensitivity to sufficiently reflect the impact of mental health problems on quality of life [7], which is obviously problematic. The EQ-5D, for example, appears to perform well in mild to moderate mental health conditions [8, 9], but showed weak correlations with severe mental health problems such as schizophrenia [6]. Some argue that this may be due to the fact that these commonly used quality of life instruments have been developed top-down by clinicians or other experts and primarily for people with a physical illness, thereby limiting the coverage of dimensions perceived important to the quality of life of people with mental health problems [10]. Hence, the debate in this area relates both to the sensitivity of existing health-related quality of life instruments, but also to the scope of relevant outcomes (i.e. potentially broadening the evaluative space). The latter is analogous to discussions related to outcome measurements in economic evaluations in elderly care [11]. Another explanation could be that generic instruments by definition focus on the most important quality of life dimensions across diseases, and hence may focus less on particular dimensions relevant in specific diseases. This highlights the tension between the use of generic instruments and more domain or disease specific instruments, which is characterized by a trade-off between comparability between diseases and sensitivity within a disease.

In order to adequately measure and value the benefits of mental healthcare interventions, the use of a multidimensional, preference-based instrument that comprehensively captures the benefits of mental healthcare interventions is required. Based on previous work by Connell and colleagues [12, 13] that identified seven dimensions known to be important to the quality of life of people with mental health problems, the aim of this paper was to assess the content validity of quality of life instruments used in the mental health field. In addition, it was evaluated whether the available instruments are suitable or, on the basis of the content validity, can be made suitable for use in economic evaluations. The results of this study may then enhance the selection of the most suitable instruments in terms of their coverage of dimensions and benefit the development of adequate outcome instruments to measure and value the benefits of mental healthcare interventions.

Methods

Data sources and search strategy

In order to identify available quality of life instruments used in people with mental health problems, a systematic literature search was conducted on the Embase, Medline and PsycINFO databases in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [14]. The search was conducted on January 3, 2018 and was restricted to studies published between January 1, 2012, to January 3, 2018. The search strategy combined terms related to quality of life (e.g. 'quality of life', 'quality of life assessment') and terms related to a broad range of clinical and subclinical mental health problems. See Additional file 1 for the search strategies. We did not register a protocol for the review.

Eligibility criteria

Studies were selected for inclusion if they met all of the following criteria:

  1. The study population consisted of patients 18 years or older with a clinical or subclinical primary mental health problem;

  2. Quality of life was an explicit outcome measure;

  3. Quality of life was measured as a multidimensional construct through a generic, domain (i.e. mental health), or disease-specific quality of life instrument with established psychometric properties;

  4. The study was a randomized controlled trial, case–control study, cross-sectional study, or cohort study;

  5. Published in English and full text available.

Exclusion was based on not meeting all eligibility criteria. Hence, studies that did not meet one or more of the above-listed eligibility criteria were excluded from the review. We emphasise that our review was not restricted to preference-based instruments, but also included ‘non-preference-based’ instruments. For preference-based or preference-accompanied instruments a value set is available of ‘utility scores’ that reflect the relative importance of or preference for the states described with such instruments. Such ‘utility scores’ are typically obtained in a representative sample of the general population and, if derived appropriately, enable the generation of health state utility values for the states described with the instrument. Health state utility values are used to calculate quality-adjusted life-years (QALYs) in economic evaluations of (mental) healthcare interventions. The outcomes of such evaluations can be used in funding and allocation decisions in healthcare. The most frequently used preference-based instrument is the EQ-5D. Other well-known preference-based instruments are the SF-36 and the Health Utility Index (HUI).

The inclusion of both preference-based instruments and non-preference-based instruments in this review was motivated by the fact that this allows the identification of the outcome instruments currently used in the mental health field, and whether those instruments cover the seven relevant dimensions. This was deemed important since comprehensive non-preference-based instruments could potentially be made suitable for use in economic evaluations by deriving utility scores for the states described with such instruments. Indeed, for instruments to be used in economic evaluations the availability of utility scores that indicate the value of health states are a main requirement, so that the value of changes therein can also be assessed (which can subsequently be compared to the costs required to produce these changes in order to judge value for money).

Study selection and data abstraction

Search results were compiled and deduplicated using RefWorks (http://www.refworks.com), a web-based, bibliographic citation manager. Prior to the eligibility assessment of all identified references, two reviewers (FK, KF) independently screened a random sample of 166 titles and abstracts, and reached strong agreement (Cohen’s κ = 0.83). Blinded to journal titles and authors, the two reviewers then independently screened titles and abstracts of all identified references for potential eligibility using a standardized Excel workbook. For all references that were potentially eligible, a full-text version was retrieved and independently assessed by the two reviewers. Disagreements were resolved by discussion or through third-party adjudication (LH). Data abstraction was performed in duplicate and independently using a standardized, Excel-based data abstraction form. The following data were extracted from the included studies: (1) general study characteristics (year of publication, continent of study origin); (2) sample size; (3) (sub)clinical diagnosis of study population; (4) quality of life instrument(s) used. Following the data abstraction of included studies, the development papers and original instruments of identified quality of life instruments were retrieved online or requested from the author. A detailed risk of bias assessment of the included studies was not performed as the primary objective of the review was to compile a list of quality of life instruments used in people with mental health problems.

Evaluation of identified instruments

The following aspects of each of the identified instruments were evaluated: (1) type (generic, domain, or disease-/subgroup-specific); (2) number of items; (3) number of dimensions; (4) region of development; (5) availability of preferences weights (yes/no). The availability of preferences weights was evaluated in order to assess the instruments' suitability for use in cost-effectiveness studies. Such preference-based weights may also help to get an idea about the relative importance of (changes in) different domains and levels. Adapted versions of original instruments were analysed separately as their number of items as well as their number and type of dimensions covered could differ from the original instrument.

An evaluation framework of dimensions was established in order to assess whether the identified quality of life instruments cover the dimensions valued highly by people with mental health problems. The evaluation framework was established based on previous work of Connell and colleagues [12, 13] who identified seven dimensions known to be important elements of the quality of life of people with mental health problems: well-being and ill-being; relationships and belonging; activity; self-perception; autonomy; hope and hopelessness; physical health. The work by Connell and colleagues [12, 13] was selected as the basis for our evaluation framework, given that it specifically aimed to identify the dimensions of quality of life important to people with mental health problems by using a rigorous mixed-methods approach, i.e. combining a systematic review of qualitative research [12] with complementary interviews [13].

Two reviewers (FK, KF) independently mapped the content of each quality of life instrument onto the evaluation framework and indicated the extent to which the instrument covered each of the dimensions of the evaluation framework: fully covered, partially covered, not covered. A dimension of the evaluation framework was scored as 'fully covered' when the content of the identified quality of life instrument covered more than 75% of the underlying themes of a dimension of the evaluation framework of Connell and colleagues [12, 13] and can be also be found in Additional file 2. Likewise, a dimension was scored as 'partially covered' when the dimensions covered less than 75% of the underlying themes of the dimensions of the evaluation framework. A dimension was scored as ‘not covered' when the dimensions covered none of the underlying themes of the dimensions of the evaluation framework. Disagreements were resolved by discussion or through third-party adjudication (LH).

Results

Study selection and study characteristics

The primary search of databases yielded 5727 references. After duplicate removal and subsequent title and abstract screening, 1172 papers were obtained for full-text review. Following full-text review, 949 studies met the inclusion criteria and were included in the qualitative synthesis. See Fig. 1 for the flow chart of the study selection process and Additional file 3 for the reference list of the included studies.

Fig. 1.

Fig. 1

Flow chart of study selection process. RCT, Randomized controlled trial; QoL, quality of life

An overview of the general characteristics of the included studies is shown in Table 1. Most of the studies were conducted in Europe (35.6%), followed North America (24.9%), and Asia (23.0%). The most frequently studied diagnosis was schizophrenia spectrum and other psychotic disorders, which was the primary diagnosis of the patient population in 31.3% of the included studies.

Table 1.

General characteristics of the included studies (N = 949)

N %
Year of publication
2012 140 14.8
2013 158 16.6
2014 132 13.9
2015 188 19.8
2016 184 19.4
2017 147 15.5
Study region
Africa 13 1.4
Asia 218 23.0
Oceania 39 4.1
Europe 338 35.6
Middle east 49 5.2
North America 236 24.9
South America 53 5.6
Covering various regions 3 0.3
Mental health disorder(s) of the study populationa,b
Anxiety disorders 41 4.3
Bipolar or related disorders 53 5.6
Depressive disorders 128 13.5
Feeding and eating disorders 42 4.4
Gender dysphoria 2 0.2
Neurodevelopmental disorders 23 2.4
Obsessive–compulsive and related disorders 25 2.6
Personality disorders 4 0.4
Schizophrenia spectrum and other psychotic disorders 297 31.3
Sleep–wake disorders 5 0.5
Somatic symptom and related disorders 7 0.7
Substance-related and addictive disorders 101 10.6
Trauma and stressor-related disorders 55 5.8
Various disorders 166 17.5

aDisorders were grouped according to the diagnostic and statistical manual (DSM)-5 categories

bDisorder in this case refers to both clinical and subclinical mental health disorders

Characteristics of identified instruments

A total of 44 quality of life instruments were identified in the primary search, of which 12 were adapted versions of original instruments. Of all instruments, the World Health Organization's Quality of Life Instrument-Short Version (WHOQOL-BREF) [15] was used most frequently (n = 240, 23.9%), followed by the 36-item Short-Form Health Survey (SF-36) [16] (n = 181, 18.0%). Of the 44 identified instruments, 16 were generic instruments, 9 were domain-specific (i.e. mental health specific) instruments and 19 were disease- or subgroup-specific instruments. Generic instruments were the most commonly used (65.0%), followed by domain-specific instruments (20.3%), and disease- and subgroup-specific instruments (14.7%). Of the disease- and subgroup-specific instruments, six were developed for schizophrenia, five for eating disorders, two for veterans, while one was developed for attention-deficit/hyperactivity disorder (ADHD), bipolar depression, Gilles de la Tourette syndrome, forensic inpatients, older people, and patients under neuroleptic treatments. On average, the identified instruments included 35 items (median = 23, range = 5–143), and covered and average of 7 dimensions (median = 7, range = 2–17). Five instruments allowed for utility score calculations: the Short Form-6 Dimensions (SF-6D) [17], the EuroQol five-dimensional questionnaire (EQ-5D) [18], the Assessment of Quality of life-4 Dimensions (AQoL-4D) [19], the Assessment of Quality of life-8 Dimensions (AQoL-8D) [20], and the 15 Dimensional (15D) [21]. See Table 2 for the general characteristics of the identified instruments and Tables 4, 5 and 6 for the complete list of identified quality of life instruments, their frequency of use, and number of items and dimensions.

Table 2.

General characteristics of identified instruments

All instruments (N = 44) Generic instruments (N = 16) Domain-specific instruments (N = 9) Disease- and subgroup-specific instruments (N = 19)
Frequency of use (N, %) 1004 (100.0) 653 (65.0) 204 (20.3) 147 (14.7)
Number of items
Mean (SD) 37.2 (35.5) 23.3 (25.8) 66.2 (50.7) 35.1 (26.8)
Median 23 14 78 27
Range 4–143 4–100 15–143 12–131
Number of dimensions
Mean (SD) 7.6 (3.8) 6.1 (3.0) 10.8 (3.7) 7.4 (3.7)
Median 8 6 9 8
Range 2–17 3–15 8–17 2–15
Number of adapted versions (N, %) 12 (27.3) 9 (56.3) 1 (11.1) 4 (21.1)
Utility score available, Yes (N, %) 5 (11.4) 5 (31.3) 0 (0.0) 0 (0.0)

SD, standard deviation

Table 4.

General characteristics and dimension coverage of identified generic instruments

graphic file with name 12955_2021_1883_Tab4_HTML.jpg

Y, Yes; N, No

a Inline graphic indicates the dimension is fully covered; Inline graphic indicates the dimension is partially covered

bThe SF-6D was the reported instrument in 3 studies (0.3%); these studies did not report the actual administered instrument (i.e. SF-36 or SF-12)

Table 5.

General characteristics and dimension coverage of identified domain-specific instruments

graphic file with name 12955_2021_1883_Tab5_HTML.jpg

Y, Yes; N, No

a Inline graphic indicates the dimension is fully covered; Inline graphic indicates the dimension is partially covered

bThe mapping of the content onto the evaluation framework was based on the description of the items and dimensions in the development paper, since the instrument itself could not be retrieved (online or from the author)

Table 6.

General characteristics and dimension coverage of identified disease- and subgroup-specific instruments

graphic file with name 12955_2021_1883_Tab6_HTML.jpg

ADHD, Attention-Deficit/Hyperactivity Disorder; BP, Bipolar Depression; ED, Eating Disorders; FI, Forensic Inpatients; GTS, Gilles de la Tourette; N, No; PUNT, Patients Under Neuroleptic Treatment; SCZ, Schizophrenia; Y, Yes

a Inline graphic indicates the dimension is fully covered; Inline graphic indicates the dimension is partially covered

bThe mapping of the content onto the evaluation framework was based on the description of the items and dimensions in the development paper, since the instrument itself could not be retrieved (online or from the author)

Instruments' coverage of dimensions of the evaluation framework

The identified instruments differed in the extent to which they covered the dimensions of the evaluation framework (Tables 3, 4, 5, 6). The "Relationships and belonging" dimension was the most frequently covered (93%), followed by the "Activity" (89%), and "Physical health" (86%) dimensions. The least covered dimensions were the "Self-perception" and "Hope and hopelessness" dimensions, which were included in only 57% and 32% of all instruments, respectively. Compared to the generic instruments and disease- and subgroup-specific instruments, the quality of life instruments specially designed for use in the mental health field covered the "Relationships and belonging", "Activity", and "Autonomy" dimensions most frequently. Of all identified instruments, the World Health Organization's Quality of Life Instrument (WHOQOL-100) [22], the Schizophrenia Quality of Life Questionnaire 41 (S-QoL 41) [23], the Schizophrenia Quality of Life Scale (SQLS) [24], the Eating Disorder Quality of Life (EDQoL) [25], the Quality of Life Index (QLI) [26], and the Internet Mental Health Quality of Life scale (IMHQOL) [27] covered the dimensions of the evaluation framework best. None of the identified instruments fully covered all dimensions of the evaluation framework.

Table 3.

Frequency (N (%)) with which the identified quality of life instruments (fully or partially) cover the dimensions of the evaluation framework

Quality of life dimension All instruments (N = 44) Generic instruments (N = 16) Domain-specific instruments (N = 9) Disease- and subgroup-specific instruments (N = 19)
Well-being and ill-being 36 (82) 13 (81) 6 (67) 17 (89)
Relationships and belonging 41 (93) 13 (81) 9 (100) 19 (100)
Activity 39 (89) 13 (81) 9 (100) 17 (89)
Self-perception 25 (57) 8 (50) 5 (56) 12 (63)
Autonomy 28 (64) 7 (44) 9 (100) 12 (63)
Hope and hopelessness 14 (32) 3 (19) 2 (22) 9 (47)
Physical health 38 (86) 16 (100) 9 (100) 13 (68)

Discussion

The aim of this systematic review was to assess the content validity and suitability for use in economic evaluations of quality of life instruments used in people with mental health problems. A total of 44 unique instruments were identified, of which 12 were adapted versions of original instruments. The evaluation framework of Connell and colleagues was used to assess whether the identified quality of life instruments cover the dimensions valued highly by people with mental health problems. The best coverage of the dimensions of the evaluation framework was by the WHOQOL-100, S-QoL 41, SQLS, EDQoL, QLI and IMHQOL, but none fully covered the dimensions of the evaluation framework. The instruments with the best coverage of the dimensions of the evaluation framework lack a preference-based scoring algorithm, at present. In line with the study of Touré and colleagues [58], it was found that all identified preference-based instruments, which were all generic, cover the dimension “Physical health”, but generally lack coverage of mental health related (sub)dimensions. Of the five instruments that were found to have a preference-based scoring algorithm, the AQoL-8D had the most overlap with the framework of Connell and colleagues [12, 13].

The results of this study highlight the multitude of available quality of life instruments and support previous research questioning the ability of commonly used instruments to adequately measure and value the benefits of mental healthcare interventions [10]. The findings of this review suggest that this inability might be related to the content validity of the available quality of life instruments, since none of the identified preference-based instruments was found to fully cover the dimensions known valued highly by people with mental health problems. Noteworthy was the lack of coverage of the "Hope and hopelessness" and "Self-perception" dimensions, which were covered in only 14% and 34% of the identified instruments, respectively. Note that the low coverage of the “Hope and Hopelessness” dimension may be explained by the fact that this dimension may be, to a certain degree, transversal to depression and distress, which were underlying themes of the “Well-being” dimension. It is important to recognize differences in the coverage of dimensions in selecting the quality of life instruments of choice for evaluating the effectiveness of interventions, as they implicitly define the maximand of interventions. Another noteworthy finding was that the majority of identified instruments are non-preference-based and are, therefore, not directly useful for inclusion in cost-utility studies. In order to make available instruments suitable for use in cost-utility studies, health state utility values should be generated by use of utility-elicitation procedures or, as a second-best option, predicted by statistical association [59]. However, given that none of the identified instruments fully cover the dimensions valued highly by people with mental health problems, it seems advisable to first refine existing instruments or develop new quality of life instruments that cover all of the relevant dimensions. In the refinement or development of such instruments, next to their content validity, other elements of validity and reliability require much attention. Even more so, as, particularly in the mental health field, self-completion instruments may be less reliable in certain disease areas, as affected by the illness itself, and may be prone to bias due to effects of social desirability and stigma. In addition, in order to sufficiently reflect the impact of mental health problems on quality of life, but simultaneously prevent a loss of comparability of utility values across mental health diagnoses, such new instruments should preferably be domain-specific (i.e. mental health) in nature. It needs noting that such a strategy does raise numerous questions about the desired scope of such instruments and the subsequent comparability of outcomes across sectors. In other words, optimisation per domain may compromise the optimisation over domains. These issues are beyond the scope of the current review but require attention in future research.

This systematic review is strengthened by its use of a comprehensive search strategy, the bias protection measures taken (e.g. the independent and duplicate screening and reviewing of identified studies), the executed dimension analysis of identified instruments based on a scientifically founded evaluation framework, and the inclusion of studies focusing on populations with clinical and subclinical primary mental health problems.

Despite the strengths of this review, some limitations should be noted. First, the review was restricted to peer-reviewed studies published in the Embase, Medline and PsycINFO databases. Expanding the search strategy by, for instance, including grey literature, using snowballing or including other databases such as the Cochrane Central Register of Controlled Trials, might have produced (even) more results. Hence, some relevant studies may have been missed in the current review. Second, most of the included studies were conducted in Europe, North America, and Asia. Future research could explore the reasons for the relatively low frequency of use of quality of life instruments in mental health research in other continents. Third, given our focus on published studies up to 2018, we may have missed recent developments in the field of quality of life assessment. One important quality of life instrument, specifically designed for use in the mental health field, that has become available since the completion of our review is the Recovering Quality of Life (ReQoL) measure [60]. The ReQoL measure is a preference-based [61] patient reported outcome measure that was explicitly designed to cover all seven dimensions of the evaluation framework used in the current study. The development of the ReQoL measure highlights the need and search for outcome instruments that adequately measure and value the benefits of mental healthcare interventions. Further work is required to assess how the ReQoL performs in various contexts, especially in the contexts in which existing quality of life measures lack the sensitivity to sufficiently reflect the impact of mental health problems on quality of life, and in relation to other outcome measures identified in this study. Fourth, given the focus on the identification of quality of life instruments used in people with mental health problems, we might have missed relatively new instruments that were available but not used in studies published in the reference period of our search. The Clinical Outcomes in Routine Evaluation (CORE)-6D [62] is an example of such a measure. Given the rapid developments in this field, it is advisable that studies like the present one are repeated in the future. Fifth, since the aim of the review was to identify available quality of life instruments used in people with mental health problems and assess whether these instruments cover the dimensions found to be important in people with mental health problems (content validity), the analysis does not take anything regarding the other psychometric performance of the identified instruments into account. Inclusion of quality of life instruments in studies on the (cost-)effectiveness of mental health interventions should be based on and motivated by evidence on all psychometric properties of the instruments, as for example assessed by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) [63]. Hence, even if instruments cover most of the dimensions of the evaluation framework, it does not imply that these instruments are recommended over others, nor does it imply that these instruments are the best available for use in people with mental health problems. In addition, failure to meet the criteria of the evaluation framework is not a disqualification of the instrument as such, but it raises questions about the suitability of the instruments when used in the context of mental health. The findings of this study could, however, enhance the selection of the most suitable instruments in terms of their coverage of dimensions and practical characteristics such as number of items and the availability of preference-based utility values. Sixth, the study population of one of the studies underlying the evaluation framework [13] only included mental healthcare service users, not a wider population of people with mental health problems. This may have influenced the dimensions of quality of life in the framework. However, in the absence of studies examining the important quality of life dimensions in a broader, mixed population with people with mental health problems, the study carried out by Connell and colleagues [13] was considered the best available to base the framework on. Seventh, the adoption of the framework by Connell and colleagues [12, 13] implicitly implies that life domains considered important by the relevant population should determine the evaluative scope of an economic evaluation. This matter can be debated and relates to normative questions of what should be maximized (health or more general well-being), whether outcome measures should be generic or may be domain-specific, and the appropriate source for domains and their relative valuations. These are crucial questions that fall outside the scope of the current study. Eighth, the mapping of the dimensions of the identified instruments onto the evaluation framework was inherently subjective. In order to minimise the subjective nature of the mapping procedure, the dimensions of each identified instrument were assessed and mapped onto the evaluation framework by two reviewers in a structured, independent manner using standardized criteria.

Conclusions

The results of this study highlight the multitude of available quality of life instruments and lack of consensus regarding the choice of instruments used in people with mental health problems. In addition, the results could enhance the selection of the most suitable instruments in terms of their coverage of dimensions and practical characteristics. At the same time, the increasing importance of quality of life measurement in clinical and research settings emphasizes the need for more methodological studies on quality of life measurement in the mental health field. More specifically, future research could evaluate and compare the psychometric properties of promising instruments, and obtain preference-based utility values for these instruments to make them suitable for use in cost-effectiveness studies. In addition, since the results of this study suggest that none of the identified instruments cover all the dimensions found to be important in people with mental health problems, future research could explore the possibilities of refining existing instruments or the development of a new quality of life instrument that covers all of the dimensions valued highly by people with mental health problems. Future research on these issues remains crucial to capture the benefits of interventions targeted at people with mental health problems and facilitate the comparison of the clinical and cost-effectiveness of mental healthcare interventions, which in turn could improve the allocation of scarce resources in the mental health field.

Supplementary Information

12955_2021_1883_MOESM3_ESM.pdf (618.3KB, pdf)

Additional file 3. References of included studies. 

Acknowledgements

We thank Wichor M. Bramer, biomedical information specialist, Medical Library, Erasmus MC University Medical Center for the assistance in the literature search.

Abbreviations

15D

15 Dimensional

AAQol

Adult ADHD quality of life scale

ADHD

Attention-deficit/hyperactivity disorder

AQoL-4D

Assessment of quality of life-4 dimensions

AQoL-8D

Assessment of quality of life-8 dimensions

Bref QoL.BD

Brief version of quality of life in bipolar disorder

CDC HRQOL‐4

Centers for Disease Control Health‐Related Quality of Life Core Module

COSMIN

COnsensus-based Standards for the selection of health Measurement INstruments

CSCV

Seville Quality of Life Questionnaire

DSM

Diagnostic and statistical manual

EDQLS

Eating disorders quality of life survey

EDQoL

Eating disorder quality of life

EDQoL

Eating disorder quality of life

EQ-5D

EuroQol five-dimensional

EUROHIS-QOL

European health interview survey-quality of life

FQL

Forensic Inpatient Quality of Life Questionnaire

GTS-QoL

Gilles de la Tourette syndrome-quality of life scale

HeRQoLED

Health-related quality of life in eating disorders

IMHQOL

Internet mental health quality of life scale

LQoLP

Lancashire quality of life profile

MANSA

Manchaster short assessment of quality of life

PRISMA

Preferred reporting items for systematic reviews and meta-analyses

PWI-A

Personal wellbeing index-adult

Q-LES-Q-SF

Quality of Life, Enjoyment, and Satisfaction Questionnaire-Short Form

Q-LES-Q

Quality of Life, Enjoyment, and Satisfaction Questionnaire

QALYs

Quality-adjusted life-years

QLI

Quality of life index

QLiS

Quality-of-life in schizophrenia

QLS

Heinrichs-carpenter quality of life scale

QOL ED

Quality of life eating disorders

QoL

Quality of life

QOLI

Quality of life inventory

QOLS

Quality of life scale

RCT

RCT Randomized controlled trial

ReQoL

Recovering quality of life

S-QoL 41

Schizophrenia Quality of Life Questionnaire 41

S-QoL

Schizophrenia Quality of Life Questionnaire

SD

Standard deviation

SF-12

12-Item short-form health survey

SF-36

36-Item short-form health survey

SF-6D

Short form-6 dimensions

SLDS

Satisfaction with life domains scale

SQLS

Schizophrenia quality of life scale

SQLS

Schizophrenia quality of life scale

SWN-20

Subjective well-being under neuroleptic treatment scale short form

VR

Veterans rand health survey

W-QLI

Wisconsin quality of life index for mental health

WHOQOL-100

World Health Organization's Quality of Life Instrument

WHOQOL-BREF

World Health Organization's Quality of Life Instrument-Short Version

WHOQOL-OLD

World Health Organization Quality of Life Questionnaire-Older Adults Module

Authors' contributions

FK, KF, JB, LH, and WB were involved in the conceptualization of the study. FK and KF analyzed the data and drafted the manuscript. JB, LH, and WB reviewed the drafts of the manuscript. All authors read and approved the final manuscript.

Funding

No funding was received.

Availability of data and materials

The dataset used and/or analysed during the current study are available from the corresponding author on reasonable request.

Declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Harris A, Buxton M, Orien B, Drummond RF, Drummond M. Using economic evidence in reimbursement decisions for health technologies: experience of 4 countries. Exp Rev Pharmacoecon Outcomes Res. 2001;1(1):7. doi: 10.1586/14737167.1.1.7. [DOI] [PubMed] [Google Scholar]
  • 2.Franken M, le Polain M, Cleemput I, Koopmanschap M. Similarities and differences between five European drug reimbursement systems. Int J Technol Assess Health Care. 2012;28(4):349–357. doi: 10.1017/S0266462312000530. [DOI] [PubMed] [Google Scholar]
  • 3.Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2015. [Google Scholar]
  • 4.Weinstein MC, Torrance G, McGuire A. QALYs: the basics. Value Health. 2009;12:S5–S9. doi: 10.1111/j.1524-4733.2009.00515.x. [DOI] [PubMed] [Google Scholar]
  • 5.Brazier J. Is the EQ-5D fit for purpose in mental health? Br J Psychiatry. 2010;197(5):348–349. doi: 10.1192/bjp.bp.110.082453. [DOI] [PubMed] [Google Scholar]
  • 6.Papaioannou D, Brazier J, Parry G. How valid and responsive are generic health status measures, such as EQ-5D and SF-36, in schizophrenia? A systematic review. Value Health. 2011;14(6):907–920. doi: 10.1016/j.jval.2011.04.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Saarni SI, Viertiö S, Perälä J, Koskinen S, Lönnqvist J, Suvisaari J. Quality of life of people with schizophrenia, bipolar disorder and other psychotic disorders. Br J Psychiatry. 2010;197(5):386–394. doi: 10.1192/bjp.bp.109.076489. [DOI] [PubMed] [Google Scholar]
  • 8.Lamers L, Bouwmans C, van Straten A, Donker M, Hakkaart L. Comparison of EQ-5D and SF-6D utilities in mental health patients. Health Econ. 2006;15(11):1229–1236. doi: 10.1002/hec.1125. [DOI] [PubMed] [Google Scholar]
  • 9.Mulhern B, Mukuria C, Barkham M, Knapp M, Byford S, Brazier J. Using generic preference-based measures in mental health: psychometric validity of the EQ-5D and SF-6D. Br J Psychiatry. 2014;205(3):236–243. doi: 10.1192/bjp.bp.112.122283. [DOI] [PubMed] [Google Scholar]
  • 10.Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T, et al. A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess. 2014;18(34):1–188. doi: 10.3310/hta18340. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Makai P, Brouwer WB, Koopmanschap MA, Stolk EA, Nieboer AP. Quality of life instruments for economic evaluations in health and social care for older people: a systematic review. Soc Sci Med. 2014;102:83–93. doi: 10.1016/j.socscimed.2013.11.050. [DOI] [PubMed] [Google Scholar]
  • 12.Connell J, Brazier J, O’Cathain A, Lloyd-Jones M, Paisley S. Quality of life of people with mental health problems: a synthesis of qualitative research. Health Qual Life Outcomes. 2012;10(1):138. doi: 10.1186/1477-7525-10-138. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Connell J, O'Cathain A, Brazier J. Measuring quality of life in mental health: are we asking the right questions? Soc Sci Med. 2014;120:12–20. doi: 10.1016/j.socscimed.2014.08.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;62(10):e1–e34. doi: 10.1016/j.jclinepi.2009.06.006. [DOI] [PubMed] [Google Scholar]
  • 15.Whoqol Group Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med. 1998;28(3):551–558. doi: 10.1017/S0033291798006667. [DOI] [PubMed] [Google Scholar]
  • 16.Ware Jr JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care. 1992:473–483. [PubMed]
  • 17.Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–292. doi: 10.1016/S0167-6296(01)00130-8. [DOI] [PubMed] [Google Scholar]
  • 18.Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997:1095–1108. [DOI] [PubMed]
  • 19.Hawthorne G, Richardson J, Osborne R. The Assessment of Quality of Life (AQoL) instrument: a psychometric measure of health-related quality of life. Qual Life Res. 1999;8(3):209–224. doi: 10.1023/A:1008815005736. [DOI] [PubMed] [Google Scholar]
  • 20.Richardson J, Iezzi A, Khan MA, Maxwell A. Validity and reliability of the Assessment of Quality of Life (AQoL)-8D multi-attribute utility instrument. Patient Patient Cent Outcomes Res. 2014;7(1):85–96. doi: 10.1007/s40271-013-0036-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Sintonen H. The 15D instrument of health-related quality of life: properties and applications. Ann Med. 2001;33(5):328–336. doi: 10.3109/07853890109002086. [DOI] [PubMed] [Google Scholar]
  • 22.Group TW The World Health Organization quality of life assessment (WHOQOL): development and general psychometric properties. Soc Sci Med. 1998;46(12):1569–1585. doi: 10.1016/S0277-9536(98)00009-4. [DOI] [PubMed] [Google Scholar]
  • 23.Auquier P, Simeoni M, Sapin C, Reine G, Aghababian V, Cramer J, et al. Development and validation of a patient-based health-related quality of life questionnaire in schizophrenia: the S-QoL. Schizophr Res. 2003;63(1–2):137–149. doi: 10.1016/S0920-9964(02)00355-9. [DOI] [PubMed] [Google Scholar]
  • 24.Wilkinson G, Hesdon B, Wild D, Cookson R, Farina C, Sharma V, et al. Self-report quality of life measure for people with schizophrenia: the SQLS. Br J Psychiatry. 2000;177(1):42–46. doi: 10.1192/bjp.177.1.42. [DOI] [PubMed] [Google Scholar]
  • 25.Engel SG, Wittrock DA, Crosby RD, Wonderlich SA, Mitchell JE, Kolotkin RL. Development and psychometric validation of an eating disorder-specific health-related quality of life instrument. Int J Eat Disord. 2006;39(1):62–71. doi: 10.1002/eat.20200. [DOI] [PubMed] [Google Scholar]
  • 26.Ferrans CE, Powers MJ. Quality of life index: development and psychometric properties. Adv Nurs Sci. 1985. [DOI] [PubMed]
  • 27.Long PW. Internet mental health quality of life scale (IMHQOL). https://www.mentalhealth.com/qol/qol.html
  • 28.Ware Jr JE, Kosinski M, Keller SD. A 12-Item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996:220–233. [DOI] [PubMed]
  • 29.Schmidt S, Mühlan H, Power M. The EUROHIS-QOL 8-item index: psychometric results of a cross-cultural field study. Eur J Public Health. 2005;16(4):420–428. doi: 10.1093/eurpub/cki155. [DOI] [PubMed] [Google Scholar]
  • 30.Flanagan JC. A research approach to improving our quality of life. Am Psychol. 1978;33(2):138. doi: 10.1037/0003-066X.33.2.138. [DOI] [Google Scholar]
  • 31.Flanagan JC. Measurement of quality of life: current state of the art. Arch Phys Med Rehabil. 1982;63(2):56–59. [PubMed] [Google Scholar]
  • 32.Moriarty DG, Zack MM, Kobau R. The centers for disease control and prevention's healthy days measures-population tracking of perceived physical and mental health over time. Health Qual Life Outcomes. 2003;1(1):37. doi: 10.1186/1477-7525-1-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Cummins RA, Eckersley R, Pallant J, Van Vugt J, Misajon R. Developing a national index of subjective wellbeing: The Australian Unity Wellbeing Index. Soc Indicators Res. 2003;64(2):159–190. doi: 10.1023/A:1024704320683. [DOI] [Google Scholar]
  • 34.Lindholt JS, Ventegodt S, Henneberg EW. Development and validation of QoL5 for clinical databases. A short, global and generic questionnaire based on an integrated theory of the quality of life. Eur J Surg. 2002;168(2):107–113. doi: 10.1080/11024150252884331. [DOI] [PubMed] [Google Scholar]
  • 35.Endicott J, Nee J, Harrison W, Blumenthal R. Quality of Life Enjoyment and Satisfaction Questionnaire: a new measure. Psychopharmacol Bull. 1993. [PubMed]
  • 36.Lehman AF. A quality of life interview for the chronically mentally ill. Eval Program Plan. 1988;11(1):51–62. doi: 10.1016/0149-7189(88)90033-X. [DOI] [Google Scholar]
  • 37.Priebe S, Huxley P, Knight S, Evans S. Application and results of the Manchester Short Assessment of Quality of Life (MANSA) Int J Soc Psychiatry. 1999;45(1):7–12. doi: 10.1177/002076409904500102. [DOI] [PubMed] [Google Scholar]
  • 38.Frisch MB. Quality-of-life-inventory. Encyclopedia of quality of life and well-being research. 2014:5374–5377.
  • 39.Oliver J, Huxley P, Priebe S, Kaiser W. Measuring the quality of life of severely mentally ill people using the Lancashire Quality of Life Profile. Soc Psychiatry Psychiatr Epidemiol. 1997;32(2):76–83. doi: 10.1007/BF00788924. [DOI] [PubMed] [Google Scholar]
  • 40.Becker M, Diamond R, Sainfort F. A new patient focused index for measuring quality of life in persons with severe and persistent mental illness. Qual Life Res. 1993;2(4):239–251. doi: 10.1007/BF00434796. [DOI] [PubMed] [Google Scholar]
  • 41.Baker F, Intagliata J. Quality of life in the evaluation of community support systems. Eval Program Plan. 1982;5(1):69–79. doi: 10.1016/0149-7189(82)90059-3. [DOI] [PubMed] [Google Scholar]
  • 42.Heinrichs DW, Hanlon TE, Carpenter WT., Jr The Quality of Life Scale: an instrument for rating the schizophrenic deficit syndrome. Schizophr Bull. 1984;10(3):388–398. doi: 10.1093/schbul/10.3.388. [DOI] [PubMed] [Google Scholar]
  • 43.Boyer L, Simeoni M, Loundou A, D'Amato T, Reine G, Lancon C, et al. The development of the S-QoL 18: a shortened quality of life questionnaire for patients with schizophrenia. Schizophr Res. 2010;121(1–3):241–250. doi: 10.1016/j.schres.2010.05.019. [DOI] [PubMed] [Google Scholar]
  • 44.Brod M, Johnston J, Able S, Swindle R. Validation of the adult attention-deficit/hyperactivity disorder quality-of-life Scale (AAQoL): a disease-specific quality-of-life measure. Qual Life Res. 2006;15(1):117–129. doi: 10.1007/s11136-005-8325-z. [DOI] [PubMed] [Google Scholar]
  • 45.Kazis LE, Lee A, Spiro A, Rogers W, Ren XS, Miller DR, et al. Measurement comparisons of the medical outcomes study and veterans SF-36 health survey. Health Care Financ Rev. 2004;25(4):43–58. [PMC free article] [PubMed] [Google Scholar]
  • 46.Selim AJ, Rogers W, Fleishman JA, Qian SX, Fincke BG, Rothendler JA, et al. Updated US population standard for the Veterans RAND 12-item health survey (VR-12) Qual Life Res. 2009;18(1):43–52. doi: 10.1007/s11136-008-9418-2. [DOI] [PubMed] [Google Scholar]
  • 47.Franz M, Fritz M, Gallhofer B, Meyer T. QLiS–development of a schizophrenia-specific quality-of-life scale. Health Qual Life Outcomes. 2012;10(1):61. doi: 10.1186/1477-7525-10-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Michalak EE, Murray G, Crest BD. Development of the QoL. BD: a disorder-specific scale to assess quality of life in bipolar disorder. Bipolar Disord. 2010;12(7):727–740. doi: 10.1111/j.1399-5618.2010.00865.x. [DOI] [PubMed] [Google Scholar]
  • 49.Giner J, Ibáñez E, Baca E, Bobes J, Leal C, Cervera S. Desarrollo del cuestionario Sevilla de Calidad de Vida (CSCV) Actas Luso-Esp Neurol Psiquiatr. 1997;25(2):11–23. [Google Scholar]
  • 50.Vorstenbosch E, Bulten B, Bouman Y, Braun P. Forensic inpatient quality of life questionnaire. Nijmegen: Pompestichting; 2007. [Google Scholar]
  • 51.Las Hayas C, Quintana JM, Padierna Á, Bilbao A, Muñoz P, Madrazo A, et al. The new questionnaire health-related quality of life for eating disorders showed good validity and reliability. J Clin Epidemiol. 2006;59(2):192–200. doi: 10.1016/j.jclinepi.2005.06.005. [DOI] [PubMed] [Google Scholar]
  • 52.Las Hayas C, Quintana JM, Padierna JA, Bilbao A, Muñoz P. Use of rasch methodology to develop a short version of the Health related quality of life for eating disorders questionnaire: a prospective study. Health Qual Life Outcomes. 2010;8(1):29. doi: 10.1186/1477-7525-8-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Naber D, Karow A, Lambert M. Subjective well-being under neuroleptic treatment and its relevance for compliance. Acta Psychiatr Scand. 2005;111:29–34. doi: 10.1111/j.1600-0447.2005.00542.x. [DOI] [PubMed] [Google Scholar]
  • 54.Power M, Quinn K, Schmidt S. Development of the WHOQOL-old module. Qual Life Res. 2005;14(10):2197–2214. doi: 10.1007/s11136-005-7380-9. [DOI] [PubMed] [Google Scholar]
  • 55.Adair CE, Marcoux GC, Cram BS, Ewashen CJ, Chafe J, Cassin SE, et al. Development and multi-site validation of a new condition-specific quality of life measure for eating disorders. Health Qual Life Outcomes. 2007;5(1):23. doi: 10.1186/1477-7525-5-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Cavanna AE, Schrag A, Morley D, Orth M, Robertson M, Joyce E, et al. The Gilles de la Tourette syndrome–quality of life scale (GTS-QOL): development and validation. Neurology. 2008;71(18):1410–1416. doi: 10.1212/01.wnl.0000327890.02893.61. [DOI] [PubMed] [Google Scholar]
  • 57.Abraham SF, Brown T, Boyd C, Luscombe G, Russell J. Quality of life: eating disorders. Aust N Z J Psychiatry. 2006;40(2):150–155. doi: 10.1080/j.1440-1614.2006.01762.x. [DOI] [PubMed] [Google Scholar]
  • 58.Touré M, Kouakou CR, Poder TG. Dimensions used in instruments for QALY calculation: a systematic review. Int J Environ Res Public Health. 2021;18(9):4428. doi: 10.3390/ijerph18094428. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Brazier JE, Yang Y, Tsuchiya A, Rowen DL. A review of studies mapping (or cross walking) non-preference based measures of health to generic preference-based measures. Eur J Health Econ. 2010;11(2):215–225. doi: 10.1007/s10198-009-0168-z. [DOI] [PubMed] [Google Scholar]
  • 60.Keetharuth AD, Brazier J, Connell J, Bjorner JB, Carlton J, Buck ET, et al. Recovering quality of life (ReQoL): a new generic self-reported outcome measure for use with people experiencing mental health difficulties. Br J Psychiatry. 2018;212(1):42–49. doi: 10.1192/bjp.2017.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Keetharuth AD, Rowen D, Bjorner JB, Brazier J. Estimating a preference-based index for mental health from the recovering quality of life measure: valuation of recovering quality of life utility index. Value Health. 2021;24(2):281–290. doi: 10.1016/j.jval.2020.10.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Mavranezouli I, Brazier JE, Young TA, Barkham M. Using Rasch analysis to form plausible health states amenable to valuation: the development of CORE-6D from a measure of common mental health problems (CORE-OM) Qual Life Res. 2011;20(3):321–333. doi: 10.1007/s11136-010-9768-4. [DOI] [PubMed] [Google Scholar]
  • 63.Prinsen CA, Mokkink LB, Bouter LM, Alonso J, Patrick DL, De Vet HC, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–1157. doi: 10.1007/s11136-018-1798-3. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

12955_2021_1883_MOESM3_ESM.pdf (618.3KB, pdf)

Additional file 3. References of included studies. 

Data Availability Statement

The dataset used and/or analysed during the current study are available from the corresponding author on reasonable request.


Articles from Health and Quality of Life Outcomes are provided here courtesy of BMC

RESOURCES