Skip to main content
Evidence-Based Mental Health logoLink to Evidence-Based Mental Health
. 2021 Dec 23;25(2):85–92. doi: 10.1136/ebmental-2021-300334

Patient-reported outcome measures suitable for quality of life/well-being assessment in multisectoral, multinational and multiperson mental health economic evaluations

Agata Łaszewska 1, Timea Mariann Helter 1, Anna Nagel 1, Nataša Perić 1, Judit Simon 1,
PMCID: PMC9046758  PMID: 34949634

Abstract

Question

The aim was to systematically collate and synthesise existing, publicly available patient-reported outcome measure (PROM) information suitable for quality of life (QOL)/well-being measurement in mental health economic evaluations, with specific focus on their applicability in multisectoral, multinational, multiperson economic evaluations and to develop an electronic PROM compendium with meta-data.

Study selection and analysis

A systematic literature search for non-disease-pecific PROMs and their versions suitable for the measurement of QOL/well-being or recovery was conducted from 2008 to February 2020. Six criteria were applied to judge their suitability in multisectoral, multinational, multiperson economic evaluations: (i) availability of separate adult and child/adolescent versions, (ii) availability of a proxy-completion option, (iii) assessing outcomes beyond health, (iv) availability of translations (≥2 language versions), (v) availability of a preference-based valuation, (vi) availability of value sets in more than one country.

Findings

The final ProgrammE in Costing, resource use measurement and outcome valuation for Use in multisectoral National and International health economic evaluAtions (PECUNIA) PROM-MH Compendium includes 204 unique scales, out of which 88 are individual instruments, while the remaining 116 scales belong to 46 PROM families with more than one distinctive version. Out of the total 134 individual PROMs/PROM families, 72% have at least two language versions, 8% measure broader well-being beyond health-related QOL, 11% have preference-based valuation, with multiple country sets available for 60% of these. None of the identified PROMs met all six proposed criteria.

Conclusions

The PECUNIA PROM-MH Compendium provides a unique overview of the relevant PROMs and their linked meta-data, and should be a helpful tool when choosing a suitable instrument for future mental health economic evaluations.

Background

The positive impacts of using patient-reported outcomes (PROs) in monitoring quality of care and improving health outcomes have generated increasing interest in their wide-ranging application. Several Health Technology Assessment (HTA) agencies require evidence on PROs to assess the effectiveness of health interventions.1–4 PROs are defined as a subjective assessment of health and/or disability provided directly by the patient without any interpretation by a clinician or other health professional.5 6 Patient-reported outcome measures (PROMs) are instruments developed to assess PROs that comprise a series of structured questions that ask patients for example about their health status, quality of life (QOL) or well-being from their point of view at a single point in time.7 8

Typology of PROMs include instruments that are non-disease specific, that is, considering a broad range of generic dimensions of QOL that, in principle, could be impacted by any disease; or disease-specific, that is, concentrating on dimensions impacted by a particular disease.9 Since disease-specific instruments have a limited use to comparisons between studies within the same disease area only, generic measures are preferred for (economic) evaluative purposes.10 Both disease-specific and generic instruments can be accompanied by utilities/value sets to facilitate the estimation of quality-adjusted life years (QALYs), which can be used in economic evaluations to assess the value of medical interventions.11

QOL is ‘a broad construct reflecting subjective or objective judgement concerning all aspect of individual’s existence, including health, economic, political, cultural, environmental, aesthetic and spiritual aspects’.12 Health-related quality of life (HRQOL) is part of QOL assessment that focuses on the impact of health on the person’s overall well-being.13 14 The scope of some commonly used HRQOL PROMs (eg, EuroQoL Five Dimensions (EQ-5D)) might not reflect all important consequences of health-related interventions. In recent years, new measures have been developed with the focus on well-being broader than HRQOL, such as, social care-related QOL (Adult Social Care Outcomes Toolkit (ASCOT)),15 process of recovery for users of mental health services (ReQoL)16 or capabilities (eg, ICEpop CAPability measure (ICECAP), Oxford CAPabilities questionnaire-Mental Health (OxCAP-MH)).17 18 Moreover, for disease areas with major impact on the health and well-being of carers and families (eg, mental health problems or chronic diseases), multiperson outcomes may have to be measured and valued jointly, preferably within the same framework and with the same method.

Outcome measurement within the area of mental health deserves special attention due to the increasing disease burden of mental health disorders,19 20 paired with a proportionally low expenditure on mental healthcare worldwide.21 The cumulative global economic impact of mental, neurological and substance use disorders was estimated at US$16.3 trillion between 2011 and 2030, exceeding cardiovascular disease, chronic respiratory disease, cancer and diabetes in its contribution to global burden of disease.21 However, standard methods can only be applied with some caution.22 A general issue is that mental health service users often have more than one diagnosis, particularly those with severe and complex problems.23 Furthermore, QALYs, the most commonly used outcome measure for economic evaluations, have limited ability to capture effects beyond direct health impacts (eg, educational attainment, work productivity, self-realisation, safety, discrimination, freedom of choice, social networks, attachment, control), may be insensitive to the impact of social care interventions, and likely underestimate the full welfare impact of mental health interventions.22 24 This resulted in the recent development of several PROMs that could potentially be used for broader well-being measurement in the economic evaluation of mental health interventions. However, the choice between these instruments and their practical application in particular contexts lack a systematic approach.25 26

Objective

The ProgrammE in Costing, resource use measurement and outcome valuation for Use in multisectoral National and International health economic evaluAtions (PECUNIA) project aimed to tackle the healthcare challenges of an ever-growing and rapidly ageing population in the European Union by developing new standardised, harmonised and validated methods and tools for the assessment of costs and outcomes in European healthcare systems (https://pecunia-project.eu/). The project used selected mental disorders (schizophrenia, depression, post-traumatic stress disorder) as illustrative examples to address methodological issues at their maximum in dealing with complex services, major intersectoral economic and social consequences and broader well-being impacts in all ages, and to contribute to major public health challenges with highly needed applied evidence. One work stream of the project focused on improving the methods and tools for comparable outcome assessment in economic evaluations of mental health interventions. To achieve this goal, one of the tasks was to harmonise methods for broader health and well-being impact measurement across sectors, countries and age groups using PROMs. Therefore, this study aimed to systematically collate and synthesise existing, publicly available generic and mental health-specific QOL PROM information and compile their meta-data in the form of an electronic compendium, the PECUNIA PROM-MH Compendium. The goal was to develop a compendium that provides comparable, easily searchable information about PROMs potentially suitable for QOL/well-being measurement for mental health economic evaluations. In addition, the specific applicability of PROMs in multisectoral, multinational, multiperson economic evaluations was assessed.

Study selection and analysis

Systematic literature review

The aim of the systematic literature review was to identify self-reported, non-mental health disease-specific (ie, not specific to a single mental disorder) PROMs used in mental health research for the measurement of QOL/well-being outcomes (including recovery) potentially suitable for economic evaluations. The protocol for the literature review has been registered in the PROSPERO database (CRD42018117800), and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklist is shown in the online Ssupplementalry material. Five bibliographic databases (Embase, Medline, PsycINFO, Social Science Citation Index and CINAHL) were searched in 2018 for the past 10 years (2008 onwards) with an updated search in February 2020. This restriction on time-period was deemed appropriate in order to capture instruments actively in use for outcome measurement over the past 10 years, and was in line with the period for significantly increased annual number of internationally published economic evaluations as reported by the NHS EED.27 Therefore, the potential marginal benefit of bibliographic searches for instruments in use only prior to 2008 was not in line with the estimated additional workload and the expected relevance of the findings to the study’s overall objective. Instead, we used reference searches of existing reviews and PROM databases as part of the secondary searches reported below for this purpose. No language restrictions were applied in the search, but eventually articles in the languages represented in the PECUNIA Group were included (Dutch, English, German, Hungarian, Polish, Spanish). Search strategy exported from Medline (searched via Ovid) is presented in online supplemental table 1.

Supplementary data

ebmental-2021-300334supp001.pdf (349.7KB, pdf)

Two independent researchers (AŁ and TMH) screened titles and abstracts of the identified de-duplicated records, while the third reviewer (JS) decided on the inclusion/exclusion of articles if there was no agreement between the two independent researchers. At this stage, studies were excluded using the following exclusion criteria: (i) not relevant for mental health outcome measurement (ie, the study was not concerned with a mental health condition), (ii) no standardised PROM was used, (iii) outcome other than QOL/well-being or recovery was measured, (iv) only disease-specific outcome was measured (ie, neither generic PROMs, nor those designed for mental health overall), (v) study was a systematic literature review/editorial/commentary, (vi) only abstract available. The full texts of potentially eligible studies were retrieved and independently assessed for eligibility by two review team members (AŁ and TMH).

Additional grey literature search was conducted to identify instruments that have not been captured in the systematic search of bibliographic databases. The search included the COSMIN database of systematic reviews of outcomes measurement instruments (https://database.cosmin.nl/), previous systematic literature reviews of PROMs searched in Medline by searching the keywords describing a ‘review’ and ‘PROM’. Finally, existing online PROM databases (eg, https://scireproject.com/outcome-measures/) were searched to identify relevant PROM instruments. The final list of 21 systematic reviews and 7 databases from which information was later extracted is provided in online supplemental appendix table 2.

Inclusion of PROMs

Individual PROMs were identified and extracted from all eligible studies from the bibliographic database search. PROMs were included if they measured QOL/well-being (including recovery) and were generic or designed for use in a broad field of mental health diseases without being disease-specific.

According to existing definitions, the term QOL encompasses a broad range of aspects, and boundaries between QOL and well-being are increasingly blurred.12 28 29 Therefore, in this work, QOL and well-being are presented as overlapping concepts. Moreover, according to several existing definitions, concepts such as happiness, spirituality and life satisfaction are part of QOL.30 Therefore, all instruments measuring and valuing QOL (including HRQOL), well-being as well as happiness, spirituality and life satisfaction were considered with multisectoral referring to those measures that are able to capture outcomes beyond individual health (eg, capabilities, social outcomes). Since recovery was identified in the scoping review as a related concept with particular importance in the context of mental disorders,31 and personal recovery is increasingly emphasised as key in evaluation of mental health interventions,37 instruments measuring recovery in mental diseases were also included. Other concepts such as resilience, which focus particularly on the ‘ability to withstand, adapt to and recover from adversity and stress’32 rather than overall QOL/well-being, were not identified or included.

In addition, different versions of identified PROMs and additional PROMs extracted from the scoping review search were included. PROMs from all sources were compiled into one list.

Secondary searches and extraction of meta-data

Secondary searches were conducted with the aim to locate most up-to-date PROM meta-data information. Meta-data were searched in Google, Google Scholar, Google Books, PubMed, instrument manuals, review articles, other available peer-reviewed publications and other web-based sources. The secondary search strategy is presented in online supplemental appendix table 3. Extraction of the meta-data information was conducted between April and July 2020.

The extracted meta-data of included instruments were compiled in Microsoft Excel. A specific extraction template was developed by the authors of this study and reviewed by outcome research experts within the PECUNIA project to present the most crucial PROM characteristics in a concise, transparent and replicable way. Elements were organised into the following sections: (1) basic characteristics; (2) scoring information; (3) availability of validation studies in mental health; (4) application in multisectoral, multinational, multiperson economic evaluations and (5) other information. Six criteria were applied to judge the suitability of PROMs for the application in multisectoral, multinational and multiperson evaluations. They are outlined in table 1.

Table 1.

Assessment criteria applied to the identified PROMs

Assessment category Assessment criteria
Multiperson (i) Availability of separate adult and child/adolescents versions
(ii) Availability of a proxy-completion option
Multisectoral (iii) Feasibility of assessing outcomes beyond a person’s individual health, that is, capabilities, social outcomes
Multinational (iv) Availability of multiple translations (two or more language versions of the instrument)
Economic evaluation (v) Availability of a preference-based value set
(vi) Availability of preference-based value sets in more than one country

PROM, patient-reported outcome measure.

Findings

Systematic literature review

The PRISMA chart (figure 1) presents the process of identifying the relevant PROMs. Bibliographic database and grey literature searches initially resulted in 313 unique instruments, and a further 29 questionnaires that were different versions of them (eg, 17D was added as a version of 15D, Control, Autonomy, Self-realization, and Pleasure scale (CASP)-12 was added as a version of CASP-19). Overall, 204 unique instruments were included. Of these, 88 were individual PROMs that had no other related versions available (eg, brief version or adolescent/child version). The other 116 instruments were eventually grouped into 46 PROM families meaning that at the time of the data extraction there were two or more related questionnaires belonging to the same ‘family’ of instruments (eg, questionnaires 15D, 16D, 17D grouped into 15D family).

Figure 1.

Figure 1

Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow chart. PROM, patient-reported outcome measure; SLR, systematic literature review.

Characteristics of the included PROMs

A total of 204 individual instruments were included for meta-data extraction along 47 meta-data categories. When the relevant information could not be identified, ‘not known’ was entered in the respective data field. A summary of the main characteristics of PROMs is provided in table 2. PROMs were mostly designed for adults (n=152; 74%), the majority was developed in the 1990s (n=73; 36%) and 2000s (n=70; 34%), most frequently in Europe (n=91; 45%) or North America (n=88; 43%). The vast majority (n=165; 81%) of the extracted instruments were generic, whereas 19% (n=39) were designed for use in a broad field of mental health diseases and thereby allow comparison across the area of mental health without being disease-specific. Regarding the characteristics of individual PROMs or PROM families relevant to multisectoral, multinational, multiperson economic evaluations, the total number of scales equalled 134 with each PROM family counted as one. The list of PROMs (n=204) included in the review is provided in online supplemental appendix table 4.

Table 2.

Summary characteristics of individual PROMs

Characteristics of individual PROMs (n=204) N %
Target age group*
 Children or adolescents 52 26
 Adults or older adults 152 74
 Type of measure
 Generic 165 81
 Designed for mental health 39 19
Main category of outcome measurement
 QOL/Well-being 190 93
 Recovery-specific 14 7
Year of development
 1960s 1 0
 1970s 4 2
 1980s 16 8
 1990s 73 36
 2000s 70 34
 2010s 40 20
Region of development
 North America 88 43
 Asia 6 3
 Europe 91 45
 Australia 8 4
 South America 1 0
 International 10 5
Characteristics of individual PROMs or PROM families relevant for MS, MN and MP EEs (n=134) n %
 MP: availability of separate adult and child/adolescents versions 16 12
 MP: availability of a proxy-completion option 27 20
 MS: feasibility of assessing outcomes beyond health, that is, capabilities or caregiver, family or social care outcomes 11 8
 MN: availability of multiple translations (two or more language versions of the instrument) 97 72
 EE: availability of a value set 15 11
 MN: availability of value set in more than one country 9 7

*If the target demographic group was not stated, the measure was considered designed for adults.

†Characteristics of 88 individual PROMs (one version available) and 116 scales grouped into 46 PROM families (more than one distinct version of the same questionnaire exist).

EE, economic evaluation; MN, multinational; MP, multiperson; MS, multisectoral; PROM, patient-reported outcome measure; QOL, quality of life.

Applicability in economic evaluations

Among the eligible (families of) PROMs, 16 (12%) had both adult and child/adolescent versions, and 27 (20%) had a proxy completion option (table 2). A total of 11 (8%) measured capabilities/family outcomes considered a criterion for broader well-being, beyond HRQOL, measurement. Furthermore, 15 (11%) had value set, of which 9 (7%) were available for more than one country. A total of 97 (72%) of (families of) PROMs had at least two language versions available. None of the (families of) instruments met all six proposed criteria for multisectoral, multinational and multiperson economic evaluations. At least five assessment criteria were met by the 15D family and the EQ-5D family of instruments, and four criteria were met by the Assessment of Quality of Life Scale family, ASCOT family, Care-related Quality of Life instrument, Child Health Utility 9D, Chateau Sante Base, Health Utilities Index Mark family and ICECAP family of instruments.

Applicability in mental health research

For the completeness of data, studies on the development and validation of the PROMs in populations suffering from any mental disorders were retrieved and compiled in the electronic compendium. Online supplemental appendix table 5 presents the PROMs for which validation studies in the mental health field were found. Section on the availability of the validation studies in mental health in the compendium consists of information whether any relevant studies were found in the secondary searches and relevant links to identified studies were provided. Specific assessment of the different aspects of validity of the PROMs based on these studies was beyond the scope of the current study. Altogether, 97 (48%) instruments had available validation studies in at least one mental disease category. Frequently, the validation studies of the instruments were available for depression, schizophrenia or mental health in general (without specifying the disease). Of all PROMs, EQ-5D-3L, Q-LES-Q, SF-36 and WEMWBS were the measures with most validation studies in the mental disease area.

The PECUNIA PROM-MH Compendium

The PECUNIA PROM-MH Compendium compiles PROM meta-data information that is either generic or designed for use in a broad field of mental health diseases, and thereby allows comparison across the area of mental health without being disease-specific. It includes dedicated sections on their validity in mental health outcome measurement focusing on QOL/well-being (including recovery) and their applicability in multisectoral, multinational and multiperson mental health economic evaluations across 220 Excel worksheets.

Information about each individual PROM is presented along 36 items that are organised into five main sections: (1) basic characteristics; (2) scoring information; (3) availability of validation studies in mental health; (4) application in multisectoral, multinational, multiperson economic evaluations and (5) other information. Furthermore, several links to websites, sample questionnaires, instrument manuals and scientific articles relevant to a specific PROM are provided to allow the user to easily identify relevant sources of information. Moreover, PROMs belonging to the same family of instruments are linked with each other so the user has a brief overview of all linked questionnaires.

Table 3 presents the comparison of two families of PROMs that fulfilled most of the proposed criteria for multisectoral, multinational and multiperson economic evaluations: the EQ-5D (consisting of EQ-5D-3L, EQ-5D-5L and EQ-5D-Y instruments) and 15D (consisting of 15D, 16D and 17D instruments) families.

Table 3.

Comparison of selected PROMs based on main meta-information extracted from the PECUNIA PROM-MH Compendium

15D family EQ-5D family
15D 16D 17D EQ-5D-3L EQ-5D-5L EQ-5D-Y
Year of first publication 199334 199635 199636 199037 201113 201038
Country of origin Finland Finland Finland UK UK UK
Main category of outcome measurement* QOL/Well-being QOL/Well-being QOL/Well-being QOL/Well-being QOL/Well-being QOL/Well-being
Subcategory of outcome measurement† (multisectoral) Health-related QOL Health-related QOL Health-related QOL Health-related QOL Health-related QOL Health-related QOL
Generic/Mental health specific Generic Generic Generic Generic Generic Generic
Target age group‡ (multiperson) Adults Adolescents Children Adults Adults Children, adolescents
No. of items 15 16 17 5 5 5
Levels of answers 5 5 5 3 5 3
Approximate time to complete 5 min 5–10 min 20–30 min 1–2 min 2–3 min 1–3 min
Standard recall period§ Day of completion Day of completion Day of completion Day of completion Day of completion Day of completion
Person completing instrument¶ (multiperson) Self-reported, proxy-reported, interviewer-administration Self-reported, proxy-reported, interviewer-administration Self-reported, proxy-reported, interviewer-administration Self-reported, proxy-reported, interviewer-administration Self-reported, proxy-reported, interviewer-administration Self-reported, proxy-reported
Modes of administration** Paper-based, computer-based14 Paper-based, computer-based14 Paper-based, computer-based14 Paper-based, computer-based, telephone-administration, other (interactive voice response)39 Paper-based, computer-based, telephone-administration, other (interactive voice response)40 Paper-based, computer-based41
Other language versions available (multinational) Yes Yes Yes Yes Yes Yes
Approximate no. of known translations 3242 542 542 18043 15044 4045
Answer scale Likert scale Likert scale Likert scale Likert scale Likert scale Likert scale
Level-sum scoring (min-max) Not known Not known Not known Descriptive data are presented as the percentage reporting each level in each dimension Descriptive data are presented as the percentage reporting each level in each dimension Descriptive data are presented as the percentage reporting each level in each dimension
Weighted preference-based scoring (economic evaluations) Yes Yes Yes Yes Yes No (in development)
Approximate number of preference-based value sets (multinational) 346 135 136 4147 2148 Not applicable
Technique of valuation†† VAS VAS VAS TTO, VAS TTO, DCE Not applicable
Availability of validation studies in mental health Not known Not known Not known Yes (anxiety disorders, depression, personality disorder, post-traumatic stress disorder, schizophrenia/psychosis, mental health not specified) Yes (depression, personality disorder, post-traumatic stress disorder, opiate use disorder) Not known
Date of meta-data 3 April 2020 3 April 2020 3 April 2020 3 April 2020 3 April 2020 3 April 2020

*Possible entry options: QOL/well-being; recovery.

†Possible entry options: QOL/well-being; health-related QOL; capabilities; care-related QOL; social care-related QOL; recovery; family well-being; health status; happiness; life satisfaction; positive mental health.

‡Possible entry options: children (aged 0–10 years); adolescents (aged 11–16 years); adults (aged 16+ years); older adults (aged 65+ years).

§Possible entry options: day of completion (your health today); past week; past 2 weeks; past 4 weeks/past month; past 3 months; other (specify); not known.

¶Possible entry options: self-reported; proxy-reported; parent-reported; caregiver/family member-reported; interviewer-administration.

**Possible entry options: paper-based administration; computer-based administration (E-version); telephone administration; other (specify).

††Possible entry options: TTO, VAS, SG, DCE, BWS, other (specify), not applicable.

BWS, best-worst scaling; 15D, 15D instrument of health-related QOL; 16D, 16D instrument of health-related QOL; 17D, 17D instrument of health-related QOL; DCE, discrete choice experiment; EQ-5D-3L, EuroQoL Five Dimensions 3L; EQ-5D-5L, EuroQoL Five Dimensions 5L; EQ-5D-Y, EuroQol Five Dimensions Youth; QOL, quality of life; SG, standard gamble; TTO, time trade-off; VAS, Visual Analogue Scale.

Conclusions and clinical implications

This paper describes the process that led to the synthesis of existing, publicly available PROM information suitable for QOL/well-being (including recovery) measurement in mental health economic evaluations with specific focus on their applicability in multisectoral, multinational, multiperson economic evaluations and the resulting electronic PROM library, the PECUNIA PROM-MH Compendium. Overall, we found >200 non-disease-specific PROMs that have been used or are potentially suitable for outcome measurement in mental health economic evaluations. However, no single instrument fulfilled all the criteria necessary for a fully multisectoral, multinational and multiperson economic evaluation as potentially relevant for European-level HTAs.

The PECUNIA PROM-MH Compendium is a useful Microsoft Excel-based resource when designing comparative mental health economic evaluations as it compiles an overview of all relevant instruments (generic or designed for use in mental health) with browsable features. It is a unique and unprecedented collection of PROMs in the area of mental health, and of information on their important specifics for economic evaluations. The library also addresses the increasing need for overview of methods and tools that are available, standardised, harmonised and validated across sectors, countries and demographic groups for this purpose. Main strengths of this study are the scientifically rigorous systematic review methods with which PROMs were collated, and the comprehensive meta-information that will simplify the work of future researchers who wish to identify a suitable instrument with specific characteristics. For instance, it is now easy to look for an instrument designed for children with a proxy-completion option available in multiple languages with validation studies in mental health. For this purpose, the instruments listed in PECUNIA PROM-MH Compendium are classified according to different criteria (eg, target age group) to allow more efficient searches. Furthermore, the well-documented systematic review methods enable future update of the information on a regular basis, thereby also keeping the compendium up to date.

The development process of the PECUNIA PROM-MH Compendium identified some challenges. One such challenge is the distinction between fully generic and non-disease-specific but mental health oriented instruments, for instance, the OxCAP-MH questionnaire. While the latter ones are expected to be more sensitive for mental health-specific research, they may have comparative limitations beyond the mental health field. Such comparative assessments, however, are scarce. The cut-off point between disease-specific instruments and those designed for broader mental health outcome measurement was also not clear in some instances. The categorisation of PROMs as measurements of QOL/well-being, as experienced for example for recovery measurements, is also not without controversy. A further challenge relates to the linking of multiple instruments that belong to the same PROM family because some PROMs have been renamed or further developed since their initial publication, therefore, requiring very resource-intensive secondary searches. Finally, the availability of translations, mapping studies, value sets and validation in mental health would require further quality assessment in terms of adherence to given guidelines and standards. Although, these steps were beyond the scope of the current study, based on the meta-information now collated and linked for each identified instrument in the compendium, such assessments should be much easier and systematic to do in the future.

The main limitation of the current study mainly stem from the compromises that had to be made during the design of the systematic literature review. The PECUNIA PROM-MH Compendium includes no information about instruments in development, and the information about the included PROMs is time stamped to the date of the review which should be updated on a regular basis to provide fully reliable information for its users. For example, the systematic review in this study might have missed some protocol papers and instruments under development in this rapidly changing field. The search was limited to certain languages, thereby excluding potential instruments of interests and existing non-peer-reviewed translations. The PECUNIA PROM-MH Compendium currently only includes officially recognised translations, but further translations might be potentially available. Furthermore, the synthesis excluded disease-specific measures that could be relevant for specific cost-effectiveness analyses.

The PECUNIA PROM-MH Compendium can be accessed free of charge for non-commercial research, healthcare and academic teaching activities following registration.33 A sample version of the PECUNIA PROM-MH Compendium can be accessed under the following link: https://www.pecunia-project.eu/tools/prom-mh-compendium.

Acknowledgments

We thank the PECUNIA consortium and members of the Scientific Advisory Board of the PECUNIA project for their feedback on the meta-data information template and the earlier version of the electronic PROM compendium.

Footnotes

Correction notice: This article has been corrected since it first published. In the final paragraph, the web address has been corrected.

Contributors: JS and AŁ developed the concept of this study. AŁ conducted the searches. AŁ and TMH screened the titles and abstracts and full-text of identified studies, JS resolved conflicts. TMH extracted information about the studies included in the review. AŁ compiled the final list of PROMs. AŁ, AN, TMH, NP and JS designed the template for extraction of meta-data information. AŁ, AN, TMH extracted PROM meta-data information into the template. AŁ, NP and JS designed the compendium. AŁ prepared first draft of the manuscript. All authors reviewed the manuscript and provided their critical feedback. All authors approved the final version of the manuscript. JS acts as guarantor and accepts full responsibility for the finished work and/or the conduct of the study, had access to the data, and controlled the decision to publish.

Funding: This research was carried out as part of the H2020 PECUNIA (ProgrammE in Costing, resource use measurement and outcome valuation for Use in multisectoral National and International health economic evaluAtions) project, which has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement no. 779292.

Competing interests: No, there are no competing interests.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Data availability statement

Data are available in a public, open access repository. The PECUNIA PROM-MH Compendium can be accessed free of charge for non-commercial research, healthcare and academic teaching activities following registration: Łaszewska A, Helter H, Perić N, Simon J: PECUNIA PROM-MH Compendium. Version 1.0; 20 Nov 2020. DOI: 10.5281/zenodo.5037082.

Ethics statements

Patient consent for publication

Not applicable.

Ethics approval

This study does not involve human participants.

References

  • 1. AOTMiT . Wytyczne oceny technologii medycznych (HTA, ang. health technology assessment). Wersja 3.0, A.O.T.M.i. Taryfikacji, Editor. Warszawa, 2016. [Google Scholar]
  • 2. Belgian Health Care Knowledge Centre . Belgrain guidelines for economic evaluation and budget impact analyses. 2nd ed. Brussels, 2012. [Google Scholar]
  • 3. Nederland Z. Guideline for economic evaluations in healthcare 2016.
  • 4. Health Information and Quality Authority . Guidelines for the economic evaluation of health technologies in Ireland 2019.
  • 5. Use, C.f.M.P.f.H . Reflection paper on the regulatory guidance for the use of health-related quality of life (HRQL) measures in the evaluation of medicinal products. London: European Medicines Agency, 2005. [Google Scholar]
  • 6. U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health . Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes 2006;4:79. 10.1186/1477-7525-4-79 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Devlin NJ, Appleby J. Getting the most out of PROMS. Putting health outcomes at the heart of NHS decision-making. London: The King’s Fund, 2010. [Google Scholar]
  • 8. Acquadro C, Berzon R, Dubois D, et al. Incorporating the patient's perspective into drug development and communication: an AD hoc Task force report of the patient-reported outcomes (pro) harmonization group meeting at the food and drug administration, February 16, 2001. Value Health 2003;6:522–31. 10.1046/j.1524-4733.2003.65309.x [DOI] [PubMed] [Google Scholar]
  • 9. Fox-Rushby J, Cairns J. Economic evaluation. UK: McGraw-Hill Education, 2005. [Google Scholar]
  • 10. Drummond MF, et al. Methods for the economic evaluation of health care programmes. Oxford: Oxford university press, 2015. [Google Scholar]
  • 11. Devlin N. ‘Preference-based measure’ is misleading – can we agree on something better? T.A.H.E. Blog, Editor, 2020. [Google Scholar]
  • 12. Brazier J, et al. Measuring and valuing health benefits for economic evaluation. Oxford: Oxford university press, 2017. [Google Scholar]
  • 13. Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011;20:1727–36. 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Homepage of the 15D instrument. Available: http://www.15d-instrument.net/15d/
  • 15. Rand S, Caiels J, Collins G, et al. Developing a proxy version of the adult social care outcome toolkit (Ascot). Health Qual Life Outcomes 2017;15:108. 10.1186/s12955-017-0682-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Keetharuth AB, Connell J, Ricketts J. Development of a new patient reported outcome measure (PROM) in mental health: recovering quality of life (ReQoL). Journal of Mental Health Policy and Economics 2016;19:S5. [Google Scholar]
  • 17. Simon J, Anand P, Gray A, et al. Operationalising the capability approach for outcome measurement in mental health research. Soc Sci Med 2013;98:187–96. 10.1016/j.socscimed.2013.09.019 [DOI] [PubMed] [Google Scholar]
  • 18. Al-Janabi H, Flynn TN, Coast J. Development of a self-report measure of capability wellbeing for adults: the ICECAP-A. Qual Life Res 2012;21:167–76. 10.1007/s11136-011-9927-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. Lancet Psychiatry 2016;3:171–8. 10.1016/S2215-0366(15)00505-2 [DOI] [PubMed] [Google Scholar]
  • 20. Rehm J, Shield KD. Global burden of disease and the impact of mental and addictive disorders. Curr Psychiatry Rep 2019;21:10. 10.1007/s11920-019-0997-0 [DOI] [PubMed] [Google Scholar]
  • 21. Knapp M, Wong G. Economics and mental health: the current scenario. World Psychiatry 2020;19:3–14. 10.1002/wps.20692 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Simon J. Health economic analysis of service provision (Chapter 23/136). In: Geddes JR AN, Goodwin GM, eds. New Oxford textbook of psychiatry. Oxford: Oxford University Press, 2020. [Google Scholar]
  • 23. Brazier J. Measuring and valuing mental health for use in economic evaluation. J Health Serv Res Policy 2008;13 Suppl 3:70–5. 10.1258/jhsrp.2008.008015 [DOI] [PubMed] [Google Scholar]
  • 24. Brazier J. Is the EQ-5D fit for purpose in mental health? Br J Psychiatry 2010;197:348–9. 10.1192/bjp.bp.110.082453 [DOI] [PubMed] [Google Scholar]
  • 25. Helter TM, Coast J, Łaszewska A, et al. Capability instruments in economic evaluations of health-related interventions: a comparative review of the literature. Qual Life Res 2020;29:1433–64. 10.1007/s11136-019-02393-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Gelkopf M, Mazor Y, Roe D. A systematic review of patient-reported outcome measurement (PROM) and provider assessment in mental health: goals, implementation, setting, measurement characteristics and barriers. International Journal for Quality in Health Care 2020;33. [DOI] [PubMed] [Google Scholar]
  • 27. Jakovljevic MM, Pejcic AV. Growth of global publishing output of health economics in the twenty-first century: a Bibliographic insight. Front Public Health 2017;5:211. 10.3389/fpubh.2017.00211 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Barry MM, Zissi A. Quality of life as an outcome measure in evaluating mental health services: a review of the empirical evidence. Soc Psychiatry Psychiatr Epidemiol 1997;32:38–47. 10.1007/BF00800666 [DOI] [PubMed] [Google Scholar]
  • 29. Salvador-Carulla L, Lucas R, Ayuso-Mateos JL, et al. Use of the terms "Wellbeing" and "Quality of Life" in health sciences: a conceptual framework. The European Journal of Psychiatry 2014;28:50–65. 10.4321/S0213-61632014000100005 [DOI] [Google Scholar]
  • 30. Shah K. A brief review of concepts: health, quality of life, health-related quality of life and well-being. In: EuroQol working paper series, number 17001. Rotterdam, the Netherlands: E.R. Foundation, 2017. [Google Scholar]
  • 31. Oliveira-Maia AJ, Mendonça C, Pessoa MJ, et al. The mental health recovery measure can be used to assess aspects of both Customer-Based and Service-Based recovery in the context of severe mental illness. Front Psychol 2016;7:1679. 10.3389/fpsyg.2016.01679 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. U.S. Department of Health and Human Services . Individual resilience. public health and medical emergency support for a national prepared, 2015. Available: http://www.phe.gov/Preparedness/planning/abc/Pages/individual-resilience.aspx
  • 33. Łaszewska A, Helter H, Perić N. Simon J: PECUNIA PROM-MH compendium. Version 1.0 2020. 10.5281/zenodo.5037082 [DOI] [Google Scholar]
  • 34. Sintonen H. The 15-D measure of health related quality of life: reliability, validity and sensitivity of its health state descriptive system. 41. Working Paper, 1994. [Google Scholar]
  • 35. Apajasalo M, Sintonen H, Holmberg C, et al. Quality of life in early adolescence: a sixteen-dimensional health-related measure (16D). Qual Life Res 1996;5:205–11. 10.1007/BF00434742 [DOI] [PubMed] [Google Scholar]
  • 36. Apajasalo M, Rautonen J, Holmberg C, et al. Quality of life in pre-adolescence: a 17-dimensional health-related measure (17D). Qual Life Res 1996;5:532–8. 10.1007/BF00439227 [DOI] [PubMed] [Google Scholar]
  • 37. EuroQol Group . EuroQol--a new facility for the measurement of health-related quality of life. Health Policy 1990;16:199–208. 10.1016/0168-8510(90)90421-9 [DOI] [PubMed] [Google Scholar]
  • 38. Wille N, Badia X, Bonsel G, et al. Development of the EQ-5D-Y: a child-friendly version of the EQ-5D. Qual Life Res 2010;19:875–86. 10.1007/s11136-010-9648-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. EQ-5D-3L . Available modes of administration.. Available: euroqol.org/eq-5d-instruments/eq-5d-3l-available-modes-of-administration/
  • 40. EQ-5D-5L . Available modes of administration. Available: https://euroqol.org/eq-5d-instruments/eq-5d-5l-available-modes-of-administration/
  • 41. EQ-5D-Y . Available modes of administration. Available: https://euroqol.org/eq-5d-instruments/eq-5d-y-available-modes-of-administration/
  • 42. Languages . Available: http://www.15d-instrument.net/15d/languages/
  • 43. EQ-5D-3L about. Available: https://euroqol.org/eq-5d-instruments/eq-5d-3l-about/
  • 44. EQ-5D-5L about. Available: https://euroqol.org/eq-5d-instruments/eq-5d-5l-about/
  • 45. EQ-5D-Y about. Available: https://euroqol.org/eq-5d-instruments/eq-5d-y-about/
  • 46. Michel YA, Augestad LA, Barra M, et al. A Norwegian 15D value algorithm: proposing a new procedure to estimate 15D value algorithms. Qual Life Res 2019;28:1129–43. 10.1007/s11136-018-2043-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Valuation. Available: https://euroqol.org/eq-5d-instruments/eq-5d-3l-about/valuation/
  • 48. Value sets. Available: https://euroqol.org/eq-5d-instruments/eq-5d-5l-about/valuation-standard-value-sets/

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

ebmental-2021-300334supp001.pdf (349.7KB, pdf)

Data Availability Statement

Data are available in a public, open access repository. The PECUNIA PROM-MH Compendium can be accessed free of charge for non-commercial research, healthcare and academic teaching activities following registration: Łaszewska A, Helter H, Perić N, Simon J: PECUNIA PROM-MH Compendium. Version 1.0; 20 Nov 2020. DOI: 10.5281/zenodo.5037082.


Articles from Evidence-Based Mental Health are provided here courtesy of BMJ Publishing Group

RESOURCES