Abstract
Introduction
The current service metrics used to evaluate quality in emergency care do not account for specific healthcare outcome goals for older people living with frailty. These have previously been classified under themes of ‘Autonomy’ and ‘Functioning’. There is no person-reported outcome measure (PROM) for older people with frailty and emergency care needs. This study aimed to identify and co-produce recommendations for instruments potentially suitable for use in this population.
Methods
In this systematic review, we searched six databases for PROMs used between 2010 and 2021 by older people living with frailty receiving acute hospital care. Studies were reviewed against predefined eligibility criteria and appraised for quality using the COSMIN Risk of Bias checklist. Data were extracted to map instrument constructs against an existing framework of acute healthcare outcome goals. Instrument face and content validity were assessed by lay collaborators. Recommendations for instruments with potential emergency care suitability were formed through co-production.
Results
Of 9392 unique citations screened, we appraised the full texts of 158 studies. Nine studies were identified, evaluating nine PROMs. Quality of included studies ranged from ‘doubtful’ to ‘very good’. Most instruments had strong evidence for measurement properties. PROMs mainly assessed ‘Functioning’ constructs, with limited coverage of ‘Autonomy’. Five instruments were considered too burdensome for the emergency care setting or too specific for older people living with frailty.
Conclusions
Four PROMs were recommended as potentially suitable for further validation with older people with frailty and emergency care needs: COOP/WONCA charts, EuroQol, McGill Quality of Life (Expanded), and Palliative care Outcome Scale.
Supplementary Information
The online version contains supplementary material available at 10.1186/s41687-022-00438-x.
Keywords: Frailty, Geriatrics, Emergency medicine, Patient-reported outcome measure, Patient satisfaction, Person-centred care
Introduction
Research and quality improvement in emergency care usually focus on service metrics such as length of stay and readmission rates, which do not necessarily align with patient perspectives [1, 2]. Metrics such as mortality and length of stay are convenient as they are easily generated, but may not be meaningful to older people with frailty [3, 4].
We have previously classified meaningful healthcare outcome goals for acute care among older people living with frailty by themes of autonomy and functioning based on empirical qualitative research with this target population (Fig. 1) [5]. Autonomythemed goals include information (knowing what the problem is), security (being able to live without fear), and control (being able to make healthcare decisions). Functioning-themed goals include physical (being able to self-care and move), psychosocial (being able to think and interact with others), and relief (feeling better from the health problem). The predominance of person-centredness themes across the outcome goals reiterates the vulnerability of older people with frailty in the acute care setting [4].
Fig. 1.
Acute healthcare outcome goals for older people living with frailty classified in qualitative research [5]
The attainment of healthcare outcome goals should be ascertained directly from patients themselves. This is possible using Patient-Reported Outcome Measures (PROMs) and Patient-Reported Experience Measures (PREMs) [6, 7]. By capturing data to monitor and compare individuals’ healthcare outcomes, PROMs can measure care effectiveness and contribute to its improvement [8]. The use of PROMs is advocated within the International Federation for Emergency Medicine’s recently updated framework on quality and safety [9]. PREMs consider the process rather than the outcome of healthcare delivery. The framework in Fig. 1 includes concepts measurable using both PROMs and PREMs. This review focuses on the PROMs which best overlap with acute healthcare outcome goals as measures of the effect of that care.
Across the globe, older people represent an increasing proportion of emergency attendances and hospital admissions. There is wide recognition of the need to deliver person-centred holistic care to this group, but the quality of this is poorly captured using existing service metrics [10]. There is currently no consensus about how best to measure emergency care outcomes from older people with frailty [11]. To date, generic PROM instruments have been used to report person-centred emergency care outcomes, but these have been evaluated mainly among younger people, and do not account for either the specific goals of people living with frailty or for the inherent challenges in collecting PROMs in busy emergency care environments [12]. Although there are a number of available instruments that could be used for older people with frailty there is little evidence on their performance in the emergency setting [8].
This systematic review aimed to inform future developments towards more meaningful evaluation of emergency care services for older people living with frailty. The study objectives were to: (1) identify and appraise evidence for existing PROM instruments used to measure outcomes for older people with frailty in other acute hospital settings, and (2) co-produce recommendations for instruments suitable for future emergency care validation studies.
Methods
Search strategy
The British Nursing Index (BNI), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Cochrane Database of Systematic Reviews, Embase, Medline, and PsycInfo databases were searched for instruments used to evaluate the outcomes of acute care in hospital for people aged over 65 living with frailty. The strategy searched for instruments studied since 2010, as those in more recent use should have measured concepts relevant to the present-day healthcare system attitudes, processes, and hospital capacity. Emergency care worldwide has been rapidly developing, both in high- and low-income countries. The spectrum of expertise, disciplines involved in the emergency care team, and patients’ case mix and age demographic has been changing. An arbitrary cut-off of 2010 was chosen as a compromise between completeness and relevance to modern patient outcomes of emergency care.
Search strategies using exploded Medical Subject Headings (MeSH) and keywords were adapted from recent literature, and iteratively piloted and developed [13]. Search terms in three blocks (population, setting and intervention) were modified for each database. The detailed search strategy is available in Additional file 1. The review was conducted with reference to the PRISMA-P checklist for preferred reporting and the study protocol was deposited in an open-source registry [14, 15].
Terms relating to Patient-Reported Experience Measures (PREMs) were included in the search strategy. While not seeking to report on PREMs in this review, we included these search terms to limit the likelihood of omitting PROMs and to improve confidence that all relevant literature was identified.
Databases were searched to 24 June 2021. Searches were restricted to English language. Citations were downloaded for management using EndNote software and duplicate articles were removed [16].
Eligibility
Studies were included which reported the use of PROM(s) in hospital settings by older people living with frailty to measure health-related quality of life or healthcare outcomes from acute, emergency, or urgent care. Multidimensional PROMs were included as frailty affects a heterogenous population who have wide-ranging health conditions associated with multifaceted problems and outcome goals. All citation titles and abstracts were screened by the first author against pre-defined inclusion criteria (Table 1). A 20% sample was screened by the second author. Full texts of identified citations were then downloaded, read, and assessed for eligibility by both reviewers. Cohen’s kappa statistic was calculated for interrater reliability for screening decisions. Disagreements were all resolved by discussion. Reasons were recorded for exclusion of ineligible articles at the full text stage. The reference lists of included full texts were hand-searched for additional papers.
Table 1.
Eligibility criteria
| Include | Exclude | |
|---|---|---|
| Population |
Participants aged over 65 with frailty (include ‘older’, ‘elderly’, ‘senior’, ‘geriatric’) Receiving care in inpatient hospital settings |
Younger participants People without frailty Community settings Hospice or rehabilitation settings Outpatient clinics |
| Intervention | Patient-reported outcome measure | |
| Outcome |
Multidimensional health-related quality of life Acute, emergency, or urgent healthcare outcomes |
|
| Publication |
2010 onwards English language Peer-reviewed |
Conference abstracts where no full paper has been published |
Appraisal of identified instruments
Data extraction and quality assessment
Data from each eligible full text were extracted into a standardised Microsoft Excel form, including study design and setting, psychometric and feasibility outcomes, and themes investigated [17]. Studies were appraised for methodological quality using the COSMIN Risk of Bias checklist [18]. This method guides comprehensive appraisal of PROM development, content and structural validity, reliability and responsiveness, and hypothesis testing. The checklist requires measurement properties to be rated from ‘inadequate’, ‘doubtful’, ‘adequate’, to ‘very good’, counting the worst score. Quality was assessed for each paper and compiled for each instrument. The level of evidence for each measurement property considered the quality and number of studies for each instrument (Table 2). This approach to quality appraisal was adapted from the COSMIN Risk of Bias manual and from a systematic review of studies using an empathy scale [19, 20]. No instruments were excluded based only on quality assessment [20].
Table 2.
Level of evidence rating criteria
| Level | Rating | Criteria |
|---|---|---|
| Strong | + or − |
Consistent findings in multiple studies of good methodological quality OR in one study of excellent methodological quality |
| Moderate | + or − |
Consistent findings in multiple studies of fair methodological quality OR in one study of good methodological quality |
| Limited | + or − | One study of fair methodological quality |
| Conflicting | + or − | Conflicting findings |
| Unknown | ? | Only studies of poor methodological quality or no studies |
+ : positive rating, ?: indeterminate rating, −: negative rating
Construct mapping
Each identified PROM was sourced from original development study manuscripts or downloaded from registry websites. The component items and reference time frames, scales, and anchor descriptions were tabulated using Microsoft Excel [17]. Items were categorised by their underlying constructs, as originally defined. To aid recognition of crossover between instrument constructs, closely related categories (such as “Social” and “Social Function”) were merged following discussion with the lay research partners.
The merged instrument constructs were then mapped against the previously established framework of acute healthcare outcome goals for older people living with frailty (Fig. 1) [5].
Assessment of face and content validity
A panel of research collaborators was consulted on the potential suitability of the identified PROMs for emergency care. These research collaborators were all members of a Patient and Public Involvement (PPI) Forum specialising in ageing-related research. They included nine lay members who were older people with frailty or their carers and who had personal experience of emergency care. There were also nine professional members who included clinicians and university researchers with expertise in geriatric emergency care.
In an open PPI Forum meeting, the lay and professional collaborators were invited to reflect on the framework of healthcare outcome goals and consider each identified PROM. Feedback was recorded. Each instrument was appraised for face validity and appropriateness for collection from older people with frailty receiving emergency care. Face validity was evaluated by considering whether each instrument relevantly and comprehensively assessed the themes of importance [21, 22]. Instruments which had unanimous consensus for poor face validity or appropriateness to emergency care settings were discarded.
The remaining instruments with potential face validity were then evaluated for their content validity. During a second open PPI Forum meeting, each instrument was presented for discussion in closer detail with the lay and professional collaborators. Discussions focused on accessibility for completion, instrument comprehensiveness, and relevance to older people’s emergency care. Feedback was captured in meeting notes and ensuing emails and was summarised and tabulated for each instrument. Instruments were excluded where there was unanimous consensus for poor content validity.
Co-production of recommendations
Three of the PPI Forum lay members were recruited as lay research partners for further detailed instrument appraisal. Recommendations for potentially suitable instruments were formed through a co-production process with these lay research partners [23]. The lay research partners were consulted separately on four further occasions, with stepwise progress towards recommendations. The first author assumed overall responsibility for the decisions.
In follow-up consultations after each open Forum meeting, the lay research partners read each remaining instrument in full and considered feedback from their peers. Session notes were shared among the lay research partners to ensure accuracy and promote further discussion. All available evidence for methodology quality grades, the construct map, and assessments of face and content validity were reviewed with the lay research partners. Instruments judged as accessibly measuring relevant themes were recommended as suitable for future validation studies.
Results
After removal of duplicates, 9392 citations were screened (Fig. 2). During title and abstract screening, 9234 citations were excluded. One hundred and fifty-eight full texts were read. Of these, nineteen were excluded for focusing upon younger populations and seventeen for non-hospital settings. Fifty-two studies did not use PROMs, and instead used PREMs, clinical risk tools, or diagnostic instruments. Twenty-nine studies did not address multi-dimensional health-related quality of life or outcomes from healthcare interventions, and thirty-two citations (predominantly conference proceedings) had ineligible publication type or insufficient data for extraction and appraisal. Cohen’s kappa statistic for interrater reliability within the 20% double-screened citations showed substantial agreement (k = 0.75).
Fig. 2.
Citation screening for searches to 24 June 2021
Nine papers evaluated nine instruments used in acute hospital settings to report multi-dimensional outcomes: the COOP/WONCA chart, Duke Health Profile, EuroQol (EQ-5D-3L and EQ-5D-5L were considered together for purposes of suitability selection), the McGill Quality of Life Questionnaire (Expanded) (MQoL-E), Medical Outcomes Study short form survey (SF-36), the Palliative care Outcome Scale (PcOS), Quality of Life in Alzheimer’s Disease (QoL-AD), Readiness for Hospital Discharge Scale for Older People (RHDS-OP-SF), and The Older Persons and Informal Caregivers Survey (TOPICS-CEP) Composite End Point. The data extraction sheet is available as Additional file 2.
Studies reported development of novel or adapted instruments for people receiving palliative care in Canada [24] and for older people being discharged from hospitals in the USA, Ireland, and Switzerland [25]. Other studies from the UK [26], Netherlands [27], and France [28] evaluated instruments for conceptual overlap and convergent validity, while interrater comparison or outcome prediction studies were performed in Australia [29], UK [30], Sweden [31] and Taiwan [32]. Although developed as a condition-specific measure, the QoL-AD was included at this stage as one study examined its collection from participants who did not necessarily have cognitive impairment [31]. Participants’ mean age ranged from 69 to 85 years, with 102 to 17,603 participants included.
Mean instrument length was 18 items, ranging from 5 (EQ-5D) to 42 (TOPICS-CEP). Respondent burden was characterised by response rate in two studies [28, 30] ranging from 50% (EQ-5D) to 73% (Duke), retest response rate (78%, COOP/WONCA) in one study [29] and by data integrity in one further study [27] in which 89% of TOPICS-CEP completions had no missing values. Two studies evaluating QoL-AD [30, 31] both found completion by proxies to underestimate quality of life as reported by patients themselves. QoL-AD was difficult for people with moderate and severe dementia to complete. Most instruments used a reference time period of 0–3 days, while three measured quality of life during the previous week (Duke), fortnight (COOP/WONCA), or month (SF-36).
Evidence considered and outcomes of recommendation co-production
Methodological quality
COSMIN Risk of Bias ratings ranged from ‘Doubtful’ to ‘Very good’ (Table 3). None of the instruments had been evaluated for reliability or serial measurement properties in the setting of interest, and likewise no results were reported for cross-cultural adaptation. The full scoring ratings are tabulated in Additional file 3. One study which developed new instrument items was assigned a moderate score (‘adequate’) for its cognitive interview component [24]. The five studies which evaluated structural validity (usually with factor analysis) and internal consistency (usually with Cronbach’s alpha statistic) were all assigned ‘adequate’ or ‘very good’ methodological quality ratings [24–26, 28, 31].
Table 3.
COSMIN Risk of Bias assessment of studies and level of evidence for measurement properties
| Instrument | Paper(s) | Participants | Assessed measurement properties (lowest COSMIN rating) | Level of evidence | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Development | Factors | Testing | ||||||||
| PROM design | Content validity | Structural validity | Internal consistency | Criterion validity | Construct validity | Responsiveness | ||||
| COOP/WONCA | Franke (2021) | 118 | – | – | – | – | – | – | D | Limited (+) |
| Duke | Perret-Guillaume (2010) | 701 | – | – | – | V | – | V | – | Strong (+) |
| EQ-5D-3L | Dzingina (2017) | 783 | – | – | A | – | – | V | – | Strong (+) |
| Lin (2020) | 102 | – | – | – | – | – | V | – | ||
| EQ-5D-5L | Sheehan (2012) | 109 | – | – | – | – | – | V | – | Strong (+) |
| MQoL-E | Cohen (2019) | 803 | A | A | V | V | – | – | – | Strong (+) |
| PcOS | Dzingina (2017) | 783 | – | – | A | – | – | V | – | Strong (+) |
| QoL-AD | Sheehan (2012) | 109 | – | – | – | – | – | V | – | Strong (+) |
| Torisson (2016) | 199 | – | – | A | V | – | V | – | ||
| RHDS-OP-SF | Mabire (2015) | 998 | – | – | V | V | V | – | – | Strong (+) |
| SF-36 | Perret-Guillaume (2010) | 701 | – | – | – | V | – | V | – | Strong (+) |
| TOPICS-CEP | Hofman (2017) | 17,603 | – | – | – | – | – | V | – | Strong (+) |
Properties: V: very good, A: adequate, D: doubtful. Evidence: + : positive rating. Instruments: MQoL-E (McGill Quality of Life Questionnaire Expanded), PcOS (Palliative care Outcome Scale). QoL-AD (Quality of Life in Alzheimer’s Disease), RHDS-OP-SF (Readiness for Hospital Discharge Scale for Older People), TOPICS-CEP (The Older Persons and Informal Caregivers Survey composite endpoint)
No instruments had been evaluated for cross-cultural validity, reliability, or measurement error
Most studies evaluated instruments for criterion or construct validity. Methodological quality for these was rated as ‘Very good’, with most studies using regression techniques. In one study investigating COOP/WONCA responsiveness during and following hospital admission, quality was limited by the absence of correlation statistics [29].
The levels of evidence for instrument quality ratings are also summarised in Table 3. Most instruments were graded as having ‘Strong’ positive evidence, having at least one measurement property with ‘Very good’ methodology in at least one study. There was limited evidence supporting the COOP/WONCA chart, as the only investigating study was rated as having ‘Doubtful’ quality.
Construct map
The map of instrument constructs to themes of acute healthcare outcome goals is shown in Table 4. Functioning outcomes were the predominant focus in most identified PROMs. Autonomy outcomes were considered in fewer PROMs. All themes in the classification were represented but were not measured comprehensively by any single instrument.
Table 4.
Instrument constructs mapped against acute healthcare outcome goals for older people living with frailty
| Construct | Instrument | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| COOP/WONCA | Duke | EuroQol | MQoL-E | PcOS | QoL-AD | RHDS-OP-SF | SF-36 | TOPICS-CEP | |
| Autonomy | |||||||||
| Control | – | – | – | • | • | – | – | – | – |
| Information | – | – | – | • | – | – | • | – | – |
| Security | – | – | – | – | – | • | – | • | • |
| Functioning | |||||||||
| Physical | • | • | • | • | • | • | • | • | • |
| Psychosocial | • | • | • | • | • | • | – | • | • |
| Relief | • | • | • | • | • | • | – | • | • |
The acute healthcare outcome goals were defined and classified in previous qualitative work [5]
Communication effectiveness, particularly around healthcare information and decision-making, was considered in the MQoL-E and RHDS-OP-SF instruments but not in others. Three instruments measured a ‘self-esteem’ construct, which had some overlap with the ‘security’ and ‘psychosocial’ themes. Two instruments included ‘financial’ items, which appeared to be a redundant theme in the acute care classification.
Face validity
Lay research partners’ impressions of relevance, appropriateness, and summarised comments are shown in Table 5. The COOP/WONCA, EQ-5D, MQoL-E, PcOS, and QoL-AD instruments had relevant thematic coverage and were shortlisted for potential recommendation. The remaining instruments were judged to be too focussed on specific outcome themes (Duke, SF-36, RHDS-OP-SF), or infeasible due to their length (TOPICS-CEP) and were not recommended for use by older people with frailty receiving emergency care.
Table 5.
Instrument face validity informing reduction of a shortlist
| Instrument | Theme relevance | Appropriate to setting | Summarised comments | Shortlist |
|---|---|---|---|---|
| COOP/WONCA | Moderate | Good | Superficial, accessible | Yes |
| Duke | Moderate | Poor | Focussed on self-esteem / existential | No |
| EuroQol | Moderate | Good | Superficial | Yes |
| MQoL-E | Good | Good |
Appropriate themes for people with frailty Self-esteem less relevant |
Yes |
| SF-36 | Moderate | Poor |
Focus on physical constructs Many activities beyond typical people with frailty |
No |
| PcOS | Good | Good |
Appropriate themes Very focused on existential |
Yes |
| QoL-AD | Moderate | Moderate | Very specific to people with cognitive impairment | Yes |
| RHDS-OP-SF | Poor | Poor | Too specific to discharge period | No |
| TOPICS-CEP | Good | Poor |
Appropriate level. Good coverage of physical and psychosocial Very long |
No |
Content validity
The QoL-AD instrument was excluded during the PPI Forum review stage based on it lacking content validity. The instrument was judged to be useful for people with mild cognitive impairment, but too focussed to be relevant to many people with emergency care needs. QoL-AD administration was by interview, and lay collaborators noted that while enabling access for some people, this could restrict accessibility for others, particularly those experiencing problems with insecurity either at home or in the healthcare setting.
The COOP/WONCA, EQ-5D, MQoL-E, and PcOS were judged to measure relevant themes and were suitably accessible to be considered as potential instruments for emergency care validation in future studies. Additional items are required to comprehensively measure the autonomy themes.
Discussion
Four instruments which have been collected from older people with frailty in hospitals to measure health-related quality of life domains were recommended as having potential suitability for future studies emergency care settings: COOP/WONCA charts, EuroQol, McGill Quality of Life (Expanded), and Palliative care Outcome Scale. These co-produced recommendations were based on methodological quality, concept coverage, and face and content validity. Most studies used ‘very good’ quality methodologies for assessing measurement properties, and there was strong evidence for properties for most instruments. The identified instruments predominantly measured ‘Functioning’ domains.
Strengths and limitations
This is the first systematic review to identify PROMs potentially suitable for older people with frailty and emergency care needs. Recommendations for potential suitability were formed through quality appraisal, construct mapping, and assessment of face and content validity with research collaborators. To ensure recommendations were grounded in a patient perspective, a co-production approach involved lay research partners at each stage of work. These partners had substantial knowledge of the population and setting and had advised many researchers on other ageing-related studies through the PPI Forum. However, they did not have expertise or specific training in clinical psychometrics, and therefore further work is indicated to confirm instrument measurement properties in this application.
Multiple databases and reference list hand-searches were included in the strategy, but we did not examine grey literature sources. Most citations were screened for eligibility by a single reviewer. However, there was strong interrater agreement for the 20% random sample of double-screened citations.
The COSMIN Risk of Bias checklist was used for quality appraisal, as all studies included some aspect of PROM development or validity evaluation. This checklist does require the researcher to apply judgment [33]. Appraisal was conducted by two reviewers (and supervised by the senior authors) who had expertise with the reference population and who were undertaking PhD research in PROMs. An instrument appraised in a study with ‘doubtful’ methodological quality was included in accordance with the COSMIN manual for systematic reviews [20]. The grade was reflected in the level of evidence summary and was considered during subsequent recommendation co-production. The review methodology sought evidence for instruments only from their use by older people living with frailty in hospital settings, and therefore did not fully consider the accumulated evidence for the measurement performance of these tools. Additional detailed evaluation of validity could use systematic reviews of evidence for each identified instrument [34].
Implications for research and practice
Autonomy-themed healthcare outcomes (control, information, and safety) were poorly covered in these measures. Emergency care is unique in terms of its complexity, uncertainty, and consequent vulnerability [35, 36]. Autonomy outcomes may be absent from identified instruments due to the inclusion of studies with hospital inpatient participants, who may have been in more stable health with less uncertainty. Autonomy concepts are also harder to measure or correlate with existing outcomes data, and so traditionally may have been less attractive to consider alongside service metrics. Since autonomy has been identified as an outcome goal for older people’s acute care, further research into its measurement within PROMs is required.
Autonomy concepts are important and meaningful to patients and so should be measured. While these might usually be classified separately as aspects of care processes (and thus measured using PREMs), there is rationale for their consideration alongside PROMs among people who are living with frailty. People living with severe frailty have shorter life expectancy following acute care, and spend more of their time in healthcare settings [37]. They have similar needs to people receiving palliative care, for whom quality of life determinants also include having the knowledge and skills to be prepared for future healthcare interactions [38]. Indeed, ‘personal autonomy’ and ‘healthcare delivery’ are considered in the identified PROMs developed for people with palliative care needs [24, 39]. The merits of measurement using separate PROMs and PREMs or combined PROEMs is a matter for ongoing enquiry.
Instrument format is a key consideration for future research. Even people with advanced cognitive impairment have been able to self-report quality of life using PROM instruments [40]. Implementation programmes must ensure accessibility by accounting for factors known to affect completion including lower literacy and advancing age [41, 42].
The MQoL-E and PcOS instruments were notable for the relevance, range, and depth of information measured. However, these instruments used 21 and 10 items respectively, and both would require additional items to comprehensively measure autonomy themes. Longer instrument length presents a potential barrier to completion in emergency care settings by people living with frailty and requires evaluation in validation studies. There may be a trade-off between the desired data detail and the instrument accessibility which may feasibly be achieved.
EuroQol’s five-level version has been found to have better sensitivity and informativity than the three-level version, without posing problems with missing values [43, 44]. The responsiveness of EQ-5D has been identified as a property for further evaluation, and future studies comparing score changes against self-rated health have been recommended. EQ-5D scores should also be examined for discrepancies with preference values, which may foreseeably be encountered among people with frailty who have physical disability [45].
Conclusion
Nine PROMs have been collected from older people living with frailty in acute care settings. The instruments were evaluated for emergency care suitability with lay and academic research collaborators, using construct mapping and assessment for face and content validity. The COOP/WONCA, EQ-5D, MQoL-E, and PcOS instruments were recommended as potentially suitable for validation studies with older people with frailty and emergency care needs. There was no ideal instrument which comprehensively measured all outcome goal themes for this population, and additional items are needed if autonomy domains are to be evaluated.
Supplementary Information
Additional file 1. Detailed search strategy.
Additional file 2. Data extraction sheet.
Additional file 3. COSMIN scoring summary.
Acknowledgements
Not applicable.
Abbreviations
- PROM
Person (or Patient) -Reported Outcome Measure
- PREM
Person (or Patient) -Reported Experience Measure
- MeSH
Medical Subject Heading
- MQoL-E
McGill Quality of Life Questionnaire (Expanded)
- PcOS
Palliative care Outcome Scale
- QoL-AD
Quality of Life in Alzheimer’s Disease
- RHDS-OP-SF
Readiness for Hospital Discharge Scale for Older People (Short Form)
- TOPICS-CEP
The Older Persons and Informal Caregivers Survey composite endpoint
- UK
United Kingdom
Authors' contributions
JDvO conceived the study and obtained research funding under supervision by TJC, SPC, NM, and JMV. JDvO and BG designed the protocol and the search strategy. JDvO and AA screened citations and appraised study quality. JDvO, JL, VR and PR mapped the instrument constructs and formed the suitability recommendations. JDvO drafted the manuscript, and all authors contributed substantially to its revision. JDvO takes responsibility for the paper as a whole. All authors read and approved the final manuscript.
Funding
This study was supported by the National Institute for Health Research (Doctoral Research Fellowship NIHR300901 – salary for JDvO) and by the British Medical Association Foundation for Medical Research (Lift Into Research – lay collaborator engagement expenses). The funders had no role in the study’s design nor its data collection, interpretation, and presentation.
Availability of data and materials
The search strategy and data extraction sheets are provided as Supplementary Materials.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Burkett E, Martin-Khan MG, Gray LC. Quality indicators in the care of older persons in the emergency department: a systematic review of the literature. Australas J Ageing. 2017;36(4):286–298. doi: 10.1111/ajag.12451. [DOI] [PubMed] [Google Scholar]
- 2.Considine J, Berry D, Rasmussen B, Hutchinson AM, Rawson H, Jordan P, et al. Impact of emergency department length of stay on anxiety and comfort in older people. Int Emerg Nurs. 2021;56:100974. doi: 10.1016/j.ienj.2021.100974. [DOI] [PubMed] [Google Scholar]
- 3.Olde Rikkert MGM, van der Wees PJ, Schoon Y, Westert GP. Using patient reported outcomes measures to promote integrated care. Int J Integr Care. 2018;18(2):8. doi: 10.5334/ijic.3961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.van Oppen JD, Keillor L, Mitchell A, Coats TJ, Conroy SP. What older people want from emergency care: a systematic review. Emerg Med J. 2019;36(12):754–761. doi: 10.1136/emermed-2019-208589. [DOI] [PubMed] [Google Scholar]
- 5.van Oppen JD, Coats TJ, Conroy SP, Lalseta J, Phelps K, Regen E et al (2022) What matters most in acute care: an interview study with older people living with frailty. BMC Geriatr 22:156 [DOI] [PMC free article] [PubMed]
- 6.Valderas J, Alonso J. Patient reported outcome measures: a model-based classification system for research and clinical practice. Qual Life Res. 2008;17(9):1125–1135. doi: 10.1007/s11136-008-9396-4. [DOI] [PubMed] [Google Scholar]
- 7.Black N, Jenkinson C. Measuring patients’ experiences and outcomes. BMJ. 2009;339:b2495. doi: 10.1136/bmj.b2495. [DOI] [PubMed] [Google Scholar]
- 8.van Oppen JD, Valderas JM, Mackintosh NJ, Conroy SP. Patient-reported outcome and experience measures in geriatric emergency medicine. Z Gerontol Geriatr. 2020;54:122–124. doi: 10.1007/s00391-020-01777-4. [DOI] [PubMed] [Google Scholar]
- 9.IFEM Quality and Safety Special Interest Group . An updated framework on quality and safety in emergency medicine. International Federation for Emergency Medicine; 2019. [Google Scholar]
- 10.NICE (2012) CG138: patient experience in adult NHS services: improving the experience of care for people using adult NHS services. https://www.nice.org.uk/guidance/cg138/chapter/1-guidance [PubMed]
- 11.Conroy S, Carpenter C, Banerjee J. Silver Book II. London: British Geriatrics Society; 2021. [Google Scholar]
- 12.Mols EM, van der Velde M, Nanayakkara P, Haak HR, Kremers M. Evaluating quality in acute care using patient reported outcome measures: a scoping review. Acute Med. 2021;20(1):37–47. [PubMed] [Google Scholar]
- 13.Sawatzky RC, Chan ECK, Bryan S, Cohen R, Cuthbertson L, Dixon D et al (2015) Patient- and family-reported experience and outcome measures for elderly acute care patients: a knowledge synthesis. Canadian Frailty Network. https://www.cfn-nce.ca/project/ks2013-09/
- 14.van Oppen JD (2021) Testing and validation of a Patient-Reported Outcome Measure for Older People with frailty and Acute Care needs (PROM-OPAC). protocolsio
- 15.Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ Br Med J. 2015;349:g7647. doi: 10.1136/bmj.g7647. [DOI] [PubMed] [Google Scholar]
- 16.The EndNote Team (2013) EndNote. EndNote X9 edn. Clarivate, Philadelphia
- 17.Microsoft Corporation (2021) Microsoft Excel for Mac, 16 edn
- 18.Mokkink LB, de Vet HCW, Prinsen CAC, Patrick DL, Alonso J, Bouter LM, et al. COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Qual Life Res. 2018;27(5):1171–1179. doi: 10.1007/s11136-017-1765-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Williams B, Beovich B. A systematic review of psychometric assessment of the Jefferson Scale of Empathy using the COSMIN Risk of Bias checklist. J Eval Clin Pract. 2020;26(4):1302–1315. doi: 10.1111/jep.13293. [DOI] [PubMed] [Google Scholar]
- 20.Mokkink L, Prinsen C, Patrick D, Alonso D, Bouter L, de Vet H, et al. COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs) Qual Life Res. 2018;27:1147–1157. doi: 10.1007/s11136-017-1765-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide. Cambridge: Cambridge University Press; 2011. [Google Scholar]
- 22.Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 5. Oxford: Oxford University Press; 2015. [Google Scholar]
- 23.Turakhia P, Combs B. Using principles of co-production to improve patient care and enhance value. AMA J Ethics. 2017;19(11):1125–1131. doi: 10.1001/journalofethics.2017.19.11.pfor1-1711. [DOI] [PubMed] [Google Scholar]
- 24.Cohen SR, Russell LB, Leis A, Shahidi J, Porterfield P, Kuhl DR, et al. More comprehensively measuring quality of life in life-threatening illness: the McGill Quality of Life Questionnaire—expanded. BMC Palliat Care. 2019;18(1):92. doi: 10.1186/s12904-019-0473-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Mabire C, Coffey A, Weiss M. Readiness for Hospital Discharge Scale for older people: psychometric testing and short form development with a three country sample. J Adv Nurs. 2015;71(11):2686–2696. doi: 10.1111/jan.12731. [DOI] [PubMed] [Google Scholar]
- 26.Dzingina MD, McCrone P, Higginson IJ. Does the EQ-5D capture the concerns measured by the Palliative care Outcome Scale? Mapping the Palliative care Outcome Scale onto the EQ-5D using statistical methods. Palliative Med. 2017;31(8):716–725. doi: 10.1177/0269216317705608. [DOI] [PubMed] [Google Scholar]
- 27.Hofman CS, Lutomski JE, Boter H, Buurman BM, de Craen AJM, Donders R, et al. Examining the construct and known-group validity of a composite endpoint for The Older Persons and Informal Caregivers Survey Minimum Data Set (TOPICS-MDS); a large-scale data sharing initiative. PLoS ONE. 2017;12(3):e0173081. doi: 10.1371/journal.pone.0173081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Perret-Guillaume C, Briancon S, Guillemin F, Empereur F, Nguyen Thi PL, Wahl D. Which generic health related quality of life questionnaire should be used in older inpatients: comparison of the Duke health profile and the MOS Short-Form SF-36? J Nutr Health Aging. 2010;14(4):325–331. doi: 10.1007/s12603-010-0074-1. [DOI] [PubMed] [Google Scholar]
- 29.Franke AD. Feasibility of patient-reported outcome research in acute geriatric medicine: an approach to the ‘post-hospital syndrome’. Age Ageing. 2021;50:1834–1839. doi: 10.1093/ageing/afab074. [DOI] [PubMed] [Google Scholar]
- 30.Sheehan BD, Lall R, Stinton C, Mitchell K, Gage H, Holland C, et al. Patient and proxy measurement of quality of life among general hospital in-patients with dementia. Aging Ment Health. 2012;16(5):603–607. doi: 10.1080/13607863.2011.653955. [DOI] [PubMed] [Google Scholar]
- 31.Torisson G, Stavenow L, Minthon L, Londos E. Reliability, validity and clinical correlates of the Quality of Life in Alzheimer's disease (QoL-AD) scale in medical inpatients. Health Qual Life Outcomes. 2016;14:90. doi: 10.1186/s12955-016-0493-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Lin CF, Huang YH, Ju LY, Weng SC, Lee YS, Chou YY, et al. Health-related quality of life measured by EQ-5D in relation to hospital stay and readmission in elderly patients hospitalized for acute illness. Int J Environ Res Public Health. 2020;17(15):1–10. doi: 10.3390/ijerph17155333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.McKenna S, Heaney A. Setting and maintaining standards for patient-reported outcome measures: can we rely on the COSMIN checklists? J Med Econ. 2021;24:502–511. doi: 10.1080/13696998.2021.1907092. [DOI] [PubMed] [Google Scholar]
- 34.Valderas JM, Ferrer M, Mendivil J, Garin O, Rajmil L, Herdman M, et al. Development of EMPRO: a tool for the standardized assessment of patient-reported outcome measures. Value Health. 2008;11(4):700–708. doi: 10.1111/j.1524-4733.2007.00309.x. [DOI] [PubMed] [Google Scholar]
- 35.Mark Courtney D, Neumar RW, Venkatesh AK, Kaji AH, Cairns CB, Lavonas E, et al. Unique characteristics of emergency care research: scope, populations, and infrastructure. Acad Emerg Med. 2009;16(10):990–994. doi: 10.1111/j.1553-2712.2009.00530.x. [DOI] [PubMed] [Google Scholar]
- 36.Ablard S, Kuczawski M, Sampson FC, Mason SM. What does the ideal urgent and emergency care system look like? A qualitative study of service user perspectives. Emerg Med J. 2020;37(4):200. doi: 10.1136/emermed-2019-208921. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Keeble E, Roberts HC, Williams CD, Van Oppen J, Conroy SP. Outcomes of hospital admissions among frail older people: a 2-year cohort study. Br J Gen Pract. 2019;69(685):e555–e560. doi: 10.3399/bjgp19X704621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.McCaffrey N, Bradley S, Ratcliffe J, Currow DC. What aspects of quality of life are important from palliative care patients' perspectives? A systematic review of qualitative research. J Pain Symptom Manag. 2016;52(2):318–28.e5. doi: 10.1016/j.jpainsymman.2016.02.012. [DOI] [PubMed] [Google Scholar]
- 39.Hearn J, Higginson IJ. Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Palliative Care Core Audit Project Advisory Group. Qual Health Care. 1999;8(4):219–227. doi: 10.1136/qshc.8.4.219. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Burks H, des Bordes J, Chadha R, Holmes H, Rianon N. Quality of Life assessment in older adults with dementia: a systematic review. Dement Geriatr Cogn Disord. 2021;50:103–110. doi: 10.1159/000515317. [DOI] [PubMed] [Google Scholar]
- 41.Broeiro P, Ramos V, Tavares I, Cunha E, Amorim J. Functional status assessment in the elderly: application of a Portuguese version of the COOP/WONCA Charts. Acta Med Port. 1995;8(5):279–288. [PubMed] [Google Scholar]
- 42.Coast J, Peters T, Richards S, Gunnell D. Use of the EuroQoL among elderly acute care patients. Qual Life Res. 1998;7:1–10. doi: 10.1023/A:1008857203434. [DOI] [PubMed] [Google Scholar]
- 43.Buchholz I, Janssen MF, Kohlmann T, Feng Y-S. A systematic review of studies comparing the measurement properties of the three-level and five-level versions of the EQ-5D. Pharmacoeconomics. 2018;36(6):645–661. doi: 10.1007/s40273-018-0642-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Feng Y-S, Kohlmann T, Janssen MF, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30(3):647–673. doi: 10.1007/s11136-020-02688-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Ghislandi S, Apolone G, Garattini L, Ghislandi I. Is EQ-5D a valid measure of HRQoL in patients with movement disorders? A comparison with SF-36 and FIM questionnaires. Eur J Health Econ. 2002;3(2):125–130. doi: 10.1007/s10198-002-0105-x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional file 1. Detailed search strategy.
Additional file 2. Data extraction sheet.
Additional file 3. COSMIN scoring summary.
Data Availability Statement
The search strategy and data extraction sheets are provided as Supplementary Materials.