Key summary points
Aim
To assess which PROM was best suited to evaluate patient-relevant outcomes of hospitalisation and to assess which factors predicted this PROM.
Findings
Accomplishment of self-defined goals represented the benefit experienced by hospitalisation best, whereas EQ-5D and Katz-15 showed no significant correlations. Subjective indicators of health and functioning are better predictors of goal accomplishment than objective.
Message
Medical decision-making should not only be based on objective medical indicators, but also on subjective indicators such as quality of life, symptom experience, goals and confidence in goal achievement.
Supplementary Information
The online version contains supplementary material available at 10.1007/s41999-022-00698-2.
Keywords: PROM, Hospitalisation, Confidence, Hope, Goal-based care
Abstract
Purpose
Although patient-reported outcome measures (PROMs) might reflect relevant outcomes from patient perspective, they do not always reflect what the individual patient finds important. Our objectives were to assess which PROM was best suited to evaluate patient-relevant outcomes of hospitalisation and to assess which factors predicted this PROM.
Methods
A longitudinal study was conducted among hospitalised older patients. Three PROMs were compared with the anchor question ‘How much have you benefited from the admission?’: a general quality of life measure: EQ-5D; a measure of daily functioning: Katz-15 and a goal-based measure: achievement of self-defined goals. Predictors were examined using logistic regression analyses.
Results
We had 185 cases with baseline and follow-up. Accomplishment of self-defined goals showed a large correlation with the anchor question, whereas EQ-5D and Katz-15 showed no significant correlations. The final regression model had four predictors: being man, having higher confidence in goal achievement and good/excellent quality of life increased the odds for goal accomplishment, while having goals in the category alleviating complaints reduced the odds.
Conclusion
Accomplishment of individual goals represented the benefit experienced by participants best. Subjective indicators of health and functioning are better predictors of goal accomplishment than objective ones. According to participant experience, the hospital appeared successful in managing disease-specific problems, but less successful in ameliorating complaints. Medical decision-making should not only be based on medical indicators, but the input of the patient is at least as important. Quality of life, goals and confidence should be discussed. More attention is needed for symptom experience.
Supplementary Information
The online version contains supplementary material available at 10.1007/s41999-022-00698-2.
Background
Outcomes of hospitalisation are complex to measure and predict. Quantitative outcomes can be described with objective or subjective measures. Examples of objective, often administrative measures are length of stay, mortality, test results or clinical performance indicators. Subjective measures are patient-reported outcomes (PROs), which are dependent on the judgement of the individual patient; examples are symptom burden, functional status and quality of life [1–3]. Although PROs might reflect relevant outcomes from patient perspective better than objective outcomes [2], they do not always reflect what patients find important, since patient involvement in the development of instruments is rare [4]. But even when patients are involved in the development of patient-reported outcome measures (PROMs), these often only reflect the priorities of the overall patient population and do not take into account the individual, while personal and not average outcomes on a group’s level are considered important to individual patients and preferred outcomes differ per individual [5, 6].
A large part of the hospital population consists of older patients [7]. Taking into account individual priorities is even more important for older patients, as they often suffer from multiple chronic diseases. For these patients, a shift is recommended from disease-oriented towards goal-oriented care [8, 9].
To measure individualised meaningful PROMs, the Patient Benefit Assessment Scale for Hospitalised Older Patients (P-BAS HOP) was developed, which was further refined and transformed into the P-BAS Picture version (P-BAS-P) [10, 11]. Both instruments were designed to select and assess the importance of various predefined personal goals during hospitalisation and to evaluate the achievement of goals during follow-up. Based on these data an individual Patient Benefit Index (PBI) was computed, which is an overall value reflecting the achievement of the set goals weighted by their importance. Unfortunately, there were problems with the reliability, validity and responsivity of the instruments [11, 12], causing a debate whether a goal-based approach is the optimal approach to assess individual patient-relevant outcomes of hospitalisation.
In the last years, much attention is paid to functional outcomes after hospitalisation, as around 30% of acute hospitalised older patients experience hospital-associated disability (HAD), which is defined as a loss of independence in activities of daily living (ADL) following hospitalisation [13, 14]. Several factors associated with functional outcomes after hospitalisation are described, including personal characteristics, functioning, health, and characteristics of admission. [15–19]. However, unknown is what the relationship of these factors is with the PROM most relevant to the individual patient.
Therefore, the aims of this study were (1) to assess which PROM is best suited to evaluate the individual patient’s relevant outcomes of hospitalisation and (2) to assess which factors predict this best suitable outcome measure.
Methods
Design and population
This longitudinal study was performed among consecutive hospitalised older patients. The first face-to-face standardised interview took place within the first 4 days of hospitalisation. The follow-up interview was performed 3 months after discharge by telephone.
Because we wanted a broad group of older patients, eligible participants were 70 years and older; either had a planned or unplanned hospital admission on medical or surgical wards of a university teaching hospital in the Netherlands, were able to speak and understand Dutch and were without cognitive impairment. Every weekday, all consecutive patients admitted to medical and surgical wards were selected in the hospital administration according to age and admission date by a trained research assistant. Then the staff nurses were contacted to verify further inclusion criteria. Patients were approached by a trained research assistant and gave signed informed consent.
The Medical Ethics Research Committee of the UMCG (file number M16.192615) confirmed that the Medical Research Involving Human Subjects Act did not apply to the research project. Official approval by the committee was therefore not required.
PROMs
We compared the following PROMs: a general quality of life measure: EQ-5D; a measure of daily functioning: Katz-15 scale and a goal-based measure: achievement of self-defined goals. These outcomes were compared with the anchor question: ‘How much have you benefited from the admission?’ with the following answer options: not at all, a little bit, somewhat, much, very much.
EQ-5D
The EQ-5D is a standardised, non-disease-specific instrument for describing and valuing health-related quality of life, consisting of five dimensions and a visual analogue scale (VAS) [20]. The dimensions are mobility, self-care, usual activities, pain/discomfort and anxiety/depression, with three answer options each: no problems, some problems and extreme problems. A single index value was generated by aggregating and weighting the five domains, using de Dutch EQ-5D tariff. A value of 1 refers to full health and 0 refers to death, while negative values are possible and refer to health states considered worse than death. The VAS, often referred to as the EuroQol ‘thermometer’, has an end point of 100 points for best imaginable health state and 0 points for worst imaginable health state [20]. Participants filled in the EQ-5D three times: during the baseline interview, to indicate their state 2 weeks prior to hospital admission, as well as the day of interview and during the follow-up interview, to indicate their state at the day of interview. We computed two difference scores: between follow-up and prior to admission; and between follow-up and during admission.
Katz-15 scale
The Katz-15 scale consists of 15 items regarding basic activities of daily living (such as the need for help with bathing) and Instrumental Activities of Daily Living (such as shopping) with dichotomous answer options [21]. Participants were asked, during the baseline interview, to indicate their functioning 2 weeks prior to hospital admission, and during the follow-up interview, to indicate their functioning on the day of interview. Items were summed, and a higher score means more dependency. A difference score was computed between the follow-up and situation before admission.
Self-defined goals
The participant was asked at baseline: ‘What do you hope to accomplish with this hospitalisation?’ and named up to five goals. At follow-up, goals stated by the participant were repeated whereafter the participant was asked per goal to what extent the goal was accomplished with the answer options: ‘not at all’, ‘somewhat’, ‘moderately’ ‘quite’, or ‘completely’. The answer options were scored on an ordinal scale from 1 (not at all) to 5 (completely). When two or more goals were scored, the mean score was calculated for calculating the correlation with the anchor question.
Predicting factors
Predicting factors and their operationalisation, selected from literature, are displayed in Table 1. We categorised them into personal characteristics, functioning, health, and characteristics of admission. In addition, we added the characteristics of goals. All goals, defined by participants, were categorised as: wanting to know what the matter is; controlling disease; staying alive; improving condition; alleviating complaints; daily functioning; social functioning; resuming work, hobbies; autonomy [5]. Two researchers (MJvdK, ST) independently categorised the goals and compared results. When a goal could not be categorised into one of the existing categories, it was categorised as ‘other’. Discrepancies were solved by consensus. Since the variety of categories caused low frequencies per category, we combined several categories. Also answer options of diverse other predictors were combined when frequencies were too low for analysis.
Table 1.
Factor | Operationalisation |
---|---|
Personal characteristics | |
Age | Years |
Gender | Male/female |
Living situation | Independent/sheltered accommodation/senior home/nursing home |
Marital status | Alone/with partner |
Health locus of control | Internal/powerful others/chance based of the multidimensional health locus of control scales (MHLC) [22]. We used the Dutch version of the MHLC. A higher score means more belief in that dimension [23] |
Baseline quality of life | Single question: ‘How is in general your quality of life?’ Bad/ reasonable/ good/ very good/ excellent. For analysis we combined the options bad/reasonable and very good/excellent |
Functioning | |
(I)ADL | Katz-15 scale [21] |
Cognitive functioning | For months backward test, we used the detailed grading for research as recommended by [24]. For analysis we combined several grades into the scores: cannot reach January/can reach January with errors/completes test without errors |
Social functioning | Single question from the 36-item Short Form Survey Instrument (SF-36): question ‘During the past 4 weeks, how much of the time has your physical health or emotional problems interfered with your social activities (like visiting with friends, relatives, etc.)?’ none of the time, a little of the time, some of the time, most of the time, all of the time [25] For analysis we combined the options most of the time/all of the time |
Hearing | Single question: ‘Are you able to hear well, with or without hearing aid?’ Yes/no |
Mobility | Single question: ‘Were you able to walk outside for five minutes?’ Impossible/only with help of somebody else/much effort/some effort/no effort. For analysis we combined the options impossible/only with help of somebody else/much effort |
Falls | Single question: ‘Have you been fallen once or more in the past six months?’ Yes/no [26] |
Continence | Single question: ‘Did you use incontinence materials?’ Yes/no |
Health | |
Comorbidity | Charlson Comorbidity Index [27], score based on medical record |
Polypharmacy | Single question: ‘Did you use five or more medications at home?’ Yes/no |
Prior hospital use | Admission to hospital in the last six months |
Depression | Two-question case-finding instrument. Score 1 or more [28] |
Number of symptoms (physical and psychological) | Rotterdam Symptom Checklist (RSCL) [29] originally, the symptoms are on a four-point Likert scale, but we dichotomised the symptoms into present or absent on admission day. Factor analysis revealed the same two factors, namely physical and psychological symptoms |
Self-rated health (two weeks before admission and on day of interview during admission) | EQ-5D VAS (0-100) [20] |
Pain (on moment of interview, during admission) | Numeric rating scale (NRS) 0: no pain at all—10: the worst imaginable pain |
Nutrition | Having either lost weight unintentionally and/or both having experienced a decreased appetite as well as used supplemental drinks or tube feeding [26] |
Characteristics of admission | |
Hospital length of stay | Days |
Admission type | Acute/elective, derived from medical record |
Specialism | Medical/surgical/intervention cardiology |
Characteristics of goals | |
Confidence in goals | NRS per goal 0: no confidence at all—10: full confidence. When a participant had more goals, the mean of the confidence ratings was calculated |
Goal category | Open goals were coded as wanting to know what the matter is/controlling disease/staying alive/improving condition/alleviating complaints/daily functioning/social functioning/resuming work, hobbies/autonomy [5]. For analysis the categories wanting to know what the matter is/controlling disease were combined into category ‘disease’, improving condition/alleviating complaints were combined into category ‘complaints’, daily functioning/autonomy were combined into category ‘functioning’, social functioning/resuming work, hobbies were combined into category ‘social’ |
Analysis
To assess correlations between PROMs and the anchor question, the Spearman’s rank order correlation was calculated. Correlations were interpreted according to Cohen’s criteria: 0.10 = small, 0.30 = medium, and 0.50 = large [30].
Associations between predicting factors and PROM were analysed by logistic regressions. First univariate logistic regression analyses were performed. Predictors with a p value ≤ 0.25 were then entered into a multivariate model [31]. Forward stepwise logistic regression model was used (likelihood ratio method, probability entry: 0.05, removal 0.10). Analyses were performed using IBM SPSS version 27. Pairwise deletion was used for all analyses to handle missing values.
Results
Full details on the inclusion and exclusion of participants are shown in Fig. 1. We included 232 patients at baseline and 185 had a follow-up. As not all cases were complete, we had 155 to 173 cases for analysis. Reasons for not completing the baseline interview were: premature ending the interview because the participant had to leave for, for example, investigation or discharge, or in four cases the participant was unable to mention a goal.
During follow-up, goal accomplishment was not answered for 18 goals. Half of the time the participant did not know the answer. As part of the follow-up took place during the corona pandemic, accomplishment of eight goals could not be answered due to the then applying measures such as travel restrictions and closing of sport accommodations and restaurants. The goals were for example going on holiday, out for lunch, or to the sport club. Descriptive statistics of the sample are shown in Table 2, outcome measures and anchor question are shown in Table 3, and full details of the predictors are shown in Supplementary Information. We compared the participants with and without follow-up and found no significant differences, except for quality life, which was slightly better for participants with follow-up (Mann–Whitney U test: mean rank 94.40 versus 114.56, p = 0.05).
Table 2.
n (%) | |
---|---|
Age (years), median (IQR), range | 75 (72–80), 70–98 |
Gender, male | 109 (59) |
Living situation | |
Independent | 180 (97) |
Sheltered | 2 (1) |
Senior home | 3 (2) |
Nursing home | 0 |
Marital status with partner | 126 (68) |
Admission type—acute | 87 (49) |
Missing | 6 |
Specialism | |
Medical | 81 (45) |
Surgical | 44 (25) |
Intervention cardiology | 54 (30) |
Missing | 6 |
Goal category | n (%) |
---|---|
Matter | 10 (3%) |
Disease | 60 (21%) |
Alive | 18 (6%) |
Condition | 21 (7%) |
Complaints | 44 (15%) |
Daily function | 42 (14%) |
Social | 20 (7%) |
Work/hobbies | 44 (15%) |
Autonomy | 8 (3%) |
Other | 24 (8%) |
Missing | 5 |
IQR interquartile range
Table 3.
Correlations between anchor question and outcome measures
Table 4 shows the correlations between PROMs and the anchor question. The EQ-5D score comparing follow-up and situation before admission showed no correlation with the anchor question, while the EQ-5D score comparing follow-up and situation during admission and the Katz-15 difference score showed a small correlation. Accomplishment of self-defined goals showed a large correlation with the anchor question and was the only statistically significant correlation.
Table 4.
Anchor question | Difference score EQ-5D follow-up—before admission n = 173 |
Difference score EQ-5D follow-up—during admission n = 173 |
Difference score Katz-15 n = 169 |
Accomplishment self-defined goals n = 165 |
---|---|---|---|---|
How much have you benefited from the admission? | 0.00 (p = 0.97) | 0.14 (p = 0.07) | − 0.13 (p = 0.09) | 0.52 (p < 0.001) |
Regression analyses between self-defined goals and predictors
The PROM accomplishment of self-defined goals was dichotomised as follows: the answer options ‘not at all’, ‘somewhat’, and ‘moderately’ were defined as ‘not accomplished’; the answer options ‘quite’ and ‘completely’ were defined as ‘accomplished’. When a participant had more than one goal and all goals were attained from ‘not at all’ to ‘moderately’, it was defined as ‘not accomplished’; when all goals were attained as ‘moderately’ to ‘completely’, this was defined as ‘accomplished’. When participants had a combination of one or more goals attained as ‘not at all’ or ‘somewhat’ and ‘quite’ or ‘completely’, the definition of accomplishment was unsure, and therefore the case was removed. After dichotomisation of goal accomplishment, 101 cases were defined as ‘accomplished’ and 59 as ‘not accomplished’. We had to remove 15 cases because accomplishment was unsure. Cases that were removed had: a higher proportion living with partner (93% versus 66%, χ2 = 4.67, p = 0.02); more dependencies on the Katz-15 (Mann–Whitney U test: mean rank 116.80 versus 84.17, p = 0.01); and a higher proportion of goals in the category ‘social’ (87% versus 18%, χ2 = 35.32, p = 0.00).
Results of the univariate logistic regression analyses are shown in Table 5. The predictors gender, baseline quality of life, mobility, depression, self-rated health before admission, confidence in goals, goal category disease, and goal category complaints predicted goal achievement with statistical significance.
Table 5.
Univariate (n = 160) | Multivariate (n = 155) | |||
---|---|---|---|---|
Odds ratio (95% CI) | p value | Odds ratio (95% CI) | p value | |
Age | 1.04 (0.97–1.11) | 0.27 | ||
Gender-male | 2.44 (1.26–4.72) | 0.01 | 2.44 (1.15–5.16) | 0.02 |
Marital status—with partner | 0.99 (0.50–1.95) | 0.98 | ||
Health locus of control | ||||
Internal | 1.01 (0.94–1.08) | 0.88 | ||
Powerful others | 1.02 (0.96–1.09) | 0.44 | ||
Chance | 0.98 (0.92–1.05) | 0.64 | ||
Quality of life | 0.00 | 0.05 | ||
Bad/reasonable | Reference | Reference | ||
Good | 2.94 (1.01–8.56) | 0.05 | 1.90 (0.56–6.43) | 0.30 |
Very good/excellent | 7.27 (2.22–23.80) | 0.001 | 4.54 (1.19–17.26) | 0.03 |
Katz ADL | 0.89 (0.76–1.05) | 0.16 | ||
Cognitive functioning | 0.54 | |||
Could not reach January | Reference | |||
Could reach January with errors | 0.55 (0.10–3.03) | 0.49 | ||
No errors | 0.44 (0.09–2.19) | 0.31 | ||
Social functioning | 0.13 | |||
None of the time | Reference | |||
A little of the time | 0.68 (0.24–1.88) | 0.46 | ||
Some of the time | 0.36 (0.16–0.82) | 0.02 | ||
Most of the time | 0.36 (0.12–1.06) | 0.06 | ||
All of the time | 0.54 (0.14–2.16) | 0.39 | ||
Hearing—well | 0.71 (0.30–1.69) | 0.44 | ||
Mobility—able to walk for 5 min | 0.04 | |||
No effort | Reference | |||
Some effort | 0.39 (0.18–0.83) | 0.02 | ||
Much effort—impossible | 0.48 (0.19–1.21) | 0.12 | ||
Falls—yes | 1.29 (0.61–2.75) | 0.51 | ||
Incontinence | 0.68 (0.30–1.54) | 0.36 | ||
Charlson Comorbidity | 0.99 (0.86–1.14) | 0.86 | ||
Polypharmacy | 0.78 (0.39–1.55) | 0.47 | ||
Prior hospitalisation | 1.20 (0.61–2.37) | 0.59 | ||
Depression score | 0.49 (0.25–0.98) | 0.04 | ||
Symptoms—physical | 0.92 (0.83–1.02) | 0.10 | ||
Symptoms—mental | 0.83 (0.69–1.01) | 0.06 | ||
Self-rated health 2 weeks before admission | 1.03 (1.01–1.04) | 0.01 | ||
Self-rated health during admission | 1.01 (0.99–1.03) | 0.28 | ||
Pain-NRS | 1.02 (0.90–1.16) | 0.80 | ||
Nutrition—score yes | 0.92 (0.46–1.85) | 0.81 | ||
Hospital length of stay | 1.01 (0.94–1.08) | 0.79 | ||
Admission type—acute | 0.86 (0.45–1.65) | 0.65 | ||
Speciality of admission | 0.42 | |||
Medical | Reference | |||
Surgical | 1.27 (0.56–2.88) | 0.57 | ||
Intervention cardiology | 1.22 (0.57–2.61) | 0.62 | ||
Confidence in goal achievement | 1.52 (1.18–1.95) | 0.00 | 1.43 (1.08–1.88) | 0.01 |
Goal category disease | 2.42 (1.16–5.03) | 0.02 | ||
Goal category complaints | 0.27 (0.13–0.53) | 0.00 | 0.26 (0.12–0.56) | 0.00 |
Goal category social | 1.67 (0.69–4.06) | 0.26 | ||
Goal category functioning | 1.06 (0.50–2.24) | 0.88 |
Multivariate model: Nagelkerke R2 = 0.29; χ2 = 37.67, p < 0.001
The predictors gender, baseline quality of life, (I)ADL, social functioning, mobility, depression, number of physical and psychological symptoms, self-rated health before admission, confidence in goals, goal category disease, and goal category alleviating complaints were entered into a multivariate analysis. Since five participants had one or more missing values in these predictors, we had 98 cases defined as ‘accomplished’ and 57 as ‘not accomplished’ for multivariate analysis. As shown in the last two columns of Table 5, the final model had four predictors, indicating that being a man and having a higher confidence in goals increased the odds for goal accomplishment and having goals in the category alleviating complaints reduced the odds for goal accomplishment. From baseline quality of life, only the odds of good/excellent quality of life were significant when compared to bad/reasonable.
Discussion
The first aim of this study was to assess which PROM is best suited to evaluate patient-relevant outcomes of hospitalisation. Therefore, multiple PROMs were compared with the anchor question whether participants experienced benefit from their hospitalisation. When comparing this perceived benefit with change in a frequently used general quality of life instrument, the EQ-5D, and change in daily functioning with the Katz-15, we noticed no, or only a small non-significant correlation. In contrast, accomplishment of self-defined goals had a large correlation with experienced benefit from hospitalisation.
Most participants did not change in EQ-5D score at all. This could be caused by a lack of responsiveness of the EQ-5D. Ceiling effects are described, as well as too little answer options [32–34]. Ceiling effects were also present in our study, with 16–20% scoring 1 at baseline. A review of reviews showed that the performance of the EQ-5D is inconsistent between different conditions, it appeared to be responsive for many diseases, but for others it was not [35]. This could be another explanation, since we had a heterogeneous group of participants. Moreover, responsiveness was mostly based on effect sizes or standardised response means [35]. This method is debatable, since these measures reflect the magnitude of change, but not the validity of change [36]. As the change, or lack of change, did not correlate with our anchor question, it apparently did not correspond with what these participants considered as a relevant (lack of) benefit.
Another debate is the relevance of the items of the EQ-5D. When comparing the goals with the domains of the EQ-5D, we saw that 90 participants had goal(s) that could not be linked to an EQ-5D domain, for 68 participants their goal(s) were represented in one domain and for 7 participants in two domains. No participants had goals represented by three or more domains. The most prevalent domain (46 times) was ‘usual activities’, followed by mobility (24×). Apparently, the EQ-5D does not reflect the specific relevant outcomes of hospitalisation for individual patients.
The correlation of the change in Katz-15 with our anchor question was also small and non-significant. Daily functioning is often mentioned as an important outcome for older persons [5, 37–40]. In our sample 22% of the participants mentioned at least one goal coded as daily functioning, which endorses the importance of daily functioning. However, this also means that 78% of the participants had no goals related to daily functioning. So, using daily functioning as an outcome of hospitalisation does not represent the diversity of personal goals.
Another explanation for the difference in strengths of correlations could be the time course direction of the questions. Both the anchor question and goal achievement ask participants to look back during follow-up to assess how much they have benefited or whether they have achieved their goals, while for the EQ-5D and Katz-15 difference scores are computed between follow-up and baseline. Therefore it is not surprising that the correlation between goals and anchor question is stronger. However, the magnitude of the difference is so large that we conclude that accomplishment of individually stated goals best represents the benefit experienced by individual participants, because goals are very individual.
From the variables predicting goal accomplishment, our second aim, it seems that more subjective indicators of health and functioning, such as quality of life, depressive symptoms, and self-rated health, are better predictors than more objective predictors, such as ADL functioning, falling, comorbidity, and nutritional status. Since goal accomplishment is also subjective, common variance may be shared. However, relationships between subjective PROMs and objective outcomes are common, such as survival [41]. The importance of subjective predictors means that medical decision-making should not only be based on medical indicators, but the input of the individual patient is at least as important. Subjective quality of life, goals, and confidence should be discussed and weighted to reach shared decision.
The importance of confidence in goal achievement can be explained from the construct of hope. Hope is always related to a goal (something for which to hope) and involves thoughts about a strategy for achieving goals and the ability to begin and continue the selected strategy [42]. Hope and optimism are also described as predictors for positive outcomes, both subjective and objective outcomes [42–46]. Although a quite new area, there are some promising interventions described to enhance hope, such as cognitive coping techniques or “hope therapy”, where goal setting has a prominent place [42]. Further research is needed to investigate whether these interventions also promote goal accomplishment.
The influence of gender was surprising. An explanation could be that men in our sample had less physical and mental symptoms, less limitations in (I)ADL and less mobility problems. This might be a reflection of the evidence that a higher proportion of older European women are in a frail state [47].
The odds ratios for the goal categories ‘Disease’ and ‘Complaints’ were contradicting, indicating that, according to participant experience, the hospital is successful in diagnosing and restoring disease-specific problems, such as removing tumours, restoring sinus rhythm or improving kidney function, but less successful in ameliorating the symptoms patients experience, such as fatigue, shortness of breath, or pain. Therefore, during hospitalisation more attention is needed for symptom experience and relief of complaints and not only for objective outcomes. Better follow-up care may be needed to continue symptom management after discharge, but maybe also patient expectations towards therapy need to be tempered. For example, fatigue more often worsens after hospitalisation than improves [48].
The final model contained four variables, namely gender, quality of life, confidence in goal achievement, and goal category complaints. The Nagelkerke R2 is a measure of overall effect size used for logistic regression. It runs from 0 to 1, and its interpretation is comparable with R2 in multiple regression analysis [49, 50]. The Nagelkerke R2 of our final model was 0.29, so much of the variance was not explained by the variables. It could be that we were missing variables, but it is also possible that goal accomplishment is very individual and therefore difficult to predict by statistical models.
Strengths and limitations
The strengths of our study are that we highlighted the importance of individualised goals and outcomes, instead of ‘one outcome fits all’. By asking open questions, the individual patient perspective was disclosed. Due to a heterogeneous sample, we have high external validity.
However, also some limitations were present. First, we had no information about the importance of the goals, while the importance of goals can influence the perceived benefit when goals are (not) accomplished [11]. The importance of goals is especially relevant when, within one participant, some goals are accomplished and others not. This was the reason we left out 15 participants with contradicting results, but we do not know what the effect of this exclusion was.
Since the 15 excluded cases, per definition, all had two or more goals, we had not included the predictor ‘number of goals’, because this would give a biased result. As a result, we cannot draw any conclusions about a potential effect of the number of indicated goals.
Our sample also had some limitations: almost all participants lived independently and we could not include any nursing home residents. Therefore, an impact of being a nursing home resident on goal accomplishment is unknown. Due to our inclusion criteria, we had little variance in cognition and therefore we cannot draw conclusions about an effect of cognition. Finally, our sample was not large enough for cross-validation. Therefore, caution is needed to draw conclusions on a stepwise regression model.
Conclusions and recommendations
Goals of hospitalisation are very individual and therefore the experienced benefit is better represented by accomplishment of individually stated goals then generalised PROMs. The accomplishment of goals is predicted by subjective indicators such as quality of life and confidence in goal achievement, and also whether goals were disease specific or ameliorating complaints. Therefore, medical decision-making should not only be based on medical indicators, but also the input of the patient should be seen as at least as important, especially confidence should be discussed. More attention for symptom management is needed during and after hospitalisation. Further research is recommended to investigate whether hope-enhancing interventions also enhance goal accomplishment.
Supplementary Information
Below is the link to the electronic supplementary material.
Funding
This work was supported by an unrestricted grant from the University of Groningen.
Declarations
Conflict of interest
We have no conflict of interest to declare.
Ethical approval
The Medical Ethics Research Committee of the UMCG (file number M16.192615) confirmed that the Medical Research Involving Human Subjects Act did not apply to the research project. Official approval by the committee was therefore not required.
Informed consent
Informed consent was obtained from all participants.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Maria Johanna van der Kluit, Email: m.j.van.der.kluit@umcg.nl.
Sanne Tent, Email: s.tent@umcg.nl.
Geke J. Dijkstra, Email: geke.dijkstra@nhlstenden.com
Sophia E. de Rooij, Email: sejaderooij@gmail.com
References
- 1.Bowyer A, Royse C. A matter of perspective - objective versus subjective outcomes in the assessment of quality of recovery. Best Pract Res Clin Anaesthesiol. 2018;32:287–294. doi: 10.1016/j.bpa.2018.02.003. [DOI] [PubMed] [Google Scholar]
- 2.Neville A, Lee L, Antonescu I, Mayo NE, Vassiliou MC, Fried GM, et al. Systematic review of outcomes used to evaluate enhanced recovery after surgery. Br J Surg. 2014;101:159–170. doi: 10.1002/bjs.9324. [DOI] [PubMed] [Google Scholar]
- 3.Ciani O, Salcher-Konrad M, Meregaglia M, Smith K, Gorst SL, Dodd S, et al. Patient-reported outcome measures in core outcome sets targeted overlapping domains but through different instruments. J Clin Epidemiol. 2021;136:26–36. doi: 10.1016/j.jclinepi.2021.03.003. [DOI] [PubMed] [Google Scholar]
- 4.Wiering B, de Boer D, Delnoij D. Patient involvement in the development of patient-reported outcome measures: a scoping review. Health Expect. 2017;20:11–23. doi: 10.1111/hex.12442. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.van der Kluit MJ, Dijkstra GJ, de Rooij SE. Goals of older hospitalised patients: a qualitative descriptive study. BMJ Open. 2019;9:e029993. doi: 10.1136/bmjopen-2019-029993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wiering B, de Boer D, Delnoij D. Asking what matters: the relevance and use of patient-reported outcome measures that were developed without patient involvement. Health Expect. 2017;20:1330–1341. doi: 10.1111/hex.12573. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bakker FC, OldeRikkert MG. Hospital care for frail elderly adults: from specialized geriatric units to hospital-wide interventions. Interdiscip Top Gerontol Geriatr. 2015;41:95–106. doi: 10.1159/000381171. [DOI] [PubMed] [Google Scholar]
- 8.Reuben DB, Tinetti ME. Goal-oriented patient care–an alternative health outcomes paradigm. N Engl J Med. 2012;366:777–779. doi: 10.1056/NEJMp1113631. [DOI] [PubMed] [Google Scholar]
- 9.Tinetti ME, Naik AD, Dodson JA. Moving from disease-centered to patient goals-directed care for patients with multiple chronic conditions: patient value-based care. JAMA Cardiology. 2016;1:9–10. doi: 10.1001/jamacardio.2015.0248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.van der Kluit MJ, Dijkstra GJ, van Munster BC, De Rooij S. Development of a new tool for the assessment of patient-defined benefit in hospitalised older patients: the patient benefit assessment scale for hospitalised older patients (P-BAS HOP) BMJ Open. 2020;10:e038203. doi: 10.1136/bmjopen-2020-038203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.van der Kluit MJ, Dijkstra GJ, de Rooij SE. Adaptation of the patient benefit assessment scale for hospitalised older patients: development, reliability and validity of the P-BAS picture version. BMC Geriatr. 2022;22:43. doi: 10.1186/s12877-021-02708-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.van der Kluit MJ, Dijkstra GJ, de Rooij SE. Reliability and validity of the patient benefit assessment scale for hospitalised older patients (P-BAS HOP) BMC Geriatr. 2021;21:149. doi: 10.1186/s12877-021-02079-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Covinsky K, Pierluissi E, Johnston CB. Hospitalization-associated disability: "she was probably able to ambulate, but I'm not sure". JAMA. 2011;306:1782–1793. doi: 10.1001/jama.2011.1556. [DOI] [PubMed] [Google Scholar]
- 14.Loyd C, Markland AD, Zhang Y, Fowler M, Harper S, Wright NC, et al. Prevalence of hospital-associated disability in older adults: a meta-analysis. J Am Med Dir Assoc. 2020;21(455):461.e5. doi: 10.1016/j.jamda.2019.09.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hoogerduijn J, Schuurmans M, Duijnstee MSH, de Rooij S, Grypdonck MFH. A systematic review of predictors and screening instruments to identify older hospitalized patients at risk for functional decline. J Clin Nurs. 2007;16:46–57. doi: 10.1111/j.1365-2702.2006.01579.x. [DOI] [PubMed] [Google Scholar]
- 16.Milte CM, Luszcz MA, Ratcliffe J, Masters S, Crotty M. Influence of health locus of control on recovery of function in recently hospitalized frail older adults. Geriatr Gerontol Int. 2015;15:341–349. doi: 10.1111/ggi.12281. [DOI] [PubMed] [Google Scholar]
- 17.McCusker J, Kakuma R, Abrahamowicz M. Predictors of functional decline in hospitalized elderly patients: a systematic review. J Gerontol A Biol Sci Med Sci. 2002;57:M569–M577. doi: 10.1093/gerona/57.9.M569. [DOI] [PubMed] [Google Scholar]
- 18.Chou MY, Liang CK, Hsu YH, Wang YC, Chu CS, Liao MC, et al. Developing a predictive model for hospital-associated disability among older patients hospitalized for an acute illness: the HAD-FREE Score. Eur Geriatr Med. 2021;12:963–971. doi: 10.1007/s41999-021-00497-1. [DOI] [PubMed] [Google Scholar]
- 19.De Saint-Hubert M, Schoevaerdts D, Cornette P, D'Hoore W, Boland B, Swine C. Predicting functional adverse outcomes in hospitalized older patients: a systematic review of screening tools. J Nutr Health Aging. 2010;14:394–399. doi: 10.1007/s12603-010-0086-x. [DOI] [PubMed] [Google Scholar]
- 20.Lamers LM, McDonnell J, Stalmeier PF, Krabbe PF, Busschbach JJ. The Dutch tariff: results and arguments for an effective design for national EQ-5D valuation studies. Health Econ. 2006;15:1121–1132. doi: 10.1002/hec.1124. [DOI] [PubMed] [Google Scholar]
- 21.Laan W, Zuithoff NP, Drubbel I, Bleijenberg N, Numans ME, de Wit NJ, et al. Validity and reliability of the Katz-15 scale to measure unfavorable health outcomes in community-dwelling older people. J Nutr Health Aging. 2014;18:848–854. doi: 10.1007/s12603-014-0558-5. [DOI] [PubMed] [Google Scholar]
- 22.Wallston KA, Wallston BS, DeVellis R. Development of the multidimensional health locus of control (MHLC) scales. Health Educ Monogr. 1978;6:160–170. doi: 10.1177/109019817800600107. [DOI] [PubMed] [Google Scholar]
- 23.Halfens R, Philipsen H. Een gezondheidsspecifieke beheersingsoriëntatieschaal. Validiteit en betrouwbaarheid van de MHLC. Tijdschrift voor sociale gezondheidszorg. 1988;66:399–403. [Google Scholar]
- 24.Meagher J, Leonard M, Donoghue L, O'Regan N, Timmons S, Exton C, et al. Months backward test: a review of its use in clinical studies. World J Psychiatry. 2015;5:305–314. doi: 10.5498/wjp.v5.i3.305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, et al. Translation, validation, and norming of the Dutch language version of the SF-36 health Survey in community and chronic disease populations. J Clin Epidemiol. 1998;51:1055–1068. doi: 10.1016/S0895-4356(98)00097-3. [DOI] [PubMed] [Google Scholar]
- 26.Heim N, van Fenema EM, Weverling-Rijnsburger AW, Tuijl JP, Jue P, Oleksik AM, et al. Optimal screening for increased risk for adverse outcomes in hospitalised older adults. Age Ageing. 2015;44:239–244. doi: 10.1093/ageing/afu187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–383. doi: 10.1016/0021-9681(87)90171-8. [DOI] [PubMed] [Google Scholar]
- 28.Whooley MA, Avins AL, Miranda J, Browner WS. Case-finding instruments for depression. Two questions are as good as many. J Gen Intern Med. 1997;12:439–445. doi: 10.1046/j.1525-1497.1997.00076.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.de Haes JC, van Knippenberg FC, Neijt JP. Measuring psychological and physical distress in cancer patients: structure and application of the Rotterdam Symptom Checklist. Br J Cancer. 1990;62:1034–1038. doi: 10.1038/bjc.1990.434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Cohen J. Statistical power analysis for the behavioral sciences. New York: Lawrence Erlbaum Associates; 1988. [Google Scholar]
- 31.Stoltzfus JC. Logistic regression: a brief primer. Acad Emerg Med. 2011;18:1099–1104. doi: 10.1111/j.1553-2712.2011.01185.x. [DOI] [PubMed] [Google Scholar]
- 32.Payakachat N, Ali MM, Tilford JM. Can the EQ-5D detect meaningful change? A systematic review. Pharmacoeconomics. 2015;33:1137–1154. doi: 10.1007/s40273-015-0295-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Paterson C. Seeking the patient's perspective: a qualitative assessment of EuroQol, COOP-WONCA charts and MYMOP. Qual Life Res. 2004;13:871–881. doi: 10.1023/B:QURE.0000025586.51955.78. [DOI] [PubMed] [Google Scholar]
- 34.Tordrup D, Mossman J, Kanavos P. Responsiveness of the EQ-5D to clinical change: is the patient experience adequately represented? Int J Technol Assess Health Care. 2014;30:10–19. doi: 10.1017/S0266462313000640. [DOI] [PubMed] [Google Scholar]
- 35.Finch AP, Brazier JE, Mukuria C. What is the evidence for the performance of generic preference-based measures? A systematic overview of reviews. Eur J Health Econ. 2018;19:557–570. doi: 10.1007/s10198-017-0902-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.De Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine. A practical guide. Cambridge: Cambridge University Press; 2011. [Google Scholar]
- 37.Beishuizen SJE, Festen S, van der Werf HW, de Graeff P, van Munster BC. Was it worth it? Benefits of transcatheter aortic valve implantation from a patient's perspective. J Am Geriatr Soc. 2021;69:2605–2611. doi: 10.1111/jgs.17216. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Coleman EA, Min SJ. Patients' and family caregivers' goals for care during transitions out of the hospital. Home Health Care Serv Q. 2015;34:173–184. doi: 10.1080/01621424.2015.1095149. [DOI] [PubMed] [Google Scholar]
- 39.Stegmann ME, Festen S, Brandenbarg D, Schuling J, van Leeuwen B, de Graeff P, et al. Using the outcome prioritization tool (OPT) to assess the preferences of older patients in clinical decision-making: a review. Maturitas. 2019;128:49–52. doi: 10.1016/j.maturitas.2019.07.022. [DOI] [PubMed] [Google Scholar]
- 40.Coylewright M, Palmer R, O'Neill ES, Robb JF, Fried TR. Patient-defined goals for the treatment of severe aortic stenosis: a qualitative analysis. Health Expect. 2016;19:1036–1043. doi: 10.1111/hex.12393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Gotay CC, Kawamoto CT, Bottomley A, Efficace F. The prognostic significance of patient-reported outcomes in cancer clinical trials. J Clin Oncol. 2008;26:1355–1363. doi: 10.1200/JCO.2007.13.3439. [DOI] [PubMed] [Google Scholar]
- 42.Corn BW, Feldman DB, Wexler I. The science of hope. Lancet Oncol. 2020;21:e452–e459. doi: 10.1016/S1470-2045(20)30210-2. [DOI] [PubMed] [Google Scholar]
- 43.Scheier MF, Carver CS. Dispositional optimism and physical health: a long look back, a quick look forward. Am Psychol. 2018;73:1082–1094. doi: 10.1037/amp0000384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Scheier MF, Swanson JD, Barlow MA, Greenhouse JB, Wrosch C, Tindle HA. Optimism versus pessimism as predictors of physical health: a comprehensive reanalysis of dispositional optimism research. Am Psychol. 2021;76:529–548. doi: 10.1037/amp0000666. [DOI] [PubMed] [Google Scholar]
- 45.Rozanski A, Bavishi C, Kubzansky LD, Cohen R. Association of optimism with cardiovascular events and all-cause mortality: a systematic review and meta-analysis. JAMA Netw Open. 2019;2:e1912200. doi: 10.1001/jamanetworkopen.2019.12200. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Rasmussen HN, Scheier MF, Greenhouse JB. Optimism and physical health: a meta-analytic review. Ann Behav Med. 2009;37:239–256. doi: 10.1007/s12160-009-9111-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Nielsen CR, Ahrenfeldt LJ, Jeune B, Christensen K, Lindahl-Jacobsen R. Healthy life expectancy by frailty state in Europe from 2004 to 2015: findings from SHARE. Eur J Public Health. 2021;31:554–560. doi: 10.1093/eurpub/ckab012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.van Seben R, Reichardt L, Essink D, van Munster B, Bosch J, Buurman B. "I Feel Worn Out, as if I Neglected Myself": older patients' perspectives on post-hospital symptoms after acute hospitalization. Gerontologist. 2018;59:315–326. doi: 10.1093/geront/gnx192. [DOI] [PubMed] [Google Scholar]
- 49.Nagelkerke NJD. A note on a general definition of the coefficient of determination. Biometrika. 1991;78:691–692. doi: 10.1093/biomet/78.3.691. [DOI] [Google Scholar]
- 50.Polit DF. Statistics and data analysis for nursing research. New Jersey: Pearson Education; 2010. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.