Abstract
Objectives
To explore and compare patient/carer experiences of rehabilitation in the intervention and usual care arms of the RECOVER trial (ISRCTN09412438); a randomised controlled trial of a complex intervention of post-intensive care unit (ICU) acute hospital-based rehabilitation following critical illness.
Design
Mixed methods process evaluation including comparison of patients' and carers' experience of usual care versus the complex intervention. We integrated and compared quantitative data from a patient experience questionnaire (PEQ) with qualitative data from focus groups with patients and carers.
Setting
Two university-affiliated hospitals in Scotland.
Participants
240 patients discharged from ICU who required ≥48 hours of mechanical ventilation were randomised into the trial (120 per trial arm). Exclusion criteria comprised: primary neurologic diagnosis, palliative care, current/planned home ventilation and age <18 years. 182 patients completed the PEQ at 3 months postrandomisation. 22 participants (14 patients and 8 carers) took part in focus groups (2 per trial group) at >3 months postrandomisation.
Interventions
A complex intervention of post-ICU acute hospital rehabilitation, comprising enhanced physiotherapy, nutritional care and information provision, case-managed by dedicated rehabilitation assistants (RAs) working within existing ward-based clinical teams, delivered between ICU discharge and hospital discharge. Comparator was usual care.
Outcome measures
A novel PEQ capturing patient-reported aspects of quality care.
Results
The PEQ revealed statistically significant between-group differences across 4 key intervention components: physiotherapy (p=0.039), nutritional care (p=0.038), case management (p=0.045) and information provision (p<0.001), suggesting greater patient satisfaction in the intervention group. Focus group data strongly supported and helped explain these findings. Specifically, case management by dedicated RAs facilitated greater access to physiotherapy, nutritional care and information that cut across disciplinary boundaries and staffing constraints. Patients highly valued its individualisation according to their needs, abilities and preferences.
Conclusions
Case management by dedicated RAs improves patients' experiences of post-ICU hospital-based rehabilitation and increases perceived quality of care.
Trial registration number
ISRCTN09412438.
Keywords: REHABILITATION MEDICINE, QUALITATIVE RESEARCH
Strengths and limitations of this study.
Our trial is among the very few critical care complex interventional trials to incorporate the Medical Research Council's (MRC) recommendations for outcomes and process evaluation into its evaluation strategy.
Our trial is among the very few such trials to critically explore patient experience, using a novel patient experience questionnaire and qualitative methods.
Exploring patient experience helped identify the perceived value of each interventional component and the means to individualise post-ICU rehabilitation in accordance with National Institute for Health and Care Excellence guidance.
The patient experience questionnaire has yet to be psychometrically validated.
Sample size was small in our comparative focus group interviews.
Introduction
Intensive care unit (ICU) survivors commonly experience physical, psychological and cognitive impairment, recently termed ‘the postintensive care syndrome’.1 National Institute for Health and Care Excellence recommends regular assessment and individualised rehabilitation for these patients,2 but optimum rehabilitation components and service delivery models are uncertain. Several trials have evaluated rehabilitation interventions conducted or initiated during the ICU stay,3–7 the acute hospital stay8 and after hospital discharge.9–12 Systematic reviews suggest that early ICU-based interventions may be effective,13–16 but interventions starting post-ICU discharge, including the RECOVER study,17 have failed to demonstrate clinical efficacy using recommended quantitative outcome-based approaches.18
Recognising the limitations of outcome evaluations of complex interventions alone, the Medical Research Council (MRC) recommends, in addition, the process evaluation of complex interventions.19 This is intended to describe the fidelity and quality of implementation, clarify causal mechanisms and identify contextual influences that may influence outcomes.19 Specific recommendations from subsequent guidance include: exploring patients' experiences of the intervention and the use of qualitative approaches to explain quantitative findings.20 With the exception of a single study,21 however, previous trials of rehabilitation interventions in this patient group have failed to describe patient experience of the intervention, therefore preventing detailed understanding of potentially beneficial components and/or treatments.
We recently reported the quantitative outcomes of a randomised controlled trial (RCT) of increased hospital-based physical rehabilitation and information provision following ICU discharge (RECOVER trial; ISRCTN0941243817). The intervention involved a dedicated rehabilitation assistant (RA) working within existing ward-based clinical teams to increase the frequency and intensity of physiotherapy and nutritional care, together with individualised critical illness-related information provision, from ICU to hospital discharge. The comparator was current usual care (figure 1, online supplementary files for a summary of trial design and content). We found no between-group differences across quantitative measures of physical function (Rivermead Mobility Index,22 hand-grip strength, the timed-up-and-go test,23 health-related quality of life (HRQoL; SF-1224), self-reported symptoms (fatigue, pain, appetite, joint stiffness, breathlessness using visual analogue scales (VAS)) or rates of anxiety, depression and post-traumatic stress using the Hospital Anxiety and Depression Scale25 and Davidson's Trauma Scale, respectively,26 at 3, 6 or 12 months postrandomisation.
bmjopen-2016-012041supp1.pdf (196.7KB, pdf)
bmjopen-2016-012041supp2.pdf (195.3KB, pdf)
However, a patient experience questionnaire (PEQ) administered at 3 months post-randomisation indicated that patient satisfaction scores were higher among the intervention group across four key intervention components. In this article, we report the findings of a preplanned, mixed methods process evaluation, comprising the triangulation of PEQ data with qualitative data from comparative focus group interviews with patients/carers. Our aim was to better understand and compare patients' experiences of rehabilitation in the trial, and specifically to explore effects on perceived quality of care that were unlikely to be captured with traditional quantitative outcome measures.
Methods
We conducted a mixed methods analysis of population-level quantitative data from the PEQ (n=182 respondents) and qualitative analysis of comparative focus groups (n=22 participants), as part of a preplanned process evaluation of the trial.
Trial overview
RECOVER was a parallel group, complex intervention RCT with blinded outcome assessment, undertaken in two university-affiliated hospitals in Edinburgh, Scotland.17 The intervention development, trial protocol and quantitative trial outcomes have been published previously.27–30 A summary of trial design, content and key differences in rehabilitation treatment are shown in figure 1.
In accordance with MRC guidance on the process evaluation of complex interventions,20 we conducted focus groups with patient participants and family members from both trial arms to explore and compare experiences of rehabilitation. We planned an a priori mixed methods process evaluation of the intervention, by integrating the quantitative PEQ data with the qualitative focus group data, in order to maximise understanding of the individual effects of the intervention's key components.
Patient experience questionnaire
The PEQ was designed based on pretrial qualitative research (Doctoral thesis) among survivors of prolonged mechanical ventilation (n=20), which identified nine domains of post-ICU acute hospital care and rehabilitation that concerned participants most.31 Based on advice from an expert in questionnaire development, these were incorporated within a VAS including anchor points (excellent (0) to poor (20)) and anchor quotes derived from the data29 to help patients report their experiences (figure 2, online supplementary files for the PEQ). We explored the face and content validity of the questionnaire by asking a small number of recovering patients to describe the extent to which the PEQ reflected their experiences of ward care. Developing the PEQ on the basis of patients' accounts was intended to maximise the questionnaire's sensitivity to issues that patients previously reported as important markers of quality care.32 Questionnaires were completed at 3 months postrandomisation, at the time of primary outcome assessment, with research staff blinded from group allocation.
Scores for each question were compared between the usual care and intervention groups using Mann-Whitney tests and median differences (with 95% CIs). We calculated p values to assess the significance of any differences between the groups, using p<0.05 as statistically significant. In order to examine the consistency of patient experience between the trial groups, we also explored the variability and dispersion of responses by comparing the IQRs between groups.
Comparative focus groups with patients and family members
Qualitative approaches can be useful in understanding the clinical context in which complex interventions take place, identifying unexpected causal mechanisms or effects, identifying evolving changes in trial implementation and exploring ‘what works, for whom, under what circumstances’.20 33 Focus group interviews are increasingly used to explore experiences of healthcare. Typically comprising 6–12 participants, they are an efficient means of capturing multiple participants' perspectives. Group dynamics can be particularly helpful in eliciting the views of patients or patient groups who might otherwise be too ‘grateful’ or reluctant to ‘complain’, and in identifying potential solutions to shared concerns.34 35 We specifically wanted to explore and compare participants' experiences of usual care versus the complex intervention.
We conducted two comparative focus groups with patients and family members in each trial arm (n=4 focus groups). The main trial was approved by the Scotland A Research Ethics Committee (10/MRE00/18) and additional written consent was provided by focus group participants. An experienced qualitative researcher (PR) developed topic guides for each trial group, based on pretrial work24 25 29 and the published taxonomy of intervention26 (tables 1 and 2, online supplementary files for indicative topic guides for each group). Participants were given significant freedom to discuss other experiences of care, both positive and negative. The focus groups took place after the primary outcome data (including the PEQ) had been collected after 3 months post-randomisation to minimise bias. Participant characteristics are summarised in table 1.
Table 1.
Focus groups | Usual care group | Intervention group |
---|---|---|
Numbers and composition | Group 1: 7 participants (4 patients; 3 carers) Group 2: 5 participants (3 patients; 2 carers) |
Group 1: 6 participants (4 patients; 2 carers) Group 2: 4 participants (3 patients; 1 carer) |
Patient age | 70 (63, 78) | 55 (36, 69) |
Proportion male (%) | 66 | 50 |
APACHE II score | 23 (17, 26) | 18 (15, 21) |
Length of ventilation (days) | 11 (5, 19) | 5 (4, 18) |
ICU length of stay (days) | 12 (4, 16) | 7 (5, 10) |
Length of hospital stay (days) | 9 (6, 18) | 13 (12, 80) |
Demographic data were not available for carers. All values represent median (1st, 3rd quartile) unless stated.
ICU, intensive care unit.
Table 2.
Aspect of rehabilitation explored in focus groups | Domains of PEQ included |
---|---|
Physiotherapy | Exercises to get you moving/back on your feet |
Nutritional care | Help with eating and nutrition |
Case management | Transfer from ICU to the ward Ward staff's understanding of your time in intensive care Help, support and advice with being independent Being involved in decisions about your care Organisation and coordination of care |
Information provision | Information about what happened in intensive care Knowing what to expect after you got home |
ICU, intensive care unit; PEQ, patient experience questionnaire.
Focus group discussions were recorded using a digital voice recorder and transcribed verbatim. Data were managed and analysed using qualitative data analysis software (NVIVO V.10). PR developed an a priori analytical framework, based on the four key components of the intervention, which mapped onto the dimensions of the PEQ. We used thematic analysis to collate qualitative data that were relevant to each intervention component, identifying broad patterns of experience therein.36 In order to minimise bias, the primary analysis was undertaken by an experienced independent qualitative researcher. A confirmatory analysis was undertaken by PR. All quantitative trial data were unavailable to the qualitative researchers during analysis.
Integration of qualitative and quantitative data
We adopted a sequential explanatory model to data collection and analysis,37 namely the administration and analysis of the quantitative measure (PEQ) across the trial population, followed by the conduct and analysis of qualitative focus group interviews, each having equal importance in terms of explanatory power. To integrate data sources, we grouped the nine PEQ dimensions into four areas that represented the key components of the complex intervention (table 2), reporting the median response values, intergroup differences and the dispersion of responses within the PEQ for each group. We then used data from the focus group interviews to help explain our findings and enhance our understanding of patients' experiences of these key components. Illustrative quotes are provided.
Results
The quantitative responses to the PEQ are summarised in table 3, illustrating the distribution of responses within each trial group, and the differences between the intervention and usual care groups. The integration of the quantitative and qualitative data is presented below according to the four predefined intervention components.
Table 3.
Intervention component | PEQ domain | Trial group | Respondents | Median score* (cm) | 1st, 3rd quartile (cm) | Interquartile distance (cm) | Median difference (95% CI) (cm) | p Value |
---|---|---|---|---|---|---|---|---|
Physiotherapy | Exercises to get you moving/back on your feet | U I |
83 95 |
6.1 5.0 |
1.2, 10.3 1.1, 7.9 |
9.1 6.8 |
1.40 (0.00 to 4.00) | 0.039† |
Nutritional care | Help with eating and nutrition | U I |
87 95 |
9.9 5.4 |
4.8, 14.5 2.3, 10.0 |
9.7 7.7 |
1.60 (0.00 to 3.80) | 0.038† |
Case management | Transfer from ICU to the ward | U I |
73 67 |
5.7 5.2 |
1.7, 14.9 4.8, 10.0 |
13.2 5.2 |
0.20 (−0.90 to 2.80) | 0.481 |
Ward staff's understanding of your time in intensive care | U I |
78 87 |
5.1 5.1 |
1.1, 10.2 1.9, 8.0 |
9.1 6.1 |
0.00 (−1.10 to 1.20) | 0.850 | |
Help, support and advice with being independent | U I |
81 95 |
5.5 5.3 |
1.2, 10.1 2.6, 10.0 |
8.9 7.4 |
0.10 (−1.10 to 1.40) | 0.787 | |
Being involved in decisions about your care | U I |
81 91 |
10.0 7.3 |
5.0, 15.0 4.8, 14.3 |
10.0 9.5 |
0.70 (−0.40 to 3.30) | 0.226 | |
Organisation and coordination of care | U I |
83 96 |
7.1 5.3 |
4.8, 12.0 2.2, 10.0 |
7.2 7.8 |
1.30 (0.00 to 3.50) | 0.045† | |
Information provision | Information about what happened in intensive care | U I |
68 83 |
10.2 3.6 |
5.0, 16.9 1.0, 10.0 |
11.9 9.0 |
4.90 (2.80 to 8.00) | <0.001† |
Knowing what to expect after you got home | U I |
81 89 |
10.0 7.2 |
5.0, 15.0 2.6, 14.9 |
10.0 12.3 |
0.50 (−0.40 to 3.30) | 0.308 |
*VAS scores: excellent (0), very good (5), good (10), ok (15) and poor (20).
†p values are with the Wilcoxon Mann-Whitney test; as this test is not a median test but a rank sum test, the point estimates are not the difference between the two medians.
I, intervention group; ICU, intensive care unit; PEQ, patient experience questionnaire; U, usual care group; VAS, visual analogue scale.
Physiotherapy
PEQ data indicated general satisfaction across both groups (intervention group median 5.0 vs 6.1 cm in the usual care group), but scores were better for intervention group patients (p=0.039). Intervention group participants gave more consistently satisfied responses (IQR: intervention group 6.8 vs 9.1 cm in the usual care group). In focus groups, physiotherapy emerged as one of the most important aspects of rehabilitation for all:
The biggest saviour in the whole thing has probably been the physio… physio is the main thing. (Usual care participant 1)
Experiences of physiotherapy varied widely in the usual care group, however, and participants frequently remarked upon resource constraints (lack of staffing) and its perceived impact upon recovery.
He (husband) wanted out of bed and he wanted to make a recovery, but if you've no(t) got the bodies (staff) there to help…. (Usual care participant's wife 2)
In contrast, intervention participants valued the frequency and consistency of physiotherapy provided by RAs.
I had two (physio) sessions-a morning and an afternoon…. (Intervention participant 3)
Intervention participants highly valued the timing and delivery of physiotherapy according to their individual abilities, needs and preferences, facilitating greater involvement in the rehabilitation process.
If there was anything that I felt that I couldn't do, or it was too much, I was just to rest get my breath if need be, and just tell them (RAs) when I was ready…and every time they would say “What would you like to do today?” and in the end I could pick what I wanted. (Intervention participant 4)
Explanation, support and encouragement to perform exercises unsupervised were also highly valued.
If you're left with a sheet of paper to say, do these exercises on a daily basis, I am not likely to be motivated, but if somebody is…physically there, saying “Do these, let's do it together”, it's very different. (Intervention participant 3)
Overall, the RAs provided continuity and consistency of care in accordance with intervention group participants' individual needs, abilities and preferences.
Nutritional care
Responses to the PEQ revealed greater satisfaction in the intervention group (median response 5.4 vs 9.9 cm in the usual care group (p=0.038)). Intervention participants were also more consistently satisfied (IQR 7.7 vs 9.7 cm). In the focus groups, nutritional care was universally perceived as important to recovery, but experiences varied widely among the usual care group.
She (dietitian) checked what I was eating…She said you could do with a wee (little) bit more of such and such, so she arranged to have that wee bowl of fruit or something. (Usual care participant 5)
Several participants, however, felt that nursing staff were too busy to physically help them eat or deliver prescribed supplements.
Nobody was interested. I was actually taking him (husband) in flasks of porridge to try and encourage him to eat…I was actually spoon feeding him…he was so weak, it was like there was nobody there to do this. (Usual care patient's wife 2)
Intervention participants, in contrast, valued the RAs' physical assistance with eating (including nutritional supplements) and support to achieve prescribed nutritional targets, using individualised feedback. Also valued was their advocacy in relaying dietary concerns to relevant ward-based clinicians.
I managed to say, “(RA), I can't manage this (high protein supplement)”. Can you speak to (the ward-based Dietitian) about it? And we did work out something and it worked, because I…asked (RA) to represent me, because with (ward-based Dietitian), I couldn't get through. (Intervention participant 6)
One intervention participant particularly valued the RA's support in accompanying her to the hospital canteen.
I was really grateful to (RA). She would spare the time to take me downstairs (to the hospital canteen) and bring me back up during lunch to just try and encourage me to eat. (Intervention participant 6)
Overall, the RAs appeared to more consistently operationalise dietetic recommendations, individualising care according to patients' needs and preferences.
Case management
Median PEQ responses to the questions ‘transfer from ICU to the ward’, ‘ward staff's understanding of your time in intensive care’ and ‘help, support and advice with being independent’ were similar between the groups with values between 5 and 6 cm (‘very good’). However, for all these domains, the IQR values were wider for the usual care group, notably for the ‘transfer from ICU to the ward’ (13.2 vs 5.2 cm), suggesting wider variation in experience. Responses to ‘being involved in decisions about your care’ were less positive (usual care 10.0 vs 7.3 cm in the intervention group) with wide variation in responses for both groups. The most direct question about case management, ‘organisation and coordination of care’, indicated better experience among intervention patients (5.3 vs 7.2 cm; p=0.045).
In the focus groups, clear differences emerged between the groups. Both described a perceived deterioration in the quality of care following transfer to the general wards, which was attributed to staff shortages, high workload and the dependency of other patients.
You know the NHS is short staffed, you know that with their resources….but I mean you're giving them all this care in Intensive Care, and after that, it's like you're thrown to the dogs. (Usual care participant's wife 2)
Experiences across both groups were very variable, and seemed dependent on the discharge destination (specific ward). The experience of usual care participants appeared less consistent; several appeared to ‘slip through the net’, for example, in terms of pre-discharge assessment and provision of aids and adaptations for community living.
Was somebody supposed to come down and assess…her needs? If she needed anything adapted…needed any kind of equipment or stuff like that? That never happened. (Usual care patient's son, 7)
Usual care participants frequently described the ‘push’ for hospital discharge, a general lack of involvement in decision-making and communication that was often ambiguous, contradictory and ‘last minute’.
I think for… basically knocking on Death's door, I think the length of time between coming out of Intensive Care and going home is far, far too short. They are in a rush to…get people out. (Usual care patient's son, 7)
Usual care participants were also critical of a lack of postdischarge follow-up.
I thought we might have been asked to come back for a check-up after so many weeks… I've never heard anything about anything like that. (Usual care patient 8)
Intervention participants, in contrast, valued the RA's assistance across multiple roles, including assistance with eating, washing and dressing, coordination of relevant assessments and referrals, and communication of discharge plans. Intervention group participants attributed this support to consistency and continuity of care.
Having one person assigned to you, I thought that was marvellous, you know? There was always that one person that you knew you would see almost, probably every day…and if you had any worries you could talk to that one person and your worries got to the right source…the source that would do something about it. (Intervention patient 3)
Other examples included the coordination of postdischarge support.
I felt I was very lucky because the day of my discharge, (the RA) had managed to gather all the things I needed, had managed to secure all the telephone numbers that I might need…I didn't have any qualms about going home…. (Intervention participant 6)
Information provision
Responses to ‘information about what happened in intensive care’ showed the largest between-group differences, with intervention patients reporting the greatest and usual care patients the lowest satisfaction across all PEQ domains (10.2 vs 3.6 cm; p<0.001). In contrast, group responses were similar to ‘knowing what to expect after you got home’, with poorer median values than for many domains (intervention group 7.2 vs 10.0 cm in the usual care group) and wide variation in satisfaction for both groups. These data suggest that the intervention improved information provision relating to the critical illness episode, but persisting unmet informational need following hospital discharge.
Focus group data strongly supported these findings. Amnesia, strange dreams and delusional memories were prevalent for all patients, and limited recall of the ICU admission and early post-discharge period was frequently described. Usual care participants frequently felt ill-informed about the circumstances and chronology of events surrounding their ICU admission and relied almost exclusively upon family members for information. This contributed to anxiety around potential recurrence, ill-explained critical illness-related morbidity, the protraction and limits of the recovery process and the long-term implications of critical illness. Several usual care participants attributed greater anxiety to acquiring information from independent sources, such as the internet.
I still don't know why I ended up in there (ICU). Well, I know why, but I don't know why I got what I got…I worry a lot more about my health than I ever did before, because I've got no idea what started it. I think that's the biggest problem. I went on the internet and looked up…the septic shock thing and what that entailed…and I wish to God that I hadn't…because I felt like I'd just been knocked back about six steps…. (Usual care participant 8)
When asked, many agreed that a clear outline of ‘what happened’ would have been helpful.
I think it would have helped me…definitely, just to fill in all the blanks. I would like to know what happened with this and what happened with that and…but I never got anything like that. (Usual care participant 9)
In marked contrast, intervention participants valued the structured, individualised information they received. The discussion with an ICU physician was generally valued for the opportunity to ‘fill in the blanks’, especially reasons for ICU admission and the clinical course. Some focus group participants declined, however, describing their ICU experience as too ‘raw’ in the early post-ICU period.
I think them coming to see you helps to fill that void, you know, because being in Intensive Care, it's almost like you've lost a number of days without knowing what's happening…(the ICU Consultant) managed to explain the facts and…what you went through…why you ended up in Intensive Care. It really did help…me to put things in chronological order. (Intervention participant 10)
The individualised lay summary of the ICU admission was valued for its easily understandable explanation, although the terminology used and its occasional receipt by post (after hospital discharge) sometimes caused anxiety, highlighting the value of face-to-face clarification, reassurance and the opportunity to ask questions.
Mine was good…but I got a wee (little) bit of a fright…although I knew I was on the breathing machine, I didn't know that it was…called a life support machine and see when I seen it written down…! (Intervention participant 11)
When participants accepted the offer of an ICU visit prior to hospital discharge, it was generally valued as an opportunity to make sense of the critical illness episode. However, timing was important, with several focus group participants reporting that their experiences were still ‘too raw’. Finally, the therapeutic relationship with the RA appeared to facilitate the sensitive timing and presentation of information in accordance with patients' needs, emotional status and ability to retain information.
Discussion
This mixed methods process evaluation provides valuable insights into patient/carer experiences in a complex intervention trial of post-ICU acute hospital rehabilitation. There was substantial concordance between cohort-level questionnaire data and the detailed accounts of focus group participants. Evidence of greater satisfaction with physiotherapy, nutritional care, information provision and coordination of care emerged from both data sources, suggesting that a case-management approach, delivered by a dedicated RA, improved patient experience of post-ICU acute hospital rehabilitation. Furthermore, focus group data revealed the high value intervention participants placed on the individualisation of their care, according to their needs, abilities and preferences.
Despite evidence of greater satisfaction in the intervention group, we found no statistically or clinically significant between-group differences across functional, physical, psychological and HRQoL outcomes between hospital discharge and 12 months follow-up in the trial.17 The discordance between these ‘biomedical’ outcomes and greater reported patient satisfaction is striking. It is possible that biomedical outcomes are resistant to modification at this stage of recovery,38 or that they fail to measure ‘what matters’ to patients during acute hospital-based recovery.38 39 The performance of outcome measures also depends on their appropriate selection, their psychometric properties in the population of interest and the timing of data collection in accordance with the delivery of the intervention.
We note with interest that only one previous study of a post-ICU critical rehabilitation intervention employed qualitative approaches in its evaluation.21 The authors demonstrated that intervention participants not only experienced improvements in objective measures of fitness but also an increased sense of motivation, well-being, achievement and social participation. In the future, such studies would be well advised to incorporate qualitative approaches and process evaluations into trial design to explore patients' experiences of the intervention (including unanticipated benefits and drawbacks) that may not be accessible by existing questionnaires.
Qualitative studies among other hospitalised patient groups have shown the high value that patients place on the therapeutic or collaborative relationship with rehabilitation staff, flexibility around the timing, content and delivery of rehabilitation and its individualisation according to needs and preferences.40–42 These issues underpinned the development of the RECOVER intervention, and the PEQ was specifically developed to capture them. Our data provide strong evidence for important effects on these person-centred outcomes. Our evaluation demonstrates the added value that qualitative research can add in RCTs, particularly in the design and conduct of a trial, improving its internal and external validity, facilitating replicability, interpretation and generalisability of findings43 and here, in exploring the value of individual components of a complex intervention.
A key finding was the value participants placed on information. The ‘need to know’ has long been reported in the critical care literature,44 underpinning various strategies such as ICU discharge summaries,45 patient diaries,46–48 follow-up clinics49 50 and return visits to the ICU.51 Our comprehensive, individualised approach was documentary (rehabilitation manual; individualised lay summary), didactic (discussion with ICU physician and the RAs) and experiential (offer of a return visit to the ICU). Qualitative and quantitative data provided strong evidence for the benefit of information, and focus group data uncovered preferences for its timing, content (including terminology) and delivery. These findings support the need for individualised information in routine post-ICU care.
A particular strength of our process evaluation was consideration of the clinical context in which the intervention took place, and participants' response to and interaction with the intervention. These are recommended when evaluating how or why complex healthcare interventions may (or may not) work.20 Our data provide empirical evidence that enhanced access to physiotherapy, nutritional care and information is important to patients during recovery, but highlight a range of preferences and the need for individualised content, delivery and timing. Case management by a dedicated RA was a key ‘active ingredient’ that facilitated these preferences and seemed to increase engagement in the rehabilitation process, resulting in greater overall perceived benefit. A potential limitation of our findings is the marked differences between the focus group's patient participants in terms of patient age, duration of mechanical ventilation and ICU length of stay.
Our findings are relevant to future trial design in this patient population. Specifically, trial interventions that use individual adaptation versus standardised or fixed interventions require different approaches to process and effectiveness evaluation.52 53 We standardised the process and function of the intervention (ie, individualisation and patient engagement in the rehabilitation process, respectively) but not the content, capturing actual differences in treatments received in the process evaluation. This approach is particularly recommended when the ‘real world’ or clinical context is complex.20 With this perspective, the internal validity of a trial should be defined functionally as well as compositionally.33 52 Our data indicate that concordance between biomedical and person-centred outcomes should not be assumed,37 highlighting the importance of specific standardised measures (few currently exist) and the use of qualitative approaches to capture the latter.
Importantly, cost-effectiveness analysis of the RECOVER trial found no incremental cost-effectiveness over the 12 months post-randomisation, and no difference in quality-adjusted life years between the groups.17 It is increasingly recognised that HRQoL trajectories are difficult to modify following critical illness, in part because pre-existing comorbidity dominates reported HRQoL during recovery.54–57 Quality of care, patient satisfaction and ‘person-centeredness’ are excluded from cost-effectiveness analysis. The use of service models based on multiskilled RAs providing individualised case management is potentially cost-neutral or even cost-saving compared to existing models that require multiple specialists from different disciplines. Our data provide strong evidence that this approach delivers higher quality care from patients' and carers' perspectives and may well justify service redesign. Our model of care has been adopted into routine clinical practice at the main study hospital.
In conclusion, we have shown that physiotherapy, nutritional care and information are highly valued by patients during post-ICU acute hospital rehabilitation. A rehabilitation strategy coordinated by a dedicated multiskilled RA improved patients' satisfaction with and perceived quality of care, cutting across traditional disciplinary boundaries, ward-level resource constraints and circumventing communication failures. The focus on individualised, coordinated care according to patient ability and preference was highly valued.
Acknowledgments
The authors acknowledge Professor Andrew Thompson (University of Edinburgh, Scotland) for his expert advice on the development of the patient experience questionnaire used in this trial.
Footnotes
Twitter: Follow David Griffith at @Griffith_DM
Collaborators: RECOVER collaborators include: Julia A Boyd, Simon J Mackenzie, Ashma Krishan, Stephanie C Lewis, Gordon D Murray, John F Forbes, Joel Smith, Alastair M Hull, Charles Wallis, Joyce Stewart, Anthony Bateman, Elizabeth Wilson, Mike Gillies, Susanne Kean, David Hope, Heidi Dawson, Corrienne McCulloch, Jean Antonelli, Louise Boardman and rehabilitation assistants Leanne Dow, Winchell Williams, Audrey McCann and Sarah Alexander.
Contributors: TW, LS, PR, JM and GH designed the trial and completed pilot and feasibility work. Specialist clinical input to trial conduct was provided by TW and DG (critical care perspective), LS (physiotherapy/rehabilitation), PR and JR (nursing) and JM (dietetics). Statistical advice was provided by Professor Gordon D Murray and Professor Stephanie C Lewis (both at the University of Edinburgh). The patient experience questionnaire was developed by PR, with expert methodological advice provided by Professor Andrew Thompson at the University of Edinburgh. The qualitative focus group interviews were designed by PR and GH and conducted and analysed by PR. All coauthors contributed to the mixed methods integration and analysis.
Funding: The trial was funded by the Chief Scientist Office, Scotland (grant number CZH/4/53).
Competing interests: None declared.
Ethics approval: Scotland A Research Ethics Committee.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data sharing statement: Additional unpublished data may be requested by contacting the lead author.
Contributor Information
Collaborators: Julia A Boyd, Simon J Mackenzie, Ashma Krishan, Stephanie C Lewis, Gordon D Murray, John F Forbes, Joel Smith, Alastair M Hull, Charles Wallis, Joyce Stewart, Anthony Bateman, Elizabeth Wilson, Mike Gillies, Susanne Kean, David Hope, Heidi Dawson, Corrienne McCulloch, Jean Antonelli, Louise Boardman, Leanne Dow, Winchell Williams, Audrey McCann, and Sarah Alexander
References
- 1.Needham DM, Davidson J, Cohen H et al. . Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med 2012;40:502–9. 10.1097/CCM.0b013e318232da75 [DOI] [PubMed] [Google Scholar]
- 2.Centre for Clinical Practice at NICE. National Institute for Health and Clinical Excellence: guidance. Rehabilitation after critical illness. London: National Institute for Health and Clinical Excellence (UK) National Institute for Health and Clinical Excellence, 2009. [Google Scholar]
- 3.Bailey P, Thomsen GE, Spuhler VJ et al. . Early activity is feasible and safe in respiratory failure patients. Crit Care Med 2007;35:139–45. 10.1097/01.CCM.0000251130.69568.87 [DOI] [PubMed] [Google Scholar]
- 4.Burtin C, Clerckx B, Robbeets C et al. . Early exercise in critically ill patients enhances short-term functional recovery. Crit Care Med 2009;37:2499–505. 10.1097/CCM.0b013e3181a38937 [DOI] [PubMed] [Google Scholar]
- 5.Schweickert WD, Pohlman MC, Pohlman AS et al. . Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet 2009;373:1874–82. 10.1016/S0140-6736(09)60658-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Denehy L, Skinner EH, Edbrooke L et al. . Exercise rehabilitation for patients with critical illness: a randomized controlled trial with 12 months of follow-up. Crit Care 2013;17:R156 10.1186/cc12835 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Moss M, Nordon-Craft A, Malone D et al. . A randomized trial of an intensive physical therapy program for acute respiratory failure patients. Am J Respir Crit Care Med 2016;193:1101–10. 10.1164/rccm.201505-1039OC [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hopkins RO, Miller RR III, Rodriguez L et al. . Physical therapy on the wards after early physical activity and mobility in the intensive care unit. Phys Ther 2012;92:1518–23. 10.2522/ptj.20110446 [DOI] [PubMed] [Google Scholar]
- 9.McWilliams DJ, Atkinson D, Carter A et al. . Feasibility and impact of a structured, exercise-based rehabilitation programme for intensive care survivors. Physiother Theory Pract 2009;25:566–71. 10.3109/09593980802668076 [DOI] [PubMed] [Google Scholar]
- 10.Elliott D, McKinley S, Alison J et al. . Health-related quality of life and physical recovery after a critical illness: a multi-centre randomised controlled trial of a home-based physical rehabilitation program. Crit Care 2011;15:R142 10.1186/cc10265 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Jackson JC, Ely EW, Morey MC et al. . Cognitive and physical rehabilitation of intensive care unit survivors: results of the RETURN randomized controlled pilot investigation. Crit Care Med 2012;40:1088–97. 10.1097/CCM.0b013e3182373115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Batterham AM, Bonner S, Wright J et al. . Effect of supervised aerobic exercise rehabilitation on physical fitness and quality-of-life in survivors of critical illness: an exploratory minimized controlled trial (PIX study). Br J Anaesth 2014;113:130–7. 10.1093/bja/aeu051 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Kayambu G, Boots R, Paratz J. Physical therapy for the critically ill in the ICU: a systematic review and meta-analysis. Crit Care Med 2013;41:1543–54. 10.1097/CCM.0b013e31827ca637 [DOI] [PubMed] [Google Scholar]
- 14.Calvo-Ayala E, Khan BA, Farber MO et al. . Interventions to improve the physical function of ICU survivors: a systematic review. Chest 2013;144:1469–80. 10.1378/chest.13-0779 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Li Z, Peng X, Zhu B et al. . Active mobilization for mechanically ventilated patients: a systematic review. Arch Phys Med Rehabil 2013;94:551–61. 10.1016/j.apmr.2012.10.023 [DOI] [PubMed] [Google Scholar]
- 16.Stiller K. Physiotherapy in intensive care: an updated systematic review. Chest 2013;144:825–47. 10.1378/chest.12-2930 [DOI] [PubMed] [Google Scholar]
- 17.Walsh TS, Salisbury LG, Merriweather JL et al. . Increased hospital-based physical rehabilitation and information provision after intensive care unit discharge: the RECOVER randomized clinical trial. JAMA Intern Med 2015;175:901–10. 10.1001/jamainternmed.2015.0822 [DOI] [PubMed] [Google Scholar]
- 18.Mehlhorn J, Freytag A, Schmidt K et al. . Rehabilitation interventions for postintensive care syndrome: a systematic review. Crit Care Med 2014;42:1263–71. 10.1097/CCM.0000000000000148 [DOI] [PubMed] [Google Scholar]
- 19.Craig P, Dieppe P, Macintyre S et al. . Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008;337:a1655 10.1136/bmj.a1655 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Moore GF, Audrey S, Barker M et al. . Process evaluation of complex interventions: Medical Research Council guidance. BMJ 2015;350:h1258 10.1136/bmj.h1258 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Walker W, Wright J, Danjoux G et al. . Project Post Intensive Care eXercise (PIX): a qualitative exploration of intensive care unit survivors’ perceptions of quality of life post-discharge and experience of exercise rehabilitation. J Intensive Care Soc 2014;16:37–44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Collen FM, Wade DT, Robb GF et al. . The Rivermead Mobility Index: a further development of the Rivermead Motor Assessment. Int Disabil Stud 1991;13:50–4. 10.3109/03790799109166684 [DOI] [PubMed] [Google Scholar]
- 23.Podsiadlo D, Richardson S. The timed “Up & Go”: a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc 1991;39:142–8. 10.1111/j.1532-5415.1991.tb01616.x [DOI] [PubMed] [Google Scholar]
- 24.Jenkinson C, Layte R, Jenkinson D et al. . A shorter form health survey: can the SF-12 replicate results from the SF-36 in longitudinal studies? J Public Health Med 1997;19:179–86. 10.1093/oxfordjournals.pubmed.a024606 [DOI] [PubMed] [Google Scholar]
- 25.Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983;67:361–70. 10.1111/j.1600-0447.1983.tb09716.x [DOI] [PubMed] [Google Scholar]
- 26.Davidson JR, Book SW, Colket JT et al. . Assessment of a new self-rating scale for post-traumatic stress disorder. Psychol Med 1997;27:153–60. 10.1017/S0033291796004229 [DOI] [PubMed] [Google Scholar]
- 27.Salisbury LG, Merriweather JL, Walsh TS. Rehabilitation after critical illness: could a ward-based generic rehabilitation assistant promote recovery? Nurs Crit Care 2010;15:57–65. 10.1111/j.1478-5153.2010.00382.x [DOI] [PubMed] [Google Scholar]
- 28.Salisbury LG, Merriweather JL, Walsh TS. The development and feasibility of a ward-based physiotherapy and nutritional rehabilitation package for people experiencing critical illness. Clin Rehabil 2010;24:489–500. 10.1177/0269215509360639 [DOI] [PubMed] [Google Scholar]
- 29.Ramsay P, Salisbury LG, Merriweather JL et al. . A rehabilitation intervention to promote physical recovery following intensive care: a detailed description of construct development, rationale and content together with proposed taxonomy to capture processes in a randomised controlled trial. Trials 2014;15:38 10.1186/1745-6215-15-38 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Walsh TS, Salisbury LG, Boyd J et al. . A randomised controlled trial evaluating a rehabilitation complex intervention for patients following intensive care discharge: the RECOVER study. BMJ Open 2012;2:e001475 10.1136/bmjopen-2012-001475 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ramsay P. Quality of life following prolonged critical illness: a mixed methods study. University of Edinburgh, 2010. [Google Scholar]
- 32.Coyle J, Williams B. An exploration of the epistemological intricacies of using qualitative data to develop a quantitative measure of user views of health care. J Adv Nurs 2000;31:1235–43. 10.1046/j.1365-2648.2000.01381.x [DOI] [PubMed] [Google Scholar]
- 33.Bonell C, Fletcher A, Morton M et al. . Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med 2012;75:2299–306. 10.1016/j.socscimed.2012.08.032 [DOI] [PubMed] [Google Scholar]
- 34.Onwuegbuzie AJ, Dickinson WB, Leech NL et al. . Toward more rigor in focus group research in stress and coping and beyond a new mixed research framework for collecting and analyzing focus group data, 2010.
- 35.Kitzinger J. Qualitative research: introducing focus groups. BMJ 1995;311:299–302. 10.1136/bmj.311.7000.299 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006;3:77–101. 10.1191/1478088706qp063oa [DOI] [Google Scholar]
- 37.Creswell JW, Plano Clark VL, Gutmann ML et al. . Advanced mixed methods research designs. In: Tashakkori A, Teddlie C, eds. Handbook of mixed methods in social and behavioral research. Thousand Oaks: (CA: ): Sage, 2003:209–40. [Google Scholar]
- 38.Cox CE, Hough CL. Improving functional recovery after critical illness. JAMA Intern Med 2015;175:911–12. 10.1001/jamainternmed.2015.0829 [DOI] [PubMed] [Google Scholar]
- 39.Ramsay P. Health-related quality of life: implications for critical care interventional studies and why we need to collaborate with patients. Curr Opin Crit Care 2011;17:510–14. 10.1097/MCC.0b013e32834a4bd4 [DOI] [PubMed] [Google Scholar]
- 40.Whalley Hammell K. Experience of rehabilitation following spinal cord injury: a meta-synthesis of qualitative findings. Spinal Cord 2007;45:260–74. 10.1038/sj.sc.3102034 [DOI] [PubMed] [Google Scholar]
- 41.Lindberg J, Kreuter M, Taft C et al. . Patient participation in care and rehabilitation from the perspective of patients with spinal cord injury. Spinal Cord 2013;51:834–7. 10.1038/sc.2013.97 [DOI] [PubMed] [Google Scholar]
- 42.Peoples H, Satink T, Steultjens E. Stroke survivors’ experiences of rehabilitation: a systematic review of qualitative studies. Scand J Occup Ther 2011;18:163–71. 10.3109/11038128.2010.509887 [DOI] [PubMed] [Google Scholar]
- 43.O'Cathain A, Thomas K, Drabble S et al. . What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open 2013;3:e002889 10.1136/bmjopen-2013-002889 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Hupcey JE, Zimmerman HE. The need to know: experiences of critically ill patients. Am J Crit Care 2000;9:192–8. [PubMed] [Google Scholar]
- 45.Bench S, Day T. The user experience of critical care discharge: a meta-synthesis of qualitative research. Int J Nurs Stud 2010;47:487–99. 10.1016/j.ijnurstu.2009.11.013 [DOI] [PubMed] [Google Scholar]
- 46.Jones C, Backman C, Capuzzo M et al. . Intensive care diaries reduce new onset post traumatic stress disorder following critical illness: a randomised, controlled trial. Crit Care 2010;14: R168 10.1186/cc9260 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Egerod I, Christensen D, Schwartz-Nielsen KH et al. . Constructing the illness narrative: a grounded theory exploring patients’ and relatives’ use of intensive care diaries. Crit Care Med 2011;39:1922–8. 10.1097/CCM.0b013e31821e89c8 [DOI] [PubMed] [Google Scholar]
- 48.Ewens BA, Hendricks JM, Sundin D. The use, prevalence and potential benefits of a diary as a therapeutic intervention/tool to aid recovery following critical illness in intensive care: a literature review. J Clin Nurs 2015;24:1406–25. 10.1111/jocn.12736 [DOI] [PubMed] [Google Scholar]
- 49.Storli SL, Lind R. The meaning of follow-up in intensive care: patients’ perspective. Scand J Caring Sci 2009;23:45–56. 10.1111/j.1471-6712.2007.00589.x [DOI] [PubMed] [Google Scholar]
- 50.Crocker C. A multidisciplinary follow-up clinic after patients’ discharge from ITU. Br J Nurs 2003;12:910–14. 10.12968/bjon.2003.12.15.11420 [DOI] [PubMed] [Google Scholar]
- 51.Engstrom A, Andersson S, Soderberg S. Re-visiting the ICU experiences of follow-up visits to an ICU after discharge: a qualitative study. Intensive Crit Care Nurs 2008;24: 233–41. 10.1016/j.iccn.2008.03.002 [DOI] [PubMed] [Google Scholar]
- 52.Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ 2004;328:1561–3. 10.1136/bmj.328.7455.1561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Bird L, Arthur A, Cox K. “Did the trial kill the intervention?” Experiences from the development, implementation and evaluation of a complex intervention. BMC Med Res Methodol 2011;11:24 10.1186/1471-2288-11-24 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Bagshaw SM, Stelfox HT, Johnson JA et al. . Long-term association between frailty and health-related quality of life among survivors of critical illness: a prospective multicenter cohort study. Crit Care Med 2015;43:973–82. 10.1097/CCM.0000000000000860 [DOI] [PubMed] [Google Scholar]
- 55.Orwelius L, Nordlund A, Nordlund P et al. . Pre-existing disease: the most important factor for health related quality of life long-term after critical illness: a prospective, longitudinal, multicentre trial. Crit Care 2010;14:R67 10.1186/cc8967 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Lone NI. Evaluation of five year survival and major health care resource use following admission to Scottish intensive care units. University of Edinburgh, 2013. [Google Scholar]
- 57.Iwashyna TJ. Trajectories of recovery and dysfunction after acute illness, with implications for clinical trial design. Am J Respir Crit Care Med 2012;186:302–4. 10.1164/rccm.201206-1138ED [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2016-012041supp1.pdf (196.7KB, pdf)
bmjopen-2016-012041supp2.pdf (195.3KB, pdf)