Abstract
Objective
To obtain consensus on the content and delivery of an occupational advice intervention for patients undergoing primary hip and knee replacement surgery. The primary targets for the intervention were (1) patients, carers and employers through the provision of individualised support and information about returning to work and (2) hospital orthopaedic teams through the development of a framework and materials to enable this support and information to be delivered.
Design
Modified Delphi study as part of a wider intervention development study (The Occupational advice for Patients undergoing Arthroplasty of the Lower limb (OPAL) study: Health Technology Assessment Reference 15/28/02) (ISRCTN27426982).
Setting
Five stakeholder groups (patients, employers, orthopaedic surgeons, general practitioners, allied health professionals and nurses) recruited from across the UK.
Participants
Sixty-six participants.
Methods
Statements for the Delphi process were developed relating to the content, format, delivery, timing and measurement of an occupational advice intervention. The statements were based on evidence gathered through the OPAL study that was processed using an intervention mapping framework. Intervention content was examined in round 1 and intervention format, delivery, timing and measurement were examined in round 2. In round 3, the developed intervention was presented to the stakeholder groups for comment.
Consensus
For rounds 1 and 2, consensus was defined as 70% agreement or disagreement on a 4-point scale. Statements reaching consensus were ranked according to the distribution of responses to create a hierarchy of agreement. Round 3 comments were used to revise the final version of the developed occupational advice intervention.
Results
Consensus was reached for 36 of 64 round 1 content statements (all agreement). In round 2, 13 questions were carried forward and an additional 81 statements were presented. Of these, 49 reached consensus (44 agreement/5 disagreement). Eleven respondents provided an appraisal of the intervention in round 3.
Conclusions
The Delphi process informed the development of an occupational advice intervention as part of a wider intervention development study. Stakeholder agreement was achieved for a large number of intervention elements encompassing the content, format, delivery and timing of the intervention. The effectiveness and cost-effectiveness of the developed intervention will require evaluation in a randomised controlled trial.
Trial registration number
International Standard Randomised Controlled Trials Number Trial ID: ISRCTN27426982
Keywords: return to work, hip replacement, knee replacement, occupational advice, employment, surgery
Strengths and limitations of this study.
Wide stakeholder engagement including patients, employers, surgeons, general practitioners, allied health professionals with knowledge of the process of returning to work after hip or knee replacement.
Recruitment of a large number of Delphi members who were invited to participate in all three Delphi rounds.
Initial Delphi statements developed from research performed as part of the Occupational advice for Patients undergoing Arthroplasty of the Lower limb study (Health Technology Assessment 15/28/02).
Loss of participants between each of the rounds of questioning, specifically the employer group who failed to participate in the final Delphi round.
The process recruited participants from the UK only, which potentially limits the generalisability of findings to healthcare settings internationally.
Introduction
Hip and knee osteoarthritis are associated with a reduction in work participation and productivity and an increased risk of work loss.1 2 The costs associated with occupational musculoskeletal disorders are significant.3 4 The estimated annual cost of workplace ill health is £9.7 billion, equivalent to £18 400 per case.5 These costs are borne not only by the individual (impact of ill health on quality of life), but also by their employers and society (loss of productivity, need for healthcare, rehabilitation and compensation).3 4 In addition to the financial costs, lengthy sickness absence can result in work disability, poorer general health, increased risk of mental health problems and higher mortality.6–8 Working, therefore, has physical and mental health benefits, alongside its socioeconomic value.
Lower limb joint replacement is an effective and cost-effective treatment for patients with hip and knee osteoarthritis.9–12 Recent changes to the pension age combined with an ageing UK workforce have resulted in a steady increase in the numbers of hip and knee replacements being performed in patients of working age over the last decade.13–15 In 2017, 18 812 (20.5% of all hip replacements) and 17 765 (17.4% of all knee replacements) were performed in patients aged less than 60 years.13–15 Current recommendations supporting return to work after hip and knee replacement are limited and inconsistent.16 There is variation in the content, delivery and format of occupational advice delivered to patients having hip and knee replacements and a need to provided more comprehensive, individualised advice for these patients to support early, sustained return to work after surgery.16
The Occupational advice for Patients undergoing Arthroplasty of the Lower limb (OPAL study) was a National Institute for Health Research-Health Technology Assessment commissioned research study that aimed to develop an occupational advice intervention to support return to work after hip and knee replacement.16 OPAL used an intervention mapping framework supported by related qualitative and quantitative work streams.16 Initial research evaluated the specific needs of the population of patients who were in work and intended to return to work following surgery, established how individual patients returned to work and documented the barriers preventing return to work.17 18 Through these work streams a range of key performance indicators and potential intervention components that could be used to develop an occupational advice intervention emerged.
To refine these components and address areas of uncertainty relating to the intervention a multistakeholder intervention development group was constructed to ascertain whether agreement could be reached about the design, content, delivery, format and timing of the proposed occupational advice intervention. To facilitate this process a modified Delphi consensus process was employed.16 The Delphi approach was chosen as it can be delivered remotely in a short time frame without the need to convene meetings. It also enables researchers to collect the opinions of a range of different individuals with differing areas of expertise which was desirable in this setting. The initial research performed as part of the intervention mapping process provided the basis for this process by generating an initial list of statements for the Delphi consensus development.
Methods
Design of the modified Delphi study
A modified 3 round Delphi consensus process was used.19–21 The process was guided by the information gathered from research completed during the first phase of the OPAL project.16–18
During the first phase of the OPAL project, a number of intervention components emerged that were considered likely to be integral to the development of a successful occupational advice intervention (box 1). Expanded versions of these components were used as the basis for initial statement development that could be explored during the Delphi process.
Box 1. Key intervention components identified during opal phase 1.
Education and advice.
Vocational counselling and guidance.
Physical therapy and exercises.
Work simulation/work hardening and job accommodation.
Contact with employer/workplace visits.
Multidisciplinary team involvement.
Delphi stakeholder recruitment
Five stakeholder groups were identified for inclusion in the modified Delphi process. The sampling strategy for each stakeholder group is outlined in table 1, with participants chosen via a targeted approach to maximise patient, public and professional engagement. To ensure wide participation and the validity of the consensus process the process aimed to recruit a minimum of five individuals from each stakeholder group. A maximum limit of 15 individuals from any given stakeholder group was chosen to ensure one group’s opinions did not overwhelm the opinions of others within the consensus process. As such, we aimed to have a minimum of 25 participants and a maximum of 75 participants for each round.
Table 1.
Sampling strategy used to identify Delphi members
Stakeholder group | Requirement for inclusion | Participants recruited via |
Patients | Experience of returning to work after hip or knee replacement in the previous 12 months. |
|
Employers and occupation health services | Experience of managing an employee returning to work after hip or knee replacement in the previous 12 months. |
|
Orthopaedic surgeons | Surgeons undertaking a minimum of 20 hip or knee replacements per year. |
|
Allied Health Professionals (AHPs—Physiotherapists and Occupational therapists) and nurses | AHPs actively involved in the assessment and/or management of patients undergoing hip or knee replacement. |
|
General practitioners | Experience of managing a patient returning to work after hip or knee replacement in the previous 12 months. |
|
OPAL, Occupational advice for Patients undergoing Arthroplasty of the Lower limb.
Although there are no definitive rules about the sample size for a Delphi study, a minimum of 8–10 participants has been suggested.22 While higher response rates and ease of administration are an advantage of smaller homogeneous groups, we considered a larger sample size desirable given the variation in expertise and the heterogeneity within our stakeholder groups. Furthermore, if areas of uncertainty are being explored larger sample sizes can help to reduce errors and improves the reliability of the findings.23
Prior to enrolment, potential participants from all stakeholder groups were invited to participate via an email from a member of the OPAL study team as per the sampling strategy for each stakeholder group outlined in table 1. This email included a participant information sheet describing the Delphi consensus process and what participation involved. Participants were asked to confirm their consent to participate by return of email and only those that responded indicating their willingness to participate were included in the process.
Development of Delphi statements
Prior to commencing, statements relating to the proposed content, format, delivery, timing and measurement of an occupational advice intervention were developed. Due to the breadth of statements developed and their inter-related nature, we adopted a stepwise approach to the presentation of individual statements to the Delphi group. Round 1 focused on defining the content of the intervention in two sections. Section 1, focused on passive content (‘written’ advice and information) and section 2 on active content (actions or processes for patients, employers and healthcare members to undertake). These statements were piloted by a small sample of surgeons, general practitioners (GPs) and patients. Having first defined the content, we then used this information to refine the statements relating to the format, delivery, timing and measurement of this content presented in round 2. In round 2, statements were grouped under headings allowing exploration around specific themes. Round 3 was then used to clarify any areas of residual uncertainty from rounds 1 and 2 and present the proposed occupational advice intervention back to the Delphi participants for final comments.
For each statement within the Delphi process, participants were asked to rate the extent of agreement with individual statements about the importance of including specific elements in a occupational advice intervention, with possible options being: strongly agree; agree; disagree; strongly disagree; do not know. For a subset of statements in round 1, they were also asked to rate the deliverability of the content or action alongside current healthcare provision. Therefore, for some statements the participants were asked to provide two ratings one for ‘importance’ and one for ‘deliverability’.
At the end of each section, there was a free-text box where participants could add suggestions relating to the intervention that could be evaluated in subsequent rounds. In rounds where statements from a previous Delphi round were being represented, these were presented alongside controlled feedback with modal round one rating for these statements; the proportion of each response option selected by the other participants; and a reminder of the participant’s own previous ratings.
Delivery of Delphi survey
The Delphi survey was delivered via email using an online web-based survey platform.24 Round 1 was delivered between 25 September 2017 and 13 October 2017, round 2 between 22 November 2017 and 13 December 2017 and round 3 between 1 June 2018 and 22 June 2018. The email included a covering letter to the participants and an electronic link to the questionnaires. All three rounds allowed a minimum of 3 weeks for participants to respond. Automated reminders were sent via the electronic system after 10 days from the day of initialising the survey. A further personalised email reminder was sent to non-responders during the final week of the surveys.
Round 1 and 2 questionnaires required respondents to provide their initials and occupation. All round 2 emails incorporated an overall report summarising the pooled responses from round 1 survey and, where appropriate, the responses of each of the five stakeholder groups. In addition, for those participants who completed the round 1 survey, an individualised report summarising their responses to the statements in round 1 were included with the round 2 survey to allow participants to reappraise their responses in view of the overall responses.25 Round 3 emails included four core documents from the developed occupational advice intervention (a summary of the intervention, occupational checklist, patient ‘return to work’ workbook and employer booklet) for participants to review and comment. Email reminders were sent to non-responders during the final week of the surveys.
Analysis of data
Descriptive analyses of the Delphi responses were undertaken by the OPAL study team. Results of each round were discussed with the wider OPAL study research team before the statements were agreed for subsequent rounds.
An a priori consensus threshold of 70% (strongly agree/agree or strongly disagree/disagree) was agreed before statements were circulated.25 There is no universal agreement on an acceptable level of consensus for a Delphi study,26 27 however, reports suggest this should be decided before commencing the study and recommends at threshold of at least 70% to ensure validity of the findings.27 For statements that failed to reach consensus, further analysis was undertaken based on responses for each of the five stakeholder subgroups. The following rules were then employed to determine which statements were discarded and which were represented in the next round.
If no or only one stakeholder group reached concordant consensus (>70% agreement or disagreement) then the statement would be withdrawn.
If two or more stakeholder groups reached concordant consensus (>70% agreement or disagreement) then the statement would be represented in a subsequent round.
In the situation where one or more stakeholder groups reach ‘agreement’ and another group reach ‘disagreement’ the statement would be discussed by the OPAL investigator team and a decision on inclusion/exclusion of the statement would be made.
For statements that were rated for both importance and deliverability in round 1, consensus was reached if the 70% threshold was achieved for both the importance and deliverability rating. Statements that reached consensus for one of the domains were analysed by stakeholder group as described above.
In rounds 1 and 2, statements reaching consensus were ranked according to the distribution of responses to create a hierarchy of agreement.
In round 3, the occupational advice intervention and associated documents were circulated for comment. Descriptive open feedback from participants to these documents were recorded.
Patient and public involvement
The OPAL research project was developed in collaboration with members of the British Orthopaedic Association (BOA) Patient Liaison Group (PLG). A patient coapplicant from the BOA PLG was involved in the development of the research question and defining the outcome measures used within the wider OPAL study. Patients were involved in the design of the study from inception of the project, through protocol development, study delivery and project dissemination. These included patients from the BOA PLG, the National Joint Registry patient group and patient and public groups affiliated with the sponsor site.
Results
Round 1
Responses were received from 43 of the 66 participants (65%) including 14 patients, 8 surgeons, 6 GPs, 11 allied health professionals and nurses, and 4 employers. In section 1 (‘written’ advice and information), consensus was reached for 26 of 32 statements (81%). Of the remaining six statements, five reached consensus for two or more stakeholder groups and were therefore taken forward to round 2 and one statement was discarded. Section 1 statements reaching consensus and ranked based on the strength of consensus are listed in table 2.
Table 2.
Statements descriptions reaching consensus for section 1 (ordered by % of respondents that strongly agreed or agreed)
Is it important that an occupational advice intervention commenced prior to hip or knee replacement includes the following | Agreement (%) |
Q9. Information about exercises and rehabilitation following surgery. | 100 |
Q13. Information about returning to driving. | 100 |
Q3. A broad overview written for all stakeholders, of what to expect following surgery (rates and timing of expected recovery). | 98 |
Q15. Information about managing pain, types of analgesia and side effects. | 98 |
Q5. Information about postoperative precautions, restrictions and activities to avoid following surgery. | 95 |
Q18. Information about symptom management in relation to return to work and specific occupations, for example, expected levels of fatigue, pain, swelling. | 95 |
Q12. Tips and tricks to help the patient manage around their home with day to day activities immediately following surgery. | 95 |
Q10. Information regarding postoperative complications and their management. | 95 |
Q14. Signposting to Driver and Vehicle Licensing Agency (DVLA) guidance. | 95 |
Q23. Information for the patient about who to ask if they are having a problem returning to work. | 93 |
Q4. Information about expected level of function at different time - points following surgery. | 88 |
Q29. Advices about adaptions to working patterns to assist return including the use of phased returns, modified hours and altered work schedules. | 88 |
Q21. Information and resources to support self-advocacy and empowerment. | 88 |
Q20. Information about when it might be appropriate for patients and employers to access occupational health services. | 88 |
Q19. Information for patients and employers about how to access occupational health services. | 88 |
Q28. A list of potential workplace modifications, aids and adjustments that could be used to assist with return to work, with examples. | 84 |
Q27. Information for the patients about how to ask for help at work from their employer and colleagues. | 84 |
Q31. Guidance on how to set an appropriate provisional return to work date based on the date and type of surgery. | 81 |
Q16. Guidance for orthopaedic care teams and GPs on how to use and prescribe a fit note. | 81 |
Q24. Signposts to national and local support services for example, Fit4Work, citizens advices, Advisory, Consiliation and Arbitration Service (ACAS). | 81 |
Q11. Information about how having surgery may impact on social relationships. | 81 |
Q32. Advice about how psychosocial and emotional factor influence return to work. | 79 |
Q6. Information about how long the hip and knee replacement prostheses will last. | 77 |
Q17. Examples of the correct use of fit notes. | 77 |
Q30. A list of potential return to work barriers for patients and employers to consider. | 74 |
Q8. Information about managing more than one joint replacement in close succession. | 72 |
GPs, general practitioners.
In section 2 (actions or processes for patients, employers and healthcare members to undertake), participants were asked to rate both the importance and deliverability of each statement. Of the 32 components presented, only 10 (31%) reached consensus for both importance and deliverability (table 3). Of the remaining 22 statements, 14 reached consensus for importance but not deliverability, 2 reached consensus for deliverability but not importance and 6 did not reach consensus for either. Of these statements seven reached consensus for both importance and deliverability for two or more stakeholder groups and were therefore taken forward to round 2 and 15 statements were discarded.
Table 3.
Statements descriptions reaching consensus for section 2 (ordered by % of respondents that strongly agreed or agreed)
How important/deliverable do you believe the following components are if an occupational advice intervention commencing prior to hip or knee replacement were to be developed | Agreement (%) |
Agreement (%) |
Ten statements reaching consensus for both importance and deliverability | ||
Q37. A postoperative mechanism for the identification of patients that are not progressing toward return to work as planned. | 95 | 71 |
Q52. Guidance for health services defining ‘best practice’ for patients returning to work after hip and knee replacement surgery. | 93 | 82 |
Q45. Training for members of the hospital orthopaedic care team to increase awareness about return to work issues. | 88 | 82 |
Q42. Interaction between the healthcare team and patient by phone, email or ‘on-line’ so that members of the care team can monitor progress and help the patient use the advice and information provided. | 88 | 70 |
Q64. Guidance on when in the return to work process patients can safely be discharged back to primary care for continued management of their return to work. | 86 | 80 |
Q36. A mechanism for preoperative identification of patients at 'high risk' of prolonged sickness absence following surgery. | 86 | 74 |
Q51. Routine preoperative therapy assessment during which a return to work plan is developed between the patients and the hospital orthopaedic care team. | 84 | 80 |
Q40. A separate intervention for hip and knee replacement patients that are not progressing towards return to work as planned. | 84 | 79 |
Q62. A process by which work status can be included in referral information for all patients referred from primary care into secondary care for consideration of hip or knee replacement. | 79 | 79 |
Q57. Information from patients that have experienced the process of returning to work after hip or knee replacement within the preoperative education process. | 76 | 73 |
Round 2
Responses were received from 26 of the 66 participants (39%) including 8 patients, 7 surgeons, 3 GPs, 6 allied health professionals and nurses, and 2 employers.
Twelve questions carried forward from round 1 plus one additional question generated from the free-text comments were presented to the participants. Of these, 10 reached consensus based on their potential importance within the proposed occupational advice intervention.
A further 81 statements grouped into 13 categories were then rated. This allowed the team to explore different approaches to a given problem. For example, the first category asked participants to rate a set of five statements relating to which healthcare team member should have responsibility for delivery and coordination of the occupational advice intervention. If at least one or more statements in a given category reached consensus this was taken as representative of the Delphi group’s position relating to the given category and the remaining statements were discarded. Overall 49 statements (60%) reached consensus (44 agreement and 5 disagreement), at least one statement in every category reached consensus (online supplementary appendix table 1).
bmjopen-2019-036191supp001.pdf (217.7KB, pdf)
The occupational advice intervention
Based on the evidence gathered throughout the OPAL study and consolidated through Delphi rounds 1 and 2 the occupational advice intervention was further developed and finalised.
The intervention was designed to support patients throughout their surgical pathway, starting during their initial outpatient appointment and continuing until 16 weeks after surgery. It had a number of key themes that linked to performance objectives for patients and staff and was supported by a range of patient and staff resources (to support delivery and measurement of the intervention). A simplified schematic of the OPAL ‘return to work’ intervention is presented in figure 1.
Figure 1.
Simplified schematic of the OPAL ‘return to work’ intervention.
Round 3
In round 3, the finalised occupational advice intervention along with selected patient and staff materials were circulated to 65 of the 66 Delphi participants for comment (one patient withdrew). Responses were received from 11 participants comprising a constructive appraisal of the intervention from 9, as well as highlighting typographical and formatting issues. The feedback was positive in all cases.
A diagram of the overall Delphi consensus process is shown in figure 2.
Figure 2.
Overview of the opal Delphi process. OPAL, Occupational advice for Patients undergoing Arthroplasty of the Lower limb.
Discussion
The Delphi consensus methodology was used to underpin the development of an evidence-based, theory-driven occupational advice intervention to assist patients returning to work after elective hip and knee replacement. It enabled the OPAL study team to rationalise the content, format, delivery and timing of the intervention and clarified areas of uncertainty related to the intervention that had arisen during the earlier stages of the research. Response to the developed intervention during the third round of the Delphi process was positive, validating the use of the Delphi process to support intervention development.
Prior to the Delphi process, the OPAL study had already completed a number of complementary research phases to enable the OPAL team understand the current evidence, stakeholder and patient perspectives, and current practice relating to return to work after hip and knee replacement.16–18 Through the intervention mapping framework this is information generated a range of components for our intervention. The Delphi methodology was then used to ‘refine’ the intervention and reach consensus on the final design. This is similar to the modified Delphi approach used by Vonk Noordegraaf et al to develop a return to work intervention for gynaecological surgery, as it used existing evidence as the basis for the process but sought to bridge gaps and clarify uncertainty within this evidence.28 However, one limitation of this approach is that it may inadvertently narrow the focus of the intervention with only components deemed important by the research team included. There is a risk that potentially useful intervention components that may have been of interest to the stakeholder groups were not included as the starting position was predefined. However, the approach used is not unusual and is similar to the approaches used by others.20 29 Furthermore, given the breadth of work completed earlier in the OPAL study and the design of the modified Delphi survey allowing participants to suggest new intervention components within each round, this is unlikely to have had a negative impact.
Broad stakeholder involvement helped the research team ensure the final intervention was acceptable to all groups, increasing the chances of success when implemented and delivered. Unfortunately, despite good initial engagement, the response rates reduced as the process progressed. This is a common finding during Delphi processes20 and was perhaps related to the larger sample size involved and extended period of the process with a 6-week gap between rounds 1 and 2 and a 6-month gap between rounds 2 and 3. The gap between rounds 2 and 3 was necessary as the intervention needed to be finalised with associated materials being developed during this period. Other contributing factors may include the increasing length of the Delphi questionnaires with each round and the volume of materials that needed to be reviewed in round 3. All participants were UK based and working with the setting of the UK National Health Service and social care provision or UK employment. Therefore, this may impact on the generalisability of the findings outside of the UK health setting.
While the low response rate in round 3 may be a concern, the purpose of this round was to circulate and draw comment regarding the final intervention rather than reach consensus on specific points. With 11 respondents, including at least one member from each stakeholder group, this seems valid as Delphi process relies more on the group dynamics even with reaching consensus rather than their statistical power and a lower limit of 10 participants is often considered sufficient for a Delphi panel.30 31 During the process, there was a notable drop off in employer respondents. In total 12 employers initially expressed an interest in participating, however, only four responded in round 1, two in round 2 and one in round 3. It is often difficult to engage employers in research32 and despite using a number of complementary strategies (17) we were unable to maintain engagement. However, as the intervention was designed to be delivered in secondary care rather than in the workplace this potentially did not significantly influence the nature of the final intervention.
The modified Delphi methodology employed in this study resolved uncertainties about a number of intervention components. However, there were a few areas where the consensus process was limited. Two key areas that stakeholders felt were important were (1) the provision of additional pre and post-operative physiotherapy/occupational therapy (over and above standard care) in which return to work issues could be addressed and (2) the identification of ‘high-risk’ patients that should be provided with additional help and support. Yet, these positions conflicted with other information gathered from the Delphi participants and the evidence from OPAL phase 1. Essentially first, our cohort study failed to identify a ‘high-risk’ population and the current literature describing predictors of return to work after hip and knee replacement was limited.33–38 This meant we were not able to confidently identify a ‘high-risk’ group in need of a more intensive targeted intervention. Second, there was concern about the cost, time and logistics associated with the implementation of a resource intensive intervention requiring additional patient interactions. The survey of practice and stakeholder/patient interviews demonstrated that services varied significantly in their structure and the resources available.18 To be successful it was agreed that the intervention should supplement rather than replace existing pathways of care and should, where possible, use existing staff and adapt current working. Comments from Delphi participants, the OPAL research team and the study steering committee had similarly raised concerns about the implementation and sustainability of an intervention requiring significant additional resources. The OPAL research team therefore felt that, despite this component reaching consensus, it was prudent to pursue a less intensive model to improve implementation of the final intervention.
We were unable to compare our intervention to other occupational advice interventions for patients undergoing hip and knee replacement as no such interventions have been reported in the literature. A rapid evidence synthesis performed earlier in the OPAL study (PROSPERO protocol registration number CRD42016045235) found only four studies that reported occupational advice interventions for patients undergoing elective surgery. This included two randomised clinical trials (RCTs) from Belgium and the Netherlands in patients undergoing gynaecological surgery and lumbar disc surgery39 40 and two qualitative studies that explored factors affecting return to work from the perspective of the patient following knee replacement41 and factors influencing work disability following mastectomy.42 Of the two interventions described in the RCTs one described a personalised e-Health intervention39 whereas the other assessed a rehabilitation-orientated intervention focusing on early resumption of activities.40 Our intervention drew on elements of both of these interventions in terms of delivering an individualised patient-centred approach while encouraging early resumption of workplace activities through discussion with employers alongside workplace adaptions and alterations to working patterns.
In conclusion, a modified Delphi consensus process employed within a wider intervention development project facilitated the development of the OPAL occupational advice intervention. Consensus was reached for a range of intervention components that allowed the content, format, delivery and timing of the intervention to be finalised. The intervention developed and the materials created to support its delivery were well received by the Delphi group. The effectiveness and cost-effectiveness of the developed intervention will require evaluation in an RCT.
Supplementary Material
Acknowledgments
The authors acknowledge the contributions of other members of the wider OPAL study team. The OPAL investigators acknowledge the support of the British Orthopaedic Association Surgery Research Centre (BOSRC) which supports the development of surgical trials.
Footnotes
Collaborators: OPAL Collaborators: The following researchers contributed to the concept, design, delivery and analysis of the OPAL study: Sayeed Khan (Make UK, the Manufacturers Organisation), Louise Thomson (Faculty of Medicine and Health Sciences, University of Nottingham), Catherine Hewitt and Catriona McDaid (York Trials Unit, University of York), Iain McNamara (Norfolk and Norwich University Hospital NHS Foundation Trust), David McDonald (University of Stirling), Judith Fitch (British Orthopaedic Association Patient Liaison Group), Gerry Richardson (Centre for Health Economics, University of York). The authors acknowledge the contributions of other members of the wider OPAL study team: Reece Walker and Amanda Goodman (South Tees Hospitals NHS Foundation Trust); Sarah Ronaldson and Elizabeth Coleman (York University); Dr Fiona Nouri and Dr Melanie Narayanasamy (University of Nottingham).
Contributors: PB: If the chief investigator for the OPAL study. Contributed to the conception of the study, the design of the work; the acquisition, analysis, or interpretation of data for the work; drafted the manuscript. LK: Contributed to the design of the work; the acquisition, analysis or interpretation of data for the work; drafted the manuscript. CC: Contributed to the conception of the study, the design of the work; the interpretation of data for the work; edited the manuscript. AD: Contributed to the conception of the study, the design of the work; the interpretation of data for the work; edited the manuscript. CM: Contributed to the conception of the study, the design of the work; the interpretation of data for the work; edited the manuscript. AR: Contributed to the design of the work; the acquisition, analysis or interpretation of data for the work; drafted the manuscript.
Funding: This project was funded by the National Institute for Health Research Health Technology Assessment (HTA) programme (project number 15/28/02). Further information available at https://www.journalslibrary.nihr.ac.uk/programmes/hta/152802/%23/
Disclaimer: This report presents independent research commissioned by the National Institute for Health Research (NIHR). The views and opinions expressed by the authors in this publication are those of the authors and do not necessarily reflect those of the National Health Service, the National Institute for Health Research, Medical Research Council, Central Commissioning Facility, NIHR Evaluations, Trials and Studies Coordinating Centre, the Health Technology Assessment Programme or the Department of Health.
Competing interests: AR is supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). CM is a member of the NIHR HTA and EME Editorial Boards.
Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Patient consent for publication: Not required.
Ethics approval: This study was reviewed and given favourable opinion by the East Midlands - Derby Research Ethics Committee (16/EM/0341) and approved by the Health Research Authority in UK.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement: Data are available on reasonable request. Anonymised data detailing the individual participants responses within each round of the OPAL Delphi study is available on request. Please submit requests in writing to the Department of Research and Innovation, South Tees Hospitals NHS Foundation Trust, Marton Rd, Middlesbrough, UK.
Contributor Information
On behalf of the OPAL study group:
Sayeed Khan, Louise Thomson, Catherine Hewitt, Iain McNamara, David McDonald, Judith Fitch, Gerry Richardson, Reece Walker, Amanda Goodman, Sarah Ronaldson, Elizabeth Coleman, Fiona Nouri, and Melanie Narayanasamy
References
- 1. Bieleman HJ, Bierma-Zeinstra SMA, Oosterveld FGJ, et al. The effect of osteoarthritis of the hip or knee on work participation. J Rheumatol 2011;38:1835–43. 10.3899/jrheum.101210 [DOI] [PubMed] [Google Scholar]
- 2. Sharif B, Garner R, Sanmartin C, et al. Risk of work loss due to illness or disability in patients with osteoarthritis: a population-based cohort study. Rheumatology 2016;55:861–8. 10.1093/rheumatology/kev428 [DOI] [PubMed] [Google Scholar]
- 3. Bhattacharya A. Costs of occupational musculoskeletal disorders (MSDs) in the United States. Int J Ind Ergon 2014;44:448–54. 10.1016/j.ergon.2014.01.008 [DOI] [Google Scholar]
- 4. Executive THaS Lower limbs: information for employees, 2018. Available: http://www.hse.gov.uk/msd/lld/employees.htm [Accessed 14 Apr 2020].
- 5. Executive THaS Costs to great Britain of workplace injuries and new cases of work-related ill health – 2017/18. Available: https://www.hse.gov.uk/statistics/cost.htm [Accessed 14 Apr 2020].
- 6. Gignac MAM, Badley EM, Lacaille D, et al. Managing arthritis and employment: making arthritis-related work changes as a means of adaptation. Arthritis Rheum 2004;51:909–16. 10.1002/art.20822 [DOI] [PubMed] [Google Scholar]
- 7. O'Brien GE, Feather NT. The relative effects of unemployment and quality of employment on the affect, work values and personal control of adolescents. J Occup Health Psychol 1990;63:151–65. 10.1111/j.2044-8325.1990.tb00517.x [DOI] [Google Scholar]
- 8. Waddell GBA. Is work good for your health and well-being? London (UK): The Stationery Office, 2006. [Google Scholar]
- 9. Jones CA, Voaklander DC, Johnston DW, et al. Health related quality of life outcomes after total hip and knee arthroplasties in a community based population. J Rheumatol 2000;27:1745–52. [PubMed] [Google Scholar]
- 10. Ethgen O, Bruyère O, Richy F, et al. Health-related quality of life in total hip and total knee arthroplasty. A qualitative and systematic review of the literature. J Bone Joint Surg Am 2004;86:963–74. 10.2106/00004623-200405000-00012 [DOI] [PubMed] [Google Scholar]
- 11. Fitzgerald JD, Orav EJ, Lee TH, et al. Patient quality of life during the 12 months following joint replacement surgery. Arthritis Rheum 2004;51:100–9. 10.1002/art.20090 [DOI] [PubMed] [Google Scholar]
- 12. Bachmeier CJ, March LM, Cross MJ, et al. A comparison of outcomes in osteoarthritis patients undergoing total hip and knee replacement surgery. Osteoarthritis Cartilage 2001;9:137–46. 10.1053/joca.2000.0369 [DOI] [PubMed] [Google Scholar]
- 13. Registry NJ. Hips - Primary Procedures - Patient Characteristics- Age and gender of primary hip replacement patients, 2018. Available: https://reports.njrcentre.org.uk/hips-primary-procedures-patient-characteristics
- 14. Registry NJ. Knees - Primary Procedures - Patient Characteristics- Age and gender of primary knee replacement patients, 2018. Available: https://reports.njrcentre.org.uk/knees-primary-procedures-patient-characteristics
- 15. Registry NJ. NJR 15th annual report; national joint Registry for England, Wales, Northern Ireland and the Isle of man, surgical data to 31 December 2017, 2018. Available: https://reports.njrcentre.org.uk/Portals/7/PDFdownloads/NJR%2015th%20Annual%20Report%202018.pdf
- 16. Baker P, Coole C, Drummond A, et al. Development of an occupational advice intervention for patients undergoing lower limb arthroplasty (the opal study). BMC Health Serv Res 2018;18:504. 10.1186/s12913-018-3238-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Coole C, Nouri F, Narayanasamy M, et al. Engaging workplace representatives in research: what recruitment strategies work best? Occup Med 2018;68:282–5. 10.1093/occmed/kqy047 [DOI] [PubMed] [Google Scholar]
- 18. Nouri F, Coole C, Narayanasamy M, et al. Managing employees undergoing total hip and knee replacement: experiences of workplace representatives. J Occup Rehabil 2019;29:451–61. 10.1007/s10926-018-9805-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Jones J, Hunter D. Consensus methods for medical and health services research. BMJ 1995;311:376–80. 10.1136/bmj.311.7001.376 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Sinha IP, Smyth RL, Williamson PR. Using the Delphi technique to determine which outcomes to measure in clinical trials: recommendations for the future based on a systematic review of existing studies. PLoS Med 2011;8:e1000393. 10.1371/journal.pmed.1000393 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Murphy MK, Black NA, Lamping DL, et al. Consensus development methods, and their use in clinical Guideline development. Health Technol Assess 1998;2:i–iv. 1-88. 10.3310/hta2030 [DOI] [PubMed] [Google Scholar]
- 22. Hallowell MR, Gambatese JA. Qualitative research: application of the Delphi method to CEM research. J Constr Eng Manag 2010;136:99–107. 10.1061/(ASCE)CO.1943-7862.0000137 [DOI] [Google Scholar]
- 23. Wilkes L. Using the Delphi technique in nursing research. Nurs Stand 2015;29:43–9. 10.7748/ns.29.39.43.e8804 [DOI] [PubMed] [Google Scholar]
- 24. SurveyMonkey Inc San Mateo, California, USA. Available: www.surveymonkey.com [Accessed 14 Apr 2020].
- 25. Sinead Keeney FH, McKenna H. The Delphi technique in nursing and health research. The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, UK: John Wiley & Sons Ltd, 2011. [Google Scholar]
- 26. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs 2000;32:1008–15. [PubMed] [Google Scholar]
- 27. Keeney S, Hasson F, McKenna H. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs 2006;53:205–12. 10.1111/j.1365-2648.2006.03716.x [DOI] [PubMed] [Google Scholar]
- 28. Vonk Noordegraaf A, Huirne JAF, Brölmann HAM, et al. Multidisciplinary convalescence recommendations after gynaecological surgery: a modified Delphi method among experts. BJOG 2011;118:1557–67. 10.1111/j.1471-0528.2011.03091.x [DOI] [PubMed] [Google Scholar]
- 29. Slade SC, Dionne CE, Underwood M, et al. Standardised method for reporting exercise programmes: protocol for a modified Delphi study. BMJ Open 2014;4:e006682. 10.1136/bmjopen-2014-006682 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manage 2004;42:15–29. 10.1016/j.im.2003.11.002 [DOI] [Google Scholar]
- 31. Akins RB, Tolson H, Cole BR. Stability of response characteristics of a Delphi panel: application of bootstrap data expansion. BMC Med Res Methodol 2005;5:37. 10.1186/1471-2288-5-37 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Lysaght R, Kranenburg R, Armstrong C, et al. Participant recruitment for studies on disability and work: challenges and solutions. J Occup Rehabil 2016;26:125–40. 10.1007/s10926-015-9594-1 [DOI] [PubMed] [Google Scholar]
- 33. Tilbury C, Schaasberg W, Plevier JWM, et al. Return to work after total hip and knee arthroplasty: a systematic review. Rheumatology 2014;53:512–25. 10.1093/rheumatology/ket389 [DOI] [PubMed] [Google Scholar]
- 34. Kuijer PPFM, de Beer MJPM, Houdijk JHP, et al. Beneficial and limiting factors affecting return to work after total knee and hip arthroplasty: a systematic review. J Occup Rehabil 2009;19:375–81. 10.1007/s10926-009-9192-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Sankar A, Davis AM, Palaganas MP, et al. Return to work and workplace activity limitations following total hip or knee replacement. Osteoarthritis Cartilage 2013;21:1485–93. 10.1016/j.joca.2013.06.005 [DOI] [PubMed] [Google Scholar]
- 36. Tilbury C, Leichtenberg CS, Tordoir RL, et al. Return to work after total hip and knee arthroplasty: results from a clinical study. Rheumatol Int 2015;35:2059–67. 10.1007/s00296-015-3311-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Leichtenberg CS, Tilbury C, Kuijer P, et al. Determinants of return to work 12 months after total hip and knee arthroplasty. Ann R Coll Surg Engl 2016;98:387–95. 10.1308/rcsann.2016.0158 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Scott CEH, Turnbull GS, MacDonald D, et al. Activity levels and return to work following total knee arthroplasty in patients under 65 years of age. Bone Joint J 2017;99-B:1037–46. 10.1302/0301-620X.99B8.BJJ-2016-1364.R1 [DOI] [PubMed] [Google Scholar]
- 39. Vonk Noordegraaf A, Anema JR, van Mechelen W, et al. A personalised eHealth programme reduces the duration until return to work after gynaecological surgery: results of a multicentre randomised trial. BJOG 2014;121:1127–36. discussion 36. 10.1111/1471-0528.12661 [DOI] [PubMed] [Google Scholar]
- 40. Donceel P, Du Bois M, Lahaye D. Return to work after surgery for lumbar disc herniation. A rehabilitation-oriented approach in insurance medicine. Spine 1999;24:872–6. 10.1097/00007632-199905010-00007 [DOI] [PubMed] [Google Scholar]
- 41. Bardgett M, Lally J, Malviya A, et al. Return to work after knee replacement: a qualitative study of patient experiences. BMJ Open 2016;6:e007912. 10.1136/bmjopen-2015-007912 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Hinman MR. Factors influencing work disability for women who have undergone mastectomy. Women Health 2001;34:45–60. 10.1300/J013v34n02_04 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2019-036191supp001.pdf (217.7KB, pdf)