Introduction
Patient and public involvement is an active partnership between patients, the public and researchers in the research process.1 Patients and the public offer unique insights from their lived experiences which cannot be substituted by expert knowledge from clinicians, researchers or other specialist stakeholders. These insights are important to ensure research is relevant and high quality.2 Furthermore, the public have a right to be involved in research which may affect them and, often, is publicly funded.3 The active partnership distinguishes involvement activities from patient and public engagement which is the sharing of research, such as science festivals or newsletter articles, and people as ‘subjects’ or participants in research.1
There has been an international drive to promote and raise the profile of patient public involvement in research and for patient public involvement to change how research is designed and conducted.4,5 Recently, an international network for patient public involvement in health and social care research was established which aims to promote and advance patient public involvement through a global partnership.6 Major funders of healthcare research increasingly expect evidence of comprehensive, meaningful patient public involvement in the development of grant applications and planned patient public involvement within the proposed project.4,5 For example, in the United Kingdom, the National Institute for Health Research have patient public involvement policies within their research and grant committees and fund INVOLVE, a national advisory group to advance patient public involvement.4,7 Similarly, in the United States, the Patient Centred Outcomes Research Institute promotes patient input to guide research questions and supports active involvement from patients in reviewing applications, sitting on advisory committees and providing feedback on policy documents.5 Funder requirements and expectations have been important drivers for the increase in number of research studies involving patient partners in the planning and delivery of research.2
Research strategy and infrastructure
Currently, patient public involvement in research is predominantly focused on specific aspects of individual research studies such as the initial study set-up, data analysis, report writing and dissemination.8 Although major funders integrate patient public involvement within their broader infrastructure, patient public involvement within organisations, such as academic research centres, is often ad hoc with different projects conducting patient public involvement independently from each other.9 This ‘siloed’ approach has been identified as a barrier to effective patient public involvement and resulted in a call for more collaborative practices.9 An alternative method is for organisations to take a broader perspective whereby patient public involvement moves beyond project-specific activities and is embedded within the wider infrastructure of the organisation. Research organisations should have a public involvement strategy at an organisational level, which patient and the public contribute to and regularly review. To ensure patient priorities, perspectives and unique skillsets are incorporated within the organisational research strategy, and public contributors could be included on strategy groups or executive committees and contribute to research prioritisation and major infrastructure bids (Box 1). The latest National Institute for Health Research INVOLVE Standards for Involvement includes indicators for organisations as well as individuals and organisations.10
Box 1.
• The Centre for Patient Reported Outcomes Research is a world-leading centre for Patient Reported Outcomes research. Patient-reported outcomes capture the patients’ perspective; therefore, it is essential to have the patients’ voice at the heart of all our research activities. |
• Patients and members of the public have been involved from the start through contributing to Centre Strategy and actively participating in the Centre launch. |
• Patient/public partners are part of the research team and receive training and support and participate in activities in line with academic staff including inductions (tailored appropriately); assessment of training needs; representation on relevant management groups; attending events (such as conferences); participation in all activities from research strategy to dissemination and inclusion in social activities, such as Christmas meals. |
• We have integrated patient public involvement within the Centre for Patient Reported Outcomes Research infrastructure through a variety of different approaches, including: representatives on the Executive Committee; User Advisory Groups for individual research projects; co-production of training materials; co-hosting a ‘Patients Included’ accredited conference (Box 2) and collaboration with patient public involvement experts from the National Institute for Health Research infrastructure to share knowledge and best practice. |
• We promote capacity building through our online training resource PROLearn, which includes a free online module for patient advocates involved in the co-design of patient-reported outcomes research/reviewing research protocols. PROLearn was co-produced with patient partners (https://www.birmingham.ac.uk/Prolearn). |
• We embed patient public involvement within the Centre’s research throughout the research cycle from research prioritisation and identifying new research topics, to dissemination including co-authored publications. |
Benefits of an organisational level approach
Embedding patient public involvement at an organisational level facilitates opportunities for shared learning across different projects and accelerated skill development, for both patient partners and academic researchers. Developing connections with patient public involvement experts, such as patient public involvement leads, within the organisation and wider research infrastructures, enables direct access to advice and guidance, and facilitates sharing of best practice and knowledge, such as the latest guidance and standards. In turn, organisations may develop their own standards for patient public involvement based on their growing experience and expertise which enhances the conduct of future patient public involvement activities and creates continuity for long-term patient partners.
Relationships develop over time; therefore, organisational level approaches to patient public involvement may facilitate building and sustaining relationships with patients and the public, which has been identified as a key enabler to meaningful patient public involvement.11 Models of patient public involvement which incorporate relationship building have greater impact than one-off patient public involvement activities.2 Furthermore, such an approach may offer unique, unanticipated opportunities for research collaboration and co-production (Box 3). Evidence shows involvement in research has benefits for patients and the public, including: giving people a purpose; gaining new knowledge about their condition(s); understanding more about research and the latest evidence; opportunities to use existing skills and develop new skills; building confidence; and opportunities to meet other people and gain additional support (Box 4).3
Box 3.
Patient partner, Gary Price, is employed as an International Product Manager at the company ERIKS, which provides customised, automated and innovative engineering solutions for design, manufacturing and production processes. Through discussions with Gary it became apparent that there was a clear opportunity to learn from ERIKS and consider how cutting edge process management, condition monitoring and use of cloud-based technology in an engineering setting could be applied to healthcare. Medical Research Council Proximity to Discovery funding was secured to facilitate research group members to visit ERIKS European Innovation Centre in Rotterdam, fostering multidisciplinary collaboration, sharing of good practice and directly informing our research. |
Group pictures taken after a tour of the ERIKS manufacturing plant to see first-hand the processes discussed earlier. |
Picture 1, Left to right are: Wouter Siepman (Formerly ERIKS); Derek Kyte, Lee Aiyegbusi, Mel Calvert (Centre for Patient Reported Outcomes Research members); Gary Price (ERIKS staff and CPROR patient partner) |
Picture 2, Left to right are: Wouter Siepman (Formerly ERIKS); Mel Calvert, Lee Aiyegbusi, Derek Kyte (Centre for Patient Reported Outcomes Research members) |
(Permissions were granted by all for the pictures to be taken and used in subsequent publications. The pictures were uploaded to and are currently in public domain on the Twitter website.) |
Box 4.
Due to my profession as an engineer, I engaged in using patient reported outcomes when I was diagnosed with serious illness. As it was going to be a long process of intense treatment and (hopefully) recovery, I decided to create my own list of outcomes for physical, mental and wellbeing, then monitor myself to see how the drugs were affecting me long term. Each day I would rate myself adding in my blood test results along the way. I would send these to the clinicians every few days. |
At first the team of clinicians that were treating me would have a bit of a laugh with me about my charts and graphs, but within a few weeks based on my outcomes they were using my results to discuss with me how to continue the treatment. This in turn meant they could see from a patient’s point of view and feeling, exactly what was going on, there were no surprises, no reason to see me for the sake of seeing me and more importantly I could continue receiving the high doses of drugs that saved my life. |
Two years after my recovery, based on my recent illness experience and how I had dealt with it, the consultant who treated me asked if I would consider contributing to patient public involvement for a cancer trial. Through this I met Professor Calvert who was developing a proposal for a new research centre for patient reported outcomes research and I was invited to contribute to the centre strategy. After initial meetings and understanding of what this involved and how it will help patients and clinicians in future, I gladly accepted the role and have been involved in the centre ever since. Four years on and I consider myself very fortunate to be a key part of a team that has the patient at the core of its strategy. I have been able to see how more and more health sectors that the Centre for Patient Reported Outcomes Research engage with are realising the advantage of having a formal and structured patient public involvement, introducing a new dynamic to how patients are viewed and treated. I have been able to see at root level how patients are involved from concept of trials to delivery and how the clinicians value their input. |
Finally: There are other advantages that sometimes can help play a part with patient public involvement. Take the case of myself, as part of my day-to-day job I have gained a lot of experience within condition monitoring and asset management industry. From this I have been able to channel a lot of my knowledge into helping and contributing to the research that the Centre for Patient Reported Outcomes Research is doing on remote monitoring, data collection and analysis. I believe I am a good example of patient public involvement where a patient not only has experience of a serious illness but also has experience of the work that the team is doing. |
Gary Price, Centre for Patient Reported Outcomes Research patient partner |
Challenges and facilitators
Embedding patient public involvement in organisations is resource intensive and requires adequate funding, planning and time allocation (Box 5). Public contributors need to be supported in their involvement and should receive relevant training and reimbursement for their expenses and time commitment. Expenses directly incurred as a result of participating in research should be covered for clinicians and other collaborators and refreshments provided as required. Consideration should also be given to communication with public contributors, collection and sharing of feedback on public involvement, and evaluation and reporting of activities. Individual research projects should be appropriately costed for patient public involvement training and activities.12,13 However, a challenge is the lack of funding opportunities for organisational level patient public involvement, which is not associated with a specific research project, particularly in University settings.
Box 5.
Changing culture |
• Team effort – advocacy throughout institution from student and early career researcher groups to senior management committees |
• Recognition for staff who lead/facilitate public involvement activities |
• Acknowledgement of patient partners are team members |
• Involve patient partners in all team activities including social events |
• Arrange an induction for patient partners (similar to a new member of staff) |
• Demonstrate input is valued (honoraria, thanking people, listening and responding to ideas). |
Practical considerations |
• Accessibility and travel |
• Reimbursement |
• Training and support for patients, public and researchers |
• Flexible working arrangements |
• Develop processes to pay honoraria |
• Have named contact for public contributors. |
Communication |
• Explain the context of the research, such as rationale, timelines and relevance to clinical care and patient |
• Listen to views and make necessary changes |
• Establish roles and ground rules |
• Manage expectations |
• Address any concerns |
• Maintain regular contact |
• Identify optimal mode/preferences/frequency of communication. |
Measure impact |
• Consider use of key performance indicators – for example, involvement of patients and the public on committees, grant applications, publications |
• Use guidance for reporting patient and public involvement version 2 as a framework to report patient public involvement. The checklist was developed in order to address inconsistent reporting by assisting researchers, patients, carers and the public with the reporting of patient public involvement activities so as to improve the quality, consistency and transparency of reports. |
In the past, clinical research was often based on research objectives and agendas of clinicians and researchers. The studies were mostly designed, conducted and disseminated by clinicians and researchers with little or no input from patients or the general public.2 One of the issues with this traditional approach was that such objectives and outcomes may not match those prioritised highly by patients who are supposed to benefit from research studies, thus potentially limiting the usefulness and impact of research findings.2 Patient and public involvement provides the opportunity for patients, their families, carers and the general public to become co-members of the research team, participate and contribute to research alongside clinicians and researchers. Widening involvement in research this way, particularly to include under-represented voices from minority and hard to reach communities, is a well-recognised challenge.2 Embedding patient public involvement at an organisational level has potential to accentuate a lack of diversity as the nature of organisation level activities may unintentionally create bias in recruitment of patient partners. For example, attending an organisation’s executive committee meeting may not be possible for public contributors with work/carer responsibilities and individuals from low socioeconomic backgrounds may find these meetings intimidating. Therefore, it is important that organisations are aware of these risks and take steps to actively address diversity. These may involve: developing relationships with local communities; widely advertising involvement opportunities; provision of additional training and support for public contributors and ensuring chairs of meetings have the skills to involve public contributors in discussions and decision-making.10 In addition, it is important to have varied, flexible opportunities for involvement (beyond formal meeting) and ability to adapt to people’s changing circumstances and changes how much they want to contribute.
Although the proposed embedded model of patient public involvement suggests all team members are actively engaged in patient public involvement, having a person(s) who co-ordinates and is responsible for patient public involvement can be beneficial to drive patient public involvement initiatives, maintain momentum, monitor involvement strategies and outcomes, and be a named point of contact.2 However, there is a danger that research teams become reliant on the patient public involvement lead which may hinder team engagement with patient public involvement and shared learning.2 Ongoing, regular communication with public contributors, both formal and informal contact, is critical for building and sustaining relationships.12
Support from senior leadership is important to promote a culture of patient public involvement as standard practice and to ensure organisations have a public involvement strategy. Cultural changes are required to embed patient public involvement at an organisational level and to create an environment where patient public involvement is valued by researchers and viewed as the norm rather than an added extra.9 Involving patient partners in research should be done instinctively by all team members and patient partners should be regarded as integral members of the research team (Box 1).
Measuring the impact of patient and public involvement
Patient public involvement has the potential to positively impact on research at multiple levels, promoting quality and relevance of research and benefitting the wider research system.11 Impact should be assessed by measuring pre-determined key performance indicators linked to research outcomes and processes14 through qualitative and/or quantitative methods.3 Individual level performance indicators could include acquisition of new skills and knowledge for the patient public involvement contributors and better understanding of the research field from a patient perspective for the research team.11 Research quality indicators could include patient public involvement in research prioritisation,15 contributions to research design and methods,16 collaborations on grant applications17,18 and dissemination of findings via co-authorship on publications and presentations at conferences.3 Wider research system impact could be measured by assessing influence on advocacy and accountability in terms of the allocation of research resources.14
There is drive to capture key performance indicators for individual research projects; however, it is also important to document these indicators at an organisational level and think beyond project-specific objectives. The use of the Guidance for reporting patient and public involvement version 2 checklist13 to report patient public involvement activities and utilisation of the newly developed Cost and Consequences Framework19 may enhance transparency and accuracy in the reporting of positive and negative impacts. Furthermore, consideration should be given to capturing ‘soft’ outcomes, such as relationship building, which are often more difficult to measure.
Conclusion
There is a need to move away from patients and the public only being involved in individual research projects and move towards models where patient public involvement is considered at an organisational level and patient partners are valued team members. This approach has potential to promote relationship building, generate more sustainable, efficient patient public involvement practices and accelerate development of skills and expertise for patient partners, researchers and other stakeholder collaborators. However, it requires adequate resourcing, co-ordination and cultural change.
Key messages
Patient and public involvement in research is predominantly focused at the level of individual research studies; however, a move toward patient public involvement being embedded within the wider infrastructure of the organisation may maximise benefits for all involved.
This approach has potential to promote relationship building, generate more sustainable, efficient patient public involvement practices and accelerate development of skills and expertise for patient partners, researchers and other stakeholder collaborators.
Organisational level patient public involvement requires adequate resourcing, co-ordination and cultural change.
Patient involvement
Patient partner, Gary Price, has significantly contributed to this paper and is a co-author. Price has been actively involved in planning the content and structure of the manuscript, wrote a reflection of his patient public involvement experiences (Box 4) and has reviewed drafts of the manuscript. Magdalena Skrybant has a wealth of experience working with public contributors and has represented their voices during the planning and writing of the manuscript.
Box 2.
• What we did: Public contributors were at the heart of planning and delivering the UK and Ireland PROMS 2018 Conference (Birmingham, UK), which received the Patients Included Chatermark accreditation. |
• Public Involvement in planning the event: The Conference Organising Committee included a public contributor and a patient public involvement Lead who were involved in planning and delivering the event. Members of the public were involved in reviewing abstracts. |
• Public Involvement at the event: Ten bursaries were offered for patients and the public. Public contributors who attended were supported by the patient public involvement lead prior to the event, and received information on what to expect on the day, had catering to specific needs and could visit a dedicated stand on the day for all delegates where people could ask questions/receive information. |
• Impact of public involvement: |
○ Patient conference co-chair and presentations from public contributors ensured that priorities of patients were a focus for the day. |
○ Panel discussions included perspectives from patients on the relevance of research areas, impact of research to improve health outcomes and future directions for research. |
○ Public perspectives were included in decisions to award prizes including a prize for the best innovation in public involvement in Patient-Reported Outcome Measures research. |
○ Public contributors were involved in writing summaries of the Conference |
▪ Article in the Journal of Patient Reported Outcomes https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6297120/ |
▪ Blog for the BMJ opinion https://blogs.bmj.com/bmj/2018/08/23/richard-lehman-and-magdalena-skrybant-a-day-at-the-proms/ |
○ Successful inclusion of public contributors has ensured that future Patient-Reported Outcome Measures Conferences will involve public contributors in planning/delivering the event. |
Declarations
Competing Interests
The authors declare no potential conflicts of interest. GT, OLA and MC are members of the Centre for Patient Reported Outcomes Research at the University of Birmingham. The Centre has benefited from involvement of patient partners at an organisational level and employs a number of strategies to embed patient and public involvement within the Centre's infrastructure and through external collaborations. The authors have previously presented this organisational approach to patient public involvement in research at the Patient Reported Outcome Measures conference (Birmingham, 2018) and were awarded the prize for ‘Best Patient and Public Involvement'. The authors have reflected on their experiences in the context of wider literature during the development of this manuscript. MS is the Patient and Public Involvement and Engagement Lead for National Institute of Health Research Applied Research Collaboration West Midlands. MS has extensive experience in patient and public involvement and knowledge of the literature and latest guidance which has informed our discussion. GP is a patient partner within Centre for Patient Reported Outcomes Research and member of the executive board. His experiences of patient and public involvement at an organisational level within Centre for Patient Reported Outcomes Research have been important to inform the context on the manuscript and he wrote a box on reflections of his experiences. He co-authored this paper and has given his full permission to be named on it.
Funding
GT is funded by a National Institute for Health Research Postdoctoral Fellowship Award. OLA is funded by the Health Foundation, an independent charity committed to bringing about better health and healthcare for people in the United Kingdom. He also receives funding from the National Institute for Health Research Birmingham Biomedical Research Centre. MC is funded by National Institute for Health Research Biomedical Research Centre, National Institute for Health Research Applied Research Centre West Midlands, the National Institute for Health Research Surgical Reconstruction and Microbiology Research Centre at the University Hospitals Birmingham National Health Service Foundation Trust, the University of Birmingham, Health Data Research UK, Innovate UK and Macmillan Cancer Support. MS is funded by National Institute for Health Research Applied Research Centre West Midlands. This paper presents independent research and the views expressed are those of the author(s) and not necessarily those of the organisations mentioned above. This research is supported by the National Institute for Health Research Applied Research Centre West Midlands.
Guarantor
MC.
Ethics approval
Not required
Contributorship
GT and OLA drafted the initial manuscript. All the authors reviewed, revised and approved the final manuscript.
Acknowledgements
The authors thank ERIKs European Technology Centre, Rotterdam, Netherlands, for hosting them during their industry visit.
Provenance
Not commissioned; peer-reviewed by Eugene Yeung.
ORCID iD
Olalekan Lee Aiyegbusi https://orcid.org/0000-0001-9122-8251
References
- 1.INVOLVE. INVOLVE Supporting Public Involvement in NHS, Public Health and Social Care Research. See www.invo.org.uk/ (last checked 3 May 2019).
- 2.Wilson P, Mathie E, Keenan J, McNeilly E, Goodman C, Howe A, et al. Health Services and Delivery Research. ReseArch with Patient and Public invOlvement: a RealisT evaluation – The RAPPORT Study. Southampton, UK: NIHR Journals Library, 2015. [PubMed]
- 3.Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. A systematic review of the impact of patient and public involvement on service users, researchers and communities. Patient 2014; 7: 387–395. [DOI] [PubMed] [Google Scholar]
- 4.National Institute for Health Research (NIHR). NIHR: Patients and the Public. See www.nihr.ac.uk/patients-and-public/ (last checked 3 May 2019).
- 5.Patient-Centered Outcomes Research Institute (PCORI). The Value of Engagement. See www.pcori.org/about-us/our-programs/engagement/public-and-patient-engagement/value-engagement (last checked 3 May 2019).
- 6.Cochrane Consumer Network. An International Network on Public Involvement in Health and Social Care Research. See https://consumers.cochrane.org/news/international_network (last checked 3 May 2019).
- 7.INVOLVE. Going the Extra Mile: Improving the Nation’s Health and Wellbeing Through Public Involvement in Research 2015. See www.nihr.ac.uk/documents/about-us/our-contribution-to-research/how-we-involve-patients-carers-and-the-public/Going-the-Extra-Mile.pdf (last checked 17 May 2019).
- 8.Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect 2014; 17: 637–650. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Staniszewska S, Denegri S, Matthews R, Minogue V. Reviewing progress in public involvement in NIHR research: developing and implementing a new vision for the future. BMJ Open 2018; 8: e017124–e017124. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.INVOLVE. National Standards for Public Involvement in Research 2018. See www.invo.org.uk/wp-content/uploads/2019/02/71110_A4_Public_Involvement_Standards_v4_WEB.pdf (last checked 17 May 2019).
- 11.Ball S, Harshfield A, Carpenter A, Bertscher A and Marjanovic S. Patient and Public Involvement in Research: RAND Corporation. See www.rand.org/pubs/research_reports/RR2678.html (last checked 14 October 2019).
- 12.Mathie E, Wythe H, Munday D, Millac P, Rhodes G, Roberts N, et al. Reciprocal relationships and the importance of feedback in patient and public involvement: a mixed methods study. Health Expect 2018; 21: 899–908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ 2017; 358: j3453–j3453. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Edelman N, Barron D. Evaluation of public involvement in research: time for a major re-think? J Health Serv Res Policy 2015; 21: 209–211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Turner GM, Backman R, McMullan C, Mathers J, Marshall T, Calvert M. Establishing research priorities relating to the long-term impact of TIA and minor stroke through stakeholder-centred consensus. Res Involv Engagem 2018; 4: 2–2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Crocker JC, Ricci-Cabello I, Parker A, Hirst JA, Chant A, Petit-Zeman S, et al. Impact of patient and public involvement on enrolment and retention in clinical trials: systematic review and meta-analysis. BMJ 2018; 363: k4738–k4738. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Staniszewska S, Jones N, Newburn M, Marshall S. User involvement in the development of a research bid: barriers, enablers and impacts. Health Expect 2007; 10: 173–183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Andrews LM, Allen H, Sheppard ZA, Baylis G, Wainwright TW. More than just ticking a box … how patient and public involvement improved the research design and funding application for a project to evaluate a cycling intervention for hip osteoarthritis. Res Involv Engagem 2015; 1: 13–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Blackburn S, McLachlan S, Jowett S, Kinghorn P, Gill P, Higginbottom A, et al. The extent, quality and impact of patient and public involvement in primary care research: a mixed methods study. Res Involv Engagem 2018; 4: 16–16. [DOI] [PMC free article] [PubMed] [Google Scholar]