Abstract
Background
Co‐design and associated terms are increasingly being used to facilitate values‐based approaches to health‐care improvement. It is messy and complex, involving diverse actors.
Methods
We explore the notion that initiatives have outcomes other than initially planned is neither new nor novel but is overlooked when thinking about co‐design. We explore some of the unintended consequences and outline some optimal conditions that can mitigate challenges.
Discussion
Although co‐design approaches are being applied in health care, questions remain regarding its ability to produce gains in health outcomes. Little is known about determining whether co‐design is the most suitable approach to achieve the given project goals, the levels of involvement required to realize the benefits of co‐design or the potential unintended consequences. There is a risk of further marginalizing or adding burden to under‐represented populations and/or over‐researched populations.
Conclusion
Undertaking a co‐design approach without the optimal conditions for inclusive involvement by all may not result in an equal partnership or improve health or care quality outcomes. Co‐design requires on‐going reflective discussions and deliberative thinking to remove any power imbalances. However, without adequate resources, a focus on implementation and support from senior leaders, it is a tough ask to achieve.
Patient or Public Contribution
This viewpoint article was written by two academics who have undertaken a significant amount of PPI and co‐design work with members of the public and patient's right across the health system. Our work guided the focus of this viewpoint as we reflected on our experiences.
Keywords: co‐design, health‐care improvement, inclusive involvement, public and patient involvement, seldom heard, unintended consequences
1. INTRODUCTION
Co‐design (Box 1) and the associated terms of co‐creation, experience‐based co‐design, co‐production, and public and patient involvement are approaches to research inquiry increasingly used by clinicians and health service researchers to facilitate values‐based approaches to health‐care improvement. Values‐based approaches are those that seek to embed deeply held ideals that patients, families, health professionals and other stakeholders consider to be important in decision making about proposed improvements and their implementation.1 These approaches have been described as the new ‘Zeitgeist—the spirit of our times’2 and are advocated as the best approach for a ‘third era’ of medicine.3 Co‐design has attracted increasing interest in the context of shifting health‐care priorities towards user‐centric care and outcome measurement.4, 5, 6
BOX 1. What is co‐design?
Co‐design is a values‐based methodology.1 Within healthcare the process includes bringing together service users, clinical and non‐clinical staff and, at times, relevant support and advocacy groups to work together to improve or refine elements of the care systems, services or processes. It is focused on the reality of healthcare contexts and of healthcare staff work environments.7 At its core is open reciprocal democratic dialogue where all participants contribute equally.8 This approach moves from consulting to enabling the involvement of all from the outset. It ensures and supports all relevant partners to be involved in defining the problem, designing the solution and monitoring and championing the implementation.
Co‐design approaches are not new; with foundations in the humanities and social sciences, 'action research', 'emancipatory’ and ‘participatory’ approaches have focused on advancing transformation, empowerment of the person, social justice, and advocacy and translation since the early 1990s.7, 8 These approaches and terms may be new for many working and undertaking quality improvement and research in health systems, but their foundations are rooted in the humanities and social sciences. Their focus is on advancing transformation, empowerment of the person, social justice, and advocacy and translation.8, 9 When reviewing the literature, the separate reflections of Barnes and Oliver are worth revisiting.7, 10 They question whether emancipatory approaches are realistic if those leading it are interested in improving the broader structures for everyone involved.11, 12 We argue that these questions need to be reflected upon when undertaking co‐design and associated terms in health care.
Health systems internationally have shown a strong appetite for clinicians to demonstrate the use of co‐design approaches in implementing change‐focused interventions and service improvement.2, 11, 12 Health‐care agencies and systems have also identified co‐design as central to supporting patient‐centred care, illustrated in the increasing support for co‐design approaches in health research funding schemes worldwide.13, 14, 15
There is diverse and ever‐increasing evidence of widespread use of co‐design and associated approaches to improve health care and create change for quality improvement.16, 17, 18, 19, 20, 21 Successful co‐design has also been utilized in patient safety interventions,22 the development of frailty pathways,19 the development of telehealth services23 and within lean, a structured quality improvement approach in health care.24
2. UNINTENDED CONSEQUENCES FROM CO‐DESIGN
The notion that initiatives have outcomes other than initially planned is neither new nor novel but has been overlooked when thinking about co‐design.25 Although co‐design approaches are increasingly applied in health care, questions remain regarding its ability to produce gains in health outcomes.26, 27 Little is known from the literature on determining whether co‐design is the most suitable approach to achieve the given project goals, the levels of involvement required to realize the benefits of co‐design or the potential unintended consequences.16, 28, 29, 30, 31 Can we potentially do more harm than good?
The application of co‐design and its value for improving long‐term health‐care outcomes—including the depth and duration of resultant change—has been contested.16, 32, 33 Recent reviews of the literature found the involvement of service users/patients still at low and often tokenistic levels.16, 26 Apparent gaps in scientific rigour, tensions and hierarchical power differences between those involved in the process, coupled with a focus on short‐term outcomes, raise questions regarding the use of co‐design.16, 34 Few works provide any evidence or guidance on supporting the involvement of health‐care staff who may have a diverse range of needs to support their full participation.27 There are strong critiques on the use of narrow approaches that lack the involvement of priority populations, having co‐design approaches set before a project commences, and the process being managed by health‐care staff.35, 36
Undertaking a co‐design approach without the optimal conditions for inclusive involvement by all may not result in an equal partnership or improve health or care quality outcomes. 37, 38, 39 There is a risk of further marginalizing or adding burden to populations under‐represented and over‐researched with very little evidence that their involvement has improved the health system for them.6, 13, 26 Co‐design in health services is messy and complex, involving diverse actors with various abilities and statuses. Identifying diverse co‐design team members and bringing them together to enable and implement change requires an investment of resource before, during and after the process of co‐design.40, 41, 42, 43 Much of the work undertaken in well‐developed co‐design processes is invisible and based on values and relationships. This can involve additional time to enable the development of trust between participants or capture feedback and input outside of formal co‐design settings such as workshops, in particular for the public and patient partners.19 Co‐design work can increase the time and costs of involvement with no robust evidence of improved health outcomes.16, 26 Questions regarding the impact of undertaking a co‐design process must be considered.15, 44, 45 We argue that co‐design and associated terms must be considered over three stages, stressing the need to shift focus away on doing co‐design. Each has the potential to result in unintended consequences in the doing of co‐design if not considered, and we outline mitigation strategies as potential solutions.
3. PRE‐COMMENCEMENT STAGE: WHO DECIDES THAT CO‐DESIGN IS THE BEST APPROACH?
We recognize that there are now significant guidance, frameworks and literature on co‐designing once everyone is together.46, 47 There still is a substantial gap in the evidence on what needs to occur before participants enter into a co‐design process.48 Clarity is required on who decides what type of co‐design approach to take 49 The pre‐commencement stage should provide the space for exploring what other alternatives/approaches are available. Recent work found a lack of guidance on approaching this pre‐commencement stage, noting the phase where inequities of power concerning agenda setting were occurring.13 As a potential solution, the paper stressed the need to embed values‐based approaches such as respect, openness, reciprocity and flexibility from the pre‐commencement.13 Several ways these values could be used were outlined. For example, all partners planning co‐design work should use the values as a basis of developing an initial term of reference outlining everyone motivations on why they want to undertake co‐design. These should be constantly reflected upon by all parties. This requires time and being open to flexibility from all to engage repeated and transparent dialogue to achieve beneficial outcomes for all stakeholders. Being open to new inputs and differing modes of knowledge and ideas must be expected during this stage.
There is still a lack of clarity on how the key principles and practice of co‐design is implemented for populations who experience health and health‐care disparities, such as those from ethnic minority backgrounds.19, 22 A key task to undertake at the pre‐commencement stage should be an understanding of who should be involved. It is often the case that the ‘usual suspects’ are involved in co‐design work.14, 35, 37, 49, 50, 51 Understanding, building trust and engaging diverse public involvement are a key activity at the pre‐commencement stage.11, 37 This requires time and must be culturally appropriate.43 This may involve meetings between partners occurring in ‘spaces and places’ that are accessible and safe to them, often occurring in their own local communities.14
4. PROCESS OF INVOLVEMENT
Once co‐design commences, the main priority is to ensure that all participants are treated equally in the process.18, 19, 52 Power relations within these interactions can manifest easily often because of where the co‐design occurs.32, 37 The space and place where the co‐design occurs are often overlooked.14 Consider, for example, if the interactions are occurring in an acute hospital, external participants can often be unfamiliar with the environment. Often, they can be left to navigate this environment to make it to the ‘room’. This first interaction can often be overwhelming.14 Previous work has stressed the importance of developing a positive atmosphere that enables the contribution of all.19, 47, 51 One approach is to use community members as co‐chairs of the co‐design sessions and to provide them with adequate capacity building to enable them to amplify their voices.19 Having the co‐design sessions relaxed, informal jargon‐free that provided food and refreshments was also stressed.19 It is necessary to ensure that flexible and diverse financial (vouchers, cash or whichever is most appropriate for the community partners as alternatives) and administrative supports are provided to all participants. Managing and providing realistic and clear expectations regarding participant input into the co‐design process were highlighted as important enablers for meaningful involvement.12, 14, 19, 36, 51 Expecting and managing tensions must be anticipated, and it is important that everyone involved in the process can set the agenda and influence the process.53
5. AFTER CO‐DESIGNING, WHAT NEXT?
Ensuring ownership of the co‐design process must continue during the implementation stage. Often, people leave the co‐design space and think it is the responsibility of others to implement.47 Perhaps the most significant gap of co‐design is enabling a feedback loop for all who were involved in the process as the ideas are implemented and evaluated.15, 37 How can participants who were involved in the co‐design project have oversight and involvement in the implementation state? For example, Palmer et al note that people involved in co‐design, such as mental health service users, can often have a fractured experience in the health system. Their attitudes can change from being involved in co‐design, and they can be important champions to support organizational culture change.2 Often overlooked is defining and guiding the roles of implementation for those involved in the co‐design process—ensuring that all participants are invited to be involved is critical. The benefits of involving community groups and service users at this stage can have significant benefits as they can champion the change and communicate the change back to their communities.13
Co‐design is often so contextualized that we do not have enough evidence of how it can be scaled and spread for long‐term health system impact.26 We do know from the literature that a key mechanism for implementation of co‐design priorities is securing institutional commitment, sponsorship and leadership.6 An exemplar of this occurring focused on co‐designing a frailty pathway that stressed the importance of supporting collective leadership across the health system to support implementation.19 Education and training were critical to encourage professional commitment to the initiatives identified from the co‐design phase. Key to the success and future sustainability of many of the initiatives was identifying champions who could be a liaison between the different professions while negotiating disciplinary responsibilities and demonstrating strong interpersonal communication skills.19 Ensuring on‐going evaluations of co‐design initiatives is central to capture success where the focus is on capturing long‐term health system change.2, 12, 14, 18, 26, 44 The evidence on the impact of co‐design is short term, with scant evidence available of the long‐term changes occurring in the health system.26, 32 There needs to be a focus on long‐term reciprocal partners where co‐design initiatives are built on and developed to support transformation evidence. The key to this is helping people to step in and out of the co‐design process by enabling an on‐going learning system, mentoring and capacity building.19
Optimal conditions that can mitigate unintended consequences for co‐design arise when there is sufficient focus from the pre‐commencement to the implementation stages, with some core elements notable at each stage (table 1).
Table 1.
Mitigation strategies for optimal co‐design
| Pre‐Commencement | Mitigation Strategies |
|---|---|
| At the core of co‐design should be the involvement of diverse participants. | Time and resources are needed to understand who needs to be involved. At the core of this is building trust, and this work may occur in spaces and places that are inclusive and safe for partners. |
| Co‐design adds to the complexity of the work being undertaken. Is co‐design the right approach? | Central to good co‐design is allowing all stakeholders equal opportunities to influence the process. Using values‐based approaches can enable the development of an initial term of reference. This should capture everyone's motivations, noting the agreed outcome and should be monitored frequently. |
| Identify champions to support the implementation | The support and involvement of health‐care staff across the system are critical to enabling implementation. Senior leaders need to be included in this stage. Time and focus are needed at this stage on how to develop, agree, capture and evaluate long‐term impacts |
| Process of involvement | Mitigation Strategies |
|---|---|
| Enabling equal inclusive involvement. | All partners involved must be compensated for their time associated with participation (travel, subsistence, care release etc). Additional supports may need to be provided for some participants such as translation, follow‐up calls to answer any questions and accessibility supports. |
| Managing power relations | Tensions and conflicts can emerge during co‐design. To ensure democratic involvement, rotating lay co‐chair is recommended. This may require the provision of additional supports to amplify their voices. |
| Inclusive environments | Review and consider the space where the involvement will occur. Will it create an open atmosphere where everyone can feel included? |
| Managing expectations | Enable open communication that provides clear and realistic expectations for all. Review and refine via consensus the developed terms of reference |
| After co‐design | Mitigation Strategies |
|---|---|
| Ownership of the process | Ensure that role clarity for implementation is agreed upon by those who were involved in the process. Provide diverse opportunities to support oversight and champion implementation. This may need to involve further training and education sessions. |
| Update on implementation | Provide a feedback loop for all on implementation. |
| Capture impact | Review, reflect and share the impact. Ensure support for co‐design is provided by the health‐care organization to support any learnings and changes that emerge from the process. |
| Celebrate success and retain links | Ensure that time and adequate flexible resources are made available to celebrate success and achievements. Maintain on‐going relationships with partners by supporting on‐going learning and capacity building. |
6. CO‐DESIGN MAY NOT BE SUITABLE FOR ALL INITIATIVES
To conclude, we recognize that co‐design is messy and may not be suitable for all initiatives.14, 39 Ensuring inclusive, equitable involvement is time‐consuming, and requires everyone involved to be flexible, patient and open to differing ideas. Much of the work involved is invisible. To do this well, it is clear from the literature and from our experiences of undertaking co‐design that the work requires on‐going reflective discussions and deliberative thinking to remove any power imbalances. However, without adequate resources, a focus on implementation and support from senior leaders, it is a tough ask to achieve. It often reinforces hierarchies and takes away the spirit of involvement that is central to co‐design.14, 44, 49 Senior leaders within health systems have a key role to play to support this, particularly at the pre‐commencement stage.47 The motivations for those working in the health system to scale up and ensure diversity of involvement of co‐design methodologies remain challenging.3, 8 Co‐design work must be responsive and open to mitigating the potential multiple unintended consequences from co‐design.
ACKNOWLEDGEMENTS
We are grateful to the reviewers for their considered feedback on this article.
Ní Shé É, Harrison R. Mitigating unintended consequences of co‐design in health care. Health Expect. 2021;24:1551–1556. 10.1111/hex.13308
DATA AVAILABILITY STATEMENT
Data sharing is not applicable to this article as no data sets were generated or analysed during the current study.
REFERENCES
- 1.Health NSW, New South Wales, Ministry of Health, Agency for Clinical Innovation (N.S.W.), New South Wales, Clinical Excellence Commission , et al. Leading better value care: improving the health outcomes and experiences that matter to patients. 2019.
- 2.Palmer VJ, Weavell W, Callander R, et al. The Participatory Zeitgeist: an explanatory theoretical model of change in an era of coproduction and codesign in healthcare improvement. Med Humanit. 2019;45(3):247‐257. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Berwick DM. Era 3 for medicine and health care. JAMA. 2016;315(13):1329. [DOI] [PubMed] [Google Scholar]
- 4.Fennelly O, Blake C, FitzGerald O, et al. Advanced musculoskeletal physiotherapy practice: the patient journey and experience. Musculoskelet Sci Pract. 2020;1(45):102077. [DOI] [PubMed] [Google Scholar]
- 5.Alokozai A, Jayakumar P, Bozic KJ. Value‐based Healthcare: improving outcomes through patient activation and risk factor modification. Clin Orthop. 2019;477(11):2418‐2420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Black A, Strain K, Wallsworth C, et al. What constitutes meaningful engagement for patients and families as partners on research teams? J Health Serv Res Policy. 2018;23(3):158‐167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Oliver M. Changing the social relations of research production? Disabil Handicap Soc. 1992;7(2):101‐114. [Google Scholar]
- 8.Donnelly S, Morton S. Creating organisational and practice change through the use of co‐operative inquiry groups in healthcare settings. Action Res. 2019;17(4):451‐468. [Google Scholar]
- 9.Ethics in Participatory Research for Health and Social Well‐Being: Cases and Commentaries [Internet]. Routledge and CRC Press. https://www.routledge.com/Ethics‐in‐Participatory‐Research‐for‐Health‐and‐Social‐Well‐Being‐Cases/Banks‐Brydon‐Miller/p/book/9781138093430. Accessed May 1, 2021.
- 10.Barnes C. What a difference a decade makes: reflections on doing ‘emancipatory’ disability research. Disabil Soc. 2003;18(1):3‐17. [Google Scholar]
- 11.Harrison R, Walton M, Chauhan A, et al. What is the role of cultural competence in ethnic minority consumer engagement? An analysis in community healthcare. Int J Equity Health. 2019;18(1):191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Ward M, Ní Shé É, De Brún A, et al. The co‐design, implementation and evaluation of a serious board game ‘PlayDecide patient safety’ to educate junior doctors about patient safety and the importance of reporting safety concerns. BMC Med Educ. 2019;19(1):232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ní Shé É, Cassidy J, Davies C, et al. Minding the gap: identifying values to enable public and patient involvement at the pre‐commencement stage of research projects. Res Involv Engagem. 2020;6(1):46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Ní Shé É, Morton S, Lambert V, et al. Clarifying the mechanisms and resources that enable the reciprocal involvement of seldom heard groups in health and social care research: a collaborative rapid realist review process. Health Expect. 2019;22(3):298‐306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17(1):33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Slattery P, Saeri AK, Bragge P. Research co‐design in health: a rapid overview of reviews. Health Res Policy Syst. 2020;18(1):17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Lim S, Morris H, Pizzirani B, Kajewski D, Lee WK, Skouteris H. Evaluating hospital tools and services that were co‐produced with patients: a rapid review. Int J Qual Health Care. 2020;32(4):231‐239. [DOI] [PubMed] [Google Scholar]
- 18.Dimopoulos‐Bick TL, O'Connor C, Montgomery J, et al. “Anyone can co‐design?”: a case study synthesis of six experience‐based co‐design (EBCD) projects for healthcare systems improvement in New South Wales, Australia. Patient Exp J. 2019;6(2):93‐104. [Google Scholar]
- 19.O’Donnell D, Ní Shé É, McCarthy M, et al. Enabling public, patient and practitioner involvement in co‐designing frailty pathways in the acute care setting. BMC Health Serv Res. 2019;19(1):797. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Locock L, Robert G, Boaz A, et al. Using a national archive of patient experience narratives to promote local patient‐centered quality improvement: an ethnographic process evaluation of ‘accelerated’ experience‐based co‐design. J Health Serv Res Policy. 2014;19(4):200‐207. [DOI] [PubMed] [Google Scholar]
- 21.Bombard Y, Baker GR, Orlando E, et al. Engaging patients to improve quality of care: a systematic review. Implement Sci. 2018;13(1):98. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory‐based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Eaton L. The long road to patient co‐production in telehealth services. BMJ. 2019;25(366):l4770. [DOI] [PubMed] [Google Scholar]
- 24.Smith I, Hicks C, McGovern T. Adapting lean methods to facilitate stakeholder engagement and co‐design in healthcare. BMJ. 2020;28(368):m35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Bloomrosen M, Starren J, Lorenzi NM, Ash JS, Patel VL, Shortliffe EH. Anticipating and addressing the unintended consequences of health IT and policy: a report from the AMIA 2009 health policy meeting. J Am Med Inform Assoc. 2011;18(1):82‐90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Lloyd N, Kenny A, Hyett N. Evaluating health service outcomes of public involvement in health service design in high‐income countries: a systematic review. BMC Health Serv Res [Internet]. 2021;21(1):364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Harrison R, Chin M, Ní Shé É. What does co‐design mean for Australia’s diverse clinical workforce? Aust Health Review. 2021; In Press. [DOI] [PubMed]
- 28.Blomkamp E. The promise of co‐design for public policy. Aust J Public Adm. 2018;77(4):729‐743. [Google Scholar]
- 29.Stolee P, MacNeil M, Elliott J, Tong C, Kernoghan A. Seven lessons from the field: research on transformation of health systems for older adults. Healthc Manage Forum. 2020;33(5):220‐227. [DOI] [PubMed] [Google Scholar]
- 30.Green T, Bonner A, Teleni L, et al. Use and reporting of experience‐based codesign studies in the healthcare setting: a systematic review. BMJ Qual Saf. 2020;29(1):64‐76. [DOI] [PubMed] [Google Scholar]
- 31.Einfeld C, Blomkamp E. Nudge and co‐design: complementary or contradictory approaches to policy innovation? Policy Stud. 2021;0(0):1‐19. [Google Scholar]
- 32.Farrington CJ. Co‐designing healthcare systems: between transformation and tokenism. J R Soc Med. 2016;109(10):368‐371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Boyd H, McKernon S, Mullin B, Old A. Improving healthcare through the use of co‐design. 2012;125(1357):12. [PubMed] [Google Scholar]
- 34.Rogers L, De Brún A, Birken SA, Davies C, McAuliffe E. The micropolitics of implementation; a qualitative study exploring the impact of power, authority, and influence when implementing change in healthcare teams. BMC Health Serv Res. 2020;20(1):1059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Farr M. Power dynamics and collaborative mechanisms in co‐production and co‐design processes. Crit Soc Policy. 2018;38(4):623‐644. [Google Scholar]
- 36.Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement. BMJ Qual Saf. 2016;25(8):626‐632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Moll S, Wyndham‐West M, Mulvale G, et al. Are you really doing ‘codesign’? Critical reflections when working with vulnerable populations. BMJ Open. 2020;10(11):e038339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Jones B, Heslop D, Harrison R. Seldom heard voices: a meta‐narrative systematic review of Aboriginal and Torres Strait Islander peoples healthcare experiences. Int J Equity Health. 2020;19(1):222. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Mulvale G, Miatello A, Green J, Tran M, Roussakis C, Mulvale A. A COMPASS for navigating relationships in co‐production processes involving vulnerable populations. Int J Public Adm. 2021;1‐13. [Google Scholar]
- 40.Fraser N. Rethinking the public sphere: a contribution to the critique of actually existing democracy. Soc Text. 1990;(25/26):56‐80. [Google Scholar]
- 41.Maguire K, Britten N. ‘You’re there because you are unprofessional’: patient and public involvement as liminal knowledge spaces. Sociol Health Illn. 2018;40(3):463‐477. [DOI] [PubMed] [Google Scholar]
- 42.DeCamp M, Brewer SE, Dukhanin V. Patient, public, consumer, and community engagement: from consucrat to representative comment on “The Rise of the Consucrat”. Int J Health Policy Manag. 2020;15:1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Ekezie W, Routen A, Denegri S, Khunti K. Patient and public involvement for ethnic minority research: an urgent need for improvement. J R Soc Med. 2021;24:141076821994274. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Williams O, Sarre S, Papoulias SC, et al. Lost in the shadows: reflections on the dark side of co‐production. Health Res Policy Syst. 2020;18(1):43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co‐creation in community‐based health services: literature review and case study. Milbank Q. 2016;94(2):392‐429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Boylan A, Locock L, Thomson R, Staniszewska S. “About sixty per cent I want to do it”: health researchers’ attitudes to, and experiences of, patient and public involvement (PPI)—a qualitative interview study. Health Expect. 2019;22(4):721‐730. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Pallesen KS, Rogers L, Anjara S, De Brún A, McAuliffe E. A qualitative evaluation of participants’ experiences of using co‐design to develop a collective leadership educational intervention for health‐care teams. Health Expect. 2020;23(2):358‐367. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Mulvale G, Moll S, Miatello A, et al. Codesigning health and other public services with vulnerable and disadvantaged populations: insights from an international collaboration. Health Expect. 2019;22(3):284‐297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Louise L, Annette B. Drawing straight lines along blurred boundaries: qualitative research, patient and public involvement in medical research, co‐production and co‐design. Evid Policy J Res Debate Pract. 2019;15(3):409‐421. [Google Scholar]
- 50.Beyond the usual suspects. Towards inclusive user involvement [Internet]. The Learning Exchange. 2013. https://lx.iriss.org.uk/content/beyond‐usual‐suspects‐towards‐inclusive‐user‐involvement. Accessed December 19, 2020.
- 51.Knowles S, Hays R, Senra H, et al. Empowering people to help speak up about safety in primary care: using codesign to involve patients and professionals in developing new interventions for patients with multimorbidity. Health Expect. 2018;21(2):539‐548. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Faulkner A, Carr S, Gould D, et al. ‘Dignity and respect’: an example of service user leadership and co‐production in mental health research. Health Expect. 2021;24(Suppl 1):10‐19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Bowen S, McSeveny K, Lockley E, Wolstenholme D, Cobb M, Dearden A. How was it for you? Experiences of participatory design in the UK health service. CoDesign. 2013;9(4):230‐246. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data sharing is not applicable to this article as no data sets were generated or analysed during the current study.
