Skip to main content
BMJ Open logoLink to BMJ Open
. 2020 Nov 3;10(11):e038339. doi: 10.1136/bmjopen-2020-038339

Are you really doing ‘codesign’? Critical reflections when working with vulnerable populations

Sandra Moll 1,, Michelle Wyndham-West 2, Gillian Mulvale 3, Sean Park 4, Alexis Buettgen 1,5, Michelle Phoenix 6, Robert Fleisig 7, Emma Bruce 1
PMCID: PMC7640510  PMID: 33148733

Abstract

‘Codesign’ and associated terms such as ‘coproduction’ or ‘patient engagement’, are increasingly common in the health research literature, due to an increased emphasis on the importance of ensuring that research related to service/systems development is meaningful to end-users.  However, there continues to be a lack of clarity regarding the key principles and practices of codesign, and wide variation in the extent to which service users are meaningfully engaged in the process. These issues are particularly acute when end-users include populations who have significant health and healthcare disparities that are linked to a range of intersecting vulnerabilities (eg, poverty, language barriers, age, disability, minority status, stigmatised conditions).  The purpose of this paper is to prompt critical reflection on the nature of codesign research with vulnerable populations, including key issues to consider in the initial planning phases, the implementation process, and final outputs.  Risks and tensions will be identified in each phase of the process, followed by a tool to foster reflexivity in codesign processes to address these issues.

Keywords: statistics & research methods, qualitative research, organisation of health services, quality in health care

Introduction

Over the last decade, codesign has emerged as a ubiquitous research and service/systems development approach across a myriad of health-oriented disciplines including, but not limited to, health services,1–4 quality improvement,5 health technology development6 7; Indigenous health8 9 and community-based health.10 Application of codesign approaches are increasingly evident with populations who experience vulnerability due to social, economic and environmental barriers, from children,6 11 12 through to older adults.13–15 Researchers and practitioners within these disciplines have deployed codesign approaches across a range of settings, using various terms such as cocreation, coproduction, coresearch, experience-based codesign, human-centred design, technology codesign, participatory research, collaborative and community-based research.16 17 The terms are linked to sets of core principles regarding the value of lived experience, collaboration, building on capabilities and creativity.16 Codesign, at a basic level, refers to application of user-centric research and service/systems development approaches in order to solve a particular problem or challenge.18 However, codesign has also been described as a dynamic, creative approach to research that embraces partnership with community, and focuses on systems change and improving human experience.16

The increasing use of the term codesign and its associated methodologies has made it challenging to distinguish whether or not the term has been co-opted in such a way that sidesteps meaningful engagement with the original principles of codesign: distribution of power in research, amelioration of the human experience and positive societal impact. These issues are particularly acute when engaging populations who are ‘vulnerable’; considering vulnerability not as an individual characteristic, but as the result of social and systemic barriers (eg, poverty, literacy, language barriers, and discrimination related to age, disability status, ethnicity/race, gender).

In this article, we critically discuss three questions, with a particular focus on research with vulnerable service users: (1) what is the epistemological starting point that is underpinning the decision to apply codesign processes and techniques?; (2) how are codesign methodologies, planned, applied and adapted while engaging in iterative ‘research through design’ processes?; (3) what type of post codesign outputs can be anticipated and created, and what will the manifest and latent impacts of these outputs be? These questions are based on synthesis of theoretical and practical writings about codesign from a range of disciplines, including engineering, business, health sciences, rehabilitation and social sciences, as well as our own experiences as codesign researchers in these disciplines. Our standpoint as researchers is informed by reflections on our varied experiences in codesign with a range of communities, including families of children with disabilities, youth with mental health issues, newcomers, and older adults who are precariously housed. The critical discussion which ensues places a particular emphasis on how power is conceptualised, deployed and received19 within codesign processes aimed to ameliorate health services, products and experiences for vulnerable individuals and groups.

Where are you starting from?

Advancing effective and ethical codesign should start with critical reflection on the epistemological beliefs that are driving initiation of the process, including the ‘mindset’ of the codesign facilitators. Codesign should begin with critical and embodied reflexivity that attends to (1) ourselves—the subjective self or ‘I’; (2) our relationship with others—the intersubjective ‘we’; and (3) the systems in which we and others are embedded—the objective ‘it’.20

The first point of reflection is internal; as a facilitator of codesign, it is important to consider the worldview, assumptions and values that you bring to the process. Codesign facilitators need to embrace critical, reflexive practice, including development of a subjective, embodied understanding of their own standpoints and epistemological frameworks that will impact their relationships with others.21 They need to be capable of improvising and taking other perspectives, and be willing to be transformed in the process.22 These capabilities are cultivated through enhancing mindful awareness of, and working with the thoughts, emotions, perceptions, sensations, that arise as part of being in an interpersonal relationship.23

The second point of reflection is on your relationship with others who are engaged in the codesign. This includes attending to the effects that you have as a researcher, educator and/or practitioner at every step of the design process. It also involves a commitment to ongoing dialogue about various ways of knowing, the interrogation of power and privilege, and making the time and space to listen, share and cocreate.24 The humanity and multidimensionality of all participants must be respected and attended to with care, compassion, creativity and humility. Relationships require openness and vulnerability in the immediacy of human-to-human connection.25

The third and final point of reflection is on the system in which the codesign process will occur. There may be a clash of values since many organisations operate within a sociopolitical environment that privileges individualism over collectivism, self-sufficiency over collaboration, and scientific expertise over other ways of knowing based on lived experiences.3 26 The fundamental principles of collaboration in codesign may be subverted in the drive for efficiency and top-down decision making. Critical awareness and resistance to these pressures may be needed in order to find the time and space required for an authentic way of working together for social justice and change. Beginning a codesign project requires institutional support to ensure that there is a commitment to critical thinking, learning and change,27 that diverse people are given an opportunity to participate28 and that sufficient resources (including funding and space) are provided.

What should you be doing?

Codesign has been described as both a philosophy and a method27 that includes authentic and equitable collaboration between stakeholders in projects that are emergent, flexible and iterative.28 There are several specific approaches that have been used in the context of healthcare, including experience-based codesign (EBCD),29 30 participatory research1 8 and user centred design.31 Each approach has its own processes and tools, but there are several overarching issues to consider in optimising the process of collaboration and design.

First, it is critical to include diverse people in the codesign process, including those with lived experience, those who deliver or implement a service or programme, and other key stakeholders or influencers.28 A noteworthy criticism of codesign specifically, and patient-oriented research generally, is that vulnerable populations may be excluded32 or represented by ‘super users’ who do not reflect the typical population.33 Super users are individuals who frequently contribute to research projects. They are often invited to participate since they are actively engaged, articulate and clearly understand their role in the process. One of the dangers, however, is that over time, socialisation to their research role may desensitise them to the perspective of those experiencing greater disenfranchisement.33 It takes time and effort to ensure representation from the important, but often unheard voices of communities who face many barriers to engagement.

When engaging groups from historically marginalised communities, sensitivity to power differentials and creative approaches may be needed to ensure a safe and inclusive space for collaboration. Invited spaces have been criticised for perpetuating marginalisation and tokenism, since unexamined power imbalances may delegitimise forms of knowledge that depart from the status quo.34 Principles and tools for engagement could include: (1) formalising agreements for shared leadership, decision making and ownership of knowledge; (2) providing training and ongoing mentorship for new participants who may be uncomfortable and/or unfamiliar with the process; (3) ensuring flexibility to account for differences and fluctuations in ability to participate; and (4) establishing formal recognition for the value of service user input.28 33 34 Richards and colleagues35 present an insightful argument regarding compensation for service users in order to recognise vulnerability, promote equity, facilitate commitment and remove barriers to participation. They suggest starting the conversation early to build relationships, negotiating a fair rate that addresses the needs of all parties, and establishing a formal agreement on roles and responsibilities in order to avoid the risk of tokenism.

Specific steps of codesign may vary depending on the project, however, core processes include building trust, finding voice, sharing perspectives and creating a common vision for change.28 Arts-based tools and techniques can be incorporated to generate initial insights into stakeholder experiences, as well to foster creativity in designing solutions. Generative design strategies, as outlined by Sanders and Stappers,31 emphasise the role of ‘doing’ and ‘making’ as alternate paths of expression that can evoke deeper insights and creative solutions. They highlight how a range of probes, generative toolkits and prototyping strategies can facilitate the codesign process, using creative tools such as video, storyboards, clay and even Lego to evoke insights and ideas that transcend what people might put into words. These strategies may be particularly effective to engage service users who may have difficulty with purely verbal interviews or focus group discussions (eg, recent immigrants, young children, older adults with dementia).

Rather than following a series of rigid steps, working with vulnerable populations requires following a set of core principles; ‘taking time to fully engage, listen for understanding and not move forward until participants or communities are ready’ (p295).28 One of the challenges for codesign facilitators is responding to pressures related to resource and time constraints that could compromise the process.27

What are your intended outputs?

In addition to how codesign is implemented, it is critical to examine outputs of the process. With its roots in design thinking and action research, codesign involves creating prototype solutions to address the priority problems or issues. Ultimately, the process should continue to implementation and evaluation of the proposed solutions, with a commitment to ongoing collaboration in the process of change.36 37 Without this movement to positive change, participants can become disempowered and even resentful, particularly with perpetuation of the status quo.

The specific outputs and outcomes of codesign are varied, but can occur on several levels, from individual to systems change. A survey of 59 EBCD projects in six countries found that most projects initially targeted small quality improvements, however the legacies of the codesign work had much larger impacts in terms of ‘deep changes in attitudes and behaviours’.30 Similarly, Palmer et al38 argue that while practical solutions are important, the skills gained by service users, family/caregivers and staff in negotiating new ways of advancing the future that they have helped to shape is even more significant. This can be particularly important for groups who have a history of fractured relations (eg, mental health service users), wherein new shared identities can be developed as the basis for a restructuring of future relationships.39 40 These attitudinal and behavioural shifts are important in shifting culture within a service, and thereby improve the inter-personal dynamics of care,41 including power sharing and enhanced communication between service professionals and users.42 The ultimate hope is for positive, sustained change in health and/or social services through outputs of greater empathy, increased trust, shared commitment and advocacy.38 The extent to which this occurs will depend on adopting and adhering to core principles and skilled facilitation.28 43

The way forward

The ubiquity of codesign as a strategy for health service and system reform, and the diversity in how it is defined, begs the question of whether there should be standards for implementation and evaluation, as well as critical reflection on the implications of doing this work with participants who experience a range of vulnerabilities.

As noted earlier, careful planning and critical reflection is needed to ensure that the process does not produce ‘token’ service user involvement or further perpetuate inequities. A useful guidance document developed by INVOLVE44 outlines key principles and strategies to consider in coproducing a research project. Also, guidelines for reporting on patient and public involvement in health and social care research (GRIPP2) have been proposed as a strategy to advance quality and transparency in codesign.45 These guidelines are a helpful step toward consistency in language and reporting of codesign processes, outputs and outcomes, as well as a useful tool for generating critical reflection on the engagement of service users in research. The next steps are to create more specific questions to critically evaluate codesign projects stemming from the three overarching questions addressed in this article. Box 1 outlines a list of suggested sub-questions to consider, which reflect the high level of engagement expected throughout the entirety of a codesign project. It should be noted that these questions are directed towards researchers and facilitators of codesign initiatives, as a tool to prompt reflexive analysis. Stakeholders who represent community partners and end users should also be engaged in dialogue about how to optimise the codesign process.

Box 1. A tool to foster reflexivity in codesign with vulnerable populations.

Where are you starting from?

  • What are your worldviews, assumptions and values relevant to the issue(s) or problem(s) you are trying to address? How open are you to being transformed by other worldviews?

  • How will you respectfully interact and compassionately attend to human diversity, and various ways of knowing?

  • How will you interrogate power and privilege?

  • How will you make time and space for sharing, dialogue and cocreation despite timelines and resource constraints?

What should you be doing?

  • How will you purposefully select a broad range of stakeholder perspectives and representatives? How do you define inclusive participation?

  • What tools, processes and techniques will you use to fully understand lived experiences, build rapport and foster trust within an environment of open and respectful dialogue?

  • How will you tap into tacit knowledge, creativity and shared meaning of diverse perspectives to cocreate a shared vision for improvement?

What are your intended outputs?

  • How will you facilitate implementation of prototype solutions?

  • How will you foster commitment to change to minimise the risk of tokenistic engagement of vulnerable populations and perpetuating the status quo?

  • How will your codesign processes build capacity and forge new ways of communicating, and in doing so shift service cultures toward greater empathy, trust, shared commitment and advocacy?

  • How will you determine if your project has achieved the desired outcomes? Will these outcomes be sustainable?

Another key step forward will be more robust evaluation of codesign work, in terms of costs and benefits, quality improvement and wider systems impacts.30 In their review of health-related codesign research, Slatterly and colleagues18 echo the call for systematic research on the effectiveness of various codesign approaches and strategies. They emphasise that research should be theoretically informed, and build on implementation science principles that capture the context and complexity of the codesign process. Realist evaluation, therefore, is a promising approach, since it considers the impact of the context, as well as the mechanisms of change that shape project outcomes.46 Realist evaluations are also based on a theory of change which can help to explicate the relationship between various dimensions of the codesign process and how they lead to change.47

In conclusion, it should be recognised that codesign can be a powerful tool to contest vulnerability through authentic collaboration in research and service/system design. Codesign is a philosophy and method that has the potential to empower people, both researchers and participants, service providers and service users, policy makers and community members. It must be recognised, however, that codesign is ultimately a relational process and as such, careful attention must be paid to ensuring that the process does not perpetuate inequities. The realities of fiscal and time constraints must be balanced with critical reflexivity and commitment to creating meaningful collaborative solutions.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @profseanpark, @RobertFleisig

Contributors: The first author (SM) was responsible for the overall paper, incorporating input from the team. MW-W, GM, SP, AB, MP were all involved in writing sections of the paper. All authors (including RF and EB) were involved in the conceptualisation of the paper and provided feedback on draft versions.

Funding: The codesign hub for Vulnerable Populations is funded through the McMaster (SAF2019) Strategic Alignment Initiative.

Competing interests: None declared.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; externally peer reviewed.

References

  • 1.Bowen S, McSeveny K, Lockley E, et al. . How was it for you? experiences of participatory design in the UK health service. CoDesign 2013;9:230–46. 10.1080/15710882.2013.846384 [DOI] [Google Scholar]
  • 2.Bowen S, Dearden A, Wright P, et al. . Co-designing better outpatient services for older people: inspiration stories for participatory design with health and social care institutions workshop. 11th biennial participatory design. Sydney, Australia, 2010. [Google Scholar]
  • 3.Mulvale G, Moll S, Miatello A, et al. . Codesigning health and other public services with vulnerable and disadvantaged populations: insights from an international collaboration. Health Expect 2019;22:284–97. 10.1111/hex.12864 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Wolstenholme D, et al. Design-Led service improvement for older people. Australas Med J 2010;3:465–70. 10.4066/AMJ.2010.377 [DOI] [Google Scholar]
  • 5.Greenhalgh T, Russell J, Swinglehurst D. Narrative methods in quality improvement research. Qual Saf Health Care 2005;14:443–9. 10.1136/qshc.2005.014712 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Allsop MJ, Holt RJ, Levesley MC, et al. . The engagement of children with disabilities in health-related technology design processes: identifying methodology. Disabil Rehabil Assist Technol 2010;5:1–13. 10.3109/17483100903323267 [DOI] [PubMed] [Google Scholar]
  • 7.Sutcliffe A, Thew S, De Bruijn O, et al. . User engagement by user-centred design in e-health. Philos Trans A Math Phys Eng Sci 2010;368:4209–24. 10.1098/rsta.2010.0141 [DOI] [PubMed] [Google Scholar]
  • 8.Blodgett AT, Schinke RJ, Peltier D, et al. . May the circle be unbroken: the research recommendations of Aboriginal community members engaged in participatory action research with university academics. J Sport Soc Issues 2011;35:264–83. [Google Scholar]
  • 9.Moscou K, Rempel K, Beeman C, et al. . A healthy neighbourhood: voices of Indigenous youth.Brandon, Manitoba. Canada: Centre for Aboriginal and Rural Education Studies, 2018. [Google Scholar]
  • 10.Buffel T, Handler S, Philipson C. Age-Friendly cities and communities: AGlobal perspective. Great Britain: Policy Press, 2018. [Google Scholar]
  • 11.Beresford B. Working on Well-Being: Researchers’ Experiences of a Participative Approach to Understanding the Subjective Well-Being of Disabled Young People. Child Soc 2012;26:234–40. 10.1111/j.1099-0860.2012.00436.x [DOI] [Google Scholar]
  • 12.Veinot TC, Flicker SE, Skinner HA, et al. . "Supposed to make you better but it doesn't really": HIV-positive youths' perceptions of HIV treatment. J Adolesc Health 2006;38:261–7. 10.1016/j.jadohealth.2005.03.008 [DOI] [PubMed] [Google Scholar]
  • 13.Holroyd-Leduc J, Resin J, Ashley L, et al. . Giving voice to older adults living with frailty and their family caregivers: engagement of older adults living with frailty in research, health care decision making, and in health policy. Res Involv Engagem 2016;2:1–19. 10.1186/s40900-016-0038-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Burnell KJ, Selwood A, Sullivan T, et al. . Involving service users in the development of the support at home: interventions to enhance life in dementia carer supporter programme for family carers of people with dementia. Health Expect 2015;18:95–110. 10.1111/hex.12012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Tanner D. Co-research with older people with dementia: experience and reflections. J Ment Health 2012;21:296–306. 10.3109/09638237.2011.651658 [DOI] [PubMed] [Google Scholar]
  • 16.Greenhalgh T, Jackson C, Shaw S, et al. . Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q 2016;94:392–429. 10.1111/1468-0009.12197 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Littlechild R, Tanner D, Hall K. Co-research with older people: perspectives on impact. Qual Soc Work 2015;14:18–35. 10.1177/1473325014556791 [DOI] [Google Scholar]
  • 18.Slattery P, Saeri AK, Bragge P. Research co-design in health: a rapid overview of reviews. Health Res Policy Sys 2020;18:1–13. 10.1186/s12961-020-0528-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Allen A. The politics of ourselves: power, autonomy and gender in contemporary critical theory. New York: Columbia University Press, 2013. [Google Scholar]
  • 20.Hochachka G, Sustainability D. Developing the self: an integral approach to international and community development. Victoria, Canada: Trafford, 2009. [Google Scholar]
  • 21.Cunliffe AL. On becoming a critically reflexive practitioner. J Manag Educ 2004;28:407–26. 10.1177/1052562904264440 [DOI] [Google Scholar]
  • 22.Keeney H, Keeney B, Chenail R. Recursive frame analysis: a qualitative research method for mapping Change-Oriented discourse. Fort Lauderdale, FL: TQR Books, 2015. [Google Scholar]
  • 23.Varela F. Ethical know-how: action, wisdom, cognition. Palo Alto, CA: Stanford University Press, 1999. [Google Scholar]
  • 24.Hankivsky O. Intersectionality 101. Burnaby: Institute for Intersectionality Research and Policy, Simon Fraser University, 2014. [Google Scholar]
  • 25.Cipolla C. Designing for vulnerability: interpersonal relations and design. She Ji: The Journal of Design, Economics, and Innovation 2018;4:111–22. 10.1016/j.sheji.2018.03.001 [DOI] [Google Scholar]
  • 26.Kelly K, Caputo T. Community: a contemporary analysis of policies, programs, andPractices. Toronto, Ontario: University of Toronto Press, 2011. [Google Scholar]
  • 27.Donetto S, Pierri P, Tsianakas V, et al. . Experience-Based Co-design and healthcare improvement: Realizing participatory design in the public sector. The Design Journal 2015;18:227–48. 10.2752/175630615X14212498964312 [DOI] [Google Scholar]
  • 28.Mulvale G, Moll S, Miatello A, et al. . Co-designing services for youth with mental health issues: novel elicitation approaches. Int J Qual Methods 2019;18:160940691881624 10.1177/1609406918816244 [DOI] [Google Scholar]
  • 29.Bate P, Robert G. Bringing user experience to healthcare improvement: the concepts, methods and practices of experience-based design. Radcliffe Publishing: Oxford, 2007. [Google Scholar]
  • 30.Donetto S, Tsianakas V, Robert G, et al. . Using experience-based co-design (EBCD) to improve the quality of healthcare: mapping where we are now and establishing future directions. London: King’s College London, 2014. [Google Scholar]
  • 31.Sanders EB-N, Stappers PJ, Probes SP. Probes, toolkits and prototypes: three approaches to making in codesigning. CoDesign 2014;10:5–14. 10.1080/15710882.2014.888183 [DOI] [Google Scholar]
  • 32.Gonzalez M, Phoenix M, Saxena S, et al. . Strategies used to engage hard-to-reach populations in childhood disability research: a scoping review. Disabil Rehabil 2020:1–13. 10.1080/09638288.2020.1717649 [DOI] [PubMed] [Google Scholar]
  • 33.Black A, Strain K, Wallsworth C, et al. . What constitutes meaningful engagement for patients and families as partners on research teams? J Health Serv Res Policy 2018;23:158–67. 10.1177/1355819618762960 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.de Freitas C, Martin G. Inclusive public participation in health: policy, practice and theoretical contributions to promote the involvement of marginalised groups in healthcare. Soc Sci Med 2015;135:31–9. 10.1016/j.socscimed.2015.04.019 [DOI] [PubMed] [Google Scholar]
  • 35.Richards DP, Jordan I, Strain K, et al. . Patient partner compensation in research and health care: the patient perspective on why and how. Patient Exp J 2018;5:6–12. 10.35680/2372-0247.1334 [DOI] [Google Scholar]
  • 36.Bovaird T. Beyond engagement and participation: user and community coproduction of public services. Public Adm Rev 2007;67:846–60. 10.1111/j.1540-6210.2007.00773.x [DOI] [Google Scholar]
  • 37.Loeffler E, Bovaird T. User and community co-production of public services: what does the evidence tell us? Int J Public Admin 2016;39:1006–19. [Google Scholar]
  • 38.Palmer VJ, Weavell W, Callander R, et al. . The participatory Zeitgeist: an explanatory theoretical model of change in an era of coproduction and codesign in healthcare improvement. Med Humanit 2019;45:247–57. 10.1136/medhum-2017-011398 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mulvale G, Green J, Miatello A, et al. . Finding harmony within dissonance: engaging patients, family/caregivers and service providers in research to fundamentally restructure relationships through integrative dynamics. Health Expect 2020. 10.1111/hex.13063. [Epub ahead of print: 11 Jun 2020]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Shapiro D. Negotiating the Nonnegotiable: how to resolve your most emotionally charged conflicts. New York, NY: Penguin, 2016. [Google Scholar]
  • 41.Piper D, Iedema R, Gray J, et al. . Utilizing experience-based co-design to improve the experience of patients accessing emergency departments in New South Wales public hospitals: an evaluation study. Health Serv Manage Res 2012;25:162–72. 10.1177/0951484812474247 [DOI] [PubMed] [Google Scholar]
  • 42.Bradwell P, Marr S. Making the most of collaboration: an international survey of public service co-design. London, UK: Demos, 2008. [Google Scholar]
  • 43.Iedema R, Merrick E, Piper D, et al. . Codesigning as a discursive practice in emergency health services: the architecture of deliberation. J Appl Behav Sci 2010;46:73–91. 10.1177/0021886309357544 [DOI] [Google Scholar]
  • 44.Hickey G, Brearley S, Coldham T, et al. . Guidance on co-producing a research project. INVOLVE: Southampton, 2018. [Google Scholar]
  • 45.Staniszewska S, Brett J, Simera I, et al. . GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ 2017;358:j3453. 10.1136/bmj.j3453 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Pawson R, Tilley N. Realistic evaluation. London: Sage, 1997. [Google Scholar]
  • 47.Rolfe S. Combining theories of change and realist evaluation in practice: lessons from a research on evaluation study. Evaluation 2019;25:294–316. 10.1177/1356389019835229 [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES