Abstract
Background
An often‐hidden element in healthcare students' education is the pedagogy of public involvement, yet public participation can result in deep learning for students with positive impacts on the public who participate.
Objective
This article aimed to synthesize published literature reviews that described the impact of public participation in healthcare students' education.
Search Strategy
We searched MEDLINE, EMBASE, ERIC, PsychINFO, CINAHL, PubMed, JBI Database of Systematic Reviews and Implementation Reports, the Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects and the PROSPERO register for literature reviews on public participation in healthcare students' education.
Inclusion Criteria
Reviews published in the last 10 years were included if they described patient or public participation in healthcare students' education and reported the impacts on students, the public, curricula or healthcare systems.
Data Extraction and Synthesis
Data were extracted using a predesigned data extraction form and narratively synthesized.
Main Results
Twenty reviews met our inclusion criteria reporting on outcomes related to students, the public, curriculum and future professional practice.
Discussion and Conclusion
Our findings raise awareness of the benefits and challenges of public participation in healthcare students' education and may inform future research exploring how public participation can best be utilized in higher education.
Patient or Public Contribution
This review was inspired by conversations with public healthcare consumers who saw value in public participation in healthcare students' education. Studies included involved public participants, providing a deeper understanding of the impacts of public participation in healthcare students' education.
Keywords: curriculum, healthcare education, patient–public engagement, research synthesis
1. INTRODUCTION
The pedagogy of public involvement is an approach used to engage members of the public to actively participate in decision‐making around issues that affect their lives and communities. The aim is to empower individuals and communities with the knowledge, skills and opportunities to participate in or contribute to these decisions. 1 Emphasis is often placed on inclusivity, transparency and collaboration to foster partnerships between decision‐makers and the public. 1 , 2 In the context of healthcare students' education, the pedagogy of public involvement focuses on engaging patients, families and communities in teaching healthcare students.
Historically, patient involvement in teaching healthcare students has been a cornerstone of learning, where patients engage as storytellers or resources for students. However, over time this has evolved. 3 , 4 Recently, there has been a need to develop this involvement further towards an emerging pedagogy of public involvement throughout educational programmes. 2 , 3 Modigh et al. 5 argued that this shift is a moral responsibility and that those who pay for and/or receive healthcare ought to inform how it is provided.
This emerging pedagogy holds promise to impact students, the public, educational curricula and healthcare systems. Public involvement emphasizes patient‐centred care and acknowledges the expertise and perspectives of patients and their families. 1 , 2 , 6 It can promote the active involvement of patients and families in their own care, encourage shared decision‐making and foster the development of patient advocacy skills. 1 , 4 The pedagogy of public involvement in healthcare students' education can also enhance empathy, 7 , 8 communication skills, 9 reflective practices and critical thinking that encourages students to critically examine power dynamics, social inequities and ethical considerations in healthcare. Additionally, it has benefits for patients such as empowered participation in their own care, 6 and feeling like they have contributed to others. 10 Integrating the principles of public involvement into healthcare education may result in more patient‐centred, community‐oriented and socially responsible healthcare systems.
The pedagogy of public participation incorporates patient and public involvement across multiple touchpoints in healthcare students' education programmes. Patient involvement range includes little involvement, emerging involvement, growing involvement, collaboration or partnership. 2 , 4 , 11 While some promising evidence continues to emerge regarding the impact of public involvement in healthcare students' education, the literature lacks coherent, evidence‐based direction for how public participants, students and educators can best enhance teaching and learning experiences and ultimately improve healthcare experiences for all. Therefore, this umbrella review aimed to identify current, relevant and robust evidence on the impacts of public participation in healthcare students' education on students, public, curricula and healthcare systems.
2. METHODS
2.1. Design
In conducting our umbrella review, we followed best practices as outlined by the Centre for Reviews and Dissemination (CRD) 12 and the Joanna Briggs Institute (JBI) guidelines for systematic reviews and research syntheses. 13 While the JBI and CRD recommend that only systematic reviews be included in umbrella reviews, we purposefully included all types of reviews in our analysis.
2.2. Data sources and search strategy
An experienced librarian reviewed our literature search strategy in November 2022. We searched the following databases to identify English language reviews suitable for inclusion in this review: MEDLINE, EMBASE, ERIC, PsychINFO, CINAHL, PubMed, JBI Database of Systematic Reviews and Implementation Reports, the Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects and the PROSPERO register. A complete search strategy for all included databases can be found in Table S1.
2.3. Eligibility criteria
Reviews were included if they:
-
1.
focused on healthcare students, patients/public and/or healthcare educators;
-
2.
described patient or public participation in healthcare students' education;
-
3.
reported on the impact of patient/public participation in healthcare students' education, including impacts on students, patient/public, curricula or healthcare setting and
-
4.
were published from 2012 onwards.
Reviews were excluded if they:
-
1.
focused on non‐healthcare students or non‐healthcare educators;
-
2.
did not address the patient/public participants in healthcare students' education;
-
3.
were primary studies, commentaries, editorials or letters;
-
4.
had not been published within the last 10 years and
-
5.
were non‐English language reviews.
2.4. Selection of reviews
All search results were exported to Covidence to facilitate data management, organization and progress of this review. Studies were screened in two stages. First, study titles and abstracts were independently screened in duplicate by two reviewers. Screeners achieved an overall interrater agreement above 90% and all disagreements were resolved by a third reviewer. Second, full texts of studies included during title and abstract screening were subsequently screened in the same manner as title and abstract screening.
2.5. Quality appraisal
The reviews that met the inclusion criteria were assessed independently by two researchers using the Joanna Briggs Institute's Critical Appraisal Checklist for Systematic Reviews and Research Synthesis 13 with disagreements resolved through discussion. The checklist includes 11 assessment criteria that were each scored ‘yes’, ‘no’, ‘unclear’ or ‘not applicable’. We did not exclude reviews based on their quality appraisal scores.
2.6. Data extraction and synthesis
One reviewer independently extracted data from the included reviews and a second reviewer reviewed the extraction data for accuracy. Any disagreements in extraction were resolved through discussion. Due to the heterogeneity of the reviews, a meta‐analysis was not possible. We instead utilized a narrative synthesis approach to describe the impact public participation in healthcare students' education has on students, the public, curricula and healthcare systems.
3. RESULTS
Our electronic and hand searches generated 2564 records, which were screened for inclusion and 30 underwent secondary full‐text screening. Of these, 20 reviews were included in the final synthesis. Figure 1 displays the flow of literature throughout our review.
Figure 1.

Flow of literature through the umbrella review.
3.1. Review characteristics
Table 1 provides an overview of review characteristics. The included reviews were published between 2012 and 2022 with nine (45%) published since 2020. A wide range of studies were included in the reviews, with a minimum of 7 studies and a maximum of 59 studies assessed in a single review. When combined, a total of 49,014 articles were screened within the included literature reviews, and 418 were selected for synthesis.
Table 1.
Review characteristics.
| Characteristic | N = 20 |
|---|---|
| n (%) | |
| Type of review | |
| Systematic review | 12 (60%) |
| Scoping review | 2 (10%) |
| Literature review | 3 (15%) |
| Integrative review | 2 (10%) |
| Theoretical systematic review | 1 (5%) |
| Disciplines | |
| Multiple health and social care disciplines | 6 (30%) |
| Medicine | 7 (35%) |
| Nursing | 6 (30%) |
| Pharmacy | 1 (5%) |
| Year of publication | |
| 2012 | 1 (5%) |
| 2013 | 1 (5%) |
| 2014 | 1 (5%) |
| 2015 | 3 (15%) |
| 2016 | 2 (10%) |
| 2017 | 0 (0%) |
| 2018 | 2 (10%) |
| 2019 | 1 (5%) |
| 2020 | 3 (15%) |
| 2021 | 2 (10%) |
| 2022 | 4 (20%) |
3.2. Review quality
Table 2 presents the quality appraisal assessment for all included reviews. Most review articles reported sufficient information across most of the criteria; however, some authors failed to report whether the appraisal of studies included in the review was conducted independently by at least two authors; how or if data from the studies were systematically extracted, and how authors combined included studies in their results.
Table 2.
Quality appraisal scores.
| References | Review type | Review question | Inclusion criteria | Search strategy | Sources and resources | Appraisal criteria | Appraisal by two reviewers | Data extraction | Combining studies | Publication bias | Policy/practice recommendations | Future research |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| [32] | Literature review | Y | Y | Y | Y | Y | N | U | Y | N/A | Y | Y |
| [14] | Theoretical systematic review | Y | Y | Y | Y | Y | Y | U | Y | N/A | Y | Y |
| [15] | Systematic review | Y | Y | Y | N | Y | U | Y | Y | N/A | Y | Y |
| [16] | Systematic review | Y | Y | Y | Y | Y | Y | Y | U | N/A | Y | Y |
| [17] | Systematic review | Y | Y | Y | Y | Y | U | Y | U | N/A | Y | Y |
| [4] | Systematic review | Y | Y | Y | Y | Y | Y | Y | Y | N/A | Y | Y |
| [18] | Systematic review | Y | Y | Y | Y | N | N | U | U | N/A | Y | Y |
| [19] | Systematic review | Y | Y | Y | Y | Y | Y | U | Y | N/A | Y | Y |
| [20] | Scoping review | Y | Y | Y | Y | N | N | Y | Y | N/A | Y | Y |
| [21] | Integrative review | Y | Y | Y | Y | Y | Y | Y | Y | N/A | Y | Y |
| [22] | Integrative review | Y | Y | Y | Y | Y | U | U | U | N/A | Y | Y |
| [23] | Literature review | Y | Y | Y | Y | N | U | Y | U | N/A | Y | Y |
| [24] | Systematic review | Y | Y | Y | Y | Y | N | Y | U | N/A | Y | Y |
| [25] | Systematic review | Y | Y | Y | Y | Y | U | U | U | N/A | Y | Y |
| [26] | Systematic review | Y | Y | Y | Y | Y | Y | Y | U | N/A | Y | Y |
| [27] | Systematic review | Y | Y | Y | Y | Y | Y | Y | Y | N/A | Y | Y |
| [28] | Scoping review | Y | Y | Y | Y | Y | Y | Y | Y | N/A | Y | Y |
| [29] | Literature review | Y | Y | Y | Y | Y | U | Y | U | N/A | Y | Y |
| [30] | Systematic review | Y | Y | Y | Y | Y | Y | Y | U | N/A | Y | Y |
| [31] | Systematic review | Y | Y | Y | Y | Y | Y | Y | U | N/A | Y | Y |
Abbreviations: N, no; N/A, not applicable; U, unclear; Y, yes.
3.3. Reported outcomes
Table 3 presents a high‐level overview of study characteristics, Table 4 presents items related to review findings and Table 5 presents the key themes identified within the extracted data. The following narrative synthesis presents reported outcomes related to the impact on students, the public, healthcare and curricula.
Table 3.
Summary of review methods.
| References | Review type | Guidelines | Inclusion criteria | Exclusion criteria | Search terms | Databases | Appraisal tools |
|---|---|---|---|---|---|---|---|
| [32] | Literature review | No guidelines cited |
|
|
|
PubMed | Critical Appraisal Skills Programme (CASP) |
| [14] | Theoretical systematic review | STORIES 39 |
|
|
|
CINAHL ERIC PubMed Scopus |
Theoretical Quality Tool 40 |
| [15] | Systematic review | No guidelines cited |
|
|
|
CINAHL ERIC PubMed PsycINFO Scopus |
MMAT |
| [41] | Scoping review | Arskey and O'Malley 42 |
|
|
|
CINAHL Cochrane Database of Systematic Reviews Cochrane Controlled Trial Registry Database of Abstracts of Reviews of Effectiveness EBSCOhost Medline PsycINFO PubMed SABINET |
No appraisal tools mentioned |
| [16] | Systematic review | PRISMA |
|
|
|
CINAHL ERIC PubMed |
McMaster University Quantitative Critical Evaluation form; Qualitative Critical Evaluation form |
| [17] | Systematic review | PRISMA |
|
|
|
Cochrane Library Medline Web of Sciences |
Criteria for appraising qualitative research designed by Walsh and Downe; Medical Education Research Study Quality Instrument |
| [4] | Systematic review | STORIES 39 |
|
|
|
Cochrane Library Embase ERIC PsycINFO PubMed Scopus Web of Science |
Visual RAG ranking system |
| [18] | Systematic review | No guidelines cited |
|
|
|
Academic Search Complete CINAHL Education Full Text Health Source: Nursing Academic Edition Ovid |
No appraisal tools mentioned |
| [19] | Systematic review | PRISMA |
|
|
|
CINAHL PubMed |
No appraisal tools mentioned |
| [20] | Scoping review | PRISMA Extension for Scoping Reviews 43 |
|
|
|
Cochrane Central Register of Controlled Trials (CENTRAL) ERIC Embase Medline (OvidSP) PsycINFO (OvidSP) Web of Science |
No appraisal tools mentioned |
| [21] | Integrative review | No guidelines cited |
|
|
|
APA PsycNet Embase PsycINFO PsychNET PubMed/Medline Scopus Social Sciences Citation Index Web of Science |
Matrix method |
| [22] | Integrative review | Whittemore and Knafl 44 |
|
|
|
CINAHLERIC PubMed | MMAT |
| [23] | Literature review | No guidelines cited |
|
|
|
CINAHL Cochrane Library Embase ProQuest Central PubMed RISS (domestic Korean database for dissertation and other domestic journal publications) |
No appraisal tools mentioned |
| [24] | Systematic review | PRISMA |
|
|
|
British Education Index Campbell Collaboration Online Library CINAHL Cochrane Database of Systematic Reviews Database of Abstract of Reviews of Effects Embase Epub ERIC Medline PROSPERO Social Science Citation Index |
MMAT |
| [25] | Systematic review | No guidelines cited |
|
|
|
AUEI BREI CINAHL ERIC Medline | (CASP) Application Screening tools to reduce biases |
| [26] | Systematic review | PRISMA |
|
|
|
Embase Medline PubMed Scopus Web of Science |
Medical Education Research Study Quality Instrument |
| [45] | Meta‐narrative review | RAMESES guidelines |
|
|
|
CENTRAL ERIC PubMed Scopus Web of Science |
No appraisal tools mentioned |
| [27] | Systematic review | PRISMA |
|
|
|
Academic Search Complete CINAHL Cochrane ERIC OTseeker ProQuest Central PsycINFO PubMed |
CASP 46 and Moule et al. 47 |
| [48] | Scoping review | PRISMA Extension for Scoping Reviews 43 |
|
|
|
Embase ERIC Medline PsycINFO |
No appraisal tools mentioned |
| [28] | Scoping review | No guidelines cited |
|
|
|
CINAHL Cochrane Embase ERIC Medline PsycINFO |
Reilly et al. 49 |
| [29] | Literature review | No guidelines cited |
|
|
|
BIREME SciELO |
University of York NHS Centre for Reviews and Dissemination, 50 Greenhalgh 51 |
| [30] | Systematic review | PRISMA |
|
|
|
Scopus | MERSQI |
| [31] | Systematic review | PRISMA | MMAT 52 |
Abbreviations: EMR, Electronic Medical Records; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta‐Analyses; RAG, red, amber, green.
Table 4.
Summary of review findings.
| References | Discipline | Review question/aim | # studies reviewed | # studies included | Key findings |
|---|---|---|---|---|---|
| [32] | Health and social care disciplines |
|
2340 | 36 | Impact on students:
|
| [14] | Health and social care disciplines |
|
4848 | 7 | Impact on students:
|
| [15] | Medicine | To identify the scope of active patient involvement in medical education, the current knowledge gaps relating to rationale and motivation for involvement, recruitment and preparation, roles, learning outcomes and key procedural contributors. | 769 | 49 | Impact on students:
|
| [16] | Medicine | How does feedback from patients impact healthcare student's clinical skill development and learning? | 164 | 12 | Impact on students:
|
| [17] | Health and social care disciplines | What is reported in the literature regarding children and adolescents who work as standardized patients in health professional education? | 58 | 15 | Impact on students:
|
| [4] | Medicine |
|
6155 | 39 | Impact on students:
|
| [18] | Health and social care disciplines | What is the state of evidence for consumer involvement in the tertiary‐level education of psychiatrists, nurses, psychologists, social workers and occupational therapists? | 487 | 20 | Impact on students:
|
| [19] | Medicine | To systematically review published work that has explored terminally ill patient's views about being involved in undergraduate medical teaching | 1540 | 7 | Impact on students:
|
| [20] | Medicine |
|
821 | 41 | Impact on students:
|
| [21] | Nursing |
|
1736 | 14 | Impact on students:
|
| [22] | Nursing |
|
1782 | 22 | Impact on students:
|
| [23] | Medicine | To understand how participation in student‐run clinics influences the professional development of medical students and elucidate benefits for patients and students | 10,201 | 7 | Impact on students:
|
| [24] | Pharmacy | To explore the evidence relating to the involvement of patients in the education of student pharmacists, in terms of the nature, extent and outcomes of their contribution | 5369 | 12 | Impact on students:
|
| [25] | Health and social care disciplines |
|
1233 | 10 | Impact on students:
|
| [26] | Health and social care disciplines | To synthesize learning outcomes that result from the involvement of patients in the nutrition of dietetic student education and to consider if these interactions promote patient‐centred care | 6459 | 13 | Impact on students:
|
| [27] | Nursing | To synthesize published literature on service user involvement in undergraduate nursing education and examine how students are exposed to engagement with service users | 279 | 11 | Impact on students:
|
| [28] | Nursing |
|
3594 | 32 | Impact on students:
|
| [29] | Nursing |
|
708 | 8 | Impact on students:
|
| [30] | Medicine |
|
631 | 59 | Impact on patients/public/consumers:
|
| [31] | Nursing | To provide an accurate overview of community‐based education on undergraduate nursing student skills | 90 | 17 | Impact on students:
|
Table 5.
Summary of impact on students, impact on patients, potential impact on healthcare and considerations for curriculum.
| Impact on students | Impact on patients | Potential impact on healthcare | Considerations for curriculum | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| References | Increased awareness and understanding of patients' experiences | Greater empathy | Enhanced communication and interpersonal skills | Self‐reflection and personal growth | Increased confidence in supporting patients | Greater ability to address stigma and discrimination | Empowerment to be more active in care | Increased trust in healthcare providers | Shared decision making and collaborative care | Decreased stigma and discrimination | Enhanced understanding of recovery | Increased mental health and quality of life | Collaboration between patients and healthcare providers | Better healthcare service based on consumer participation | Increased accountability and transparency | Better care and increased satisfaction | Consumer‐informed healthcare policies | Decreased healthcare disparities | Integrating patient perspectives into education | Embedding consumer‐led initiatives into the curriculum | Incorporating real‐life case studies into learning | Utilizing patient‐ centred teaching strategies | Promoting patient advocacy and professionalism | Incorporating patients as teachers | Including recovery‐oriented practices | Enhancing cultural competence | Increasing communication and teamwork |
| [32]) | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||
| [14] | X | X | X | X | X | X | X | X | X | X | |||||||||||||||||
| [15] | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||||||||||
| [16] | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||||||||||
| [17] | X | X | X | X | X | X | |||||||||||||||||||||
| [4] | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||||||||||
| [18] | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||||||||||
| [19] | X | X | X | X | X | X | X | X | X | X | X | ||||||||||||||||
| [20] | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||||||||||
| [21] | X | X | X | X | X | X | X | X | |||||||||||||||||||
| [22] | X | X | X | X | X | X | X | ||||||||||||||||||||
| [23] | X | X | X | X | X | X | |||||||||||||||||||||
| [24] | X | X | X | X | X | X | X | X | |||||||||||||||||||
| [25] | X | X | X | X | |||||||||||||||||||||||
| [26] | X | X | X | X | |||||||||||||||||||||||
| [27] | X | X | X | X | X | ||||||||||||||||||||||
| [28] | X | X | X | X | |||||||||||||||||||||||
| [29] | X | X | X | X | X | X | X | X | |||||||||||||||||||
| [30] | X | X | |||||||||||||||||||||||||
| [31] | X | X | X | ||||||||||||||||||||||||
3.4. Impact on students
Of the 20 articles included in this review, all reported the impacts of public participation in healthcare students' education on students.
3.4.1. Increased awareness of patient's perspectives and experiences
Sixteen articles reported students developed an increased understanding of patient's perspectives and experiences by engaging with the public through their education. 4 , 14 , 15 , 16 , 18 , 19 , 20 , 22 , 23 , 25 , 26 , 27 , 28 , 29 , 31 , 32 For some, this awareness led to a reduction in the stigmatization of certain conditions such as mental illness. As a result of interacting with the public, students reported an increase in their awareness of patients' experiences with a variety of medical conditions. Interestingly, no articles reported on unconscious bias.
3.4.2. Greater empathy
Fourteen articles reported that students developed greater empathy for patients through their interactions with the public. 4 , 14 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 29 , 32 This included greater understanding and empathy for medical, social and cultural factors that often impact overall health and wellbeing. 22 , 23 , 24 , 32 By speaking with patients about their perspectives and experiences, students developed a greater awareness and empathy for a variety of challenges patients may face.
3.4.3. Enhanced communication and interpersonal skills
Enhanced communication and interpersonal skills were reported in 16 articles. 4 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 24 , 25 , 26 , 29 , 31 , 32 Students demonstrated improved communication skills and stronger self‐confidence and critical thinking when communicating with patients. 31 Some students found they communicated using less professional jargon 28 or they more easily discussed difficult topics or sensitive information. 18
3.4.4. Self‐reflection and personal growth
Student self‐reflection and personal growth were identified in four articles as impacts of public participation in healthcare students' education. 16 , 20 , 27 , 32 Khalife et al. 20 explained that self‐reflection following interactions with the public allowed healthcare students to accept patients' needs and improve as practitioners. Scammell et al. 27 identified that patient interactions followed by self‐reflection gave healthcare students better insights into their goals and future careers.
3.4.5. Increased confidence in supporting patients
Eight articles discussed the impacts of public involvement in healthcare students' education on developing students' confidence to support patients. 15 , 17 , 22 , 24 , 26 , 29 , 31 , 32 When given the opportunity to work with members of the public, students utilized skills they learned throughout their education in real‐world settings. This increased their overall confidence in their ability to provide competent and supportive care to serve the needs of their patients. 14
3.4.6. Greater ability to address stigma and discrimination
Seven articles identified that stigma and discrimination are present in healthcare settings and public involvement in healthcare students' education is one way to address it. 14 , 18 , 21 , 22 , 23 , 24 , 32 Arblaster et al. 32 discussed the many forms of stigma people face, such as mental health issues, poor or unequal living circumstances and adversity to recovery, and suggested students can address stigma and discrimination by supporting social inclusion, challenging stigmatizing attitudes, promoting positive understandings of peoples struggles and partnering with communities. Community engagement and exposure to the patients' struggles provide students with some knowledge and experiences to address stigma and discrimination.
3.5. Impact on the public
Sixteen of the 20 articles reported outcomes of the impact of public participation in healthcare students’ education on the public.
3.5.1. Empowered to be more active in care
Ten articles reported that when the public participated in healthcare students' education, they became more actively involved in their own care. 4 , 15 , 16 , 18 , 19 , 20 , 24 , 28 , 29 , 32 Engaging with healthcare students resulted in the public developing an increased sense of empowerment to be more involved in making medical decisions.
3.5.2. Increased trust in healthcare providers
Eleven articles reported that when the public interacted with healthcare students it resulted in increased trust between the public and healthcare providers. 4 , 14 , 15 , 16 , 17 , 19 , 20 , 23 , 27 , 28 , 32 These interactions also improved patient satisfaction 4 , 14 , 15 , 16 , 17 , 23 , 26 , 27 and improved communication between healthcare providers and the public. 16 , 17 , 19 , 20
3.5.3. Shared decision‐making and collaborative care
Ten articles reported that public engagement in healthcare students' education resulted in shared decision‐making and more collaborative care. 4 , 14 , 15 , 16 , 17 , 18 , 20 , 28 , 30 , 32 Shared decision‐making can empower patients when they are consulted within their care. 16 Arblaster et al. 32 explained that public consumers of healthcare feel supported and empowered by collaborative care approaches and being involved in students' education.
3.5.4. Decreased stigma and discrimination
Five articles reported on how public participation in healthcare students' education impacted public experiences of stigma and discrimination. 18 , 21 , 29 , 30 , 32 The decline of stigma and discrimination was described previously regarding its impact on students; however, this was also identified as an impact on the public. Arblaster et al. 32 acknowledged that the most common outcome of consumer participation in healthcare education was a decrease in stigma. Public involvement in education actively decreased the stigma and discrimination against members of the public because healthcare students learned how to consider patient perspectives during their education.
3.5.5. Enhanced understanding of recovery
Three articles reported that when patients interacted with healthcare students, patients developed an enhanced understanding of their recovery. 4 , 27 , 32 Public participation in healthcare students’ education contributed to moving to recovery‐orientated practice specifically for those with mental health concerns. 32
3.5.6. Increased mental health and quality of life
Two articles reported on how patient participation in healthcare students' education resulted in patients having an increased sense of mental health and quality of life. 29 , 32 Mental health needs to be more readily addressed within healthcare, and public involvement in education may be one way to address this need. When students developed skills to hear and respond to patients and their experiences, patients felt well taken care of and not discouraged or hindered by their mental health. However, these benefits were not universal. Terry 28 reported that patient engagement in healthcare students' education was stressful. 28
3.6. Potential impact on healthcare
Sixteen out of 20 reviews included in this study highlighted the potential impact that public participation in healthcare students’ education has on healthcare more broadly than just on individual patients and students.
3.6.1. Collaboration between patients and healthcare providers
Seven articles reported on the potential of public participation in healthcare students’ education to increase collaboration between patients and healthcare providers more broadly. 4 , 14 , 16 , 19 , 20 , 25 , 32 Gordon et al. 4 found that the collaboration between patients and healthcare providers had the potential to improve healthcare overall.
3.6.2. Better healthcare service based on consumer participation
Seven articles reported that public participation in healthcare students' education resulted in better healthcare services created based on consumer participation. 4 , 15 , 16 , 18 , 19 , 20 , 32 Patient views of the impact of being involved in the education of healthcare students included personal fulfilment in the belief they were improving the healthcare system. 14 Others reported the involvement of patients led to improved outcomes 15 and an increased understanding of patient‐centred 4 holistic care, 32 potentially impacting healthcare services.
3.6.3. Increased accountability and transparency
The theme of accountability and transparency was present in one article. Arblaster et al. 32 took a comprehensive view regarding accountability and transparency within a patient‐worker collaborative model and found where patients were teaching and advising on their health to students it allowed for younger patients to be heard by those who are usually in a place of power. When patients are more involved in their care, healthcare providers can have a higher sense of accountability to ensure they share knowledge and account for the patient's perspective. 32
3.6.4. Better care and increased satisfaction
Ten articles reported that when the public participated in healthcare students’ education, they received better care, which resulted in increased satisfaction. 4 , 15 , 16 , 17 , 18 , 20 , 23 , 24 , 26 , 32 When patients participated in teaching, healthcare providers learned patient‐centred care and holistic care. The overall increase in patient satisfaction with their care allows greater confidence in healthcare systems potentially making healthcare better all around.
3.6.5. Consumer‐informed healthcare policies
Eight articles reported that when the public participates in healthcare students' education, this can potentially lead to more consumer‐informed healthcare policies. 15 , 20 , 21 , 24 , 25 , 27 , 29 , 32 The combined effort of patients and providers to create and influence new policies is notably beneficial. Perry et al. 25 addressed that a large interest has been placed on policy creation through a collaborative model with users of healthcare. Further, Scammell et al. 27 indicated that in places like the UK nursing policy development often involves engagement with healthcare users for advisement and recommendations.
3.6.6. Decreased healthcare disparities
Five articles reported the potential of public participation in healthcare students' education to help decrease healthcare disparities. 15 , 16 , 18 , 19 , 32 Dijk et al. 14 highlighted that Indigenous patient populations, transgender health and cancer disparities were better understood because of patient engagement in education. 14 Notably, the participation of mental health patients in the education of healthcare students helped challenge stigma and discrimination, thus promoting social inclusion and positive understandings. 32
3.7. Considerations for curriculum
Of the 20 articles included in this review, 12 reported on future curriculum considerations for public participation in healthcare students' education.
3.7.1. Integrating patient perspectives into education
Nine articles suggested the need to further integrate patient perspectives into healthcare students' education. 4 , 14 , 15 , 16 , 18 , 19 , 20 , 21 , 32 Integration of patient narratives and perspectives into students’ education can advance student learning. 14 For example, involving patients' lived experiences in mental health nursing education facilitated a new level of understanding for students. 20 However, studies have identified the need for future research to determine the theoretical mechanisms through which patient involvement promotes learning. 31 Another way in which patient perspectives may be integrated into education is the involvement of patients in learner assessment. However, some barriers may influence such involvement, including language and reading comprehension challenges and the nonreadiness of educational programmes to partner with patients. 19 To benefit from patient perspectives in education, such barriers require addressing.
3.7.2. Embedding consumer‐led initiatives into the curriculum
Nine articles highlighted the potential benefits of embedding consumer‐led initiatives into the curriculum. 4 , 14 , 15 , 16 , 18 , 19 , 20 , 21 , 32 Consumer participation across the design, planning and delivery stages of education, including serving as a learning resource, being a collaborator, assessing learning or helping with the development of teaching materials, with patients objecting to voyeurism and tokenism. 32 Finch et al. 16 found that when patients give feedback on students' clinical skills it has a positive impact on learning.
3.7.3. Incorporating real‐life case studies into learning
Nine articles suggested that real‐life case studies based on patient experience be incorporated into healthcare students' education. 15 , 16 , 18 , 22 , 23 , 24 , 32 Dijk et al. 15 explained that while simulations or practice with an inanimate body is useful, practice on real patients often results in more authenticity in care and provides better guidance with skills such as physical examinations. McCray et al. 23 reported on the positive impact on student academic performance through the incorporation of student‐run clinic experiences in medical education. The use of patients as simulated patients has been reported in various healthcare professions education contexts such as with student pharmacists. 24
3.7.4. Utilizing patient‐centred teaching strategies
Six articles reported on the potential of utilizing patient‐centred teaching strategies when teaching healthcare students. 4 , 14 , 15 , 16 , 19 , 20 The rationale of exposing students to patient voices is to support the development of patient‐centred professional identity and the understanding of patient‐centredness. 14 , 15 Gordon et al. 4 took an in‐depth look into the outcomes of utilizing teaching strategies that involve putting the patient first and suggested benefits to learners, such as a greater understanding of holistic and patient‐centred care. Khalife et al. 20 advocated for a competency‐based medical education framework that mandates students be exposed to patient‐centred education to prepare them to meet the patient's needs.
3.7.5. Promoting patient advocacy and professionalism
The promotion of patient advocacy as a part of professionalism was present in three articles. 16 , 20 , 32 Arblaster et al. 32 reported that personal contact of healthcare students with mental health patients under power‐equalizing conditions was key to stigma reduction and advocating for this patient population. Khalife et al. 20 reported that patient involvement in assessment approaches in competency‐based education could enhance learner advocacy competencies.
3.7.6. Incorporating patients as teachers
The concept of incorporating patients as teachers was present in one article. 4 Gordon et al. 4 highlighted that the involvement of patients as educators benefited students, including increased confidence and comfort working with patients; it also benefited patients as they felt they made a valuable and meaningful impact on healthcare. Further, Gordon et al. 4 stated that using patients as teachers is most effective when standardized assessment checklists and scoring criteria are clear.
3.7.7. Including recovery‐oriented practices
Our review identified recovery‐oriented practices in two articles. 18 , 32 Arblaster et al. 32 evaluated evidence regarding the effectiveness of patient participation in producing graduates with the ability for recovery‐oriented occupational therapy practice; although the authors cautioned that minimal evidence currently exists, they highlighted that patient participation is a way to exemplify recovery‐oriented practice and that education should continue to involve patients. Happell et al. 18 provide similar findings as they suggested that the consistent involvement of educators and patients within healthcare students' education allows students to gain a better understanding of multiple ways and paths of recovery.
3.7.8. Enhancing cultural competence
Six articles reported the importance of enhancing cultural competence in healthcare students' education. 4 , 15 , 18 , 19 , 21 , 32 The enhancement of cultural competencies has played a more vital role in recent years as healthcare and several other industries strive to diversify and understand diversity more readily. Dijk et al. 15 stated that one of the rationales for involving patients in medical education is the multicultural learning environment it produces that allows students to practice social accountability and inclusion.
3.7.9. Increasing communication and teamwork
Seven articles suggested the need for and importance of increasing communication and teamwork within healthcare students' education. 4 , 14 , 15 , 18 , 19 Gordon et al. 4 provide evidence that communication and teamwork are interlinked and a vital piece of preparing both students and healthcare users to be present within clinical spaces. Skills such as professionalism, communication, patient‐centredness and holistic care can effectively be learned when patients and students communicate and work together as a team as part of educational interventions. 4
4. DISCUSSION
In conducting this umbrella review we aimed to identify current, relevant and robust evidence on the impacts of public participation in healthcare students; education. Given the educational lens of our research question, it is unsurprising that all reviews we synthesized demonstrated an impact on healthcare student learning. Specifically, increased awareness of medical conditions and their effects on actual patients improved patient‐centred communication, invigorated motivation and engagement in their own training and increased empathy. Empathy is considered a core skill for most health professionals and can enhance therapeutic communication, improve patient health outcomes 33 and influence health professional wellbeing. 34 Unfortunately, research shows waning empathy amongst health professorial students as their education progresses 34 and how empathy is not always enacted by health professionals. 33 Additionally, there remains no consensus on which of the mechanisms used and studied for empathy education are most appropriate or effective. 35 Our umbrella review has uncovered that while empathy teaching was not the original focus of these individual reviews, patient involvement in health professional education is a powerful mechanism to enhance empathy skills necessary for practice.
Public members who participated in student training identified greater satisfaction with care and increased understanding of their condition and treatment. Participation in healthcare student education fostered more trusting relationships with healthcare professionals with additional observed ripple effects on self‐advocacy and self‐management. Kangasjarvi et al. 36 interviewed patients as teachers to understand more about their experiences participating in healthcare student education and noted that patients felt ‘re‐humanized’ with a new sense of empowerment to act for system changes. Patients have also emphasized how future graduates must spend even more time building trust with patients with increased transparency in treatment decision‐making. 37
How public participation in healthcare education ultimately exerts long‐term impacts on healthcare and associated systems is difficult to clearly discern; such downstream and sustained effects are subject to multiple shifting influences. 38 Nevertheless, our findings indicate changes in patient‐centred treatment decision‐making and patient safety are achievable through these educational initiatives and partnerships.
Integration of patient experiences into healthcare students' education promoted student development of skills necessary for patient care, including favourable professional attitudes and behaviours. Educators are increasingly examining how optimal conditions for public participation can be created, including addressing public member ideas for their own instructional professional development. 3
Given the stated expectations of many health professional programmes to train graduates equipped to serve society, our findings of public participation are encouraging, but these opportunities must be maintained, expanded, and adopted by more education programmes across health professional disciplines. Most experiences reported in our review are amongst physicians and nurses in training. These students represent a large, but incomplete membership of the healthcare workforce who ultimately interface with the public. Robust evaluation plans and strategies to overcome resource constraints associated with public participation in the curriculum are needed. 1
4.1. Strengths and limitations
To the best of our knowledge, this is the first umbrella review to synthesize the impact of public participation in healthcare students' education on students, the public, healthcare systems and curricula. While a systematic and comprehensive search was conducted, we limited our search to English language publications that were published in the last 10 years; therefore, we may have failed to capture some key literature relevant to this review. The heterogeneity of review types, disciplines and reported outcomes made it difficult to synthesize review findings in a generalizable manner. We chose to purposefully include reviews conducted across healthcare professions noting that the findings may not be as easily transferable to specific contexts. However, as healthcare professions are increasingly relying on public participation in healthcare education, a review that synthesizes evidence across disciplines has a unique value in terms of the transferability of knowledge.
4.2. Recommendations for future research
We encourage future research across healthcare disciplines to identify more unified platforms to facilitate public participation in healthcare students' education. A clear definition of public involvement in healthcare students' education is needed to gain conceptual clarity of what this entails (such as patient vs. public vs. consumer). Future research to explore and evaluate additional methods of integrating patient and public participation in healthcare students' education is warranted. Further, longitudinal research is needed to evaluate the persistence of impacts on students, patients/public and healthcare systems.
5. CONCLUSION
Public participation in healthcare students' education has positive impacts on students, the public, curricula and healthcare systems. Findings from this review offer critical insight for healthcare educators to consider avenues for greater collaboration amongst students, patients and the public.
AUTHOR CONTRIBUTIONS
Lorelli Nowell: Conceptualization; investigation; writing—original draft; methodology; validation; visualization; writing—review and editing; formal analysis; project administration; supervision; resources. Bryn Keogh: Writing—original draft; formal analysis. Eleftheria Laios: investigation; writing—original draft; validation; conceptualization; formal analysis. Lisa Mckendrick‐Calder: Conceptualization; investigation; writing—original draft; validation; formal analysis. Whitney Lucas Molitor: Conceptualization; investigation; writing—original draft; validation; formal analysis. Kerry Wilbur: Conceptualization; investigation; validation; formal analysis.
CONFLICT OF INTEREST STATEMENT
The authors declare no conflict of interest.
Supporting information
Supporting information.
ACKNOWLEDGEMENTS
The authors gratefully acknowledge the International Society for the Scholarship of Teaching and Learning International Collaborative Writing Group where the authors gathered to develop this work. Bryn Keogh was supported by an Alberta Innovates Summer Research Studentship.
Nowell L, Keogh B, Laios E, Mckendrick‐Calder L, Molitor WL, Wilbur K. Public participation in healthcare students' education: an umbrella review. Health Expect. 2024;27:e13974. 10.1111/hex.13974
DATA AVAILABILITY STATEMENT
Data sharing is not applicable to this article as no new data were created or analyzed in this study.
REFERENCES
- 1. Eijkelboom C, Brouwers M, Frenkel J, et al. Twelve tips for patient involvement in health professions education. Patient Educ Couns. 2023;106:92‐97. [DOI] [PubMed] [Google Scholar]
- 2. Regan de Bere S, Nunn S. Towards a pedagogy for patient and public involvement in medical education. Med Educ. 2016;50(1):79‐92. 10.1111/medu.12880 [DOI] [PubMed] [Google Scholar]
- 3. Cullen M, Cadogan C, George S, et al. Key stakeholders' views, experiences and expectations of patient and public involvement in healthcare professions' education: a qualitative study. BMC Med Educ. 2022;22:305. 10.1186/s12909-022-03373-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Gordon M, Gupta S, Thornton D, Reid M, Mallen E, Melling A. Patient/service user involvement in medical education: a best evidence medical education (BEME) systematic review: BEME Guide No. 58. Med Teach. 2020;42(1):4‐16. 10.1080/0142159X.2019.1652731 [DOI] [PubMed] [Google Scholar]
- 5. Modigh A, Sampaio F, Moberg L, Fredriksson M. The impact of patient and public involvement in health research versus healthcare: a scoping review of reviews. Health Policy. 2021;125(9):1208‐1221. 10.1016/j.healthpol.2021.07.008 [DOI] [PubMed] [Google Scholar]
- 6. Miller T, Reihlen M. Assessing the impact of patient‐involvement healthcare strategies on patients, providers, and the healthcare system: a systematic review. Patient Educ Couns. 2023;110:107652. 10.1016/j.pec.2023.107652 [DOI] [PubMed] [Google Scholar]
- 7. Hache C, Honoré S, Hache G. Active involvement of patients in pharmacist education has a positive impact on students' perspective: a pilot study. BMC Med Educ. 2020;20(1):322. 10.1186/s12909-020-02241-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Romme S, Smeets HWH, Bosveld MH, van den Besselaar H, Kline C, Van Bokhoven MA. Involving patients in undergraduate health professions education: what's in it for them? Patient Educ Couns. 2022;105(7):2190‐2197. 10.1016/j.pec.2021.12.014 [DOI] [PubMed] [Google Scholar]
- 9. Keating D, McWilliams S, Hynes C, Purcell A, Clarke M, Strawbridge J. Patients and caregivers helping to shape the undergraduate pharmacy mental health curriculum. Am J Pharm Educ. 2019;83(9):7138. 10.5688/ajpe7138 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Ward K, Stanyon M, Ryan K, Dave S. Power, recovery and doing something worthwhile: A thematic analysis of expert patient perspectives in psychiatry education. Health Expect. 2022;25(2):549‐557. 10.1111/hex.13375 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Towle A, Bainbridge L, Godolphin W, et al. Active patient involvement in the education of health professionals. Med Educ. 2010;44(1):64‐74. 10.1111/j.1365-2923.2009.03530.x [DOI] [PubMed] [Google Scholar]
- 12. Centre for Reviews and Dissemination . Systematic Reviews: CRD's Guidance for Undertaking Reviews in Health Care. Centre for Reviews and Dissemination; 2009. [Google Scholar]
- 13. Aromataris E, Fernandez R, Godfrey CM, Holly C, Khalil H, Tungpunkom P. Summarizing systematic reviews. Int J Evid‐Based Healthc. 2015;13(3):132‐140. 10.1097/xeb.0000000000000055 [DOI] [PubMed] [Google Scholar]
- 14. Bennett‐Weston A, Gay S, Anderson ES. A theoretical systematic review of patient involvement in health and social care education. Adv Health Sci Educ. 2023;28(1):279‐304. 10.1007/s10459-022-10137-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Dijk SW, Duijzer EJ, Wienold M. Role of active patient involvement in undergraduate medical education: a systematic review. BMJ Open. 2020;10(7):e037217. 10.1136/bmjopen-2020-037217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Finch E, Lethlean J, Rose T, et al. How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review. Med Teach. 2018;40(3):244‐252. 10.1080/0142159X.2017.1401218 [DOI] [PubMed] [Google Scholar]
- 17. Gamble A, Bearman M, Nestel D. A systematic review: children & adolescents as simulated patients in health professional education. Adv Simul. 2016;1:1. 10.1186/s41077-015-0003-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Happell B, Byrne L, McAllister M, et al. Consumer involvement in the tertiary‐level education of mental health professionals: a systematic review. Int J Ment Health Nurs. 2014;23(1):3‐16. 10.1111/inm.12021 [DOI] [PubMed] [Google Scholar]
- 19. Harris DG, Coles B, Willoughby HM. Should we involve terminally ill patients in teaching medical students? A systematic review of patient's views. BMJ Support Palliat Care. 2015;5(5):522‐530. 10.1136/bmjspcare-2013-000535 [DOI] [PubMed] [Google Scholar]
- 20. Khalife R, Gupta M, Gonsalves C, et al. Patient involvement in assessment of postgraduate medical learners: a scoping review. Med Educ. 2022;56(6):602‐613. 10.1111/medu.14726 [DOI] [PubMed] [Google Scholar]
- 21. Kang KI, Joung J. Outcomes of consumer involvement in mental health nursing education: an integrative review. Int J Environ Res Public Health. 2020;17(18):6756. 10.3390/ijerph17186756 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Marcilla‐Toribio I, Moratalla‐Cebrián ML, Bartolomé‐Guitierrez R, Cebada‐Sánchez S, Galán‐Moya EM, Martínez‐Andrés M. Impact of service‐learning educational interventions on nursing students: an integrative review. Nurse Educ Today. 2022;116:105417. 10.1016/j.nedt.2022.105417 [DOI] [PubMed] [Google Scholar]
- 23. McCray E, Atkinson WR, McCray CE, et al. Impact of medical student participation in student‐run clinics on education, residency selection, and patient care: a review of selected articles. Cureus. 2022;14(6):e26183. 10.7759/cureus.26183 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Nguyen W, O'Reilly CL, Moles RJ, et al. A systematic review of patient interactions with student pharmacists in educational settings. J Am Pharm Assoc. 2021;61(6):678‐693. 10.1016/j.japh.2021.08.014 [DOI] [PubMed] [Google Scholar]
- 25. Perry J, Watkins M, Gilbert A, Rawlinson J. A systematic review of the evidence on service user involvement in interpersonal skills training of mental health students. J Psychiatr Ment Health Nurs. 2013;20(6):525‐540. 10.1111/j.1365-2850.2012.01955.x [DOI] [PubMed] [Google Scholar]
- 26. Porter J, Kellow N, Anderson A, et al. Patient involvement in education of nutrition and dietetics students: a systematic review. Nutrients. 2019;11(11):2798. 10.3390/nu11112798 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Scammell J, Heaslip V, Crowley E. Service user involvement in preregistration general nurse education: a systematic review. J Clin Nurs. 2016;25(1‐2):53‐69. 10.1111/jocn.13068 [DOI] [PubMed] [Google Scholar]
- 28. Suikkala A, Koskinen S, Leino‐Kilpi H. Patients' involvement in nursing students' clinical education: A scoping review. Int J Nurs Stud. 2018;84:40‐51. 10.1016/j.ijnurstu.2018.04.010 [DOI] [PubMed] [Google Scholar]
- 29. Terry J. Service user involvement in pre‐registration mental health nurse education classroom settings: a review of the literature. J Psychiatr Ment Health Nurs. 2012;19(9):816‐829. 10.1111/j.1365-2850.2011.01858.x [DOI] [PubMed] [Google Scholar]
- 30. Vaughn JL, Rickborn LR, Davis JA. Patients' attitudes toward medical student participation across specialties: a systematic review. Teach Learn Med. 2015;27(3):245‐253. 10.1080/10401334.2015.1044750 [DOI] [PubMed] [Google Scholar]
- 31. Zeydani A, Atashzadeh‐Shoorideh F, Abdi F, Hosseini M, Zohari‐Anboohi S, Skerrett V. Effect of community‐based education on undergraduate nursing students' skills: a systematic review. BMC Nurs. 2021;20:233. 10.1186/s12912-021-00755-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Arblaster K, Mackenzie L, Willis K. Mental health consumer participation in education: a structured literature review. Aust Occup Therap J. 2015;62(5):341‐362. 10.1111/1440-1630.12205 [DOI] [PubMed] [Google Scholar]
- 33. Moudatsou M, Stavropoulou A, Philalithis A, Koukouli S. The role of empathy in health and social care professionals. Healthcare. 2020;8(1):26. 10.3390/healthcare8010026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Everson N, Levett‐Jones T, Pitt V. The impact of educational interventions on the empathic concern of health professional students: a literature review. Nurse Educ Pract. 2018;31:104‐111. 10.1016/j.nepr.2018.05.015 [DOI] [PubMed] [Google Scholar]
- 35. Bas‐Sarmiento P, Fernández‐Gutiérrez M, Baena‐Baños M, Romero‐Sánchez JM. Efficacy of empathy training in nursing students: a quasi‐experimental study. Nurse Educ Today. 2017;59:59‐65. 10.1016/j.nedt.2017.08.012 [DOI] [PubMed] [Google Scholar]
- 36. Kangasjarvi E, Forsey J, Simpson JS, Ng SL. “We're back in control of the story and we're not letting anyone take that away from usw”: patient teacher programs as means for patient emancipation. Adv Health Sci Educ. Published online July 16, 2023. 10.1007/s10459-023-10255-6 [DOI] [PubMed] [Google Scholar]
- 37. Jeyakumar T, Younus S, Zhang M, et al. Preparing for an artificial intelligence‐enabled future: patient perspectives on engagement and health care professional training for adopting artificial intelligence technologies in health care settings. J Med Internet Res Artif Intell. 2023;2:e40973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Zimlichman E, Nicklin W, Aggarwal R, Bates DW. Health care 2030: the coming transformation. N Engl J Med. 2021;2(2):1‐11. [Google Scholar]
- 39. Gordon M, Gibbs T. STORIES statement: publication standards for healthcare education evidence synthesis. BMC Med. 2014;12:143. 10.1186/s12916-014-0143-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Hean S, Anderson L, Green C, John C, Pitt R, O'Halloran C. Reviews of theoretical frameworks: challenges and judging the quality of theory application. Medl Teach. 2016;38(6):613‐620. 10.3109/0142159X.2015.1075648 [DOI] [PubMed] [Google Scholar]
- 41. Dogba M, Dossa AR, Breton E, et al. Using information and communication technologies to involve patients and the public in health education in rural and remote areas: a scoping review. BMC Health Serv Res. 2019;19:128. 10.1186/s12913-019-3906-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19‐32. 10.1080/1364557032000119616 [DOI] [Google Scholar]
- 43. Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA‐ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467‐473. 10.7326/M18-0850 [DOI] [PubMed] [Google Scholar]
- 44. Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005;52(5):546‐553. 10.1111/j.1365-2648.2005.03621.x [DOI] [PubMed] [Google Scholar]
- 45. Rowland P, Anderson M, Kumagai AK, McMillan S, Sandhu VK, Langlois S. Patient involvement in health professionals’ education: A meta‐narrative review. Adv Health Sci Educ. 2019;24:595‐617. 10.1007/s10459-018-9857-7 [DOI] [PubMed] [Google Scholar]
- 46. Heyvaert M, Hannes K, Maes B, Onghena P. Critical appraisal of mixed methods studies. J Mixed Methods Res. 2013;7(4):302‐327. [Google Scholar]
- 47. Moule P, Pontin D, Gilchrist M, Ingram R. Critical appraisal framework. 2003. Retrieved January 13, 2024.
- 48. Soon YE, Murray CM, Aguilar A, Boshoff K. Consumer involvement in university education programs in the nursing, midwifery, and allied health professions: a systematic scoping review. Int J Nurs Stud. 2020;109:103619. 10.1016/j.ijnurstu.2020.103619 [DOI] [PubMed] [Google Scholar]
- 49. Reilly S, Xie C, Jacobs S, Challis D. Examining the state of adult social care research 1990‒2001: a systematic synthesis of research methods and quality. Evidence & Policy. 2008;4(3):155‐182. 10.1332/174426408X355542 [DOI] [Google Scholar]
- 50. Centre for Reviews and Dissemination . University of York. 2001. https://www.york.ac.uk/crd/guidance/
- 51. Greenhalgh T. How to read a paper: papers that summarise other papers (systematic reviews and meta‐analyses. BMJ. 1997;315(7109):672‐675. 10.1136/bmj.315.7109.672 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Hong QN, Fàbregues S, Bartlett G. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Educ Inf. 2018;34(4):285‐291. 10.3233/EFI-180221 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supporting information.
Data Availability Statement
Data sharing is not applicable to this article as no new data were created or analyzed in this study.
