Abstract
Background
Youth and families play an indispensable role in health research, given their unique lived experiences and expertise. Aligning research with patients’ needs, values, and preferences can significantly enhance its relevance and impact; however, recent research has highlighted various challenges and risks associated with youth and family engagement in health research. These challenges encompass the perils of tokenism, power imbalances and dynamics, questioning the motives behind engagement, and limited accessibility to patient-friendly training for patient partners, as well as inadequate training on patient engagement for researchers and the absence of equitable engagement tools. To address these risks and challenges, different patient engagement models, theories, frameworks, and guiding principles have been developed and adopted; to date, however, their transferability to youth- and family-specific engagement in research has been limited.
Objective
The objectives of this project are (1) to determine the extent of the literature on the application of patient engagement models, theories, frameworks, and guiding principles in the context of youth-specific research; and (2) to determine how meaningful the key components and constructs of these models, theories, frameworks, and guiding principles are to youth and their family members.
Methods
This project will use an integrated knowledge translation approach and consists of 2 phases: (1) a scoping review to identify patient engagement models, theories, frameworks and guiding principles in youth research; and (2) a qualitative descriptive study using one-on-one semistructured interviews with youth and family members to understand their conceptualization of meaningful engagement in health research. For phase 1, the following databases were searched: Medline, CINAHL, EMBASE, PsycINFO, and the Cochrane Central Register of Controlled Trials. Literature from 2013 to August 28, 2024, was captured. Primary studies using a patient engagement in research model, theory, or framework, or guiding principles, in youth will be included. The risk of bias of included studies will not be assessed. Extracted data will be quantitatively summarized using numerical counts and qualitatively using content analysis. For phase 2, we will recruit 9 to 17 youth and 9 to 17 family members. Transcripts will be analyzed using an inductive approach outlined by Braun and Clarke.
Results
The project has received funding from the Canadian Institutes of Health Research. A 9-member integrated knowledge translation panel consisting of 6 youth and 3 family members has been established.
Conclusions
The findings from this study will identify what is currently known about the application of patient engagement models, theories, frameworks, and guiding principles in youth-specific research and the important components of these models, theories, frameworks, and guiding principles from the perspective of youth and their families. These findings will be instrumental to developing a youth- and family-specific engagement in research framework called the UNITE framework and subsequently, a validated measure.
International Registered Report Identifier (IRRID)
PRR1-10.2196/65733
Keywords: youth and family engagement, frameworks, implementation science, scoping review, qualitative
Introduction
Background
Patients play an essential role in health research, given their unique lived experiences and expertise, which can significantly enhance the quality, relevance, and impact of research by aligning it with patient needs, values, and preferences [1,2]. The overarching objective of patient engagement in health research is to generate research that contributes to improved health care service delivery, clinical outcomes, and population health [3]. Recent research has highlighted the myriad benefits and positive outcomes associated with patient engagement for patient partners, investigators, and research endeavors [4-8]. For example, engaging patients has influenced initial research priorities, study designs, interpretation of findings, health care interventions, and knowledge mobilization strategies, resulting in outcomes that more closely align with patient perspectives [7,9]. When patient engagement is characterized as meaningful and authentic, it provides a rewarding experience for patients and researchers alike [10].
However, other recent research has highlighted various challenges and risks associated with patient engagement in health research. These challenges, which include tokenism [11-14], power imbalances/dynamics [12,15], limited accessibility to patient-friendly training for patient partners [16], and the absence of equitable engagement tools [17], can have lasting effects on patient partners, including mental and physical exhaustion, deteriorating health, doubts about the value of engagement, and a sense of having personally failed both the team and the broader patient community [18]. A recent article by patient partners led by Richards et al [18] on how patient engagement can falter highlighted key themes, including “patient partners as a checkmark,” “unconscious bias towards patient partners,” “lack of support to fully include patient partners,” and “lack of recognizing the vulnerability of patient partners” [18].
To address these challenges and risks, various patient engagement models, theories, frameworks, and guiding principles (eg, the strategy for patient-oriented research [SPOR], the patient engagement in research [PEIR] framework, and “ways community members can participate in the stages of research” from the Ontario Brain Institute) have been developed and adopted within the research community [10,19,20]. For example, the PEIR framework [10] includes eight key components, which collectively contribute to meaningful patient engagement in research: (1) procedural requirements, (2) convenience, (3) contributions, (4) support, (5) team interaction, (6) research environment, (7) feeling valued, and (8) benefits. A subsequent measure of meaningful patient engagement in research from the patient perspective has been developed, the Patient Engagement in Research Scale (PEIRS-22) [21,22]. This measure is designed to be completed by adult patients and family caregivers who partner with researchers on projects.
It is important to acknowledge that existing frameworks often predominantly emphasize the benefits of patient partners to the research project and team, sometimes overlooking the reciprocal benefits that may occur between the research team and patient partners, especially youth partners [23]. This skewed approach fails to fully consider the potentially extractive nature of research collaboration, as aptly described by Metz and Damschroder [23], where the research process can unintentionally exploit the knowledge and contributions of youth without adequately reciprocating in terms of personal and professional development opportunities. This issue takes on particular significance when crafting an engagement framework tailored for youth, as research teams have the potential to foster skill development, positively impact their life and career trajectories, and contribute to their holistic growth [23].
Despite the significant contribution of the PEIR framework [10] and the PEIRS-22 [21,22], they lack the incorporation of a comprehensive review of the evidence on existing frameworks, and their development was based on participants with limited diversity in terms of gender, race, education, primary diagnosis (all had arthritis), and age [10,21,22]. These limitations impede the transferability of this framework and measure to youth- and family-specific engagement in health research.
Furthermore, there is a model of engagement specifically designed for use with youth called the McCain model of youth engagement [24]. However, it was developed solely in the context of youth mental health systems research for youth and young adults aged 15 to 29 years [24], limiting transferability (ie, across different contexts and family members) and highlighting the need to develop a broader framework. Accordingly, our research seeks to directly address these specific gaps in existing engagement models, theories, and frameworks by developing a youth and family-specific engagement in research framework, the UNITE framework.
Research Objectives
This proposal has two objectives: (1) to determine the extent of literature on the application of patient engagement models, theories, frameworks, and guiding principles in the context of youth- and family-specific research; and (2) to understand how meaningful the key components and constructs of these models, theories, frameworks, and guiding principles are to youth and their family members. Collectively, these findings will be foundational to the development of the UNITE framework and a subsequent validated measure.
Methods
Study Design
This study will be conducted in 2 phases, with phase 1 consisting of a scoping review and phase 2 consisting of a qualitative descriptive study.
Integrated Knowledge Translation Approach
Integrated knowledge translation (iKT) is defined as a collaborative relationship between researchers and relevant knowledge users as partners that facilitates mutually beneficial decision-making related to a study or research program [25]. Youth aged 10 to 24 years in Canada and their family members who have engaged in health research (ie, as patient partners) in the last 3 years were recruited as iKT panel members via Holland Bloorview Kids Rehabilitation Hospital’s Youth Advisory Council and Family Leader Program, professional networks, social media pages, and email lists. A sample of diverse youth advisors who have participated in our previous research on best practices in youth engagement were also approached, including youth with disabilities or developmental differences [26]. A total of 6 youths and 3 family members were recruited to be part of the iKT panels. The lead youth representative will lead the iKT panels. The lead youth representative and research team decided to hold separate iKT panels (ie, having a youth panel and a family panel with the opportunity to mix panels when needed). This approach will ensure that both groups feel comfortable and can freely express their unique perspectives. Activities of the panels have included planning study activities, and may include participant recruitment, data collection and analyses, and knowledge mobilization. Panel discussions will be conducted in a manner that respects diverse perspectives and experiences. A reflective exercise on equity, diversity and inclusion developed by the Strategy for Patient-Oriented Research Evidence Alliance will be conducted with iKT panel members to encourage dialogue and understanding around equity, diversity and inclusion [27].
Phase 1: Scoping Review on Patient Engagement Models, Theories, Frameworks, and Guidance in Youth Health Research
The methodology for the scoping review will follow the methodological frameworks of the Joanna Briggs Institute (JBI) [28] and Khalil et al [29]. The scoping review protocol has been registered on the Open Science Framework Registries [30] and was guided by and reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) [31]. The completed PRISMA-P checklist can be found in Multimedia Appendix 1. The results of the scoping review will be reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for Scoping Reviews (PRISMA-ScR) checklist [32].
Stage 1: Developing a Search Strategy
The population, concept, and context (PCC) framework was used to guide the search strategy (population: World Health Organization [WHO] definition of “young people” as those aged 10-24 years [33]; concept: patient engagement in research; context: models, theories, frameworks, and guiding principles). With the assistance of a research librarian, literature search strategies using Medical Subject Headings and text words related to patient engagement and models, theories, frameworks, and guidance or guiding principles were developed. The search strategy combined structured database-specific subject headings (as available) and keywords or synonyms. An information specialist with expertise in conducting searches for systematic and scoping reviews drafted the search strategy using OVID Medline (Multimedia Appendix 2) and worked with the research team to refine and finalize the search. The final search strategy also underwent peer review using the Peer Review of Electronic Search Strategies (PRESS) statement checklist with another librarian/information specialist [34].
The following databases were searched: Medline, CINAHL, EMBASE, PsycINFO and Cochrane Central Register of Controlled Trials. Searches were limited to English. Literature from 2013 to August 28, 2024 was captured, consistent with when the term “patient engagement” became frequently used [35]. We will also search the gray literature in specialized databases like OpenGrey, Grey Literature Report, and GreyNet International, platforms like arXiv, bioRxiv, and SSRN, and databases such as ProQuest Dissertations and Theses.
Stage 2: Evidence Screening and Selection
All primary studies using a model, theory, or framework for patient engagement in research among young people will be eligible for inclusion. Studies with a model, theory, or framework may have also reported on guiding principles. We define young people as those aged 10 to 24 years, consistent with the WHO definition [33]. We define a model as the essential elements or variables of a phenomenon or a specific aspect of a phenomenon; a theory as “a set of analytical principles or statements designed to structure our observation, understanding and explanation of the world”; and a framework as an explanation of a phenomenon by organizing it into a collection of descriptive categories and the relationships between them [36]. Systematic reviews, meta-analyses, editorials, commentaries, and nonspecific conference proceedings will be excluded to focus on including primary results and not preliminary findings or ongoing research; however, the reference lists of such articles will be hand-searched for relevant articles.
Removal of duplicates as well as level 1 and level 2 screening will be managed through Covidence. To increase reliability, the level 1 screening form will be piloted on a random sample of approximately 50 articles. Eligibility criteria descriptions will be revised if deemed necessary by the team, or if low agreement (ie, <70%) [37] is observed, to improve the consistent application of the selection criteria. Agreement will be measured using Cohen κ [38]. A pilot test of the level 2 screening will also be performed on approximately 25% of the articles, similar to the process for level 1 screening. For studies that are excluded at level 2, the reason for exclusion will be recorded. All screening will occur in duplicate and independently. When necessary, another reviewer will be sought to resolve conflicts.
Stage 3: Data Extraction
A standardized data extraction form will be developed by the research team and iKT panels based on the JBI Manual data extraction recommendations [28] and those recommended for the extraction, analysis, and presentation of results in scoping reviews [28,39]. Extracted data will include study characteristics (eg, study design, year of publication, geographic location), youth and family participant characteristics (eg, age of the youth), and details of the engagement models, theories, frameworks, and guiding principles (eg, components or values and principles and how they were enabled or enacted in the study), as well as study results. Additional categories for data extraction identified through discussions with the research team and iKT panels will be added to the final data extraction template as applicable. The data extraction template will be piloted for 2 to 3 articles to ensure all relevant results are extracted. All data will then be extracted in duplicate by 2 independent reviewers. Discrepancies in the extracted data will be discussed and resolved by the 2 reviewers. Quality and risk of bias will not be assessed, as this is not required in scoping reviews [32].
Stage 4: Data Analysis
The extracted data will be quantitatively summarized using numerical counts and qualitatively summarized using content analysis [40]. The data will be grouped by the main components of the model, theories, frameworks, guiding principles (and how they were enabled or enacted), study designs, and associated methods (eg, one-on-one interviews). We will also synthesize data on how youth and family members were engaged throughout the research process, the types of outcomes collected, and results. Depending on the available data, subgroup analyses may be conducted by health condition, sex, gender-related variables, and other PROGRESS-Plus characteristics (PROGRESS-Plus is a term meaning “place of residence, race/ethnicity/culture/language, occupation, gender/sex, religion, education, socioeconomic status, social capital”) [41]. If feasible, we will contact the study authors of the included studies to confirm that all the data collected were included in the published article (ie, nothing was excluded due to word count limitations of a journal).
Phase 2: Qualitative Study to Understand Key Components and Constructs for Development of a Framework for Youth- and Family-Specific Engagement in Research
Study Design
Phase 2 will adopt a qualitative descriptive approach [42,43]. Findings from the scoping review will inform the development of the interview guide for phase 2, such as identifying what aspects of the included models, theories, frameworks, and guiding principles resonate with youth and family members and which do not.
Recruitment
We will recruit Canadian youth (aged 10-24 years) and their family members who have had experience in youth engagement in health research (eg, as partners of a research project) within the last 3 years. Participants will be recruited via our professional networks, including those of the iKT panel members (eg, the Kids Brain Health Network, the Bloorview Research Institute Family Engagement Office, and the SickKids Patient and Family Engagement Office), social media pages, and email lists. We will also enlist the help of a diverse group of youth advisors who have participated in our research team’s previous research for recruitment [26,44,45]. We aim to recruit 9 to 17 youth and 9 to 17 family members; this is consistent with the sample size in qualitative studies to reach thematic saturation [46].
Data Collection
Youth and family participants will take part in separate, one-on-one, semistructured telephone or online interviews with a member of the research team with expertise in qualitative research methods [47,48]. All interviews will be digitally recorded and transcribed verbatim for data analysis. The interview guides will consist of questions focused on youth and family members’ conceptualization of meaningful engagement in health research. The interview guide will be pilot-tested with various members of the research team and iKT panel. We will use probes or recursive questioning during interviews to explore issues in greater depth and verify the interviewer’s understanding of the collected information [49,50].
Data Analysis
We will use inductive thematic analysis, as described by Braun and Clarke [51,52], which is consistent with the pragmatic orientation of this research [53]. Codes and themes will be refined through discussion with the larger research team. The software program NVivo (version 14; Lumivero) will be used during the analysis of the transcripts to help organize the codes. Multiple aspects of trustworthiness will be used [54]. For example, we will demonstrate credibility via peer debriefing with various members of the research team and the iKT panels. Transferability will be accomplished by describing the study samples. Independent analysts will review the data and contest the themes to ensure dependability. Finally, confirmability will be accomplished by providing decision trails between data and interpretation [54].
Ethical Considerations
Ethics approval for phase 2 of this project will be obtained from the first author’s primary institution (Holland Bloorview Kids Rehabilitation Hospital, Bloorview Research Institute). Informed consent will be obtained from participants prior to the start of the interview. Transcripts from the interviews will be deidentified to ensure privacy prior to data analysis. Participants will be compensated for their time in the form of gift cards. The amount compensated will be consistent with the Canadian Institutes of Health Research (CIHR) Patient Partner Compensation Guidelines (CAD $50 [US $34.96] per participant) [55].
Results
This work is supported by a CIHR Healthy Youth Catalyst Grant received in March 2024 (HEY- 192883; Multimedia Appendix 3). A 9-member iKT panel consisting of 6 youth and 3 family members has been established and has been actively involved in the study. We anticipate that phase 1 of the study will be completed in March 2025. Ethics approval for phase 1 was not required as it did not involve collecting or using data from participants. Ethics approval for phase 2 of the study will be applied for in winter 2025. Phase 2 of the project is anticipated to be completed in August 2025. A detailed timeline of the project can be found in Multimedia Appendix 4.
Discussion
Anticipated Findings
The findings from this study will allow us to identify what is currently known about the application of patient engagement models, theories, frameworks, and guiding principles, which are often designed for adults, in the context of youth-specific research, and to understand the importance of the components that make up these models, theories, and frameworks from the perspective of youth and their families.
Dissemination Plans
We will use a variety of passive and active end-of-grant knowledge mobilization approaches to disseminate our findings, which will be codeveloped with our iKT panels. We will ensure youth and family voices are heard to develop flexible communication plans that will suit diverse needs. Traditional knowledge translation will include dissemination through meetings locally, nationally, and internationally (eg, PxP and For Patients, By Patients) and publications in peer-reviewed journals. Members of the research team are affiliated with and situated within pediatric institutions where the UNITE framework will be disseminated and implemented. We will codevelop plain language summaries with youth and family partners with clear, simple, and individualized messages for patients and family and community service organizations to augment the accessibility of the information. Finally, members of the research team will also discuss and distribute the UNITE framework within their expansive training curriculum and a planned youth-focused engagement in research course.
Future Directions
This project lays the foundational work for developing a patient engagement framework called the UNITE framework, which will include equity, diversity, and inclusion considerations, and the subsequent development and validation of an associated measure of engagement. Future research will involve the implementation of the UNITE framework and a subsequent measure in a learning health system context within pediatric institutions that our research teams are associated with. The UNITE framework and associated measure will contribute to meaningful and sustained engagement of youth and their families in health research by addressing gaps in current patient engagement frameworks.
Strengths and Limitations
A strength of this study is the inclusion of gray literature (eg, reports and policy literature) for phase 1 (the scoping review). This will provide a more comprehensive understanding of the concept (patient engagement in research) and context (models, theories, frameworks, and guiding principles) that we are interested in, as well as mitigate publication bias [56]. In addition, the search strategy for phase 1 has been reviewed by the iKT panel and undergone peer review using the PRESS statement checklist [34], which further strengthens the relevance, comprehensiveness, and quality of the search strategy. One limitation of this project is the potential for selection bias (specifically for phase 2), where individuals who had either very positive or very negative experiences with patient engagement in research may be more likely to participate in the study, which may limit the applicability of the study’s findings. However, the adoption of the iKT approach and having the iKT panels (consisting of youth and their families) assist in the recruitment for phase 2 of the study should result in the recruitment of a variety of individuals with diverse interests.
Conclusions
The current proposal will lead to the development of a youth- and family-specific engagement in research framework, UNITE, with future research focused on the development of an associated validated measure. The UNITE framework and measure will lay the foundation for meaningful and sustained engagement in health research by youth and their families, ultimately contributing to enhanced health care service delivery, improved clinical outcomes, and increased overall well-being and quality of life for youth and their families [1-3].
Abbreviations
- CIHR
Canadian Institutes of Health Research
- iKT
integrated knowledge translation
- PCC
population, concept, and context
- PEIR
patient engagement in research
- PEIRS-22
Patient Engagement in Research Scale-22
- PRESS
Peer Review of Electronic Search Strategies
- PRISMA-P
Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols
- PRISMA- ScR
Preferred Reporting Items for Systematic Reviews and Meta-Analysis Extension for Scoping Reviews
- SPOR
strategy for patient-oriented research
- WHO
World Health Organization
PRISMA-P checklist.
Medline search strategy.
Peer-review report by the Catalyst Grant: Healthy Youth competition, Canadian Institutes of Health Research (Canada).
Timelines and milestones for the youth- and family-specific engagement in research (UNITE) project.
Data Availability
The data collected during this study are available from the corresponding author upon reasonable request.
Footnotes
Authors' Contributions: SEPM, AT, and CJ conceptualized the overall study design and methods, wrote the manuscript, and approved the final manuscript as submitted. CJ, SEPM, and AT informed the design of the study engagement approach and coordinated the knowledge user engagement. SEPM, CJ, and AT contributed to the design of the study knowledge mobilization strategies. All authors provided input and guidance on the study design and approved the final manuscript as submitted.
Conflicts of Interest: SEPM is the editor-in-chief of JMIR Rehabilitation and Assistive Technologies.
References
- 1.Hayes H, Buckland S, Tarpey M. Briefing notes for researchers: public involvement in NHS, public health and social care research. National Institute for Health Research. [2025-03-07]. https://tinyurl.com/mup6ksvt .
- 2.Frank L, Forsythe L, Ellis L, Schrandt S, Sheridan S, Gerson J, Konopka K, Daugherty S. Conceptual and practical foundations of patient engagement in research at the patient-centered outcomes research institute. Qual Life Res. 2015 May;24(5):1033–41. doi: 10.1007/s11136-014-0893-3. https://europepmc.org/abstract/MED/25560774 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Manafo E, Petermann L, Mason-Lai P, Vandall-Walker V. Patient engagement in Canada: a scoping review of the 'how' and 'what' of patient engagement in health research. Health Res Policy Syst. 2018 Feb 07;16(1):5. doi: 10.1186/s12961-018-0282-4. https://health-policy-systems.biomedcentral.com/articles/10.1186/s12961-018-0282-4 .10.1186/s12961-018-0282-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ashcroft J, Wykes T, Taylor J, Crowther A, Szmukler G. Impact on the individual: what do patients and carers gain, lose and expect from being involved in research? J Ment Health. 2016;25(1):28–35. doi: 10.3109/09638237.2015.1101424. https://www.tandfonline.com/doi/abs/10.3109/09638237.2015.1101424?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Staley K, Abbey-Vital I, Nolan C. The impact of involvement on researchers: a learning experience. Res Involv Engagem. 2017;3:20. doi: 10.1186/s40900-017-0071-1. https://researchinvolvement.biomedcentral.com/articles/10.1186/s40900-017-0071-1 .71 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Geissler J, Ryll B, di Priolo SL, Uhlenhopp M. Improving patient involvement in medicines research and development: a practical roadmap. Ther Innov Regul Sci. 2017 Sep;51(5):612–619. doi: 10.1177/2168479017706405. [DOI] [PubMed] [Google Scholar]
- 7.Gordon L, Dickinson A, Offredy M, Smiddy J. A research note on the benefit of patient and public involvement in research: the experience of prostate cancer patients regarding information in radiotherapy. Radiography (Lond) 2017 May;23(2):167–170. doi: 10.1016/j.radi.2017.02.004.S1078-8174(17)30009-3 [DOI] [PubMed] [Google Scholar]
- 8.Vanderhout SM, Bhalla M, Van A, Fergusson DA, Potter BK, Karoly A, Ly V, Macarthur C. The impact of patient and family engagement in child health research: a scoping review. J Pediatr. 2023 Feb;253:115–128. doi: 10.1016/j.jpeds.2022.09.030.S0022-3476(22)00852-6 [DOI] [PubMed] [Google Scholar]
- 9.Archambault PM, McGavin C, Dainty KN, McLeod SL, Vaillancourt C, Lee JS, Perry JJ, Gauvin F, Boivin A. Recommendations for patient engagement in patient-oriented emergency medicine research. CJEM. 2018 May;20(3):435–442. doi: 10.1017/cem.2018.370.S1481803518003706 [DOI] [PubMed] [Google Scholar]
- 10.Hamilton CB, Hoens AM, Backman CL, McKinnon AM, McQuitty S, English K, Li LC. An empirically based conceptual framework for fostering meaningful patient engagement in research. Health Expect. 2018 Feb;21(1):396–406. doi: 10.1111/hex.12635. https://europepmc.org/abstract/MED/28984405 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Richards D. Tokenism: Seeing it. Fixing it. Perspectives from IMHA patient partners. Canadian Institutes of Health Research. [2025-03-07]. https://blogs.ubc.ca/imhablog/2021/10/13/tokenism-seeing-it-fixing-it-perspectives-from-patient-partners/
- 12.Ethics guidance for developing partnerships with patients and researchers. Canadian Institutes of Health Research. [2025-03-07]. https://cihr-irsc.gc.ca/e/51910.html .
- 13.Hahn DL, Hoffmann AE, Felzien M, LeMaster JW, Xu J, Fagnan LJ. Tokenism in patient engagement. Fam Pract. 2017 Jun 01;34(3):290–295. doi: 10.1093/fampra/cmw097.cmw097 [DOI] [PubMed] [Google Scholar]
- 14.Johannesen J. Two-way street? A critical look at patient and family engagement. johannesen.ca. [2025-03-07]. https://johannesen.ca/2017/10/two-way-street-critical-look-patient-family-engagement/
- 15.Johannesen J. “The trouble with patient and public involvement (PPI)” – keynote at Cochrane Colloquium 2018. jjohannesen.ca. 2018. [2025-03-07]. https://johannesen.ca/2018/09/the-trouble-with-patient-and-public-involvement-ppi-keynote-at-cochrane-colloquium-2018/
- 16.Forsythe LP, Ellis LE, Edmundson L, Sabharwal R, Rein A, Konopka K, Frank L. Patient and stakeholder engagement in the PCORI pilot projects: description and lessons learned. J Gen Intern Med. 2016 Jan;31(1):13–21. doi: 10.1007/s11606-015-3450-z. https://europepmc.org/abstract/MED/26160480 .10.1007/s11606-015-3450-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Forsythe LP, Carman KL, Szydlowski V, Fayish L, Davidson L, Hickam DH, Hall C, Bhat G, Neu D, Stewart L, Jalowsky M, Aronson N, Anyanwu CU. Patient engagement in research: early findings from the Patient-Centered Outcomes Research Institute. Health Aff (Millwood) 2019 Mar;38(3):359–367. doi: 10.1377/hlthaff.2018.05067. [DOI] [PubMed] [Google Scholar]
- 18.Richards DP, Poirier S, Mohabir V, Proulx L, Robins S, Smith J. Reflections on patient engagement by patient partners: how it can go wrong. Res Involv Engagem. 2023 Jun 12;9(1):41. doi: 10.1186/s40900-023-00454-1. https://researchinvolvement.biomedcentral.com/articles/10.1186/s40900-023-00454-1 .10.1186/s40900-023-00454-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Strategy for patient-oriented research - patient engagement framework. Canadian Institutes of Health Research. 2014. [2025-03-07]. https://cihr-irsc.gc.ca/e/48413.html .
- 20.Ways community members can participate in the stages of research. Ontario Brain Institute. [2024-05-07]. https://braininstitute.ca/img/Patient-engagement-in-the-stages-of-research.pdf .
- 21.Hamilton CB, Hoens AM, McQuitty S, McKinnon AM, English K, Backman CL, Azimi T, Khodarahmi N, Li LC. Development and pre-testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS One. 2018;13(11):e0206588. doi: 10.1371/journal.pone.0206588. https://dx.plos.org/10.1371/journal.pone.0206588 .PONE-D-18-22196 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hamilton CB, Hoens AM, McKinnon AM, McQuitty S, English K, Hawke LD, Li LC. Shortening and validation of the Patient Engagement In Research Scale (PEIRS) for measuring meaningful patient and family caregiver engagement. Health Expect. 2021 Jun;24(3):863–879. doi: 10.1111/hex.13227. https://europepmc.org/abstract/MED/33729634 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Metz A, Damschroder L. "There is a deep disconnect" - Laura and Allison talk about practical implementation. Essential Implementation YouTube page. 2023. [2024-05-07]. https://www.youtube.com/watch?v=phYmTiUGVkA .
- 24.Heffernan O, Herzog T, Schiralli J, Hawke L, Chaim G, Henderson J. Implementation of a youth-adult partnership model in youth mental health systems research: Challenges and successes. Health Expect. 2017 Dec;20(6):1183–1188. doi: 10.1111/hex.12554. https://europepmc.org/abstract/MED/28295940 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Kothari A, McCutcheon C, Graham ID. Defining integrated knowledge translation and moving forward: a response to recent commentaries. Int J Health Policy Manag. 2017 May 01;6(5):299–300. doi: 10.15171/ijhpm.2017.15. https://europepmc.org/abstract/MED/28812820 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bailey K, Allemang B, Vandermorris A, Munce S, Cleverley K, Chisholm Cassandra, Cohen Eva, Davidson Cedar, El Galad Asil, Leibovich Dahlia, Lowthian Trinity, Pillainayagam Jeanna, Ramesh Harshini, Samson Anna, Senthilnathan Vjura, Siska Paul, Snider Madison, Toulany Alene. Benefits, barriers and recommendations for youth engagement in health research: combining evidence-based and youth perspectives. Res Involv Engagem. 2024 Sep 02;10(1):92. doi: 10.1186/s40900-024-00607-w. https://researchinvolvement.biomedcentral.com/articles/10.1186/s40900-024-00607-w .10.1186/s40900-024-00607-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Reflective exercise. SPOR Evidence Alliance. 2021. Aug 21, [2024-05-07]. https://sporevidencealliance.ca/wp-content/uploads/2021/08/4.-SPOREA_Reflective-EDI-Exercise-UPDATED.pdf .
- 28.Peters M, Marnie C, Tricco A, Pollock D, Munn Z, Alexander L. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synth. 2020 Oct;18(10):2119–2126. doi: 10.11124/jbies-20-00167. [DOI] [PubMed] [Google Scholar]
- 29.Khalil H, Peters MD, Tricco AC, Pollock D, Alexander L, McInerney P, Godfrey CM, Munn Z. Conducting high quality scoping reviews-challenges and solutions. J Clin Epidemiol. 2021 Feb;130:156–160. doi: 10.1016/j.jclinepi.2020.10.009.S0895-4356(20)31148-3 [DOI] [PubMed] [Google Scholar]
- 30.Munce S, Jarrett C, Senthilnathan V, Luong D, Toulany A. Patient engagement models, theories, frameworks, and guiding principles in youth health research: a scoping review protocol. OSF Registries. [2025-03-07]. https://osf.io/gqmrw .
- 31.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, PRISMA-P Group Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015 Jan 01;4(1):1. doi: 10.1186/2046-4053-4-1. https://systematicreviewsjournal.biomedcentral.com/articles/10.1186/2046-4053-4-1 .2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, Moher D, Peters MDJ, Horsley T, Weeks L, Hempel S, Akl EA, Chang C, McGowan J, Stewart L, Hartling L, Aldcroft A, Wilson MG, Garritty C, Lewin S, Godfrey CM, Macdonald MT, Langlois EV, Soares-Weiser K, Moriarty J, Clifford T, Tunçalp Özge, Straus SE. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018 Oct 02;169(7):467–473. doi: 10.7326/M18-0850. https://www.acpjournals.org/doi/abs/10.7326/M18-0850?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub0pubmed .2700389 [DOI] [PubMed] [Google Scholar]
- 33.Adolescent health. World Health Organization. [2025-03-07]. https://www.who.int/health-topics/adolescent-health#tab=tab_1 .
- 34.McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 guideline statement. J Clin Epidemiol. 2016 Jul;75:40–6. doi: 10.1016/j.jclinepi.2016.01.021. https://linkinghub.elsevier.com/retrieve/pii/S0895-4356(16)00058-5 .S0895-4356(16)00058-5 [DOI] [PubMed] [Google Scholar]
- 35.Higgins T, Larson E, Schnall R. Unraveling the meaning of patient engagement: a concept analysis. Patient Educ Couns. 2017 Jan;100(1):30–36. doi: 10.1016/j.pec.2016.09.002. https://doi.org/10.1016/j.pec.2016.09.002 .S0738-3991(16)30409-8 [DOI] [PubMed] [Google Scholar]
- 36.Nilsen P, Birken S. Handbook on Implementation Science. Cheltenham, UK: Edward Elgar Publishing; 2020. Overview of theories, models and frameworks in implementation science. [Google Scholar]
- 37.Park CU, Kim HJ. Measurement of inter-rater reliability in systematic review. Hanyang Med Rev. 2015;35(1):44–49. doi: 10.7599/hmr.2015.35.1.44. [DOI] [Google Scholar]
- 38.Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960 Apr 01;20(1):37–46. doi: 10.1177/001316446002000104. [DOI] [Google Scholar]
- 39.Aromataris E, Munn Z, editors. JBI Reviewer's Manual. Adelaide, Australia: JBI; 2017. Chapter 11: scoping reviews. [Google Scholar]
- 40.Stemler S. An overview of content analysis. Pract Assess Res Eval. 2000;7(1):17. doi: 10.7275/z6fm-2e34. [DOI] [Google Scholar]
- 41.O'Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, Evans T, Pardo Pardo J, Waters E, White H, Tugwell P. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014 Jan;67(1):56–64. doi: 10.1016/j.jclinepi.2013.08.005.S0895-4356(13)00334-X [DOI] [PubMed] [Google Scholar]
- 42.Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000 Aug;23(4):334–40. doi: 10.1002/1098-240x(200008)23:4<334::aid-nur9>3.0.co;2-g.10.1002/1098-240X(200008)23:4<334::AID-NUR9>3.0.CO;2-G [DOI] [PubMed] [Google Scholar]
- 43.Sandelowski M. What's in a name? Qualitative description revisited. Res Nurs Health. 2010 Feb;33(1):77–84. doi: 10.1002/nur.20362. [DOI] [PubMed] [Google Scholar]
- 44.Bailey K, Avolio J, Lo L, Gajaria A, Mooney S, Greer K, Martens H, Tami P, Pidduck J, Cunningham J, Munce S, Toulany A. Social and structural drivers of health and transition to adult care. Pediatrics. 2024 Jan 01;153(1):e2023062275. doi: 10.1542/peds.2023-062275.196196 [DOI] [PubMed] [Google Scholar]
- 45.Munce SEP, Wong E, Luong D, Rao J, Cunningham J, Bailey K, John T, Barber C, Batthish M, Chambers K, Cleverley K, Crabtree M, Diaz S, Dimitropoulos G, Gorter JW, Grahovac D, Grimes R, Guttman B, Hébert Michèle L, Henze M, Higgins A, Khodyakov D, Li E, Lo L, Macgregor L, Mooney S, Severino SM, Mukerji G, Penner M, Pidduck J, Shulman R, Stromquist L, Trbovich P, Wan M, Williams L, Yates D, Toulany A. Patient, caregiver and other knowledge user engagement in consensus-building healthcare initiatives: a scoping review protocol. BMJ Open. 2024 May 08;14(5):e080822. doi: 10.1136/bmjopen-2023-080822. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=38719333 .bmjopen-2023-080822 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Hennink M, Kaiser B. Sample sizes for saturation in qualitative research: a systematic review of empirical tests. Soc Sci Med. 2022 Jan;292:114523. doi: 10.1016/j.socscimed.2021.114523. https://linkinghub.elsevier.com/retrieve/pii/S0277-9536(21)00855-8 .S0277-9536(21)00855-8 [DOI] [PubMed] [Google Scholar]
- 47.Archibald MM, Ambagtsheer RC, Casey MG, Lawless M. Using Zoom videoconferencing for qualitative data collection: perceptions and experiences of researchers and participants. Int J Qual Methods. 2019 Sep 11;:18. doi: 10.1177/1609406919874596. [DOI] [Google Scholar]
- 48.Patton MQ. Qualitative research and evaluation methods (3rd ed.) Thousand Oaks, CA: SAGE Publications; 2002. [Google Scholar]
- 49.Tashakkori A, Teddlie C. SAGE Publications. 2010. [2025-03-07]. https://methods.sagepub.com/book/sage-handbook-of-mixed-methods-social-behavioral-research-2e .
- 50.Clarke V, Braun V, Hayfield N. Thematic analysis. In: Smith JA, editor. Qualitative Psychology: A Practical Guide to Research Methods. SAGE Publications: London, UK; 2015. [Google Scholar]
- 51.Braun V, Clarke V. Reflecting on reflexive thematic analysis. Qual Res Sport Exerc Health. 2019 Jun 13;11(4):589–597. doi: 10.1080/2159676x.2019.1628806. [DOI] [Google Scholar]
- 52.Guba EG, Lincoln YS. Effective Evaluation: Improving the Usefulness of Evaluation Results Through Responsive and Naturalistic Approaches. San Francisco, CA: Jossey-Bass; 1981. [Google Scholar]
- 53.Allemang B, Sitter K, Dimitropoulos G. Pragmatism as a paradigm for patient-oriented research. Health Expect. 2022 Feb;25(1):38–47. doi: 10.1111/hex.13384. https://europepmc.org/abstract/MED/34748689 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Integrated knowledge translation (iKT) Canadian Institutes of Health Research. 2012. [2025-03-07]. https://cihr-irsc.gc.ca/e/45321.html#a3 .
- 55.Patient Partner Compensation Guidelines. Canadian Institutes of Health Research. 2022. [2025-03-07]. https://cihr-irsc.gc.ca/e/53261.html .
- 56.Paez A. Gray literature: an important resource in systematic reviews. J Evid Based Med. 2017 Aug;10(3):233–240. doi: 10.1111/jebm.12266. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
PRISMA-P checklist.
Medline search strategy.
Peer-review report by the Catalyst Grant: Healthy Youth competition, Canadian Institutes of Health Research (Canada).
Timelines and milestones for the youth- and family-specific engagement in research (UNITE) project.
Data Availability Statement
The data collected during this study are available from the corresponding author upon reasonable request.