Patients as partners in health research: A scoping review

Tamara L McCarron; Fiona Clement; Jananee Rasiah; Chelsea Moran; Karen Moffat; Andrea Gonzalez; Tracy Wasylak; Maria Santana

doi:10.1111/hex.13272

. 2021 Jun 21;24(4):1378–1390. doi: 10.1111/hex.13272

Patients as partners in health research: A scoping review

Tamara L McCarron ^1,², Fiona Clement ^1,^2,^✉, Jananee Rasiah ³, Chelsea Moran ⁵, Karen Moffat ^1,^2,⁴, Andrea Gonzalez ^1,², Tracy Wasylak ^6,⁷, Maria Santana ^1,^2,^✉

PMCID: PMC8369093 PMID: 34153165

Abstract

Background

The role of patient involvement in health research has evolved over the past decade. Despite efforts to engage patients as partners, the role is not well understood. We undertook this review to understand the engagement practices of patients who assume roles as partners in health research.

Methods

Using a recognized methodological approach, two academic databases (MEDLINE and EMBASE) and grey literature sources were searched. Findings were organized into one of the three higher levels of engagement, described by the Patient and Researcher Engagement framework developed by Manafo. We examined and quantified the supportive strategies used during involvement, used thematic analysis as described by Braun and Clarke and themed the purpose of engagement, and categorized the reported outcomes according to the CIHR Engagement Framework.

Results

Out of 6621 records, 119 sources were included in the review. Thematic analysis of the purpose of engagement revealed five themes: documenting and advancing PPI, relevance of research, co‐building, capacity building and impact on research. Improved research design was the most common reported outcome and the most common role for patient partners was as members of the research team, and the most commonly used strategy to support involvement was by meetings.

Conclusion

The evidence collected during this review advanced our understanding of the engagement of patients as research partners. As patient involvement becomes more mainstream, this knowledge will aid researchers and policy‐makers in the development of approaches and tools to support engagement.

Patient/User Involvement

Patients led and conducted the grey literature search, including the synthesis and interpretation of the findings.

Keywords: co‐production, patient and public involvement, patient engagement, scoping review

1. BACKGROUND

The involvement of patients in health research is an emerging phenomenon, with critical barriers still present for researchers seeking to involve patients as partners.¹ Globally, patient and public involvement (PPI) organizations such as INVOLVE in the United Kingdom,² Patient‐Centered Outcomes Research Institute (PCORI) in the United States³ and the Canadian Institutes for Health Research (CIHR) Strategy for Patient‐Oriented Research (SPOR) in Canada⁴ have been established. These organizations aim to support the involvement of patients, their caregivers and families in the research process by promoting and providing infrastructure to support PPI in health research.

As such, the role of patients and how they engage in research has evolved over the past decade. CIHR defines this new role as “patient partner” and describes when patients contribute to the research process and research‐related activities, different from the traditional, more passive role, as research participant, where patients receive treatments or are under observation.⁵ Patient partners are more involved in conducting research activities, at all stages of the research process, including supporting grant applications, assisting with participant recruitment and performing research dissemination activities.⁶ In Canada, the SPOR patient engagement framework encompasses four principles to guide the involvement of patients as partners in research. These include the following: (a) ensuring inclusivity, so that perspectives of patients who may otherwise be excluded, marginalized, hard to reach or are members of minority groups are invited; (b) providing support through flexible environments with training opportunities that will meet patients’ diverse needs; (c) promoting mutual respect by valuing patients’, researchers’ and clinicians’ perspectives through regular discussions; and (d) co‐building research projects by identifying priorities and gaps and working to implement solutions together.⁷ Equally important in supporting patient involvement, this same framework emphasizes six outcomes for patient engagement including (a) multi‐way capacity building, which ensures that the support needed for patients and researchers to be able to work together are in place; (b) inclusive mechanisms and processes, which supports an environment where patient engagement can occur at all levels; (c) multi‐way communication and collaboration, which describes a safe environment of mutual respect; (d) patient‐informed and directed research, which discuss supportive research approaches that engage a diversity of patients; (e) experiential knowledge is valued as evidence, recognizing the importance of lived experience and the ability of this knowledge to be mobilized and translated; and (f) a shared sense of purpose, where participants, both patient and researcher, work together towards a common goal.⁷

Bird et al¹ conducted a scoping review exploring the impact of patient partners on research outcomes, acknowledging the results of this review primarily involved adults with chronic, long‐term conditions, a number of critical barriers and facilitators for researcher seeking to undertake patient partnerships were identified. Hoekstra et al synthesized the research partnership literature, and recommended a four step guidance to support partnerships processes including (a) building and maintaining relationship; (b) determining the appropriate level of engagement for each phase of the research process; (c) selecting or adapting strategies to the desired level of engagement; and (d) communicate and report the principles, strategies, outcomes and impacts of the research partnerships.⁸

Broadly, there is an understanding of researcher motivations to engage patients in the research process, such as improving the relevance of research,⁹ and an understanding of the motivations of patients who are involved as partners, such as improving health care.¹⁰ Systematic reviews on the involvement and engagement of patients in research have not differentiated between the evolving role of patient as partner in research and patient as research participant.⁹^,¹¹ Currently, there is little peer‐reviewed published literature that differentiates the role of patient as partner in research from the role of patients as research participant.¹² Although PPI has been shown to develop on‐going, productive and mutually advantageous relationships between researchers and patients,¹³^,¹⁴ the role of patient as research partner is not well understood. While the evidence provided by Manafo et al¹⁵ describes the characteristics of patient as partners, we conducted this review to understand the engagement of patients who assume roles as partners in health research projects. Since “patient as partner” is defined by individuals who assume roles with greater involvement, increased sharing of power and increased responsibility on research teams,¹⁶ we focused the review at the higher levels of the engagement spectrum (involve, collaborate and lead/support) as defined by Manafo et al¹⁵ The specific objectives of this review were to (a) report the purpose of engagement; (b) report the outcomes of engagement; (c) to capture the patient role as described by the study author; and (d) to explore the engagement strategies to support patient involvement.

2. METHODS

A scoping review was conducted because this body of literature has not yet been comprehensively reviewed, it is heterogeneous in nature and therefore not amenable to a more precise systematic review.

2.1. Design

We followed the methodological framework proposed by Arksey and O’Malley¹⁷ and further enhanced by Levac et al¹⁸ This six‐stage methodological framework includes (a) identifying the research question, (b) identifying relevant studies, (c) study selection, (d) charting the data, (e) collating, summarizing and reporting the results and (f) stakeholder consultation. A scoping review methodology was chosen to identify the research in how patient partners are involved as patient partners in health research.

2.2. Recruitment of patient partners

Posters were distributed among the first authors’ personal networks, and other organizations including the Alberta SPOR Support Unit¹⁹ and Albertans for Health Research.²⁰ The project description, proposed role and anticipated time commitment were included. Five individuals responded to the opportunity. All five individuals were interviewed and later selected. These individuals represented a diverse group in terms of diversity, age and sex and had varying experience working on research projects (from no experience to some experience).

Ethic approval was not needed as these patients were members of the research team rather than participants of the study. The details about the engagement process are described somewhere else.²¹

2.3. Stage 1: Identifying the research question

Our research team, including our patient partners and key stakeholders such as the Strategic Clinical Networks™ at Alberta Health Services, developed the research question guiding this review: “How are patients engaged as partners in health research?” We used a modified SPICE (setting, population/perspective, intervention, comparison and evaluation) methodology to develop our research question.²²

2.4. Stage 2: Identifying relevant studies

2.4.1. Protocol and registration

The final review protocol was developed a priori and posted on the Open Science Framework (https://osf.io/h2p8s/). This review was completed in accordance with the scoping review reporting guidelines (PRISMA‐ScR).²³

2.4.2. Eligibility criteria

To be included in the review, studies were considered if they: described patients assuming roles in health research at one of the six levels as defined by the spectrum of Patient and Researcher Engagement described by Manafo et al¹⁵; were written in English; and were published between 1 January 2010 and 14 January 2020. This time period was chosen to capture the evolving role of patients who began assuming responsibilities as partners in research. Studies written in English were considered given the limitations of the research team. Studies were excluded if they were an opinion, editorial, did not involve or engage patients, did not describe the engagement of patients or were examples of community rather than patient engagement.

2.4.3. Information sources

Three sources of data informed our scoping review: an academic database search; grey literature search; and hand‐searching of reference list of identified studies. Our academic search strategy was developed in consultation with a health sciences research librarian and was applied to the MEDLINE and EMBASE databases. Search terms were determined with input from the research team, research collaborators and our team of patient partners and included a broad combination of title and keyword search terms such as “patient”, “consumer”, “carer”, “family” and “community” and mesh headings such as “Patient Participation” and “Health Services Research” (Appendix S1). A team of patient partners led and conducted the grey literature component of this review. Patient partners identified studies, reports and conference abstracts of relevance to this review. To ensure that all relevant information was captured, we modified the CADTH Grey Matters²⁴ tool for searching grey literature to include an exhaustive list of organizations with a mandate in the area of patient engagement such as INVOLVE in the United Kingdom and SPOR in Canada (Appendix S2). Two training sessions on developing and conducting a grey literature coupled with weekly discussions and support meetings were held with the patient partners. A custom Google search was conducted using a comprehensive list of search terms such as “patient participation”, “public involvement” and “community integration” (Appendix S3). Finally, we hand‐searched reference lists of identified reviews to identify additional studies of relevance.

2.5. Stage 3: Study selection

2.5.1. Selection of sources of evidence

The review process consisted of two levels of screening: (a) a title and abstract review and (b) full‐text screening to assign studies to a level of engagement. For the title and abstract review, the team calibrated on the first 100, until a high level of agreement between reviewers was reached. Four reviewers, in two teams of two, independently screened all title and abstracts. When determining eligibility at full‐text screening, only studies that described the higher levels of Patient and Researcher Engagement Spectrum were retained such as at the involve level, which involved patients as members of an advisory group, the collaborate level, which described partnering as a team member; or the lead/support level which described patients leading research activities.¹⁵ Thus, studies underwent an additional screening process where two independent reviewers assigned each study to a level of engagement according to the authors’ report of the engagement activities.¹⁵ Articles reporting more than one level of engagement method were assigned to the higher level. The level of engagement of included articles was confirmed during the data extraction process, and any disagreements were resolved by a third reviewer.

2.6. Stage 4: Data collection

2.6.1. Data charting

The same data collection instruments for both the grey and academic sources were developed a priori by the research team to confirm study relevance and to extract study characteristics. Study characteristics were recorded in tabular form (using frequencies/percentages) with the following article characteristics: (a) country of origin; (b) author; (c) study design; (d) purpose of engagement as reported by the study author; (e) study population as reported in the manuscript; (f) type of engagement activities listed in the study; (g) purpose/goal of engagement activities as listed in the study; and (h) any reported direct/indirect study outcome(s) as a result of the engagement activity. Patient partner characteristics were also collected including (a) age; (b) sex; (c) gender; (d) actor (patient/parent/family member/caregiver/community member); (e) ethnicity; (f) level of education; (g) compensation received; and (h) engagement training received (Appendix S4).

Data extraction was completed by three reviewers, one of which was a patient partner who extracted data from all included sources from the grey literature search. All data were verified by a fourth reviewer. The data were compiled in Microsoft Excel. Weekly team meetings were conducted to discuss articles and maintain reliability and quality during the data extraction process.

2.7. Stage 5: Data summary and synthesis

We used the six stages of thematic data analysis as described by Braun and Clarke, to report the purpose of engagement: (a) familiarization; (b) initial coding; (c) identifying themes; (d) reviewing themes; (e) defining themes; and (f) reporting.²⁵ To facilitate the theming process, the reported purpose of engagement of each of the included studies was imported into NVIVO 12. Research team members reviewed the data individually to generate initial codes. Theming was then completed as larger group and later verified by our patient partner. Using the Canadian Institutes for Health Research (CIHR) Patient Oriented Research (POR) strategy as a lens, the reported outcomes from each of the studies were categorized according to the six components of successful patient engagement including (a) inclusive mechanisms and processes, which is described by an environment where patient engagement can occur at all levels; (b) multi‐way capacity building, described as the support needed for patients and researchers to be able to work together; (c) multi‐way communication and collaboration, which is described when a safe environment of mutual respect is present; (d) experiential knowledge of patients valued as evidence, where the importance of lived experience is mobilized and translated; (e) patient‐informed and directed research, described by research approaches that engaged a diversity of patients; and (f) a shared sense of purpose, which is described by participants working together towards a common goal.⁷ Next, the patient role, as identified by the study author, was captured. Lastly, the strategies used to support patient partners during their engagement, such as focus groups and face‐to‐face meetings, were determined using the word frequency query in NVIVO 12.

2.8. Stage 6: Consultation

According to the Scoping Review enhancements suggested by Levac,¹⁸ two consultation meetings were held with the patient partners, members of the Alberta SPOR Patient Engagement Platform²⁶ such as the Patient Engagement Research Lead, and the broader research team including students and academics. The first meeting occurred at the beginning of the project where attendees reviewed and provided comments to the study question and the overall search strategy including the search terms. The second consultation meeting occurred to gather input from stakeholders and the research team members on preliminary findings to provide context and thoughts to inform the potential implications from the review. Participants were notified of both consultation meetings one week prior by email.

3. RESULTS

After duplicates were removed (n = 1521), 6684 records were screened, and 979 records were selected for full‐text review. A total of 78 academic/peer‐reviewed articles¹⁰^,²⁷^,²⁸^,²⁹^,³⁰^,³¹^,³²^,³³^,³⁴^,³⁵^,³⁶^,³⁷^,³⁸^,³⁹^,⁴⁰^,⁴¹^,⁴²^,⁴³^,⁴⁴^,⁴⁵^,⁴⁶^,⁴⁷^,⁴⁸^,⁴⁹^,⁵⁰^,⁵¹^,⁵²^,⁵³^,⁵⁴^,⁵⁵^,⁵⁶^,⁵⁷^,⁵⁸^,⁵⁹^,⁶⁰^,⁶¹^,⁶²^,⁶³^,⁶⁴^,⁶⁵^,⁶⁶^,⁶⁷^,⁶⁸^,⁶⁹^,⁷⁰^,⁷¹^,⁷²^,⁷³^,⁷⁴^,⁷⁵^,⁷⁶^,⁷⁷^,⁷⁸^,⁷⁹^,⁸⁰^,⁸¹^,⁸²^,⁸³^,⁸⁴^,⁸⁵^,⁸⁶^,⁸⁷^,⁸⁸^,⁸⁹^,⁹⁰^,⁹¹^,⁹²^,⁹³^,⁹⁴^,⁹⁵^,⁹⁶^,⁹⁷^,⁹⁸^,⁹⁹^,¹⁰⁰^,¹⁰¹^,¹⁰²^,¹⁰³ and 41 grey literature items¹⁰⁴^,¹⁰⁵^,¹⁰⁶^,¹⁰⁷^,¹⁰⁸^,¹⁰⁹^,¹¹⁰^,¹¹¹^,¹¹²^,¹¹³^,¹¹⁴^,¹¹⁵^,¹¹⁶^,¹¹⁷^,¹¹⁸^,¹¹⁹^,¹²⁰^,¹²¹^,¹²²^,¹²³^,¹²⁴^,¹²⁵^,¹²⁶^,¹²⁷^,¹²⁸^,¹²⁹^,¹³⁰^,¹³¹^,¹³²^,¹³³^,¹³⁴^,¹³⁵^,¹³⁶^,¹³⁷^,¹³⁸^,¹³⁹^,¹⁴⁰^,¹⁴¹^,¹⁴²^,¹⁴³^,¹⁴⁴ were included (Figure 1).

3.1. Characteristics of included records

Figure 2 shows that the majority of the 119 included records were published in the United Kingdom (n = 56, 47%), followed by Canada (n = 35, 29%) and the United States (n = 14, 12%). The majority of the included records (n = 62, 52%) were published after 2016. The majority of research designs were reported as qualitative (n = 62, 52%), with case studies as the most common (n = 29, 24%), followed by unpublished research reports (n = 18, 15%) resulting from a programme called Patient and Community Engagement Researcher (PaCER).¹⁴⁵ Table 1 shows the majority of the included records are examples of patients who assume roles as patient partners, (n = 61, 51%) with the most common occurring at the “Collaborate” level (n = 60, 50%). Patient partner characteristics such as age, gender and ethnicity were infrequently reported. See Appendix S5 for a detailed patient partner data including from included studies.

Summary of included record characteristics

TABLE 1.

Summary of patient role by level of engagement

Patient role	Level of engagement (# of included records)
Patient role	Involve	Reference	Collaborate	Reference	Lead/support	Reference	Total
Member of research team	9	35, 42, 43, 46, 47, 49, 50, 70, 96	30	10, 30, 32, 34, 37, 38, 41, 44, 48, 51, 53, 58, 60, 62, 64, 66, 67, 68, 69, 71, 73, 74, 75, 77, 78, 80, 81, 94, 101, 128	22	27, 28, 54, 55, 99, 100, 112, 115, 118, 121, 123, 124, 125, 127, 129, 130, 131, 132, 135, 139, 140	61
Member of advisory group	18	33, 36, 57, 63, 65, 88, 89, 90, 91, 95, 105, 107, 109, 114, 119, 126, 134	22	29, 31, 39, 40, 45, 52, 56, 61, 76, 79, 82, 84, 92, 93, 97, 98, 102, 117, 120, 141, 143, 144	2	108, 137	42
Member of steering committee	2	86, 87	3	59, 72, 106	0		5
Member of working group	2	83, 85	2	116, 136	0		4
Not reported	0		3	110, 111, 113	4	104, 122, 133, 142	7
Total	31		60		28		119

Open in a new tab

3.2. Purpose of involvement

A thematic analysis of the purpose of involvement revealed five themes including Documenting and Advancing PPI, Relevance of Research, Co‐building, Capacity Building and Impact on Research.

The first theme, Documenting and Advancing PPI, was described when researchers involved patients as partners to describe the process used with the goal of advancing the science of patient involvement (n = 59, 39%). The next theme, Relevance of Research was described when researchers involved individuals to make the research more meaningful to those affected, such as by involving patients in developing the research question (n = 37, 24%). The third theme, Co‐building, described when researchers involved individuals in the development of a framework, tool or strategy (n = 28, 18%). The fourth theme, Capacity Building, described when opportunities were intentionally created to build the skills, confidence and knowledge of patients (n = 16, 10%). The final theme, Impact on Research, described the involvement of individuals in the conceptual aspects of research such as defining and refining research scope and research questions as well as the practical elements such as participant recruitment, writing grant proposals and undertaking research (n = 12, 8%). See Table 2.

TABLE 2.

Purpose of involvement

Theme	Frequency n (%)	Description
Documenting and advancing PPI	59 (39)	This theme described studies where researchers involved individuals in order to customize the engagement strategies to best support their projects and so to contribute to the evidence base by describing the process used such as Berg et al.²⁹ who used flexible methods to capture the knowledge and experience of participants
Relevance of research	37 (24)	This theme described when researchers involved individuals to make the research more meaningful to those affected, such as by involving patients in developing the research question such as Sauers‐Ford (2015) who involved parents in the development of the research project
Co‐building	28 (18)	This theme described when researchers involved individuals in co‐developing a framework, tool or strategy such as Horobin et al.⁵⁶ who involved individuals in co‐designing the research tools including the questionnaires and training sessions
Capacity building	16 (10)	This theme described when researchers created opportunities to build the skills, confidence and knowledge of patients such as Dennehy (2018) who engaged individuals using meetings designed to teach individuals a different part of the research process
Impact on research	12 (8)	This theme described the involvement of individuals in the conceptual aspects of research such as defining and refining research scope and research questions as well as the practical elements such as participant recruitment, writing grant proposals and undertaking specific research tasks such as Banfield et al²⁷ who involved patients throughout the research project and continually evaluated the process to ensure the research was relevant to those involved

Open in a new tab

3.3. Reported outcomes

Using the CIHR strategy for patient‐oriented research patient engagement strategy as a lens, outcomes were categorized according to one of the six components of successful patient engagement. These included the following: (a) Multi‐way Capacity Building (n = 25, 18%); (b) Inclusive Mechanisms and Processes (n = 19, 14%); (c) Multi‐way Communication and Collaboration (n = 18, 13%); (d) Patient‐informed and Directed Research (n = 7, 5%); (e) Experiential Knowledge is Valued as Evidence (n = 6, 4%); and (f) Shared Sense of Purpose, (n = 3, 2%). During analysis, two additional outcome categories were identified deductively: Improved Research Design, (n = 54; 39%); and Improved Health Outcomes (n = 2; 1%). See Figure 3.

Frequency of study outcome. *Additional outcome categories not currently defined by the CIHR Strategy for Patient Oriented Research – patient engagement framework⁷

3.4. Type of strategies used to support patient partner engagement

Included studies reported using multiple engagement strategies to support patient involvement. Using the word frequency query in NVIVO 12, the most common strategies used to support partner engagement were meetings (n = 37, 31%), followed by research activities where patients were involved in conducting or analysing data such as during focus groups (n = 29, 25%) and interviewing (n = 22, 19%). Regular communication strategies such as email (n = 8, 7%) and teleconferences (n = 8, 7%) were also used (Table 3).

TABLE 3.

Strategies used to support patient partner engagement

Strategy	Frequency (%)
Meetings	37 (31)
Focus groups	29 (25)
Interviews	22 (19)
Workshops	10 (8)
Email	8 (7)
Teleconference	8 (7)
Other research activities	4 (3)

Open in a new tab

4. DISCUSSION

Acknowledging a newly defined role for patients in health research, we undertook this scoping review to explore the role of patient as research partner. From 6684 academic and grey literature sources, we identified 119 records for inclusion. Performing thematic analysis, we revealed 5 themes for the purpose of engagement: Capacity Building; Impact on Research; Relevance of Research; Documenting and Advancing PPI; and Co‐building. We identified four classifications of the patient partner role including as members of research teams; advisory groups; steering committees; and working groups. We discovered the most commonly reported research designs were qualitative and the types of strategies used to support patient partners during engagement were consistent with activities researchers would use to support other members of the research team. Finally, using the CIHR strategy for patient‐oriented research patient engagement strategy as a lens, we categorized study outcomes into one of the six components of successful patient engagement and identified two additional categories identified during analysis including (a) Multi‐way Capacity Building; (b) Inclusive Mechanisms and Processes; (c) Multi‐way Communication and Collaboration; (d) Patient‐informed and Directed Research; (e) Experiential Knowledge is Valued as Evidence; (f) A Shared Sense of Purpose; (g) Improved Research Design; and, (h) Improved Health Outcomes.

Our findings build on a recent scoping review by Bird, which aimed to understand the impact of patient partnerships on research outcomes, identifying 14 studies which highlight how chronically ill patient partners were involved in research activities. The findings from Bird's review highlight critical barriers and facilitators for researchers seeking to undertake patient partnerships including power imbalances between patient partners and researchers.¹ Although Bird classified patients into one of the levels as defined by the Patient and Researcher Engagement framework,¹⁵ we classified studies according to the “higher” levels of engagement (collaborate, involve and lead/support) a decision supported by the literature.¹⁵^,¹⁶ We recognize this could imply a hierarchy between the levels of engagement; however, we did not find a notable difference in the study outcomes or type of engagement activities outlined between these three levels. This is a novel finding because often the argument is made that in order to have the greatest impact on a study, patients should assume greater responsibility as co‐researchers. While categorizing study outcomes, two additional outcomes, not described by the CIHR Strategy for Patient Oriented Research, were discovered, Improved Research Design and Improved Health Outcomes. These additional categories suggest the desired outcomes of the CIHR patient engagement framework could be expanded. Our findings also provide evidence of meaningful involvement, suggesting possible characteristics for engagement best practice considerations, described as researchers working alongside patient partners as members of the research team or as an advisory group/committee member, having a clear and mutually agreed upon purpose of the engagement, supported by a number of engagement activities, such as meetings. These findings are supported by Greenhalgh et al, who assert a single, “one‐size‐fits‐all framework” may be less useful than a range of co‐designed activities.¹⁴⁶

Furthermore, we found that the majority of the studies, regardless of the level of engagement as defined by the higher levels of the spectrum (involve, collaborate or lead/support), reported successful engagement. This change is in part because of the evolution of dedicated infrastructure and resources from governments, funders and partner organizations to prioritize patient engagement or involvement in research. Staley argues that a gap in understanding still remains in how the impacts or outcomes of patient engagement are achieved and suggests the solution is in providing more detailed accounts of patient involvement.¹⁴⁷ Given many of the included records infrequently reported key characteristics such as age and ethnicity, we suggest researchers go even further to report patient partner characteristics so comparisons can be made.

Additionally, national priorities and additional resources have precipitated further changes, with a surge of records on PPI since 2016 identified by this review (n = 62, 52%), primarily from the United Kingdom, Canada and the United States (47%, 29% and 12%, respectively). In contrast, patient involvement in research in low‐ and middle‐income countries (LMIC) is uncommon.¹⁴⁸ This may be due to lack of health infrastructure, socioeconomic status, cultural stigma and uncertain roles, but have the potential to improve with international‐focused collaboration.¹⁴⁸ However, we recognize that the majority of studies found were qualitative, specifically case studies or mixed methods in design. We recognize that patient engagement approaches in clinical trials¹⁴⁹^,¹⁵⁰ and data‐intensive health research¹⁵¹ require additional investment in training and capacity building for both patients and researchers.

4.1. Strengths and limitations

This study has strengths and limitations. Due to the comprehensive scope of the search, the volume of studies required us to limit to two academic databases, limit the publication dates of the included studies and limit our search to English language peer‐reviewed publications. These decisions were made to maintain the feasibility of the project. These limitations were balanced with a robust grey literature and hand‐searching strategy. Despite this, it is possible that a search without these imposed limitations may have yielded additional studies of relevance to this review. We identified the “higher” levels of engagement as a source of examples to describe patient as research partners. We believe our findings support this decision but suggest additional research be undertaken to further understand the similarities and/or differences between roles providing greater involvement, increased sharing of power and increased responsibilities and those that do not.¹⁶ When assigning studies to one of the six levels of engagement, as described by the Patient and Researcher Engagement spectrum,¹⁵ we assigned the level of engagement based on what was reported by the manuscript authors and acknowledge it is possible some studies were incorrectly assigned. We believe the duplicate review of each study and the addition of a third reviewer when consensus could not be reached minimized potential errors. Further, the patient partner‐led grey literature search and data extraction may be perceived as design bias by some. However, we feel that the robust methodological processes we developed to conduct this review minimized any potential for bias, while supporting greater understanding and confidence among the patient partners.

5. CONCLUSION

While significant research exists that highlights how researchers are involving patients in health research, the engagement of patient as research partner is not well described or understood. Our findings suggest, with much research focused on the mechanisms of how and theoretical frameworks of why to engage patients, the linkage between purpose of engagement and study outcomes are evident. The data set also enabled a greater understanding of the role of patient as partner in health research. Creating opportunities for the involvement of patients as partners, in all aspects of research, and across research designs, helps researchers and patients in building a critical mass for change on an individual and an organizational level.

CONFLICT OF INTERESTS

The authors declare that they have no conflict of interest.

AUTHOR CONTRIBUTIONS

TLM had significant involvement in the design, acquisition, analysis and interpretation of data. FC, TW and MS provided guidance in the overall design and delivery of the research. MS, AG, CM, JR and TLM were involved in the acquisition and final analysis. All authors provided revisions and the final approval to be published. All the named authors agree to take accountability for the integrity and accuracy of the work and have read and approved the final manuscript.

Supporting information

Supplementary Material

Click here for additional data file.^{(13.8KB, docx)}

Supplementary Material

Click here for additional data file.^{(58.4KB, docx)}

Supplementary Material

Click here for additional data file.^{(14.8KB, docx)}

Supplementary Material

Click here for additional data file.^{(9.7KB, xlsx)}

Supplementary Material

Click here for additional data file.^{(59.5KB, docx)}

ACKNOWLEDGEMENTS

The authors would like to thank the additional patient partners who contributed to the collection and analysis of the data in this review: Melissa Hartwell, Char Vanderhorst and Sophia Khan. We would also like to thank the Health Technology Assessment Unit at the University of Calgary for their guidance and support during this Review. We also wish to thank Farwa Naqvi for assistance during the review.

McCarron TL, Clement F, Rasiah J, et al. Patients as partners in health research: A scoping review. Health Expect. 2021;24:1378–1390. 10.1111/hex.13272

Funding information

This research was generously supported by the Alberta Strategy for Patient Oriented Research Unit at the University of Calgary and Alberta Health Services through the Strategic Clinical Networks™

Contributor Information

Fiona Clement, Email: mjsantan@ucalgary.ca.

Maria Santana, Email: mjsantan@ucalgary.ca.

DATA AVAILABILITY STATEMENT

All data generated or analysed during this study were included in this published article and/or its supplementary materials.

REFERENCES

1.Bird M, Ouellette C, Whitmore C, et al. Preparing for patient partnership: a scoping review of patient partner engagement and evaluation in research. Health Expect. 2020;23(3):523‐539. [DOI] [PMC free article] [PubMed] [Google Scholar]
2.INVOLVE . 2020. https://www.invo.org.uk. Accessed January 17, 2020.
3.PCORI . 2020. https://www.pcori.org. Accessed January 17, 2020.
4.SPOR . 2020. https://cihr‐irsc.gc.ca/e/41204.html. Accessed January 17, 2020.
5.Canadian Institutes of Health Research . Considerations when paying patient partners in research Canada. 2020. https://cihr‐irsc.gc.ca/e/51466.html. Accessed January 17, 2020.
6.Manafo E, Petermann L, Mason‐Lai P, Vandall‐Walker V. Patient engagement in Canada: a scoping review of the 'how' and 'what' of patient engagement in health research. Health Res Policy Syst. 2018;16(1). 10.1186/s12961-018-0282-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
7.Canadian Institute for Health Research . Strategy for patient‐oriented research – patient engagement framework. 2020. https://cihr‐irsc.gc.ca/e/48413.html. Accessed January 17, 2020.
8.Hoekstra F, Mrklas KJ, Khan M, et al. A review of reviews on principles, strategies, outcomes and impacts of research partnerships approaches: a first step in synthesising the research partnership literature. Health Res Pol Syst. 2020;18(1). 10.1186/s12961-020-0544-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
9.Domecq JP, Prutsky G, Elraiyah T, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14(1). 10.1186/1472-6963-14-89 [DOI] [PMC free article] [PubMed] [Google Scholar]
10.McCarron TL, Noseworthy T, Moffat K, et al. Understanding the motivations of patients: a co‐designed project to understand the factors behind patient engagement. Health Expect. 2019;22(4):709‐720. 10.1111/hex.12942 [DOI] [PMC free article] [PubMed] [Google Scholar]
11.Brett JO, Staniszewska S, Mockford C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637‐650. 10.1111/j.1369-7625.2012.00795.x [DOI] [PMC free article] [PubMed] [Google Scholar]
12.Smith E, Bélisle‐Pipon J‐C, Resnik D. Patients as research partners how to value their perceptions, contribution and labor? Citiz. Sci. Theory Pr. 2019;4(1). 10.5334/cstp.184 [DOI] [PMC free article] [PubMed] [Google Scholar]
13.Birch R, Simons G, Wähämaa H, et al. Development and formative evaluation of patient research partner involvement in a multi‐disciplinary European translational research project. Res Involv Engagem. 2020;6(1):1‐14. [DOI] [PMC free article] [PubMed] [Google Scholar]
14.Bagley HJ, Short H, Harman NL, et al. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Res Involv Engagem. 2016;2(1):15. [DOI] [PMC free article] [PubMed] [Google Scholar]
15.Manafo E, Petermann L, Vandall‐Walker V, Mason‐Lai P. Patient and public engagement in priority setting: a systematic rapid review of the literature. PLoS One. 2018;13(3):e0193579. 10.1371/journal.pone.0193579 [DOI] [PMC free article] [PubMed] [Google Scholar]
16.Carman KL, Dardess P, Maurer M, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff. 2013;32(2):223‐231. 10.1377/hlthaff.2012.1133 [DOI] [PubMed] [Google Scholar]
17.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19‐32. 10.1080/1364557032000119616 [DOI] [Google Scholar]
18.Levac D, Colquhoun H, O'Brien K. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1). 10.1186/1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]
19.Alberta SPOR Support Unit . Alberta SPOR support unit (AbSPORU). 2020. https://albertainnovates.ca/programs/strategy‐for‐patient‐oriented‐research/. Accessed November 17, 2019.
20.Albertans for Health Research . Find an opportunity. 2020. https://albertans4healthresearch.ca/opportunities. Accessed January 17, 2020.
21.McCarron TL, Clement F, Rasiah J, Moffat K, Wasylak T, Santana MJ. Co‐designing strategies to support patient partners during a scoping review and reflections on the process: a commentary. Res Involv Engagem. 2021;7(25). 10.1186/s40900-021-00272-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
22.Booth A. Clear and present questions: formulating questions for evidence based practice. Library Hi Tech. 2006;24(3):355‐368. 10.1108/07378830610692127 [DOI] [Google Scholar]
23.Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA‐ScR). Checklist Explanat. 2018;169:467‐473. [DOI] [PubMed] [Google Scholar]
24.CADTH . Grey Matters: a practical tool for searching health‐related grey literature Canada. 2019. https://www.cadth.ca/resources/finding‐evidence/grey‐matters
25.Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77‐101. [Google Scholar]
26.Alberta Strategy for Patient Oriented Research . Patient engagement platform Calgary, Alberta. 2020. https://spor.albertainnovates.ca/the‐alberta‐spor‐support‐unit/patient‐engagement‐platform/
27.Banfield M, Randall R, O'Brien M, et al. Lived experience researchers partnering with consumers and carers to improve mental health research: reflections from an Australian initiative. Int J Ment Health Nurs. 2018;27(4):1219‐1229. 10.1111/inm.12482 [DOI] [PubMed] [Google Scholar]
28.Bates MJ, Ardrey J, Mphwatiwa T, Squire SB, Niessen LW. Enhanced patient research participation: a Photovoice study in Blantyre Malawi. BMJ Support Palliat Care. 2018;8(2):171‐174. 10.1136/bmjspcare-2017-001439 [DOI] [PMC free article] [PubMed] [Google Scholar]
29.Berg M, Adolfsson A, Ranerup A, Sparud‐Lundin C, for the University of Gothenburg Centre for Person‐Centred C . Person‐centered Web support to women with type 1 diabetes in pregnancy and early motherhood–the development process. Diabetes Technol Ther. 2013;15(1):20‐25. 10.1089/dia.2012.0217 [DOI] [PubMed] [Google Scholar]
30.Best P, Badham J, Corepal R, et al. Network methods to support user involvement in qualitative data analyses: an introduction to participatory theme elicitation. Trials. 2017;18(1). 10.1186/s13063-017-2289-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
31.Blomqvist K, Theander E, Mowide I, Larsson V. What happens when you involve patients as experts? A participatory action research project at a renal failure unit. Nurs Inq. 2010;17(4):317‐323. [DOI] [PubMed] [Google Scholar]
32.Boyer AP, Fair AM, Joosten YA, et al. A multilevel approach to stakeholder engagement in the formulation of a clinical data research network. Med Care. 2018;56(Suppl 1):S22‐S26. 10.1097/mlr.0000000000000778 [DOI] [PMC free article] [PubMed] [Google Scholar]
33.Brach JS, Perera S, Gilmore S, et al. Stakeholder involvement in the design of a patient‐centered comparative effectiveness trial of the "On the Move" group exercise program in community‐dwelling older adults. Contemp Clin Trials. 2016;50:135‐142. 10.1016/j.cct.2016.08.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
34.Brainard JS, Al Assaf E, Omasete J, Leach S, Hammer CC, Hunter PR. Forced migrants involved in setting the agenda and designing research to reduce impacts of complex emergencies: combining Swarm with patient and public involvement. Res Involv Engagem. 2017;3:23. [DOI] [PMC free article] [PubMed] [Google Scholar]
35.Brear M. Process and outcomes of a recursive, dialogic member checking approach: a project ethnography. Qual Health Res. 2019;29(7):944‐957. 10.1177/1049732318812448 [DOI] [PubMed] [Google Scholar]
36.Brereton L, Ingleton C, Gardiner C, et al. Lay and professional stakeholder involvement in scoping palliative care issues: methods used in seven European countries. Palliat Med. 2017;31(2):181‐192. [DOI] [PubMed] [Google Scholar]
37.Callander R, Ning L, Crowley A, Childs B, Brisbane P, Salter T. Consumers and carers as partners in mental health research: reflections on the experience of two project teams in Victoria, Australia. Int J Ment Health Nurs. 2011;20(4):263‐273. 10.1111/j.1447-0349.2010.00731.x [DOI] [PubMed] [Google Scholar]
38.Carr ECJ, Patel JN, Ortiz MM, et al. Co‐design of a patient experience survey for arthritis central intake: an example of meaningful patient engagement in healthcare design. BMC Health Serv Res. 2019;19(1). 10.1186/s12913-019-4196-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
39.Chiu CG, Mitchell TL, Fitch MI. From patient to participant: enhancing the validity and ethics of cancer research through participatory research. J Cancer Educ. 2013;28(2):237‐246. 10.1007/s13187-013-0464-2 [DOI] [PubMed] [Google Scholar]
40.Clarke CL, Wilkinson H, Watson J, Wilcockson J, Kinnaird L, Williamson T. A seat around the table: participatory data analysis with people living with dementia. Qual Health Res. 2018;28(9):1421‐1433. 10.1007/s13187-013-0464-2 [DOI] [PubMed] [Google Scholar]
41.Concannon TW, Fuster M, Saunders T, et al. A systematic review of stakeholder engagement in comparative effectiveness and patient‐centered outcomes research. J Gen Intern Med. 2014;29(12):1692‐1701. [DOI] [PMC free article] [PubMed] [Google Scholar]
42.Coon JT, Gwernan‐Jones R, Moore D, et al. End‐user involvement in a systematic review of quantitative and qualitative research of non‐pharmacological interventions for attention deficit hyperactivity disorder delivered in school settings: reflections on the impacts and challenges. Health Expect. 2016;19(5):1084‐1097. 10.1111/hex.12400 [DOI] [PMC free article] [PubMed] [Google Scholar]
43.Costello W, Dorris E. Laying the groundwork: building relationships for public and patient involvement in pre‐clinical paediatric research. Health Expect. 2020;23(1):96‐105. 10.1111/hex.12972 [DOI] [PMC free article] [PubMed] [Google Scholar]
44.Dennehy R, Cronin M, Arensman E. Involving young people in cyberbullying research: the implementation and evaluation of a rights‐based approach. Health Expect. 2019;22(1):54‐64. 10.1111/hex.12830 [DOI] [PMC free article] [PubMed] [Google Scholar]
45.Dovey‐Pearce G, Walker S, Fairgrieve S, Parker M, Rapley T. The burden of proof: the process of involving young people in research. Health Expect. 2019;22(3):465‐474. 10.1111/hex.12870 [DOI] [PMC free article] [PubMed] [Google Scholar]
46.Edwards L, Monro M, Butterfield Y, et al. What matters most to patients about primary healthcare: mixed‐methods patient priority setting exercises within the PREFeR (PRioritiEs For Research) project. BMJ Open. 2019;9(7):e025954. [DOI] [PMC free article] [PubMed] [Google Scholar]
47.Elliott MJ, Goodarzi Z, Sale JEM, et al. Perceived significance of engagement in research prioritization among chronic kidney disease patients, caregivers, and health care professionals: a qualitative study. Can J Kidney Health Dis. 2018;5:205435811880748. 10.1177/2054358118807480 [DOI] [PMC free article] [PubMed] [Google Scholar]
48.Evans BA, Porter A, Snooks H, Burholt V. A co‐produced method to involve service users in research: the SUCCESS model. BMC Med Res Methodol. 2019;19(1). 10.1186/s12874-019-0671-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
49.Garwick AW, Seppelt AM. Developing a family‐centered participatory action research project. J Fam Nurs. 2010;16(3):269‐281. [DOI] [PubMed] [Google Scholar]
50.Gibson A, Welsman J, Britten N. Evaluating patient and public involvement in health research: from theoretical model to practical workshop. Health Expect. 2017;20(5):826‐835. 10.1111/hex.12486 [DOI] [PMC free article] [PubMed] [Google Scholar]
51.Gillard S, Simons L, Turner K, Lucock M, Edwards C. Patient and public involvement in the coproduction of knowledge: reflection on the analysis of qualitative data in a mental health study. Qual Health Res. 2012;22(8):1126‐1137. 10.1177/1049732312448541 [DOI] [PubMed] [Google Scholar]
52.Hamilton CB, Hoens AM, Backman CL, et al. An empirically based conceptual framework for fostering meaningful patient engagement in research. Health Expect. 2018;21(1):396‐406. 10.1111/hex.12635 [DOI] [PMC free article] [PubMed] [Google Scholar]
53.Hamilton CB, Hoens AM, McQuitty S, et al. Development and pre‐testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS One. 2018;13(11):e0206588. 10.1371/journal.pone.0206588 [DOI] [PMC free article] [PubMed] [Google Scholar]
54.Hofmann D, Ibrahim F, Rose D, et al. Expectations of new treatment in rheumatoid arthritis: developing a patient‐generated questionnaire. Health Expect. 2015;18(5):995‐1008. 10.1111/hex.12073 [DOI] [PMC free article] [PubMed] [Google Scholar]
55.Holmes L, Cresswell K, Williams S, et al. Innovating public engagement and patient involvement through strategic collaboration and practice. Res Involv Engagem. 2019;5(1):30. 10.1186/s40900-019-0160-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
56.Horobin A, Brown G, Higton F, et al. Co‐producing public involvement training with members of the public and research organisations in the East Midlands: creating, delivering and evaluating the lay assessor training programme. Res Involv Engagem. 2017;3:7. [DOI] [PMC free article] [PubMed] [Google Scholar]
57.Hull D, Barton D, Guo K, Russell C, Aucott B, Wiles D. Patient and public involvement to support liver disease research. Br J Nurs. 2012;21(16):972‐976. 10.12968/bjon.2012.21.16.972 [DOI] [PubMed] [Google Scholar]
58.Iliffe S, McGrath T, Mitchell D. The impact of patient and public involvement in the work of the Dementias & Neurodegenerative Diseases Research Network (DeNDRoN): case studies. Health Expect. 2013;16(4):351‐361. [DOI] [PMC free article] [PubMed] [Google Scholar]
59.Irving A, Turner J, Marsh M, et al. A coproduced patient and public event: an approach to developing and prioritizing ambulance performance measures. Health Expect. 2018;21(1):230‐238. 10.1111/hex.12606 [DOI] [PMC free article] [PubMed] [Google Scholar]
60.Jennings H, Slade M, Bates P, Munday E, Toney R. Best practice framework for Patient and Public Involvement (PPI) in collaborative data analysis of qualitative mental health research: methodology development and refinement. BMC Psychiatry. 2018;18(1). 10.1186/s12888-018-1794-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
61.Jorgensen CR, Eskildsen NB, Johnsen AT. User involvement in a Danish project on the empowerment of cancer patients – experiences and early recommendations for further practice. Res Involv Engagem. 2018;4:26. [DOI] [PMC free article] [PubMed] [Google Scholar]
62.Jorgensen CR, Eskildsen NB, Thomsen TG, Nielsen ID, Johnsen AT. The impact of using peer interviewers in a study of patient empowerment amongst people in cancer follow‐up. Health Expect. 2018;21(3):620‐627. 10.1111/hex.12655 [DOI] [PMC free article] [PubMed] [Google Scholar]
63.Kandiyali R, Hawton A, Cabral C, et al. Working with patients and members of the public: informing health economics in child health research. Pharmacoeconom Open. 2019;3(2):133‐141. 10.1007/s41669-018-0099-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
64.Keenan J, Poland F, Boote J, et al. 'We're passengers sailing in the same ship, but we have our own berths to sleep in': evaluating patient and public involvement within a regional research programme: an action research project informed by normalisation process theory. PLoS One. 2019;14(5):e0215953. 10.1371/journal.pone.0215953 [DOI] [PMC free article] [PubMed] [Google Scholar]
65.Kim KK, Khodyakov D, Marie K, et al. A Novel stakeholder engagement approach for patient‐centered outcomes research. Med Care. 2018;56(Suppl 1):S41‐S47. 10.1097/mlr.0000000000000790 [DOI] [PMC free article] [PubMed] [Google Scholar]
66.Kristensen S, Mainz J, Baandrup L, et al. Conceptualizing patient‐reported outcome measures for use within two Danish psychiatric clinical registries: description of an iterative co‐creation process between patients and healthcare professionals. Nord J Psychiatry. 2018;72(6):409‐419. 10.1080/08039488.2018.1492017 [DOI] [PubMed] [Google Scholar]
67.Larkin M, Boden ZVR, Newton E. On the brink of genuinely collaborative care. Qual Health Res. 2015;25(11):1463‐1476. 10.1177/1049732315576494 [DOI] [PubMed] [Google Scholar]
68.Leese J, Macdonald G, Kerr S, et al. ‘Adding another spinning plate to an already busy life’. Benefits and risks in patient partner–researcher relationships: a qualitative study of patient partners’ experiences in a Canadian health research setting. BMJ Open. 2018;8(8):e022154. 10.1136/bmjopen-2018-022154 [DOI] [PMC free article] [PubMed] [Google Scholar]
69.Likumahuwa‐Ackman S, Angier H, Sumic A, et al. IMPACCT kids' care: a real‐world example of stakeholder involvement in comparative effectiveness research. J Comp Eff Res. 2015;4(4):351‐357. [DOI] [PMC free article] [PubMed] [Google Scholar]
70.Lowes L, Robling MR, Bennert K, et al. Involving lay and professional stakeholders in the development of a research intervention for the DEPICTED study. Health Expect. 2011;14(3):250‐260. 10.1111/j.1369-7625.2010.00625.x [DOI] [PMC free article] [PubMed] [Google Scholar]
71.Malus M, Shulha M, Granikov V, et al. A participatory approach to understanding and measuring patient satisfaction in a primary care teaching setting. Prog Community Health Partnersh. 2011;5(4):417‐424. [PubMed] [Google Scholar]
72.Mann C, Chilcott S, Plumb K, Brooks E, Man MS. Reporting and appraising the context, process and impact of PPI on contributors, researchers and the trial during a randomised controlled trial – the 3D study. Res Involv Engagem. 2018;4:15. [DOI] [PMC free article] [PubMed] [Google Scholar]
73.Marks S, Mathie E, Smiddy J, Jones J, da Silva‐Gane M. Reflections and experiences of a co‐researcher involved in a renal research study. Res Involv Engagem. 2018;4(1). 10.1186/s40900-018-0120-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
74.Mawn L, Welsh P, Stain HJ, Windebank P. Youth Speak: increasing engagement of young people in mental health research. J Ment Health. 2015;24(5):271‐275. 10.3109/09638237.2014.998810 [DOI] [PubMed] [Google Scholar]
75.McCarron TL, Moffat K, Wilkinson G, et al. Understanding patient engagement in health system decision‐making: a co‐designed scoping review. Syst Rev. 2019;8(1):97. [DOI] [PMC free article] [PubMed] [Google Scholar]
76.Mockford C, Murray M, Seers K, et al. A SHARED study‐the benefits and costs of setting up a health research study involving lay co‐researchers and how we overcame the challenges. Res Involv Engagem. 2016;2:8. [DOI] [PMC free article] [PubMed] [Google Scholar]
77.Moltu C, Stefansen J, Svisdahl M, Veseth M. Negotiating the coresearcher mandate – service users' experiences of doing collaborative research on mental health. Disabil Rehabil. 2012;34(19):1608‐1616. [DOI] [PubMed] [Google Scholar]
78.Nierse CJ, Abma TA. Developing voice and empowerment: the first step towards a broad consultation in research agenda setting. J Intellect Disabil Res. 2011;55(4):411‐421. [DOI] [PubMed] [Google Scholar]
79.Nierse CJ, Schipper K, van Zadelhoff E, van de Griendt J, Abma TA. Collaboration and co‐ownership in research: dynamics and dialogues between patient research partners and professional researchers in a research team. Health Expect. 2012;15(3):242‐254. 10.1111/j.1369-7625.2011.00661.x [DOI] [PMC free article] [PubMed] [Google Scholar]
80.Nowell WB, Curtis JR, Crow‐Hercher R. Patient governance in a patient‐powered research network for adult rheumatologic conditions. Med Care. 2018;56(Suppl 1):S16‐S21. 10.1097/mlr.0000000000000814 [DOI] [PMC free article] [PubMed] [Google Scholar]
81.O’Donnell D, Ní Shé É, McCarthy M, et al. Enabling public, patient and practitioner involvement in co‐designing frailty pathways in the acute care setting. BMC Health Serv Res. 2019;19(1). 10.1186/s12913-019-4626-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
82.O'Gorman CM, Smith Martin M, Oliffe JL, Leggo C, Korchinski M, Martin RE. Community voices in program development: the wisdom of individuals with incarceration experience. Can J Public Health. 2012;103(5):e379–e383. 10.1007/bf03404446 [DOI] [PMC free article] [PubMed] [Google Scholar]
83.O’Hara MC, Hynes L, O’Donnell M, et al. Strength in numbers: an international consensus conference to develop a novel approach to care delivery for young adults with type 1 diabetes, the D1 now study. Res Involv Engagem. 2017;3:25. [DOI] [PMC free article] [PubMed] [Google Scholar]
84.Ostrow L, Penney D, Stuart E, Leaf PJ. Web‐based survey data collection with peer support and advocacy organizations: implications of participatory methods. Prog Community Health Partnersh. 2017;11(1):45‐52. 10.1353/cpr.2017.0006 [DOI] [PubMed] [Google Scholar]
85.Portalupi LB, Lewis CL, Miller CD, et al. Developing a patient and family research advisory panel to include people with significant disease, multimorbidity and advanced age. Fam Pract. 2017;34(3):364‐369. [DOI] [PMC free article] [PubMed] [Google Scholar]
86.Read S, Maslin‐Prothero S. The involvement of users and carers in health and social research: the realities of inclusion and engagement. Qual Health Res. 2011;21(5):704‐713. 10.1177/1049732310391273 [DOI] [PubMed] [Google Scholar]
87.Sauers‐Ford HS, Simmons JM, Shah SS, et al. Strategies to engage stakeholders in research to improve acute care delivery. J Hosp Med. 2016;11(2):123‐125. 10.1002/jhm.2492 [DOI] [PubMed] [Google Scholar]
88.Saunders T, Mackie TI, Shah S, Gooding H, de Ferranti SD, Leslie LK. Young adult and parent stakeholder perspectives on participation in patient‐centered comparative effectiveness research. J Comp Eff Res. 2016;5(5):487‐497. 10.2217/cer-2016-0025 [DOI] [PubMed] [Google Scholar]
89.Schenk EC, Bryant RA, Van Son CR, Odom‐Maryon T. Developing an intervention to reduce harm in hospitalized patients: patients and families in research. J Nurs Care Qual. 2019;34(3):273‐278. 10.1097/ncq.0000000000000354 [DOI] [PubMed] [Google Scholar]
90.Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, et al. Patient and service user engagement in research: a systematic review and synthesized framework. Health Expect. 2015;18(5):1151‐1166. 10.1111/hex.12090 [DOI] [PMC free article] [PubMed] [Google Scholar]
91.Slade M, Bird V, Chandler R, et al. The contribution of advisory committees and public involvement to large studies: case study. BMC Health Serv Res. 2010;10(1). 10.1186/1472-6963-10-323 [DOI] [PMC free article] [PubMed] [Google Scholar]
92.Snape D, Kirkham J, Britten N, et al. Exploring perceived barriers, drivers, impacts and the need for evaluation of public involvement in health and social care research: a modified Delphi study. BMJ Open. 2014;4(6):e004943. [DOI] [PMC free article] [PubMed] [Google Scholar]
93.Tapp H, Derkowski D, Calvert M, Welch M, Spencer S. Patient perspectives on engagement in shared decision‐making for asthma care. Fam Pract. 2017;34(3):353‐357. [DOI] [PMC free article] [PubMed] [Google Scholar]
94.Taylor C, Gill L, Gibson A, Byng R, Quinn C. Engaging, "seldom heard" groups in research and intervention development: offender mental health. Health Expect. 2018;21(6):1104‐1110. 10.1111/hex.12807 [DOI] [PMC free article] [PubMed] [Google Scholar]
95.Vaillancourt S, Beaton D, Maybee A. Engaging patients to develop a patient‐reported outcome measure for the emergency department. CMAJ. 2018;190(Suppl):S50‐S52. 10.1503/cmaj.180353 [DOI] [PMC free article] [PubMed] [Google Scholar]
96.Vale CL, Tierney JF, Spera N, Whelan A, Nightingale A, Hanley B. Evaluation of patient involvement in a systematic review and meta‐analysis of individual patient data in cervical cancer treatment. Syst Rev. 2012;1(1):23. [DOI] [PMC free article] [PubMed] [Google Scholar]
97.Wikman A, Kukkola L, Börjesson H, et al. Development of an internet‐administered cognitive behavior therapy program (ENGAGE) for parents of children previously treated for cancer: participatory action research approach. J Med Internet Res. 2018;20(4):e133. 10.2196/jmir.9457 [DOI] [PMC free article] [PubMed] [Google Scholar]
98.Williamson T, Kenney L, Barker AT, et al. Enhancing public involvement in assistive technology design research. Disabil Rehabil Assist Technol. 2015;10(3):258‐265. [DOI] [PubMed] [Google Scholar]
99.Wilson T, Miller J, Teare S, et al. Patient perspectives on engagement in decision‐making in early management of non‐ST elevation acute coronary syndrome: a qualitative study. BMC Med Inform Decis Mak. 2017;17(1):153. 10.1186/s12911-017-0555-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
100.Bryant W, Parsonage J, Tibbs A, Andrews C, Clark J, Franco L. Meeting in the mist: key considerations in a collaborative research partnership with people with mental health issues. Work. 2012;43(1):23‐31. [DOI] [PubMed] [Google Scholar]
101.Stevenson M, Taylor BJ. Involving individuals with dementia as co‐researchers in analysis of findings from a qualitative study. Dementia (London). 2019;18(2):701‐712. 10.1177/1471301217690904 [DOI] [PubMed] [Google Scholar]
102.Marsden J, Bradburn J. Patient and clinician collaboration in the design of a national randomized breast cancer trial. Health Expect. 2004;7(1):6‐17. 10.1111/j.1369-7625.2004.00232.x [DOI] [PMC free article] [PubMed] [Google Scholar]
103.O’Brien P, McConkey R, García‐Iriarte E. Co‐researching with people who have intellectual disabilities: insights from a national survey. J Appl Res Intellect Disabil. 2014;27(1):65‐75. 10.1111/jar.12074 [DOI] [PubMed] [Google Scholar]
104.Healthtalk . Patient and public involvement on healthtalk.org. 2014. https://www.invo.org.uk/noticeboard/
105.Afzal C, Donnelly A, Giles S, Hammond P. Establishing a research user group from the Greater Manchester Primary Care Patient Safety Translational Research Centre. 2014. https://www.invo.org.uk/posttypeconference/establishing‐a‐research‐user‐group‐from‐the‐greater‐manchester‐primary‐care‐patient‐safety‐translational‐research‐centre/
106.Armitage G, Crane D, Giles S, Parveen S, Reynolds C. Patient involvement in the development of a patient safety intervention. 2014. https://www.invo.org.uk/posttypeconference/patient‐involvement‐in‐the‐development‐of‐a‐patient‐safety‐intervention/
107.Bartram J, Lawson J, Marshall L. Arthritis Research UK Centre for sport exercise and osteoarthritis: changing research culture and improving understanding of patient and public involvement (PPI). 2014. https://www.invo.org.uk/posttypeconference/arthritis‐research‐uk‐centre‐for‐sport‐exercise‐and‐osteoarthritis‐changing‐research‐culture‐and‐improving‐understanding‐of‐patient‐and‐public‐involvement‐ppi/
108.Bell S, Donnelly A, Planner C. PRIMER (Primary Care Research in Manchester Engagement Resource): a patient, carer and public involvement group working collaboratively with primary care researchers. 2014. https://www.invo.org.uk/posttypeconference/primer‐primary‐care‐research‐in‐manchester‐engagement‐resource‐a‐patient‐carer‐and‐public‐involvement‐group‐working‐collaboratively‐with‐primary‐care‐researchers/
109.Beresford J, Boote J, Gamble C, Giles S, Thompson J. “Doing PPI at scale”. Exploring the impact of public involvement in the NIHR Greater Manchester Primary Care Patient Safety Translational Research Centre: interim findings of a formative evaluation. 2014. https://www.invo.org.uk/posttypeconference/doing‐ppi‐at‐scale‐exploring‐the‐impact‐of‐public‐involvement‐in‐the‐nihr‐greater‐manchester‐primary‐care‐patient‐safety‐translational‐research‐centre‐interim‐findings‐of‐a‐formati/
110.Boaz A, Chambers M, O'Shea A. The role of public and patient involvement in clinical commissioning groups. 2014. https://www.invo.org.uk/posttypeconference/the‐role‐of‐public‐and‐patient‐involvement‐in‐clinical‐commissioning‐groups/ [DOI] [PMC free article] [PubMed]
111.Boet S. Out‐of‐the‐box thinking. 2019. https://ossu.ca/2019/09/out‐of‐the‐box‐thinking/
112.Boulton D, Oswell D, Oxland P. Patient and family experiences when moving from the intensive care unit (ICU) to a hospital ward. 2015. https://prism.ucalgary.ca/bitstream/handle/1880/109947/20150130_MovingFromICU_internshipreport.pdf?sequence=1&isAllowed=y
113.Bourke S, Knowles S, Planner C. Hacking health research: supporting rapid patient and public involvement (PPI) through patient hack days. 2014. https://www.invo.org.uk/posttypeconference/hacking‐health‐research‐supporting‐rapid‐patient‐and‐public‐involvement‐ppi‐through‐patient‐hack‐days/
114.Britt D, Eglin S, Raymond G. Developing a regional approach to patient and public involvement in research: experience in the North West. 2010. https://www.invo.org.uk/posttypeconference/developing‐a‐regional‐approach‐to‐patient‐and‐public‐involvement‐in‐research‐experience‐in‐the‐north‐west/
115.Bryk C, Lewis TR, Penman C, Miller J, Teare S. The experience of waiting for help with osteoarthritis. 2013. https://prism.ucalgary.ca/bitstream/handle/1880/109968/20130826_WaitingForHelp_internshipreport.pdf?sequence=4&isAllowed=y
116.Cameron T, Patel N, Wray P. The CLAHRC East Midlands Patient and Public Partners’ Council and Centre for Black and Minority Ethnic Health initiatives, are supporting proportional, representative and diverse public involvement throughout the organisation, health research and regional structures. 2014. https://www.invo.org.uk/posttypeconference/the‐clahrc‐east‐midlands‐patient‐and‐public‐partners‐council‐and‐centre‐for‐black‐and‐minority‐ethnic‐health‐initiatives‐are‐supporting‐proportional‐representative‐and‐diverse‐public‐involvement‐t/
117.Canadian Foundation for Healthcare I . Better together. 2017. https://www.cfhi‐fcass.ca/about/news‐and‐stories/news‐detail/2020/05/19/report‐of‐the‐2017‐better‐together‐policy‐roundtable
118.Choudhury R, Wheeler L. Patient engagement in breast health education initiative. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109937/20171031_BreastHealth_PaCERreport.pdf?sequence=4&isAllowed=y
119.Dakers Thomson M, Worth A. Challenging landscapes: establishing patient and public involvement in a clinical research setting. 2014. https://www.invo.org.uk/posttypeconference/challenging‐landscapes‐establishing‐patient‐and‐public‐involvement‐in‐a‐clinical‐research‐setting/
120.Dickie C, Culbert M. PREFeR (PRioritiEs For Research) Project. https://spor‐bcphcrn.ca/projects/prefer/
121.Fairs C, Lengkeek S, Van Engelen A, McKinney L. Living with inflammatory bowel disease. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109952/201602_LivingWithIBD_internshipreport.pdf?sequence=1&isAllowed=y
122.Mossie F, Steel R. Patient research ambassadors: providing patient leadership in NHS research? 2014. https://www.invo.org.uk/posttypeconference/patient‐research‐ambassadors‐providing‐patient‐leadership‐in‐nhs‐research/
123.Gill M, Boulton D, Oswell D, Oxland P. Understanding patient and family experiences in the daily care of criticially Ill patients. 2014. https://prism.ucalgary.ca/bitstream/handle/1880/109970/20140926_DailyCareCriticallyIll_PaCERreport.pdf?sequence=1&isAllowed=y
124.Gill M, Nguyen S, Shklarov S. Patient experience of waiting for elective surgery. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109941/20170714_WaitingElectiveSurgery_PaCERreport.pdf?sequence=1&isAllowed=y
125.Gill M, Zelinsky S, Gillis C, Nguyen S. ERAS from the patient perspective. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109966/20161018_ERASPerspective_PaCERreport.pdf?sequence=1&isAllowed=y
126.Loud F. Patient involvement in quality improvement: how a self‐management intervention for a long‐term condition (chronic kidney disease – CKD) was both developed and delivered to practitioners by a patient advisory group. 2012. https://www.invo.org.uk/posttypeconference/patient‐involvement‐in‐quality‐improvement‐how‐a‐self‐management‐intervention‐for‐a‐long‐term‐condition‐chronic‐kidney‐disease‐ckd‐was‐both‐developed‐and‐delivered‐to‐practitioners‐by‐a‐patient‐a/
127.Marlett N, Gill M, Kozcur S, Choudhury R. Patient perspectives and expectations about primary care by occasional users, seniors and those with complex and chronic care needs. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109950/20170304_ExpectationsPrimaryCare_PaCERreport.pdf?sequence=1&isAllowed=y
128.Maybee A, Chandani S. Person generated health data (PGHD) principles: through the patients and caregivers lens. 2019. https://95c34945‐b08e‐4116‐9057‐56dd704184dd.filesusr.com/ugd/6ac9da_e1ac2ad9be9a407b863ae9712e72ce77.pdf
129.Miller J, Teare S. Report on the PaCER component of the knee osteoarthritis and self –management knowledge. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109944/20170614_KOASK_PaCERreport.pdf?sequence=1&isAllowed=y
130.Miller J, Teare S. Patient engagement to identify priorities for shared decision‐making tools in cardiac care. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109957/20160229_SharedDecisionmakingCardiacCare_PaCERreport.pdf?sequence=1&isAllowed=y
131.Miller J, Teare S. Meaningful results from meaningful engagement: enabling patient and family participation in the AHS seniors health SCN. 2015. https://prism.ucalgary.ca/bitstream/handle/1880/109971/20150405_EnablingPatientFamilyParticipation_PaCERreport.pdf?sequence=1&isAllowed=y
132.Miller J, Teare S. Report on the PaCER component of the AS MOC study. 2014. https://prism.ucalgary.ca/handle/1880/109961
133.Nunn J, Grayson M. Building research partnerships. https://www.invo.org.uk/building‐research‐partnerships/
134.Palm M. Patient and public involvement in the Manchester Biomedical Research Centre. 2012. https://www.invo.org.uk/posttypeconference/patient‐and‐public‐involvement‐in‐the‐manchester‐biomedical‐research‐centre/
135.Persaud N, Shah B. The impact of providing carefully selected essential medications at no charge to primary care patients. 2019. https://ossu.ca/for‐researchers/impact‐awards/improved‐care‐and‐prevention/improving‐access‐to‐medications/
136.Pritchard R. Implementing public and patient engagement in research: lessons learned from a three‐strand strategy. 2012. https://www.invo.org.uk/posttypeconference/implementing‐public‐and‐patient‐engagement‐in‐research‐lessons‐learned‐from‐a‐three‐strand‐strategy/
137.Rainey P, Morris C. Consumers take the initiative in patient and public involvement (PPI) training. https://www.invo.org.uk/consumers‐take‐the‐initiative‐in‐patient‐and‐public‐involvement‐ppi‐training/
138.Roland B, Wheatley V, Jones A, Gillis C. Stillbirth, still life: a qualitative patient‐led study on parents’ unsilenced stories of stillbirth. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109948/2017_StillbirthStillLife_internshipreport.pdf?sequence=1&isAllowed=y
139.Shearkani S, McKinnon A, Maybee A. Uncovering the experiences of patients and caregivers as couples. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109958/20160517_CaregiversAsCouples_internshipreport.pdf?sequence=1&isAllowed=y
140.Sheridan M, Zelinsky S, Gill M. Understanding safe surgery checklist experiences of surgical patients in Alberta. 2014. https://prism.ucalgary.ca/bitstream/handle/1880/109963/20140325_UnderstandingSafeSurgeryChecklist_PaCERreport.pdf?sequence=1&isAllowed=y
141.Taylor J. Jane Taylor. https://www.invo.org.uk/posttypemembers/jane‐taylor/
142.Aden Z. Reviewing funding applications: an example of tangible patient involvement at the proposal stage. 2014. https://www.invo.org.uk/posttypeconference/reviewing‐funding‐applications‐an‐example‐of‐tangible‐patient‐involvement‐at‐the‐proposal‐stage/
143.Johansson J. Patient views on ladders of engagement Ontario: Ontario SPOR support unit. 2018. https://ossu.ca/wp‐content/uploads/Patient‐views‐on‐ladders‐of‐engagement‐Johannesen‐FINAL‐JJ‐v3.pdf
144.CHSRF . Patients and professionals partnerning to redesign inpatient care. 2012. https://www.youtube.com/watch?v=OXIylBCJstE&list=UUm‐tze53Qzz2nZzLLVK0mVA&index=1&feature=plcp
145.PaCER . We are PaCER. 2020. https://pacerinnovates.ca
146.Greenhalgh T, Hinton L, Finlay T, et al. Frameworks for supporting patient and public involvement in research: systematic review and co‐design pilot. Health Expect. 2019;22(4):785‐801. [DOI] [PMC free article] [PubMed] [Google Scholar]
147.Staley K. ‘Is it worth doing?’ Measuring the impact of patient and public involvement in research. Res Involv Engagem. 2015;1(1):6. [DOI] [PMC free article] [PubMed] [Google Scholar]
148.Janic A, Kimani K, Olembo I, Dimaras H. Lessons for patient engagement in research in low‐ and middle‐income countries. Ophthalmol Ther. 2020;9(2):221. [DOI] [PMC free article] [PubMed] [Google Scholar]
149.Schilling I, Behrens H, Hugenschmidt C, Liedtke J, Schmiemann G, Gerhardus A. Patient involvement in clinical trials: motivation and expectations differ between patients and researchers involved in a trial on urinary tract infections. Res Involv Engagem. 2019;5(1). [DOI] [PMC free article] [PubMed] [Google Scholar]
150.Coulman KD, Nicholson A, Shaw A, et al. Understanding and optimising patient and public involvement in trial oversight: an ethnographic study of eight clinical trials. Trials. 2020;21(1). 10.1186/s13063-020-04495-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
151.Hobbs G, Tully MP. Realist evaluation of public engagement and involvement in data‐intensive health research. Res Involv Engagem. 2020;6(37). 10.1186/s40900-020-00215-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material

Click here for additional data file.^{(13.8KB, docx)}

Supplementary Material

Click here for additional data file.^{(58.4KB, docx)}

Supplementary Material

Click here for additional data file.^{(14.8KB, docx)}

Supplementary Material

Click here for additional data file.^{(9.7KB, xlsx)}

Supplementary Material

Click here for additional data file.^{(59.5KB, docx)}

Data Availability Statement

All data generated or analysed during this study were included in this published article and/or its supplementary materials.

[hex13272-bib-0001] 1.Bird M, Ouellette C, Whitmore C, et al. Preparing for patient partnership: a scoping review of patient partner engagement and evaluation in research. Health Expect. 2020;23(3):523‐539. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0002] 2.INVOLVE . 2020. https://www.invo.org.uk. Accessed January 17, 2020.

[hex13272-bib-0003] 3.PCORI . 2020. https://www.pcori.org. Accessed January 17, 2020.

[hex13272-bib-0004] 4.SPOR . 2020. https://cihr‐irsc.gc.ca/e/41204.html. Accessed January 17, 2020.

[hex13272-bib-0005] 5.Canadian Institutes of Health Research . Considerations when paying patient partners in research Canada. 2020. https://cihr‐irsc.gc.ca/e/51466.html. Accessed January 17, 2020.

[hex13272-bib-0006] 6.Manafo E, Petermann L, Mason‐Lai P, Vandall‐Walker V. Patient engagement in Canada: a scoping review of the 'how' and 'what' of patient engagement in health research. Health Res Policy Syst. 2018;16(1). 10.1186/s12961-018-0282-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0007] 7.Canadian Institute for Health Research . Strategy for patient‐oriented research – patient engagement framework. 2020. https://cihr‐irsc.gc.ca/e/48413.html. Accessed January 17, 2020.

[hex13272-bib-0008] 8.Hoekstra F, Mrklas KJ, Khan M, et al. A review of reviews on principles, strategies, outcomes and impacts of research partnerships approaches: a first step in synthesising the research partnership literature. Health Res Pol Syst. 2020;18(1). 10.1186/s12961-020-0544-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0009] 9.Domecq JP, Prutsky G, Elraiyah T, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14(1). 10.1186/1472-6963-14-89 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0010] 10.McCarron TL, Noseworthy T, Moffat K, et al. Understanding the motivations of patients: a co‐designed project to understand the factors behind patient engagement. Health Expect. 2019;22(4):709‐720. 10.1111/hex.12942 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0011] 11.Brett JO, Staniszewska S, Mockford C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637‐650. 10.1111/j.1369-7625.2012.00795.x [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0012] 12.Smith E, Bélisle‐Pipon J‐C, Resnik D. Patients as research partners how to value their perceptions, contribution and labor? Citiz. Sci. Theory Pr. 2019;4(1). 10.5334/cstp.184 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0013] 13.Birch R, Simons G, Wähämaa H, et al. Development and formative evaluation of patient research partner involvement in a multi‐disciplinary European translational research project. Res Involv Engagem. 2020;6(1):1‐14. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0014] 14.Bagley HJ, Short H, Harman NL, et al. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Res Involv Engagem. 2016;2(1):15. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0015] 15.Manafo E, Petermann L, Vandall‐Walker V, Mason‐Lai P. Patient and public engagement in priority setting: a systematic rapid review of the literature. PLoS One. 2018;13(3):e0193579. 10.1371/journal.pone.0193579 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0016] 16.Carman KL, Dardess P, Maurer M, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff. 2013;32(2):223‐231. 10.1377/hlthaff.2012.1133 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0017] 17.Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19‐32. 10.1080/1364557032000119616 [DOI] [Google Scholar]

[hex13272-bib-0018] 18.Levac D, Colquhoun H, O'Brien K. Scoping studies: advancing the methodology. Implement Sci. 2010;5(1). 10.1186/1748-5908-5-69 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0019] 19.Alberta SPOR Support Unit . Alberta SPOR support unit (AbSPORU). 2020. https://albertainnovates.ca/programs/strategy‐for‐patient‐oriented‐research/. Accessed November 17, 2019.

[hex13272-bib-0020] 20.Albertans for Health Research . Find an opportunity. 2020. https://albertans4healthresearch.ca/opportunities. Accessed January 17, 2020.

[hex13272-bib-0021] 21.McCarron TL, Clement F, Rasiah J, Moffat K, Wasylak T, Santana MJ. Co‐designing strategies to support patient partners during a scoping review and reflections on the process: a commentary. Res Involv Engagem. 2021;7(25). 10.1186/s40900-021-00272-3 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0022] 22.Booth A. Clear and present questions: formulating questions for evidence based practice. Library Hi Tech. 2006;24(3):355‐368. 10.1108/07378830610692127 [DOI] [Google Scholar]

[hex13272-bib-0023] 23.Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA‐ScR). Checklist Explanat. 2018;169:467‐473. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0024] 24.CADTH . Grey Matters: a practical tool for searching health‐related grey literature Canada. 2019. https://www.cadth.ca/resources/finding‐evidence/grey‐matters

[hex13272-bib-0025] 25.Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77‐101. [Google Scholar]

[hex13272-bib-0026] 26.Alberta Strategy for Patient Oriented Research . Patient engagement platform Calgary, Alberta. 2020. https://spor.albertainnovates.ca/the‐alberta‐spor‐support‐unit/patient‐engagement‐platform/

[hex13272-bib-0027] 27.Banfield M, Randall R, O'Brien M, et al. Lived experience researchers partnering with consumers and carers to improve mental health research: reflections from an Australian initiative. Int J Ment Health Nurs. 2018;27(4):1219‐1229. 10.1111/inm.12482 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0028] 28.Bates MJ, Ardrey J, Mphwatiwa T, Squire SB, Niessen LW. Enhanced patient research participation: a Photovoice study in Blantyre Malawi. BMJ Support Palliat Care. 2018;8(2):171‐174. 10.1136/bmjspcare-2017-001439 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0029] 29.Berg M, Adolfsson A, Ranerup A, Sparud‐Lundin C, for the University of Gothenburg Centre for Person‐Centred C . Person‐centered Web support to women with type 1 diabetes in pregnancy and early motherhood–the development process. Diabetes Technol Ther. 2013;15(1):20‐25. 10.1089/dia.2012.0217 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0030] 30.Best P, Badham J, Corepal R, et al. Network methods to support user involvement in qualitative data analyses: an introduction to participatory theme elicitation. Trials. 2017;18(1). 10.1186/s13063-017-2289-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0031] 31.Blomqvist K, Theander E, Mowide I, Larsson V. What happens when you involve patients as experts? A participatory action research project at a renal failure unit. Nurs Inq. 2010;17(4):317‐323. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0032] 32.Boyer AP, Fair AM, Joosten YA, et al. A multilevel approach to stakeholder engagement in the formulation of a clinical data research network. Med Care. 2018;56(Suppl 1):S22‐S26. 10.1097/mlr.0000000000000778 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0033] 33.Brach JS, Perera S, Gilmore S, et al. Stakeholder involvement in the design of a patient‐centered comparative effectiveness trial of the "On the Move" group exercise program in community‐dwelling older adults. Contemp Clin Trials. 2016;50:135‐142. 10.1016/j.cct.2016.08.003 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0034] 34.Brainard JS, Al Assaf E, Omasete J, Leach S, Hammer CC, Hunter PR. Forced migrants involved in setting the agenda and designing research to reduce impacts of complex emergencies: combining Swarm with patient and public involvement. Res Involv Engagem. 2017;3:23. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0035] 35.Brear M. Process and outcomes of a recursive, dialogic member checking approach: a project ethnography. Qual Health Res. 2019;29(7):944‐957. 10.1177/1049732318812448 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0036] 36.Brereton L, Ingleton C, Gardiner C, et al. Lay and professional stakeholder involvement in scoping palliative care issues: methods used in seven European countries. Palliat Med. 2017;31(2):181‐192. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0037] 37.Callander R, Ning L, Crowley A, Childs B, Brisbane P, Salter T. Consumers and carers as partners in mental health research: reflections on the experience of two project teams in Victoria, Australia. Int J Ment Health Nurs. 2011;20(4):263‐273. 10.1111/j.1447-0349.2010.00731.x [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0038] 38.Carr ECJ, Patel JN, Ortiz MM, et al. Co‐design of a patient experience survey for arthritis central intake: an example of meaningful patient engagement in healthcare design. BMC Health Serv Res. 2019;19(1). 10.1186/s12913-019-4196-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0039] 39.Chiu CG, Mitchell TL, Fitch MI. From patient to participant: enhancing the validity and ethics of cancer research through participatory research. J Cancer Educ. 2013;28(2):237‐246. 10.1007/s13187-013-0464-2 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0040] 40.Clarke CL, Wilkinson H, Watson J, Wilcockson J, Kinnaird L, Williamson T. A seat around the table: participatory data analysis with people living with dementia. Qual Health Res. 2018;28(9):1421‐1433. 10.1007/s13187-013-0464-2 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0041] 41.Concannon TW, Fuster M, Saunders T, et al. A systematic review of stakeholder engagement in comparative effectiveness and patient‐centered outcomes research. J Gen Intern Med. 2014;29(12):1692‐1701. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0042] 42.Coon JT, Gwernan‐Jones R, Moore D, et al. End‐user involvement in a systematic review of quantitative and qualitative research of non‐pharmacological interventions for attention deficit hyperactivity disorder delivered in school settings: reflections on the impacts and challenges. Health Expect. 2016;19(5):1084‐1097. 10.1111/hex.12400 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0043] 43.Costello W, Dorris E. Laying the groundwork: building relationships for public and patient involvement in pre‐clinical paediatric research. Health Expect. 2020;23(1):96‐105. 10.1111/hex.12972 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0044] 44.Dennehy R, Cronin M, Arensman E. Involving young people in cyberbullying research: the implementation and evaluation of a rights‐based approach. Health Expect. 2019;22(1):54‐64. 10.1111/hex.12830 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0045] 45.Dovey‐Pearce G, Walker S, Fairgrieve S, Parker M, Rapley T. The burden of proof: the process of involving young people in research. Health Expect. 2019;22(3):465‐474. 10.1111/hex.12870 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0046] 46.Edwards L, Monro M, Butterfield Y, et al. What matters most to patients about primary healthcare: mixed‐methods patient priority setting exercises within the PREFeR (PRioritiEs For Research) project. BMJ Open. 2019;9(7):e025954. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0047] 47.Elliott MJ, Goodarzi Z, Sale JEM, et al. Perceived significance of engagement in research prioritization among chronic kidney disease patients, caregivers, and health care professionals: a qualitative study. Can J Kidney Health Dis. 2018;5:205435811880748. 10.1177/2054358118807480 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0048] 48.Evans BA, Porter A, Snooks H, Burholt V. A co‐produced method to involve service users in research: the SUCCESS model. BMC Med Res Methodol. 2019;19(1). 10.1186/s12874-019-0671-6 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0049] 49.Garwick AW, Seppelt AM. Developing a family‐centered participatory action research project. J Fam Nurs. 2010;16(3):269‐281. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0050] 50.Gibson A, Welsman J, Britten N. Evaluating patient and public involvement in health research: from theoretical model to practical workshop. Health Expect. 2017;20(5):826‐835. 10.1111/hex.12486 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0051] 51.Gillard S, Simons L, Turner K, Lucock M, Edwards C. Patient and public involvement in the coproduction of knowledge: reflection on the analysis of qualitative data in a mental health study. Qual Health Res. 2012;22(8):1126‐1137. 10.1177/1049732312448541 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0052] 52.Hamilton CB, Hoens AM, Backman CL, et al. An empirically based conceptual framework for fostering meaningful patient engagement in research. Health Expect. 2018;21(1):396‐406. 10.1111/hex.12635 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0053] 53.Hamilton CB, Hoens AM, McQuitty S, et al. Development and pre‐testing of the Patient Engagement In Research Scale (PEIRS) to assess the quality of engagement from a patient perspective. PLoS One. 2018;13(11):e0206588. 10.1371/journal.pone.0206588 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0054] 54.Hofmann D, Ibrahim F, Rose D, et al. Expectations of new treatment in rheumatoid arthritis: developing a patient‐generated questionnaire. Health Expect. 2015;18(5):995‐1008. 10.1111/hex.12073 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0055] 55.Holmes L, Cresswell K, Williams S, et al. Innovating public engagement and patient involvement through strategic collaboration and practice. Res Involv Engagem. 2019;5(1):30. 10.1186/s40900-019-0160-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0056] 56.Horobin A, Brown G, Higton F, et al. Co‐producing public involvement training with members of the public and research organisations in the East Midlands: creating, delivering and evaluating the lay assessor training programme. Res Involv Engagem. 2017;3:7. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0057] 57.Hull D, Barton D, Guo K, Russell C, Aucott B, Wiles D. Patient and public involvement to support liver disease research. Br J Nurs. 2012;21(16):972‐976. 10.12968/bjon.2012.21.16.972 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0058] 58.Iliffe S, McGrath T, Mitchell D. The impact of patient and public involvement in the work of the Dementias & Neurodegenerative Diseases Research Network (DeNDRoN): case studies. Health Expect. 2013;16(4):351‐361. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0059] 59.Irving A, Turner J, Marsh M, et al. A coproduced patient and public event: an approach to developing and prioritizing ambulance performance measures. Health Expect. 2018;21(1):230‐238. 10.1111/hex.12606 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0060] 60.Jennings H, Slade M, Bates P, Munday E, Toney R. Best practice framework for Patient and Public Involvement (PPI) in collaborative data analysis of qualitative mental health research: methodology development and refinement. BMC Psychiatry. 2018;18(1). 10.1186/s12888-018-1794-8 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0061] 61.Jorgensen CR, Eskildsen NB, Johnsen AT. User involvement in a Danish project on the empowerment of cancer patients – experiences and early recommendations for further practice. Res Involv Engagem. 2018;4:26. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0062] 62.Jorgensen CR, Eskildsen NB, Thomsen TG, Nielsen ID, Johnsen AT. The impact of using peer interviewers in a study of patient empowerment amongst people in cancer follow‐up. Health Expect. 2018;21(3):620‐627. 10.1111/hex.12655 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0063] 63.Kandiyali R, Hawton A, Cabral C, et al. Working with patients and members of the public: informing health economics in child health research. Pharmacoeconom Open. 2019;3(2):133‐141. 10.1007/s41669-018-0099-7 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0064] 64.Keenan J, Poland F, Boote J, et al. 'We're passengers sailing in the same ship, but we have our own berths to sleep in': evaluating patient and public involvement within a regional research programme: an action research project informed by normalisation process theory. PLoS One. 2019;14(5):e0215953. 10.1371/journal.pone.0215953 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0065] 65.Kim KK, Khodyakov D, Marie K, et al. A Novel stakeholder engagement approach for patient‐centered outcomes research. Med Care. 2018;56(Suppl 1):S41‐S47. 10.1097/mlr.0000000000000790 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0066] 66.Kristensen S, Mainz J, Baandrup L, et al. Conceptualizing patient‐reported outcome measures for use within two Danish psychiatric clinical registries: description of an iterative co‐creation process between patients and healthcare professionals. Nord J Psychiatry. 2018;72(6):409‐419. 10.1080/08039488.2018.1492017 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0067] 67.Larkin M, Boden ZVR, Newton E. On the brink of genuinely collaborative care. Qual Health Res. 2015;25(11):1463‐1476. 10.1177/1049732315576494 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0068] 68.Leese J, Macdonald G, Kerr S, et al. ‘Adding another spinning plate to an already busy life’. Benefits and risks in patient partner–researcher relationships: a qualitative study of patient partners’ experiences in a Canadian health research setting. BMJ Open. 2018;8(8):e022154. 10.1136/bmjopen-2018-022154 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0069] 69.Likumahuwa‐Ackman S, Angier H, Sumic A, et al. IMPACCT kids' care: a real‐world example of stakeholder involvement in comparative effectiveness research. J Comp Eff Res. 2015;4(4):351‐357. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0070] 70.Lowes L, Robling MR, Bennert K, et al. Involving lay and professional stakeholders in the development of a research intervention for the DEPICTED study. Health Expect. 2011;14(3):250‐260. 10.1111/j.1369-7625.2010.00625.x [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0071] 71.Malus M, Shulha M, Granikov V, et al. A participatory approach to understanding and measuring patient satisfaction in a primary care teaching setting. Prog Community Health Partnersh. 2011;5(4):417‐424. [PubMed] [Google Scholar]

[hex13272-bib-0072] 72.Mann C, Chilcott S, Plumb K, Brooks E, Man MS. Reporting and appraising the context, process and impact of PPI on contributors, researchers and the trial during a randomised controlled trial – the 3D study. Res Involv Engagem. 2018;4:15. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0073] 73.Marks S, Mathie E, Smiddy J, Jones J, da Silva‐Gane M. Reflections and experiences of a co‐researcher involved in a renal research study. Res Involv Engagem. 2018;4(1). 10.1186/s40900-018-0120-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0074] 74.Mawn L, Welsh P, Stain HJ, Windebank P. Youth Speak: increasing engagement of young people in mental health research. J Ment Health. 2015;24(5):271‐275. 10.3109/09638237.2014.998810 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0075] 75.McCarron TL, Moffat K, Wilkinson G, et al. Understanding patient engagement in health system decision‐making: a co‐designed scoping review. Syst Rev. 2019;8(1):97. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0076] 76.Mockford C, Murray M, Seers K, et al. A SHARED study‐the benefits and costs of setting up a health research study involving lay co‐researchers and how we overcame the challenges. Res Involv Engagem. 2016;2:8. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0077] 77.Moltu C, Stefansen J, Svisdahl M, Veseth M. Negotiating the coresearcher mandate – service users' experiences of doing collaborative research on mental health. Disabil Rehabil. 2012;34(19):1608‐1616. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0078] 78.Nierse CJ, Abma TA. Developing voice and empowerment: the first step towards a broad consultation in research agenda setting. J Intellect Disabil Res. 2011;55(4):411‐421. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0079] 79.Nierse CJ, Schipper K, van Zadelhoff E, van de Griendt J, Abma TA. Collaboration and co‐ownership in research: dynamics and dialogues between patient research partners and professional researchers in a research team. Health Expect. 2012;15(3):242‐254. 10.1111/j.1369-7625.2011.00661.x [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0080] 80.Nowell WB, Curtis JR, Crow‐Hercher R. Patient governance in a patient‐powered research network for adult rheumatologic conditions. Med Care. 2018;56(Suppl 1):S16‐S21. 10.1097/mlr.0000000000000814 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0081] 81.O’Donnell D, Ní Shé É, McCarthy M, et al. Enabling public, patient and practitioner involvement in co‐designing frailty pathways in the acute care setting. BMC Health Serv Res. 2019;19(1). 10.1186/s12913-019-4626-8 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0082] 82.O'Gorman CM, Smith Martin M, Oliffe JL, Leggo C, Korchinski M, Martin RE. Community voices in program development: the wisdom of individuals with incarceration experience. Can J Public Health. 2012;103(5):e379–e383. 10.1007/bf03404446 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0083] 83.O’Hara MC, Hynes L, O’Donnell M, et al. Strength in numbers: an international consensus conference to develop a novel approach to care delivery for young adults with type 1 diabetes, the D1 now study. Res Involv Engagem. 2017;3:25. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0084] 84.Ostrow L, Penney D, Stuart E, Leaf PJ. Web‐based survey data collection with peer support and advocacy organizations: implications of participatory methods. Prog Community Health Partnersh. 2017;11(1):45‐52. 10.1353/cpr.2017.0006 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0085] 85.Portalupi LB, Lewis CL, Miller CD, et al. Developing a patient and family research advisory panel to include people with significant disease, multimorbidity and advanced age. Fam Pract. 2017;34(3):364‐369. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0086] 86.Read S, Maslin‐Prothero S. The involvement of users and carers in health and social research: the realities of inclusion and engagement. Qual Health Res. 2011;21(5):704‐713. 10.1177/1049732310391273 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0087] 87.Sauers‐Ford HS, Simmons JM, Shah SS, et al. Strategies to engage stakeholders in research to improve acute care delivery. J Hosp Med. 2016;11(2):123‐125. 10.1002/jhm.2492 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0088] 88.Saunders T, Mackie TI, Shah S, Gooding H, de Ferranti SD, Leslie LK. Young adult and parent stakeholder perspectives on participation in patient‐centered comparative effectiveness research. J Comp Eff Res. 2016;5(5):487‐497. 10.2217/cer-2016-0025 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0089] 89.Schenk EC, Bryant RA, Van Son CR, Odom‐Maryon T. Developing an intervention to reduce harm in hospitalized patients: patients and families in research. J Nurs Care Qual. 2019;34(3):273‐278. 10.1097/ncq.0000000000000354 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0090] 90.Shippee ND, Domecq Garces JP, Prutsky Lopez GJ, et al. Patient and service user engagement in research: a systematic review and synthesized framework. Health Expect. 2015;18(5):1151‐1166. 10.1111/hex.12090 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0091] 91.Slade M, Bird V, Chandler R, et al. The contribution of advisory committees and public involvement to large studies: case study. BMC Health Serv Res. 2010;10(1). 10.1186/1472-6963-10-323 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0092] 92.Snape D, Kirkham J, Britten N, et al. Exploring perceived barriers, drivers, impacts and the need for evaluation of public involvement in health and social care research: a modified Delphi study. BMJ Open. 2014;4(6):e004943. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0093] 93.Tapp H, Derkowski D, Calvert M, Welch M, Spencer S. Patient perspectives on engagement in shared decision‐making for asthma care. Fam Pract. 2017;34(3):353‐357. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0094] 94.Taylor C, Gill L, Gibson A, Byng R, Quinn C. Engaging, "seldom heard" groups in research and intervention development: offender mental health. Health Expect. 2018;21(6):1104‐1110. 10.1111/hex.12807 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0095] 95.Vaillancourt S, Beaton D, Maybee A. Engaging patients to develop a patient‐reported outcome measure for the emergency department. CMAJ. 2018;190(Suppl):S50‐S52. 10.1503/cmaj.180353 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0096] 96.Vale CL, Tierney JF, Spera N, Whelan A, Nightingale A, Hanley B. Evaluation of patient involvement in a systematic review and meta‐analysis of individual patient data in cervical cancer treatment. Syst Rev. 2012;1(1):23. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0097] 97.Wikman A, Kukkola L, Börjesson H, et al. Development of an internet‐administered cognitive behavior therapy program (ENGAGE) for parents of children previously treated for cancer: participatory action research approach. J Med Internet Res. 2018;20(4):e133. 10.2196/jmir.9457 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0098] 98.Williamson T, Kenney L, Barker AT, et al. Enhancing public involvement in assistive technology design research. Disabil Rehabil Assist Technol. 2015;10(3):258‐265. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0099] 99.Wilson T, Miller J, Teare S, et al. Patient perspectives on engagement in decision‐making in early management of non‐ST elevation acute coronary syndrome: a qualitative study. BMC Med Inform Decis Mak. 2017;17(1):153. 10.1186/s12911-017-0555-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0100] 100.Bryant W, Parsonage J, Tibbs A, Andrews C, Clark J, Franco L. Meeting in the mist: key considerations in a collaborative research partnership with people with mental health issues. Work. 2012;43(1):23‐31. [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0101] 101.Stevenson M, Taylor BJ. Involving individuals with dementia as co‐researchers in analysis of findings from a qualitative study. Dementia (London). 2019;18(2):701‐712. 10.1177/1471301217690904 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0102] 102.Marsden J, Bradburn J. Patient and clinician collaboration in the design of a national randomized breast cancer trial. Health Expect. 2004;7(1):6‐17. 10.1111/j.1369-7625.2004.00232.x [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0103] 103.O’Brien P, McConkey R, García‐Iriarte E. Co‐researching with people who have intellectual disabilities: insights from a national survey. J Appl Res Intellect Disabil. 2014;27(1):65‐75. 10.1111/jar.12074 [DOI] [PubMed] [Google Scholar]

[hex13272-bib-0104] 104.Healthtalk . Patient and public involvement on healthtalk.org. 2014. https://www.invo.org.uk/noticeboard/

[hex13272-bib-0105] 105.Afzal C, Donnelly A, Giles S, Hammond P. Establishing a research user group from the Greater Manchester Primary Care Patient Safety Translational Research Centre. 2014. https://www.invo.org.uk/posttypeconference/establishing‐a‐research‐user‐group‐from‐the‐greater‐manchester‐primary‐care‐patient‐safety‐translational‐research‐centre/

[hex13272-bib-0106] 106.Armitage G, Crane D, Giles S, Parveen S, Reynolds C. Patient involvement in the development of a patient safety intervention. 2014. https://www.invo.org.uk/posttypeconference/patient‐involvement‐in‐the‐development‐of‐a‐patient‐safety‐intervention/

[hex13272-bib-0107] 107.Bartram J, Lawson J, Marshall L. Arthritis Research UK Centre for sport exercise and osteoarthritis: changing research culture and improving understanding of patient and public involvement (PPI). 2014. https://www.invo.org.uk/posttypeconference/arthritis‐research‐uk‐centre‐for‐sport‐exercise‐and‐osteoarthritis‐changing‐research‐culture‐and‐improving‐understanding‐of‐patient‐and‐public‐involvement‐ppi/

[hex13272-bib-0108] 108.Bell S, Donnelly A, Planner C. PRIMER (Primary Care Research in Manchester Engagement Resource): a patient, carer and public involvement group working collaboratively with primary care researchers. 2014. https://www.invo.org.uk/posttypeconference/primer‐primary‐care‐research‐in‐manchester‐engagement‐resource‐a‐patient‐carer‐and‐public‐involvement‐group‐working‐collaboratively‐with‐primary‐care‐researchers/

[hex13272-bib-0109] 109.Beresford J, Boote J, Gamble C, Giles S, Thompson J. “Doing PPI at scale”. Exploring the impact of public involvement in the NIHR Greater Manchester Primary Care Patient Safety Translational Research Centre: interim findings of a formative evaluation. 2014. https://www.invo.org.uk/posttypeconference/doing‐ppi‐at‐scale‐exploring‐the‐impact‐of‐public‐involvement‐in‐the‐nihr‐greater‐manchester‐primary‐care‐patient‐safety‐translational‐research‐centre‐interim‐findings‐of‐a‐formati/

[hex13272-bib-0110] 110.Boaz A, Chambers M, O'Shea A. The role of public and patient involvement in clinical commissioning groups. 2014. https://www.invo.org.uk/posttypeconference/the‐role‐of‐public‐and‐patient‐involvement‐in‐clinical‐commissioning‐groups/ [DOI] [PMC free article] [PubMed]

[hex13272-bib-0111] 111.Boet S. Out‐of‐the‐box thinking. 2019. https://ossu.ca/2019/09/out‐of‐the‐box‐thinking/

[hex13272-bib-0112] 112.Boulton D, Oswell D, Oxland P. Patient and family experiences when moving from the intensive care unit (ICU) to a hospital ward. 2015. https://prism.ucalgary.ca/bitstream/handle/1880/109947/20150130_MovingFromICU_internshipreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0113] 113.Bourke S, Knowles S, Planner C. Hacking health research: supporting rapid patient and public involvement (PPI) through patient hack days. 2014. https://www.invo.org.uk/posttypeconference/hacking‐health‐research‐supporting‐rapid‐patient‐and‐public‐involvement‐ppi‐through‐patient‐hack‐days/

[hex13272-bib-0114] 114.Britt D, Eglin S, Raymond G. Developing a regional approach to patient and public involvement in research: experience in the North West. 2010. https://www.invo.org.uk/posttypeconference/developing‐a‐regional‐approach‐to‐patient‐and‐public‐involvement‐in‐research‐experience‐in‐the‐north‐west/

[hex13272-bib-0115] 115.Bryk C, Lewis TR, Penman C, Miller J, Teare S. The experience of waiting for help with osteoarthritis. 2013. https://prism.ucalgary.ca/bitstream/handle/1880/109968/20130826_WaitingForHelp_internshipreport.pdf?sequence=4&isAllowed=y

[hex13272-bib-0116] 116.Cameron T, Patel N, Wray P. The CLAHRC East Midlands Patient and Public Partners’ Council and Centre for Black and Minority Ethnic Health initiatives, are supporting proportional, representative and diverse public involvement throughout the organisation, health research and regional structures. 2014. https://www.invo.org.uk/posttypeconference/the‐clahrc‐east‐midlands‐patient‐and‐public‐partners‐council‐and‐centre‐for‐black‐and‐minority‐ethnic‐health‐initiatives‐are‐supporting‐proportional‐representative‐and‐diverse‐public‐involvement‐t/

[hex13272-bib-0117] 117.Canadian Foundation for Healthcare I . Better together. 2017. https://www.cfhi‐fcass.ca/about/news‐and‐stories/news‐detail/2020/05/19/report‐of‐the‐2017‐better‐together‐policy‐roundtable

[hex13272-bib-0118] 118.Choudhury R, Wheeler L. Patient engagement in breast health education initiative. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109937/20171031_BreastHealth_PaCERreport.pdf?sequence=4&isAllowed=y

[hex13272-bib-0119] 119.Dakers Thomson M, Worth A. Challenging landscapes: establishing patient and public involvement in a clinical research setting. 2014. https://www.invo.org.uk/posttypeconference/challenging‐landscapes‐establishing‐patient‐and‐public‐involvement‐in‐a‐clinical‐research‐setting/

[hex13272-bib-0120] 120.Dickie C, Culbert M. PREFeR (PRioritiEs For Research) Project. https://spor‐bcphcrn.ca/projects/prefer/

[hex13272-bib-0121] 121.Fairs C, Lengkeek S, Van Engelen A, McKinney L. Living with inflammatory bowel disease. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109952/201602_LivingWithIBD_internshipreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0122] 122.Mossie F, Steel R. Patient research ambassadors: providing patient leadership in NHS research? 2014. https://www.invo.org.uk/posttypeconference/patient‐research‐ambassadors‐providing‐patient‐leadership‐in‐nhs‐research/

[hex13272-bib-0123] 123.Gill M, Boulton D, Oswell D, Oxland P. Understanding patient and family experiences in the daily care of criticially Ill patients. 2014. https://prism.ucalgary.ca/bitstream/handle/1880/109970/20140926_DailyCareCriticallyIll_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0124] 124.Gill M, Nguyen S, Shklarov S. Patient experience of waiting for elective surgery. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109941/20170714_WaitingElectiveSurgery_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0125] 125.Gill M, Zelinsky S, Gillis C, Nguyen S. ERAS from the patient perspective. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109966/20161018_ERASPerspective_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0126] 126.Loud F. Patient involvement in quality improvement: how a self‐management intervention for a long‐term condition (chronic kidney disease – CKD) was both developed and delivered to practitioners by a patient advisory group. 2012. https://www.invo.org.uk/posttypeconference/patient‐involvement‐in‐quality‐improvement‐how‐a‐self‐management‐intervention‐for‐a‐long‐term‐condition‐chronic‐kidney‐disease‐ckd‐was‐both‐developed‐and‐delivered‐to‐practitioners‐by‐a‐patient‐a/

[hex13272-bib-0127] 127.Marlett N, Gill M, Kozcur S, Choudhury R. Patient perspectives and expectations about primary care by occasional users, seniors and those with complex and chronic care needs. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109950/20170304_ExpectationsPrimaryCare_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0128] 128.Maybee A, Chandani S. Person generated health data (PGHD) principles: through the patients and caregivers lens. 2019. https://95c34945‐b08e‐4116‐9057‐56dd704184dd.filesusr.com/ugd/6ac9da_e1ac2ad9be9a407b863ae9712e72ce77.pdf

[hex13272-bib-0129] 129.Miller J, Teare S. Report on the PaCER component of the knee osteoarthritis and self –management knowledge. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109944/20170614_KOASK_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0130] 130.Miller J, Teare S. Patient engagement to identify priorities for shared decision‐making tools in cardiac care. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109957/20160229_SharedDecisionmakingCardiacCare_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0131] 131.Miller J, Teare S. Meaningful results from meaningful engagement: enabling patient and family participation in the AHS seniors health SCN. 2015. https://prism.ucalgary.ca/bitstream/handle/1880/109971/20150405_EnablingPatientFamilyParticipation_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0132] 132.Miller J, Teare S. Report on the PaCER component of the AS MOC study. 2014. https://prism.ucalgary.ca/handle/1880/109961

[hex13272-bib-0133] 133.Nunn J, Grayson M. Building research partnerships. https://www.invo.org.uk/building‐research‐partnerships/

[hex13272-bib-0134] 134.Palm M. Patient and public involvement in the Manchester Biomedical Research Centre. 2012. https://www.invo.org.uk/posttypeconference/patient‐and‐public‐involvement‐in‐the‐manchester‐biomedical‐research‐centre/

[hex13272-bib-0135] 135.Persaud N, Shah B. The impact of providing carefully selected essential medications at no charge to primary care patients. 2019. https://ossu.ca/for‐researchers/impact‐awards/improved‐care‐and‐prevention/improving‐access‐to‐medications/

[hex13272-bib-0136] 136.Pritchard R. Implementing public and patient engagement in research: lessons learned from a three‐strand strategy. 2012. https://www.invo.org.uk/posttypeconference/implementing‐public‐and‐patient‐engagement‐in‐research‐lessons‐learned‐from‐a‐three‐strand‐strategy/

[hex13272-bib-0137] 137.Rainey P, Morris C. Consumers take the initiative in patient and public involvement (PPI) training. https://www.invo.org.uk/consumers‐take‐the‐initiative‐in‐patient‐and‐public‐involvement‐ppi‐training/

[hex13272-bib-0138] 138.Roland B, Wheatley V, Jones A, Gillis C. Stillbirth, still life: a qualitative patient‐led study on parents’ unsilenced stories of stillbirth. 2017. https://prism.ucalgary.ca/bitstream/handle/1880/109948/2017_StillbirthStillLife_internshipreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0139] 139.Shearkani S, McKinnon A, Maybee A. Uncovering the experiences of patients and caregivers as couples. 2016. https://prism.ucalgary.ca/bitstream/handle/1880/109958/20160517_CaregiversAsCouples_internshipreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0140] 140.Sheridan M, Zelinsky S, Gill M. Understanding safe surgery checklist experiences of surgical patients in Alberta. 2014. https://prism.ucalgary.ca/bitstream/handle/1880/109963/20140325_UnderstandingSafeSurgeryChecklist_PaCERreport.pdf?sequence=1&isAllowed=y

[hex13272-bib-0141] 141.Taylor J. Jane Taylor. https://www.invo.org.uk/posttypemembers/jane‐taylor/

[hex13272-bib-0142] 142.Aden Z. Reviewing funding applications: an example of tangible patient involvement at the proposal stage. 2014. https://www.invo.org.uk/posttypeconference/reviewing‐funding‐applications‐an‐example‐of‐tangible‐patient‐involvement‐at‐the‐proposal‐stage/

[hex13272-bib-0143] 143.Johansson J. Patient views on ladders of engagement Ontario: Ontario SPOR support unit. 2018. https://ossu.ca/wp‐content/uploads/Patient‐views‐on‐ladders‐of‐engagement‐Johannesen‐FINAL‐JJ‐v3.pdf

[hex13272-bib-0144] 144.CHSRF . Patients and professionals partnerning to redesign inpatient care. 2012. https://www.youtube.com/watch?v=OXIylBCJstE&list=UUm‐tze53Qzz2nZzLLVK0mVA&index=1&feature=plcp

[hex13272-bib-0145] 145.PaCER . We are PaCER. 2020. https://pacerinnovates.ca

[hex13272-bib-0146] 146.Greenhalgh T, Hinton L, Finlay T, et al. Frameworks for supporting patient and public involvement in research: systematic review and co‐design pilot. Health Expect. 2019;22(4):785‐801. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0147] 147.Staley K. ‘Is it worth doing?’ Measuring the impact of patient and public involvement in research. Res Involv Engagem. 2015;1(1):6. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0148] 148.Janic A, Kimani K, Olembo I, Dimaras H. Lessons for patient engagement in research in low‐ and middle‐income countries. Ophthalmol Ther. 2020;9(2):221. [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0149] 149.Schilling I, Behrens H, Hugenschmidt C, Liedtke J, Schmiemann G, Gerhardus A. Patient involvement in clinical trials: motivation and expectations differ between patients and researchers involved in a trial on urinary tract infections. Res Involv Engagem. 2019;5(1). [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0150] 150.Coulman KD, Nicholson A, Shaw A, et al. Understanding and optimising patient and public involvement in trial oversight: an ethnographic study of eight clinical trials. Trials. 2020;21(1). 10.1186/s13063-020-04495-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

[hex13272-bib-0151] 151.Hobbs G, Tully MP. Realist evaluation of public engagement and involvement in data‐intensive health research. Res Involv Engagem. 2020;6(37). 10.1186/s40900-020-00215-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

PERMALINK

Patients as partners in health research: A scoping review

Tamara L McCarron, PhD, MBA

Fiona Clement, PhD

Jananee Rasiah, MN, RN

Chelsea Moran, MA

Karen Moffat

Andrea Gonzalez

Tracy Wasylak, MSc

Maria Santana, MPharm, PhD

Abstract

Background

Methods

Results

Conclusion

Patient/User Involvement

1. BACKGROUND

2. METHODS

2.1. Design

2.2. Recruitment of patient partners

2.3. Stage 1: Identifying the research question

2.4. Stage 2: Identifying relevant studies

2.4.1. Protocol and registration

2.4.2. Eligibility criteria

2.4.3. Information sources

2.5. Stage 3: Study selection

2.5.1. Selection of sources of evidence

2.6. Stage 4: Data collection

2.6.1. Data charting

2.7. Stage 5: Data summary and synthesis

2.8. Stage 6: Consultation

3. RESULTS

FIGURE 1.

3.1. Characteristics of included records

FIGURE 2.

TABLE 1.

3.2. Purpose of involvement

TABLE 2.

3.3. Reported outcomes

FIGURE 3.

3.4. Type of strategies used to support patient partner engagement

TABLE 3.

4. DISCUSSION

4.1. Strengths and limitations

5. CONCLUSION

CONFLICT OF INTERESTS

AUTHOR CONTRIBUTIONS

Supporting information

ACKNOWLEDGEMENTS

Contributor Information

DATA AVAILABILITY STATEMENT

REFERENCES

Associated Data

Supplementary Materials

Data Availability Statement

ACTIONS

PERMALINK

RESOURCES

Similar articles

Cited by other articles

Links to NCBI Databases