Table 1. . Contexts, processes and outcomes for planning, evaluating and reporting stakeholder engagement.
Topic | Subtopic | Planning stakeholder-engaged research and research on stakeholder engagement | Minimum reporting (stakeholder-engaged research) | Comprehensive reporting (research on stakeholder engagement) |
---|---|---|---|---|
1. Contexts† | ||||
Resources available |
Funding, time, expertise of researchers and stakeholders, training for researchers and stakeholders |
X |
|
X |
Attitudes and expectations |
Commitment to and attitudes toward engagement from researchers and stakeholders |
X |
|
X |
Desired input from stakeholders |
Values, knowledge and experience sought |
X |
X |
X |
Desired goals of engagement |
Decisions to be deliberated with stakeholders and goals of engagement |
X |
X |
X |
2. Processes† | ||||
Stakeholder recruitment |
Identification and outreach to potential stakeholders; recruitment rate |
X |
X |
X |
Stakeholder composition |
Diversity, composition |
X |
X |
X |
Setting expectations |
How expectations were communicated; introductions; stakeholder understanding of roles and expectations; agenda-setting for specific meetings; establishment of reciprocal relationships; establishment of power sharing |
X |
|
X |
Decision making |
Structured decision making, use of appropriate quantitative/qualitative methods, use of facilitators; stakeholder experience of decision making |
X |
|
X |
Frequency and duration of engagement |
Timing, duration, method, frequency, flexibility and methods of interactions Options for stakeholder-initiated interaction Ongoing/sustained engagement vs more limited engagement |
X |
X |
X |
Representativeness |
Balanced representation and participation Group decision making |
X |
|
X |
Co-learning |
Two-way sharing of information and background to allow meaningful contribution and conversation; use of written or visual materials; avoiding jargon |
X |
|
X |
Valuing stakeholder contribution |
Thoughtful and transparent requests for time commitment; financial compensation |
X |
|
X |
Transparency |
Transparent engagement processes and rationale Feedback given to stakeholders about their input and impact Final products for dissemination shared |
X |
|
X |
3. Outcomes | ||||
Immediate outcomes:‡ | X | |||
– Changes in project scope | Defining/prioritizing topic, question, hypotheses, intervention, outcomes to be measured | X | X | |
– Changes in project methods | Design, methods, recruitment, data collection | X | X | |
– Changes in interpretation | Analysis, interpretation, synthesis; anticipating alternative interpretation or controversy | X | X | |
– Changes in dissemination plans |
Content and method of distribution |
|
X |
X |
– Changes in future directions |
Follow-up projects, collaborations, funding |
|
X |
X |
– Changes in future engagement |
Researcher knowledge, capacity, commitment to engagement; Continued/new stakeholder involvement |
|
X |
X |
– Stakeholder satisfaction |
Satisfaction, continued involvement |
|
|
X |
Intermediate outcomes:‡ | X | X | ||
– Value of evidence generated | Quality, applicability, alignment with stakeholder priorities, alignment with stakeholder decision making | § | ||
– Efficiency of research efforts | Improved recruitment, retention, inclusivity. Improved data collection procedures. Timeliness of publication and dissemination | § | ||
– Uptake of research | Improved translation, dissemination and uptake, potentially through increased perceived legitimacy/accountability; increased relevance/quality and/or increased attention to dissemination activities | § | ||
– Improved ethics of research | Design/process more appropriate, inclusive, sensitive and ethical | § | ||
– Empowerment of patients/stakeholders |
Stakeholder participant attitudes or actions suggesting increased engagement and efficacy with research and/or healthcare system |
|
|
§ |
Creation/sustaining of partnerships |
Creating and maintaining partnerships with stakeholders, facilitating stakeholder engagement in ongoing/future work |
|
|
§ |
Long-term outcomes:‡ | X | X | ||
– Improved patient decision making | Improvement in ability of data to answer questions informing patient's decisions | § | ||
– Improved clinical/health policy decision making | Improvement in ability of data to answer questions informing clinician or policy-maker's decisions | § | ||
– Improved health outcomes | Improvement in patient-centered health outcomes | § | ||
– Improved culture of research | Improved accountability, inclusivity, trust, ethics | § |
†When relevant, consider distinguishing between planned and actual contexts, processes and outcomes, particularly for research on stakeholder engagement.
‡Planning efforts for both stakeholder-engaged research and research on stakeholder engagement should consider the evaluation of immediate, intermediate and long-term outcomes, even if not all are evaluated.
§In research on stakeholder engagement, not every intermediate and long-term outcome will be assessed, but the full range of outcomes should be considered for assessment. We recommend acknowledging missing outcomes or groups of outcomes to increase transparency and interpretability.
X: Indicates topic/subtopic relevant to the specified level of planning or reporting stakeholder engagement.