Table 2.
Domain and degrees of impact | Potential indicators |
---|---|
Alignment with multi-level priorities: How is the initiative directly linked to health system operations and research priorities? |
1a. Research priorities Research priority being addressed*; Number of research innovations implemented in routine care; Number of in-house research innovations implemented in routine care 1b. Health system operations priorities Health system priority being addressed*; Identified metrics derived from priorities and health system goals*; Total number of distinct partners; Scope and depth of partnerships* |
Commitment: How effective is the research-operations partnership? |
2. Administrative research and operations resources Amount of funding provided by partners; Non-monetary resources contributed by partners*; Description of how these resources support shared goals* 3. Investigator-developed tools and strategies Type of implementation strategy used*; Innovations to implementation strategy for facilities that have quality gaps in clinical area being addressed*; Evaluation design to examine strategy or compare the effectiveness of two implementation strategies (e.g., randomized stepped wedge)*; Approach to continuous learning and improvement throughout implementation process*; Number and type* of products developed; Number of patents awarded |
Tailoring to local context: To what extent were specific strategies and tools adopted into routine practice? |
4. Direct proximate impacts Number and type* of implementation facilities; Number and type* of implementation facilities that have quality gaps in clinical area being addressed; Number of providers trained and/or using EBP; Number of patients served by EBP |
Informing the field: How are the project results being communicated to key stakeholders and organizations? |
5a. Extent to which results were disseminated to health system leadership and other operations stakeholders Description of briefings/presentations to health system leadership and other key stakeholders with decision-making or financial authority* 5b. Extent to which results were disseminated to research stakeholders Number of published journal articles; Number of conference presentations; List of citations 5c. Extent to which results were disseminated externally to the public Number of articles published on national media outlets; Number of mentions in social media 6. Extent to which there was additional scale up and spread beyond original implementation facilities Additional resources to scale up and spread EBP*; Number of additional sites implementing EBP/tool/strategy (beyond the original sites that were directly part of the initial implementation effort) |
Observing healthcare changes and generating New questions and projects: What improvements in quality of care and health outcomes, policy, and/or culture were observed? Were new analyses/projects launched as a result of the effort? |
7. Sustainability Cost-benefit calculations; Cost of implementing intervention; Cost of implementation strategy; Return on investment (ROI) 8. Quality of care and health outcomesHealth outcomes of patients*; Quality of care metrics* 9. Policy Number of citations in clinical guidelines; Number of citations in policy documents 10. Culture Observed changes in provider engagement*; Number and range* of new quality enhancement projects or evaluation analyses launched or expanded |
*Qualitative metric