Table 1.
EMPOWER QUERI Implementation Evaluation: Summary of Methods (Reprinted with permission from Huynh et al. [76])
| Replicating Effective Programs (REP) Phase | PHASE 1 Pre-Conditions | PHASE 2 Pre-Implementation | PHASE 3 Implementation | Phase 4 Maintenance & Evolution | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Month | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 1 | 2 | 3 | 4 |
| Provider and Administrator Interviews • Phase 1: Intervention planning, needs assessment, and acceptability; • Phase 2: Factors likely to affect adoption, acceptability, feasibility, satisfaction, penetration/reach. • Phase 4: Experiences of intervention/implementation; adaptations made in practice; suggestion for future adaptations to inform effectiveness and spread. |
X | X | X | ||||||||||||||||||||||||||||
| Provider Surveys • Measuring Organizational Readiness for Patient Engagement (MORE) |
X | ||||||||||||||||||||||||||||||
| Patient Interviews • Phase 3: Factors likely to affect adoption, acceptability, feasibility, satisfaction, penetration/reach. • Phase 4: Experiences of intervention/implementation; challenges, problem-solving, and suggestions for change/adaptation. |
X | X | |||||||||||||||||||||||||||||
| Patient Surveys (pre and post-intervention) • Primary outcomes: Program engagement and retention; change in targeted symptom or risk reduction behavior; • Secondary outcomes: Satisfaction (at f/u only), global health, out of role days; • Potential moderators: engagement, patient demographics, social support, mental health. |
X | X | |||||||||||||||||||||||||||||
| Periodic Reflections • History and trajectory of implementation events • Activities and interrelationships, including stakeholder engagement; • Adaptations to intervention components and/or implementation strategies; • Contextual factors with potential impact for implementation. |
X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | ||||||
| Administrative Data • Referral monitoring • Patient engagement • Patient outcomes |
X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | |||||||||||||||
| Text Analysis • Review of changes occurring to intervention components and/or implementation strategies per T1 (Baseline) proposal materials and subsequent institutional review, amendments, and other study documentation. |
X | ||||||||||||||||||||||||||||||