Table 3.
IS evaluation framework | Construct to evaluate | Construct definition | Similar construct | Case studies |
---|---|---|---|---|
Proctor’s outcomes [29] | Acceptability | Extent to which implementation stakeholders perceive innovation to be agreeable or palatable | Satisfaction |
Ahmed et al. [30]: implementing PROMs in a chronic pain network Roberts et al. [31]: implementing PROMs in routine cancer care van Oers et al. [32]: implementing PROMs for pediatric and adult clinics treating chronic conditions |
Appropriateness | Perceived fit, relevance, or compatibility of innovation for given practice setting | Compatibility, usefulness | ||
Adoption | Intention, initial decision, or action to employ innovation by service settings (proportion and representativeness) | Uptake | ||
Feasibility | Extent to which innovation can be successfully used or carried out within given setting | Practicability | ||
Reach/penetration | Extent to which target population is reached | Service penetration | ||
Fidelity | Degree to which innovation or implementation strategy delivered as intended | Adherence | ||
Costs | Financial impact of innovation, including costs, personnel, and clinic and patient time necessary for treatment delivery, or cost of implementation strategy | Cost–benefit, cost-effectiveness | ||
Sustainability | Extent to which innovation is maintained as intended and/or institutionalized within service setting’s ongoing operations | Maintenance, institutionalized | ||
Reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) |
Reach | Extent to which target population is reached | Penetration | Manalili and Santana [33]: implementing PREMs for quality improvement in primary care |
Effectiveness | Impact of innovation on important outcomes, including potential negative effects, quality of life, and economic | |||
Adoption | Absolute number, proportion, and representativeness of settings and intervention agents (people who deliver the program) who are willing to initiate a program | Uptake | ||
Implementation |
• At setting level: intervention agents’ fidelity to various elements of innovation’s protocol, including consistency of delivery as intended and time and cost of intervention • At individual level: use of intervention strategies |
|||
Maintenance |
• At setting level: extent to which an innovation becomes institutionalized/part of routine practices and policies • At individual level: Long-term effects of innovation on outcomes 6+ months after most recent contact |
Sustainability, institutionalized |