Skip to main content
. 2020 Jul 10;30(11):3015–3033. doi: 10.1007/s11136-020-02564-9

Table 3.

Comparison of implementation science frameworks used for evaluation

IS evaluation framework Construct to evaluate Construct definition Similar construct Case studies
Proctor’s outcomes [29] Acceptability Extent to which implementation stakeholders perceive innovation to be agreeable or palatable Satisfaction

Ahmed et al. [30]: implementing PROMs in a chronic pain network

Roberts et al. [31]: implementing PROMs in routine cancer care

van Oers et al. [32]: implementing PROMs for pediatric and adult clinics treating chronic conditions

Appropriateness Perceived fit, relevance, or compatibility of innovation for given practice setting Compatibility, usefulness
Adoption Intention, initial decision, or action to employ innovation by service settings (proportion and representativeness) Uptake
Feasibility Extent to which innovation can be successfully used or carried out within given setting Practicability
Reach/penetration Extent to which target population is reached Service penetration
Fidelity Degree to which innovation or implementation strategy delivered as intended Adherence
Costs Financial impact of innovation, including costs, personnel, and clinic and patient time necessary for treatment delivery, or cost of implementation strategy Cost–benefit, cost-effectiveness
Sustainability Extent to which innovation is maintained as intended and/or institutionalized within service setting’s ongoing operations Maintenance, institutionalized

Reach, effectiveness, adoption, implementation, and maintenance (RE-AIM)

www.re-aim.org

[47, 48]

Reach Extent to which target population is reached Penetration Manalili and Santana [33]: implementing PREMs for quality improvement in primary care
Effectiveness Impact of innovation on important outcomes, including potential negative effects, quality of life, and economic
Adoption Absolute number, proportion, and representativeness of settings and intervention agents (people who deliver the program) who are willing to initiate a program Uptake
Implementation

• At setting level: intervention agents’ fidelity to various elements of innovation’s protocol, including consistency of delivery as intended and time and cost of intervention

• At individual level: use of intervention strategies

Maintenance

• At setting level: extent to which an innovation becomes institutionalized/part of routine practices and policies

• At individual level: Long-term effects of innovation on outcomes 6+ months after most recent contact

Sustainability, institutionalized