Skip to main content
. 2020 Mar 2;7:e7. doi: 10.1017/gmh.2020.1

Table 1.

Implementation outcome definitions used for systematic review based on Proctor's implementation outcome framework (Proctor et al., 2011)

Implementation outcome Narrative definition Population reporting Stage of implementation reported Type of data reporting Specific study inclusion criteria Exclusion criteria
Acceptability Satisfaction with various aspects of intervention or implementation strategy Consumer; Implementer Pre-implementation; During implementation; Post-implementation Qualitative; Quantitative Must report formal analyses of quantitative or qualitative results of satisfaction with specific depression intervention or implementation strategy being tested Excluded if general service satisfaction not linked to specific depression intervention or implementation strategy; Excluded if descriptive without formal analyses of client or consumer perceptions
Adoption Initial implementation, utilization, or intention to try intervention or implementation strategy Implementer; Organization; Setting Pre-implementation; During implementation Quantitative Must be able to calculate numerator and denominator (no. of implementers, organizations, or settings adopting or intending to adopt/no. of eligible) Excluded if qualitative results on use or intent to use not allowing calculation of proportion adopting
Appropriateness Perceived fit, relevance, compatibility, usefulness, or practicability of intervention or implementation strategy Consumer; Implementer; Organization; Setting Pre-implementation Qualitative; Quantitative Must report formal qualitative or quantitative analyses of pre-implementation perceived fit of specific depression intervention or implementation strategy being tested Excluded if general service appropriateness not focused on intervention or strategy of interest; Excluded if descriptive without formal analyses of client or consumer perceptions
Feasibility Actual fit, relevance, compatibility, usefulness, or practicability of intervention or implementation strategy Consumer; Implementer; Organization; Setting During implementation; Post-implementation Qualitative; Quantitative Must report formal quantitative or qualitative analyses of post-implementation actual fit of specific depression intervention or implementation strategy being tested Excluded if general service feasibility not focused on intervention or strategy of interest; Excluded if descriptive without formal analyses of client or consumer experiences
Fidelity Degree to which an intervention or implementation strategy was implemented as intended Implementer During implementation Quantitative Must report formal analyses of fidelity to intervention or implementation strategy of interest; must be able to calculate numerator and denominator of (no. of implementers achieving fidelity/no. of implementing) Excluded if general quality of care or delivery not focused on intervention or strategy of interest; Excluded if qualitative results on fidelity that do not allow calculation of proportion achieving fidelity
Cost Cost of intervention or strategy delivery Implementer; Organization; Setting Post-implementation Quantitative Must report actual dollar amounts of implementation cost of intervention or implementation strategy of interest Excluded if general costs of service delivery not tied to intervention or strategy of interest
Penetration Degree of integration of intervention or implementation strategy within service setting and subsystems in non-controlled settings Consumer; Implementer; Organization; Setting During implementation; Post-implementation Quantitative Must be able to calculate numerator and denominator of either (no. of implementers, organizations, or settings delivering intervention or implementation strategy/no. of eligible) or (no. of consumers using a given intervention/no. of eligible); Depression intervention must be under routine institutional implementation, rather than controlled by researchers or external implementers Excluded if results do not allow calculation of proportion utilizing intervention or implementation strategy with depression intervention delivered under routine conditions; Excluded if depression intervention under researcher-controlled implementation and not institutional implementation
Sustainability Extent to which an intervention or implementation strategy is maintained within service setting's ongoing, stable operations Organization; Setting During implementation; Post-implementation Qualitative; Quantitative Defined as measurement of maintenance (either quantitative or qualitative) or ‘intent-to-continue use’ after initial pilot research-based funding has been rescinded and implementation is progressing under routine care conditions Excluded if measurement only occurred during pilot research-based funding; Excluded if general sustainability not targeting intervention or implementation strategy of interest