Table 6.
Measures of sustainability as an outcome | ||||||
---|---|---|---|---|---|---|
Measure (year of initial publication) | Number of studies | Country | Settings | Perspectives | Constructs other than sustainability | Adaptations made |
Provider Report of Sustainment Scale (PRESS) (2021) [32] | 0 | |||||
Stages of implementation completion (SIC) (2006) [33] | 27 |
Australia Canada Denmark Mozambique Switzerland USA |
Clinics Community Department of Veterans Affairs sites Juvenile justice Housing providers Primary care Public service systems Substance use disorder treatment agencies |
Administrators/executives Champions Purveyor Providers Research staff |
Implementation process/phases |
N=14 Removed items Additional items Changed wording New domain Change response scale |
Measures of sustainability determinants | ||||||
Assessment of Barriers to Implementation and Sustainability in Schools (ABISS) (2016) [36] | 0 | |||||
Advanced Level Tier Interventions Treatment Utilization and Durability (ALTITUDE) (2021) [37] | 0 | |||||
A measurement instrument for sustainability of work practices in in long-term care (2011)a [38] | 6 |
Netherlands USA |
Community Hospital Long term care organisations |
Executives Frontline staff |
None |
N = 6 Removed items Additional items Changed wording Deleted domains Changed response scale |
Change Process Capability Questionnaire (CPCQ) (2008) [39] | 34 |
Europe Japan Spain USA Vietnam |
College Community Outpatient Substance Use Disorder Treatment Clinics Primary care Dental clinics/practices Radiology health care organizations |
Executives Frontline staff |
Capacity to change Change process Implementation Organizational capacity Readiness to change Readiness to manage change Quality improvement Adoption of new interventions |
N = 19 Removed items Additional items Changed wording Deleted domains Other |
Clinical Sustainability Assessment Tool (CSAT) (2021) [40] | 5 |
Europe USA |
Health care Hospital General practice |
Executives Frontline staff |
None | N = 0 |
Faith-Based Organization Health Integration Inventory (FBO-HII) (2020) [41] | 1 | USA | Churches | Frontline staff | None | N = 0 |
General Organizational Index (GOI) (2009) [42, 43] | 9 |
Netherlands Norway USA |
Community mental health Primary care Medical centre |
Frontline staff Implementation monitors Research staff Trained raters |
Implementation fidelity Operating characteristics of an organization Organizational change Penetration and general integration Quality of clinical care Quality improvement |
N = 2 Additional items Changed wording Deleted domains Other |
Levels of Institutionalization (Loln) (1993) [44, 45] | 14 |
Australia Belgium Canada Uganda USA |
Community Department of Veterans Affairs sites Health facilities Hospitals Public health and sports services department School |
Executive Frontline staff |
Institutionalisation |
N = 7 Removed items Changed wording Deleted domains Changed response scale Other |
National Health Service (NHS) Sustainability Model and Guide (2010) [47] | 18 |
Canada South Africa Tanzania UK USA |
Department of Veterans Affairs sites Hospital Primary care Patient homes University Medical center |
Executive staff Frontline staff Implementation teams |
None |
N = 2 Deleted domains Changed response scale |
The Normalisation Measure Development questionnaire(NoMAD) (2018) [48–53] | 29 |
Albania Australia Brazil Canada Denmark France Germany Kosovo Netherlands Scotland Spain Sweden UK USA Wales |
Community health General practice Health care service Hospital Mental health organizations Primary care Rural health services School University |
Executive staff Frontline staff |
Acceptance Adoption Contextual factors impacting the implementation Implementation process Perceptions of implementation Normalization Maintenance |
N = 13 Removed items Additional items Changed wording New domains Deleted domains Changed response scale Other |
New South Wales Sustainability Checklist (2009) [55] | 1 | Australia | School | Stakeholders/partners | None |
N = 1 Removed items |
Office of Adolescent Health (OAH) Sustainability Assessment (2014) [56] | 0 | |||||
Office of Population Affairs (OPA) Sustainability Assessment Tool (2019) [57] | 0 | |||||
Prevention Program Assessment (2012) [58] | 2 | USA |
Community health clinics Clinical care and practice settings |
Frontline staff | Readiness for evidence-based intervention | N = 0 |
Program Sustainability Assessment Tool (PSAT) (2014) [10] | 20 |
Malaysia Philippines Puerto Rico Spain USA |
Criminal courthouse/justice settings Fire department Government health departments and non-government or support groups with HIV advocacy Pharmacy Prenatal clinics Primary care Home settings School State and community health settings State agencies and coalitions Supportive housing agencies |
Executives Frontline staff Research staff Stakeholders |
None |
N = 4 Additional items Changed wording Deleted domains Changed response scale |
Program Sustainability Assessment Tool (PSAT) – adapted for elementary setting (2021) [59] | 0 | |||||
Program Sustainability Index (2004) [60] | 12 | USA |
Child welfare systems Community settings Department of Veterans Affairs sites Medical centers |
Executives Frontline staff Stakeholders |
None |
N = 10 Removed items Additional items Changed wording Deleted domains Changed response scale Other |
School-wide Universal Behaviour Sustainability Index- School Teams (SUBSIST) (2010) [61–65] | 6 |
New Zealand USA |
School |
Executives Frontline staff |
None |
N = 2 Removed items Additional items Other |
Sustainability Formative Self-Assessment Tool (2011) [66] | 0 | |||||
Sustainable Implementation Scale (SIS) (2018) [67] | 4 | Sweden |
Community mental health services Public employment services |
Research staff | None | N = 0 |
Sustained Implementation Support Scale (2018) [67] | 1 | Australia | Aboriginal and Torres Strait Islander child welfare agencies | Frontline staff | None | N = 0 |
Sustaining Innovation Through Education (SITE): Extended Behavioural (2020) [69] | 0 | |||||
Sustaining Innovation Through Education (SITE): Short Behavioural ( 2020) [69] | 0 | |||||
Sustainment Leadership Scale (2018) [70] | 0 | |||||
Sustainment Measurement System Scale (SMSS) (2020) [72] | 0 |
aEmpirical use of the long and short version of this measure were assessed together