Table 7.
Instruments, instrument-related procedures, and measures
| Measurement instrument | Measurement instrument time points and procedures | |||||
|---|---|---|---|---|---|---|
| Staff survey #1 (t = month 0) |
Preparation phase assessment (t = months 1–6) |
Implementation phase assessment (t = months 7–12) |
Staff survey #2 (t = month 13) |
Staff survey #3 (t = month 19) |
Measure name (purpose) Description |
|
| Independent Tape Rater Scale [26] | Xa | Time to proficiency (preparation outcome) A continuous staff measure representing the number of days between completion of the workshop training by BI staff and their demonstration of proficiency [26, 30] in the motivational interviewing-based brief intervention (MIBI) |
||||
| Independent Tape Rater Scale [26] | Xb | Implementation effectiveness [31] (implementation outcome) A continuous staff measure representing the sum of the standardized cumulative number of MIBIs delivered by BI staff (i.e., consistency) and the cumulative integrity score of their delivery of the MIBI (i.e., quality) |
||||
| Staff survey | Xc | Xc | Xc | Level of sustainment (sustainment outcome) A continuous staff measure (no specified range) that represents the number of MIBIs a BI staff self-reports having delivered during the past 6 months |
||
| Staff survey | Xc | Xc | Xc | Motivational Interviewing Experience (moderator variable) A staff measure indicating a BI staff’s perception of their motivational interviewing experience (0 = none, 1 = beginner, 2 = intermediate, 3 = advanced, 4 = expert) |
||
| Staff survey | Xc | Xc | Xc | Readiness for implementing change (moderator variable) A continuous organization measure (ranges from 1 to 5) that represents the organizational average of 6 items, each rated on a 5-point scale (1 = disagree, 2 = somewhat disagree, 3 = neither agree nor disagree, 4 = somewhat agree, 5 = agree) and adapted from Shea et al.’ readiness measure [106] |
||
| Staff survey | Xc | Xc | Xc | Implementation climate (moderator variable) A continuous organization measure (ranges from 1 to 5) that represents the organizational average of 6 items, each rated on a 5-point scale (1 = disagree, 2 = somewhat disagree, 3 = neither agree nor disagree, 4 = somewhat agree, 5 = agree) and adapted from Jacobs et al.’ implementation measure [107] |
||
| Staff survey | Xc | Xc | Xc | Leadership engagement (moderator variable) A continuous organization measure (ranges from 0 to 6) that represents the organizational average of 4 items, each rated on a 7-point scale (0 = not at all to 6 = highest extent possible) and developed for this study based on the leadership engagement construct described by Damschroder et al.—commitment, involvement, and accountability of leaders with the implementation [108] |
||
| Staff Survey |
Xc | Xc | Xc | Tension for change (moderator variable) A continuous organization measure (ranges from 0 to 6) that represents the organizational average of 3 items, each rated on a 7-point scale (0 = not at all to 6 = highest extent possible) and developed for this study based on the tension for change construct described by Damscroder et al.—stakeholders’ shared perception of the extent to which a change is important, needed, and desired [108] |
||
aRatings during the preparation phase were completed by one of the co-authors (DV)
bRatings during the implementation phase were rated by one of 15 experienced raters, each of which were trained, calibrated, and monitored by one of the co-authors (SM)
cStaff surveys (electronically administered) required approximately 30 min to complete, and staff received one $25 e-gift card per completed survey as compensation