Table 3.
Qualitative codebook of evaluation dimensions
Dimension | Original description | Sub-category | Application to TRIPLE | Relevant quantitative data |
---|---|---|---|---|
Reaction | How participants feel about the training | 78.6% of respondents rated high levels of acceptability and appropriateness | ||
Receptivity to the training | Participants reactions to the training prior to attending | |||
Positive about the training | Positive comments participants made about the training. | |||
Negative or neutral about the training | Negative or neutral comments participants made about the training. | |||
Learning | Increase in participant knowledge | Participant comments regarding things they learned in the training, or how the training changed their way of thinking. | Significant increase in self-competence (knowledge subscale of ILS), with large effect size | |
Behavior | Application of knowledge in job | Participant reports of applying their knowledge in their agency or changing how they approach their job based on what they learned in the training. | Significant increase in resilient behaviors (perseverant subscale of ILS), with large effect size | |
Results | Effect on the business or environment | Significant increases in supporting, rewarding, and valuing expertise in EBP implementation (educational support, recognition, and selection subscales of ICS), with medium to large effect sizes | ||
Changes in services delivery or practice | Attempting to implement or successfully implementing new EBPs/considering the evidence-base for current practices and making adjustments to achieve fidelity. | |||
Changes in agency culture or climate regarding EBP | Changes in how other administrative staff view EBP or implement services. Also, includes enhanced collaboration among staff. | |||
Improved staff knowledge/training | Changes made to help frontline staff learn more about EBPs, or understand why the agency uses EBPs. | |||
Changes in evaluative approaches | Changes in data collection forms and how evaluation is approached within the agency. |