Table 2.
NIH BCC treatment fidelity strategy checklist | n | % | Medication, % | p | |
---|---|---|---|---|---|
No, n = 249 | Yes, n = 506 | ||||
Treatment design | |||||
1. Provided information about treatment dose in the intervention condition(s) | 755 | 96.3 | 96.0 | 96.4 | .754 |
Length of contact session(s) | 755 | 59.3 | 54.0 | 62.1 | .030 |
Number of contacts | 755 | 76.0 | 71.6 | 78.3 | .040 |
Content of treatment | 755 | 88.0 | 92.4 | 85.8 | .009 |
Duration of contact over time | 755 | 87.3 | 84.8 | 88.5 | .141 |
2. Provided information about treatment dose in the control or comparison condition | 755 | 84.0 | 85.6 | 83.2 | .410 |
Length of contact session | 755 | 43.2 | 35.6 | 47.0 | .002 |
Number of contacts | 755 | 56.7 | 54.0 | 58.1 | .264 |
Content of treatment | 755 | 74.3 | 76.8 | 73.1 | .289 |
Duration of contact over time | 755 | 71.3 | 69.2 | 72.3 | .353 |
3. Mention of provider credentials | 690 | 63.1 | 70.0 | 60.2 | .016 |
4. Mention of theoretical model or clinical guidelines | 755 | 62.4 | 73.6 | 56.9 | <.001 |
5. Mention of potential confounders that limit the ability to make conclusions | 755 | 81.1 | 86.4 | 78.5 | .009 |
6. Mention of plans to address possible setbacks in implementation | 755 | 5.2 | 4.8 | 5.3 | .763 |
7. More than one intervention is described, they all described equally well | 414 | 81.8 | 81.4 | 82.1 | .858 |
Training providers | |||||
1. Indication of how providers were trained | 689 | 23.3 | 29.2 | 20.8 | .017 |
2. Indication that provider training was standardized | 689 | 21.3 | 22.9 | 20.7 | .519 |
3. Measurement of provider skill acquisition post training (pre-field implementation) | 689 | 7.4 | 10.0 | 6.3 | .085 |
4. Indication of how provider skills were maintained | 689 | 24.7 | 24.2 | 24.9 | .839 |
5. A priori articulation of the characteristics being sought in a treatment provider | 689 | 6.7 | 5.2 | 7.3 | .317 |
6. Assessment of fit between the provider and the intervention at the hiring stage | 689 | 1.9 | 1.0 | 2.3 | .237 |
Delivery of treatment | |||||
1. Method to ensure that the content of the intervention was being delivered as specified | 755 | 24.2 | 27.3 | 22.7 | .167 |
2. Method to ensure that the dose of the intervention was being delivered as specified | 755 | 15.2 | 14.5 | 15.6 | .678 |
3. Mechanism to assess if the provider actually adhered to the intervention plan | 689 | 21.1 | 22.6 | 20.4 | .502 |
4. Non-specific treatment effects (eg perceived warmth) evaluated | 688 | 2.6 | 2.4 | 2.7 | .784 |
5. Authors indicate that a treatment manual was used | 688 | 32.1 | 30.5 | 32.8 | .546 |
6. Authors indicate a plan for assessment of whether active ingredients were delivered | 755 | 16.4 | 16.9 | 16.2 | .817 |
7. Authors indicate a plan for assessment of whether proscribed components were excluded | 755 | 7.8 | 8.4 | 7.5 | .657 |
8. Authors indicate a plan for how will contamination between conditions be prevented | 700 | 12.4 | 14.6 | 11.4 | .220 |
9. Authors indicate a priori specification of treatment fidelity | 755 | 10.9 | 16.9 | 7.9 | <.001 |
10. Authors indicate any post-activation adaptations or modifications in treatment delivery | 755 | 9.3 | 14.9 | 6.5 | <.001 |
Receipt of treatment | |||||
1. Subject comprehension of the intervention assessed during the intervention period | 755 | 6.6 | 7.6 | 6.1 | .435 |
2. Strategy to improve subject comprehension of the intervention | 755 | 5.2 | 4.8 | 5.3 | .763 |
3. Subject ability to perform the intervention skills assessed during the intervention period | 755 | 44.2 | 44.2 | 44.3 | .981 |
4. Strategy to improve subject performance of intervention skills during the intervention period | 755 | 9.8 | 8.8 | 10.3 | .531 |
5. Multi-cultural factors considered in the development and delivery of the intervention | 755 | 13.8 | 13.6 | 13.8 | .946 |
Enactment of treatment skills | |||||
1. Subject performance of the intervention skills assessed | 755 | 43.0 | 42.2 | 43.5 | .733 |
2. Strategy to improve subject performance of the intervention | 755 | 6.6 | 6.0 | 6.9 | .643 |
Boldface indicates statistical significance (p ≤ .05).