Table 3.
Comparison of Fidelity Condition Scores to Direct Observation Scores
| Mean Condition Score (SD) | Mean direct observation Score (SD) | Least Squares Mean Paired Difference Between Condition and direct observation | Cohen’s dd | P value of Paired Differenceb | |
|---|---|---|---|---|---|
| Maximum CBT Score | |||||
|
| |||||
| SR (n=100) | 5.28 (1.17) | 3.42 (1.55) | −1.84 | 1.34 | <.001 |
| CSR (n=96) | 4.53 (1.18) | 3.69 (1.36) | −0.83 | 0.62 | <.001 |
| BR (n=92) | 4.09 (1.48) | 3.72 (1.59) | −0.34 | 0.22 | .08c |
|
| |||||
| Mean CBT Score a | |||||
|
| |||||
| SR (n= 89) | 3.91 (0.82) | 2.77 (0.72) | −1.15 | 1.49 | <.001 |
| CSR (n= 94) | 3.18 (0.63) | 2.80 (0.68) | −0.38 | 0.58 | .002 |
| BR (n=87) | 3.13 (0.93) | 2.82 (0.70) | −0.30 | 0.36 | .02c |
|
| |||||
| CBT Count Total Techniques Scored | |||||
|
| |||||
| SR (n=100) | 7.17 (2.59) | 3.15 (1.84) | −4.02 | 1.79 | <.001 |
| CSR (n=96) | 4.38 (1.74) | 3.15 (1.40) | −1.23 | 0.77 | <.001 |
| BR (n=92) | 3.10 (1.58) | 3.21 (1.78) | 0.118 | 0.07 | .75c |
Abbreviations: SR, Self-Report; CSR, Chart-Stimulated Recall; BR, Behavioral Rehearsal. Direct Observation was measured by the Therapy Process Observation Coding Scale-Revised Strategies.
Sample sizes varied for this analysis, as it only included sessions in which CBT was scored as present (i.e., a 2 or greater on the 7-point scale).
Presents the p value of the significance of the intercept of the three-level regression model comparing condition and direct observation adherence score. A significant p value indicates that the least squares paired mean difference is not equal to zero.
p > .01, indicating no significant difference in adherence score produced between Condition (SR, CSR, or BR) and direct observation.
Cohen’s d calculated as the magnitude of effect of the least squares mean paired difference between condition and direct observation