Table 5.
Comparing MEtRICS-Trained Observers’ Competent Adherence Ratings on the CPS-MEtRICS to Providers’ Self-Reported CPS-PIF
| Item | 1. CPS-MEtRICS | 2. CPS-PIF by self-report | 1 versus 2 |
|---|---|---|---|
| Mean ( SD ) | Mean ( SD ) | Paired- t or multilevel model | |
| 1 | 3.29 (0.75) | 2.78 (0.89) | 1.56 |
| 2 | 2.93 (0.87) | 2.79 (0.95) | 1.20 |
| 3 | 2.25 (0.79) | 2.60 (0.90) | −1.57 |
| 4 | 2.6 (0.83) | 2.82 (0.89) | −2.92* |
| 5 | 2.47 (0.84) | 2.97 (0.81) | −4.99** |
| 6 | 2.58 (0.86) | 2.92 (0.76) | −3.67** |
| 7 | 1.99 (0.94) | 2.80 (0.92) | −7.73** |
| 8 | 2.25 (0.96) | 2.80 (0.93) | −6.58** |
| 9 | 2.44 (1.11) | 2.97 (0.91) | −1.79 |
| 10 | 3.28 (1.29) | 3.34 (1.25) | −0.47 |
| 11 | 3.18 (0.81) | 2.90 (0.88) | 3.53* |
| Avg. | 2.79 (0.71) | 2.98 (0.67) | −3.26* |
| Glob. | 2.62 (0.81) | 2.70 (0.78) | −1.37 |
Note. CPS = Collaborative Problem Solving; PIF = Practice Integrity Form; MEtRICS = Manualized Expert-Rated Integrity Coding System; Avg = average integrity score (calculated); Glob = global integrity score (assigned).
* p < .01; ** p < .001.