Table 2.
Measurement Method Characteristics
| Measurement Method Characteristics | n of measurement methods |
% of methods |
|---|---|---|
| Type of Measurement Method (n =249) | ||
| Observational | 178 | 71.5% |
| Written | 65 | 26.1% |
| Psychometric Evaluation | ||
| Results reported | 185 | 74.3% |
| Psychometric properties reported | 87 | 35% |
| Reliability evidence provided | ||
| Intraclass Correlations | 43 | 17.3 |
| Kendall’s Coefficient of Concordance | 3 | 1.2% |
| Cronbach’s alpha provided | 19 | 7.6% |
| Cohen’s Kappa | 13 | 5.2% |
| Validity evidence | ||
| Convergence, concurrent, or discriminant | 6 – 11 | 2.4 – 4.4% |
| Association of adherence with outcomes | 26 | 10.4% |
| Details of Observational Data Collection (n = 178) | ||
| Audio recording | 100 | 56.2% |
| Video recording | 73 | 41% |
| Live observation | 5 | 2.8% |
| Treatment Session Sampling Strategy | ||
| Not reported | 94 | 52.8% |
| Proportion of treatment sessions coded | 140 | 78.7% |
| 20 – 25% of sessions | 23 | 27% |
| Entire session coded | 144 | 80% |
| Session segments coded | 11 | 6.2% |
| Coding Personnel | ||
| Clinicians | 57 | 22.9% |
| University students or research assistants | 67 | 26.9% |
| Study authors or treatment experts | 51 | 20.5% |
| Details of Written Data Collection (n=65) | ||
| Treatment Session Sampling Strategy | ||
| All sessions | 43 | 66.2% |
| Once weekly | 6 | 9.2% |
| Once monthly | 4 | 6.2% |
| Respondents | ||
| Therapists | 56 | 86.2% |
| Clients | 11 | 16.9% |
1
Percentages within categories often total more than 100% since one adherence measurement method may be used in multiple clinical contexts within and across studies.