TABLE 2.
Item Score Frequency Among 75 Trials of Computer-Assisted Therapies for Psychiatric Disordersa
| Item | Rating | N | % | Mean | SD |
|---|---|---|---|---|---|
| Randomized control trial quality | |||||
| Randomization | 1.73 | 0.44 | |||
| No method | 0 | ||||
| Unspecified method | 1 | 20 | 27 | ||
| Randomized method (equivalent groups) | 2 | 55 | 73 | ||
| Follow-up evaluation | 0.80 | 0.68 | |||
| None | 0 | 26 | 35 | ||
| Conducted posttreatment | 1 | 38 | 51 | ||
| Data for >80% of total sample | 2 | 11 | 15 | ||
| Assessment | 0.45 | 0.70 | |||
| Self-report only | 0 | 50 | 67 | ||
| Outcome interview | 1 | 16 | 21 | ||
| Blind interview | 2 | 9 | 12 | ||
| Sample size | 1.20 | 0.79 | |||
| Small (<20 per group) | 0 | 17 | 23 | ||
| Moderate (20–50 per group) | 1 | 26 | 35 | ||
| Large (>50 per group) | 2 | 32 | 43 | ||
| Statistics | 1.05 | 0.49 | |||
| Weak approach | 0 | 7 | 9 | ||
| Reasonable method | 1 | 57 | 76 | ||
| Strong analytic method | 2 | 11 | 15 | ||
| Missing data | 0.73 | 0.68 | |||
| Not mentioned/inappropriate | 0 | 30 | 40 | ||
| Handled with imputations | 1 | 35 | 47 | ||
| Intention to treat (all subjects included) | 2 | 10 | 13 | ||
| Replication | 0.57 | 0.76 | |||
| None | 0 | 44 | 59 | ||
| One | 1 | 19 | 25 | ||
| Multiple populations | 2 | 12 | 16 | ||
| Computer-assisted therapy-specific quality | |||||
| Defined problem | 1.45 | 0.62 | |||
| No clear criteria | 0 | 5 | 7 | ||
| Self-report or cutoff score | 1 | 31 | 41 | ||
| Diagnostic interview | 2 | 39 | 52 | ||
| Evidence-based | 1.43 | 0.60 | |||
| None | 0 | 4 | 5 | ||
| Some (no manual) | 1 | 35 | 47 | ||
| Strong | 2 | 36 | 48 | ||
| Control condition | 1.13 | 0.76 | |||
| Wait-list | 0 | 17 | 23 | ||
| Placebo/attention/education | 1 | 31 | 41 | ||
| Active (equal time) | 2 | 27 | 36 | ||
| Outcome measure | 1.16 | 0.57 | |||
| Unvalidated | 0 | 7 | 9 | ||
| Self-report only | 1 | 49 | 65 | ||
| Independent assessment | 2 | 19 | 25 | ||
| Quality control/adherence | 0.97 | 0.72 | |||
| No measure | 0 | 20 | 27 | ||
| Measure access | 1 | 37 | 49 | ||
| Considered in analysis | 2 | 18 | 24 | ||
| Credibility | 0.33 | 0.64 | |||
| No measure | 0 | 57 | 76 | ||
| Measure included | 1 | 11 | 15 | ||
| Comparability across treatments | 2 | 7 | 9 | ||
| Time exposure | 0.61 | 0.93 | |||
| Not equal | 0 | 52 | 69 | ||
| Equivalent | 2 | 23 | 31 |
a
The totals with regard to score range for randomized control quality items and computer-assisted therapy-specific quality items are 2–11 and 2–13, respectively; the total mean score values are 6.55 (SD=1.90) and 7.09 (SD=2.67), respectively; and the totals for overall quality score range and mean value are 6–21 and 13.64 (SD=3.62).