Table 3.
Methodological Quality Characteristics of Studies Based on the Methodological Quality Rating Scale (MQRS) (n = 17).
| Methodology attributes (points) | n (%) | IRR |
|---|---|---|
| A. Study design | 1.00 | |
| Single group pretest posttest (1) | 5 (29.4) | |
| Quasi-experimental (nonequivalent control) (2) | 11 (64.7) | |
| Randomization with control group (3) | 1 (5.9) | |
| B. Replicability | 1.00 | |
| Procedures contain insufficient detail (0) | 0 (0) | |
| Procedures contain sufficient detail (1) | 17 (100) | |
| C. Baseline | 0.94 | |
| No baseline scores, characteristics, or measures reported (0) | 1 (5.9) | |
| Baseline scores, characteristics, or measures reported (1) | 16 (94.1) | |
| D. Quality control | 1.00 | |
| No standardization specified (0) | 3 (17.6) | |
| Intervention standardization by manual, procedures, specific training, etc. (1) | 14 (82.4) | |
| E. Follow-up length | 0.94 | |
| Less than 6 months (0) | 14 (82.4) | |
| 6–11 months (1) | 3 (17.6) | |
| 12 months or longer (2) | 0 (0) | |
| F. Dosage No discussion of dosage or % of treatment received (0) | 5 (29.4) | 1.00 |
| Dosage, % treatment enumerated and accounted for (1) | 12 (70.6) | |
| G. Collaterals | 1.00 | |
| No collateral verification (0) | 17 (100) | |
| Collaterals interviewed (1) | 0 (0) | |
| H. Objective verification | 1.00 | |
| No objective verification (0) | 1 (5.9) | |
| Verification of records (paper records, blood, materials, etc.) (1) | 16 (94.1) | |
| I. Dropouts / attrition | 0.94 | |
| Dropouts neither discussed nor accounted for (0) | 6 (35.3) | |
| Dropouts enumerated and discussed (1) | 11 (64.7) | |
| J. Statistical power | 0.82 | |
| Inadequate power due to sample size/dropouts (0) | 6 (35.3) | |
| Adequate power with adequate sample size (1) | 11 (64.7) | |
| K. Independent | 0.88 | |
| Follow-up nonblind, unspecified (0) | 17 (100) | |
| Follow-up of interventions treatment-blind (1) | 0 (0) | |
| L. Analyses | 0.88 | |
| No statistical analyses or clearly inappropriate analyses (0) | 1 (5.9) | |
| Appropriate statistical analyses (group differences, characteristics comparable) (1) | 16 (94.1) | |
| M. Multisite | 1.00 | |
| Single site (0) | 14 (82.4) | |
| Parallel replications at two or more sites (1) | 3 (17.6) |
Note:
*
Dosage was scored as a “1” if all aspects of the intervention were enumerated and discussed.
Abbreviation. IRR: interrater reliability.