Table 1.
Inter-rater reliability for the QUASR-R items.
| QUASR-R items | % | κ | 95% CI |
|---|---|---|---|
| Reported assessment of PSQ | 90.0 | 0.688 | (0.522, 0.853) |
| Coding method described | 86.7 | 0.704 | (0.560, 0.849) |
| Purpose for assessing PSQ | 77.8 | 0.601 | (0.469, 0.870) |
| Discussed the importance of assessing PSQa | 82.2 | 0.545 | (0.260, 0.831) |
| Reported criteria used to judge quality | |||
| Study design | 91.1 | 0.744 | (0.501, 0.986) |
| Missing data or attrition | 91.1 | 0.818 | (0.644, 0.992) |
| Sample size | 100 | 1.00 | – |
| Measured used | 82.2 | 0.643 | (0.416, 0.870) |
| Statistical analyses conducted | 84.4 | 0.632 | (0.380, 0.884) |
| Literature review | 100 | 1.00 | – |
| Adequacy of study conclusions | 86.7 | 0.182 | (–0.244, 0.608) |
| Definition/operationalism of | 97.8 | 0.789 | (0.377, 1.00) |
| constructs | |||
| Publication status | 93.3 | 0.378 | (–0.170, 0.925) |
| Power | 100 | 1.00 | – |
| Validity | 93.3 | 0.690 | (0.352, 1.00) |
| Reliability | 97.8 | 0.656 | (0.014, 1.00) |
| Reported study design characteristics | 72.5 | 0.393 | (0.219, 0.566) |
| Research aim | 85.1 | 0.719 | (0.599, 0.839) |
aSuch as quality’s impact on the validity of conclusions drawn by the meta-analysis or primary studies, or the potential limitations resulting from the quality of primary studies.