Table 3. Weighted Kappa scores for inter-rater agreement when assessing the component studies included in two systematic reviews.
Systematic Review | Domain | Overall RoB Judgment | ||||||
---|---|---|---|---|---|---|---|---|
Bias Due to Confounding | Bias in Selection of Participants | Bias in Measurement of Interventions | Bias Due to Departures from Intended Interventions | Bias Due to Missing Data | Bias in Measurement of Outcomes | Bias in Selection of Reported Results | ||
Loke et al. [17] | 0.72 | 0.91 | 0.63 | 0.67 | 0.59 | 1.00 | 0.78 | 0.72 |
McGettigan and Henry [18]* | 0.78 | 0.50 | 0.71 | 0.77 | 1.00 | 1.00 | 0.45 | 0.91 |
*Graham et al. [20] was excluded from these analyses, as it was used for training purposes.