Table 1. Comparison of raters’ judgements for two independent raters using the Semi-Automated Quality Assessment Tool (SAQAT).
Quality rating | Weighted Kappa (95% CI) | Magnitude of Agreement |
---|---|---|
Overall judgement | 0.79 (0.65 to 0.93) | Substantial |
Risk of Bias | 1 | Almost Perfect |
Inconsistency | 0.78 (0.62 to 0.95) | Substantial |
Indirectness | 0.69 (0.44 to 0.94) | Substantial |
Imprecision | 1 | Almost Perfect |
Publication bias | 0.63 (0.17 to 1) | Substantial |