Table 4.
Comparison of inter-rater agreement ratings for Version 4.0 versus Version 6.0 of RoB-SPEO by domain.
| RoB-SPEO domain | Inter-rater reliability, Version 4.0 | Inter-rater reliability, Version 6.0 | Change from Version 4.0 to Version 6.0 | |
|---|---|---|---|---|
| 1 | Bias in selection of participants into the study | 0.33 | 0.67 | +0.34 |
| 2 | Bias due to a lack of blinding of study personnel | 0.65 | 0.82 | +0.17 |
| 3 | Bias due to exposure misclassification | 0.76 | 0.80 | +0.04 |
| 4 | Bias due to incomplete exposure data | 0.31 | 0.73 | +0.42 |
| 5 | Bias due to selective reporting of exposures | 0.80 | 0.82 | +0.02 |
| 6 | Bias due to conflict of interest | 0.51 | 0.76 | +0.25 |
| 7 | Bias due to differences in numerator and denominator | NAa | 0.54 | NAa |
| 8 | Other bias | 0.51 | 0.74 | +0.23 |
a
NA = not applicable (the domain of bias due to differences in numerator and denominator was not included in Version 4.0 of RoB-SPEO).