Skip to main content
. 2021 May 18;29(11):6995–7011. doi: 10.1007/s00520-021-06274-x

Table 1.

Illustrating the breakdown of quality appraisal scores and inter-rater reliability values for quantitative method studies

Author Checklist item Inter-rater reliability
1) Question or objective sufficiently described? 2) Evident and appropriate design 3) Subject selection 4) Subject characteristics 5) Random allocation 6) Blinding of investigators 7) Blinding of subjects 8) Defined androbust outcome measures 9) Sample size 10) Analysis described and appropriate 11) Estimate of variance 12) Controlled for confounding 13) Sufficient Results 14) Results match
Conclusions?
Huang et al., (2019) [36] 2 2 2 2 2 N/A N/A 2 2 2 2 0 2 2 1 (100%)
Park et al., (2019) [34] 2 2 2 2 2 N/A N/A 2 2 2 2 N/A 2 2 1 (100%)
Ji et al., (2019) [33] 2 2 2 2 1 N/A N/A 2 2 1 2 2 2 2 1 (100%)
Lafaro et al., (2019) [37] 2 1 2 2 N/A N/A N/A 1 1 2 1 N/A 2 2 1 (100%)
Timmerman et al., (2017) [13] 2 2 2 1 N/A N/A N/A 2 1 2 2 N/A 2 2 1 (100%)
Coats et al., (2019) [35] 2 2 1 2 N/A N/A N/A 2 1 2 2 1 2 2 1 (100%)
Maguire et al., (2015) [15] 2 2 2 2 N/A N/A N/A 2 2 2 2 N/A 2 2 1 (100%)
Denis et al., (2014) [32] 1 1 2 2 N/A N/A N/A 2 1 2 N/A N/A 2 2 1 (100%)