Skip to main content
. 2019 Oct 2;21(10):e15118. doi: 10.2196/15118

Table 2.

Methodological quality assessment for each individual SRa included in this study using a combination of the ROBISb tool and the AMSTARc 2.

Author, year (type of SR) Risk of bias using the ROBIS tool, Phase 2d: Identifying concerns with the review process—the four domains of bias Risk of bias using the ROBIS tool, Phase 3: Judging overall risk of bias in the review Level of confidence using the AMSTAR 2: final judgment

Study eligibility criteria Identification and selection of studies Data collection and study appraisal Synthesis and findings

Bloomfield, 2008 [36] (QTe) Low High High High High Low
Brunero, 2012 [37] (MSRf) Low Unclear Unclear High Unclear Low
Byrne, 2008 [38] (QT) High Unclear High High Unclear Low
Carroll, 2009 [39] (MSR) High Unclear High High High Critically low
Chipps, 2012 [40] (QT) Low Low Low Unclear Low Moderate
Coyne, 2018 [41] (MSR) Low Low Low Unclear Unclear Moderate
Du, 2013 [42] (QT) Low Low Low Low Low High
Feng, 2013 [43] (QT) Low Unclear Low Low Low High
Freire, 2013 [44] (MSR) Unclear Low High High High Low
Harkanen, 2016 [45] (QT) Low Low Low Low Low High
Hegland, 2017 [46] (QT) Low Low Low Low Low High
Hines, 2015 [47] (QT) Low Low Unclear Low Low Moderate
Kakushi, 2016 [48] (MSR) Unclear Unclear High High High Low
Kang, 2017 [49] (QT) Low Unclear Low Low Low High
Knapp, 2008 [10] (MSR) High High High High High Critically low
Lahti, 2014 [1] (QT) Low Unclear Low Low Low Moderate
Lam-Antoniades, 2009 [50] (QT) Low Unclear Unclear High High Low
Lawn, 2017 [51] (MSR) Unclear High Low High Unclear Low
Nicoll, 2018 [3] (MSR) Low Unclear Unclear High High Low
Philips, 2012 [52] (MSR) Unclear Unclear Unclear Unclear Unclear Low
Sinclair, 2016 [4] (QT) Low Low Low Low Low High
Tomlinson, 2013 [53] (QT) Low Unclear High High High Low

aSR: systematic review.

bROBIS: Risk Of Bias In Systematic Reviews.

cAMSTAR: Assessment of Multiple Systematic Reviews.

dPhase 1 is optional and consists of assessing the relevance of SRs. It was not performed nor described.

eQT: quantitative review.

fMSR: mixed-studies review.