Table 4. Consensus ACROBAT-NRSI judgments between two reviewers by domain of bias—component studies from Loke et al. [17].
Component Study | Domain | Overall RoB Judgment | ||||||
---|---|---|---|---|---|---|---|---|
Bias Due to Confounding | Bias in Selection of Participants | Bias in Measurement of Interventions | Bias Due to Departures from Intended Interventions | Bias Due to Missing Data | Bias in Measurement of Outcomes | Bias in Selection of Reported Results | ||
Cohort study design | ||||||||
Bilik et al. [24] | Serious | Low | Low | Low | Low | Low | Low | Serious |
Brownstein et al. [25] | Moderate | Low | Moderate | Moderate | Low | Low | Low | Serious |
Graham et al. [20] | Low | Low | Low | Low | Low | Low | Low | Low |
Hsiao et al. [27] | Critical | Serious | Low | Moderate | Low | Low | Low | Critical |
Juurlink et al. [28] | Low | Low | Low | Low | Low | Low | Low | Low |
Margolis et al. [31] | Moderate | Serious | Moderate | Moderate | Low | Low | Low | Serious |
Pantalone et al. [32] | Serious | Serious | Low | Moderate | Serious | Low | Low | Critical |
Tzoulaki et al. [34] | Low | Low | Low | Low | Moderate | Low | Low | Moderate |
Walker et al. [35] | Low | Low | Low | Low | Low | Low | Low | Low |
Wertz et al. [36] | Low | Low | Low | Low | Low | Low | Low | Low |
Winkelmayer et al. [37] | Low | Low | Low | Low | Low | Low | Low | Low |
Ziyadeh et al. [38] | Moderate | Low | Low | Low | Low | Low | Low | Moderate |
Case–control study design | ||||||||
Dormuth et al. [26] | Low | Low | Low | Low | Low | Low | Low | Low |
Koro et al. [29] | Moderate | Moderate | Low | Low | Low | Low | Serious | Serious |
Lipscombe et al. [30] | Moderate | Low | Low | Low | Low | Low | Low | Moderate |
Stockl et al. [33] | Moderate | Low | Low | Low | Low | Low | Low | Moderate |