Skip to main content
. 2016 Jul 19;2016(7):CD011792. doi: 10.1002/14651858.CD011792.pub2
Bias due to confounding
1.1 Is confounding of the effect of intervention unlikely in this study? Y / PY / PN / N / NI
If Y or PY to 1.1, the study can be considered to be at low risk of bias due to confounding
and no further signalling questions need be considered
For cohort‐type studies:
1.2. If N or PN to 1.1: Were participants analysed according to their initial intervention group throughout follow‐up?
Y / PY / PN / N / NI / NA
If Y or PY to 1.2, answer questions 1.4 to 1.6, which relate to baseline confounding
For cohort‐type studies:
1.3 If N or PN to 1.2: Were intervention discontinuations or switches unlikely to be related to factors that are prognostic for the outcome?
Y / PY / PN / N / NI / NA
If Y or PY to 1.3, answer questions 1.4 to 1.6, which relate to baseline confounding
If N or PN to 1.1 and 1.2 and 1.3, answer questions 1.7 and 1.8, which relate to time‐varying
confounding
1.4. Did the authors use an appropriate analysis method that adjusted for all the critically important confounding domains? Y / PY / PN / N / NI / NA
1.5. If Y or PY to 1.4: Were confounding domains that were adjusted for measured validly and reliably by the variables available in this study? Y / PY / PN / N / NI / NA
1.6. Did the authors avoid adjusting for postintervention variables? Y / PY / PN / N / NI / NA
1.7. Did the authors use an appropriate analysis method that adjusted for all the critically important confounding domains and for time‐varying confounding? Y / PY / PN / N / NI / NA
1.8. If Y or PY to 1.7: Were confounding domains that were adjusted for measured validly and reliably by the variables available in this study? Y / PY / PN / N / NI / NA
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 1.9: What is the predicted direction of bias due to confounding? Favours experimental / Favours comparator / Unpredictable
Bias in selection of participants into the study
2.1. Was selection into the study unrelated to intervention or unrelated to outcome? Y / PY / PN / N / NI
For cohort‐type studies:
2.2. Do start of follow‐up and start of intervention coincide for most participants?
Y / PY / PN / N / NI
2.3. If N or PN to 2.1 or 2.2: Were adjustment techniques used that
are likely to correct for the presence of selection biases?
Y / PY / PN / N / NI / NA
For case‐control studies:
2.4 Were the controls sampled from the population that gave rise to the cases, or using another method that avoids selection bias?
Y / PY / PN / N / NI
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 2.5: What is the predicted direction of bias due to selection of participants into the study? Favours experimental / Favours comparator / Towards null /
Away from null / Unpredictable
Bias in measurement of interventions
3.1 Is intervention status well defined? Y / PY / PN / N / NI
3.2 Was information on intervention status recorded at the time of intervention? Y / PY / PN / N / NI
3.3 Was information on intervention status unaffected by knowledge of the outcome or risk of the outcome? Y / PY / PN / N / NI
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 3.4: What is the predicted direction of bias
due to measurement of outcomes or interventions?
Favours experimental / Favours comparator / Towards null /
Away from null / Unpredictable
Bias due to departures from intended interventions
4.1. Were the critical co‐interventions balanced across intervention groups? Y / PY / PN / N / NI
4.2. Were numbers of switches to other interventions low? Y / PY / PN / N / NI
4.3. Was implementation failure minor? Y / PY / PN / N / NI
For cohort‐type studies:
4.4. If N or PN to 4,1, 4.2, or 4.3: Were adjustment techniques used that are likely to correct for these issues?
Y / PY / PN / N / NI / NA
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 4.5: What is the predicted direction of bias due to departures from the intended interventions? Favours experimental / Favours comparator / Towards null /
Away from null / Unpredictable
Bias due to missing data
For cohort‐type studies:
5.1 Are outcome data reasonably complete?
For case‐control studies:
5.1 Was outcome status reasonably complete for those in whom it was sought?
Y / PY / PN / N / NI
For cohort‐type studies:
5.2 Was intervention status reasonably complete for those in whom it was sought?
For case‐control studies:
5.2 Were data on intervention status reasonably complete?
Y / PY / PN / N / NI
5.3 Are data reasonably complete for other variables in the analysis? Y / PY / PN / N / NI
For cohort‐type studies:
5.4 If N or PN to 5.1, 5.2, or 5.3: Are the proportion of participants and reasons for missing data similar across interventions?
For case‐control studies:
5.4 If N or PN to 5.1, 5.2, or 5.3: Are the proportion of participants and reasons for missing data similar across cases and controls?
Y / PY / PN / N / NI / NA
5.5 If N or PN to 5.1, 5.2, or 5.3:
Were appropriate statistical methods used to account for missing data?
Y / PY / PN / N / NI / NA
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 5.6: What is the predicted direction of bias due to missing data? Favours experimental / Favours comparator / Towards null /
Away from null / Unpredictable
Bias in measurement of outcomes
For cohort‐type studies:
6.1 Was the outcome measure objective?
For case‐control studies:
6.1 Was the definition of case status (and control status, if applicable) based on objective criteria?
Y / PY / PN / N / NI
For cohort‐type studies:
6.2 Were outcome assessors unaware of the intervention received by study participants?
For case‐control studies:
6.2 Was the definition of case status (and control status, if applicable) applied without knowledge of the intervention received?
Y / PY / PN / N / NI
For cohort‐type studies:
6.3 Were the methods of outcome assessment comparable across intervention groups?
Y / PY / PN / N / NI
For cohort‐type studies:
6.4 Were any systematic errors in measurement of the outcome unrelated to intervention received?
Y / PY / PN / N / NI
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 6.5: What is the predicted direction of bias due to measurement of outcomes? Favours experimental / Favours comparator / Towards null /
Away from null / Unpredictable
Bias in selection of the reported result
Is the reported effect estimate unlikely to be selected, on the basis of the results, from...
For cohort‐type studies:
7.1. ...multiple outcome measurements within the outcome domain?
For case‐control studies:
7.1 ...multiple definitions of the intervention?
Y / PY / PN / N / NI
7.2 ...multiple analyses of the intervention‐outcome relationship? Y / PY / PN / N / NI
7.3 ...different subgroups? Y / PY / PN / N / NI
'Risk of bias' judgement Low / Moderate / Serious / Critical / NI
OPTIONAL 7.4: What is the predicted direction of bias due to selection of the reported result? Favours experimental / Favours comparator / Towards null /
Away from null / Unpredictable
Abbreviations: Y: yes; PY: probably yes; PN: probably no; N: no; NI: no information; NA: not applicable