Skip to main content
. 2021 Apr 16;2021(4):CD010682. doi: 10.1002/14651858.CD010682.pub3
Bias due to confounding
1.1 Is there potential for confounding of the effect of intervention in this study?
If N/PN to 1.1: the study can be considered to be at low risk of bias due to confounding and no further signalling questions need be considered
If Y/PY to 1.1: determine whether there is a need to assess time‐varying confounding
Y/PY/PN/N
1.2. If Y/PY to 1.1: Was the analysis based on splitting participants’ follow‐up time according to intervention received?
If N/PN to 1.2, answer questions relating to baseline confounding (1.4 to 1.6)
If Y/PY to 1.2, go to question 1.3
Y/PY/PN/N/NI/NA
1.3 Were intervention discontinuations or switches likely to be related to factors that are prognostic for the outcome?
If N/PN to 1.3, answer questions relating to baseline confounding (1.4 to 1.6)
If Y/PY to 1.3, answer questions relating to both baseline and time‐varying confounding (1.7 and 1.8)
Y/PY/PN/N/NI/NA
1.4. Did the authors use an appropriate analysis method that controlled for all the important confounding domains? Y/PY/PN/N/NI/NA
1.5. If Y/PY to 1.4, were confounding domains that were controlled for measured validly and reliably by the variables available in this study? Y/PY/PN/N/NI/NA
1.6. Did the authors control for any post‐intervention variables that could have been affected by the intervention? Y/PY/PN/N/NI/NA
1.7. Did the authors use an appropriate analysis method that controlled for all the important confounding domains and for time‐varying confounding? Y/PY/PN/N/NI/NA
1.8. If Y or PY to 1.7, were confounding domains that were controlled for measured validly and reliably by the variables available in this study? Y/PY/PN/N/NI/NA
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Bias in selection of participants into the study
2.1. Was selection of participants into the study (or into the analysis) based on participant characteristics observed after the start of intervention?
If N/PN to 2.1, go to 2.4
Y/PY/PN/N/NI
2.2. If Y/PY to 2.1, were the post‐intervention variables that influenced selection likely to be associated with intervention? Y/PY/PN/N/NI/NA
2.3. If Y/PY to 2.2, were the post‐intervention variables that influenced selection likely to be influenced by the outcome or a cause of the outcome? Y/PY/PN/N/NI/NA
2.4. Do start of follow‐up and start of intervention coincide for most participants? Y/PY/PN/N/NI
2.5. If Y/PY to 2.2 and 2.3, or N/PN to 2.4, were adjustment techniques used that are likely to correct for the presence of selection biases? Y/PY/PN/N/NI/NA
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Bias in classification of interventions
3.1 Were intervention groups clearly defined? Y/PY/PN/N/NI
3.2 Was the information used to define intervention groups recorded at the start of the intervention? Y/PY/PN/N/NI
3.3 Could classification of intervention status have been affected by knowledge of the outcome or risk of the outcome? Y/PY/PN/N/NI
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Bias due to deviations from intended interventions
If your aim for this study is to assess the effect of assignment to intervention, answer questions 4.1 and 4.2
If your aim for this study is to assess the effect of starting and adhering to intervention, answer questions 4.3 to 4.6
4.1. Were there deviations from the intended intervention beyond what would be expected in usual practice? Y/PY/PN/N/NI
4.2. If Y/PY to 4.1, were these deviations from intended intervention unbalanced between groups and likely to have affected the outcome? Y/PY/PN/N/NI/NA
4.3. Were important co‐interventions balanced across intervention groups? Y/PY/PN/N/NI
4.4. Was the intervention implemented successfully for most participants? Y/PY/PN/N/NI
4.5. Did study participants adhere to the assigned intervention regimen? Y/PY/PN/N/NI
4.6. If N/PN to 4.3, 4.4, or 4.5, was an appropriate analysis used to estimate the effect of starting and adhering to the intervention? Y/PY/PN/N/NI/NA
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Bias due to missing data
5.1 Were outcome data available for all, or nearly all, participants? Y/PY/PN/N/NI
5.2 Were participants excluded due to missing data on intervention status? Y/PY/PN/N/NI
5.3 Were participants excluded due to missing data on other variables needed for the analysis? Y/PY/PN/N/NI
5.4 If PN/N to 5.1, or Y/PY to 5.2 or 5.3, are the proportion of participants and reasons for missing data similar across interventions? Y/PY/PN/N/NI/NA
5.5 If PN/N to 5.1, or Y/PY to 5.2 or 5.3, is there evidence that results were robust to the presence of missing data? Y/PY/PN/N/NI/NA
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Bias in measurement of outcomes
6.1 Could the outcome measure have been influenced by knowledge of the intervention received? Y/PY/PN/N/NI
6.2 Were outcome assessors unaware of the intervention received by study participants? Y/PY/PN/N/NI
6.3 Were the methods of outcome assessment comparable across intervention groups? Y/PY/PN/N/NI
6.4 Were any systematic errors in measurement of the outcome unrelated to intervention received? Y/PY/PN/N/NI
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Bias in selection of the reported result
Is the reported effect estimate likely to be selected, on the basis of the results, from...
7.1. ... multiple outcome measurements within the outcome domain? Y/PY/PN/N/NI
7.2 ...multiple analyses of the intervention‐outcome relationship? Y/PY/PN/N/NI
7.3 ...different subgroups? Y/PY/PN/N/NI
'Risk of bias' judgement Low/Moderate/Serious/Critical/NI
Abbreviations: Y: yes; PY: probably yes; PN: probably no; N: no; NI: no information; NA: not applicable