RANDOM SEQUENCE GENERATION Selection bias (biased allocation to interventions) due to inadequate generation of a randomised sequence
Criteria for a judgement of ‘low risk’ of bias	The investigators describe a random component in the sequence generation process such as: referring to a random number table; using a computer random number generator; coin tossing; shuffling cards or envelopes; throwing dice; drawing of lots; minimisation.* *Minimisation may be implemented without a random element, and this is considered to be equivalent to being random.
Criteria for the judgement of ‘high risk’ of bias	The investigators describe a non‐random component in the sequence generation process. Usually, the description would involve some systematic, non‐random approach, for example: sequence generated by odd or even date of birth; sequence generated by some rule based on date (or day) of admission; sequence generated by some rule based on hospital or clinic record number. Other non‐random approaches happen much less frequently than the systematic approaches mentioned above and tend to be obvious. They usually involve judgement or some method of non‐random categorisation of participants, for example: allocation by judgement of the clinician; allocation by preference of the participant; allocation based on the results of a laboratory test or a series of tests; allocation by availability of the intervention.
Criteria for the judgement of ‘unclear risk’ of bias	Insufficient information about the sequence generation process to permit judgement of low or high risk
ALLOCATION CONCEALMENT Selection bias (biased allocation to interventions) due to inadequate concealment of allocations prior to assignment
Criteria for a judgement of ‘low risk’ of bias	Participants and investigators enrolling participants could not foresee assignment because one of the following, or an equivalent method, was used to conceal allocation: central allocation (including telephone, web‐based, and pharmacy‐controlled randomisation); sequentially numbered drug containers of identical appearance; sequentially numbered, opaque, sealed envelopes.
Criteria for the judgement of ‘high risk’ of bias	Participants or investigators enrolling participants could possibly foresee assignments and thus introduce selection bias, such as allocation based on: using an open random allocation schedule (e.g. a list of random numbers); assignment envelopes were used without appropriate safeguards (e.g. if envelopes were unsealed or non­opaque or not sequentially numbered); alternation or rotation; date of birth; case record number; any other explicitly unconcealed procedure.
Criteria for the judgement of ‘unclear risk’ of bias	Insufficient information to permit judgement of low or high risk. This is usually the case if the method of concealment is not described or not described in sufficient detail to allow a definite judgement, such as if the use of assignment envelopes is described, but it remains unclear whether envelopes were sequentially numbered, opaque, and sealed.
BLINDING OF PARTICIPANTS AND PERSONNEL Performance bias due to knowledge of the allocated interventions by participants and personnel during the study
Criteria for a judgement of ‘low risk’ of bias	Any one of the following: no blinding or incomplete blinding, but the review authors judge that the outcome is not likely to be influenced by lack of blinding; blinding of participants and key study personnel ensured, and unlikely that the blinding could have been broken.
Criteria for the judgement of ‘high risk’ of bias	Any one of the following: no blinding or incomplete blinding, and the outcome is likely to be influenced by lack of blinding; blinding of key study participants and personnel attempted, but likely that the blinding could have been broken, and the outcome is likely to be influenced by lack of blinding
Criteria for the judgement of ‘unclear risk’ of bias	Any one of the following: insufficient information to permit judgement of low or high risk; the study did not address this outcome.
BLINDING OF OUTCOME ASSESSMENT Detection bias due to knowledge of the allocated interventions by outcome assessors
Criteria for a judgement of ‘low risk’ of bias	Any one of the following: no blinding of outcome assessment, but the review authors judge that the outcome measurement is not likely to be influenced by lack of blinding; blinding of outcome assessment ensured, and unlikely that the blinding could have been broken.
Criteria for the judgement of ‘high risk’ of bias	Any one of the following: no blinding of outcome assessment, and the outcome measurement is likely to be influenced by lack of blinding; blinding of outcome assessment, but likely that the blinding could have been broken, and the outcome measurement is likely to be influenced by lack of blinding.
Criteria for the judgement of ‘unclear risk’ of bias	Any one of the following: insufficient information to permit judgement of low or high risk; the study did not address this outcome.
INCOMPLETE OUTCOME DATA Attrition bias due to amount, nature, or handling of incomplete outcome data
Criteria for a judgement of ‘low risk’ of bias	Any one of the following: no missing outcome data; reasons for missing outcome data unlikely to be related to true outcome (for survival data, censoring unlikely to be introducing bias); missing outcome data balanced in numbers across intervention groups, with similar reasons for missing data across groups; for dichotomous outcome data, the proportion of missing outcomes compared with observed event risk not enough to have a clinically relevant impact on the intervention effect estimate; for continuous outcome data, plausible effect size (difference in means or standardised difference in means) among missing outcomes not enough to have a clinically relevant impact on observed effect size; missing data have been imputed using appropriate methods.
Criteria for the judgement of ‘high risk’ of bias	Any one of the following: reason for missing outcome data likely to be related to true outcome, with either imbalance in numbers or reasons for missing data across intervention groups; for dichotomous outcome data, the proportion of missing outcomes compared with observed event risk enough to induce clinically relevant bias in intervention effect estimate; for continuous outcome data, plausible effect size (difference in means or standardised difference in means) among missing outcomes enough to induce clinically relevant bias in observed effect size; ‘as‐treated’ analysis done with substantial departure of the intervention received from that assigned at randomisation; potentially inappropriate application of simple imputation.
Criteria for the judgement of ‘unclear risk’ of bias	Any one of the following: insufficient reporting of attrition/exclusions to permit judgement of low or high risk (e.g. number randomised not stated, no reasons for missing data provided); the study did not address this outcome.
SELECTIVE REPORTING Reporting bias due to selective outcome reporting
Criteria for a judgement of ‘low risk’ of bias	Any of the following: the study protocol is available and all of the study’s prespecified (primary and secondary) outcomes that are of interest in the review have been reported in the prespecified way; the study protocol is not available but it is clear that the published reports include all expected outcomes, including those that were prespecified (convincing text of this nature may be uncommon).
Criteria for the judgement of ‘high risk’ of bias	Any one of the following: not all of the study’s prespecified primary outcomes have been reported; one or more primary outcomes is reported using measurements, analysis methods, or subsets of the data (e.g. subscales) that were not prespecified; one or more reported primary outcomes were not prespecified (unless clear justification for their reporting is provided, such as an unexpected adverse effect); one or more outcomes of interest in the review are reported incompletely so that they cannot be entered in a meta‐analysis; the study report fails to include results for a key outcome that would be expected to have been reported for such a study.
Criteria for the judgement of ‘unclear risk’ of bias	Insufficient information to permit judgement of low or high risk. It is likely that the majority of studies will fall into this category.
Early stopping Bias due to problems not covered elsewhere in the table
Criteria for a judgement of ‘low risk’ of bias	Sample size calculation was reported, and the trial was not stopped or the trial was stopped early by a formal stopping rule at a point where the likelihood of observing an extreme intervention effect due to chance was low.
Criteria for the judgement of ‘high risk’ of bias	Sample size calculations were not reported, and it is not clear whether the trial was stopped early.
Criteria for the judgement of ‘unclear risk’ of bias	The trial was stopped early because of an informal stopping rule, or the trial was stopped early by a formal stopping rule at a point where the likelihood of observing an extreme intervention effect due to chance was high.