Skip to main content
. 2021 Mar 4;2021(3):CD013498. doi: 10.1002/14651858.CD013498.pub2
Items (1) All‐cause mortality (2) Health‐related quality of life (3) Severe hypoglycaemia (4) Non‐fatal myocardial infarction/stroke (5) Severe nocturnal hypoglycaemia (6) Serious adverse events (7) HbA1c
Study limitations
(risk of bias)a Overall risk of bias Low risk Some concerns Low risk Low risk / low risk Low risk Low risk Low risk
Inconsistencyb Point estimates did not vary widely? NA NA Yes NA Yes Yes Yes
To what extent did confidence intervals overlap (substantial: all confidence intervals overlap at least one of the included studies point estimate; some: confidence intervals overlap but not all overlap at least one point estimate; no: at least one outlier: where the confidence interval of some of the studies do not overlap with those of most included studies)? Substantial Substantial Substantial Some
Was the direction of effect consistent? Yes Yes Yes Yes
What was the magnitude of statistical heterogeneity (as measured by I²) ‐ low (I² < 40%), moderate (I² 40%‐60%), high I² > 60%)? Low Low Low Low
Was the test for heterogeneity statistically significant (P < 0.1)? Not statistically significant Not statistically significant Not statistically significant Not statistically significant
Indirectness Were the populations in included studies applicable to the decision context? Highly applicable Highly applicable Highly applicable Highly applicable Highly applicable Highly applicable Highly applicable
Were the interventions in the included studies applicable to the decision context? Highly applicable Highly applicable Highly applicable Highly applicable Highly applicable Highly applicable Highly applicable
Was the included outcome not a surrogate outcome? Yes Yes Yes Yes Yes Yes No (↓)
Was the outcome timeframe sufficient? No (↓) Yes Yes No (↓) Yes Yes Yes
Were the conclusions based on direct comparisons? Yes Yes Yes Yes Yes Yes Yes
Imprecisionc Was the confidence interval for the pooled estimate not consistent with benefit and harm? NA NA No (↓) NA No (↓) No (↓) No (↓)
What is the magnitude of the median sample size (high: 300 participants, intermediate: 100‐300 participants, low: < 100 participants)?e Intermediate Intermediate Intermediate Intermediate Intermediate Intermediate Intermediate
What was the magnitude of the number of included studies (large: > 10 studies, moderate: 5‐10 studies, small: < 5 studies)?e Small (↓) Small (↓) Small (↓) Small (↓) Small (↓) Small (↓) Small (↓)
Was the outcome a common event (e.g. occurs more than 1/100)? No (↓) NA Yes NA Yes Yes NA
Publication biasd Was a comprehensive search conducted? Yes Yes Yes Yes Yes Yes Yes
Was grey literature searched? Yes Yes Yes Yes Yes Yes Yes
Were no restrictions applied to study selection on the basis of language? Yes Yes Yes Yes Yes Yes Yes
There was no industry influence on studies included in the review? No No No No No No No
There was no evidence of funnel plot asymmetry? NA NA NA NA NA NA NA
There was no discrepancy in findings between published and unpublished studies? NA NA NA NA Yes NA Yes
aRisk of bias was addressed by the Cochrane 'Risk of bias' 2 tool (RoB 2).
bQuestions on inconsistency are primarily based on visual assessment of forest plots and prediction intervals.
cWhen judging the width of the confidence interval, it is recommended to use a clinical decision threshold to assess whether the imprecision is clinically meaningful.
dQuestions address comprehensiveness of the search strategy, industry influence, funnel plot asymmetry and discrepancies between published and unpublished studies.
eDepends on the context of the systematic review area.
(↓): key item for potential downgrading the certainty of the evidence (GRADE) as shown in the footnotes of the 'Summary of finding' table(s).
HbA1c: glycosylated haemoglobin A1c;NA: not applicable.