Skip to main content
La Tunisie Médicale logoLink to La Tunisie Médicale
. 2022 May 1;100(5):353.

How to assess heterogeneity for a meta-analysis?

Comment évaluer l’hétérogénéité pour une méta-analyse ?

Chadli Dziri 1
PMCID: PMC9552239  PMID: 36206082

TO THE EDITOR: I read the update meta-analysis from biomedical literature about MTHFR ’polymorphisms and the CML’ risk, published by Turki et al. in the Apr issue of “La Tunisie Médicale” (1 ) with interest, and I congratulate the authors for their reported meta-analysis. However, I have some comments on the presentation of the methodology (Methods section, page 287, left column - 2nd paragraph):

1.   The authors stated: "The heterogeneity was determined by calculating I² metric statistic. I²<I²50% were interpreted as low, moderate, and high degrees of heterogeneity, respectively (reference 19)."

This concept is not accurate. Lopez Lopez's reference 19 does not mention the origin of this concept. Lopez Lopez should have quoted the reference of Higgins (2 ) who introduced this concept in 2003, which remains an opinion of expert (level 5 of evidence according to the Oxford classification). The same author Higgins with Borenstein and others published an article with the title of " I² is not an absolute measure of heterogeneity " (3 ).

In fact, heterogeneity is assessed by the variation of the true effect size which is provided by the 95% Predictive Interval (4, 5 ) and its variance Tau squared (Tau²). The 95% predictive interval is an index of dispersion while the confidence interval is an index of precision.

2.   The authors also stated: "When no heterogeneity was found with p >0, 05 or I² < 50%, a fixed effect model was chosen to estimate the pooled ORs with their corresponding 95%CIs. Otherwise, a random-effects model was used (reference 20).

This concept is not accurate. When dealing with different populations, the Random Model must always be applied, whatever the I², which is what the authors did in Figures 2A and 2B. Indeed, there is no place for the fixed model in this context (6 ).

References

  1. Turki Fatma, Louati Nour, Kamoun Hassen, Keskes Leila, Rebaii Tarek, Frikha Rim. La Tunisie M{é}dicale. 4. Vol. 100. Tunisian Society of Medical Sciences; 2022. Update meta-analysis from biomedical literature about MTHFR’polymorphisms and the CML’risk; p. 285. [PMC free article] [PubMed] [Google Scholar]
  2. Higgins Julian PT, Thompson Simon G, Deeks Jonathan J, Altman Douglas G. Bmj. 7414. Vol. 327. British Medical Journal Publishing Group; 2003. Measuring inconsistency in meta-analyses; pp. 557–560. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. M Borenstein, JP Higgins, LV Hedges, HR Rothstein. Basics of Meta-Analysis: I<sup>2</sup> is not an absolute measure of heterogeneity. Res Synth Methods. 2017;8(1):5–18. doi: 10.1002/jrsm.1230.Epub2017Jan6. [DOI] [PubMed] [Google Scholar]
  4. Borenstein Michael, Hedges Larry V, Higgins Julian PT, Rothstein Hannah R. John Wiley &amp; Sons; 2021. Introduction to meta-analysis. [Google Scholar]
  5. Borenstein Michael. Biostat, Incorporated; 2019. Common mistakes in meta-analysis and how to avoid them; pp. 85–93. [Google Scholar]
  6. Borenstein Michael, Hedges Larry V, Higgins Julian P T, Rothstein Hannah R. A basic introduction to fixed-effect and random-effects models for meta-analysis. Res Synth Methods . 2010;1(2):97–111. doi: 10.1002/jrsm.12. [DOI] [PubMed] [Google Scholar]

Articles from La Tunisie Médicale are provided here courtesy of Tunisian Society of Medical Sciences

RESOURCES