INTRODUCTION
The practice of evidence-based medicine (EBM) mandates that rational clinicians apply a combination of both clinical judgement and rigorous review of literature before introducing any new drug, technique, or even practice in their clinical practice.[1] Medical literature, particularly in interventional branches such as anaesthesia, is fraught with studies that have contrasting results, as should be when studies are conducted in varied patient populations and in different clinical settings. Systematic reviews and meta-analyses (SRMAs) provide a lens to evaluate such conflicting evidence.[2]
For primary clinicians however, who do not possess mastery in statistical terminology and methods, translating and applying the complicated data presented by the SRMAs, into clinical practice, becomes quite challenging. An imperfect understanding of interpretation of results also increases the risk of prematurely adopting such results, when the efficacy could merely be seen on paper but not in practice.
UNDERSTANDING SYSTEMATIC REVIEWS AND META-ANALYSES
A well-designed and conducted SRMA not only synthesises the available evidence but also allows the detection of difference that an intervention may provide, which the smaller studies may not have been powered to detect.[3] The data available from an additional number of patients also put into perspective the real-life value of the effect size. For instance, a 10% mortality benefit of one therapy over the other might translate into saving millions of lives per year.[4]
Ready availability of medical literature on the Internet and powerful synthesis tools in the hands of techno-savvy and academically inclined clinicians have led to an exponential increase in the number of SRMAs in the past decade, as is evidenced by the increase in number from 7,265 in 2015 to 32,531 in 2025 on the PubMed database alone. It has thus become important for all clinicians to understand and interpret the published SRMAs in order to assess if the SRMA can be used in their routine clinical practice.
Understanding how to interpret SRMAs is anchored in two core domains. The first involves understanding the quality of the evidence presented by the SRMA itself. First, the research question should be one which is novel, interesting, and relevant. Second, the quality of a SRMA depends on the studies included in the review. The most important part of the SRMA is the literature search with the appropriate keywords to ensure not missing out on studies that can potentially be included. In addition, a thorough search of potential databases including but not limited to PubMed, Scopus, and Embase is needed. Third, the appropriate studies need to be included after thorough screening. Fourth, the outcomes should be clearly defined a priori and noted from all studies included in the SRMA with clear tabulation of results. Fifth, weightage to studies should be assigned appropriately in the SRMA without undue influence of any one study on the entire results. Sixth, assessing for heterogeneity is critical in interpreting an SRMA. Eyeballing the forest plots can give a clue to whether there are contrasting results in different studies. Seventh, study quality is very important and dictates overall study interpretation and impact. Studies need to be assessed for potential bias. Lastly, while anyone can perform a systematic review on any topic, a subject expert is needed for drawing appropriate conclusions. There are several articles that deliberate over the interpretation of SRMAs in detail.[3,4,5,6] Figure 1 attempts to summarise the aforementioned concepts for the readers.
Figure 1.
Key steps to be followed to interpret systematic reviews and meta-analyses. *Adapted from reference numbers 3,4,5
The other important factor is the contextual calibration of the meta-analysis. Unlike the homogeneity created during clinical trials, routine clinical practice is rooted in heterogeneity, right from patient population to the clinical settings.[7] Whether or not the available pooled evidence is relevant and applicable in a particular setting is impacted by differences in the local patient populations, available infrastructure, and staffing. It is recognising and incorporating these nuances into the decision-making process that will allow for the selective adoption of appropriate new clinical approaches.
SIMPLIFIED TRAFFIC-LIGHT FRAMEWORK FOR ASSESSING CONTEXTUAL APPLICABILITY OF SYSTEMATIC REVIEWS AND META-ANALYSES
Keeping these intricacies in mind, the authors propose a structured pragmatic 5-step framework that will aid the clinician in making contextually informed decisions, thus bolstering the steps 7, 8, and 9 of steps in interpreting an SRMA [Figure 1].[5,8] The framework shown in Table 1 is not intended as intended as a singular or definitive tool to analyse SRMAs but offers a pragmatic accessible guidance to busy clinicians that balances fidelity to available evidence and practical applicability. The authors recommend a sequential appraisal of five core principles which are grounded in the Grading of Recommendations Assessment, Development and Evaluation (GRADE). This includes the clinical importance of outcomes, the magnitude of absolute effect, the certainty and consistency of evidence, its contextual applicability, and the balance of harms and costs.[9] A traffic-light framework was added to provide a more explicit decision scaffold to clinicians and ease the cognitive burden, where green indicates favourable conditions, yellow suggests intermediate or uncertain results, and red suggests insufficient or inapplicable evidence. The authors have further defined the thresholds to capture the cumulative strength of evidence across each of the domains.
Table 1.
5 Step framework for contextual calibration of SRMAs
| Steps | Question | Green | Yellow | Red |
|---|---|---|---|---|
| 1 | Is the outcome clinically important? | Study discusses patient-centred outcomes (e.g., ventilator-free days, length of hospital stay) | Study uses validated surrogates (e.g., improvement in PaO2/FiO2 ratios in ARDS) | Pure surrogates only (e.g., use of lab values only) |
| 2 | What is the absolute effect shown by the study? | Effect size (as denoted by ARR or SMD) very high OR low NNT suggestive of meaningful absolute benefit as per clinical context | Small effect size suggestive of small benefit | Very small effect size suggestive of minimal benefit |
| 3 | Is the evidence clear? | Risk of bias is low as assessed by validated tools (RoB2, ROBINS-I) | Intermediate risk of bias | High risk of bias |
| 4 | Is this applicable in your patients? | Feasible in local context | Partial fit (e.g., drug access issues, infrastructure issues) | High-resource mismatch, limited applicability |
| 5 | What are the harms and costs? | Minimal burden, low cost, safe | Moderate cost or logistical complexity | High cost, high risk, difficult to implement |
|
Key to Traffic Light System | ||||
| All ≥4 green but no red | Consider routine adoption | |||
| 2–3 green with ≥2 yellow | Selective use can be considered after weighing risk and benefit | |||
| ≥ 2 red | Avoid change in current practices | |||
| If the answer to ‘what are the harms and costs?’ falls in red | DO NOT ADOPT | |||
ARR: Absolute risk reduction, Event rate difference between the experimental group and control group, pooled among studies. SMD: Standardised mean difference, Difference in continuous outcomes between the experimental group and control group, pooled among studies. NNT: Number needed to treat. The number of patients who need to receive the intervention for one additional patient to benefit compared to the control. Lower the NNT, better is the intervention. PaO2: Partial pressure of oxygen; FiO2: Fraction of inspired oxygen; ARDS: Acute respiratory distress syndrome; SRMAs: Systematic reviews and meta-analyses
Routine adoption can be undertaken if the SRMA meets all the criteria, thus ensuring alignment across all domains. When the evidentiary support is only partial with 3–4 domains showing limited congruence, selective use may be considered. Insufficient evidence in two or more domains should discourage adoption.
Our traffic-light framework is a novel tool which aims at reducing the cognitive burden in understanding complex data for busy clinicians. However, understanding the full impact of clinical utility will need external validation as a further study.
CONCLUSION
To conclude, as the number of SRMAs being published in indexed anaesthesia journals continues to increase, understanding how to interpret SRMAs is now a fundamental requirement for conscientious clinical decision-making. The authors hope that this context-aware step-wise process will help the readers to thoughtfully interpret the complex data presented in the SRMAs and decide the feasibility and appropriateness of incorporation of the said findings into their routine clinical practice.
Author contributions
GRG: Conceptualisation, methodology, writing – review & editing. SS: Conceptualisation, resource collection, methodology, writing – review & editing.
Presentation at conferences/CMEs and abstract publication
None.
Study data availability
None.
Disclosure of use of artificial intelligence(AI)-assistive or generative tools
The authors confirm that no AI tools or language models (LLMs) were used in the writing or editing of the manuscript, and no images were manipulated using AI.
Declaration of use of permitted tools
None.
Conflicts of interest
There are no conflicts of interest.
Acknowledgement
None.
Funding Statement
Nil.
REFERENCES
- 1.Clephas PRD, Heesen M. Interpretation of meta-analyses. Interv Pain Med. 2022;15(1):100120. doi: 10.1016/j.inpm.2022.100120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016;21:125–7. doi: 10.1136/ebmed-2016-110401. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Russo MW. How to review a meta-analysis. Gastroenterol Hepatol (N Y) 2007;3:637–42. [PMC free article] [PubMed] [Google Scholar]
- 4.El Dib R. How to interpret a meta-analysis? J Vasc Bras. 2022;21:e20220043. doi: 10.1590/1677-5449.202200431. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Carlson RB, Martin JR, Beckett RD. Ten simple rules for interpreting and evaluating a meta-analysis. PLoS Comput Biol. 2023;19:e1011461. doi: 10.1371/journal.pcbi.1011461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Kurdi MS, Bajwa SJS. Systematic reviews and meta-analyses: Their darker side…. J Indian Med Assoc. 2025;123:55–7. [Google Scholar]
- 7.Gagnier JJ, Moher D, Boon H, Beyene J, Bombardier C. Investigating clinical heterogeneity in systematic reviews: A methodologic review of guidance in the literature. BMC Med Res Methodol. 2012;12:111. doi: 10.1186/1471-2288-12-111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Maurya I, Garg R. Systematic review meta-analysis protocol preparation and registration – A narrative review. Indian J Anaesth. 2025;69:132–7. doi: 10.4103/ija.ija_1165_24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, et al. What is “quality of evidence” and why is it important to clinicians? BMJ. 2008;336:995–8. doi: 10.1136/bmj.39490.551019.BE. [DOI] [PMC free article] [PubMed] [Google Scholar]