Skip to main content
Ethiopian Journal of Health Sciences logoLink to Ethiopian Journal of Health Sciences
. 2019 Nov;29(6):775–778. doi: 10.4314/ejhs.v29i6.15

Using the Methodology of Systematic Review of Reviews for Evidence-Based Medicine

Edris Hasanpoor 1, Jamal Hallajzadeh 2, Yibeltal Siraneh 3, Ebrahim Hasanzadeh 4, Elaheh Haghgoshayie 1,
PMCID: PMC6842712  PMID: 31741649

Introduction

Evidence-based medicine miracle has embraced all the sciences (15). This movement improved medical practice using the critical thinking (1, 69). In the meantime, systematic reviews are one of the best available evidence by apprising preliminary studies. Systematic reviews and meta-analyses have become increasingly important in health care. In addition, these studies are increasing globally in different healthcare settings (1013). It is estimated that around 22 new systematic reviews are published every day. The evidence suggest that almost 50 systematic reviews are published every day (14). The purpose of this study was to introduce the type, necessities, and applications of reviews of systematic reviews for evidence-based medicine.

With the increase in the number of systematic reviews, a fundamental next step to provide decision-makers in healthcare with the evidence they require has been the conduct of reviews of existing systematic reviews and evidence brief. The reviews of systematic reviews are referred to by several different terms in the scientific evidence, including umbrella reviews, overviews of reviews, metareview, review of reviews, a summary of systematic reviews and also a synthesis of reviews (15). The reviews of systematic reviews are a relatively new method of evidence synthesis. Each reviews of systematic reviews focuses on a broad condition or problem for which there are two or more potential interventions and highlights reviews that address these potential interventions and their results (15, 16).

Conduct of a meta-review offers the possibility to address a broad area of issues related to the phenomena of interest and is ideal to present a wide scope of the evidence related to a specific question (15, 17). Systematic reviews are essential to evidence-based decision-making and provide the highest level of evidence to clinicians and policy-makers (1821). Nowadays more and more number of review studies is increasingly expanding and are becoming part of the routine and basic research in healthcare sciences (22). On the other hand, clinicians and policy-makers are faced with a large number of review studies in a particular domain of work (2, 3, 6). So, when collecting and extracting outcomes from several reviews, the reviews of systematic reviews is needed. In literature, many topics have multiple systematic reviews with varying degrees of quality and scope. Thus, reviews of systematic reviews is needed to finalize into a single document where the results of multiple reviews can be compared, thus making it easier for the decision-maker (16, 23).

Methodology of Systematic Review of Reviews

The meta-review or reviews of systematic reviews is important for several reasons (10, 24, 25): (1) it allows the results of reviews relevant to a review question to be compared and contrasted; (2) It allows ready assessment of whether review authors addressing similar review questions independently observe similar findings; (3) it can play a role in signposting the reader to evidence, summarising existing research or highlighting the absence of evidence; (4) It could be a useful source for decision-makers in developing clinical practice guidelines, decision support systems, and drug formularies; (5) the reviews of systematic reviews contain a clearly stated objective designed to answer at least one research question; and (6) It was judged to be the most appropriate method to address this complex area of as there is a vast literature which is highly heterogeneous. Conducting reviews of systematic reviews enables the results of individual reviews to be brought together, compared and contrasted, with the aim of providing a single comprehensive overview, which can serve as a simple introduction to the challenges of achieving change and implementing complex interventions in healthcare services for managers, clinicians or decision- makers (5, 24, 25). According to evidence, there is different type of reviews of systematic reviews. Common applications for systematic review of reviews based on the type of included reviews in reviews of systematic reviews are shown in Table 1.

Table 1.

Applications for different systematic review of reviews

No. Type of systematic review
of reviews
Applications
1 Systematic review of
intervention reviews
  • To summarise evidence from more than one systematic review of different interventions for the same condition or problem.

  • To summarise evidence from more than one systematic review of the same intervention for the same condition or problem where different outcome

  • To summarise evidence from more than one systematic review of the same intervention for the same condition or problem where different outcomes.

  • To summarise evidence from more than one systematic review of the same intervention for different conditions, problems or populations.

  • To summarise evidence about adverse effects of an intervention from more than one systematic review of use of the intervention for one or more conditions.

2 Systematic review of
prognosis/prevalence
reviews
  • To summarise evidence about prognosis/ prevalence from more than one systematic review.

3 Systematic review of diagnostic test accuracy reviews
  • To summarise evidence from more than one systematic review of diagnostic test accuracy assessing the same medical test to address the same condition or problem.

4 Systematic review of risk factors reviews
  • These overviews incorporate disease etiology or risk factors when the risks of interest may not directly relate to prognostic variables or risk prediction models.

5 Systematic review of descriptive reviews
  • To summarise evidence from more than one systematic review of descriptive reviews to address the descriptive results of review studies.

6 Systematic review of qualitative reviews
  • To summarise systematic review evidence relating to qualitative views or experiences. There is clear guidance available on the good conduct of an overview of qualitative syntheses.

A meta-review's most important feature is that this type of evidence synthesis only assumes for inclusion the highest level of evidence, namely other systematic reviews and meta-analyses (13, 15, 23). Specifically, review of systematic reviews refers to review compiling evidence from multiple reviews into one accessible and usable document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address these interventions and their results. However, as systematic reviews become more numerous, there is the potential for greater use of such overarching reviews as a mechanism for aggregating findings from several reviews that address specific questions (15, 23). With the ever-increasing number of systematic reviews published daily, reviews of systematic reviews have a clear role in evidence-based healthcare and decision-making in health care services (2, 6, 26, 27). This era is known as age of the evidence-based everything. Healthcare decision-makers can create a conducive context and provide the big opportunities to improve peer-to-peer evidence and knowledge sharing together. The reviews of systematic reviews have the potential to be a useful tool for the translation of health evidence and decision-making. In addition, reviews of systematic reviews are sources of evidence for conducting the policy brief and for designing the decision support systems. A systematic review of reviews allows the creation of a summary of reviews in a single document. These may be preferred by healthcare decision-makers because they synthesize all systematic reviews evidence in one single document. In future study, we identify the items based on the best available evidence for reporting the systematic review of reviews.

References

  • 1.Hasanpoor E, Bahadori M, Yaghoubi M, Haghgoshayie E, Mahboub-Ahari A. Evidence-based management as a basis for evidence-based medical consultation. BMJ evidence-based medicine. 2018 doi: 10.1136/bmjebm-2018-111104. bmjebm-2018-111104. [DOI] [PubMed] [Google Scholar]
  • 2.Hasanpoor E, Hajebrahimi S, Janati A, Abedini Z, Haghgoshayie E. Barriers, facilitators, process and sources of evidence for evidence-based management among health care managers: a qualitative systematic review. Ethiopian journal of health sciences. 2018;28(5):665. doi: 10.4314/ejhs.v28i5.18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Hasanpoor E, Janati A, Arab-Zozani M, Haghgoshayie E. Using the evidence-based medicine and evidence-based management to minimise overuse and maximise quality in healthcare: a hybrid perspective. BMJ evidence-based medicine. 2018 doi: 10.1136/bmjebm-2018-110957. bmjebm-2018-110957. [DOI] [PubMed] [Google Scholar]
  • 4.Hasanpoor E, Belete YS, Janati A, Hajebrahimi S, Haghgoshayie E. The Use of Evidence-Based Management in Nursing Management. Africa Journal of Nursing and Midwifery. 2019;21(1):16. 9. [Google Scholar]
  • 5.Langell JT. Evidence-based medicine: A datadriven approach to lean healthcare operations. International Journal of Healthcare Management. 2019:1–4. [Google Scholar]
  • 6.Janati A, Hasanpoor E, Hajebrahimi S, Sadeghi-Bazargani H. Health care managers' perspectives on the sources of evidence in evidence-based hospital management: A qualitative study in Iran. Ethiopian journal of health sciences. 2017;27(6):659–668. doi: 10.4314/ejhs.v27i6.11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Janati A, Hasanpoor E, Hajebrahimi S, Sadeghi-Bazargani H. Evidence-based management-healthcare manager viewpoints. International journal of health care quality assurance. 2018;31(5):436–448. doi: 10.1108/IJHCQA-08-2017-0143. [DOI] [PubMed] [Google Scholar]
  • 8.Janati A, Hasanpoor E, Hajebrahimi S, Sadeghi-Bazargani H, Khezri A. An evidence-based framework for evidence-based management in healthcare organizations: a delphi study. Ethiopian journal of health sciences. 2018;28(3):305–314. doi: 10.4314/ejhs.v28i3.8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hasanpoor E, Belete YS, HSM PF, Janati A, Hajebrahimi S, Haghgoshayie E. Nursing Managers' Perspectives on the Facilitators and Barriers to Implementation of Evidence-Based Management. Worldviews on Evidence-Based Nursing. 2019;1:8. doi: 10.1111/wvn.12372. [DOI] [PubMed] [Google Scholar]
  • 10.Moher D, Liberati A, Tetzlaff J, Altman DG, Group P Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine. 2009;6(7):e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Moher D, Liberati A, Tetzlaff J, Altman DG, Group P Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. 2010;336 [PMC free article] [PubMed] [Google Scholar]
  • 12.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic reviews. 2015;4(1):1. doi: 10.1186/2046-4053-4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Khan KS, Ball E, Fox CE, Meads C. Systematic reviews to evaluate causation: an overview of methods and application. BMJ evidence-based medicine. 2012;17(5):137–141. doi: 10.1136/ebmed-2011-100287. [DOI] [PubMed] [Google Scholar]
  • 14.Hunt H, Pollock A, Campbell P, Estcourt L, Brunton G. An introduction to overviews of reviews: planning a relevant research question and objective for an overview. Systematic reviews. 2018;7(1):39. doi: 10.1186/s13643-018-0695-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Aromataris E, Fernandez R, Godfrey CM, Holly C, Khalil H, Tungpunkom P. Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. International journal of evidence-based healthcare. 2015;13(3):132–140. doi: 10.1097/XEB.0000000000000055. [DOI] [PubMed] [Google Scholar]
  • 16.Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal. 2009;26(2):91–108. doi: 10.1111/j.1471-1842.2009.00848.x. [DOI] [PubMed] [Google Scholar]
  • 17.Aromataris E, Fernandez RS, Godfrey C, Holly C, Khalil H, Tungpunkom P. Methodology for JBI umbrella reviews. 2014. [DOI] [PubMed] [Google Scholar]
  • 18.Bastian H, Glasziou P, Chalmers I. Seventyfive trials and eleven systematic reviews a day: how will we ever keep up? PLoS medicine. 2010;7(9):e1000326. doi: 10.1371/journal.pmed.1000326. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Pieper D, Mathes T. Survey of instructions for authors on how to report an update of a systematic review: guidance is needed. BMJ evidence-based medicine. 2017 doi: 10.1136/ebmed-2016-110609. ebmed-2016-110609. [DOI] [PubMed] [Google Scholar]
  • 20.Perera R, Heneghan C. Interpreting metaanalysis in systematic reviews. BMJ evidencebased medicine. 2008;13(3):67–69. doi: 10.1136/ebm.13.3.67. [DOI] [PubMed] [Google Scholar]
  • 21.Guo R, Berkshire SD, Fulton LV, Hermanson PM. Predicting intention to use evidence-based management among US healthcare administrators: Application of the theory of planned behavior and structural equation modeling. International Journal of Healthcare Management. 2019;12(1):25–32. [Google Scholar]
  • 22.Mulrow CD. Systematic reviews: rationale for systematic reviews. Bmj. 1994;309(6954):597–599. doi: 10.1136/bmj.309.6954.597. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Samnani SS, Vaska M, Ahmed S, Turin TC. Review typology: The basic types of reviews for synthesizing evidence for the purpose of knowledge translation. Journal of the College of Physicians and Surgeons Pakistan. 2017;27(10):635–641. [PubMed] [Google Scholar]
  • 24.Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC medical research methodology. 2011;11(1):15. doi: 10.1186/1471-2288-11-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, et al. Achieving change in primary care—causes of the evidence to practice gap: systematic reviews of reviews. Implementation Science. 2015;11(1):40. doi: 10.1186/s13012-016-0396-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Arab-Zozani M, Pezeshki MZ, Khodayari-Zarnaq R, Janati A. Medical overuse in the Iranian healthcare system: a systematic review protocol. BMJ open. 2018;8(4):e020355. doi: 10.1136/bmjopen-2017-020355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Jefferson T, Doshi P, Boutron I, Golder S, Heneghan C, Hodkinson A, et al. When to include clinical study reports and regulatory documents in systematic reviews. BMJ evidence-based medicine. 2018;23(6):210–217. doi: 10.1136/bmjebm-2018-110963. [DOI] [PubMed] [Google Scholar]

Articles from Ethiopian Journal of Health Sciences are provided here courtesy of College of Public Health and Medical Sciences of Jimma University

RESOURCES