In 2015, the Nobel Prize in Physiology or Medicine was awarded to Youyou Tu, for her discovery of the natural anti-malarial drug Artemisinin. Since then, natural products research has earned great attention, in terms of the significance of their role as a vast source of new drugs in modern drug discovery research. Over the past few decades, systematic reviews and meta-analyses have become crucial in healthcare settings. Clinicians and healthcare providers use these types of research to keep up to date with their field. Moreover, these reviews are frequently adopted as a starting point for improving clinical practice guidelines.
Therefore, and with a great interest in the latest advances in natural products research, with emphasis on the induced pharmacological properties, we recently read a systematic review that has been published in the International Journal of Environmental Research and Public Health by Hamdan et al. [1]. After reading the article, we would like to address several critical concerns and comments, which were ascertained to be essential for such a type of review article. Unfortunately, numerous methodological flaws were observed, which could have a marked impact on the quality and the value of the review and its outcomes, as well as the potential applicability in complementary medicine.
Although Hamdan et al. recovered the analyzed articles from two major online databases (Scopus and Medline), their search was restricted to the English language, cross-sectional study designs, and only two databases. These constraints limit the search procedure and increase the probability of missing numerous relevant studies. Thus, the comprehensiveness of the outcomes of this review could have been enhanced through assembling the data from articles reported in various languages [2], as well as employing other study designs. Additionally, various other online databases could be utilized to collect more relevant data [3]. In this systematic review, the authors non-systematically selected articles with broad and heterogeneous methodological designs, including randomized control trials and observational investigations with no obvious selection criteria regarding the methodological designs of the studies involved. Furthermore, the authors failed to evaluate the quality of the evidence, the risk of bias and the heterogeneity of the incorporated studies.
Most importantly, this review is not reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement guidelines, where no proof was presented [4]. In addition, there was no confirmation to indicate that the used protocol (the search strategy, determination of eligibility, extraction, and analysis for the systematic review) was registered in any database of systematic review protocols [5]. Such procedures could reduce bias and improve the quality of the review by certifying the recorded outcomes and the level of evidence, as well as support future updates. To sum up, the quality of the evidence along with the accuracy of reported conclusions were significantly affected by the observed methodological flaws. Eventually, and based on the above-mentioned concerns, we highly recommend that the authors consider and follow the guidelines such as those recommended by Siddaway et al. [6] in their future work to produce a high-quality systematic review.
References
- 1.Hamdan A., Haji Idrus R., Mokhtar M.H. Effects of Nigella Sativa on Type-2 Diabetes Mellitus: A Systematic Review. Int. J. Environ Res. Public Health. 2019;16:4911. doi: 10.3390/ijerph16244911. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Morrison A., Polisena J., Husereau D., Moulton K., Clark M., Fiander M., Mierzwinski-Urban M., Clifford T., Hutton B., Rabb D. The effect of English-language restriction on systematic review-based meta-analyses: A systematic review of empirical studies. Int. J. Technol. Assess. Health Care. 2012;28:138–144. doi: 10.1017/S0266462312000086. [DOI] [PubMed] [Google Scholar]
- 3.Bramer W.M., Rethlefsen M.L., Kleijnen J., Franco O.H. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev. 2017;6:245. doi: 10.1186/s13643-017-0644-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Moher D., Liberati A., Tetzlaff J., Altman D.G., PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009;6:e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.PLoS Medicine Editors Best practice in systematic reviews: The importance of protocols and registration. PLoS Med. 2011:e1001009. doi: 10.1371/journal.pmed.1001009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Siddaway A.P., Wood A.M., Hedges L.V. How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annu Rev. Psychol. 2019;70:747–770. doi: 10.1146/annurev-psych-010418-102803. [DOI] [PubMed] [Google Scholar]
