Abstract
A recent systematic review with meta-analysis performed by Tiwari et al. (Middle East Fertil Soc J 26:44, 2021) suggested that coronavirus disease 2019 (COVID-19) affects both semen parameters and sexual hormones. However, we have observed a few inconsistencies in their systematic review methods and their synthesis of results (meta-analysis), which would have impacted their results.
Systematic review methods
Tiwari et al. [1] included Scopus and MEDLINE and had restricted research papers to English language. According to Cochrane Collaboration, they should have searched Embase and Cochrane Library, additionally search for gray literature and registered ongoing studies. Any missing eligible studies could have impacted the summary of the evidence.
Synthesis of results (meta-analysis)
First, Tiwari et al. [1] included seven studies: five cross-sectional [2–6], one case control [7], and one cohort [8]. The synthesis (forest plots) are very questionable since they put in the same analysis different study designs, which may generate misleading results. Estimated intervention effects for non-randomized studies of interventions (NRSI), with different study design features, can be expected to be influenced to varying degrees by different sources of bias. Results from NRSI with different combinations of study design features should be expected to differ systematically, resulting in increased heterogeneity. As heterogeneity among NRSI is expected to be substantial due to their diversity of study designs, detected in the meta-analysis, we recommend that NRSI with different design features should be analyzed separately. Meta-analysis methods based on estimates and standard errors, and in particular the generic inverse-variance method, will be suitable for NRSI [9, 10]. They should have done a subgroup analysis for different study designs and remove the total values (diamond).
Second, most outcomes semen (semen volume, sperm concentration, total sperm number, progressive mobility, sperm motility, vitality) and sex hormones (follicle-stimulating hormone, luteinizing hormone, testosterone, prolactin and estradiol) analysis presented substantial heterogeneity in the forest plots; in one hand, metanalysis would not be recommended, because they are synthesizing different study designs and people in the same analysis. If they decided to do it, they should have done a proper sensitivity analysis and explore the sources of heterogeneity, which could be statistical, methodological, and clinical diversity among studies [11].
Third, despite their results being statistically significant, they are not clinically relevant, since the differences are very small and do not affect any sort of decision-making.
Fourth, the funnel plot presented to investigate publication bias is not recommended due to the limited number of studies included; when there are fewer studies, the power of the tests is too low to distinguish chance from real asymmetry. Thus, any assumption based on that is not valid.
In conclusion, there are major concerns about future studies being designed based in this review and not critically looking at it. The point of having a systematic review is to map the area, provide synthesis of effects, and show the best available evidence to decision-making and to plan future studies.
Acknowledgements
Not applicable
Abbreviations
- COVID-19
Coronavirus disease 2019
- NRSI
Non-randomized studies of interventions
Authors’ contributions
AJG, LRM, and MIR wrote the manuscript. TC, MIR, and DES were responsible for the critical analysis. MLRU was responsible for reviewing and submitting the manuscript. The authors read and approved the final manuscript.
Funding
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.
Declarations
Ethics approval and consent to participate
Not applicable
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Tiwari S, Kc N, Thapa S, Ghimire A, Bijukchhe S, Sah GS, Isnuwardana R. Semen parameters in men recovered from COVID-19: a systematic review and meta-analysis. Middle East Fertil Soc J. 2021;26(1):44. doi: 10.1186/s43043-021-00089-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Erbay G, Sanli A, Turel H, et al. Shortterm effects of COVID-19 on semen parameters: a multicenter study of 69 cases. Andrology. 2021 doi: 10.1111/andr.13019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Ma L, Xie W, Li D, et al. Evaluation of sex-related hormones and semen characteristics in reproductive-aged male COVID-19 patients. J Med Virol. 2021;93(1):456–462. doi: 10.1002/jmv.26259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ruan Y, Hu B, Liu Z, et al. No detection of SARS-CoV-2 from urine, expressed prostatic secretions, and semen in 74 recovered COVID-19 male patients: a perspective and urogenital evaluation. Andrology. 2021;9(1):99–106. doi: 10.1111/andr.1293. [DOI] [PubMed] [Google Scholar]
- 5.Temiz MZ, Dincer MM, Hacibey I et al (2021) Investigation of SARS-CoV-2 in semen samples and the effects of COVID-19 on male sexual health by using semen analysis and serum male hormone profile: a cross-sectional, pilot study. Andrologia 53(2):e13912. 10.1111/and.13912 [DOI] [PMC free article] [PubMed]
- 6.Xu H, Wang Z, Feng C, et al. Effects of SARS-CoV-2 infection on male sex-related hormones in recovering patients. Andrology. 2021;9(1):107–114. doi: 10.1111/andr.12942. [DOI] [PubMed] [Google Scholar]
- 7.Guo TH, Sang MY, Bai S, et al. Semen parameters in men recovered from COVID-19. Asian J Androl. 2021 doi: 10.4103/aja.aja_31_21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Holtmann N, Edimiris P, Andree M, et al. Assessment of SARS-CoV-2 in human semen-a cohort study. Fertil Steril. 2020;114(2):233–238. doi: 10.1016/j.fertnstert.2020.05.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Higgins JPT, Li T, Deeks JJ (editors) (2019) Chapter 6: Choosing effect measures and computing estimates of effect. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019). Cochrane Available from www.training.cochrane.org/handbook
- 10.Li T, Higgins JPT, Deeks JJ (editors) (2019) Chapter 5: Collecting data. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated July 2019). Cochrane Available from www.training.cochrane.org/handbook
- 11.Deeks JJ, Higgins JPT, Altman DG (editors) (2022) Chapter 10: Analysing data and undertaking meta-analyses. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.3 (updated February 2022). Cochrane Available from www.training.cochrane.org/handbook
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.