Skip to main content
BMJ Open logoLink to BMJ Open
. 2018 Dec 6;8(12):e022743. doi: 10.1136/bmjopen-2018-022743

Metabolomics for predicting fetal growth restriction: protocol for a systematic review and meta-analysis

Debora Farias Batista Leite 1,2, Aude-Claire Morillon 3, Elias F Melo Júnior 1, Renato T Souza 2, Ali S Khashan 3,4, Philip N Baker 5, Louise C Kenny 3,6, José Guilherme Cecatti 2
PMCID: PMC6286473  PMID: 30530473

Abstract

Introduction

Fetal growth restriction (FGR) is a relevant research and clinical concern since it is related to higher risks of adverse outcomes at any period of life. Current predictive tools in pregnancy (clinical factors, ultrasound scan, placenta-related biomarkers) fail to identify the true growth-restricted fetus. However, technologies based on metabolomics have generated interesting findings and seem promising. In this systematic review, we will address diagnostic accuracy of metabolomics analyses in predicting FGR.

Methods and analysis

Our primary outcome is small for gestational age infant, as a surrogate for FGR, defined as birth weight below the 10th centile by customised or population-based curves for gestational age. A detailed systematic literature search will be carried in electronic databases and conference abstracts, using the keywords ‘fetal growth retardation’, ‘metabolomics’, ‘pregnancy’ and ‘screening’ (and their variations). We will include original peer-reviewed articles published from 1998 to 2018, involving pregnancies of fetuses without congenital malformations; sample collection must have been performed before clinical recognition of growth impairment. If additional information is required, authors will be contacted. Reviews, case reports, cross-sectional studies, non-human research and commentaries papers will be excluded. Sample characteristics and the diagnostic accuracy data will be retrieved and analysed. If data allows, we will perform a meta-analysis.

Ethics and dissemination

As this is a systematic review, no ethical approval is necessary. This protocol will be publicised in our institutional websites and results will be submitted for publication in a peer-reviewed journal.

PROSPERO registration number

CRD42018089985.

Keywords: fetal growth restriction, intrauterine growth restriction, small for gestational age infant, metabolomics, prediction


Strengths and limitations of this study.

  • This systematic review covers a great range of electronic databases and will also search for grey literature.

  • Two researchers will perform literature search, data extraction and study quality assessment independently, and any disagreement will be resolved by a third reviewer.

  • Careful statistics procedures will be performed to identify accuracy of metabolomics in predicting fetal growth restriction.

Introduction

Fetal growth restriction (FGR) is usually defined as a fetus that has not reached its intrauterine growth potential,1 2 with no major congenital abnormalities1 and has also been named as fetal growth retardation, intrauterine growth restriction or retardation.3 This heterogeneous condition is associated with increased risks of stillbirth,4 5 neonatal intensive care unit admission,6 neonatal mortality,5 cognitive and behavioural impairment in infancy7 and chronic non-transmissible disease in adulthood.8 FGR is mainly diagnosed according to the estimated fetal weight in ultrasound scans below the 10th centile,2 9 although it is anticipated that misdiagnosis can occur: fetuses below the 10th centile, but with normal outcomes (‘constitutionally’ small), or fetuses above the 10th centile, but who did not follow personal growth potential.2 In this context, antenatal recognition of truly restricted fetuses, that is, those at higher risk of morbidity and mortality in any period of life, followed by adequate obstetrical care, can improve neonatal outcomes.10

Unfortunately, in current practice, there is no gold standard for FGR diagnosis. Recent consensus has added ultrasound criteria (eg, abdominal circumference, umbilical and uterine artery Doppler measurements) and lowered estimated fetal weight cut-offs (<3rd centile),1 to improve specificity. In these terms, the concept of FGR can overlap with that of small for gestational age (SGA), which includes infants with birth weight below the 10th (or fifth, or third) centile for gender and gestational age.11 In fact, it is common to use SGA as a surrogate for FGR,6 12 13 as an indication of real intrauterine growth impairment. Besides that, neonatal parameters seem more adequate as ‘patient important outcomes’, but regrettably, ultrasound have still low accuracy to determine them.6

Since 1990s, when the thrifty phenotype theory was introduced,14 a huge effort has been undertaken to investigate the pathologically growth restricted fetuses and newborns and to enhance antenatal screening.6 Clinical data has been intensively studied, with conflicting risk factors15 16 and, in general, poor accuracy is achieved for identifying impaired birth weight17 or neonatal morbidity,6 even when first,18 second13 17 or third trimester19 ultrasound parameters are added to prediction model. Using only clinical or ultrasound variables, the great majority of SGA babies will only be recognised after birth, by population-based5 or customised curves.17 Biomarkers, such as placental growth factor (PlGF), soluble fms-like tyrosine kynase 1 (s-Flt-1) and alpha-fetoprotein,20 have each been found to show promise as aids to understanding FGR. However, the performance of these angiogenic factors as predictors of FGR has been limited (positive likelihood ratio, LR+, of 1.3 for PlGF and 1.4 for s-Flt-1).21 Similarly, placental proteins are not robust enough biomarkers for FGR (eg, LR+ of 3.7 for placental protein-13 in first trimester).22 Therefore, there is a real need for better methods of FGR prediction.

The disappointing evidence may be due to the multifactorial nature of FGR; the aetiology of the condition is complex and poorly defined. Moreover, placental structure and functioning, maternal and fetal metabolism vary during pregnancy.23 In this context, contemporary metabolomics approaches have identified several pathways and metabolic processes that may contribute to FGR, such as disruptions in DNA methylation,24 cellular signalling,25 26 neurotransmitter precursors26 27 and energy generation.25 26

Despite excellent performance of some metabolites in predicting FGR (area under the curve, above 0.9),25 26 these studies have shown an overall modest accuracy.21 However, only two ‘omics’ studies were included in Conde-Agudelo et al 21 review, and issues related to gestational age of sampling and delivery, or analysis of composite outcomes, could have introduced bias and confounders to metabolomics findings. In recent years, many authors have applied diverse metabolomics techniques to predict FGR, suggesting that metabolite biomarkers may have a role to play in disease screening. Thus, the main objective of this systematic review is to define the accuracy of metabolomics techniques for predicting FGR. As secondary aims, we will try to determine which metabolites are robust candidates for a prediction model of FGR and which chemical class they belong to.

Methods and analysis

Review question

What is the accuracy of metabolomics for predicting FGR?

Condition or domain studied

SGA infant and FGR.

Participants/population

Inclusion criteria: Original studies including pregnant women.

Exclusion: Congenital malformation.

Interventions/exposure

Screening for SGA/FGR with metabolomics approach. Biomarker analysis should have been performed on samples taken before clinical recognition of neonatal outcome.

Inclusion and exclusion criteria

Original studies (cohort or case control studies) involving pregnant women, as the studied population and SGA infant (and variations of terminology), as the outcome of interest, will be included in this systematic review.

The reasons for excluding studies are: (1) if they are Cross-sectional studies, Case Reports, Editorials, Letter to Editors, Commentaries, Expert Opinions, or any type of Reviews; (2) if they describe only experimental studies with animals; (3) if they show duplicate publication of the same data; in these cases, we will use the most recent publication.

Outcomes

Primary outcome

SGA infant, defined as a birth weight below the 10th centile according to population-based or to customised charts.

Secondary outcomes

Birth weight below the fifth or the third centile by population-based or customised parameters.

Literature search

The primary source of information will be these electronic databases: PubMed, EMBASE, Latin American and Caribbean Health Sciences Literature, Scientific Electronic Library Online, Health Technology Assessment, Database of Abstracts of Reviews of Effects, Aggressive Research Intelligence Facility, Cumulative Index of Nursing and Allied Health Literature, Maternity and Infant Care, Scopus and Web of Science. Secondary sources include Google Scholar, hand-held searching of the reference list of eligible studies, conference proceedings and contact with authors when necessary.

The keywords linked to the outcomes of interest will be combined with terms related to ‘metabolomics’ technique, ‘pregnancy’ and ‘screening’, using Boolean connectors. The same search strategy will be applied for each database, adapting for individual filters, main language, their own syntax and mechanisms of search; the complete search strategy is provided as online supplementary material.

Supplementary data

bmjopen-2018-022743supp001.pdf (18.1KB, pdf)

Considering that the term metabolome was first used in 1998,28 we will take into account studies published in the last 20 years (1998–2018). The preliminary searches for this systematic review have started in February 2018. The search strategy will be re-run before final analysis, to check for recently published eligible studies. There are no language restrictions.

Data extraction and management

All searches will be exported to a reference manager (EndNote). Individually, two researchers (DFBL and ACM) will select papers according to (1) title or abstract and (2) full text, that will be read only when abstracts are not sufficient to decide about inclusion criteria. Any disagreement about selected studies will be dealt by a third researcher (EFMJ or RTS); in these cases, only after majority decision (2:1 ratio) the next step will be performed. A fifth investigator (JGC) will revise all procedures before approving the data extraction. DFBL, ACM and ASK will deal with the statistic procedures. JGC, PNB and LCK will re-examine all steps and supervise data interpretation.

A standardised form will be applied to extract the variables of interest—by two independent researchers—which will include: authors and year of publication, country of participants’ enrolment, study design, definition used for FGR/SGA (customised or population-based charts) and outcome measured, number of affected (who later delivered a FGR/SGA baby) and non-affected pregnant women, gestational age of assessment (throughout pregnancy), laboratory methods and biological sample analysed (eg, blood, amniotic fluid). In addition, data regarding growth impairment suspicion in pregnancy—such as gestational age, criteria applied for diagnosis and follow-up—will be retrieved once available. Researchers will contact authors (by electronic address) if any clarification of data is needed. The metabolites described will be matched with the Human Metabolome database to check their characteristics.29

Strategy for data synthesis

Details about data search and selection will be presented as a flow diagram, according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement recommendations.30 An aggregate participant data synthesis will be performed with all included studies; narrative data will be analysed and structured according to birth weight centile (10th, 5th and 3rd) and curve type (population-based or customised curves). Additionally, the metabolites will be grouped and synthesised according to their biological function and chemical subclass. Studies’ characteristics and risk of bias assessment will be demonstrated in tables. Once possible, we will perform subgroup analysis according to:

  • Which metabolomic methods were applied (gas or liquid chromatography coupled with mass spectrometry; or proton nuclear magnetic resonance).

  • Maternal health status before pregnancy (healthy ones vs women with any chronic health condition).

  • Gestational age of first fetal growth impairment suspicion (early vs late FGR).1

  • Type of pregnancy (single vs multiple).

Depending on data availability, accuracy measures will be calculated and a meta-analysis will be drawn. Considering the quantitative nature of the metabolomics approach and the expected different thresholds for metabolites in each study, we will try to perform the hierarchical summary receiver characteristic operating curve.31 Heterogeneity will also be assessed, through I2 test.

Risk of bias assessment

Both investigators initially involved with literature search (DFBL and ACM) will assess methodological quality and applicability of all included studies, and they must check their judgements. A third researcher (EFMJ or RTS) will resolve any disagreement if necessary and the final decisions will be made by majority. We will use the ‘Quality Assessment of Diagnostic Accuracy Studies’32 tool, which comprised four domains: patient selection, characteristics of index test (metabolomics technique), the reference standard test (measurement of birth weight) and flow and timing of patient inclusion and follow-up. Every study will be labelled as ‘low’, ‘high’ or ‘unclear’ risk of bias for each domain. For example, there is ‘low risk of bias’ if the study clearly states how the metabolomics techniques were performed, or which birth weight curve was applied to identify the SGA babies.

Regarding publication bias, we will assess the symmetry of funnel plots if more than ten studies are included in the meta-analysis.33

Potential limitations to this review

Concerning the publication bias, we expect to encounter more published positive results and data interpretation must take this issue in consideration. The metabolomics approach is highly detailed and meticulous, has shown great technological advancements in recent years, and results from mass spectrometry and from nuclear magnetic resonance complement each other. Therefore, we acknowledge that we may find distinct metabolites in each study and generalisation may be challenging.

In this systematic review, we have considered SGA as a proxy for FGR, as other authors.6 12 13 The consensus for FGR diagnosis was published recently1 and past investigations may have used distinct terminology or conflicting criteria for this condition in pregnancy. Additional confounders to interpret the selected studies will include clinical factors potentially associated to FGR/SGA, like parity, smoking habits and history of previous fetal growth impairment. These characteristics will be appraised during data extraction and synthesis, and detailed evidence will be retrieved.

Ethics and dissemination

This protocol follows the PRISMA Protocols statements.34 A report of this systematic review will be sent to our sponsors. This protocol will be electronically available on UNICAMP-CNPq-Gates Foundation project website (www.medscinet.com/samba) and Infant Centre website (infantcentre.ie). Our results will be submitted to publication in peer-reviewed journal.

Patient and public involvement

Patients and or public were not involved at all in elaborating this systematic review protocol.

Conclusion

This systematic review will synthesise data about metabolomics and FGR/SGA, a promising field for understanding disease pathophysiology and natural history. By highlighting the metabolites and chemical classes that they belong to, this review might present solid data to future research protocols, that can target the most promising compounds, or assess the participants in a more reliable gestational age, for example. A robust FGR/SGA prediction assumes great importance in reproductive health and epidemiology, since this condition is associated with short and long-term adverse outcomes for the offspring.

Supplementary Material

Reviewer comments
Author's manuscript

Acknowledgments

We would like to thank Shauna Barret, librarian of Brookfield Library, University College Cork, Ireland, for her support with the literature search strategy. We are also grateful to Maeve O’Connell, for her suggestions to the final manuscript.

Footnotes

Contributors: DFBL (the guarantor of the review) and A-CM developed the systematic review protocol and will perform the literature search, study selection, data extraction and risk of bias assessment. ASK, PNB, RTS, EFMJ and JGC supervised protocol elaboration and the latter three will resolve any discrepancy about methodology. ASK, DFBL and A-CM will deal with statistics procedures. PNB and LCK performed the last amendments of protocol and will revise the final systematic review draft. All authors have read this manuscript and have agreed with this submission.

Funding: This research was supported by Brazilian National Research Council (grant number 401636/2013-5) and Bill and Melinda Gates Foundation (grant number OPP1107597-Grand Challenges Brazil: Reducing the burden of preterm birth, Fiotec number 05/2013), which provided funding to PRETERM-SAMBA project (www.medscinet.com/samba). DFBL was granted a scholarship (process number 88881.134512/2016-01) from the Brazilian Federal Agency for Support and Evaluation of Graduate Education (CAPES) and developed part of her doctoral studies as a visiting student at University College Cork, Ireland. RTS has also awarded a scholarship from CAPES (process number 88881.134095/2016-01). A-CM was granted a scholarship from Science Foundation Ireland, for her doctoral thesis. Our sponsors have not intervened in authors’ decision to write the systematic review protocol or to submit this paper.

Competing interests: DFBL and A-CM are studying this technology in predicting FGR. JGC, LCK and PNB have presented conference talks about this field. LCK and PNB are principal investigators of Metabolomic Diagnostics.

Patient consent: Not required.

Ethics approval: As this is a systematic review protocol, no ethics committee approval is necessary.

Provenance and peer review: Not commissioned; externally peer reviewed.

References

  • 1. Gordijn SJ, Beune IM, Thilaganathan B, et al. Consensus definition of fetal growth restriction: a Delphi procedure. Ultrasound Obstet Gynecol 2016;48:333–9. 10.1002/uog.15884 [DOI] [PubMed] [Google Scholar]
  • 2. American College of Obstetricians and Gynecologists. ACOG Practice bulletin no. 134: fetal growth restriction. Obstet Gynecol 2013;121:1122–33. 10.1097/01.AOG.0000429658.85846.f9 [DOI] [PubMed] [Google Scholar]
  • 3. Medical subject headings. https://www.ncbi.nlm.nih.gov/mesh/68005317 (accessed 23 Jan 2018).
  • 4. Gardosi J, Madurasinghe V, Williams M, et al. Maternal and fetal risk factors for stillbirth: population based study. BMJ 2013;346:f108 10.1136/bmj.f108 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Mendez-Figueroa H, Truong VTT, Pedroza C, et al. Small-for-gestational-age infants among uncomplicated pregnancies at term: a secondary analysis of 9 Maternal-Fetal Medicine Units Network studies. Am J Obstet Gynecol 2016;215:628.e1–7. 10.1016/j.ajog.2016.06.043 [DOI] [PubMed] [Google Scholar]
  • 6. Sovio U, White IR, Dacey A, et al. Screening for fetal growth restriction with universal third trimester ultrasonography in nulliparous women in the Pregnancy Outcome Prediction (POP) study: a prospective cohort study. Lancet 2015;386:2089–97. 10.1016/S0140-6736(15)00131-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Korzeniewski SJ, Allred EN, Joseph RM, et al. Neurodevelopment at age 10 years of children born <28 weeks with fetal growth restriction. Pediatrics 2017;140 10.1542/peds.2017-0697 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Cheong JN, Wlodek ME, Moritz KM, et al. Programming of maternal and offspring disease: impact of growth restriction, fetal sex and transmission across generations. J Physiol 2016;594:4727–40. 10.1113/JP271745 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Lausman A, Kingdom J, Gagnon R, et al. Intrauterine growth restriction: screening, diagnosis, and management. J Obstet Gynaecol Canada 2013;35:741–8. 10.1016/S1701-2163(15)30865-3 [DOI] [PubMed] [Google Scholar]
  • 10. Verlijsdonk JW, Winkens B, Boers K, et al. Suspected versus non-suspected small-for-gestational age fetuses at term: perinatal outcomes. J Matern Fetal Neonatal Med 2012;25:938–43. 10.3109/14767058.2011.600793 [DOI] [PubMed] [Google Scholar]
  • 11. Villar J, Cheikh Ismail L, Victora CG, et al. International standards for newborn weight, length, and head circumference by gestational age and sex: the Newborn Cross-Sectional Study of the INTERGROWTH-21st Project. Lancet 2014;384:857–68. 10.1016/S0140-6736(14)60932-6 [DOI] [PubMed] [Google Scholar]
  • 12. Malacova E, Regan A, Nassar N, et al. Risk of stillbirth, preterm delivery, and fetal growth restriction following exposure in a previous birth: systematic review and meta-analysis. BJOG: An Int J Obstet Gynaecol 2018;125:183–92. 10.1111/1471-0528.14906 [DOI] [PubMed] [Google Scholar]
  • 13. Parry S, Sciscione A, Haas DM, et al. Role of early second-trimester uterine artery Doppler screening to predict small-for-gestational-age babies in nulliparous women. Am J Obstet Gynecol 2017;217:594.e1–594.e10. 10.1016/j.ajog.2017.06.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Hales CN, Barker DJ. The thrifty phenotype hypothesis. Br Med Bull 2001;60:5–20. 10.1093/bmb/60.1.5 [DOI] [PubMed] [Google Scholar]
  • 15. Vesterinen HM, Morello-Frosch R, Sen S, et al. Cumulative effects of prenatal-exposure to exogenous chemicals and psychosocial stress on fetal growth: Systematic-review of the human and animal evidence. PLoS One 2017;12 10.1371/journal.pone.0176331 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Abraham M, Alramadhan S, Iniguez C, et al. A systematic review of maternal smoking during pregnancy and fetal measurements with meta-analysis. PLoS One 2017;12:1–13. 10.1371/journal.pone.0170946 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. McCowan LM, Thompson JM, Taylor RS, et al. Clinical prediction in early pregnancy of infants small for gestational age by customised birthweight centiles: findings from a healthy nulliparous cohort. PLoS One 2013;8:e70917 10.1371/journal.pone.0070917 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Velauthar L, Plana MN, Kalidindi M, et al. First-trimester uterine artery Doppler and adverse pregnancy outcome: a meta-analysis involving 55,974 women. Ultrasound Obstet Gynecol 2014;43:500–7. 10.1002/uog.13275 [DOI] [PubMed] [Google Scholar]
  • 19. Tarca AL, Hernandez-Andrade E, Ahn H, et al. Single and Serial Fetal Biometry to Detect Preterm and Term Small- and Large-for-Gestational-Age Neonates: A Longitudinal Cohort Study. PLoS One 2016;11:e0164161–16. 10.1371/journal.pone.0164161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Poon LC, Lesmes C, Gallo DM, et al. Prediction of small-for-gestational-age neonates: screening by biophysical and biochemical markers at 19-24 weeks. Ultrasound Obstet Gynecol 2015;46:437–45. 10.1002/uog.14904 [DOI] [PubMed] [Google Scholar]
  • 21. Conde-Agudelo A, Papageorghiou AT, Kennedy SH, et al. Novel biomarkers for predicting intrauterine growth restriction: a systematic review and meta-analysis. BJOG 2013;120:681–94. 10.1111/1471-0528.12172 [DOI] [PubMed] [Google Scholar]
  • 22. Zhong Y, Zhu F, Ding Y. Serum screening in first trimester to predict pre-eclampsia, small for gestational age and preterm delivery: systematic review and meta-analysis. BMC Pregnancy Childbirth 2015;15:1–10. 10.1186/s12884-015-0608-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Zhang S, Regnault TR, Barker PL, et al. Placental adaptations in growth restriction. Nutrients 2015;7:360–89. 10.3390/nu7010360 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Horgan RP, Broadhurst DI, Dunn WB, et al. Changes in the metabolic footprint of placental explant-conditioned medium cultured in different oxygen tensions from placentas of small for gestational age and normal pregnancies. Placenta 2010;31:893–901. 10.1016/j.placenta.2010.07.002 [DOI] [PubMed] [Google Scholar]
  • 25. Horgan RP, Broadhurst DI, Walsh SK, et al. Metabolic profiling uncovers a phenotypic signature of small for gestational age in early pregnancy. J Proteome Res 2011;10:3660–73. 10.1021/pr2002897 [DOI] [PubMed] [Google Scholar]
  • 26. Sulek K, Han TL, Villas-Boas SG, et al. Hair metabolomics: identification of fetal compromise provides proof of concept for biomarker discovery. Theranostics 2014;4:953–9. 10.7150/thno.9265 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Maitre L, Fthenou E, Athersuch T, et al. Urinary metabolic profiles in early pregnancy are associated with preterm birth and fetal growth restriction in the Rhea mother-child cohort study. BMC Med 2014;12:1–14. 10.1186/1741-7015-12-110 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Oliver SG, Winson MK, Kell DB, et al. Systematic functional analysis of the yeast genome. Trends Biotechnol 1998;16:373–8. 10.1016/S0167-7799(98)01214-1 [DOI] [PubMed] [Google Scholar]
  • 29. Wishart DS, Jewison T, Guo AC, et al. HMDB 3.0—The Human Metabolome Database in 2013. Nucleic Acids Res 2013;41:D801–7. 10.1093/nar/gks1065 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med 2001;20:2865–84. [DOI] [PubMed] [Google Scholar]
  • 32. Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011;155:529–36. 10.7326/0003-4819-155-8-201110180-00009 [DOI] [PubMed] [Google Scholar]
  • 33. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 2005;58:882–93. 10.1016/j.jclinepi.2005.01.016 [DOI] [PubMed] [Google Scholar]
  • 34. Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;349:g7647–25. 10.1136/bmj.g7647 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2018-022743supp001.pdf (18.1KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES