Abstract
Background:
Neural tube defects (NTDs) affect pregnancies worldwide annually. Few nongenetic factors, other than folate deficiency, have been identified that may provide intervenable solutions to reduce the burden of NTDs. Prenatal exposure to toxic metals [arsenic (As), cadmium (Cd), mercury (Hg), manganese (Mn) and lead (Pb)] may increase the risk of NTDs. Although a growing epidemiologic literature has examined associations, to our knowledge no systematic review has been conducted to date.
Objective:
Through adaptation of the Navigation Guide systematic review methodology, we aimed to answer the question “does exposure to As, Cd, Hg, Mn, or Pb during gestation increase the risk of NTDs?” and to assess challenges to evaluating this question given the current evidence.
Methods:
We selected available evidence on prenatal As, Cd, Hg, Mn, or Pb exposure and risk of specific NTDs (e.g., spina bifida, anencephaly) or all NTDs via a comprehensive search across MEDLINE, Embase, Web of Science, and TOXLINE databases and applied inclusion/exclusion criteria. We rated the quality and strength of the evidence for each metal. We applied a customized risk of bias protocol and evaluated the sufficiency of evidence of an effect of each metal on NTDs.
Results:
We identified 30 studies that met our criteria. Risk of bias for confounding and selection was high in most studies, but low for missing data. We determined that, although the evidence was limited, the literature supported an association between prenatal exposure to Hg or Mn and increased risk of NTDs. For the remaining metals, the evidence was inadequate to establish or rule out an effect.
Conclusion:
The role of gestational As, Cd, or Pb exposure in the etiology of NTDs remains unclear and warrants further investigation in high-quality studies, with a particular focus on controlling confounding, mitigating selection bias, and improving exposure assessment. https://doi.org/10.1289/EHP11872
Introduction
Neural tube defects (NTDs), including myelomeningocele (commonly referred to as spina bifida), anencephaly, and encephalocele, occur in early pregnancy owing to improper closure of the embryonic neural tube.1 Anencephaly is nearly uniformly fatal and spina bifida and encephalocele are often accompanied by serious disability in affected infants.2,3 In the United States, the prevalence of NTDs decreased in the years following the introduction of folic acid fortification of cereal grain products in 1996–1998.2 However, the prevalence of NTDs in the United States has remained stable in the years post-fortification, with an estimated 2,469 NTDs occurring annually, often termed folate-resistant NTDs.1,2,4 Globally, where folic acid supplementation is not universal, it is estimated that babies are born with NTDs annually.5
NTD etiology is multifactorial, with genetic and environmental contributions.1 Known mechanisms of genetic vulnerability to NTDs relate to one-carbon metabolism or planal cell polarity genes, with certain polymorphisms known to increase susceptibility of pregnancies to the effects of nongenetic risk factors, such as maternal diabetes and folate status.3 Aside from folate deficiency and diabetes, few nongenetic factors have been consistently linked to NTDs, although in general, they have not been widely studied.3 Because these birth defects remain a substantial cause of morbidity and mortality, even in regions with folic acid supplementation, there is an urgent need to identify modifiable factors that may reduce the burden of NTDs. Environmental contaminants, such as toxic metals, may feasibly be involved in known vulnerability pathways and represent a promising area of research for preventable causes of NTDs.3
Arsenic (As), cadmium (Cd), mercury (Hg), manganese (Mn), and lead (Pb) are toxic metals/metalloids (herein all referred to as “metals”) of global concern that have been most commonly implicated in the etiology of NTDs. Toxic metals are ubiquitous contaminants in the United States. In a nationally representative survey between 2003 and 2014, As, Cd, Mn, and Pb were detected in women of reproductive age in 97.8%, 87.9%, 86.9%, and 99.0% of biological samples, respectively.6 Exposures occur predominantly through ingestion of contaminated foods and drinking water, as well as through inhalation of polluted air.7 As, Cd, Hg, and Pb are known developmental toxicants and can cross from mother to fetus through transplacental transfer.8–10 One of the proposed biological mechanisms through which environmental factors, including As, Cd, Hg, Mn, Pb, and other metals, influence NTD etiology is increased levels of oxidative stress, providing biological plausibility to the hypothesis that prenatal metal exposure increases the risk of NTDs.11–14
Although the literature describing epidemiologic studies of toxic metals and NTDs has grown in recent years, to our knowledge no systematic reviews have been performed to summarize strengths and weaknesses of the evidence, nor have any meta-analyses been conducted to assess whether results may be suitable to deriving summary effect estimates or whether heterogeneity or evidence quality prevents useful summarization. Thus, the primary purpose of this review was to summarize and evaluate the quality of the epidemiologic evidence investigating associations of As, Cd, Hg, Mn, and Pb exposures during gestation and the prevalence of NTDs, with reference to the Navigation Guide methodology.15,16 As a secondary goal, if a particular association was found to have evidence that supports a meta-analytic summary estimate (sufficient number of studies with consistent study characteristics and high-quality methods across the literature such that random error rather than systematic bias is the primary concern), then our goal was to also provide such an estimate. We additionally aimed to provide a discussion of key methodological considerations and knowledge gaps to inform future research.
Methods
Prior to starting the process of the systematic review, we developed a thorough initial protocol detailing all the steps that we anticipated would be undertaken (available in the Supplemental Material, “REVIEW PROTOCOL”). We followed, with adaptations to best meet our question’s needs, the Navigation Guide’s systematic review methodology’s first three steps, namely 1) specifying the study question; 2) selecting the evidence; 3) rating the quality and strength of the evidence.15,16
Study Question
Our objective was to answer the question: “does exposure to As, Cd, Hg, Mn, or Pb during gestation increase the risk of NTDs?” We evaluated all articles for evidence in relation to this question even if the study question of the article itself was different. The PECO statement that we used was as follows:
Population: Humans who were studied during pregnancy or after birth/termination
Exposure: Prenatal exposure to metals of interest (As, Cd, Hg, Mn, Pb)
Comparator: Humans exposed to lower levels of metals than the more highly exposed humans
Outcome: All NTDs (i.e., the outcome assessed includes multiple NTDs considered together) or specific NTDs considered separately (e.g., spina bifida, anencephaly, hydrocephaly, encephalocele).
Note that the PECO statement was adapted following the second search (see the section “Search strategy” for search dates). The initial PECO statement that guided the search strategy listed the outcome as “All, subgroups or specific birth defects.” However, following extraction of data, we generated the updated PECO statement in which the outcome included only NTDs based on availability of studies to summarize (see the section “Data extraction and visualization”).
Selection of Evidence
Search strategy.
We searched for all literature types in MEDLINE (via PubMed), Embase, Web of Science, and TOXLINE from date of database inception through 11 November 2022, using terms for As, Cd, Hg, Mn, and Pb combined with terms for birth defects and studies with human subjects. We used either medical subject headings (MeSH) or Embase subject headings (Emtree) where available or keywords when applicable. The full search string can be found in Table S1. We conducted the first search on 10 July 2019, a second search on 20 March 2021, and a final search on 11 November 2022. Toxline was decommissioned by the National Library of Medicine on 29 January 2021, but all of the content is still available in MEDLINE. Toxline was therefore only searched in 2019. In addition, UNC-Chapel Hill stopped its subscription to Web of Science in December 2021; therefore, it was not included in the 2022 search.
Study selection criteria.
First, we screened articles by reviewing the title and abstract. Then, for articles not excluded based on title and abstract, we conducted a full-text review to assess for further eligibility. We used Covidence systematic review software for the screening process (Veritas Health Innovation; https://www.covidence.org). Authors L.A.E., G.C., E.H., F.C.M.S., J.P.B., and A.P.K. conducted the screening. In both the title and abstract screening and full-text review, all studies were reviewed independently by two authors. If there was a discrepancy, it was resolved by a third author or brought to the larger team to discuss and resolve the discrepancy through consensus. To be included, studies needed to meet all the following criteria:
The study was an epidemiologic study of human exposures. All animal or other non-epidemiologic studies were excluded. There were no criteria for the type of epidemiologic study design.
The study measured prenatal exposure to As, Cd, Hg, Mn, or Pb. For biomarker-based exposure assessment, we defined prenatal exposure as biomarkers measured after conception and before or at birth/termination from either the mother or offspring, including measurements immediately after birth/termination. For environmental or occupational exposure in which the exposure level could feasibly be considered constant over time (e.g., exposure via occupation or soil), no time restriction was enforced. Studies were excluded if they considered only paternal exposures or were conducted as part of assessments of diet or supplement interventions.
The study undertook a quantitative exposure assessment or for ecologic study designs, comparisons of exposed/unexposed (or less-exposed) groups were considered.
The study evaluated the outcome of all, subgroups, or specific birth defects, either at birth/termination or during pregnancy.
The article was published in English in a peer-reviewed journal after 1 January 1995, to limit the search to the past 25 y of literature.
Data extraction and visualization.
For each included study, we extracted data, including study sample characteristics, estimates of association, exposure assessment, and outcome assessment. When applicable, we extracted unadjusted and adjusted estimates of association, as well as sex-stratified estimates and dose–response assessments. However, other stratified estimates were not extracted. Authors L.A.E., G.C., E.H., J.P.B., and A.P.K. conducted data extraction using a custom Excel spreadsheet. The custom Excel spreadsheet, complete with extracted data for an example study, can be found in the Supplemental Material. For specific details regarding data extraction steps, please refer to the review protocol (available in the Supplemental Material, “REVIEW PROTOCOL”).
We performed three rounds of extractions with two authors per study and resolved discrepancies with a third author and discussed as an author group. During this process, the data extraction protocol was refined and once we were consistently reaching consensus as a group and extracting repeatable data in these early rounds, subsequent rounds of extraction were performed by single authors. Although the Cochrane Handbook for Systematic Reviews of Interventions describes the extraction of study characteristics by two authors as “desirable” and study outcomes by two authors as “mandatory,” we found that study outcomes were consistently abstracted in the first rounds of review and did not warrant duplicated efforts in further rounds.17
For comparison across all articles extracted, we grouped studies by birth defect category assessed, using the International Statistical Classification of Diseases and Related Health Problems 10th Revision (ICD10) classification system, which is generally organized by biological system affected.18 Following this step, we evaluated the extracted data for the number of studies investigating associations between each metal–birth defect category pairing (Table S2). From this assessment, we decided to prioritize a review of NTDs, given the preponderance of studies for this category, and we then modified our PECO statement accordingly. Hydrocephaly, although not usually considered to be an NTD, was included in this review because two papers on NTDs included it and we wanted to be as comprehensive as possible. A Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) diagram summarizing the search, screen, and extraction process is provided in Figure S1.
For studies with information that was required in our data extraction process and not included in the published manuscript, we contacted the study authors. Specifically, we sent two email requests to the corresponding authors of two papers with incomplete information19,20 in February and March of 2022; however, we received no response.
Quality and Strength of Evidence Evaluation
We assessed the quality and strength of the evidence in three sequential stages: 1) for each included study, we undertook a risk of bias assessment to evaluate study characteristics that may have introduced bias; 2) for each metal included, we evaluated the quality of the evidence across all studies; 3) for each metal included, we assessed the strength, or certainty, of the evidence across all studies. These steps were informed by the process detailed in the Navigation Guide; however, they were adapted to our study question in ways that are detailed below. Note that for steps 2 and 3, we focused on studies that provided estimates of association with any NTDs as the outcome, given how few studies evaluated specific NTDs. The majority of studies that did provide specific NTDs estimates, however, also provided estimates of association for any NTDs as the outcome.
Assessing the risk of bias for each study.
To differentiate between studies in terms of the scale of threats to validity for estimates of association, we performed a risk of bias assessment adapted from the Navigation Guide’s protocol.15,16 Our protocol included five domains of potential biases: a) exposure measurement, b) outcome ascertainment, c) selection bias: recruitment and loss-to-follow-up, d) confounding, and e) missing data. These domains were selected based on considering the Navigation Guide’s proposed domains in the context of this specific study question and the authors’ understanding of the most concerning threats to internal validity in this literature. We note that any studies of birth defects would be subject to bias owing to the inability to fully enumerate conceptuses or fetuses at an early stage of pregnancy and, for NTDs specifically, it cannot be determined when incomplete closure of neural tubes “starts” (i.e., an incident case), thus prevalent cases are used as proxies for incident cases throughout the literature. Therefore, we did not consider these potential sources of bias when evaluating the literature.
Compared with the Navigation Guide, we omitted the domains of Conflict of Interest, Blinding, and Selective Outcome Reporting. We deemed conflict of interest to be less of a threat to the validity of this literature compared with studies of man-made pharmaceutical or industrial chemicals, common in other applications of the Navigation Guide. Therefore, we noted any declared conflicts of interest and funding sources for all included studies but did not formally assess conflict of interest in the risk of bias. Blinding was captured within the broader exposure assessment domain, which required exposure assessment to be independent of the outcome. Last, selective outcome reporting was removed because we decided that without preregistration of the studies, not common in the observational studies setting, we would not be able to accurately judge whether outcomes were being selectively reported. Study design features (e.g., whether cases derived from a population-based registry or hospital-based study) were considered in evaluating risk of bias. For example, we specifically noted potential for Berkson’s bias when using hospital-based studies depending on how controls were selected.
For each article, we scored the five potential bias domains as either low risk of bias, probably low risk of bias, probably high risk of bias, high risk of bias, or unclear risk of bias. These scores are meant to reflect the perceived validity of a result as well as believability. That is, two studies may have equally valid results, but we defined a study as more believable (i.e., identifiable lower risk of bias) if it transparently reported factors across each of these domains according to our protocol. For example, a study that reports few missing data was considered more believable than a study that makes no mention of missing data. The full risk of bias assessment protocol is detailed in the review protocol (available in the Supplemental Material, “REVIEW PROTOCOL”). Specific instructions for classifying studies as “high risk of bias” or “low risk of bias” for each domain are provided in the protocol. We assigned “probably low risk of bias” when there was insufficient information to fully meet the criteria for “low risk of bias” but there was indirect evidence that suggested the criteria were met. We assigned “probably high risk of bias” when there was insufficient information to fully meet the criteria for “high risk of bias” but there was indirect evidence that suggested the criteria were met. Although the Navigation Guide does not include an “unclear risk of bias” ranking, we added this option to distinguish between not having enough information to make a judgment vs. adequate information to determine a high risk of bias. Bias was aggregated on a studywide scale, so some specific analyses may differ in risk of bias from the study overall. L.A.E. drafted the initial protocol prior to beginning the screening process, with input and revisions from G.C., E.H., J.P.B., and A.P.K. Authors L.A.E., G.C., E.H., J.P.B., and A.P.K. conducted the risk of bias assessment. To calibrate scores across different reviewers, we conducted three initial rounds in which two reviewers assigned risk of bias scores for one study, we discussed and compared scores as a group, and came to a consensus ranking for each domain for each study. Through this process, we refined the protocol and once independent reviewers were consistently reaching the same scores, for remaining studies, one reviewer was assigned per study.
Assessing the quality of evidence for each metal.
We adapted the Navigation Guide protocol for determining the strength and quality of the evidence to best meet the needs of our study question.15,16 Authors L.A.E., G.C., J.P.B., and A.P.K. individually completed assessments for each metal prior to a group discussion in which ratings and rationales were compared to reach a group consensus. At baseline, we assigned the evidence as “moderate” quality status (or 0), and then we considered three downgrade () and three upgrade () factors. The downgrade factors that we considered were a) risk of bias, b) imprecision, and c) publication bias. For assessing publication bias, we did not construct funnel plots given the heterogeneity of studies included. The upgrade factors that we considered were a) large magnitude of effect, b) dose response, and c) residual confounding. The Navigation Guide does not give explicit directions for how to convert the upgrade and downgrade factors into an overall rating.15,16 Thus, to be transparent, we derived an overall quality of evidence rating classification by summing the upgrade and downgrade factors. If the sum was , we considered the evidence to be of “low” quality. If the sum was , we considered the evidence to be of “high” quality. Summed values of 0 were assigned “moderate” quality status. The labels of “high,” “low,” and “moderate” should not be considered objective judgments but, rather, as parsimonious descriptions of how the numeric scores corresponded to subjective assessments of the literature on metals and NTDs relative to other literatures with which we are familiar. The complete detailed criteria for scoring each of the factors for the strength and quality assessment can be seen in the review protocol (available in the Supplemental Material, “REVIEW PROTOCOL”).
Note that in comparison with the Navigation Guide, we did not consider indirectness because there are several valid study questions that fit our PECO statement. For instance, environmental exposures may provide direct evidence about effects of external exposure, whereas biomarker exposures may provide direct evidence about effects of dose to target tissues. We did not prioritize either of these valid study questions and, consequently, did not find that “indirectness” was a salient issue for the body of literature under consideration. Furthermore, any study not addressing the broad scope of the PECO statement would already have been removed in the screening phase of the review. In addition, we did not consider inconsistency given that this was captured in our consideration of the direction of the effect and because exposure assessment and levels, along with other study methods, varied widely enough from study to study that we were not able to a priori hypothesize the expected effect of heterogeneity in study methods collectively on the direction and magnitude of effect estimates. Thus, apparent inconsistency in findings above and beyond effect direction was a stronger indication of heterogeneity of study methods, which we could not with confidence estimate the effect of, rather than quality of the literature (see the section “Assessing the strength of evidence for each metal”).
Assessing the strength of evidence for each metal.
Next, for each metal, we rated the strength of the evidence across all relevant studies. Our goal was to ultimately provide a concise statement summarizing the current state of the evidence regarding each metal’s association with risk of NTDs. Adapting the Navigation Guide, we evaluated the strength of evidence based on three factors: a) quality of the evidence (from the previous step), b) the direction of effect, and c) our confidence in the estimates of association.15,16 We determined that the direction of effect would be based on a meta-analytic summary estimate in the case of conducting a meta-analysis. We a priori decided that we would only conduct a meta-analysis when supported by a sufficient number of high-quality studies with consistent study methodologies such that random error would be the primary concern. Where no meta-analytic estimate was estimated, we judged the direction of effect based on visual assessment of all studies included in forest plots. We decided on our confidence in the estimates of association based on a judgment regarding the likelihood that additional studies would change the conclusion.
After consideration of these three factors, we determined the evidence of an association for each metal to be “sufficient,” “limited,” “inadequate,” or “evidence of lack of effect,” based on the definitions used in the Navigation Guide.15 In brief, sufficient evidence was defined as an observed positive relationship between the metal and risk of NTDs where “chance, bias, and confounding can be ruled out with reasonable confidence.” Limited evidence was defined as an observed positive relationship between the metal and risk of NTDs where “chance, bias, and confounding cannot be ruled out with reasonable confidence,” and confidence in the relationship is hindered by number, size, or quality of studies, as well as by inconsistencies in findings.15 Inadequate evidence was defined as the evidence being insufficient to assess the relationship between the metal and NTDs given low number, size, or quality of studies. Evidence of lack of effect was defined as an observed lack of association between the metal and NTDs where “chance, bias, and confounding can be ruled out with reasonable confidence.”
Results
Included Studies
We retrieved 1,184 articles. In the title and abstract screening process, we excluded 1,055 articles for not being relevant according to the PECO statement. We screened the remaining 129 articles for eligibility via the full-text screen. Of these, 66 articles met the inclusion criteria and 63 were excluded. Specific reasons for the exclusion of each article at the full-text stage are provided in Table S2. Next, we categorized each of the 66 articles into groups according to the body system affected by the birth defect evaluated (Table S3). Following this step, we identified NTDs as the defect category to focus on based on the greatest number of articles to evaluate. From the 66 articles eligible for inclusion, 30 evaluated NTDs and represented the final group of studies we evaluated in this review (Table 1). The PRISMA flow diagram is shown in Figure S1.
Table 1.
Summary of metals and defects assessed, outcome ascertainment methods, study designs, conflicts of interest and funding sources, and risk of bias rankings for included studies.
| Reference | Metal(s) assessed | Defects evaluated | Outcome ascertainmenta | Conflict of interest (COI) and fundingb | Risk of bias rankings | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| As | Cd | Pb | Mn | Hg | NTDs | Ac | Hc | Ec | SB | Hospital/facility | Population-based | Declared no COI | National agencies or university | E | O | S | C | M | |
| Liu et al.21 | — | X | X | — | — | X | — | — | — | — | X | — | X | X | PL | PL | L | PL | L |
| Tian et al.22 | — | X | X | X | X | X | — | — | — | — | — | X | X | X | PL | PL | PL | PL | L |
| Tong et al.23 | — | — | — | — | X | X | X | X | — | — | — | X | X | X | L | L | H | H | L |
| Liu et al.24 | — | — | — | X | — | X | — | — | — | — | X | — | X | X | PH | L | PH | H | L |
| Ovayolu et al.25 | X | X | X | X | X | X | — | — | — | — | X | — | X | — | L | PL | L | PH | PH |
| Yin et al.26 | — | — | — | X | — | X | — | — | — | — | — | X | X | X | L | PL | PH | PH | L |
| Demir et al.27 | X | X | X | X | — | X | — | — | — | — | X | — | X | X | PH | H | H | H | PH |
| Özel et al.28 | X | X | X | X | X | X | — | — | — | — | X | — | X | — | L | L | PL | H | L |
| Troisi et al.29 | — | X | X | X | X | X | — | — | — | — | X | — | X | — | PH | PL | PL | H | L |
| Wang et al.30 | X | — | — | — | — | X | X | — | — | X | X | — | X | X | PL | PH | PH | PL | L |
| Cim et al.31 | — | X | X | X | — | X | — | — | — | — | X | — | — | — | PL | PL | PH | H | L |
| Marie et al.32,c | X | — | — | — | — | X | — | — | — | — | — | X | X | X | PH | L | PH | PL | L |
| Yan et al.20 | — | — | — | X | — | X | X | — | X | X | X | — | X | — | PL | H | H | PH | PH |
| Jin et al.33 | — | — | — | — | X | X | X | — | — | X | — | X | — | X | PH | PL | U | H | U |
| Manduca et al.34 | — | X | X | — | X | X | — | — | — | — | X | — | X | — | PL | PL | PH | H | L |
| Sanders et al.35,d | X | X | X | X | — | — | — | — | — | X | — | X | X | X | PL | L | L | PL | L |
| Jin et al.19 | X | X | X | — | X | X | X | — | — | X | — | X | X | X | L | L | H | PL | L |
| Liu et al.36 | — | — | — | X | — | X | X | — | — | X | X | — | — | X | L | U | U | PL | U |
| Ramírez-Altamirano et al.37 | — | — | X | X | — | X | — | — | — | — | X | — | X | — | L | PH | H | H | L |
| Gatti et al.38,c | — | — | X | — | — | X | — | — | — | — | X | — | — | X | L | PL | H | H | L |
| Zeyrek et al.39 | — | — | X | — | — | X | — | — | — | — | X | — | X | — | PL | U | U | H | L |
| Friel et al.40 | — | X | — | — | — | — | X | — | — | — | X | — | — | X | PL | PL | H | H | L |
| Carrillo-Ponce et al.41 | — | X | X | — | — | X | — | — | — | — | — | — | — | — | PH | U | U | U | U |
| Cengiz et al.42 | — | — | X | — | — | X | — | — | — | — | X | — | — | — | PL | L | PL | H | L |
| Macdonell et al.43,c | — | — | X | — | — | X | — | — | — | — | — | X | — | — | H | PL | PH | H | L |
| Dawson et al.44 | — | — | X | — | — | X | — | — | — | — | X | — | — | — | PL | L | PH | H | L |
| Stoll et al.45 | — | — | — | X | — | — | — | X | — | X | — | X | — | X | PL | PL | L | H | L |
| Romero et al.46 | — | — | X | — | X | — | X | — | — | — | X | — | — | — | PL | L | H | H | L |
| Bound et al.47 | — | — | X | — | — | X | X | — | — | X | X | — | — | — | PH | PH | H | PL | U |
| Tahan et al.48 | — | — | X | — | X | — | — | — | — | — | X | — | — | — | PH | L | PH | H | U |
Note: As noted in the text, hydrocephaly, although not usually considered to be an NTD, was included in this review because two papers included it and we wanted to be as comprehensive as possible. For additional information on the study country, sample size, and exposure assessment, see Figures 2–6. —, not applicable; Ac, anencephaly; As, arsenic; C, confounding; Cd, cadmium; E, exposure assessment; Ec, encephalocele; H, high risk of bias; Hc, hydrocephaly; Hg, mercury; L, low risk of bias; M, missing data; Mn, manganese; NTD, neural tube defect (grouping of individual NTDs); O, outcome ascertainment; Pb, lead; PH, probably high risk of bias; PL, probably low risk of bias; S, selection; SB, spina bifida; U, unclear risk of bias.
The following definitions were used for categorizing the outcome assessment methods: a) population-based active surveillance: abstractor actively reviews multiple data sources to identify all cases, b) population-based registry (e.g., birth records or passive surveillance): case ascertainment from medical record abstraction or based on registry data only, c) hospital/facility based: based on hospital/facility, (a) and (b) are combined in this table as “population-based.”
Only entries with an “X” have a section in the published manuscript describing conflicts of interest/funding sources, of lack thereof.
All studies are case–control studies unless indicated by a superscript c.
Referred to as “semi-ecologic” in paper, described herein as a retrospective cohort with ecologic exposure assessment.
Risk of Bias Assessment for Individual Studies
The risk of bias scores for each domain for each study, along with rationale, are detailed in Table S4. The risk of bias rankings varied substantially across studies (Table 1). When we assessed risk of bias across all studies grouped by metal assessed, we identified confounding as a major area of bias, followed by selection bias and exposure assessment, across all metals (Figure 1). For all metals, over half of all articles ranked as high risk of bias for confounding (Figure 1). Specifically, for As, 4/7 studies (57%) ranked high risk of bias; for Cd, 8/13 (62%) ranked high; for Hg, 8/12 (75%) ranked high; for Mn, 6/12 (50%) ranked high; and for Pb, 16/20 (80%) ranked high. Selection bias had over half of all articles ranked as high or probably high risk of bias for most metals, other Mn. Specifically, for As, 5/7 studies (71%) ranked high or probably high risk of bias; for Cd, 7/13 (54%) ranked high or probably high; for Hg, 6/12 (50%) ranked high or probably high; for Mn, 5/12 (42%) ranked high or probably high; and for Pb, 13/20 (65%) ranked high or probably high. Exposure assessment was deemed high or probably high risk of bias in 17%–43% of articles for each metal, with Mn having the lowest percentage of studies ranked as probably high or high risk of bias [2/12 (17%)] and As having the highest [3/7 (43%)]. Outcome measurement was ranked as low or probably low risk of bias in the majority of included articles for As (5/7, 72%), Cd (10/12, 77%), Hg (10/11, 83%), Mn (9/12, 75%), and Pb (15/20, 75%). Similarly, missing data was ranked as low or probably low risk of bias in most included articles for As (6/7, 86%), Cd (10/12, 77%), Hg (8/11, 67%), Mn (9/12, 75%), and Pb (16/20, 80%).
Figure 1.

Summary of risk of bias analysis for each domain and for each metal, summarized across all studies. For detailed criteria for classifying studies as “high risk of bias” or “low risk of bias,” see the review protocol (available in the Supplemental Material, “REVIEW PROTOCOL”). “Probably low risk of bias” was assigned when there was insufficient information to fully meet the criteria for “low risk of bias” but there was indirect evidence that suggested the criteria were met. “Probably high risk of bias” was assigned when there was insufficient information to fully meet the criteria for “high risk of bias” but there was indirect evidence that suggested the criteria were met. “Unclear risk of bias” was assigned when there was not enough information in the study to determine the risk of bias.
Although conflict of interest was not evaluated formally in our risk of bias assessment, we did note declared conflicts of interests and funding sources for each study (Table 1). Nearly all studies published since 2005 either declared no conflict of interest or were funded by universities or national agencies. For most studies published before 2005, conflicts of interest and funding sources were not described, which is likely reflective of publishing conventions changing over time.
Summary of Results across Studies
We generated forest plots for each metal to aid with the visual assessment of the direction, consistency, and precision of the estimates of association (Figures 2–6). We were unable to retrieve needed additional or corrected data for two studies.19,20 To allow for comparison of methodologies across articles that did not report an estimate of association, we reported study characteristics alongside the forest plots for visual comparison of methodologies across studies. There were too few studies within each of the outcome categories (any NTDs, or each of the specific NTDs) to formally assess heterogeneity in study effect estimates via methods like meta-regression. However, various orderings of the forest plots (e.g., by exposure assessment, which we felt to be the most salient domain by which study quality varied), did not produce discernible patterns.
Figure 2.

Summary of data extracted from all studies of arsenic exposure and risk of NTDs. For each study, we selected the estimate to plot based on the following prioritization: 1) Dose response: plot quartile estimates, then tertile, then above/below median or other dichotomous split. We plotted continuous estimates in addition if presented, as well as nonlinear dose response. 2) Adjustment: fully adjusted estimates were preferentially plotted. Studies that did not present point estimates are summarized in Table S5. Given the range of scales and media of these measurements, they could not be adequately visually summarized. Under the “OR (95% CI)” column, the squares represent the odds ratio values and the bars represent the 95% confidence intervals. Risk of bias (ROB) rankings are indicated by the color coding in the far right column. ROB rankings can also be found in Table 1. The single asterisk indicates studies that did not present point estimates and rather presented comparisons of concentrations between cases and controls are listed without an OR; summary results from these studies are listed in Table S5. The double asterisk indicates that the article provided the for the full study cohort but only the male-stratified effect estimate. Note: %ile, percentile; C, confounding; CI, confidence interval; E, exposure measurement; edu, maternal education; fa, folic acid use; flufev, flu or fever during pregnancy; geosize, size of municipality; hxBD, history of birth defect; M, missing data; ma, maternal age; Med, median; NTD, neural tube defect; O, outcome measurement; occup, occupation or employment; OR, odds ratio; par, parity; pass smoke, passive smoking; Q, quartile; raceeth, maternal race or ethnicity; S, selection; yr, year of birth.
Figure 6.

Summary of data extracted from all studies of lead exposure and risk of NTDs. For each study, we selected the estimate to plot based on the following prioritization: 1) Dose response: plot quartile estimates, then tertile, then above/below median or other dichotomous split. We plotted continuous estimates in addition if presented, as well as nonlinear dose response. 2) Adjustment: fully adjusted estimates were preferentially plotted. Studies that did not present point estimates are summarized in Table S5. Given the range of scales and media of these measurements, they could not be adequately visually summarized. Under the “OR (95% CI)” column, the squares represent the odds ratio values and the bars represent the 95% confidence intervals. Risk of bias (ROB) rankings are indicated by the color coding in the far right column. ROB rankings can also be found in Table 1. The single asterisk indicates that the studies did not present point estimates and, rather, presented comparisons of concentrations between cases and controls and are listed without an OR; summary results from these studies are listed in Table S5. The double asterisk indicates the studies provided no confidence limits. Note: %ile, percentile; bmi, body mass index; C, confounding; CI, confidence interval; deprivation, area-level deprivation score; E, exposure measurement; edu, maternal education; fa, folic acid use; flufev, flu or fever during pregnancy; ga, gestational age; M, missing data; ma, maternal age; Med, median; n/a, not available; NTD, neural tube defect; O, outcome measurement; OR, odds ratio; par, parity; raceeth, maternal race or ethnicity; ROC, receiver operating characteristic; S, selection; sex, infant sex; T, tertile.
Figure 3.

Summary of data extracted from all studies of cadmium exposure and risk of NTDs. For each study, we selected the estimate to plot based on the following prioritization: 1) Dose response: plot quartile estimates, then tertile, then above/below median or other dichotomous split. We plotted continuous estimates in addition if presented, as well as nonlinear dose response. 2) Adjustment: fully adjusted estimates were preferentially plotted. Studies that did not present point estimates are summarized in Table S5. Given the range of scales and media of these measurements, they could not be adequately visually summarized. Under the “OR (95% CI)” column, the squares represent the odds ratio values and the bars represent the 95% confidence intervals. Risk of bias (ROB) rankings are indicated by the color coding in the far right column. ROB rankings can also be found in Table 1. The single asterisk indicates the study was not plotted because the reported OR was outside of the reported 95% CI. The double asterisk indicates that the studies did not present point estimates and, rather, presented comparisons of concentrations between cases and controls and are listed without an OR; summary results from these studies are listed in Table S5. Note: %ile, percentile; bmi, body mass index; C, confounding; CI, confidence interval; E, exposure measurement; edu, maternal education; fa, folic acid use; flufev, flu or fever during pregnancy; ga, gestational age; hxBD, history of birth defect; M, missing data; ma, maternal age; Med, median; n/a, not available; NTD, neural tube defect; O, outcome measurement; occup, occupation or employment; OR, odds ratio; pass smoke, passive smoking; raceeth, maternal race or ethnicity; S, selection; sex, infant sex; T, tertile.
Figure 4.

Summary of data extracted from all studies of mercury exposure and risk of NTDs. For each study, we selected the estimate to plot based on the following prioritization: 1) Dose response: plot quartile estimates, then tertile, then above/below median or other dichotomous split. We plotted continuous estimates in addition if presented, as well as nonlinear dose response. 2) Adjustment: fully adjusted estimates were preferentially plotted. Studies that did not present point estimates are summarized in Table S5. Given the range of scales and media of these measurements, they could not be adequately visually summarized. Under the “OR (95% CI)” column, the squares represent the odds ratio values and the bars represent the 95% confidence intervals. Risk of bias (ROB) rankings are indicated by the color coding in the far right column. ROB rankings can also be found in Table 1. Note: bmi, body mass index; C, confounding; CI, confidence interval; E, exposure measurement; edu, maternal education; fa, folic acid use; flufev, flu or fever during pregnancy; ga, gestational age; hxBD, history of birth defect; M, missing data; ma, maternal age; Med, median; n/a, not available; NTD, neural tube defect; O, outcome measurement; OR, odds ratio; pass smoke, passive smoking; S, selection; sex, infant sex; T, tertile.
Figure 5.

Summary of data extracted from all studies of manganese exposure and risk of NTDs. For each study, we selected the estimate to plot based on the following prioritization: 1) Dose response: plot quartile estimates, then tertile, then above/below median or other dichotomous split. We plotted continuous estimates in addition if presented, as well as nonlinear dose response. 2) Adjustment: fully adjusted estimates were preferentially plotted. Studies that did not present point estimates are summarized in Table S5. Given the range of scales and media of these measurements, they could not be adequately visually summarized. Under the “OR (95% CI)” column, the squares represent the odds ratio values and the bars represent the 95% confidence intervals. Risk of bias (ROB) rankings are indicated by the color coding in the far right column. ROB rankings can also be found in Table 1. The single asterisk indicates the study had Q3 vs. Q1 OR listed as 0.14 (0.02–1.18) and is not plotted given that this is likely an error. The double asterisk indicates that the studies did not present point estimates and, rather, presented comparisons of concentrations between cases and controls and are listed without an OR; summary results from these studies are listed in Table S5. Note: %ile, percentile; bmi, body mass index; C, confounding; CI, confidence interval; E, exposure measurement; edu, maternal education; fa, folic acid use; flufev, flu or fever during pregnancy; ga, gestational age; hxBD, history of birth defect; M, missing data; ma, maternal age; NTD, neural tube defect; O, outcome measurement; occup, occupation or employment; OR, odds ratio; par, parity; Q, quartile; raceeth, maternal race or ethnicity; ROC, receiver operating characteristic; S, selection; sex, infant sex; smoke, smoking; T, tertile.
Quality of Body of Evidence
We assessed the quality of the evidence across all included articles for each metal (Table 2). The quality of the evidence for all metals was downgraded owing to numerous studies with notable risk of bias. Specifically, for all metals at least 50% of studies were ranked as having high risk of bias for confounding and high or probably high risk of bias for selection bias. No body of evidence was downgraded for imprecision because none of them had numerous studies with a sample size of cases. Although we did not formally assess publication bias because of the heterogeneity of studies, based on the other considerations outlined in the review protocol (available in the Supplemental Material, “REVIEW PROTOCOL”), we deemed substantial publication bias to be unlikely for all metals. Specifically, no body of evidence was dominated by early, small studies with negative associations; studies were not uniformly small across any of the bodies of evidence; and a comprehensive search was conducted. We upgraded the evidence for a large magnitude of effect for Hg and Mn (most studies had effect estimates in the same direction and ) as well as Cd (most studies had effect estimates in the same direction and ). We also upgraded the evidence based on an observed dose response for Hg in three studies,19,22,33 Mn in three studies,22,24,26 Cd in one study,19 and Pb in one study.22 No other upgrade factors were applied. Overall, we assigned the evidence for Cd, Hg, and Mn a high quality rating, Pb a moderate quality rating, and As a low quality rating.
Table 2.
Summary of quality and strength of evidence for metals and neural tube defects.
| Mn | Pb | Cd | Hg | As | |
|---|---|---|---|---|---|
| Quality factor | |||||
| Downgrade factors | |||||
| Risk of bias across studies | |||||
| Imprecision | 0 | 0 | 0 | 0 | 0 |
| Publication bias | 0 | 0 | 0 | 0 | 0 |
| Upgrade factors | |||||
| Large magnitude of effect | 1 | 0 | 1 | 1 | 0 |
| Dose response | 1 | 1 | 1 | 1 | 0 |
| Confounding minimizes effect | 0 | 0 | 0 | 0 | 0 |
| Overall quality of evidence | 1 | 0 | 1 | 1 | |
| Strength considerations | |||||
| Quality of body of evidence | High | Moderate | High | High | Low |
| Direction of effect | Increase | Increase | Decrease | Increase | Null |
| Confidence in estimates of association: “Is it likely or unlikely that a new study would change the trend/pattern observed in the high quality literature at the moment?” | Likely | Likely | Likely | Likely | Likely |
| Other compelling attributes of the data that may influence certainty | There are three studies that demonstrate a monotonic dose response. If you remove the study using hair as the exposure, the studies are very consistent. | None | Although one study did demonstrate a monotonic dose response, this is not consistent across studies. | There are three studies that demonstrate a monotonic dose response. | None |
| Overall strength of evidence (“sufficient,” “limited,” “inadequate,” or “evidence of lack of effect”) | Limited | Inadequate | Inadequate | Limited | Inadequate |
Note: decrease, increasing exposure levels/decreasing risk; high, sum of quality factors is ; increase, increasing exposure levels/increasing risk; low, sum of quality factors is ; moderate, sum of quality factors is 0.
Strength of Body of Evidence
We concluded that none of the metals had a literature supportive of conducting a meta-analysis. Specifically, the literature for all metals was such that we could not consider random error as the primary concern. In addition, heterogeneous exposure assessment and outcome assessment methodologies were used across studies.
We concluded that the overall direction of association was positive or, in other words, increasing levels of the metal increased the risk of any NTDs, for Hg, Mn, and Pb. We found that the direction of association was consistently negative for Cd and was null for As. For considering confidence in estimates of association, across the evidence for all metals, we deemed it likely that a hypothetical, well-designed new study that disagrees with the current trend would shift our assessment of the quality of the literature. For considering the strength of the evidence for Cd, whereas a high quality rating was given based on the review protocol, our confidence in the upgrade of the evidence for the dose response was weakened, compared with for Hg and Mn, given that the dose response was observed only in one study and was not consistent across studies. Taken together, we concluded that the current epidemiologic literature provides inadequate evidence for an association of exposure to As, Cd, or Pb with NTD prevalence. We determined that the current body of literature provides a limited evidence base for an adverse association of prenatal exposure to Hg or Mn on NTD prevalence. It is worth noting that studies on Hg included those assessing total Hg, and one specifically evaluating methyl-Hg (MeHg),33 generally considered to be more toxic.49 Total Hg includes inorganic Hg and MeHg, and can act as a good biomarker for MeHg in populations with high fish consumption. However, only two studies that assessed total Hg noted that the population was not a fish-consuming population19,23; therefore, it was difficult to distinguish the effects of MeHg vs. inorganic Hg from the literature currently.
Literature on Metal Mixtures
There was only one included study that assessed the effect of exposure to metal mixtures and risk of NTDs.24 That study evaluated essential metals, including only Mn in its mixture among the metals of interest in this review. Thus, no included study evaluated mixture effects among As, Cd, Hg, Mn, or Pb.
Discussion
Many regulatory agencies, including the U.S. Food and Drug Administration (FDA),50 the U.S. Environmental Protection Agency (EPA),51 the National Institute of Environmental Health Sciences,52 the World Health Organization,53 and the International Agency for Research on Cancer54 make use of systematic reviews of epidemiologic studies to evaluate the safety of chemical exposures within the framework of regulatory decision-making. Because regulatory actions may stem from systematic reviews, it is important that robust approaches be applied to such studies, including prespecification of and transparency in methodology as well as bias identification and possible reduction. With regulatory consequences in mind, we adapted the Navigation Guide methodology, a systematic review approach for use in observational environmental health research, and summarized 30 epidemiologic studies of As, Cd, Hg, Mn, and Pb and NTDs.15,16 There were two major findings. First, we determined that there was limited evidence of an adverse association between Hg or Mn exposure during pregnancy and prevalence of NTDs. Second, we concluded that there was inadequate evidence to assess a relationship between prenatal exposure to As, Cd, or Pb and prevalence of NTDs, thus highlighting the need for additional high-quality studies to make any regulatory decision based on the risk of NTDs upon As, Cd, or Pb exposure.
Our conclusion of limited evidence of an adverse association for prenatal Hg and Mn exposures during pregnancy and prevalence of NTDs reflects consistently positive associations observed across the current bodies of evidence for these metals, which were each deemed high quality. This denoting implies that we believe the evidence suggests there is an effect, but this judgment of the evidence could be convincingly overturned by contradictory, high-quality studies. These bodies of literature consisted of four (Hg)19,22,23,33 to six (Mn)20,22,24,26,28,36 case–control studies using biomarker-based exposure assessment, the majority of which reported large magnitudes of adverse associations. In addition, for both Hg and Mn, three studies demonstrated monotonic dose responses.19,22,24,26,33 There was particularly strong agreement across high-quality studies of Hg measured in placenta19,23,33 and Mn biomarkers other than hair,22,24,26 although all these studies were limited to exposure assessment at birth, which may not accurately capture early pregnancy exposure, the period of most concern for NTDs.55,56 Further and Mn on NTDs. In addition, assessments of effect measure modification are needed to assist with identifying population subgroups that are most vulnerable to these metals during pregnancy.
A special consideration is needed in interpreting findings for Hg given that most studies measured total Hg, which includes exposure to inorganic Hg (e.g., dental amalgams and preservatives) that do not cross the placenta as easily as MeHg.33,57 Further, all our reviewed Hg studies were based in China, where placental Hg is generally higher than that in other countries,58 so internationally relevant low-dose studies should be conducted to assess toxicity at current levels elsewhere. Regardless, we did note consistent, positive associations in the majority of studies assessing prenatal Hg and NTD prevalence. Putting this finding in the context of regulatory action, the FDA and the U.S. EPA issued joint statements on Hg in 2004 and 2019, detailing fish consumption guidelines based on MeHg exposure in the context of in utero exposure and neurodevelopment risk.59,60 The statement encourages women who are or might become pregnant, breastfeeding mothers, and young children to limit fish consumption to no more than 12 oz () of commercially caught fish per week and no more than 6 oz () of locally caught fish per week.59,60 Even though the evidence of an adverse association between prenatal Hg exposure and NTDs observed in this review is limited, it adds to knowledge of the prenatal neurotoxic potential of this metal and thus further emphasizes the need to avoid exposures as advised by the FDA and U.S. EPA.
One notable challenge for regulatory decision-making is that most chemical exposures do not occur in isolation. The Agency for Toxic Substances and Disease Registry (ATSDR) has identified the following priority mixtures: As, Cd, Cr, and Pb, as well as chlorpyrifos, Pb, Hg, and MeHg.61 Notably, even marginal evidence for single metal association with NTDs, as reported herein for Hg and Mn, could be highly relevant if synergistic effects occur in the presence of exposure to these common mixtures, or such evidence may be relevant without synergism in the case where small independent effects of multiple exposures can additively lead to larger joint effects. However, to date, the literature evaluating metal mixture effects on NTDs is extremely limited.
For all other metals examined (As, Cd, and Pb), the literature was deemed inadequate to determine the association with NTDs. This classification means that the literature is insufficient to assess the effect of the exposure, and that more high-quality studies are needed for any determination. The major area of concern generated from our assessment of the strength and quality of the literature was confounding bias. Notably, many studies included in this review adjusted for no confounders, and among those that did adjust for confounders, no study explained their approach to selection of confounders. This was especially true for studies that evaluated Pb: 12 (60%) of the 20 included studies simply presented a comparison of median or mean concentrations in cases or controls with accompanying -tests or equivalents.
Crucially, with respect to metals, environmental measurements and biomarker measurements can differ substantially with respect to potential for confounding bias. In studies with environmental matrix, where exposures are attributed to individuals based on area-level concentrations detected in soil or water samples, a key potential confounder would be exposure sources (e.g., pollution sources) emitting copollutants that may truly be driving an effect. There is also potential confounding by factors that vary geographically along with exposure sources, such as socioeconomic characteristics.62 For instance, it is documented that populations living closer to Superfund sites in the United States are more likely to be low-income and racial minorities, vulnerable also to exposures connected to income inequality and systemic racism that may influence the risk of NTDs as well.63,64 In contrast, when exposure measures derive from biomarker measurements (e.g., maternal urine), the potential for “physiologic confounding” becomes an additional concern, where (sometimes hard-to-capture) factors, such as metabolism, urine dilution, and blood volume, can influence biomarker measurements and reflect underlying physiologic differences that relate to the subsequent risk of a NTD, such as diabetes status and nutritional status (including folate levels).65 Both biomarker and environmental measures are common in assessing health effects of metals exposure, emphasizing a need to address the potential for confounding differently for these two types of exposure assessment methods.
In addition to confounding bias, we identified selection bias as a major area of concern in the current literature evaluating metals and NTDs. One salient concern in studies of birth outcomes such as NTDs arises when the target population is the population of conceptuses, or very early stage fetuses. Often, studies of birth defects are restricted to live births or pregnancies that progress past some period of gestation (e.g., 20 wk). In such cases, the study population consists of pregnancies that last at least to the minimum gestational age, so that processes occurring prior to that time can lead to informative loss of fetuses from the target population. This phenomenon, which has been termed live birth bias, is illustrated in the directed acyclic graph (DAG) shown in Figure 7.66,67 In this figure, restricting the study population to fetuses that survive past a certain gestational age, or to birth, means that exposures measured before fetal death can have spurious relationships with NTDs if there are unaccounted for factors (U) that can result in either fetal death or NTDs. This bias can potentially be reduced by analytic approaches to selection bias, such as inverse probability weighting, or by generating different target parameters, such as survivor average causal effects.68,69 However, in many cases U must be known and well measured to do so, or the full population of conceptuses must be enumerated, and these challenges can be substantial. To some extent, all studies examined in this review were subject to potential bias from missing information on early pregnancy losses, although the potential magnitude of this bias is not well understood. Thus, rather than conclude that every study was subject to a high risk of bias for selection bias, we assessed studies relative to what could be feasibly done in studies of birth defects. If exposure to metals does increase the risk of early loss and if other factors also jointly increase both early loss and NTDs, then we would expect this bias to be toward the null such that prevalence ratios and odds ratios would underestimate true risk ratios and cumulative incidence ratios that would have been estimated in the absence of early losses.
Figure 7.
Directed acyclic graph describing live birth bias in the context of prenatal metal exposure and neural tube defects (NTDs). Note: U, unknown or unaccounted for factor.
The final major area of needed improvement identified was exposure assessment. In general, for all metals, articles included in this review collected samples after the critical window for NTDs, which predominantly develop in the first 4 wk of pregnancy.55,56 It is challenging to capture biomarkers of exposure during this window given that many women do not yet know they are pregnant. Future studies could use maternal toenails as a biomarker of exposure, which are noninvasive, have been shown for As and Mn to be valid biomarkers of maternal–fetal transfer and have the potential to be time stamped to a window of exposure, such as early pregnancy.70–72 In addition, studies could consider the use of children’s teeth, which can also be time stamped, although this would not be feasible for life-limiting birth defects.73,74
The studies we reviewed also varied in sample collection, preparation, and analytical methods used for biomarker measurements, with some studies failing to provide details on laboratory procedures at all. This is critical because some of the biomarkers used are particularly susceptible to misclassification from sample collection and preparation methods. For example, past studies have shown that Cd concentrations vary throughout the placenta, and the way in which samples are collected and processed has an important impact on results.75 In addition, hair samples can reflect both internal dose and external deposition of metals. Consistent methods for washing hair samples prior to processing are necessary to ensure externally deposited contaminants are removed.70
Moreover, regardless of laboratory procedures, the matrices used to estimate exposure concentrations in many of the studies reviewed may not be optimal for the specific metals of interest. For instance, Cd is known to accumulate in the placenta.58,76 Therefore, measured placental concentrations of these metals likely represent cumulative maternal exposures during gestation. Given that NTD cases have a high risk of preterm birth, the time period for accumulation to occur (i.e., gestation), can be much shorter in cases vs. controls.77 This may lead to placental Cd being lower in cases vs. controls as an artifact of gestational age, rather than this metal truly being protective of NTDs. In the one study included that assessed placental Cd and NTD prevalence, indeed a negative relationship was found for both spina bifida and any NTDs.19 This accumulation of Cd in placenta may represent a bias in exposure assessment that explains the counterintuitive findings finding that Cd demonstrated a negative relationship with NTDs prevalence. This negative relationship was, however, also observed for infant serum collected at birth and census tract well-water concentrations; therefore, it is also possible that the accumulation of Cd in placenta tissue represents a true barrier to fetal exposure, thus protecting it from Cd toxicity.35,41 Overall, although a negative relationship was observed for Cd, the strength of the evidence was deemed inadequate to make a formal judgment.
Although outcome assessment was judged to be less of an urgent concern for improving this literature, there are several relevant notes for considerations of future study designs. The articles included in this review varied in their outcome assessment methods. Some relied on a single trained health care worker to visually assess outcomes and identify cases, whereas others involved a team of physicians who reviewed and cross-validated outcomes, potentially using imaging and laboratory studies to assist with case identification. Many did not provide clear details about the outcome assessment methods, limiting our ability to compare across studies.73,74 Misdiagnosis of less-severe, nonvisually observable birth defects (e.g., congenital heart defects) is a well-known issue.78–82 This could lead to missed cases of less-severe NTDs, such as spina bifida. However, several studies have found that most NTDs (e.g., spina bifida, anencephaly, encephalocele), which are severe and easy to see, are less prone to misclassification and diagnostic variability than other birth defects.78,81,82 Thus, although issues related to outcome assessment methods could have led to some misclassification or missed cases, this is less likely with NTDs, and misclassification would not be expected to vary by exposure status.
Despite the use of a transparent and thorough protocol, there are some limitations of this approach. Although we aimed to conduct a comprehensive review of prior literature, it is possible that we did not identify every relevant study. For instance, we did not search the gray literature for possibly relevant studies. For some studies, point estimates or precision measures were not available, and we were not able to obtain this information despite our attempts to contact study authors. We did not conduct a formal meta-analysis of study effect estimates nor a formal assessment of publication bias for any of the metals we assessed owing to the lack of a sufficient number of studies and the heterogeneity of the study methodologies. We did not review toxicologic studies to inform potential biological mechanisms and plausibility of relations under study because we considered this literature to be outside the scope of our review. Finally, our risk of bias decisions were based on our author team’s knowledge, expertise, and judgments, and it is possible that our conclusions may differ from those of another research team. As an example, there are some other potentially important confounders that could have also been considered in the risk of bias, including maternal obesity and diabetes, as well as folate status; however, we did not consider these based on our DAG analysis. Although not a limitation of this review, per se, it is worthy of note that many other categories of birth defects, including urinary system defects, genital organ defects, and digestive system effects, did not have an adequate number of studies to summarize the literature, thus pointing to literature gaps in need of further research.
Overall, we found that the literature examining relationships between prenatal exposure to As, Cd, Hg, Mn, and Pb and NTDs is sparse and generally in need of higher-quality studies. Future studies can improve the literature substantially by employing robust exposure assessment methods in relevant time windows and consider modern approaches to reducing or controlling confounding and selection bias. Although the overall strength of the evidence was inadequate to decide for other heavy metals, we found limited evidence of an adverse association between prenatal Hg or Mn and NTD prevalence, which speaks to the consistency of the results despite a multitude of potential biases. Overall, owing to limitations of the existing evidence base, the role of prenatal As, Cd, and Pb exposure in etiology of NTDs remains unclear and warrants further investigation in high-quality studies.
Supplementary Material
Acknowledgments
We thank K. Moon for her guidance in synthesizing the results and V. Davila for her assistance with data cleaning and organization. We also thank the librarians at the University of North Carolina at Chapel Hill Health Sciences Library for their assistance with conducting the literature search.
This research was supported in part by the National Institutes of Health/National Institute for Environmental Health Sciences (R01ES029531, to A.P.K.; P42ES031007, to R.C.F.).
References
- 1.Greene NDE, Copp AJ. 2014. Neural tube defects. Annu Rev Neurosci 37:221–242, PMID: , 10.1146/annurev-neuro-062012-170354. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Williams J, Mai CT, Mulinare J, Isenburg J, Flood TJ, Ethen M, et al. 2015. Updated estimates of neural tube defects prevented by mandatory folic acid fortification—United States, 1995–2011. MMWR Morb Mortal Wkly Rep 64(1):1–5, PMID: . [PMC free article] [PubMed] [Google Scholar]
- 3.Copp AJ, Stanier P, Greene NDE. 2013. Neural tube defects: recent advances, unsolved questions, and controversies. Lancet Neurol 12(8):799–810, PMID: , 10.1016/S1474-4422(13)70110-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Mai CT, Isenburg JL, Canfield MA, Meyer RE, Correa A, Alverson CJ, et al. 2019. National population-based estimates for major birth defects, 2010–2014. Birth Defects Res 111(18):1420–1435, PMID: , 10.1002/bdr2.1589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Christianson A, Howson CP, Modell B. 2005. March of Dimes: Global Report on Birth Defects, The Hidden Toll of dying and Disabled Children. White Plains, NY: March of Dimes Birth Defects Foundation. [Google Scholar]
- 6.Bulka CM, Bommarito PA, Fry RC. 2019. Predictors of toxic metal exposures among US women of reproductive age. J Expo Sci Environ Epidemiol 29(5):597–612, PMID: , 10.1038/s41370-019-0152-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Jaishankar M, Tseten T, Anbalagan N, Mathew BB, Beeregowda KN. 2014. Toxicity, mechanism and health effects of some heavy metals. Interdiscip Toxicol 7(2):60–72, PMID: , 10.2478/intox-2014-0009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.OEHHA (Office of Environmental Health Hazard Assessment). 2022. The Proposition 65 List. https://oehha.ca.gov/proposition-65/proposition-65-list [accessed 10 April 2022].
- 9.Aylward LL, Hays SM, Kirman CR, Marchitti SA, Kenneke JF, English C, et al. 2014. Relationships of chemical concentrations in maternal and cord blood: a review of available data. J Toxicol Environ Health B Crit Rev 17(3):175–203, PMID: , 10.1080/10937404.2014.884956. [DOI] [PubMed] [Google Scholar]
- 10.Gundacker C, Hengstschläger M. 2012. The role of the placenta in fetal exposure to heavy metals. Wien Med Wochenschr 162(9–10):201–206, PMID: , 10.1007/s10354-012-0074-3. [DOI] [PubMed] [Google Scholar]
- 11.Lin S, Ren A, Wang L, Huang Y, Wang Y, Wang C, et al. 2018. Oxidative stress and apoptosis in benzo[a]pyrene-induced neural tube defects. Free Radic Biol Med 116:149–158, PMID: , 10.1016/j.freeradbiomed.2018.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Han ZJ, Song G, Cui Y, Xia HF, Ma X. 2011. Oxidative stress is implicated in arsenic-induced neural tube defects in chick embryos. Int J Dev Neurosci 29(7):673–680, PMID: , 10.1016/j.ijdevneu.2011.06.006. [DOI] [PubMed] [Google Scholar]
- 13.Tung EWY, Winn LM. 2011. Valproic acid increases formation of reactive oxygen species and induces apoptosis in postimplantation embryos: a role for oxidative stress in valproic acid-induced neural tube defects. Mol Pharmacol 80(6):979–987, PMID: , 10.1124/mol.111.072314. [DOI] [PubMed] [Google Scholar]
- 14.Liu Z, He C, Chen M, Yang S, Li J, Lin Y, et al. 2018. The effects of lead and aluminum exposure on congenital heart disease and the mechanism of oxidative stress. Reprod Toxicol 81:93–98, PMID: , 10.1016/j.reprotox.2018.07.081. [DOI] [PubMed] [Google Scholar]
- 15.Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, et al. 2014. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect 122(10):1028–1039, PMID: , 10.1289/ehp.1307893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Woodruff TJ, Sutton P. 2014. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect 122(10):1007–1014, PMID: , 10.1289/ehp.1307175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Cumpston M, Li T, Page MJ, Chandler J, Welch VA, Higgins JP, et al. 2019. Updated guidance for trusted systematic reviews: a new edition of the Cochrane Handbook for Systematic Reviews of Interventions. Cochrane Database Syst Rev 10(10):ED000142, PMID: , 10.1002/14651858.ED000142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.WHO (World Health Organization). 2019. International Statistical Classification of Diseases and Related Health Problems 10th Revision. https://icd.who.int/browse10/2019/en [accessed 18 May 2022].
- 19.Jin L, Zhang L, Li Z, Liu JM, Ye R, Ren A. 2013. Placental concentrations of mercury, lead, cadmium, and arsenic and the risk of neural tube defects in a Chinese population. Reprod Toxicol 35:25–31, PMID: , 10.1016/j.reprotox.2012.10.015. [DOI] [PubMed] [Google Scholar]
- 20.Yan L, Wang B, Li Z, Liu Y, Huo W, Wang J, et al. 2017. Association of essential trace metals in maternal hair with the risk of neural tube defects in offspring. Birth Defects Res 109(3):234–243, PMID: , 10.1002/bdra.23594. [DOI] [PubMed] [Google Scholar]
- 21.Liu M, Yu J, Su Z, Sun Y, Liu Y, Xie Q, et al. 2021. Associations between prenatal exposure to cadmium and lead with neural tube defect risks are modified by single-nucleotide polymorphisms of fetal MTHFR and SOD2: a case–control study. Environ Health 20(1):66, PMID: , 10.1186/s12940-021-00752-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Tian T, Yin S, Jin L, Liu J, Wang C, Wei J, et al. 2021. Single and mixed effects of metallic elements in maternal serum during pregnancy on risk for fetal neural tube defects: a Bayesian kernel regression approach. Environ Pollut 285:117203, PMID: , 10.1016/j.envpol.2021.117203. [DOI] [PubMed] [Google Scholar]
- 23.Tong M, Yu J, Liu M, Li Z, Wang L, Yin C, et al. 2021. Total mercury concentration in placental tissue, a good biomarker of prenatal mercury exposure, is associated with risk for neural tube defects in offspring. Environ Int 150:106425, PMID: , 10.1016/j.envint.2021.106425. [DOI] [PubMed] [Google Scholar]
- 24.Liu M, Jin L, Yu J, Su Z, Sun Y, Liu Y, et al. 2020. Essential trace elements in umbilical cord tissue and risk for neural tube defects. Reprod Toxicol 98:149–156, PMID: , 10.1016/j.reprotox.2020.09.007. [DOI] [PubMed] [Google Scholar]
- 25.Ovayolu A, Ovayolu G, Karaman E, Yuce T, Ozek MA, Turksoy VA. 2020. Amniotic fluid levels of selected trace elements and heavy metals in pregnancies complicated with neural tube defects. Congenit Anom (Kyoto) 60(5):136–141, PMID: , 10.1111/cga.12363. [DOI] [PubMed] [Google Scholar]
- 26.Yin S, Wang C, Wei J, Wang D, Jin L, Liu J, et al. 2020. Essential trace elements in placental tissue and risk for fetal neural tube defects. Environ Int 139:105688, PMID: , 10.1016/j.envint.2020.105688. [DOI] [PubMed] [Google Scholar]
- 27.Demir N, Başaranoğlu M, Huyut Z, Değer İ, Karaman K, Şekeroğlu MR, et al. 2019. The relationship between mother and infant plasma trace element and heavy metal levels and the risk of neural tube defect in infants. J Matern Fetal Neonatal Med 32(9):1433–1440, PMID: , 10.1080/14767058.2017.1408064. [DOI] [PubMed] [Google Scholar]
- 28.Özel Ş, Ozyer S, Aykut O, Çinar M, Yılmaz OH, Caglar A, et al. 2019. Maternal second trimester blood levels of selected heavy metals in pregnancies complicated with neural tube defects. J Matern Fetal Neonatal Med 32(15):2547–2553, PMID: , 10.1080/14767058.2018.1441280. [DOI] [PubMed] [Google Scholar]
- 29.Troisi J, Giugliano L, Sarno L, Landolfi A, Richards S, Symes S, et al. 2019. Serum metallome in pregnant women and the relationship with congenital malformations of the central nervous system: a case-control study. BMC Pregnancy Childbirth 19(1):471, PMID: , 10.1186/s12884-019-2636-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wang B, Zhu Y, Yan L, Zhang J, Wang X, Cheng H, et al. 2019. Association of maternal chronic arsenic exposure with the risk of neural tube defects in Northern China. Environ Int 126:222–227, PMID: , 10.1016/j.envint.2019.02.016. [DOI] [PubMed] [Google Scholar]
- 31.Cim N, Tolunay HE, Boza B, Bilici M, Karaman E, Cetin O, et al. 2018. Is there any association between fetal nervous system anomalies and heavy metal-trace element levels in amniotic fluid? Clin Exp Obstet Gynecol 45(4):555–557, 10.12891/ceog4378.2018. [DOI] [Google Scholar]
- 32.Marie C, Léger S, Guttmann A, Marchiset N, Rivière O, Perthus I, et al. 2018. In utero exposure to arsenic in tap water and congenital anomalies: a French semi-ecological study. Int J Hyg Environ Health 221(8):1116–1123, PMID: , 10.1016/j.ijheh.2018.07.012. [DOI] [PubMed] [Google Scholar]
- 33.Jin L, Liu M, Zhang L, Li Z, Yu J, Liu J, et al. 2016. Exposure of methyl mercury in utero and the risk of neural tube defects in a Chinese population. Reprod Toxicol 61:131–135, PMID: , 10.1016/j.reprotox.2016.03.040. [DOI] [PubMed] [Google Scholar]
- 34.Manduca P, Naim A, Signoriello S. 2014. Specific association of teratogen and toxicant metals in hair of newborns with congenital birth defects or developmentally premature birth in a cohort of couples with documented parental exposure to military attacks: observational study at Al Shifa Hospital, Gaza, Palestine. Int J Environ Res Public Health 11(5):5208–5223, PMID: , 10.3390/ijerph110505208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Sanders AP, Desrosiers TA, Warren JL, Herring AH, Enright D, Olshan AF, et al. 2014. Association between arsenic, cadmium, manganese, and lead levels in private wells and birth defects prevalence in North Carolina: a semi-ecologic study. BMC Public Health 14:955, PMID: , 10.1186/1471-2458-14-955. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Liu J, Jin L, Zhang L, Li Z, Wang L, Ye R, et al. 2013. Placental concentrations of manganese and the risk of fetal neural tube defects. J Trace Elem Med Biol 27(4):322–325, PMID: , 10.1016/j.jtemb.2013.04.001. [DOI] [PubMed] [Google Scholar]
- 37.Ramírez-Altamirano MdeJ, Fenton-Navarro P, Sivet-Chiñas E, Harp-Iturribarria FdeM, Martínez-Cruz R, Cruz PH, et al. 2012. The relationship of aluminium and silver to neural tube defects; a case control. Iran J Pediatr 22(3):369–374, PMID: . [PMC free article] [PubMed] [Google Scholar]
- 38.Gatti AM, Bosco P, Rivasi F, Bianca S, Ettore G, Gaetti L, et al. 2011. Heavy metals nanoparticles in fetal kidney and liver tissues. Front Biosci (Elite Ed) 3(1):221–226, PMID: , 10.2741/e236. [DOI] [PubMed] [Google Scholar]
- 39.Zeyrek D, Soran M, Cakmak A, Kocyigit A, Iscan A. 2009. Serum copper and zinc levels in mothers and cord blood of their newborn infants with neural tube defects: a case–control study. Indian Pediatr 46(8):675–680, PMID: . [PubMed] [Google Scholar]
- 40.Friel JK, Longerich H, Jackson SE, Pushpananthan C, Wright JR Jr.. 2005. Possible altered mineral metabolism in human anencephalic fetuses. Nutr Res 25(2):103–109, 10.1016/j.nutres.2004.10.007. [DOI] [Google Scholar]
- 41.Carrillo-Ponce MdeL, Martínez-Ordaz VA, Velasco-Rodríguez VM, Hernández-García A, Hernández-Serrano MC, Sanmiguel F. 2004. Serum lead, cadmium, and zinc levels in newborns with neural tube defects from a polluted zone in Mexico. Reprod Toxicol 19(2):149–154, PMID: , 10.1016/j.reprotox.2004.07.003. [DOI] [PubMed] [Google Scholar]
- 42.Cengiz B, Söylemez F, Oztürk E, Cavdar AO. 2004. Serum zinc, selenium, copper, and lead levels in women with second-trimester induced abortion resulting from neural tube defects: a preliminary study. Biol Trace Elem Res 97(3):225–235, PMID: , 10.1385/BTER:97:3:225. [DOI] [PubMed] [Google Scholar]
- 43.Macdonell JE, Campbell H, Stone DH. 2000. Lead levels in domestic water supplies and neural tube defects in Glasgow. Arch Dis Child 82(1):50–53, PMID: , 10.1136/adc.82.1.50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Dawson EB, Evans DR, Harris WA, Van Hook JW. 1999. Amniotic fluid B12, calcium, and lead levels associated with neural tube defects. Am J Perinatol 16(7):373–378, PMID: , 10.1055/s-2007-993887. [DOI] [PubMed] [Google Scholar]
- 45.Stoll C, Dott B, Alembik Y, Koehl C. 1999. Maternal trace elements, vitamin B12, vitamin A, folic acid, and fetal malformations. Reprod Toxicol 13(1):53–57, PMID: , 10.1016/s0890-6238(98)00058-6. [DOI] [PubMed] [Google Scholar]
- 46.Romero RA, Salgado O, Marcano L. 1998. Impact of social factors and heavy metal pollution on the incidence of anencephaly at the eastern coast of Lake Maracaibo, Venezuela. Trace Elem Electroly 15(1):34–38. [Google Scholar]
- 47.Bound JP, Harvey PW, Francis BJ, Awwad F, Gatrell AC. 1997. Involvement of deprivation and environmental lead in neural tube defects: a matched case-control study. Arch Dis Child 76(2):107–112, PMID: , 10.1136/adc.76.2.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Tahán JE, Barrios LC, Marcano L, Granadillo VA, Cubillán HS, Sánchez JM, et al. 1996. Levels of Hg, Pb and V in brain, kidney, liver and lung of anencephalic fetuses from the eastern coast of Lake Maracaibo, Venezuela. Trace Elem Electroly 13(1):7–13. [Google Scholar]
- 49.Hong YS, Kim YM, Lee KE. 2012. Methylmercury exposure and health effects. J Prev Med Public Health 45(6):353–363, PMID: , 10.3961/jpmph.2012.45.6.353. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.FDA (U.S. Food and Drug Administration). 2022. FDA Guidance Documents: Drugs. https://www.fda.gov/drugs/guidance-compliance-regulatory-information/guidances-drugs [accessed 7 June 2022].
- 51.Davis JA, Kopylev L, Gift J. 2018. Quantitative meta-analytical approaches for the analysis of animal toxicology and epidemiologic data in human health risk assessments. In: 2018 Society for Risk Analysis Annual Meeting. 2–6 December 2018. New Orleans, LA: Society for Risk Analysis, Abstract WS-D.1. [Google Scholar]
- 52.National Toxicology Program. 2019. Handbook for Conducting Systematic Reviews for Health Effects Evaluations. https://ntp.niehs.nih.gov/whatwestudy/assessments/noncancer/handbook/index.html [accessed 10 June 2022].
- 53.WHO. 2021. Framework for the use of systematic review in chemical risk assessment. https://www.who.int/publications/i/item/9789240034488 [accessed 10 June 2022].
- 54.Straif K, Stayner L, Demers PA, Landrigan PJ. 2012. Use of meta-analyses by IARC working groups. Environ Health Perspect 120(9):A342–A343, PMID: , 10.1289/ehp.1205397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Botto LD, Moore CA, Khoury MJ, Erickson JD. 1999. Neural-tube defects. N Engl J Med 341(20):1509–1519, PMID: , 10.1056/NEJM199911113412006. [DOI] [PubMed] [Google Scholar]
- 56.Copp AJ, Greene NDE. 2013. Neural tube defects—disorders of neurulation and related embryonic processes. Wiley Interdiscip Rev Dev Biol 2(2):213–227, PMID: , 10.1002/wdev.71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Park JD, Zheng W. 2012. Human exposure and health effects of inorganic and elemental mercury. J Prev Med Public Health 45(6):344–352, PMID: , 10.3961/jpmph.2012.45.6.344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Esteban-Vasallo MD, Aragonés N, Pollan M, López-Abente G, Perez-Gomez B. 2012. Mercury, cadmium, and lead levels in human placenta: a systematic review. Environ Health Perspect 120(10):1369–1377, PMID: , 10.1289/ehp.1204952. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.FDA. 2004. FDA/EPA 2004 Advice on What You Need to Know About Mercury in Fish and Shellfish. https://www.fda.gov/food/metals-and-your-food/fdaepa-2004-advice-what-you-need-know-about-mercury-fish-and-shellfish [accessed 9 June 2022].
- 60.FDA. 2019. Advice about Eating Fish. https://www.fda.gov/food/consumers/advice-about-eating-fish [accessed 9 June 2022].
- 61.ATSDR (Agency for Toxic Substances and Disease Registry). 2014. Interaction Profiles for Toxic Substances. https://www.atsdr.cdc.gov/interactionprofiles/index.html [accessed 10 June 2022].
- 62.Schnell P, Papadogeorgou G. 2019. Mitigating unobserved spatial confounding when estimating the effect of supermarket access on cardiovascular disease deaths. arXiv. Preprint posted online July 28, 2019, 10.48550/arXiv.1907.12150. [DOI] [Google Scholar]
- 63.U.S. EPA (U.S. Environmental Protection Agency). 2021. Population Surrounding 1,866 Superfund Sites. https://www.epa.gov/superfund/population-surrounding-1866-superfund-sites [accessed 14 July 2022].
- 64.Yang J, Carmichael SL, Canfield M, Song J, Shaw GM, National Birth Defects Prevention Study. 2008. Socioeconomic status in relation to selected birth defects in a large multicentered US case–control study. Am J Epidemiol 167(2):145–154, PMID: , 10.1093/aje/kwm283. [DOI] [PubMed] [Google Scholar]
- 65.Weisskopf MG, Webster TF. 2017. Trade-offs of personal versus more proxy exposure measures in environmental epidemiology. Epidemiology 28(5):635–643, PMID: , 10.1097/EDE.0000000000000686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Greenland S, Pearl J, Robins JM. 1999. Causal diagrams for epidemiologic research. Epidemiology 10(1):37–48, PMID: . [PubMed] [Google Scholar]
- 67.Leung M, Kioumourtzoglou MA, Raz R, Weisskopf MG. 2021. Bias due to selection on live births in studies of environmental exposures during pregnancy: a simulation study. Environ Health Perspect 129(4):047001, PMID: , 10.1289/EHP7961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Weuve J, Tchetgen Tchetgen EJ, Glymour MM, Beck TL, Aggarwal NT, Wilson RS, et al. 2012. Accounting for bias due to selective attrition: the example of smoking and cognitive decline. Epidemiology 23(1):119–128, PMID: , 10.1097/EDE.0b013e318230e861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Chaix B, Evans D, Merlo J, Suzuki E. 2012. Commentary: weighing up the dead and missing: reflections on inverse-probability weighting and principal stratification to address truncation by death. Epidemiology 23(1):129–131, PMID: , 10.1097/EDE.0b013e3182319159. [DOI] [PubMed] [Google Scholar]
- 70.Skröder H, Kippler M, Nermell B, Tofail F, Levi M, Rahman SM, et al. 2017. Major limitations in using element concentrations in hair as biomarkers of exposure to toxic and essential trace elements in children. Environ Health Perspect 125(6):067021, PMID: , 10.1289/EHP1239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Rodrigues EG, Kile M, Dobson C, Amarasiriwardena C, Quamruzzaman Q, Rahman M, et al. 2015. Maternal–infant biomarkers of prenatal exposure to arsenic and manganese. J Expo Sci Environ Epidemiol 25(6):639–648, PMID: , 10.1038/jes.2015.45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Gutiérrez-González E, García-Esquinas E, de Larrea-Baz NF, Salcedo-Bellido I, Navas-Acien A, Lope V, et al. 2019. Toenails as biomarker of exposure to essential trace metals: a review. Environ Res 179(pt A):108787, PMID: , 10.1016/j.envres.2019.108787. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Curtin P, Austin C, Curtin A, Gennings C, Arora M, Tammimies K, et al. (for the Emergent Dynamical Systems Group). 2018. Dynamical features in fetal and postnatal zinc-copper metabolic cycles predict the emergence of autism spectrum disorder. Sci Adv 4(5):eaat1293, PMID: , 10.1126/sciadv.aat1293. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Andra SS, Austin C, Arora M. 2016. The tooth exposome in children’s health research. Curr Opin Pediatr 28(2):221–227, PMID: , 10.1097/MOP.0000000000000327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Lagerkvist BI, Sandberg S, Frech W, Jin T, Nordberg GF. 1996. Is placenta a good indicator of cadmium and lead exposure? Arch Environ Health 51(5):389–394, PMID: , 10.1080/00039896.1996.9934427. [DOI] [PubMed] [Google Scholar]
- 76.Amaya E, Gil F, Freire C, Olmedo P, Fernández-Rodríguez M, Fernández MF, et al. 2013. Placental concentrations of heavy metals in a mother–child cohort. Environ Res 120:63–70, PMID: , 10.1016/j.envres.2012.09.009. [DOI] [PubMed] [Google Scholar]
- 77.Honein MA, Kirby RS, Meyer RE, Xing J, Skerrette NI, Yuskiv N, et al. 2009. The association between major birth defects and preterm birth. Matern Child Health J 13(2):164–175, PMID: , 10.1007/s10995-008-0348-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Mai CT, Isenburg J, Langlois PH, Alverson CJ, Gilboa SM, Rickard R, et al. 2015. Population-based birth defects data in the United States, 2008 to 2012: presentation of state-specific data and descriptive brief on variability of prevalence. Birth Defects Res A Clin Mol Teratol 103(11):972–993, PMID: , 10.1002/bdra.23461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Tikanoja T. 1995. Effect of technical development on the apparent incidence of congenital heart disease. Pediatr Cardiol 16(2):100–101, PMID: , 10.1007/BF00796830. [DOI] [PubMed] [Google Scholar]
- 80.Martin GR, Perry LW, Ferencz C. 1989. Increased prevalence of ventricular septal defect: epidemic or improved diagnosis. Pediatrics 83(2):200–203, PMID: , 10.1542/peds.83.2.200. [DOI] [PubMed] [Google Scholar]
- 81.Langlois PH, Sheu SU, Scheuerle AE. 2010. A physician survey regarding diagnostic variability among birth defects. Am J Med Genet A 152A(6):1594–1598, PMID: , 10.1002/ajmg.a.33413. [DOI] [PubMed] [Google Scholar]
- 82.Langlois PH, Scheuerle A. 2007. Using registry data to suggest which birth defects may be more susceptible to artifactual clusters and trends. Birth Defects Res A Clin Mol Teratol 79(11):798–805, PMID: , 10.1002/bdra.20407. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

