Skip to main content
Environmental Epidemiology logoLink to Environmental Epidemiology
. 2022 Jan 28;6(1):e194. doi: 10.1097/EE9.0000000000000194

Prenatal exposure to metal mixtures and newborn neurobehavior in the Rhode Island Child Health Study

Pei Wen Tung a, Amber Burt a, Margaret Karagas b, Brian P Jackson c, Tracy Punshon d, Barry Lester e,f, Carmen J Marsit a,*
PMCID: PMC8835549  PMID: 35169672

Abstract

Background:

Prenatal exposure to metals can affect the developing fetus and negatively impact neurobehavior. The associations between individual metals and neurodevelopment have been examined, but little work has explored the potentially detrimental neurodevelopmental outcomes associated with the combined impact of coexisting metals. The objective of this study is to evaluate prenatal metal exposure mixtures in the placenta to elucidate the link between their combined effects on newborn neurobehavior.

Method:

This study included 192 infants with available placental metal and NICU Network Neurobehavioral Scale data at 24 hours–72 hours age. Eight essential and nonessential metals (cadmium, cobalt, copper, iron, manganese, molybdenum, selenium, zinc) detected in more than 80% of samples were tested for associations with atypical neurobehavior indicated by NICU Network Neurobehavioral Scale using logistic regression and in a quantile g-computation analysis to evaluate the joint association between placental metal mixture and neurobehavioral profiles.

Results:

Individually, a doubling of placental cadmium concentrations was associated with an increased likelihood of being in the atypical neurobehavioral profile (OR = 2.39; 95% CI = 1.05 to 5.71). In the mixture analysis, joint effects of a quartile increase in exposure to all metals was associated with 3-fold increased odds of newborns being assigned to the atypical profile (OR = 3.23; 95% CI = 0.92 to 11.36), with cadmium having the largest weight in the mixture effect.

Conclusions:

Prenatal exposure to relatively low levels of a mixture of placental metals was associated with adverse newborn neurobehavior. Examining prenatal metal exposures as a mixture is important for understanding the harmful effects of concomitant exposures in the vulnerable populations.

Keywords: Metals, Mixtures, Cadmium, Placenta, NNNS, Neurodevelopment


What this study adds

In this study, we utilize placenta as a biomarker for prenatal metal exposure and evaluate whether metal mixture is linked to newborn neurobehavioral performance assessed using the NNNS. This approach and topic make this manuscript of interest to the audience of Environmental Epidemiology, and this manuscript represents the first to link an examination of a mixture of metal exposure and early life measures of neurobehavioral development. Findings from this study may shed insight on developing useful policies to mitigate and prevent exposures as well as identify infants at risk to allow for appropriate and early intervention.

Introduction

Understanding the health impacts of metal exposure during the sensitive developmental periods in utero and early in life is imperative; neurodevelopmental processes are underway, and both fetuses and newborns are sensitive to even very subtle exposures to potentially toxic metals. The placenta is a crucial organ throughout pregnancy considering its roles of transporting water, gases and nutrients between mother and fetus, regulating the progression of pregnancy, metabolism of endogenous and exogenous factors.1 Some studies have also documented that the placenta plays an important role in neurodevelopment, as the variety of neurotransmitters produced by the placenta throughout pregnancy stimulate normal fetal brain development.2,3 Therefore, the placenta’s part in the associations between prenatal exposure to metals and subsequent developmental outcomes in newborns has garnered attention.

Prevalent exposure to nonessential metals such as cadmium (Cd) and lead (Pb) is concerning as the population is commonly exposed to them through sources such as dietary intake or smoking.46 Cd exposure has been frequently linked to kidney functions, and emerging evidence has shown that Cd toxicity leads to cognitive deficits in children.4,7,8 Lead (Pb) is a well-established neurodevelopmental toxicant that can result in neurodevelopmental deficits even at very low levels.9,10 Arsenic (As) and mercury (Hg) are also neurotoxicants known for their negative effects on early development.1115 On the other hand, exposure to essential trace elements or nutrients such as manganese (Mn) and copper (Cu) can also raise concerns. Essential trace nutrients are involved in numerous biological and developmental processes and the human body requires them to function properly, yet abnormal levels of such elements have been linked to adverse health outcomes in children. For instance, studies have established respiratory and neurological effects upon Mn exposure, and Mn toxicity has been linked to impaired neurodevelopment in children.5,7,8,16,17 Lower Cu levels were found in children with attention deficit/hyperactivity disorder when compared with children in the control group.18

An abundance of evidence on the impacts of exposure to individual metal on neurodevelopment have provided valuable insights on the importance of regulating metal exposures and protecting vulnerable populations from life-long developmental consequences. With the variety, ubiquity, and persistence of metals in our environment, it is plausible that multiple metals act concurrently, and pose threats to normal development. Metals could share common pathways to disrupt development, such as the generation of reactive oxygen species that lead to oxidative stress, effects on enzyme activities, or impacts to immunological functions, thus even at very low levels, simultaneous exposure to multiple metals can be especially detrimental.16,1921 However, the exact mechanisms of metals’ joint effect on neurodevelopment is unclear and the potential additive or protective effects of metals have yet to be thoroughly examined.22

Previous epidemiologic studies usually address metal exposure and neurodevelopment using single-metal models or, at most, binary combination of metals, although these traditional approaches can be biased by the limited number of metals evaluated in an analysis. More importantly, as the population may never actually be exposed to only one metal at any given time, it is necessary to investigate multiple metals in one setting to better grasp the magnitude of neurodevelopmental effects upon exposure to coexisting metals. Our study objective is to examine placental metals as a mixture using a recently developed method, quantile g-computation, and evaluate the potential impact of the metal mixture on newborn neurobehavior performance indicated through NICU Network Neurobehavioral Scale (NNNS) latent profiles in the Rhode Island Child Health Study (RICHS) population. We hypothesize that a mixture of both essential and nonessential placental metals can impact neurobehavioral performance of an infant with nonessential elements most strongly contributing to poor performance.

Methods

Study population

Mother-infant pairs in the RICHS study population were recruited from the Women and Infants Hospital of Rhode Island (N = 840). Briefly, the objective and design of the RICHS cohort was to understand aberrant fetal growth, thus the study population was oversampled for term infants born large for gestational age (≥90th birth weight percentile) and small for gestational age (≤10th birth weight percentile) based on the Fenton growth chart.23 Adequate for gestational age infants were matched to large for gestational age and small for gestational age infants on sex, maternal age (±2 years), and gestational age (±3 days). The study included mothers who were at least 18 years of age and did not have life-threatening medical complications. Eligible infants were born free of life-threatening medical complications or congenital or chromosomal abnormalities. Obstetric medical information was obtained from a structured medical chart review, and demographic, lifestyle, and exposure histories were collected from interviewer-based questionnaires. All participants provided written informed consent approved by the Institutional Review Boards at the Women and Infants Hospital and Emory University. For this study, a series of 192 consecutive participants recruited in 2010–2011 with samples collected specifically for placental metals assessment were included.

Metals assessment

Placenta parenchyma tissue was biopsied approximately 2 cm from the cord insertion site and free of maternal decidua within 2 hours of delivery. Samples were snap frozen in liquid nitrogen and stored at -80°C until processed. Laboratory methods of assessing placental metal concentrations have been described previously.24 Placental levels of 24 trace elements (aluminum [Al], arsenic [As], calcium [Ca], cadmium [Cd], cobalt [Co], chromium [Cr], copper [Cu], iron [Fe], mercury [Hg], potassium [K], magnesium [Mg], manganese [Mn], molybdenum [Mo], sodium [Na], nickel [Ni], phosphorus [P], lead [Pb], sulfur [S], antimony [Sb], selenium [Se], tin [Sn], uranium [U], vanadium [V], zinc [Zn]) were quantified in 192 samples using standardized ICP-MS protocols at the Dartmouth Trace Elements Analysis laboratory. Of this panel of metals, 14 were detectable in more than 80% of the samples (Table S1; http://links.lww.com/EE/A175). The current study focused on the prenatal exposure to a mixture of potentially toxic metals and micronutrients, and eight metals were included in the following mixture analyses (Cd, Co, Cu, Fe, Mn, Mo, Se, Zn). A small number of samples showed values below the limit of detection (LOD) for three metals, Cd (9.4%), Co (12.5%), and Mo (2.6%), and these values were substituted with LOD/·. The LOD for placental Cd, Co, and Mo were 2.12 ng/g, 2.12 ng/g, and 4.24 ng/g, respectively.

Neurobehavior assessment

NNNS is an assessment initially designed to examine a variety of neurobehavioral performances in drug-exposed and high-risk infants.25,26 A standardized and comprehensive examination of both behavioral and neurologic functioning, NNNS was commonly used for at risk and preterm infants, and later extended its application to low-risk and term infants in the general population.27,28 Researchers have also established the predictive characteristics of NNNS for developmental outcomes later in life. In a generally healthy, low-risk population like ours, Sucharew et al found that NNNS profiles were associated with early neurodevelopmental outcomes indicated through lower motor performance.28 In the maternal lifestyle study, infants from the profile with the least optimal NNNS scores showed several adverse developmental and behavioral outcomes, including lower MDI scores at ages 1 and 2, more behavioral problems assessed through the Child Behavior Checklist at age 3, and lower IQ at 4.5 years of age.29

In the RICHS study population, NNNS was administered by certified psychometrists in 625 newborns (74%) after 24 hours of birth and before discharge.30 We utilized latent profile analysis (LPA) to further categorize the study population into mutually exclusive neurobehavior profiles.29,31 Based on the NNNS score patterns, profiles produced through the LPA method had minimized heterogeneity within a profile and maximized heterogeneity across different profiles. There are 13 summary scales in NNNS, but the habituation construct was not assessed for 54.9% of the newborns in RICHS as they would need to be in the required sleep state for assessment, so the LPA method included the remaining 12 summary scores from NNNS and generated five discrete profiles for the RICHS newborns. Figure S1 (http://links.lww.com/EE/A175) shows the NNNS summary score patterns and descriptions for the five profiles in the RICHS study population. Newborns categorized into profile 5 demonstrated the most atypical neurobehavior, as the summary scale patterns showed more extreme neurobehavioral performances, such as highest excitability, arousal, hypertonicity, and stress signs, along with exhibiting lowest regulation and quality of movement compared with the other profiles.31

Covariates

Based on previous RICHS studies and literature review, covariates considered for analyses include infant sex, maternal age, maternal race, prepregnancy body mass index (BMI), educational status, and smoking status during pregnancy. Infant sex was obtained from medical records. Maternal age and prepregnancy BMI were considered as continuous variables. Self-reported maternal race information was dichotomized into White or other, given the small number of individuals in any of the non-White race/ethnicity groups. Highest educational attainment was also self-reported and was recoded into two groups, more than high school or high school or less. We also conducted sensitivity analysis to test whether regression results were robust when smoking status during pregnancy was included. Women reported their smoking status during pregnancy and were defined as smoked at any point during pregnancy or no smoking during pregnancy.

Statistical analysis

Descriptive information on demographic and gestational characteristics were compared between the subcohort with available placental metal data (N = 192) and those without (N = 433) using chi-square tests and t-tests. For the eight metals included in the mixture, the mean, standard deviation, minimum and maximum values, and quartile ranges were assessed.

As described in our previous work, and similar to other research groups, we utilized LPA to generate NNNS profiles with model fit criteria used to determine the ultimate number of profiles.29,32 Based on these criteria, the 5-profile model showed the best fit.

The association between individual metals and NNNS profiles were assessed with multivariable logistic regression models, controlled for covariates previously mentioned. Based on descriptive analyses and histograms, metals were log2-transformed for normal distribution in the single-metal models. NNNS profiles were further dichotomized into two groups, profile 5 versus all the other profiles. Based on the score patterns (Figure S1; http://links.lww.com/EE/A175), profile 5 showed most of the extreme NNNS summary scores, thus newborns categorized in this profile were considered as having the most atypical neurobehavioral performance in the RICHS study population.31

As concurrent exposure to metals is likely the norm in the study population, we aimed to further evaluate potential impact of metals as a mixture on newborn neurobehavior. Therefore, the quantile g-computation approach was used to understand the joint association between metal mixture and NNNS profile assignment (atypical profile 5 vs. all other profiles) in this study. Previously described in detail in Keil et al,33 quantile g-computation is based on the concept of generalized linear model to estimate the impact on the outcome when simultaneously increasing all exposures in the mixture by one quantile. Adapted from weighted quantile sum regression (WQS), one of the main differences is the assumption of directional homogeneity.34 Unlike WQS, quantile g-computation does not require directional homogeneity, and different exposures within the mixture may contribute oppositely (positively or negatively) to the mixture’s impact on the outcome.33 With this approach, exposures will first be categorized into quartiles, and then fitted into regression models. Each exposure will be given a positive or negative weight, and weights from all components of the mixture will sum to 1. In the event that directional homogeneity does not apply, both positive and negative weights will sum to 1, and an individual exposure’s weight can then be interpreted as the proportion of the positive (or negative) partial effect on the outcome due to the specific component of the mixture.35 For this study, we report the conditional odds ratio, and also estimate the joint effect of metal mixture on neurobehavior profile assignment with the inclusion of previously mentioned covariates through adjusted quantile g-computation models.

LPA analysis for NNNS profile membership was performed with Mplus version 8.4. All other statistical analyses were conducted using R version 3.5.1.

Results

Demographic and gestational characteristics are shown in Table 1. Among 192 newborns with available NNNS assessment scores and placental metal data in the RICHS cohort, 91 (47.4%) were female and 73.4% of the mothers were White, with 75.5% reported obtaining some posthigh school education. Average gestational age in the subcohort was 39.31 weeks, and the average maternal age was 29.79 years old. Demographic characteristics were similar between the included participants and those without available placental metal information (N = 433), although newborns included in this study were heavier averaging 3,644 grams.

TABLE 1.

Demographic and Gestational Characteristics

Characteristic Newborns With NNNS and Placental Metal Data (N = 192) Newborns With NNNS and Without Placental Metal Data (N = 433)
n (%)
 Infant gender
  Female 91 (47.4%) 230 (53.1%)
  Male 101 (52.6%) 203 (46.9%)
 Birth weight category
  SGA 29 (15.1%) 94 (21.7%)
  AGA 93 (48.4%) 263 (60.7%)
  LGA 70 (36.5%) 76 (17.6%)
 Maternal race
  White 141 (73.4%) 300 (69.3%)
  Other 47 (24.5%) 120 (27.7%)
  Unknown 4 (2.1%) 13 (3.0%)
 Infant race
  White 123 (64.1%) 285 (65.8%)
  Other 64 (33.3%) 137 (31.6%)
  Unknown 5 (2.6%) 11 (2.5%)
 Maternal education status
  No more than high school 47 (24.5%) 119 (27.5%)
  Some posthigh school* 145 (75.5%) 314 (72.5%)
 Maternal smoking status
  Yes 26 (13.5%) 63 (14.5%)
  No 165 (85.9%) 365 (84.3%)
  Unknown 1 (0.5%) 5 (1.2%)
Mean ± SD
Birth weight (g) 3,644 ± 680.37 3,404 ± 644.89
Gestational age (weeks) 39.31 ± 0.95 39.35 ± 0.97
Maternal age (years) 29.79 ± 5.63 29.34 ± 5.43
Maternal BMI (kg/m2) 27.48 ± 7.14 26.37 ± 6.87

*Posthigh school education included junior college, college or any post graduate schooling education.

Box plots for the eight metals (Cd, Co, Cu, Fe, Mn, Mo, Se, Zn) across five NNNS profiles are presented in Figure 1. Correlations between the metals are shown in Table S2 (http://links.lww.com/EE/A175), and the strongest correlation was between Mn and Se (r = 0.45).

Figure 1.

Figure 1.

Metal distribution by NNNS profiles. Levels of the eight placental metals (y axis) included in the mixture analysis are shown across NNNS profiles 1–5 (x axis) in the RICHS study population.

Apart from Cu and Se, in single-metal models, unadjusted logistic regression showed increased odds of belonging to the atypical profile 5 as placental metal level increases, although the confidence intervals included the null (Figure 2). In adjusted models, every doubling of placental Cd was associated with increased odds of the newborn belonging to the atypical profile 5 (OR = 2.39; 95% CI = 1.05 to 5.71). On the other hand, with every doubling of placental Cu, we observed decreased odds of newborns belonging to the atypical profile 5 (OR = 0.42; 95% CI = 0.05 to 2.23).

Figure 2.

Figure 2.

Associations between individual metals and neurobehavioral performance indicated through NNNS profiles. Log2-transformed levels of eight metals were individually assessed in logistic regression models. Odds ratio and 95% CI indicated the odds of newborns belonging to the atypical profile 5 with every doubling of placental metal concentration.

Quartile ranges of each metal are presented to provide additional information on the distribution of the metals included in the mixture used in the following quantile g-computation analyses (Table 2). In the g-computation mixtures analyses (Table 3), as all metals in the mixture increase by one quartile, we observed increased odds of newborns belonging to the atypical profile 5 (OR = 3.23; 95% CI = 0.92 to 11.36). This approach also demonstrated Cd as the driving factor for the overall positive association between increased levels of all metals as a mixture and atypical neurobehavior, as this metal was assigned the largest positive weight, with Zn, Mn, and Fe following with smaller positive weights. Alternatively, Cu showed the largest negative weight among the metals (Figure 3). The RICHS study population had a low percentage of women who smoked during pregnancy, resulting in a very limited number of smokers in each profile (among infants categorized into the atypical profile 5, only one mother reported smoking during pregnancy). Accordingly, smoking status during pregnancy was included in a sensitivity analysis, and results showed attenuated effects of the overall mixture effect on neurobehavior (OR = 2.14; 95% CI = 0.71 to 7.61).

TABLE 2.

Mean Levels and Quartile Ranges for Metals Included in the Mixture (ng/g)

Metal Mean Quartile 1 Quartile 2 Quartile 3 Quartile 4
Cd 4.56 1.06–2.80 >2.80–4.19 >4.19–5.38 >5.38–17.99
Co 3.65 1.18–2.56 >2.56–3.36 >3.36–4.32 >4.32–11.95
Cu 971.72 623.10–799.98 >799.98–878.90 >878.90–1,042.90 >1,042.90–2,643.50
Fe (µg/g) 84.93 33.67–65.49 >65.49 –81.05 >81.05–99.30 >99.30–194.03
Mn 95.40 42.34–73.66 >73.66–89.12 >89.12–115.91 >115.91–231.49
Mo 6.76 3.57–5.85 >5.85–6.58 >6.58–7.42 >7.42–13.04
Se 270.68 174.44–247.17 >247.17–271.79 >271.79–291.22 >291.22–384.91
Zn (µg/g) 10.11 5.94–8.98 >8.98–9.96 >9.96–10.92 >10.92–23.13

TABLE 3.

Quantile g-Computation Estimates (Odds Ratio and 95% CI) for Being Placed in the Atypical Profile 5 for a Quartile Increase in All Metals

Unadjusted Adjusted*
Mixture 2.47 (0.82, 7.40) 3.23 (0.92, 11.36)

*Adjusted for infant sex, maternal age, race, BMI, education status

†8 metals: Cd, Co, Cu, Fe, Mn, Mo, Se, Zn.

Figure 3.

Figure 3.

Weights for each metal in the quantile g-computation model. Weights represent the proportion of the positive or negative partial effect for each component (metal) in the mixture on newborn neurobehavior. Shadings of the bars correspond to the overall effect size—the darker colored bars are shown in the positive direction as the overall mixture effect is positive.

Discussion

Exposure to combinations of metals in our environment is inevitable, hence understanding the joint effects of coexisting metals is critical. Although studies have since elucidated metal-associated health effects in the general population, the potential impacts of multiple placental metals on newborn neurobehavioral performance remain unclear. Additionally, possible protective effects of some essential metals are even less studied. In this study, we observed simultaneously increased levels of eight placental metals as a mixture were associated with increased odds of impaired neurobehavior, which was indicated via. membership in an atypical NNNS profile. The “atypical” profile was characterized by infants showing the most signs of arousal, stress/abstinence, excitability, and hypertonicity, along with poorer regulation and quality of movement. With the quantile g-computational method, we further identified Cd as the primary metal associated with the “atypical” neurobehavior profile.

Placental levels of the eight metals included in our mixture analyses were generally comparable to what was reported in other study populations. In particular, Cd levels in RICHS would be amongst some of the lowest reported of ranges around the world (average: 4 ng/g), although it should be noted that the studies reported were from 1977 to 2011, and exhibit a decreasing trend over time.36 While the mean (4.56 ng/g) and interquartile range (IQR = 2.80–5.38 ng/g) of placental Cd measured in our study was relatively similar to that measured in the INMA Project (mean: 4.45 ng/g; IQR = 2.79–6.49 ng/g), RICHS Mn levels demonstrated a higher mean of 95.37 ng/g (SD = ±30.08) and wider range of levels (IQR = 73.66–115.91 ng/g) compared with the INMA Project (mean: 70 ng/g; IQR = 52.50–82.24 ng/g).37,38 RICHS placental Cu levels (mean: 0.97 µg/g) were comparable to another Spanish study (mean: 0.97 µg/g), although slightly higher than that measured in the New Hampshire Birth Cohort Study (mean: 0.88 µg/g).39,40

Common sources of Cd in the American population are dietary intake and tobacco smoke exposure.4,6 Our study population had a relatively low percentage of self-reported smoking during pregnancy, and we did not obtain dietary information throughout pregnancy from the participants, which represents a limitation of the study. Despite the relatively low concentrations of Cd and low-to-moderate correlations between Cd and other metals included in the mixture, we interpret our results with caution and note that Cd exposure, individually and concurrently with other metals, during the sensitive developmental period in utero may lead to adverse effects on neurobehavior.

In agreement with our single-metal findings, several previously published studies also found prenatal Cd exposure to be associated with adverse impacts on neurodevelopment later in life. A Japanese birth cohort study found that maternal blood Cd concentrations negatively affect the postural-motor area of neurodevelopment in 2-year-old boys.41 Cd measured in maternal urine was found to be inversely associated with cognitive score in the Spanish INMA Project and children’s IQ (verbal, performance, and full scale) measured in 5-year olds in rural Bangladesh.42,43 Cord blood Cd also negatively associate with performance IQ in children at 5 years of age in a South Korean study.44 However, there remains some inconsistencies in the association between prenatal Cd exposure and developmental or behavioral outcomes in newborns or young children across different study populations. The INMA Project did not find a significant association between placental Cd and general cognitive score in preschool children, and no association was observed between maternal blood Cd and behavioral outcomes in children between the ages of 1–8 years old in the HOME study.38,45 Aside from Cd, we observed potential adverse effects of Mn on neurobehavior, which is consistent with some prior studies.7,46 However, we also note the limitation in our assumption of linearity in the mixture analysis, which does not address a U-shaped association between Mn and behavioral outcomes reported in some prior work.47,48 Similarly, the potential adverse effect of iron on neurobehavior observed in our study is consistent with several reports, although the exact impact of iron dysregulation on behavioral outcomes warrants further investigation.4951

Difference seen across these studies could be attributable in part to difference in sample type used in exposure assessment. Some metals that readily pass the placental tissue (i.e., Pb and Mn) and would more likely be detected in the fetuses’ blood or other tissues, would not be well represented and thus there impact on neurobehavior will be missed in this analysis, while others, such as Cd may be more likely retained in the placenta where they can exert toxic effects.5254 Elements like Zn, Cu, Fe, and Se that are essential for fetal growth and development are tightly regulated but their trans-placental efficiency is less well understood. Researchers have identified metal-transporters that transport them across the placenta into the fetal system, and found the processes may be affected by competition of toxic metals like Cd.5559 Using the placenta as a biomarker has its challenges, yet the reflected exposure window and its ability of regulating passage of these elements throughout the gestational period could provide valuable insight on prenatal exposure characteristics.

With the myriad of metals present in the environment, it is challenging to capture all combinations of metals. Researchers have since focused on several trace metals, both toxic and nontoxic, that represent common exposures in the general population and/or are more well-known for their effects on human health. Kim et al suggested an interaction between blood Cd and Pb with findings of an inverse association with Pb for both mental development index (MDI) and psychomotor development index (PDI) scores among 6-month-old infants with above-median Cd levels.60 In the MOCEH study, researchers also explored the association between combined metal exposure (Cd, Hg, and Pb) and children’s neurodevelopment using the Bayley Scales of Infant Development. In a Bayesian kernel machine regression analysis, they found a joint effect from late pregnancy Pb and Hg exposures on MDI and PDI scores at 6 months.61 Using the same Bayesian kernel machine regression approach for mixtures, Valeri et al observed a negative effect on cognitive scores from joint exposure to As, Mn, and Pb.62 Alternatively, Kordas et al did not observe an association between metals (blood Pb, hair Cd, Mn, and As) and MDI or PDI scores in young children.63

Our observed overall mixture effect also highlighted Cu and Se to be inversely related to the risk of atypical neurodevelopment. Cu and Se are considered as essential for proper organ functioning and metabolic processes, although abnormal levels can be detrimental to health. Adequate Cu intake is crucial in forming red blood cells and maintaining normal immune functions.64 The main source of Cu in the general population is through diet, including vegetables, fruits, cereal, and nuts.65 Although very uncommon, Cu-associated toxicity can impair numerous biological processes. Studies over the decades have largely focused on Cu deficiency and the associated effects on brain activities, such as Menkes disease, of which infants are subject to developmental disability.64,66 It is also suggested that Cu-deficient infants are at risk to psychomotor impacts and hypotonia, among many other vessel, bone, and skin abnormalities.64,67 In relation to neuropsychological outcomes, however, there remain discrepancies on the epidemiologic association between prenatal Cu concentrations and neurodevelopment or behavior early in life. For instance, a study demonstrated maternal Cu level adversely impacting the Bayley Scales of Infant Development mental scale accessed at 12 months, although in a Polish study, no association was found between prenatal Cu exposure and psychomotor development at 1–2 years of age.68,69 In our single-metal analysis, Cu was the only metal with an OR < 1, indicating higher placental Cu level may lower odds of newborns belonging to the atypical NNNS profile. This association was likewise observed in our mixture analysis.

Se is generally regarded as a protective trace element to human health, with studies documenting positive effects on cognitive function and the cardiovascular and immune systems.7072 Se is also a crucial component of selenoproteins which oversee antioxidant defense mechanisms and protect the neuronal system.73,74 One of the proposed mechanisms of toxic metals eliciting adverse health impacts is by generating oxidative stress and targeting normal dopamine pathway functions.75,76 It is possible that as part of the metal mixture, Se could display antagonistic and antioxidant properties, which in turn mitigated neurodevelopmental defects resulted from coexposure to neurotoxic metals such as Cd and Mn.74,77 A Chinese study investigating two-way metal interactions found that higher Se levels may be protective toward Mn-induced toxic effects on neurodevelopment.78 However, further studies of placental metal mixtures that include Se as a component are needed.

By considering the real-life circumstances of concurrent exposures to multiple metals, evaluating metals as a mixture in the sensitive prenatal period indicated potential adverse impacts on newborn neurobehavior. A reasonable motivation in investigating prenatal metal exposure to metal mixtures was to reflect the reality of exposure patterns in the study population. The application of quantile g-computation enabled us to assess exposure mixture-response association, and this method also helps to identify the “bad actor” among the variety of metals present in the environment. With this information, future interventions can be designed to first target and eliminate exposure to the “bad actor” to effectively decrease negative impacts to newborn neurodevelopment. In addition, newborns that are most affected by exposures are identified early and appropriate medical follow-ups and interventions can be implemented to mitigate long term adverse developmental outcomes.

Quantiling of exposure levels when generating quantile g-computation results makes this method insensitive to exposure outliers and in turn reduces outliers’ influences on model coefficients. Another advantage of this analysis method was that we were able to assess both directions of associations of metal exposures and neurobehavior. Metals like Cd are toxic and nonessential, while others such as Cu and Se, are essential to normal biological functions, and so the quantile g-computation served as an informative approach to addressing this question. A limitation, although, is the assumption of linearity. Larger studies which can assess a broader range of exposures would be needed to better examine nonlinear associations between metals and these outcomes.

Among the 24 metals accessed in the RICHS placenta samples, only 14 metals were detectable in more than 80% of the samples. Several simultaneously occurring toxic trace elements that were well-known to impact neurodevelopment, such as As, Pb, and Hg, were excluded due to high percentages of <LOD. Another factor that may have affected the evaluation of placental metal mixture-neurobehavior association in our study is the relatively low to modest level for all eight metals in the RICHS study population. Although the subcohort with available placental metal data is representative to the full RICHS cohort, the small sample size may also affect the precision of model estimates. Coupled with our generally healthy, thus smaller proportion of atypical neurobehavior newborns, it is likely that we lack sufficient power to robustly detect an association between metal mixture and NNNS profiles. Therefore, it is also important for future research to include larger sample sizes, especially if the inherent metal exposure levels are low in the targeted population, to establish any potential neurodevelopmental impacts upon concurrent metal exposures.

Conclusions

In summary, we observed a significant association between placental Cd levels and atypical neurobehavior. As multiple placental metals were jointly investigated as a mixture, we also found the overall mixture effect to demonstrate an increased odds of newborns being assigned to the atypical NNNS profile, with Cd regarded as the driving factor of the mixture’s adverse effect on neurobehavioral performance. Investigating prenatal metal exposure as a mixture provided additional insight on the adverse neurobehavior effects elicited from combined metal exposure. Future analyses are warranted to provide and verify more robust associations between concomitant metal exposures and newborn neurobehavioral outcomes that may have persistent effects later in life.

Supplementary Material

ee9-6-e194-s001.pdf (114.2KB, pdf)

Footnotes

Published online 28 January 2022

The authors declare that they have no conflicts of interest with regard to the content of this report.

This work was supported by the National Institutes of Health [NIH-NIEHS R24 ES028507, NIH-NIEHS P30 ES019776, NIH-NIGMS P20 GM104416, and NIH-NIEHS P01 ES022832] and the US Environmental Protection Agency [US EPA grant RD83544201]. Its contents are solely the responsibility of the grantee and do not necessarily represent the official views of the US EPA. Further, the US EPA does not endorse the purchase of any commercial products or services mentioned in the presentation.

Data used in this analysis may be available in deidentified format through the RICHS dataverse.

Supplemental digital content is available through direct URL citations in the HTML and PDF versions of this article (www.environepidem.com).

References

  • 1.Nugent BM, Bale TL. The omniscient placenta: metabolic and epigenetic regulation of fetal programming. Front Neuroendocrinol. 2015;39:28–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Rosenfeld CS. The placenta-brain-axis. J Neurosci Res. 2021;99:271–283. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Zeltser LM, Leibel RL. Roles of the placenta in fetal brain development. Proc Natl Acad Sci USA. 2011;108:15667–15668. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Agency for Toxic Substances and Disease Registry (ATSDR). Toxic Substances Portal: Toxicology profile for Cadmium. 2012. Available at: https://www.atsdr.cdc.gov/ToxProfiles/tp5.pdf. Accessed 6 April 2021. [PubMed]
  • 5.Agency for Toxic Substances and Disease Registry (ATSDR). Toxic Substances Portal: Toxicology profile for Manganese. 2012. Available at: https://www.atsdr.cdc.gov/ToxProfiles/tp151.pdf. Accessed 6 April 2021. [PubMed]
  • 6.Kim K, Melough MM, Vance TM, Noh H, Koo SI, Chun OK. Dietary cadmium intake and sources in the US. Nutrients. 2019;11:2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Rodríguez-Barranco M, Lacasaña M, Aguilar-Garduño C, et al. Association of arsenic, cadmium and manganese exposure with neurodevelopment and behavioural disorders in children: a systematic review and meta-analysis. Sci Total Environ. 2013;454-455:562–577. [DOI] [PubMed] [Google Scholar]
  • 8.Sanders AP, Claus Henn B, Wright RO. Perinatal and childhood exposure to cadmium, manganese, and metal mixtures and effects on cognition and behavior: a review of recent literature. Curr Environ Health Rep. 2015;2:284–294. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Bellinger DC. Very low lead exposures and children’s neurodevelopment. Curr Opin Pediatr. 2008;20:172–177. [DOI] [PubMed] [Google Scholar]
  • 10.Agency for Toxic Substances and Disease Registry (ATSDR). Toxic Substances Portal: Toxicology profile for Lead. 2020. Available at: https://www.atsdr.cdc.gov/ToxProfiles/tp13.pdf. Accessed 6 April 2021.
  • 11.Rodrigues EG, Bellinger DC, Valeri L, et al. Neurodevelopmental outcomes among 2- to 3-year-old children in Bangladesh with elevated blood lead and exposure to arsenic and manganese in drinking water. Environ Health. 2016;15:44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Tolins M, Ruchirawat M, Landrigan P. The developmental neurotoxicity of arsenic: cognitive and behavioral consequences of early life exposure. Ann Glob Health. 2014;80:303–314. [DOI] [PubMed] [Google Scholar]
  • 13.Kim Y, Ha EH, Park H, et al. Prenatal mercury exposure, fish intake and neurocognitive development during first three years of life: Prospective cohort mothers and Children’s environmental health (MOCEH) study. Sci Total Environ. 2018;615:1192–1198. [DOI] [PubMed] [Google Scholar]
  • 14.Gao Y, Yan CH, Tian Y, et al. Prenatal exposure to mercury and neurobehavioral development of neonates in Zhoushan City, China. Environ Res. 2007;105:390–399. [DOI] [PubMed] [Google Scholar]
  • 15.Llop S, Guxens M, Murcia M, et al.; INMA Project. Prenatal exposure to mercury and infant neurodevelopment in a multicenter cohort in Spain: study of potential modifiers. Am J Epidemiol. 2012;175:451–465. [DOI] [PubMed] [Google Scholar]
  • 16.Horning KJ, Caito SW, Tipps KG, Bowman AB, Aschner M. Manganese is essential for neuronal health. Annu Rev Nutr. 2015;35:71–108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Yu XD, Zhang J, Yan CH, Shen XM. Prenatal exposure to manganese at environment relevant level and neonatal neurobehavioral development. Environ Res. 2014;133:232–238. [DOI] [PubMed] [Google Scholar]
  • 18.Kiddie JY, Weiss MD, Kitts DD, Levy-Milne R, Wasdell MB. Nutritional status of children with attention deficit hyperactivity disorder: a pilot study. Int J Pediatr. 2010;2010:767318. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.de Burbure C, Buchet JP, Leroyer A, et al. Renal and neurologic effects of cadmium, lead, mercury, and arsenic in children: evidence of early effects and multiple interactions at environmental exposure levels. Environ Health Perspect. 2006;114:584–590. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Farina M, Aschner M, Rocha JB. Oxidative stress in MeHg-induced neurotoxicity. Toxicol Appl Pharmacol. 2011;256:405–417. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Chen P, Miah MR, Aschner M. Metals and neurodegeneration. F1000Res. 2016;5:F1000 Faculty Rev–F1000 Faculty 366. [Google Scholar]
  • 22.Claus Henn B, Coull BA, Wright RO. Chemical mixtures and children’s health. Curr Opin Pediatr. 2014;26:223–229. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Fenton TR. A new growth chart for preterm babies: Babson and Benda’s chart updated with recent data and a new format. BMC Pediatr. 2003;3:13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Punshon T, Li Z, Marsit CJ, Jackson BP, Baker ER, Karagas MR. Placental metal concentrations in relation to Maternal and Infant Toenails in a U.S. Cohort. Environ Sci Technol. 2016;50:1587–1594. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lester BM, Tronick EZ. History and description of the Neonatal Intensive Care Unit Network Neurobehavioral Scale. Pediatrics. 2004;113(3 Pt 2):634–640. [PubMed] [Google Scholar]
  • 26.Lester BM, Tronick EZ, Brazelton TB. The neonatal Intensive Care Unit Network Neurobehavioral Scale procedures. Pediatrics. 2004;113(3 Pt 2):641–667. [PubMed] [Google Scholar]
  • 27.Fink NS, Tronick E, Olson K, Lester B. Healthy newborns’ neurobehavior: norms and relations to medical and demographic factors. J Pediatr. 2012;161:1073–1079. [DOI] [PubMed] [Google Scholar]
  • 28.Sucharew H, Khoury JC, Xu Y, Succop P, Yolton K. NICU Network Neurobehavioral Scale profiles predict developmental outcomes in a low-risk sample. Paediatr Perinat Epidemiol. 2012;26:344–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Liu J, Bann C, Lester B, et al. Neonatal neurobehavior predicts medical and behavioral outcome. Pediatrics. 2010;125:e90–e98. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Appleton AA, Murphy MA, Koestler DC, et al. Prenatal programming of Infant Neurobehaviour in a Healthy population. Paediatr Perinat Epidemiol. 2016;30:367–375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Tung PW, Burt A, Karagas M, et al. Association between placental toxic metal exposure and NICU Network Neurobehavioral Scales (NNNS) profiles in the Rhode Island Child Health Study (RICHS). Environ Res. 2022;204(Pt A):111939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Berlin KS, Williams NA, Parra GR. An introduction to latent variable mixture modeling (part 1): overview and cross-sectional latent class and latent profile analyses. J Pediatr Psychol. 2014;39:174–187. [DOI] [PubMed] [Google Scholar]
  • 33.Keil AP, Buckley JP, O’Brien KM, Ferguson KK, Zhao S, White AJ. A quantile-based g-computation approach to addressing the effects of exposure mixtures. Environ Health Perspect. 2020;128:47004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Carrico C, Gennings C, Wheeler DC, Factor-Litvak P. Characterization of weighted quantile sum regression for highly correlated data in a risk analysis setting. J Agric Biol Environ Stat. 2015;20:100–120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Niehoff NM, Keil AP, O’Brien KM, et al. Metals and trace elements in relation to body mass index in a prospective study of US women. Environ Res. 2020;184:109396. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Esteban-Vasallo MD, Aragonés N, Pollan M, López-Abente G, Perez-Gomez B. Mercury, cadmium, and lead levels in human placenta: a systematic review. Environ Health Perspect. 2012;120:1369–1377. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Freire C, Amaya E, Gil F, et al. ; INMA Project. Placental metal concentrations and birth outcomes: The Environment and Childhood (INMA) project. Int J Hyg Environ Health. 2019;222:468–478. [DOI] [PubMed] [Google Scholar]
  • 38.Freire C, Amaya E, Gil F, et al. ; INMA Project. Prenatal co-exposure to neurotoxic metals and neurodevelopment in preschool children: The Environment and Childhood (INMA) Project. Sci Total Environ. 2018;621:340–351. [DOI] [PubMed] [Google Scholar]
  • 39.Cerrillos L, Fernández R, Machado MJ, et al. Placental levels of metals and associated factors in urban and sub-urban areas of Seville (Spain). J Trace Elem Med Biol. 2019;54:21–26. [DOI] [PubMed] [Google Scholar]
  • 40.Kennedy E, Everson TM, Punshon T, et al. Copper associates with differential methylation in placentae from two US birth cohorts. Epigenetics. 2020;15:215–230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Ma C, Iwai-Shimada M, Nakayama SF, et al. ; Japan Environment Children’s Study Group. Association of prenatal exposure to cadmium with neurodevelopment in children at 2 years of age: The Japan Environment and Children’s Study. Environ Int. 2021;156:106762. [DOI] [PubMed] [Google Scholar]
  • 42.Forns J, Fort M, Casas M, et al. Exposure to metals during pregnancy and neuropsychological development at the age of 4 years. Neurotoxicology. 2014;40:16–22. [DOI] [PubMed] [Google Scholar]
  • 43.Kippler M, Tofail F, Hamadani JD, et al. Early-life cadmium exposure and child development in 5-year-old girls and boys: a cohort study in rural Bangladesh. Environ Health Perspect. 2012;120:1462–1468. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Jeong KS, Park H, Ha E, et al. Performance IQ in children is associated with blood cadmium concentration in early pregnancy. J Trace Elem Med Biol. 2015;30:107–111. [DOI] [PubMed] [Google Scholar]
  • 45.Yang W, Vuong AM, Xie C, et al. Maternal cadmium exposure and neurobehavior in children: The HOME study. Environ Res. 2020;186:109583. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Lin CC, Chen YC, Su FC, et al. In utero exposure to environmental lead and manganese and neurodevelopment at 2 years of age. Environ Res. 2013;123:52–57. [DOI] [PubMed] [Google Scholar]
  • 47.Claus Henn B, Ettinger AS, Schwartz J, et al. Early postnatal blood manganese levels and children’s neurodevelopment. Epidemiology. 2010;21:433–439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Bhang SY, Cho SC, Kim JW, et al. Relationship between blood manganese levels and children’s attention, cognition, behavior, and academic performance–a nationwide cross-sectional study. Environ Res. 2013;126:9–16. [DOI] [PubMed] [Google Scholar]
  • 49.Tamura T, Goldenberg RL, Hou J, et al. Cord serum ferritin concentrations and mental and psychomotor development of children at five years of age. J Pediatr. 2002;140:165–170. [DOI] [PubMed] [Google Scholar]
  • 50.Vaughn J, Brown J, Carter JP. The effects of maternal anemia on infant behavior. J Natl Med Assoc. 1986;78:963–968. [PMC free article] [PubMed] [Google Scholar]
  • 51.Iglesias L, Canals J, Arija V. Effects of prenatal iron status on child neurodevelopment and behavior: a systematic review. Crit Rev Food Sci Nutr. 2018;58:1604–1614. [DOI] [PubMed] [Google Scholar]
  • 52.Goyer RA. Transplacental transport of lead. Environ Health Perspect. 1990;89:101–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Gundacker C, Hengstschläger M. The role of the placenta in fetal exposure to heavy metals. Wien Med Wochenschr. 2012;162:201–206. [DOI] [PubMed] [Google Scholar]
  • 54.Wier PJ, Miller RK, Maulik D, DiSant’Agnese PA. Toxicity of cadmium in the perfused human placenta. Toxicol Appl Pharmacol. 1990;105:156–171. [DOI] [PubMed] [Google Scholar]
  • 55.McArdle HJ, Andersen HS, Jones H, Gambling L. Copper and iron transport across the placenta: regulation and interactions. J Neuroendocrinol. 2008;20:427–431. [DOI] [PubMed] [Google Scholar]
  • 56.Cao C, Fleming MD. The placenta: the forgotten essential organ of iron transport. Nutr Rev. 2016;74:421–431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Chen Z, Myers R, Wei T, et al. Placental transfer and concentrations of cadmium, mercury, lead, and selenium in mothers, newborns, and young children. J Expo Sci Environ Epidemiol. 2014;24:537–544. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Iyengar GV, Rapp A. Human placenta as a ‘dual’ biomarker for monitoring fetal and maternal environment with special reference to potentially toxic trace elements. Part 3: toxic trace elements in placenta and placenta as a biomarker for these elements. Sci Total Environ. 2001;280:221–238. [DOI] [PubMed] [Google Scholar]
  • 59.Zalups RK, Ahmad S. Molecular handling of cadmium in transporting epithelia. Toxicol Appl Pharmacol. 2003;186:163–188. [DOI] [PubMed] [Google Scholar]
  • 60.Kim Y, Ha EH, Park H, et al. Prenatal lead and cadmium co-exposure and infant neurodevelopment at 6 months of age: the Mothers and Children’s Environmental Health (MOCEH) study. Neurotoxicology. 2013;35:15–22. [DOI] [PubMed] [Google Scholar]
  • 61.Shah-Kulkarni S, Lee S, Jeong KS, et al. Prenatal exposure to mixtures of heavy metals and neurodevelopment in infants at 6 months. Environ Res. 2020;182:109122. [DOI] [PubMed] [Google Scholar]
  • 62.Valeri L, Mazumdar MM, Bobb JF, et al. The joint effect of prenatal exposure to metal mixtures on neurodevelopmental outcomes at 20-40 months of age: evidence from Rural Bangladesh. Environ Health Perspect. 2017;125:067015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Kordas K, Ardoino G, Coffman DL, et al. Patterns of exposure to multiple metals and associations with neurodevelopment of preschool children from Montevideo, Uruguay. J Environ Public Health. 2015;2015:493471. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Uriu-Adams JY, Scherr RE, Lanoue L, Keen CL. Influence of copper on early development: prenatal and postnatal considerations. Biofactors. 2010;36:136–152. [DOI] [PubMed] [Google Scholar]
  • 65.Prohaska JR. Copper. In: Present Knowledge in Nutrition. John Wiley & Sons, Ltd; 2012:540–553. [Google Scholar]
  • 66.Hordyjewska A, Popiołek Ł, Kocot J. The many “faces” of copper in medicine and treatment. Biometals. 2014;27:611–621. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Kaler SG. Inborn errors of copper metabolism. Handb Clin Neurol. 2013;113:1745–1754. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Amorós R, Murcia M, González L, et al. Maternal copper status and neuropsychological development in infants and preschool children. Int J Hyg Environ Health. 2019;222:503–512. [DOI] [PubMed] [Google Scholar]
  • 69.Polanska K, Hanke W, Krol A, et al. Micronutrients during pregnancy and child psychomotor development: opposite effects of Zinc and Selenium. Environ Res. 2017;158:583–589. [DOI] [PubMed] [Google Scholar]
  • 70.Agency for Toxic Substances and Disease Registry (ATSDR). Toxic Substances Portal: Toxicology profile for Selenium. 2003. Available at: https://www.atsdr.cdc.gov/ToxProfiles/tp92.pdf. Accessed 9 August 2021. [PubMed]
  • 71.Pieczyńska J, Grajeta H. The role of selenium in human conception and pregnancy. J Trace Elem Med Biol. 2015;29:31–38. [DOI] [PubMed] [Google Scholar]
  • 72.Skröder H, Kippler M, Tofail F, Vahter M. Early-life selenium status and cognitive function at 5 and 10 years of age in Bangladeshi Children. Environ Health Perspect. 2017;125:117003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Solovyev ND. Importance of selenium and selenoprotein for brain function: From antioxidant protection to neuronal signalling. J Inorg Biochem. 2015;153:1–12. [DOI] [PubMed] [Google Scholar]
  • 74.Schofield K. The Metal neurotoxins: an important role in current human neural epidemics? Int J Environ Res Public Health. 2017;14:E1511. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Domingo-Relloso A, Grau-Perez M, Galan-Chilet I, et al. Urinary metals and metal mixtures and oxidative stress biomarkers in an adult population from Spain: The Hortega Study. Environ Int. 2019;123:171–180. [DOI] [PubMed] [Google Scholar]
  • 76.Lee DH, Lim JS, Song K, Boo Y, Jacobs DR, Jr. Graded associations of blood lead and urinary cadmium concentrations with oxidative-stress-related markers in the U.S. population: results from the third National Health and Nutrition Examination Survey. Environ Health Perspect. 2006;114:350–354. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Kiełczykowska M, Kocot J, Paździor M, Musik I. Selenium - a fascinating antioxidant of protective properties. Adv Clin Exp Med. 2018;27:245–255. [DOI] [PubMed] [Google Scholar]
  • 78.Yang X, Bao Y, Fu H, Li L, Ren T, Yu X. Selenium protects neonates against neurotoxicity from prenatal exposure to manganese. PLoS One. 2014;9:e86611. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ee9-6-e194-s001.pdf (114.2KB, pdf)

Articles from Environmental Epidemiology are provided here courtesy of Wolters Kluwer Health

RESOURCES