Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Mar 1.
Published in final edited form as: Environ Res. 2021 Aug 27;204(Pt A):111939. doi: 10.1016/j.envres.2021.111939

Association between placental toxic metal exposure and NICU Network Neurobehavioral Scales (NNNS) profiles in the Rhode Island Child Health Study (RICHS)

Pei Wen Tung a, Amber Burt a, Margaret Karagas b, Brian P Jackson c, Tracy Punshon d, Barry Lester e,f, Carmen J Marsit a,*
PMCID: PMC8639656  NIHMSID: NIHMS1737345  PMID: 34461121

Abstract

Background –

Prenatal exposure to heavy metals has been linked to a variety of adverse outcomes in newborn health and later life. Toxic metals such as cadmium (Cd), manganese (Mn) and lead (Pb) have been implicated to negatively affect newborn neurobehavior. Placental levels of these metals may provide additional understandings on the link between prenatal toxic metal exposures and neurobehavioral performances in newborns.

Objective –

To evaluate associations between placental concentrations of toxic metals and newborn neurobehavioral performance indicated through the NICU Network Neurobehavioral Scales (NNNS) latent profiles.

Method –

In the Rhode Island Child Health Study cohort (n=625), newborn neurobehavioral performance was assessed with NNNS, and a latent profile analysis was used to define five discrete neurobehavioral profiles based on summary scales. Using multinomial logistic regression, we determined whether increased levels of placental toxic metals Cd, Mn and Pb associated with newborns assigned to the profile demonstrating atypical neurobehavioral performances.

Results –

Every doubling in placenta Cd concentration was associated with increased odds of newborns belonging to the atypical neurobehavior profile (OR: 2.72, 95% CI [1.09, 6.79]). Detectable placental Pb also demonstrated an increased odds of newborns assignment to the atypical profile (OR: 3.71, 95% CI [0.97, 13.96]) compared to being in the typical neurobehavioral profile.

Conclusions –

Toxic metals Cd and Pb measured in placental tissue may adversely impact newborn neurobehavior. Utilizing the placenta as a prenatal toxic metal exposure biomarker is useful in elucidating the associated impacts of toxic metals on newborn health.

Keywords: NNNS, neurobehavioral assessment, latent profile analysis, placenta, cadmium, lead

1. Introduction

Exposure to environmental contaminants is an important public health concern especially among children. Toxicants, such as heavy metals, are persistent in the environment from both natural and anthropogenic activities. The general population is often exposed, voluntarily and involuntarily, through ambient air, drinking water, dietary or industrial sources. Due to the ubiquity of heavy metals in the environment, exposure to these contaminants is often inevitable in the susceptible children’s population.

A growing body of evidence has documented heavy metals contributing to a wide variety of adverse outcomes including decreased fetal growth and length of gestation, low birth weight, and cognitive and behavioral deficits in children.15 As exposure to even low levels of toxic metals during critical developmental windows have been linked to detrimental neuropsychological outcomes, it is imperative that we investigate the underlying association between prenatal heavy metal exposure and neurobehavioral outcomes in newborns at the earliest time point, as earlier prevention and intervention strategies can be the most successful.68

Although much work on the mechanistic toxicology of toxic metals has focused, appropriately, on impacts to the developing brain, there is a growing body of literature suggesting an important role for the placenta and its functions in neurodevelopment.911 Besides its role in nutrient, waste, gas, and water transport, the placenta also produces a variety of neurotransmitters and acts to metabolize maternal hormones in support of healthy fetal brain development.12 These data also suggest that stressors that can impact fetal neurodevelopment may do so, at least in part, through impacts on the placenta.1315

Cadmium (Cd) is considered a toxic metal and has been widely studied for its adverse impacts on human health.16 Aside from the commonly known effects on kidney functions and attribution to various types of cancer, Cd exposure has also been linked to neurologic, developmental and cognitive impairments in the vulnerable children’s population.1,16,17 Cd is known to accumulate in the placenta, and that its pregnancy-related toxicity is due to impacts on the placenta including eliciting oxidative stress, interfering with the transfer of essential metals to the fetus and impairing the developmental progress of the fetus during the critical gestational period.1821 This would also suggest that utilizing the placenta as a biomarker when examining its health effects can provide important information.

Lead (Pb) is an extensively studied developmental toxicant and children are the targeted population of concern due both to higher exposure scenarios and the susceptibility of the developing brain to the exposure.2224 Even at relatively low levels, exposure can lead to detrimental effects on children’s development, thus suggesting that there may be no “safe” limit for Pb exposure.2527 Although Pb can be transferred through the placenta to fetal circulation, detected levels in placenta may indicate high in utero Pb exposure and result in detrimental effects to the developing fetus.28,29

Manganese (Mn) is an essential element and is commonly found in the environment.30 Aside from natural sources, dietary sources such as rice and whole grains contain the highest Mn levels.3032 However, Mn is additionally recognized as a toxicant with32,33 excessive Mn targeting the developing central nervous system (CNS) and contributing to neurological disorders.32,34 During pregnancy, Mn can accumulate in the placenta and through impacts to the placenta may elicit adverse effects on the developing CNS of the fetus.

Numerous studies have investigated the association between prenatal Cd, Pb or Mn exposure and neurobehavioral outcomes in young children. However, with different approaches of neurobehavioral assessments and varying biological matrices available for measuring prenatal heavy metal exposure, the exact relationship between metal exposure and neurobehavioral-related outcome remains uncertain. The placenta can serve as a useful biomarker for measuring prenatal exposure, and to our best knowledge, there are still research gaps in associating placental metal levels and neurobehavioral deficits.17 Therefore, our study goal is to quantify Cd, Mn and Pb levels in the placenta and examine the hypothesis that placental trace metal concentrations are related to atypical neurobehavioral performance identified at birth.

2. Methods

2.1. Study Population

The infants included in this analysis are from the Rhode Island Health Study (RICHS), a hospital-based birth cohort established at the Women and Infants Hospital in Providence, Rhode Island, USA. The RICHS cohort recruited mothers of term infants (≥ 37 weeks) oversampled for infants that were SGA (small for gestational age) and LGA (large for gestational age), while recruiting AGA (adequate for gestational age) infants matched on sex, gestational age (within 3 days), and maternal age (within 2 years) to those at the extremes. Exclusion criteria of RICHS included mothers younger than 18 years of age, pregnancies resulting in preterm birth (< 37 weeks), or infants born with congenital or chromosomal abnormalities. A total of 840 mother-infant pairs were enrolled into the study. Medical records were used to collect anthropometric and clinical data, including birth weight, gestational age, depression and anxiety/panic/obsessive compulsive disorder history. Interviewer-administered questionnaires were used to obtain information on sociodemographic, behavioral, and exposure histories.

2.2. NNNS Assessment

The NICU Network Neurobehavioral Scale (NNNS) is a standardized assessment aimed to comprehensively assess newborns’ neurologic integrity, behavioral functioning and signs of stress.35 The assessments results in 13 summary scores, including habituation, attention (orientation), arousal, self-regulation, handling, quality of movement, excitability, lethargy, non-optimal reflexes, asymmetry reflexes, hypertonicity, hypotonicity, and stress/abstinence.

In RICHS, NNNS was administered after the first 24 hours of life, and prior to discharge by certified psychometrists. Of the 840 enrolled infants in RICHS, 625 infants (74%) were assessed with NNNS (Fig. 1). For the habituation construct, as the newborn was required to be asleep for assessment, information was not collected for 54.9% of the infants.36 As a result, we only included the remaining 12 summary scores of NNNS for the statistical analyses.

Fig. 1.

Fig. 1.

Analysis strategy: 840 mother-infant pairs recruited in the RICHS study had available demographic information. Neurobehavioral performance was assessed via NNNS after 24 hours of birth for 625 infants (74%), and heavy metal levels were analyzed in 192 placenta samples.

2.3. Metal Assessment

Placental parenchyma tissue suitable for trace metals analysis was collected from 192 participants in RICHS within 2 hours of delivery (Fig. 1). Biopsies from approximately 1–2cm from the cord insertion site, free of maternal decidua, were excised, rinsed, and stored in trace element-free tubes until further examination. Placental concentrations of twenty-four metals, including Cd, Mn, and Pb were quantified at the Dartmouth Trace Elements Analysis Core using ICP-MS protocols as described in detail elsewhere.37 Briefly, after samples were transferred and brought to room temperature, HNO3/HCl (Optima) solution was added based on sample wet weight. Following EPA method 3050B, samples were then digested via microwave, and 0.25–0.35 ml of H2O2 was added to each sample tube. Quality control measures included the analysis of standard reference material (NIST 1566b, oyster tissue), initial and continuing calibration verification, and the use of fortified blanks, analytical duplicates and spikes. The detection limits (LOD) for placenta Cd, Mn and Pb were 2.12 ng/g, 10.61 ng/g and 2.12 ng/g, respectively.

2.4. Statistical Analysis

We compared demographic characteristic differences between the RICHS study population, and the subset of participants with both placental heavy metal and NNNS data with chi-square test and t-test.

Descriptive statistics for all NNNS summary scales were reported, with higher score on each scale indicating a higher level of the measured construct. Depending on the measured aspect of neurobehavior, higher scores may either indicate better or worrisome performance. For instance, newborns with higher scores in the attention scale were more alert and able to follow visual stimulations with eyes and head during assessment. Higher level of the quality of movement scale indicated predominantly smooth movements and little jerkiness or startles. On the contrary, newborns with high scores in the lethargy or stress/abstinence scales exhibited more signs of the measured construct, which are less optimal.

We used latent profile analysis (LPA) to understand the underlying NNNS summary score patterns in the RICHS study population. According to Liu et al., LPA assumes the study population consists of several subgroups that can be labeled as latent profiles or classes.38 The purpose of using LPA for the NNNS scores was to produce discrete profiles with minimized heterogeneity within a profile and maximized heterogeneity across different profiles. In order to obtain an optimal number of profiles based on the NNNS summary scores in the study population, we fitted multiple models with different number of profiles, and the model with the most appropriate fit statistics was chosen as the number of profiles for RICHS. Referring to information-criteria based fit statistics, the model with the lowest log-likelihood and Bayesian Information Criteria (BIC) values was preferred. Entropy value greater than 0.8 is ideal as this would indicate greater classification accuracy of the subjects. Additionally, profile size will also be taken into consideration, as the smallest profile should still include at least 5% of the study population.39

Heavy metal levels and NNNS summary scores were compared across profiles with ANOVA analyses. The association between placental heavy metal levels and newborn neurobehavioral performances indicated through profiles was assessed using multinomial logistic regression. Samples with Cd levels below the detection limit were assigned a value of LOD divided by the square root of 2. We applied log2-transformed Cd and Mn levels in the models for approximation to normal distribution, and for interpretation purposes. Alternatively, 51.6% samples were flagged as <LOD for Pb levels, so we then treated placental Pb as a binary variable (non-detect vs. detectable) in the regression models. Regression models were further adjusted for covariates collected from medical records and in-person questionnaires administered by interviewers and were a priori determined in reference to previous RICHS studies. Adjusted covariates included infant sex, maternal age, maternal race (white or not white), maternal body mass index, and educational attainment (dichotomized into obtained high school or less versus more than high school education). We also ran sensitivity analysis to test whether model results were robust when tobacco smoking status during pregnancy was included.

Statistical analyses were conducted using R version 3.5.1, and LPA analysis was performed with Mplus version 8.4.

3. Results

3.1. Study population

Demographic and gestational characteristics of the RICHS cohort are shown in Table 1. Of the 625 RICHS newborns with NNNS information, 51.4% were females and 57% were born under the adequate for gestational age (AGA) birth weight category. Maternal participants were predominantly white (70.6%) and had obtained at least some post high school education (73.4%). The subset of infants with both NNNS and placental heavy metal information (n=192) showed similar distribution for most of the demographic characteristics. 47.4% of the subset of infants were females, 73.4% mothers were white, and 75.5% had some post high school education. Average gestational age in the RICHS study population and subset were both around 39.3 weeks. Birth weight category distribution was significantly different between the full cohort and sub-cohort (p=0.001), and birth weight in the subset (mean=3644 g) was significantly higher than the entire study population (mean=3477 g; p=0.003).

Table 1.

Demographic and gestational characteristics.

Newborns with NNNS data (N=625) Newborns with NNNS and placental metal data (N=192)
n (%)
Infant Gender
 Female 321 (51.4%) 91 (47.4%)
 Male 304 (48.6%) 101 (52.6%)
Birth Weight Categorya
 SGA 123 (19.7%) 29 (15.1%)
 AGA 356 (57.0%) 93 (48.4%)
 LGA 146 (23.4%) 70 (36.5%)
Delivery Method
 Cesarean section 317 (50.7%) 110 (57.3%)
 Vaginal 308 (49.3%) 82 (42.7%)
Maternal Race
 White 441 (70.6%) 141 (73.4%)
 Other 167 (26.7%) 47 (24.5%)
 Unknown 17 (2.7%) 4 (2.1%)
Infant Race
 White 408 (65.3%) 123 (64.1%)
 Other 201 (32.2%) 64 (33.3%)
 Unknown 16 (2.6%) 5 (2.6%)
Maternal Education Status
 No more than high school 166 (26.6%) 47 (24.5%)
 Some post-high school 459 (73.4%) 145 (75.5%)
Maternal Smoking Status
 Yes 64 (10.2%) 26 (13.5%)
 No 555 (88.8%) 165 (85.9%)
 Unknown 6 (1.0%) 1 (0.5%)
Mean ± SD
Birth weight (grams) 3477 ± 664.75 3644 ± 680.37
Gestational age (weeks) 39.34 ± 0.96 39.31 ± 0.95
Maternal age (years) 29.48 ± 5.49 29.79 ± 5.63
Maternal BMI (kg/m2) 26.71 ± 6.96 27.48 ± 7.14
a

SGA: small for gestational weight; AGA: adequate for gestational weight; LGA: large for gestational weight

3.2. NNNS profiles

Descriptive statistics of the summary scales of NNNS are shown in Supplement Table 1 and were used to identify potential outliers. Extreme values were found for stress abstinence, non-optimal reflexes, and asymmetric reflexes scales, but no individuals in this study population were consistently outliers for all of the NNNS summary scales.

To determine the most appropriate number of profiles in this study population, we fit LPA models with 2 to 6 profiles. As the fitted profile numbers increased from 2 to 6 profiles, BIC values decreased (Supplement Table 2). Entropy values for all the models were all greater than 0.8, which was preferred, and showed better accuracy in classifying participants into different profiles. Additionally, profile size was used to determine the optimal number of profiles as it is recommended that the smallest profile should not be smaller than 5% of the study population. Despite having the lowest BIC value, one of the profiles generated from the 6-profile model consisted of only 29 participants (4.6%). Based on fit statistics, profile size, and average class probabilities, the 5-profile model showed the best fit for the RICHS cohort.

Fig. 2 demonstrated distinct NNNS patterns of the five profiles based on the standardized summary scores as the original scores were not on the same scale. Mean and standard deviation of the 12 summary scores by profiles are shown in Supplement Table 3. The largest profile (Profile 2) consisted of 172 (27.5%) participants, while the smallest profile (Profile 5) included 45 (7.3%) subjects. Compared to other profiles, Profile 5 infants showed the most extreme scores, indicating atypical neurobehavior compared to infants in other profiles. Infants in this profile were characterized with the highest arousal, excitability, hypertonicity and stress abstinence signs, and the lowest quality of movement, regulation and non-optimal reflexes. Profile 4 (N=124, 19.8%) infants showed more signs of lethargy, hypotonicity, non-optimal reflexes and asymmetric reflexes, and lowest attention and arousal. Compared to Profiles 4 and 5, Profile 3 infants (N=157, 25.1%) required more handling, but behaved on average for most of the summary scores. The largest group, Profile 2, showed relatively average performances for most of the summary scores with the exception of the lethargy scale, which was the lowest across all profiles. Infants in Profile 1 (N=127, 20.3%) showed the highest attention, quality of movement, and regulation, and lowest stress abstinence signs, along with less handling, excitability, and hypertonicity. Given the summary scale pattern indicating most scales around the mean, in the following regression models, Profile 2 served as the reference profile.

Fig. 2.

Fig. 2.

Five NNNS profiles (N=625). NNNS summary scale z-scores across all five latent profiles as indicated via LPA among all newborns in the RICHS study population. Profile 5 (black) demonstrates atypical neurobehavior and Profile 2 (green) represents typical neurobehavioral performance.

3.3. Placental heavy metal concentrations

The mean, standard deviation, minimum and maximum values of placental Cd, Mn and Pb are shown in Supplement Table 4. We further examined log2-transformed placental metals concentration and detectable placental Pb distribution by the five NNNS profiles (Fig. 3). Placental Cd and Mn did demonstrate an elevation in Profile 5, although the differences across profiles were not considered statistically significant. We also observed a greater proportion of detectable Pb amongst placenta from individuals classified in Profile 5.

Fig. 3.

Fig. 3.

Placental heavy metal concentration and distribution across five NNNS profiles. For placental Cd (A) and Mn (B), y-axis shows log2-transformed concentrations, while the x-axis demonstrates NNNS Profiles 1–5. For placental Pb (C), stacked bar plot represents the percentages of detectable and non-detectable distributions across the five NNNS profiles (x-axis) in the RICHS study population.

3.4. Association between heavy metal and profiles

In line with the bi-variate results, in the unadjusted multinomial logistic regression results (Table 2), detectable placental Pb also demonstrated an increased odds of newborns belonging to the atypical Profile 5 (OR: 3.12, 95% CI [0.89, 10.97]) with Profile 2 as the comparison group. In adjusted regression models, compared to belonging in Profile 2 with typical neurobehavior, there were increased odds of newborns being placed in the atypical neurobehavior Profile 5 with every doubling increase in placenta Cd level (OR: 2.72, 95% CI [1.09, 6.79]). Additionally, newborns with detectable placental Pb levels also demonstrated an increased odds of belonging to Profile 5 (OR: 3.71, 95% CI [0.97, 13.96]), although in all models the 95% CI are wide suggesting potentially unstable results. Alternatively, increased placenta Mn level was not associated with increased odds of newborns belonging to the atypical Profile 5 (OR: 1.16, 95% CI [0.28, 4.92]). As a sensitivity analysis, we fit models with maternal smoking status as a covariate (Table 2: Adjustedb), noting that the number of smokers in this population is small and the number of smokers within any profile was limited. These models indicated some attenuation of the effect size for the associations between placental Cd and Pb with Profile 5. In models examining membership in Profile 5 versus all other profiles (Supplement Table 5), we observed an association between detectable placental Pb levels and increased odds of atypical neurobehavioral performances in newborns (OR: 3.94, 95% CI [1.15, 13.46]), as well as increased odds for Profile 5 membership associated with increasing Cd concentrations (OR: 2.39, 95% CI [1.03, 5.52]).

Table 2.

Odds ratio (95% CI) from multinomial regression models (reference group: Profile 2).

Profile 1 Profile 3 Profile 4 Profile 5
Unadjusted
 log2 Cd 1.30 (0.74, 2.31) 0.95 (0.55, 1.64) 0.90 (0.51, 1.57) 1.70 (0.78, 3.66)
 log2 Mn 0.64 (0.24, 1.70) 0.97 (0.39, 2.45) 0.87 (0.34, 2.25) 2.38 (0.65, 8.63)
 detectable Pb 0.73 (0.31, 1.68) 0.91 (0.41, 2.03) 0.90 (0.39, 2.05) 3.12 (0.89, 10.97) *
Adjusteda
 log2 Cd 1.55 (0.82, 2.92) 1.02 (0.57, 1.84) 1.08 (0.59, 1.98) 2.72 (1.09, 6.79) **
 log2 Mn 0.57 (0.19, 1.66) 0.79 (0.29, 2.15) 0.92 (0.33, 2.58) 1.16 (0.28, 4.92)
 detectable Pb 0.93 (0.38, 2.29) 0.96 (0.41, 2.21) 0.88 (0.37, 2.09) 3.71 (0.97, 13.96) **
Adjustedb
 log2 Cd 1.57 (0.83, 2.99) 1.03 (0.57, 1.86) 1.11 (0.60, 2.03) 2.27 (0.90, 5.70) *
 log2 Mn 0.57 (0.20, 1.67) 0.80 (0.30, 2.16) 0.93 (0.33, 2.63) 1.05 (0.24, 4.61)
 detectable Pb 0.95 (0.38, 2.35) 0.97 (0.42, 2.25) 0.91 (0.38, 2.20) 3.42 (0.88, 13.32) *
a

Adjusted for infant gender, maternal age, maternal race, maternal BMI, education status

b

Adjusted for infant gender, maternal age, maternal race, maternal BMI, education status, smoking status during pregnancy

*

p<0.1;

**

p<0.05

4. Discussion

Our study explored placental concentrations of putative neurotoxic trace metals and neurobehavior assessed by NNNS profiles. By categorizing our study population based on the NNNS using the LPA method, and after controlling for multiple covariates, we observed an association between increased placental Cd levels and higher odds of newborns belonging to the atypical neurobehavior profile (Profile 5) compared to them being placed in the typical Profile 2. Detectable placental Pb was also associated with increased odds of newborns being placed in the atypical neurobehavior profile compared to those with placental Pb levels below the detection limit.

Metal concentrations measured in this present study were generally consistent with levels detected in other study populations. Cd levels measured in the RICHS placenta samples were towards the lower end of the reported range of levels worldwide.40 A review reported that the average concentration of placental Cd was around 4 ng/g in non-exposed environments.40,41 Our reported arithmetic placental Cd mean at 4.56 ng/g (±SD 2.58) was lower compared to levels measured in some countries outside the US, but slightly greater than levels measured in a study in North Carolina.4244 The range of placental Mn level in RICHS was much wider than the detected range in a birth cohort study in Spain.45 Amongst those with detectable Pb levels, placental concentrations averaged at 4.49 ng/g (±SD 3.89), which was lower than the reported value from several study populations across the world, but comparable to the value reported in the New Hampshire Birth Cohort study.37,40,42,46

Cd is a known developmental toxicant as established by numerous studies, and common sources of Cd exposure are diet, smoking during pregnancy or industrial contamination in residential environment. The RICHS population had relatively low prevalence of women who smoked during pregnancy (10.2%), and the study setting was not occupational in nature, thus the main source of Cd exposure measured in the placenta was most likely due to diet.47 However, further understanding of dietary Cd sources in RICHS is limited as we did not obtain dietary information from the participating women.

Proper placental functions are crucial for normal fetal growth and development. During pregnancy, the placenta acts as a barrier and is thought to protect the developing fetus from Cd exposure by limiting transfer to fetal circulation. Nonetheless, Cd levels were detectable in cord blood and newborn serum in previously published studies.48,49 In our study, we investigated prenatal Cd exposure using the placenta as a biomarker and observed a significant association between Cd and the atypical Profile 5, characterized by poorer neurobehavioral performances, such as increased signs of stress and excitability. The MOCEH study in Korea found no association between Cd measured in maternal blood and neurodevelopment measured at 6 months.50 The HOME study also did found no significant association between maternal urinary Cd and cognitive and behavioral outcomes in 1–8-year-old children.51 Additionally, no relationship between blood Cd and neurodevelopment was observed in children 2 years of age in the TLC study.52 Limited numbers of epidemiologic studies have investigated the potential link between prenatal Cd exposure and fetal development through impacts on the placenta. However, in line with our findings, other studies have identified inverse associations between prenatal Cd exposure measured through maternal blood, cord blood or urine, and verbal and performance IQ in children.1,53,54 As we further explore prenatal Cd exposure in the placenta, the present finding adds to the understanding of the potential for adverse impacts from prenatal Cd exposure on fetal development.

We further observed an association between detectable Pb and assignment to the atypical profile for newborns in the RICHS population. Pb is well-documented for its developmental neurotoxicity in children.6,24,55 Our results are in agreement with a series of studies that demonstrated the negative effects on neurodevelopment from early-life Pb exposure. Postnatal dentine Pb was linked to increased behavioral problems in Mexican children between the ages of 8–11.56 In addition, prenatal and early postnatal exposure to Pb have also been found to be associated with decrements in IQ and compromised neuropsychological function in children.8,23,25,57,58 Contrary to these findings, Freire et al. measured placental Pb in the INMA cohort as we did in the present study and found no association with neurodevelopmental outcomes at 4–5 years of age.45 Additionally, Taylor et al. did not observe association between placenta Pb levels and motor skills in 7-year-old children.27 Among infants, the MOCEH study also found no association between Pb exposure measured early in pregnancy and mental (MDI) and psychomotor (PDI) development index scores, but Pb levels during late pregnancy period was found to be linked to lower MDI scores assessed at 6-month of age.50 Thus, whether early indicators of neurodevelopmental performance among newborns associate with placental Pb will need to be confirm or refuted by further studies.

We also investigated Mn exposure and newborn neurobehavior in this study population but did not find a significant association between increased placental Mn levels and higher odds of newborns belonging to the atypical Profile 5. Unlike Cd and Pb that are classified as toxic metals, Mn is recognized as an essential nutrient crucial for development and growth, though excess levels have been linked to cognitive and behavioral issues early in life, at 6 months in the MOCEH study and in children at 2 years of age from a study in Taiwan.30,32,59,60 A meta-analysis found a 50% increase in Mn levels was associated with decreased IQ points in children aged 6–8 years.17 The CHAMACOS cohort also linked increased Mn exposure to poorer behavioral performance61 In contrast, the same study found improved memory and cognitive function in older boys to be associated with higher Mn levels. In agreement with our study, a French study found no association between Mn exposure measured in the placenta and cognitive scores at age 3 or age 6.62 The mean Mn level in our study cohort was similar to the French study (0.095 ug/g vs. 0.10 ug/g), thus it is possible that placental Mn at this level was not high enough to negatively impact neurobehavior.

While our findings on placental Cd and Pb and atypical neurobehavioral phenotype generally agreed with prior studies, discrepancies may have arisen from the type of biologic matrices used. Maternal urine, maternal blood, cord blood, hair and toenails have all been used to determine the link between Cd, Pb or Mn levels and children’s neurobehavior, with fewer studies of placenta. Thus, the metals’ characteristics, such as Cd’s accumulative nature in the placenta and Pb’s ability to pass through the placenta along with the time point in which biological matrices were collected, or the study population’s exposure environment and cultural patterns, could have resulted in differences in the direction and strength of association between neurodevelopment and metal exposures across studies.

We were able to distinguish NNNS score pattern differences across five profiles and identified typical and atypical profiles based on neurobehavior characteristics. Initially designed to study effects of prenatal drug exposure on child outcomes, the NNNS assessment utilizes standardized scales to examine newborns’ neurobehavioral performances.36,63 From analyzing NNNS results from a large random sample of clinically healthy newborns, Fink et al. showed that NNNS scales ranging between the 10th to the 90th percentile would indicate normative neurobehavior.64 Researchers have since successfully applied NNNS assessments to understand neurobehavior potentially associated with different environmental exposures in healthy full-term infants.

Like others, we used the LPA approach to analyze NNNS data. We observed similarities in the identified profiles to those previously of Liu et al. in the Maternal Lifestyle Study (MLS), a multicenter longitudinal study designed to understand effects of illicit drugs during pregnancy on the mother, fetus and infant.38,65 The similarities of the NNNS patterns across the profiles of these two populations provides evidence that NNNS assessment and profiling method can be used to characterize neurobehavioral performances in low-risk, healthy infants and to investigate the determinants of these profiles.

NNNS scores evaluated within 24–72 hours of birth have prospectively predicted infant temperament and neuropsychological characteristics in toddlers and preschool-aged children.38,66,67 Thus, the application of the NNNS measurements may allow early insight in the newborns’ neurobehavioral performances which could inform ongoing monitoring or early interventions to those categorized into the atypical profiles. It is possible that by ascertaining the newborn’s neurobehavioral performance before hospital discharge, rather than waiting for adverse neurobehavior to manifest, we would be able to provide interventions within the early developmental period.

Advantages of this study include understanding prenatal metal exposure using the placenta as a biomarker. As prenatal metal exposures are known to elicit adverse impacts on the developing fetus, measuring placental levels of Cd, Mn and Pb may offer new understandings on prenatal exposure characteristics and associated neurobehavioral performance within days of life. With the LPA method, we were able to generate discrete neurobehavioral profiles, and the relatively large cohort size (N=625) in RICHS allowed adequate profile sizes with distinct NNNS patterns comparable to prior work in another study population, suggesting our findings are generalizable beyond the study region. We were able to identify atypical neurobehavior if newborns were assigned to Profile 5, though the profile size is considerably smaller than the other profiles. This is likely to due to RICHS being comprised of primarily low-risk and healthy participants, so there are relatively fewer extreme cases of neurobehavioral issues among the newborns.

For this present study, we analyzed individual metal’s contribution to atypical NNNS score patterns, but it is likely that the population was concurrently exposed to multiple metals. To better address how these developmental toxicants impact child’s neurobehavior, additional research considering metal exposures as a mixture and identifying the major contributor(s) driving the impacts of metal mixture on neurobehavior is needed. Another limitation of this study is the lack of information on exposure source of the participants. Other than smoking, a common source of exposure to Cd in the general population is dietary intake, such as shellfish or other Cd-contaminated foods.16 The general population is also primarily exposed to Mn through food and water. It is likely that with the lack of dietary data, we are restricted to fully address the association between metal exposure and neurobehavior, as certain dietary components may lead to increased metal exposure, but are also considered beneficial towards development. Aside from dietary intake, inhalation of particulate matter containing Mn or dermal contact with Mn-contaminated air, water, and soil are all possible sources of Mn exposure.30 While the overall metal exposure levels in RICHS are lower compared to other studies, future work examining metal levels based on the different exposure sources could further clarify the adverse impacts of metals on neurobehavior.

5. Conclusion

In this study, we found that placental toxic metals including Cd and Pb negatively affected neurobehavioral performance in newborns in a generally healthy population as indicated through the NNNS. Our findings also highlight the importance of the placenta in newborn health and the utility of measuring of placental metal concentrations to evaluate child health outcomes.

Supplementary Material

1

Acknowledgements

This work was supported by the National Institutes of Health [NIH-NIEHS R24 ES028507, NIH-NIEHS P30 ES019776, NIH-NIGMS P20 GM104416 and NIH-NIEHS P01 ES022832] and the U.S. Environmental Protection Agency [US EPA grant RD83544201]. Its contents are solely the responsibility of the grantee and do not necessarily represent the official views of the U.S. EPA. Further, the U.S. EPA does not endorse the purchase of any commercial products or services mentioned in the presentation.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Declaration of interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Supplementary Material

Supplementary material as attached.

References

  • 1.Sanders AP, Henn BC, Wright RO. Perinatal and Childhood Exposure to Cadmium, Manganese, and Metal Mixtures and Effects on Cognition and Behavior: A Review of Recent Literature. Curr Environ Health Rep. 2015;2(3):284–294. doi: 10.1007/s40572-015-0058-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Kim SS, Meeker JD, Carroll R, et al. Urinary trace metals individually and in mixtures in association with preterm birth. Environ Int. 2018;121(Pt 1):582–590. doi: 10.1016/j.envint.2018.09.052 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Kordas K, Ardoino G, Coffman DL, et al. Patterns of Exposure to Multiple Metals and Associations with Neurodevelopment of Preschool Children from Montevideo, Uruguay. J Environ Public Health. 2015;2015. doi: 10.1155/2015/493471 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Sabra S, Malmqvist E, Saborit A, Gratacós E, Gomez Roig MD. Heavy metals exposure levels and their correlation with different clinical forms of fetal growth restriction. PLoS ONE. 2017;12(10):e0185645. doi: 10.1371/journal.pone.0185645 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Taylor CM, Golding J, Emond AM. Moderate Prenatal Cadmium Exposure and Adverse Birth Outcomes: a Role for Sex-Specific Differences? Paediatr Perinat Epidemiol. 2016;30(6):603–611. doi: 10.1111/ppe.12318 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ris MD, Dietrich KN, Succop PA, Berger OG, Bornschein RL. Early exposure to lead and neuropsychological outcome in adolescence. J Int Neuropsychol Soc. 2004;10(2):261–270. doi: 10.1017/S1355617704102154 [DOI] [PubMed] [Google Scholar]
  • 7.Claus Henn B, Ettinger AS, Schwartz J, et al. Early Postnatal Blood Manganese Levels and Children’s Neurodevelopment. Epidemiology. 2010;21(4):433–439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Lanphear BP, Hornung R, Khoury J, et al. Low-Level Environmental Lead Exposure and Children’s Intellectual Function: An International Pooled Analysis. Environ Health Perspect. 2005;113(7):894–899. doi: 10.1289/ehp.7688 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Lester BM, Marsit CJ. Epigenetic mechanisms in the placenta related to infant neurodevelopment. Epigenomics. 2018;10(3):321–333. doi: 10.2217/epi-2016-0171 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Shallie PD, Naicker T. The placenta as a window to the brain: A review on the role of placental markers in prenatal programming of neurodevelopment. Int J Dev Neurosci. 2019;73(1):41–49. doi: 10.1016/j.ijdevneu.2019.01.003 [DOI] [PubMed] [Google Scholar]
  • 11.Bale TL. The placenta and neurodevelopment: sex differences in prenatal vulnerability. Dialogues Clin Neurosci. 2016;18(4):459–464. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Rosenfeld CS. The placenta-brain-axis. J Neuro Res. 2021;99(1):271–283. doi: 10.1002/jnr.24603 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Nugent BM, Bale TL. The omniscient placenta: Metabolic and epigenetic regulation of fetal programming. Front Neuroendocrinol. 2015;39:28–37. doi: 10.1016/j.yfrne.2015.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.O’Donnell K, O’Connor TG, Glover V. Prenatal Stress and Neurodevelopment of the Child: Focus on the HPA Axis and Role of the Placenta. DNE. 2009;31(4):285–292. doi: 10.1159/000216539 [DOI] [PubMed] [Google Scholar]
  • 15.Tomlinson MS, Lu K, Stewart JR, Marsit CJ, O’Shea TM, Fry RC. Microorganisms in the Placenta: Links to Early-Life Inflammation and Neurodevelopment in Children. Clin Microbiol Rev. 2019;32(3). doi: 10.1128/CMR.00103-18 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Cadmium | Toxicological Profile | ATSDR. Accessed April 6, 2021. https://wwwn.cdc.gov/TSP/ToxProfiles/ToxProfiles.aspx?id=48&tid=15
  • 17.Rodríguez-Barranco M, Lacasaña M, Aguilar-Garduño C, et al. Association of arsenic, cadmium and manganese exposure with neurodevelopment and behavioural disorders in children: A systematic review and meta-analysis. Sci Total Environ. 2013;454–455:562–577. doi: 10.1016/j.scitotenv.2013.03.047 [DOI] [PubMed] [Google Scholar]
  • 18.Geng HX, Wang L. Cadmium: Toxic effects on placental and embryonic development. Environ Toxicol Pharmacol. 2019;67:102–107. doi: 10.1016/j.etap.2019.02.006 [DOI] [PubMed] [Google Scholar]
  • 19.Gundacker C, Hengstschläger M. The role of the placenta in fetal exposure to heavy metals. Wien Med Wochenschr. 2012;162(9–10):201–206. doi: 10.1007/s10354-012-0074-3 [DOI] [PubMed] [Google Scholar]
  • 20.Levin AA, Plautz JR, di Sant’Agnese PA, Miller RK. Cadmium: placental mechanisms of fetal toxicity. Placenta Suppl. 1981;3:303–318. [PubMed] [Google Scholar]
  • 21.Wang Z, Wang H, Xu ZM, et al. Cadmium-induced teratogenicity: Association with ROS-mediated endoplasmic reticulum stress in placenta. Toxicol Appl Pharmacol. 2012;259(2):236–247. doi: 10.1016/j.taap.2012.01.001 [DOI] [PubMed] [Google Scholar]
  • 22.Charney E, Kessler B, Farfel M, Jackson D. Childhood lead poisoning. A controlled trial of the effect of dust-control measures on blood lead levels. N Engl J Med. 1983;309(18):1089–1093. doi: 10.1056/NEJM198311033091804 [DOI] [PubMed] [Google Scholar]
  • 23.Gorini F, Muratori F, Morales MA. The Role of Heavy Metal Pollution in Neurobehavioral Disorders: a Focus on Autism. Rev J Autism Dev Disord. 2014;1(4):354–372. doi: 10.1007/s40489-014-0028-3 [DOI] [Google Scholar]
  • 24.Toxicological Profile for Lead. U.S. Department of Health and Human Services; 2020. doi: 10.15620/cdc:95222 [DOI] [Google Scholar]
  • 25.Bellinger DC. Very low lead exposures and children’s neurodevelopment. Curr Opin Pediatr. 2008;20(2):172–177. doi: 10.1097/MOP.0b013e3282f4f97b [DOI] [PubMed] [Google Scholar]
  • 26.Canfield RL, Henderson CR, Cory-Slechta DA, Cox C, Jusko TA, Lanphear BP. Intellectual Impairment in Children with Blood Lead Concentrations below 10 μg per Deciliter. N Engl J Med. 2003;348(16):1517–1526. doi: 10.1056/NEJMoa022848 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Taylor CM, Kordas K, Golding J, Emond AM. Effects of low-level prenatal lead exposure on child IQ at 4 and 8 years in a UK birth cohort study. Neurotoxicology. 2017;62:162–169. doi: 10.1016/j.neuro.2017.07.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Goyer RA. Transplacental transport of lead. Environ Health Perspect. 1990;89:101–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Schell LM, Denham M, Stark AD, et al. Maternal blood lead concentration, diet during pregnancy, and anthropometry predict neonatal blood lead in a socioeconomically disadvantaged population. Environ Health Perspect. 2003;111(2):195–200. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Manganese | Toxicological Profile | ATSDR. Accessed April 6, 2021. https://wwwn.cdc.gov/TSP/ToxProfiles/ToxProfiles.aspx?id=102&tid=23
  • 31.Aschner JL, Aschner M. Nutritional aspects of manganese homeostasis. Mol Aspects Med. 2005;26(4–5):353–362. doi: 10.1016/j.mam.2005.07.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Horning KJ, Caito SW, Tipps KG, Bowman AB, Aschner M. Manganese Is Essential for Neuronal Health. Annu Rev Nutr. 2015;35:71–108. doi: 10.1146/annurev-nutr-071714-034419 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Bjørklund G, Chartrand MS, Aaseth J. Manganese exposure and neurotoxic effects in children. Environ Res. 2017;155:380–384. doi: 10.1016/j.envres.2017.03.003 [DOI] [PubMed] [Google Scholar]
  • 34.Yu XD, Zhang J, Yan CH, Shen XM. Prenatal exposure to manganese at environment relevant level and neonatal neurobehavioral development. Environ Res. 2014;133:232–238. doi: 10.1016/j.envres.2014.04.012 [DOI] [PubMed] [Google Scholar]
  • 35.Lester BM, Tronick EZ. History and Description of the Neonatal Intensive Care Unit Network Neurobehavioral Scale. Pediatrics. 2004;113(Supplement 2):634–640. [PubMed] [Google Scholar]
  • 36.Lester BM, Tronick EZ, Brazelton TB. The Neonatal Intensive Care Unit Network Neurobehavioral Scale Procedures. Pediatrics. 2004;113(Supplement 2):641–667. [PubMed] [Google Scholar]
  • 37.Punshon T, Li Z, Marsit CJ, Jackson BP, Baker ER, Karagas MR. Placental metal concentrations in relation to maternal and infant toenails in a US cohort. Environ Sci Technol. 2016;50(3):1587–1594. doi: 10.1021/acs.est.5b05316 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Liu J, Bann C, Lester B, et al. Neonatal Neurobehavior Predicts Medical and Behavioral Outcome. Pediatrics. 2010;125(1):e90–e98. doi: 10.1542/peds.2009-0204 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Berlin KS, Williams NA, Parra GR. An Introduction to Latent Variable Mixture Modeling (Part 1): Overview and Cross-Sectional Latent Class and Latent Profile Analyses. J Pediatr Psychol. 2014;39(2):174–187. doi: 10.1093/jpepsy/jst084 [DOI] [PubMed] [Google Scholar]
  • 40.Esteban-Vasallo MD, Aragonés N, Pollan M, López-Abente G, Perez-Gomez B. Mercury, Cadmium, and Lead Levels in Human Placenta: A Systematic Review. Environ Health Perspect. 2012;120(10):1369–1377. doi: 10.1289/ehp.1204952 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Iyengar GV, Rapp A. Human placenta as a “dual” biomarker for monitoring fetal and maternal environment with special reference to potentially toxic trace elements. Part 3: toxic trace elements in placenta and placenta as a biomarker for these elements. Sci Total Environ. 2001;280(1–3):221–238. doi: 10.1016/s0048-9697(01)00827-0 [DOI] [PubMed] [Google Scholar]
  • 42.Al-Saleh I, Shinwari N, Mashhour A, Mohamed GED, Rabah A. Heavy metals (lead, cadmium and mercury) in maternal, cord blood and placenta of healthy women. Int J Hyg Environ Health. 2011;214(2):79–101. doi: 10.1016/j.ijheh.2010.10.001 [DOI] [PubMed] [Google Scholar]
  • 43.Laine JE, Ray P, Bodnar W, et al. Placental Cadmium Levels Are Associated with Increased Preeclampsia Risk. PLoS One. 2015;10(9). doi: 10.1371/journal.pone.0139341 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Kippler M, Hoque AMW, Raqib R, Ohrvik H, Ekström E-C, Vahter M. Accumulation of cadmium in human placenta interacts with the transport of micronutrients to the fetus. Toxicol Lett. 2010;192(2):162–168. doi: 10.1016/j.toxlet.2009.10.018 [DOI] [PubMed] [Google Scholar]
  • 45.Freire C, Amaya E, Gil F, et al. Prenatal co-exposure to neurotoxic metals and neurodevelopment in preschool children: The Environment and Childhood (INMA) Project. Sci Total Environ. 2018;621:340–351. doi: 10.1016/j.scitotenv.2017.11.273 [DOI] [PubMed] [Google Scholar]
  • 46.Singh J, Singh VK, Anand M, Kumar P, Siddiqui MKJ. Placental Lead and its Interaction with Some Essential Metals among Women from Lucknow, India. Asian J Med Sci. 2010;1(2):32–36. doi: 10.3126/ajms.v1i2.3199 [DOI] [Google Scholar]
  • 47.Kim K, Melough MM, Vance TM, Noh H, Koo SI, Chun OK. Dietary Cadmium Intake and Sources in the US. Nutrients. 2019;11(1):2. doi: 10.3390/nu11010002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Chen Z, Myers R, Wei T, et al. Placental transfer and concentrations of cadmium, mercury, lead, and selenium in mothers, newborns, and young children. J Expo Sci Environ Epidemiol. 2014;24(5):537–544. doi: 10.1038/jes.2014.26 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Carrillo-Ponce M de L, Martínez-Ordaz VA, Velasco-Rodríguez VM, Hernández-García A, Hernández-Serrano MC, Sanmiguel F. Serum lead, cadmium, and zinc levels in newborns with neural tube defects from a polluted zone in Mexico. Reprod Toxicol. 2004;19(2):149–154. doi: 10.1016/j.reprotox.2004.07.003 [DOI] [PubMed] [Google Scholar]
  • 50.Kim Y, Ha EH, Park H, et al. Prenatal lead and cadmium co-exposure and infant neurodevelopment at 6 months of age: The Mothers and Children’s Environmental Health (MOCEH) study. NeuroToxicology. 2013;35:15–22. doi: 10.1016/j.neuro.2012.11.006 [DOI] [PubMed] [Google Scholar]
  • 51.Yang W, Vuong AM, Xie C, et al. Maternal cadmium exposure and neurobehavior in children: The HOME study. Environ Res. 2020;186:109583. doi: 10.1016/j.envres.2020.109583 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Cao Y, Chen A, Radcliffe J, et al. Postnatal Cadmium Exposure, Neurodevelopment, and Blood Pressure in Children at 2, 5, and 7 Years of Age. Environ Health Perspect. 2009;117(10):1580–1586. doi: 10.1289/ehp.0900765 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Kippler M, Tofail F, Hamadani JD, et al. Early-Life Cadmium Exposure and Child Development in 5-Year-Old Girls and Boys: A Cohort Study in Rural Bangladesh. Environ Health Perspect. 2012;120(10):1462–1468. doi: 10.1289/ehp.1104431 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Tian LL, Zhao YC, Wang XC, et al. Effects of Gestational Cadmium Exposure on Pregnancy Outcome and Development in the Offspring at Age 4.5 Years. Biol Trace Elem Res. 2009;132(1):51–59. doi: 10.1007/s12011-009-8391-0 [DOI] [PubMed] [Google Scholar]
  • 55.Osman K, Akesson A, Berglund M, et al. Toxic and essential elements in placentas of Swedish women. Clin Biochem. 2000;33(2):131–138. doi: 10.1016/s0009-9120(00)00052-7 [DOI] [PubMed] [Google Scholar]
  • 56.Horton MK, Hsu L, Henn BC, et al. Dentine biomarkers of prenatal and early childhood manganese, zinc and lead and childhood behavior. Environ Int. 2018;121(Pt 1):148–158. doi: 10.1016/j.envint.2018.08.045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Lidsky TI, Schneider JS. Lead neurotoxicity in children: basic mechanisms and clinical correlates. Brain. 2003;126(1):5–19. doi: 10.1093/brain/awg014 [DOI] [PubMed] [Google Scholar]
  • 58.Wasserman GA, Liu X, Popovac D, et al. The Yugoslavia Prospective Lead Study: contributions of prenatal and postnatal lead exposure to early intelligence. Neurotoxicol Teratol. 2000;22(6):811–818. doi: 10.1016/s0892-0362(00)00106-9 [DOI] [PubMed] [Google Scholar]
  • 59.Chung SE, Cheong HK, Ha EH, et al. Maternal Blood Manganese and Early Neurodevelopment: The Mothers and Children’s Environmental Health (MOCEH) Study. Environ Health Perspect. 2015;123(7):717–722. doi: 10.1289/ehp.1307865 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Lin CC, Chen YC, Su FC, et al. In utero exposure to environmental lead and manganese and neurodevelopment at 2 years of age. Environ Res. 2013;123:52–57. doi: 10.1016/j.envres.2013.03.003 [DOI] [PubMed] [Google Scholar]
  • 61.Mora AM, Arora M, Harley KG, et al. Prenatal and postnatal manganese teeth levels and neurodevelopment at 7, 9, and 10.5 years in the CHAMACOS cohort. Environ Int. 2015;84:39–54. doi: 10.1016/j.envint.2015.07.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Takser L, Mergler D, Hellier G, Sahuquillo J, Huel G. Manganese, monoamine metabolite levels at birth, and child psychomotor development. Neurotoxicology. 2003;24(4–5):667–674. doi: 10.1016/S0161-813X(03)00058-5 [DOI] [PubMed] [Google Scholar]
  • 63.Tronick E, Lester BM. Grandchild of the NBAS: The NICU Network Neurobehavioral Scale (NNNS) A Review of the Research Using the NNNS. J Child Adolesc Psychiatr Nurs. 2013;26(3). doi: 10.1111/jcap.12042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Fink NS, Tronick E, Olson K, Lester B. Healthy Newborns’ Neurobehavior: Norms and Relations to Medical and Demographic Factors. J Pediatr. 2012;161(6):1073–1079.e3. doi: 10.1016/j.jpeds.2012.05.036 [DOI] [PubMed] [Google Scholar]
  • 65.Bauer CR, Shankaran S, Bada HS, et al. The Maternal Lifestyle Study: Drug exposure during pregnancy and short-term maternal outcomes. Am J Obstet Gynecol. 2002;186(3):487–495. doi: 10.1067/mob.2002.121073 [DOI] [PubMed] [Google Scholar]
  • 66.Sucharew H, Khoury JC, Xu Y, Succop P, Yolton K. NICU Network Neurobehavioral Profiles Predict Developmental Outcomes in a Low Risk Sample. Paediatr Perinat Epidemiol. 2012;26(4):344–352. doi: 10.1111/j.1365-3016.2012.01288.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Sheinkopf SJ, Lester BM, LaGasse LL, et al. Interactions Between Maternal Characteristics and Neonatal Behavior in the Prediction of Parenting Stress and Perception of Infant Temperament. J Pediatr Psychol. 2006;31(1):27–40. doi: 10.1093/jpepsy/jsj026 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

1

RESOURCES