Abstract
Background
Temperament is a psychological construct that reflects both personality and an infant’s reaction to social stimuli. It can be assessed early in life and is stable over time Temperament predicts many later life behaviors and illnesses, including impulsivity, emotional regulation and obesity. Early life exposure to neurotoxicants often results in developmental deficits in attention, social function, and IQ, but environmental predictors of infant temperament are largely unknown. We propose that prenatal exposure to both chemical and non-chemical environmental toxicants impacts the development of temperament, which can itself be used as a marker of risk for maladaptive neurobehavior in later life.
In this study, we assessed associations among prenatal and early life exposure to lead, mercury, poverty, maternal depression and toddler temperament.
Methods
A prospective cohort of women living in the Mexico City area were followed longitudinally beginning in the second trimester of pregnancy. Prenatal exposure to lead (blood, bone), mercury, and maternal depression were assessed repeatedly and the Toddler Temperament Scale (TTS) was completed when the child was 24 months old. The association between each measure of prenatal exposure and performance on individual TTS subscales was evaluated by multivariable linear regression. Latent profile analysis was used to classify subjects by TTS performance. Multinomial regression models were used to estimate the prospective association between prenatal exposures and TTS performance.
Results
500 mother-child pairs completed the TTS and had complete data on exposures and covariates. Three latent profiles were identified and categorized as predominantly difficult, intermediate, or easy temperament. Prenatal exposure to maternal depression predicted increasing probability of difficult toddler temperament. Maternal bone lead, a marker of cumulative exposure, also predicted difficult temperament. Prenatal lead exposure modified this association, suggesting that joint exposure in pregnancy to both was most toxic.
Conclusions
Maternal depression predicts difficult temperament and concurrent prenatal exposure to maternal depression and lead predicts a more difficult temperament phenotype in 2 year olds. The role of temperament as an intermediate variable in the path from prenatal exposures to neurobehavioral deficits and other health effects deserves further study.
Keywords: Temperament, Prenatal exposure, Lead, Depression in pregnancy, Neurobehavioral outcomes
Background
Temperament reflects the manner in which an individual interacts with and responds to social and emotional environmental cues. Distinct temperament traits are identifiable in infancy and are relatively stable over time [1, 2]. Temperament is a biologically based trait [3] and is associated with later child behavior, both normal and pathological [4–7]. Early childhood temperament can be seen as an important risk factor for behavioral problems that are not expressed until later in life as well as for diseases such as obesity [8–14]. While the full range of risk factors that predict maladaptive temperament are not well-understood, it is believed that temperament is established during perinatal life through both genetic and environmental factors [13–16]. As such, in utero exposure to neurotoxicants might impact infant temperament, and maladaptive temperament may be an early life intermediate phenotype for behavioral disorders brought on by environmental toxicants.
Although prenatal exposure to elemental metals including lead and mercury is known to be detrimental to cognition and specific behavioral domains in childhood [17–23], the relationship between in utero metal exposure and temperament has not been studied previously. Social stressors such as maternal mental state and stress level – which we refer to as “non-chemical toxicants” [24] – can also have a significant clinical impact on the developing fetus [25–30]. Women who experience toxic stress, anxiety, or depression while pregnant have children at elevated risk for certain physical, cognitive, and behavioral difficulties [28–32]. To our knowledge, no study has attempted to address whether concurrent prenatal exposure to chemical and non-chemical stressors interact to predict maladaptive temperament phenotypes.
While gene-environment interactions have received much attention, the concurrent exposure to multiple toxins may also multiplicatively increase effects seen in single exposure models [33–42], and studies of prenatal exposure should evaluate both chemical and non-chemical exposures to reflect real-life exposure scenarios. In this study, we hypothesized that prenatal co-exposure to chemical and non-chemical neurotoxicants is associated with difficult infant temperament. The study was nested in a large prospective environmental health cohort study designed to investigate the impact of concurrent prenatal exposure to lead, mercury, maternal depression, socioeconomic status, and maternal nutrition on multiple long-term neurobehavioral outcomes.
Methods
Participant identification and enrollment
Between 2007 and 2011, healthy pregnant women in Mexico City were recruited through the Mexican Social Security System to participate in the PROGRESS (Programming Research in Obesity, GRowth, Environment, and Social Stress) birth cohort [43]. Informed consent to participate in the study was obtained from participants. Nine hundred forty-eight women were enrolled prior to 20 weeks of pregnancy and delivered a live infant. Of these, 760 children were evaluated for neurodevelopment in at least one visit at 6, 12, 18, or 24-months of age. Of the 549 completing the 24-month visit, 500 mothers responded to the Toddler Temperament Scale (TTS), the primary outcome in these analyses. Research ethics committees of the participating institutions approved the study (the Comité de Investigación, Comité de Bioseguridad, and the Comité de Ética en la Investigación of the National Institute of Public Health, Mexico, the Partners Human Research Committee at Brigham and Women’s Hospital, the Office of Human Research Administration at the Harvard School of Public Health, and the Program for the Protection of Human Subjects at the Icahn School of Medicine at Mount Sinai).
Participant data collection
Questionnaires were administered to collect sociodemographic information including maternal age, parity, education level, and socioeconomic status (SES). Thirteen variables derived from questionnaire results were used to classify study participant families into six levels based on the SES index created by the Asociación Mexicana de Agencias de Investigación de Mercados y Opinión Pública [44]. These levels were then collapsed into low, medium, and high socioeconomic status.
Lead measurements
Maternal lead exposure was assessed by inductively coupled plasma-mass spectrometry (Agilent 8800, Santa Clara, CA) of maternal blood during the second trimester and in bone by maternal in vivo K-shell X-ray fluorescence (K-XRF) one month postpartum (ABIOMED, Danvers, MA, USA) [45, 46]. Blood lead measurement quality control (QC) and quality assurance procedures used were: included analyses of procedural blanks, duplicates, spiked samples, national institute of standard reference material (NIST SRM) 955 (Lead in Blood); NIST SRM 1643e (trace elements in water) and blood samples from the inter-laboratory study program INSPQ/Laboratoire de Toxicologie, Quebec to monitor the accuracy and recovery rates of the procedure for each analytic batch. Lab recovery rates for QC standards and spiked samples with this method were 9- 110 % and precision (given as % RSD) was <5 %. The limit of detection for this procedure was 0.2 ng ml-1.
Our K-XRF protocol measures bone lead at the mid-shaft tibia (cortical bone) and the patella (trabecular bone) [47] to provide a representation of cumulative fetal lead exposure through gestation [45, 48]. K-XRF produces negative values when the bone lead content is below the detection limit of the instrument. As imputation to replace negative values in this context has not been shown to be beneficial [49], we included negative values as reported by K-XRF in our analyses.
Mercury measurements
Maternal mercury exposure was evaluated by measuring mercury deposition in maternal toenails collected during pregnancy. Toenails from all ten toes were collected and pre-cleaned by sonicating for 15 min in approximately 10 mL of 1 % Triton X-100 solution to remove extraneous contaminants. Samples were then rinsed with distilled deionized water and dried at 60 °C for 24 h in a drying oven. Mercury level was assessed using the Direct Mercury Analyzer 80 (Milestone Inc., Monroe, CT) using previously published methods [50]. Samples were analyzed using an aqueous calibration standards and verifyied using different weights of certified reference material GBW 07601 (human hair; Institute of Geophysical and Geochemical Exploration, China). Mercury recovery was 90–110 %, with greater than 90 % precision. The detection limit for samples varied according to sample weight. Sample weight varied from 0.006 g to 0.0.083 g, and the detection limit varied from 0.006 μg/g to 0.08 μg/g (mean = 0.019 μg/g).
Measurements of child development
All children were assessed for motor, language and cognitive development using the Bayley Scales of Infant and Toddler Development, 3rd edition (BSID) at 24 months of age [51]. Child temperament was assessed at 24 months of age using the TTS [2], which comprises a number of age-appropriate questions. These questions evaluate the nine temperamental characteristics first described by Thomas et al. [52], and expands on earlier work by Carey measuring temperament in infants [53, 54]. Caregivers are presented with a statement describing a certain behavior and asked to rate how often their child behaves in that way on a 6-point scale. The results are coded so that higher scores indicate more difficult temperament. Although the TTS is designed to be completed independently by parents, in the current study trained psychologists verbally administered the TTS to the enrolled mother at the 24-month study visit. In 9 cases where the mother was not present at the 24-month visit, the TTS questionnaire was mailed to the home for independent completion by the mother.
Measurement of maternal depression risk
The Edinburgh Postnatal Depression Scale (EPDS) was administered to mothers in the second trimester. The EPDS is a ten-item self-report scale designed to identify women experiencing depressive symptoms [55]. It is validated for repeated use during and both immediately and long after pregnancy [56, 57]. For these analyses, the second trimester EPDS result was used as the prenatal depression risk score. If the EPDS was not administered during the second trimester, the third trimester result was used as the prenatal depression risk score. The 24-month EPDS score was obtained at the same study visit as the TTS. Depression risk was evaluated both as a continuous and as a categorical variable dichotomized at an EPDS score of 13, the recommended cut point [55, 58, 59].
Although the focus of this study was to prospectively evaluate the impact of prenatal exposures including maternal depression, we also evaluated the EPDS score obtained cross-sectionally at child age 24-months in analyses, as the caregiver’s mental state at the time of TTS administration has been associated with the assessment of the child’s temperament [60, 61]. As in other studies where depressive symptoms years after childbirth were associated with perinatal depression [62, 63], the categorical variable for prenatal maternal depression risk was associated with depression risk at 24 months (p < 0.001), and the continuous variables were correlated (ρ = 0.66) in our cohort. To address the collinearity induced by including both antenatal and 24-month post-partum depression in the same model, we included variables for both the average of the two scores and the difference between scores in all analyses using the EPDS continuous variable. This transformation from the original correlated measurements to the sum and difference is the basis for traditional MANOVA analyses for multivariate outcomes [64]. The adjusted representation of the prenatal maternal depression score is referred to as “adjusted EPDS” or “adjusted prenatal depression” throughout this manuscript.
Statistical approach
Linear regression modeling
We examined univariate descriptive statistics, bivariate associations, and multivariable linear regression of each of the 9 TTS subscales using multiple measures of prenatal lead exposure, prenatal mercury exposure, maternal education, SES index, maternal ferritin during pregnancy (as a marker of nutritional status), and prenatal maternal depression score. Interaction terms for different exposures were also examined. Initial models included maternal ferritin and education, but these were dropped from subsequent models as they were insignificant (ferritin) or strongly correlated with the SES index (maternal education). These analyses were conducted using SAS 9.4 (Research Triangle Institute, Cary, NC).
In order to reduce the dimensionality of the overall nine outcome scale into a smaller set of discrete categories, we also used latent profile analysis (LPA) to evaluate associations between multiple prenatal exposures and temperament phenotype.
Latent profile analysis
Latent profile analysis (LPA) is a probabilistic, model-based variant of traditional nonhierarchical cluster analysis [65]. We used it to objectively classify children into discrete data-driven temperament profiles. LPA assumes that the population consists of a number of unobserved subgroups that are referred to as latent profiles. Individuals within a given latent profile will show similarities in their TTS subscales scores. For example, children in the same latent profile may demonstrate a high score on subscales for mood, activity and approach, low scores on rhythmicity and adaptability, and intermediate scores on the remaining subscales. Sharing a latent profile does not require consistent high or low scoring across all subscales. Rather, it identifies groups of subjects who have a similar performance pattern globally. Because the TTS assesses multiple behavioral domains that contribute to complex temperament phenotypes, we used LPA to reduce the temperament subscale data into discrete categories. We used Bayesian information criteria (BIC) whereby the smallest BIC value indicates the best fit as well as minimizes cross-classification probabilities. BIC has been shown to identify the appropriate number of profiles in finite mixture models [66] and penalizes the models for a number of parameters that may indicate model over-fit. LPA was implemented on the nine TTS subscales by using a normal mixture model as a model-based clustering technique, as fitted via an expectation–maximization algorithm in the mclust 4.3 R software package [67].
Multinomial logistic regression
Multinomial Logistic Regression (MLR) is an extension of logistic regression, which analyzes dichotomous variables. In multinomial logistic regression analysis, three or more dependent nominal variables (i.e. not clearly in defined order) are regressed choosing one as the referent group. Our LPA defined three groups (Fig. 1), two of which we could clearly categorize as easy vs difficult, with the third group being intermediate. Upon selection of a final latent class fit, we used MLR analysis to evaluate concordance between identified TTS profiles and performance on the BSID, to confirm that the identified profiles represented behaviorally consistent groupings. Based on prior noted associations between temperament and language performance [52, 68–70], we expected children with the more difficult temperament profile to be associated with worse performance on BSID measures of language. We then regressed our prenatal exposures of interest with the LPA categories [69]. Specifically, MLR was used to evaluate associations between TTS profiles and measures of prenatal lead exposure, Hg exposure, SES, and maternal depression using “easy” as the referent group. Blood lead levels were natural log transformed. Probabilistic models were built to evaluate the association between temperament profile and concurrent exposure to varying levels of prenatal factors that were found to be significant in single exposure models. LPA modeling and graphics were completed using R (R Core Team, Vienna, Austria, 2014) [71].
Results
Table 1 summarizes the demographic data on the 500 mother-infant pairs included in these analyses. Our study cohort, those who completed the TTS, were significantly more likely to be of low SES and less likely to be of high SES than PROGRESS participants who did not complete the TTS (p = 0.03). There were no other significant demographic differences between the groups. Table 2 presents associations between chemical and non-chemical prenatal exposures and scores on individual TTS subscales. Adjusted prenatal depression risk score, SES classification, maternal tibia lead K-XRF, and prenatal maternal toenail mercury levels were associated with TTS subscale performance in single exposure models. Interaction models including adjusted prenatal depression risk score and either second trimester maternal blood lead, maternal tibia lead K-XRF, or second trimester maternal toenail mercury were also significantly associated with certain TTS subscales
Table 1.
Participant Characteristics | Mexican population [44] | Selected study cohort (n = 500) | PROGRESS families not in the selected cohort (n = 260) |
---|---|---|---|
Continuous variables | |||
Maternal age (years) | 26.9 ± 5.5 | 27.3 ± 5.3 | |
Maternal 2nd trimester blood Pb, (median (IQR), ug/dL) | 2.8 (2.7) | 2.8 (2.4) | |
Maternal postpartum tibia Pb (mean ± SD, ug/g bone mineral) | 2.6 ± 8.6 | 2.7 ± 8.3 | |
Maternal postpartum patella Pb (mean ± SD, ug/g bone mineral) | 4.9 ± 8.9 | 4.3 ± 8.0 | |
Maternal EPDS score, 2nd or 3rd trimester (mean ± SD) | 8.3 ± 5.7 | 8.9 ± 6.0 | |
Categorical variables | |||
Maternal education | |||
More than high school | 117 (23.4 %) | 60 (23.1 %) | |
High school | 171 (34.2 %) | 104 (40.0 %) | |
Less than high school | 212 (42.4 %) | 96 (36.9 %) | |
Socioeconomic index | |||
High | 21.2 % | 46 (9.2 %) | 33 (12.7 %) |
Middle | 53.7 % | 177 (35.4 %) | 105 (40.4 %) |
Low | 25 % | 277 (55.4 %) | 122 (46.9 %) |
Table 2.
Activity | Rhythmicity | Approach | Adaptability | Intensity | Mood | Persistence | Distractibility | Threshold | |
---|---|---|---|---|---|---|---|---|---|
1. SES | −0.014 (0.54) | −0.081 (0.005)* | −0.027 (0.47) | −0.017 (0.56) | −0.026 (0.28) | −0.040 (0.12) | 0.013 (0.55) | 0.034 (0.19) | 0.067 (0.030)* |
2. EPDS | 0.021 (0.0003)* | 0.029 (<0.0001)* | 0.020 (0.037)* | 0.031 (<0.0001)* | 0.005 (0.46) | 0.032 (<0.0001)* | 0.018 (0.001)* | 0.008 (0.24) | −0.020 (0.015)* |
3. Blood lead | −0.009 (0.38) | 0.016 (0.21) | −0.012 (0.46) | 0.018 (0.17) | −0.005 (0.63) | 0.005 (0.67) | 0.001 (0.91) | −0.002 (0.84) | −0.009 (0.53) |
4. Blood lead x EPDS | <0.001 (0.98) | −0.005 (0.11) | −0.004 (0.37) | −0.003 (0.46) | 0.006 (0.05)* | 0.001 (0.74) | 0.004 (0.11) | 0.004 (0.20) | 0.005 (0.14) |
5. Tibia lead | −0.002 (0.56) | 0.004 (0.32) | −0.001 (0.79) | −0.0008 (0.86) | −0.002 (0.67) | 0.0008 (0.84) | −0.003 (0.42) | −0.006 (0.11) | −0.011 (0.017)* |
6. Tibia lead x EPDS | <0.0001 (0.99) | −0.003 (0.01)* | −0.002 (0.22) | −0.001 (0.31) | −0.0003 (0.73) | −0.0008 (0.37) | 0.0007 (0.38) | −0.0009 (0.37) | −0.0001 (0.93) |
7. Mercury | 0.12 (0.49) | 0.28 (0.21) | −0.25 (0.40) | 0.16 (0.50) | 0.35 (0.07) | 0.10 (0.61) | −0.13 (0.45) | 0.30 (0.16) | 0.090 (0.71) |
8. Mercury x EPDS | 0.088 (0.04)* | 0.053 (0.33) | 0.002 (0.97) | 0.13 (0.03)* | 0.022 (0.64) | 0.071 (0.15) | 0.028 (0.51) | 0.031 (0.55) | 0.091 (0.13) |
Maternal blood lead and toenail mercury were measured in the second trimester of pregnancy. Tibia lead was measured by K-XRF one month post-partum
Models 2–8 were adjusted for SES
Models 4, 6, and 8 evaluated the interaction between exposures of interest
N = 500
*p ≤ 0.05
Neither maternal patella K-XRF, nor interaction models using patella lead measurement and adjusted prenatal depression risk were associated with TTS subscale scores. Similarly, interaction models between prenatal mercury level and any measure of prenatal lead exposure were not significantly associated with TTS subscale performance (results not shown).
Our LPA demonstrated three discrete profiles (Fig. 1). Children fell into three categories of temperament, two of which could be characterized as difficult (more intense, less regulated, etc.), versus easy-going (less intense, more regulated, etc.). The third category appears to be intermediate, with performance in the moderate range for most subscales. To confirm that our LPA profiles represent neurobehaviorally meaningful groupings, we evaluated the relationship between our study’s TTS profiles and language performance on the BSID. Figure 2 shows how children in each profile performed on the BSID language elements. Consistent with studies in other populations [68, 70, 72], more difficult toddler temperament was significantly associated with worse performance on tests of language ability in our cohort.
We next tested whether the probability of a subject demonstrating a given TTS profile varied in relation to prenatal exposures. Results of multinomial logistic regression analyses of the relationship between prenatal exposures and TTS latent profile are summarized in Table 3. Greater prenatal exposure to maternal depression estimated by the adjusted prenatal EPDS, and to lead estimated either by maternal blood lead level or K-XRF of the maternal tibia, was associated with significantly increased odds of having a difficult temperament. Prenatal SES, maternal patella lead measurement, and antenatal maternal toenail mercury level were not significantly associated with the temperament classification.
Table 3.
EPDSa | SES | Blood leadb | Tibia leadc | Patella leadc | Mercuryc | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Temperament | OR | 95 % CI | OR | 95 % CI | OR | 95 % CI | OR | 95 % CI | OR | 95 % CI | OR | 95 % CI | ||||||
Easy | Ref | -- | -- | Ref | -- | -- | Ref | -- | -- | Ref | -- | -- | Ref | -- | -- | Ref | -- | -- |
Intermediate | 1.23 | 0.78 | 1.93 | 0.71 | 0.26 | 1.9 | 0.88 | 0.59 | 1.3 | 1.25 | 0.95 | 1.65 | 0.99 | 0.96 | 1.02 | 0.82 | 0.11 | 6.15 |
Difficult | 2.53 | 1.69 | 3.77 | 1.38 | 0.46 | 4.15 | 1.52 | 1.03 | 2.26 | 1.32 | 1.01 | 1.73 | 1.01 | 0.98 | 1.04 | 1.89 | 0.29 | 12.28 |
aOdds ratio (OR) and 95 % CI corresponding to IQR change in adjusted EPDS score (IQR = 7.3)
bOR and 95 % CI corresponding to 1 unit change of ln(maternal blood lead ug/dl), which corresponds to a 2.7 fold increase in second trimester maternal blood lead level
cOR and 95 % CI corresponding to per 1 unit change per 10 ug/g change in metal measurement
Finally, we addressed concurrent prenatal exposure to factors significant in single predictor models. Figure 3 demonstrates the probability of demonstrating each of the three temperament profiles (y-axis) stratified by adjusted prenatal EPDS score dichotomized at 13, and illustrates the joint impact of exposure to increasing prenatal lead exposure (x-axis) and for high or low maternal depression score (dotted versus solid lines). High adjusted prenatal depression scores increased the probability that a child demonstrated a difficult temperament. When tibia lead concentration and adjusted prenatal depression score were low (25th percentile or lower), a child demonstrated an easy or intermediate temperament approximately 70 % of the time. As prenatal lead exposure increased, the probability of demonstrating an easy or intermediate temperament fell and the probability of demonstrating a difficult temperament rose. This effect was more pronounced when the adjusted prenatal depression risk score was high. Similar results were seen when maternal blood lead was used as a measure of prenatal lead exposure, although results were less significant. Prenatal mercury exposure did not alter the effect of prenatal maternal depression on temperament (results not shown).
Discussion
While associations between prenatal exposure to metals or maternal depression and cognitive development have been widely reported [12, 13, 20, 44–47], the role of such exposures in early life behavioral development is less well-understood. Effects seen in behavior early in life can help to parse the contribution of prenatal vs later life exposures, since exposures through the life-course are often correlated. Also, early life behavioral changes that result from environmental exposures may serve as intermediates for later life behavioral phenotypes, helping us to understand the complex interrelationships among exposure and behavioral development. Environmental health research focused on intelligence has generated a great appreciation for the impact of perinatal environmental exposures on ultimate IQ and intellectual achievement. However, learning and intellectual performance are complex processes that clearly interact with behavioral traits to produce psychological health. The importance of behavioral traits to overall child development is becoming increasingly apparent [73]. Cognition and cognitive performance is dependent on many behavioral traits such as attention and impulsivity that integrate with intellectual processes such as memory and mathematical ability in everyday life. To better understand central nervous system toxicity, the role of toxins in altering behavioral development and cognitive traits should be considered equally important. Prenatal and childhood exposure to maternal depression [74–76], lead [17, 77–79], and mercury [18, 22, 80] have been associated with behavior problems from middle childhood through adolescence. Measurable early life behaviors, such as temperament, predict psychiatric traits later in life including externalizing and internalizing disorders in school age children and ADHD [81, 82]. If early life temperament is predictive of later life psychiatric traits, then our results suggest that cumulative lead exposure and maternal depression may set these trajectories as early as age two. If we are to develop effective treatments or prevention measures for behavioral disorders, we need to both better understand the role of exposure timing and develop methods for early detection of deficits so that developmental plasticity can be leveraged to mitigate the neurotoxic effects of chemical and non-chemical exposures. Evaluation of temperament may provide this intermediate outcome as both sensitive to environmental exposures and measurable at a point in development when effective interventions can be initiated to reduce long-term morbidity.
Our data demonstrate a relationship between cumulative prenatal lead exposure and the likelihood of demonstrating a difficult temperament. Additionally, those mothers in our cohort with highest scores on prenatal depression screening had toddlers most likely to demonstrate difficult temperament traits, even after adjusting for maternal depression at the time of temperament assessment. As shown in Fig. 3, the association of cumulative prenatal lead exposure with difficult temperament was most pronounced among toddlers whose mothers had the highest adjusted prenatal depression scores. This indicates that both prenatal lead exposure and exposure to prenatal maternal depression impact the developing temperament of the child. The inclusion in our models of the mother’s prenatal depression score adjusted for the 24-month post-partum depression risk scores allows us to differentiate an association between prenatal depression risk and temperament from the known association between concurrent maternal depression and maternal report of difficult temperament. Prenatal mercury exposure and SES did not modify the effect of prenatal depression on infant temperament in our analyses.
The impact of in utero exposure to maternal depression and/or environmental chemicals on temperament and the interplay of multiple co-exposures on the establishment of temperament have not been evaluated previously. Our data suggest that cumulative lead exposure rather than a single second trimester lead measurement best predicts the lead-temperament association and that the joint impact of lead and prenatal depression is most predictive of difficult temperament. Tibia bone lead level, which has a half-life of 12 years or more, reflects cumulative lead exposure over the mother’s life-time [46, 83]. Previous studies have demonstrated that bone lead is a better predictor of infant development than blood lead, perhaps due to its longer half-life [48, 84]. However, bone lead cannot distinguish whether there is a specific window of sensitivity for lead exposure. Understanding the role of exposure timing could allow us to develop early intervention strategies.
As the PROGRESS cohort ages, we are measuring other neurobehavioral domains, such as attention, impulsivity, spatial memory, motivation, time estimation and internalizing/externalizing behaviors to further assess the impact of exposure to metals and maternal depression on child behavioral development. We will also address the role of temperament as a predictor of these neurobehavioral phenotypes.
Our study has a number of strengths. As a large, prospective birth cohort study focused on perinatal environmental exposures, both social and chemical environmental factors were assessed prospectively and longitudinally multiple times through pregnancy and early childhood. The EPDS, the BSID and the TTS are validated research measures that were administered by trained study staff, all of whom had masters or doctoral degrees in child psychology. Our statistical approach using LPA reduced the dimensionality of the multiple outcome subscales into a single 3 level index that clearly identified distinct phenotypes similar to those described in prior studies of infant temperament. The relationship of these three phenotypes with BSID performance further allowed us to validate our LPA profiles. Collecting multiple measures of lead exposure allowed us to distinguish between effects of blood lead level at a specific time point as well as cumulative lead.
Our study also has some limitations. The study population is composed of families in urban Mexico, and results may not be fully generalizable to other populations in other settings. Lead exposure in our cohort is generally higher and SES lower than in the United States, but this allows us to test our hypotheses more cost-effectively. Maternal depression was estimated by the EPDS, which is a screening rather than a diagnostic tool, so some women who had positive screens may not have met diagnostic criteria for clinical depression. As is the case for most assessment tools of temperament in childhood, the TTS relies on subjective maternal report.
Conclusions
Prenatal exposure to maternal depression is associated with more difficult temperament traits at age two. This association is potentiated by concurrent prenatal exposure to environmental lead.
Abbreviations
BIC, Bayesian information criteria; BSID, Bayley Scales of Infant and Toddler Development, 3rd edition; CI, confidence interval; EPDS, Edinburgh Postnatal Depression Scale; IQR, interquartile range; K-XRF, K-shell X-ray fluorescence; LPA, latent profile analysis; OR, odds ratio; SD, standard deviation; SES, socioeconomic status; TTS, Toddler Temperament Scale
Acknowledgements
Dr. Stroustrup is supported by grant K23ES022268 from the National Institutes of Environmental Health Sciences (NIEHS). Additional funding for the investigators and this project comes through NIEHS grants R01ES013744, R01ES014930, R01ES021357, P30ES023515, and P42ES016454. The investigators would also like to acknowledge el Centro Medico ABC and the National Institute of Perinatology (Mexico) for provision of medical facilities used in study subject recruitment and evaluation.
Funding source
Dr. Stroustrup is supported by grant K23ES022268 from the National Institutes of Environmental Health Sciences (NIEHS). Additional funding for the investigators and this project comes through NIEHS grants R01ES013744, R01ES014930, R01ES021357, P30ES023515, and P42ES016454 and the National Institute of Public Health in Mexico.
Availability of data and supporting materials
The dataset and novel code supporting the conclusions of this article are available in the Open Science Framework repository osf.io/73qxe (https://osf.io/73qxe).
Authors’ contributions
AS conceptualized and designed the study, carried out the initial analyses, drafted the initial manuscript, and approved the final manuscript as submitted. HHH conceptualized and designed the study, carried out the initial analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. KS carried out the initial analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. LS, AC, MSG, MTC, and MTR designed the data collection instruments, coordinated and supervised data collection, critically reviewed the manuscript, and approved the final manuscript as submitted. CA completed laboratory analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. DCB critically reviewed the manuscript and approved the final manuscript as submitted. BAC conceptualized and designed the statistical analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. ROW, RJW, and MTR conceptualized and designed the study, reviewed and revised the manuscript, and approved the final manuscript as submitted.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Research ethics committees of the participating institutions approved the study (the Comité de Investigación, Comité de Bioseguridad, and the Comité de Ética en la Investigación of the National Institute of Public Health, Mexico, the Partners Human Research Committee at Brigham and Women’s Hospital, the Office of Human Research Administration at the Harvard School of Public Health, and the Program for the Protection of Human Subjects at the Icahn School of Medicine at Mount Sinai).
Financial disclosure
The authors have no financial relationships relevant to this article to disclose.
References
- 1.Bagner DM, Rodriguez GM, Blake CA, Linares D, Carter AS. Assessment of behavioral and emotional problems in infancy: a systematic review. Clin Child Fam Psychol Rev. 2012;15(2):113–28. doi: 10.1007/s10567-012-0110-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Fullard W, McDevitt SC, Carey WB. Assessing temperament in one- to three-year-old children. J Pediatr Psychol. 1984;9(2):205–17. doi: 10.1093/jpepsy/9.2.205. [DOI] [PubMed] [Google Scholar]
- 3.Papageorgiou KA, Ronald A. “He who sees things grow from the beginning will have the finest view of them” a systematic review of genetic studies on psychological traits in infancy. Neurosci Biobehav Rev. 2013;37(8):1500–17. doi: 10.1016/j.neubiorev.2013.04.013. [DOI] [PubMed] [Google Scholar]
- 4.McInerny T, Chamberlin RW. Is it feasible to identify infants who are at risk for later behavioral problems? The Carey Temperament Questionnaire as a prognostic tool. Clin Pediatr (Phila) 1978;17(3):233–8. doi: 10.1177/000992287801700305. [DOI] [PubMed] [Google Scholar]
- 5.Sayal K, Heron J, Maughan B, Rowe R, Ramchandani P. Infant temperament and childhood psychiatric disorder: longitudinal study. Child Care Health Dev. 2014;40(2):292–7. doi: 10.1111/cch.12054. [DOI] [PubMed] [Google Scholar]
- 6.Teerikangas OM, Aronen ET, Martin RP, Huttunen MO. Effects of infant temperament and early intervention on the psychiatric symptoms of adolescents. J Am Acad Child Adolesc Psychiatry. 1998;37(10):1070–6. doi: 10.1097/00004583-199810000-00017. [DOI] [PubMed] [Google Scholar]
- 7.Karalunas SL, Fair D, Musser ED, Aykes K, Iyer SP, Nigg JT. Subtyping attentiondeficit/hyperactivity disorder using temperamentdimensions: toward biologically based nosologic criteria. JAMA Psychiatry. 2014;71(9):1015–24. doi: 10.1001/jamapsychiatry.2014.763. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 8.Anzman-Frasca S, Stifter CA, Birch LL. Temperament and childhood obesity risk: a review of the literature. J Dev Behav Pediatr. 2012;33(9):732–45. doi: 10.1097/DBP.0b013e31826a119f. [DOI] [PubMed] [Google Scholar]
- 9.Hardee JE, Benson BE, Bar-Haim Y, Mogg K, Bradley BP, Chen G, et al. Patterns of neural connectivity during an attention bias task moderate associations between early childhood temperament and internalizing symptoms in young adulthood. Biol Psychiatry. 2013;74(4):273–9. doi: 10.1016/j.biopsych.2013.01.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hartman C, Hopfer C, Corley R, Hewitt J, Stallings M. Using Cloninger’s temperament scales to predict substance-related behaviors in adolescents: a prospective longitudinal study. Am J Addict. 2013;22(3):246–51. doi: 10.1111/j.1521-0391.2012.12010.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lahat A, Perez-Edgar K, Degnan KA, Guyer AE, Lejuez CW, Ernst M, et al. Early childhood temperament predicts substance use in young adults. Transl Psychiatry. 2012;2:e157. doi: 10.1038/tp.2012.87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Slutske WS, Moffitt TE, Poulton R, Caspi A. Undercontrolled temperament at age 3 predicts disordered gambling at age 32: a longitudinal study of a complete birth cohort. Psychol Sci. 2012;23(5):510–6. doi: 10.1177/0956797611429708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Smith AK, Rhee SH, Corley RP, Friedman NP, Hewitt JK, Robinson JL. The magnitude of genetic and environmental influences on parental and observational measures of behavioral inhibition and shyness in toddlerhood. Behav Genet. 2012;42(5):764–77. doi: 10.1007/s10519-012-9551-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Spungen LB, Farran AC. Effect of intensive care unit exposure on temperament in low birth weight preterm infants. J Dev Behav Pediatr. 1986;7(5):288–92. doi: 10.1097/00004703-198610000-00002. [DOI] [PubMed] [Google Scholar]
- 15.Riese ML. Genetic influences on neonatal temperament. Acta Genet Med Gemellol (Roma) 1990;39(2):207–13. doi: 10.1017/s0001566000005432. [DOI] [PubMed] [Google Scholar]
- 16.Zhu P, Sun MS, Hao JH, Chen YJ, Jiang XM, Tao RX, et al. Does prenatal maternal stress impair cognitive development and alter temperament characteristics in toddlers with healthy birth outcomes? Dev Med Child Neurol. 2014;56(3):283–9. doi: 10.1111/dmcn.12378. [DOI] [PubMed] [Google Scholar]
- 17.Bellinger D, Leviton A, Allred E, Rabinowitz M. Pre- and postnatal lead exposure and behavior problems in school-aged children. Environ Res. 1994;66(1):12–30. doi: 10.1006/enrs.1994.1041. [DOI] [PubMed] [Google Scholar]
- 18.Boucher O, Jacobson SW, Plusquellec P, Dewailly E, Ayotte P, Forget-Dubois N, et al. Prenatal methylmercury, postnatal lead exposure, and evidence of attention deficit/hyperactivity disorder among Inuit children in Arctic Quebec. Environ Health Perspect. 2012;120(10):1456–61. doi: 10.1289/ehp.1204976. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Hu H, Tellez-Rojo MM, Bellinger D, Smith D, Ettinger AS, Lamadrid-Figueroa H, et al. Fetal lead exposure at each stage of pregnancy as a predictor of infant mental development. Environ Health Perspect. 2006;114(11):1730–5. doi: 10.1289/ehp.9067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Lam HS, Kwok KM, Chan PH, So HK, Li AM, Ng PC, et al. Long term neurocognitive impact of low dose prenatal methylmercury exposure in Hong Kong. Environ Int. 2013;54:59–64. doi: 10.1016/j.envint.2013.01.005. [DOI] [PubMed] [Google Scholar]
- 21.Ronchetti R, van den Hazel P, Schoeters G, Hanke W, Rennezova Z, Barreto M, et al. Lead neurotoxicity in children: is prenatal exposure more important than postnatal exposure? Acta Paediatr Suppl. 2006;95(453):45–9. doi: 10.1111/j.1651-2227.2007.00144.x. [DOI] [PubMed] [Google Scholar]
- 22.Sagiv SK, Thurston SW, Bellinger DC, Amarasiriwardena C, Korrick SA. Prenatal exposure to mercury and fish consumption during pregnancy and attention-deficit/hyperactivity disorder-related behavior in children. Arch Pediatr Adolesc Med. 2012;166(12):1123–31. doi: 10.1001/archpediatrics.2012.1286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Schnaas L, Rothenberg SJ, Flores MF, Martinez S, Hernandez C, Osorio E, et al. Reduced intellectual development in children with prenatal lead exposure. Environ Health Perspect. 2006;114(5):791–7. doi: 10.1289/ehp.8552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Cowell WJ, Bellinger DC, Coull BA, Gennings C, Wright RO, Wright RJ. Associations between Prenatal Exposure to Black Carbon and Memory Domains in Urban Children: Modification by Sex and Prenatal Stress. PLoS One. 2015;10(11):e0142492. doi: 10.1371/journal.pone.0142492. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Barker ED, Kirkham N, Ng J, Jensen SK. Prenatal maternal depression symptoms and nutrition, and child cognitive function. Br J Psychiatry. 2013;203(6):417–21. doi: 10.1192/bjp.bp.113.129486. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Dulawa SC. Epigenetic programing of depression during gestation. Bioessays. 2014;36(4):353–8. doi: 10.1002/bies.201300089. [DOI] [PubMed] [Google Scholar]
- 27.Musaelyan K, Egeland M, Fernandes C, Pariante CM, Zunszain PA, Thuret S. Modulation of adult hippocampal neurogenesis by early-life environmental challenges triggering immune activation. Neural Plast. 2014;2014:194396. doi: 10.1155/2014/194396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wright RJ. Moving towards making social toxins mainstream in children’s environmental health. Curr Opin Pediatr. 2009;21(2):222–9. doi: 10.1097/MOP.0b013e3283292629. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Wright RJ. Psychological stress: a social pollutant that may enhance environmental risk. Am J Respir Crit Care Med. 2011;184(7):752–4. doi: 10.1164/rccm.201106-1139ED. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wright RJ, Fisher K, Chiu YH, Wright RO, Fein R, Cohen S, et al. Disrupted prenatal maternal cortisol, maternal obesity, and childhood wheeze. Insights into prenatal programming. Am J Respir Crit Care Med. 2013;187(11):1186–93. doi: 10.1164/rccm.201208-1530OC. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Deave T, Heron J, Evans J, Emond A. The impact of maternal depression in pregnancy on early child development. BJOG. 2008;115(8):1043–51. doi: 10.1111/j.1471-0528.2008.01752.x. [DOI] [PubMed] [Google Scholar]
- 32.Field T. Prenatal depression effects on early development: a review. Infant Behav Dev. 2011;34(1):1–14. doi: 10.1016/j.infbeh.2010.09.008. [DOI] [PubMed] [Google Scholar]
- 33.Clougherty JE, Kubzansky LD. A framework for examining social stress and susceptibility to air pollution in respiratory health. Cien Saude Colet. 2010;15(4):2059–74. doi: 10.1590/S1413-81232010000400020. [DOI] [PubMed] [Google Scholar]
- 34.Clougherty JE, Levy JI, Kubzansky LD, Ryan PB, Suglia SF, Canner MJ, et al. Synergistic effects of traffic-related air pollution and exposure to violence on urban asthma etiology. Environ Health Perspect. 2007;115(8):1140–6. doi: 10.1289/ehp.9863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Farley KJ, Meyer JS. Metal mixture modeling evaluation project: 3. Lessons learned and steps forward. Environ Toxicol Chem. 2015;34(4):821–32. doi: 10.1002/etc.2837. [DOI] [PubMed] [Google Scholar]
- 36.Farley KJ, Meyer JS, Balistrieri LS, De Schamphelaere KA, Iwasaki Y, Janssen CR, et al. Metal Mixture Modeling Evaluation project: 2. Comparison of four modeling approaches. Environ Toxicol Chem. 2015;34(4):741–53. doi: 10.1002/etc.2820. [DOI] [PubMed] [Google Scholar]
- 37.Gallagher SS, Rice GE, Scarano LJ, Teuschler LK, Bollweg G, Martin L. Cumulative risk assessment lessons learned: A review of case studies and issue papers. Chemosphere. 2015;120C:697–705. doi: 10.1016/j.chemosphere.2014.10.030. [DOI] [PubMed] [Google Scholar]
- 38.Hicken MT, Adar SD, Diez Roux AV, O’Neill MS, Magzamen S, Auchincloss AH, et al. Do psychosocial stress and social disadvantage modify the association between air pollution and blood pressure?: the multi-ethnic study of atherosclerosis. Am J Epidemiol. 2013;178(10):1550–62. doi: 10.1093/aje/kwt190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Meyer JS, Farley KJ, Garman ER. Metal mixtures modeling evaluation project: 1. Background. Environ Toxicol Chem. 2015;34(4):726–40. doi: 10.1002/etc.2792. [DOI] [PubMed] [Google Scholar]
- 40.Peters JL, Kubzansky L, McNeely E, Schwartz J, Spiro A, 3rd, Sparrow D, et al. Stress as a potential modifier of the impact of lead levels on blood pressure: the normative aging study. Environ Health Perspect. 2007;115(8):1154–9. doi: 10.1289/ehp.10002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Shmool JL, Kubzansky LD, Newman OD, Spengler J, Shepard P, Clougherty JE. Social stressors and air pollution across New York City communities: a spatial approach for assessing correlations among multiple exposures. Environ Health. 2014;13:91. doi: 10.1186/1476-069X-13-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Zota AR, Shenassa ED, Morello-Frosch R. Allostatic load amplifies the effect of blood lead levels on elevated blood pressure among middle-aged U.S. adults: a cross-sectional study. Environ Health. 2013;12(1):64. doi: 10.1186/1476-069X-12-64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Burris HH, Braun JM, Byun HM, Tarantini L, Mercado A, Wright RJ, et al. Association between birth weight and DNA methylation of IGF2, glucocorticoid receptor and repetitive elements LINE-1 and Alu. Epigenomics. 2013;5(3):271–81. doi: 10.2217/epi.13.24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Carrasco AV. The AMAI system of classifying households by socio-economic level: ESOMAR; 2002. (www.esomar.org)
- 45.Chuang HY, Schwartz J, Gonzales-Cossio T, Lugo MC, Palazuelos E, Aro A, et al. Interrelations of lead levels in bone, venous blood, and umbilical cord blood with exogenous lead exposure through maternal plasma lead in peripartum women. Environ Health Perspect. 2001;109(5):527–32. doi: 10.1289/ehp.01109527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Hu H, Rabinowitz M, Smith D. Bone lead as a biological marker in epidemiologic studies of chronic toxicity: conceptual paradigms. Environ Health Perspect. 1998;106(1):1–8. doi: 10.1289/ehp.981061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Hernandez-Avila M, Peterson KE, Gonzalez-Cossio T, Sanin LH, Aro A, Schnaas L, et al. Effect of maternal bone lead on length and head circumference of newborns and 1-month-old infants. Arch Environ Health. 2002;57(5):482–8. doi: 10.1080/00039890209601441. [DOI] [PubMed] [Google Scholar]
- 48.Hu H. Bone lead as a new biologic marker of lead dose: recent findings and implications for public health. Environ Health Perspect. 1998;106(Suppl 4):961–7. doi: 10.1289/ehp.98106s4961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Tellez-Rojo MM, Hernandez-Avila M, Lamadrid-Figueroa H, Smith D, Hernandez-Cadena L, Mercado A, et al. Impact of bone lead and bone resorption on plasma and whole blood lead levels during pregnancy. Am J Epidemiol. 2004;160(7):668–78. doi: 10.1093/aje/kwh271. [DOI] [PubMed] [Google Scholar]
- 50.Mordukhovich I, Wright RO, Hu H, Amarasiriwardena C, Baccarelli A, Litonjua A, et al. Associations of toenail arsenic, cadmium, mercury, manganese, and lead with blood pressure in the normative aging study. Environ Health Perspect. 2012;120(1):98–104. doi: 10.1289/ehp.1002805. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Bayley N. Bayley Scales of Infant and Toddler Development. San Antonio: The Psychological Corporation; 2006. [Google Scholar]
- 52.Chess S, Thomas A, Rutter M, Birch HG. Interaction of temperament and environment in the production of behavioral disturbances in children. Am J Psychiatry. 1963;120:142–8. doi: 10.1176/ajp.120.2.142. [DOI] [PubMed] [Google Scholar]
- 53.Carey WB, McDevitt SC. Revision of the Infant Temperament Questionnaire. Pediatrics. 1978;61(5):735–9. [PubMed] [Google Scholar]
- 54.Carey WB. A simplified method for measuring infant temperament. J Pediatr. 1970;77(2):188–94. doi: 10.1016/S0022-3476(70)80322-5. [DOI] [PubMed] [Google Scholar]
- 55.Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150:782–6. doi: 10.1192/bjp.150.6.782. [DOI] [PubMed] [Google Scholar]
- 56.Cox JL, Chapman G, Murray D, Jones P. Validation of the Edinburgh Postnatal Depression Scale (EPDS) in non-postnatal women. J Affect Disord. 1996;39(3):185–9. doi: 10.1016/0165-0327(96)00008-0. [DOI] [PubMed] [Google Scholar]
- 57.Murray D, Cox JL. Screening for depression during pregnancy with the Edinburgh Postnatal Depression Scale (EPDS) J Reprod Infant Psychol. 1990;8:99–106. doi: 10.1080/02646839008403615. [DOI] [Google Scholar]
- 58.Murray L, Carothers AD. The validation of the Edinburgh Post-natal Depression Scale on a community sample. Br J Psychiatry. 1990;157:288–90. doi: 10.1192/bjp.157.2.288. [DOI] [PubMed] [Google Scholar]
- 59.Boyce P, Stubbs J, Todd A. The Edinburgh Postnatal Depression Scale: validation for an Australian sample. Aust N Z J Psychiatry. 1993;27(3):472–6. doi: 10.3109/00048679309075805. [DOI] [PubMed] [Google Scholar]
- 60.Hanington L, Ramchandani P, Stein A. Parental depression and child temperament: assessing child to parent effects in a longitudinal population study. Infant Behav Dev. 2010;33(1):88–95. doi: 10.1016/j.infbeh.2009.11.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Kerstis B, Engstrom G, Edlund B, Aarts C. Association between mothers’ and fathers’ depressive symptoms, sense of coherence and perception of their child’s temperament in early parenthood in Sweden. Scand J Public Health. 2013;41(3):233–9. doi: 10.1177/1403494812472006. [DOI] [PubMed] [Google Scholar]
- 62.Di Florio A, Forty L, Gordon-Smith K, Heron J, Jones L, Craddock N, et al. Perinatal episodes across the mood disorder spectrum. JAMA Psychiatry. 2013;70(2):168–75. doi: 10.1001/jamapsychiatry.2013.279. [DOI] [PubMed] [Google Scholar]
- 63.Serati M, Redaelli M, Buoli M, Altamura AC. Perinatal Major Depression Biomarkers: A systematic review. J Affect Disord. 2016;193:391–404. doi: 10.1016/j.jad.2016.01.027. [DOI] [PubMed] [Google Scholar]
- 64.Fitzmaurice GM, Laird LM, Ware JH. Applied Longitudinal Analysis. 2. New York: Wiley; 2011. [Google Scholar]
- 65.Vermunt J, Magidson J. Latent class cluster analysis. In: Hagenaars J, McCutcheon A, editors. Applied Latent Class ANalysis. Cambridge: Cambridge University Press; 2002. pp. 89–106. [Google Scholar]
- 66.D’Unger A, Land K, McCall P, Nagin D. How mandy latent classes of delinquent/criminal careers? Results from mixed Poisson regression analyses of the London, Philadelphia, and Racine Cohort Studies. Am J Sociol. 1998;103(6):1593–630. doi: 10.1086/231402. [DOI] [Google Scholar]
- 67.Wien) IfSaMoWW. Normal Mixture Modeling fitted via EM algorithm for Model-Based Clustering, Classification, and Density Estimation, including Bayesian regularization. The Comprehensive R Archive Network. http://cran.r-project.org/web/packages/mclust/index.html. Published 2014. Accessed 25 April 2014, 2014.
- 68.Laake LM, Bridgett DJ. Happy babies, chatty toddlers: infant positive affect facilitates early expressive, but not receptive language. Infant Behav Dev. 2014;37(1):29–32. doi: 10.1016/j.infbeh.2013.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Liu J, Bann C, Lester B, Tronick E, Das A, Lagasse L, et al. Neonatal neurobehavior predicts medical and behavioral outcome. Pediatrics. 2010;125(1):e90–8. doi: 10.1542/peds.2009-0204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Sajaniemi N, Hakamies-blomqvist L, Mäkelä J, Avellan A, Rita H, von Wendt L. Cognitive Development, Temperament and Behavior at 2 Years as Indicative of Language Development at 4 Years in Pre-Term Infants. Child Psychiatry Hum Dev. 2001;31(4):329–46. doi: 10.1023/A:1010238523628. [DOI] [PubMed] [Google Scholar]
- 71.Team RDC . R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2014. [Google Scholar]
- 72.Garello V, Viterbori P, Usai MC. Temperamental profiles and language development: a replication and an extension. Infant Behav Dev. 2012;35(1):71–82. doi: 10.1016/j.infbeh.2011.09.003. [DOI] [PubMed] [Google Scholar]
- 73.Bellinger DC. Future directions for neurobehavioral studies of environmental neurotoxicants. Neurotoxicology. 2001;22(5):645–56. doi: 10.1016/S0161-813X(01)00036-5. [DOI] [PubMed] [Google Scholar]
- 74.Betts KS, Williams GM, Najman JM, Alati R. Maternal depressive, anxious, and stress symptoms during pregnancy predict internalizing problems in adolescence. Depress Anxiety. 2014;31(1):9–18. doi: 10.1002/da.22210. [DOI] [PubMed] [Google Scholar]
- 75.Dorrington S, Zammit S, Asher L, Evans J, Heron J, Lewis G. Perinatal maternal life events and psychotic experiences in children at twelve years in a birth cohort study. Schizophr Res. 2014;152(1):158–63. doi: 10.1016/j.schres.2013.11.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Glasheen C, Richardson GA, Kim KH, Larkby CA, Swartz HA, Day NL. Exposure to maternal pre- and postnatal depression and anxiety symptoms: risk for major depression, anxiety disorders, and conduct disorder in adolescent offspring. Dev Psychopathol. 2013;25(4 Pt 1):1045–63. doi: 10.1017/S0954579413000369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Burns JM, Baghurst PA, Sawyer MG, McMichael AJ, Tong SL. Lifetime low-level exposure to environmental lead and children’s emotional and behavioral development at ages 11–13 years. The Port Pirie Cohort Study. Am J Epidemiol. 1999;149(8):740–9. doi: 10.1093/oxfordjournals.aje.a009883. [DOI] [PubMed] [Google Scholar]
- 78.Dietrich KN, Ris MD, Succop PA, Berger OG, Bornschein RL. Early exposure to lead and juvenile delinquency. Neurotoxicol Teratol. 2001;23(6):511–8. doi: 10.1016/S0892-0362(01)00184-2. [DOI] [PubMed] [Google Scholar]
- 79.Kordas K, Stoltzfus RJ, Lopez P, Rico JA, Rosado JL. Iron and zinc supplementation does not improve parent or teacher ratings of behavior in first grade Mexican children exposed to lead. J Pediatr. 2005;147(5):632–9. doi: 10.1016/j.jpeds.2005.06.037. [DOI] [PubMed] [Google Scholar]
- 80.Grandjean P, Weihe P, Nielsen F, Heinzow B, Debes F, Budtz-Jorgensen E. Neurobehavioral deficits at age 7 years associated with prenatal exposure to toxicants from maternal seafood diet. Neurotoxicol Teratol. 2012;34(4):466–72. doi: 10.1016/j.ntt.2012.06.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Bohlin G, Hagekull B. Socio-emotional development: from infancy to young adulthood. Scand J Psychol. 2009;50(6):592–601. doi: 10.1111/j.1467-9450.2009.00787.x. [DOI] [PubMed] [Google Scholar]
- 82.Nigg JT, Goldsmith HH, Sachek J. Temperament and attention deficit hyperactivity disorder: the development of a multiple pathway model. J Clin Child Adolesc Psychol. 2004;33(1):42–53. doi: 10.1207/S15374424JCCP3301_5. [DOI] [PubMed] [Google Scholar]
- 83.Garrido Latorre F, Hernandez-Avila M, Tamayo Orozco J, Albores Medina CA, Aro A, Palazuelos E, et al. Relationship of blood and bone lead to menopause and bone mineral density among middle-age women in Mexico City. Environ Health Perspect. 2003;111(4):631–6. doi: 10.1289/ehp.5149. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Silbergeld EK. Lead in bone: implications for toxicology during pregnancy and lactation. Environ Health Perspect. 1991;91:63–70. doi: 10.1289/ehp.919163. [DOI] [PMC free article] [PubMed] [Google Scholar]