Abstract
Background:
Metals, including lead (Pb), manganese (Mn), chromium (Cr) and copper (Cu), have been associated with neurodevelopment; iron (Fe) plays a role in the metabolism and neurotoxicity of metals, suggesting Fe may mediate metal-neurodevelopment associations. However, no study to date has examined Fe as a mediator of the association between metal mixtures and neurodevelopment.
Objective:
We assessed Fe status as a mediator of a mixture of Pb, Mn, Cr and Cu in relation to verbal learning and memory in a cohort of Italian adolescents.
Methods:
We used cross-sectional data from 383 adolescents (10–14 years) in the Public Health Impact of Metals Exposure Study. Metals were quantified in blood (Pb) or hair (Mn, Cr, Cu) using ICP-MS, and three metrics of Fe status (blood hemoglobin, serum ferritin and transferrin) were quantified using luminescence assays or immunoassays. Verbal learning and memory were assessed using the California Verbal Learning Test for Children (CVLT-C). We used Bayesian Kernel Machine Regression Causal Mediation Analysis to estimate four mediation effects: the natural direct effect (NDE), natural indirect effect (NIE), controlled direct effect (CDE) and total effect (TE). Beta (β) coefficients and 95% credible intervals (CIs) were estimated for all effects.
Results:
The metal mixture was jointly associated with a greater number of words recalled on the CVLT-C, but these associations were not mediated by Fe status. For example, when ferritin was considered as the mediator, the NIE for long delay free recall was null (β=0.00; 95% CI=−0.22, 0.23). Conversely, the NDE (β=0.23; 95% CI=0.01, 0.44) indicated a beneficial association of the mixture with recall that operated independently of Fe status.
Conclusion:
An industry-relevant metal mixture was associated with learning and memory, but there was no evidence of mediation by Fe status. Further studies in populations with Fe deficiency and greater variation in metal exposure are warranted.
Keywords: metals, mixtures, neurodevelopment, mediation, iron status
Graphical Abstract

1. INTRODUCTION
Environmental exposure to metals, including lead (Pb), manganese (Mn), copper (Cu), chromium (Cr), and iron (Fe), is common among children, and can occur through air emissions, drinking water, and contact with contaminated soils (Agency for Toxic Substances and Disease Registry, 2020, 2012a, 2012b, 2004). Children living in close proximity to industry, such as the steel-producing ferroalloy industry, may be more highly exposed to metals, and prior research in the U.S., Canada, Brazil and elsewhere has reported higher biomarker concentrations of these metals among children living near ferroalloy plants (Boudissa et al., 2006; Butler et al., 2019; Haynes et al., 2012; Menezes-Filho et al., 2016, 2009; Riojas-Rodríguez et al., 2010). These findings are of public health concern because metals have been consistently associated with adverse neurodevelopment (Amorós et al., 2019; Caparros-Gonzalez et al., 2019; Carvalho et al., 2018; García-Chimalpopoca et al., 2019; Oulhote et al., 2014; Torres-Agustín et al., 2013; Wright et al., 2006; Yorifuji et al., 2011), and the ferroalloy industry is expanding globally (“Ferroalloy Market Share 2018–2025 Industry Growth Outlook Report,” n.d.).
Children are exposed to multiple environmental metals simultaneously (Agency for Toxic Substances and Disease Registry, 2020, 2012b, 2012a, 2004), and many metals share similar neurotoxic pathways (e.g., dopaminergic toxicity, oxidative stress, mitochondrial disruption) (Ahamed and Siddiqui, 2007; Akinyemi et al., 2019; Gaetke et al., 2014; Kalita et al., 2018; Neal and Guilarte, 2013; O’Neal et al., 2014; Wise et al., 2022). These toxicological data suggest that concurrent exposure to multiple metals can induce joint or interactive neurodevelopmental effects. Findings in animals are generally consistent with studies in pediatric cohorts, which have reported cumulative effects of multiple metals on cognition (Chandra et al., 1981; Merced-Nieves et al., 2021; Shukla and Chandra, 1987; Stein et al., 2022). In the Public Health Impact of Metals Exposure (PHIME) study, we previously found that a mixture of Mn, Pb, Cu and Cr was jointly associated with indices of neurodevelopment, though the direction of effect varied by cognitive domain. For example, the metal mixture was adversely associated with verbal intelligence quotient (IQ) and visuospatial abilities (Bauer et al., 2020a; Rechtman et al., 2020), but beneficially associated with verbal learning and memory measured on the California Verbal Learning Test for Children (CVLT-C) (Schildroth et al., 2023).
Recent epidemiological studies have investigated the role of Fe status, clinically measured through biomarkers like ferritin, hemoglobin, and transferrin (Gibson, 2005), as a modifier of the neurotoxicity of environmental metals in children (Schildroth et al., 2023, 2022b). Fe is a metal and essential nutrient required for cellular oxygen transport, neurotransmitter synthesis, and metabolic activity, and is therefore important for brain development and maturation (McCann et al., 2020). Perturbations to Fe status in gestation, early childhood, and adolescence have been consistently associated with worse scores on assessments of attention-related behaviors, memory, visuospatial abilities, IQ, and academic achievement (Halterman et al., 2001; Jáuregui-Lobera, 2014; Ji et al., 2017; Lukowski et al., 2010; Parkin et al., 2020; Roy et al., 2011; Tseng et al., 2018). A recent study of 922 adolescents observed reduced cognitive abilities among participants with lower brain Fe concentrations (measured using R2* relaxometry from magnetic resonance imaging) (Larsen et al., 2020). On the other hand, Fe overload has similarly been associated with decreased IQ scores in children, reflecting the neurotoxic impacts (i.e., oxidative stress) of Fe in excess (Salvador et al., 2011; Sammallahti et al., 2022). In addition, the toxicokinetics and toxicodynamics of Fe are similar to those of other metals. Fe and environmental metals like Pb and Mn share neurotoxic mechanisms (oxidative stress, mitochondrial disruption, altered neurotransmission and disruption of myelination) (Barkur and Bairy, 2015; Borchard et al., 2018; Fernsebner et al., 2014; Galaris et al., 2019; McCann et al., 2020; Neal and Guilarte, 2013; Soares et al., 2020; Walter et al., 2002), and also compete for transporters (e.g., the divalent metal transporter 1) in the duodenum, brain, and liver (Brain et al., 2006; Kordas, 2010; Kordas and Stoltzfus, 2004; Peraza et al., 1998). Environmental metals tend to deposit more into Fe-deficient, compared to Fe-replete, brain tissues in animal models, and this tendency has been further shown to impact neurotransmitter concentrations (Erikson et al., 2002; Kordas, 2010). These data support a body of evidence indicating that altered Fe status, in particular deficiency, impacts the neurotoxicity of environmental metals in children.
Environmental metal exposure may also affect Fe dynamics in the body. The hematologic toxicity of certain metals has been established: Pb, for example, disrupts heme synthesis, transferrin expression, erythrocyte membranes, and erythropoietin production, particularly at concentrations >10 μg/dL (Agency for Toxic Substances and Disease Registry, 2020; McCann et al., 2020; Peters et al., 2021; Rossander-Hultén et al., 1991). Though the hematologic toxicity of metals has been shown primarily with respect to hemoglobin, there is some evidence that environmental metals adversely impact other metrics of Fe status (e.g., ferritin concentrations) even at low concentrations (e.g., blood Pb <5 μg/dL), which is supported by mechanistic data illustrating the ability of metals to interfere with Fe loading onto proteins (e.g., ferritin) (Liu et al., 2020); however, many prior studies in children were limited by methodological constraints (e.g., cross-sectional design) (Choi and Kim, 2005; Henríquez-Hernández et al., 2017; Jain et al., 2005; Kutllovci-Zogaj et al., 2014; Schildroth et al., 2022a; Wang et al., 2012; Weinhouse et al., 2017). This suggests that, in addition to acting as a modifier of metals-induced toxicity, Fe status may also mediate associations between environmental metals and neurodevelopment (Figure 1, see also: (Schildroth et al., 2022b)).
Fig. 1.
A schematic illustrating the hypothesized role of Fe status as a modifier and mediator of metal-induced neurotoxicity.
A mediator is a variable that lies on the causal pathway between an exposure and outcome of interest. Identifying mediating variables can help to 1) elucidate underlying biological mechanisms of the exposure(s) of interest and 2) identify relevant pathways for potential interventions (Hafeman and Schwartz, 2009). Therefore, characterizing Fe status as a mediator of metal-neurodevelopment associations is an important public health objective, particularly because Fe deficiency is the most common nutritional deficiency in the world (Stevens et al., 2013). Prior work assessing Fe status as a mediator of metals neurotoxicity is limited (Jeong et al., 2015), and no study to date has assessed Fe status as a mediator of environmental metals or of a complex metal mixture.
Our previous study in the PHIME cohort examined Fe status as a modifier of the associations between metal mixture exposure and verbal learning and memory (Schildroth et al., 2023); the goal of the current analysis was to expand on this work and evaluate Fe status as a potential mediator of the industry-relevant metal mixture. We used a novel statistical approach to evaluate associations of a mixture of Pb, Mn, Cu and Cr with verbal learning and memory among adolescents, and to assess Fe status as a mediator of these associations. We hypothesized that the metal mixture was associated with altered Fe status (e.g., reduced ferritin concentrations), and that Fe status was a mediator of the associations between the metal mixture and neurodevelopment.
2. METHODS
2.1. Study Population
We used cross-sectional data from the Public Health Impact of Metals Exposure (PHIME) study, a cohort designed to assess the impact of metal exposures from ferroalloy industry on neurodevelopment among early adolescents (aged 10–14 years). The study population, recruitment procedures, and study protocols have been described in detail elsewhere (Lucchini et al., 2012a). In brief, we recruited 721 adolescents from three sites in Brescia, Italy with varying historical ferroalloy activity. The first site, Bagnolo Mella, had ferroalloy activity since 1974; the second site, Garda Lake, had no historical ferroalloy industry activity; and the third site, Valcamonica, had continuous ferroalloy activity that ended in 2001. Enrollment into PHIME occurred in two distinct waves that reflected two periods of funding: the first wave (2007 – 2010) enrolled 311 participants and the second (2010 – 2014) enrolled 410 participants. All study protocols were consistent between the study phases. During the second phase, we recruited participants from the Bagnolo Mella site, collected additional biomarkers (saliva, urine, nails), and additionally administered selected items from the Home Observation Measurement of the Environment (HOME) Short Form questionnaire (National Longitudinal Surveys, 1979). Participants were eligible for enrollment into PHIME if they 1) were 10 – 14 years at the time of enrollment, 2) lived in the study region since birth and 3) were born into families that lived in the study region since the 1970s. Exclusion criteria were: 1) neurologic, hepatic, metabolic, endocrine, or psychiatric disease, or clinically relevant motor deficits that may have impacted testing, 2) use of medication with neurologic side effects, 3) clinically diagnosed cognitive or behavioral impairment, 4) visual deficits without corrective measures or 5) having ever received parenteral nutrition. Potential participants were given detailed information on all study protocols and gave informed consent prior to enrollment. PHIME study protocols were approved by Institutional Review Boards at the Icahn School of Medicine at Mount Sinai, University of California Santa Cruz, and the Ethical Committee of Brescia.
2.2. Covariate Measurements
Information on covariates was collected by trained study staff either in person or via the phone using standardized questionnaires. We collected data on sociodemographic variables, including age (continuous, in years), biological sex (male or female), area of residence, birth order (first, second, third, or higher), parental occupation, and parental education level. Using World Health Organization and Italian National Institute for Statistics classifications (World Health Organization, 1988), education and occupation levels of both parents were classified as low, medium, or high. A socioeconomic status (SES) index (low, medium, or high) for each participant’s family was constructed based on education and occupation levels for the parent with the highest educational and vocational attainment using previously developed methodology for Italian populations (Cesana et al., 1995; Lucchini et al., 2012b). A HOME score (range: 0 – 9) was calculated for each participant using ten selected items from the HOME Short Form (National Longitudinal Surveys, 1979).
2.3. Biomarker Collection and Measurement
Biomarkers were collected from participants at enrollment. We selected blood as the primary biomarker for Pb because it is the gold standard biomarker of exposure in the epidemiological literature and reflects total body Pb (Barbosa et al., 2005). There is a lack of consensus on the optimal biomarker for Mn, Cu, and Cr (Bertinato and Zouzoulas, 2009; Coetzee et al., 2016; Jursa et al., 2018; Lukaski, 1999). We selected hair as the primary biomarker for these metals because there was little missing hair data, hair has been used to characterize metals exposure previously in the literature (Bauer et al., 2020a), hair metal concentrations have been consistently associated (both beneficially and adversely) with cognitive outcomes in children (Bauer et al., 2020a; Coetzee et al., 2016), and hair metal concentrations have been correlated with environmental exposures (Bauer et al., 2020a; Coetzee et al., 2016). Methodology for quantification of metals in each of these biomarkers has been described previously in depth (Eastman et al., 2013; Lucas et al., 2015; Lucchini et al., 2012a; Smith et al., 2007). Briefly, 4mL whole blood samples were collected using 19-gauge butterfly catheters and stored in lithium-heparin Sarstedt Monovette Vacutainers. Hair samples were collected from the occipital region of the scalp with stainless steel clippers and cleaned extensively using validated methods; exogenous metal contamination was removed using Triton detergent, nitric acid, and sonification, and dried hair samples were then digested using distilled nitric acid (Eastman et al., 2013; Lucas et al., 2015). Hair samples were dried overnight and digested using nitric acid. All biomarker metal concentrations were quantified using magnetic sector inductively coupled plasma mass spectrometry (Eastman et al., 2013; Lucchini et al., 2012a; Smith et al., 2007). Limits of detection (LODs) were defined based on repeated measures of procedural blanks (Butler et al., 2019); LODs ranged from 0.08 to 0.12 μg/g for hair Mn, Cr, and Cu, and the LOD for blood Pb was 0.01 μg/dL.
Fe status was measured from blood samples using three clinically relevant biomarkers: ferritin (ng/mL), hemoglobin (g/dL), and transferrin (mg/dL). Ferritin is considered a sensitive marker of Fe-deficiency and reflects long-term Fe tissue storage; transferrin transports Fe to tissues and reflects Fe availability; and hemoglobin reflects functional Fe status, where low concentrations are indicative of Fe-deficient anemia (Gibson, 2005). Hemoglobin was measured in whole blood samples during a complete blood count (CBC) with the Beckman Coulter LH Series (Beckman Coulter, Inc. Diagnostics Division, CA, USA). Blood samples were collected into tubes containing EDTA coagulant. Ferritin and transferrin were measured in serum using immunoassays with the Architect i2000SR – Abbott Laboratories (Abbott Park, IL, USA) and ADVIA (Siemens Healthcare GmbH, Germany), respectively.
2.4. Cognitive Assessment
The California Verbal Learning Test for Children (CVLT-C) was administered to PHIME participants by trained neuropsychologists to assess verbal learning and memory (Delis et al., 1994). The CVLT-C was only administered to participants during the second phase of PHIME (n= 403). The CVLT-C consists of 5 recall trials (trials 1–5) of a list of 15 verbally presented words (List A). The 15 words include 5 semantically related words from three separate categories (e.g., fruits). Participants then perform a recall trial from an interference list of 15 words (List B). This is followed by additional recall trials of List A, including free (i.e., not cued) and cued recall trials immediately following the interference list (short delay recall) and after 20-minutes (long delay recall). Lastly, participants complete a recognition trial, where they are asked to select target words (i.e., those on List A) from a written list of 44 words that includes both target and distraction words, including words from List B.
CVLT-C outcomes available for analysis included scores for the correct number of target words recalled on trial 1, trial 5, the inference list, the short (free and cued) delay trials, the long (free and cued) delay trials, and the recognition trial. Higher scores (i.e., a higher number of words correctly recalled) for these trials were indicative of better learning and memory. We calculated the number of intrusions, defined as the total number of non-target words recalled across all trials, and the number of perseveration errors, defined as the total number of target words repeated across all trials. Higher scores for both intrusions and perseverations were indicative of worse cognitive function. Lastly, we calculated a metric of forgetting by subtracting the number of correct words on the short delay free recall trial from the number of correct words on the long delay free recall trial (Kreutzer et al., 2011; Strauss et al., 2006). Negative scores for forgetting were indicative of worse memory performance, while positive scores reflected better performance (i.e., better retention or remembering). We a priori selected five CVLT-C outcomes for analysis in the current study, including trial 5 recall, long delay free recall, long delay cued recall, perseveration errors, and forgetting, because these outcomes represent varying aspects of learning and memory function (Table S1).
2.5. Statistical Analysis
All analyses were performed in R version 3.6.1.
2.5.1. Multiple imputation.
The analytic sample for this study was restricted to adolescents with complete outcome data (n= 403). There was little missing data (<6% for covariates and biomarkers, Table S2). Missing biomarker and covariate data were imputed using Markov chain Monte Carlo methods (Zhou et al., 2001) with the mice package in R (Buuren and Groothuis-Oudshoorn, 2011), where missing data were assumed to be missing at random. Twenty datasets were imputed using all covariate data, and one imputed dataset was randomly selected for all subsequent analyses.
2.5.2. Confounder selection.
Confounders were identified a priori using knowledge of the literature, biologic plausibility, and directed acyclic graphs (DAGs) (Bauer et al., 2020b; Carvalho et al., 2018; Kordas, 2010; Torres-Agustín et al., 2013). All models were adjusted for age (continuous), biological sex (binary), HOME score (continuous) and socioeconomic status (ordinal, classified as low, medium, or high).
2.5.3. Summary statistics.
Summary statistics, including medians, 25th percentiles, 75th percentiles, means and standard deviations (SDs), were calculated for all variables. Summary statistics for the randomly selected imputed dataset were similar to the complete data (Table S3). Distributions of all continuous variables were examined; based on visual inspection of histograms and boxplots, we identified several extreme values for metals concentrations. Participants with concentrations of any metal that were ±3 SDs from the mean (n= 20) were excluded from further analyses (final sample size= 383). All metals (Pb, Mn, Cu, Cr), ferritin, and one CVLT-C outcome (perseveration errors) were right-skewed, and we natural log-transformed these variables to reduce the influence of outlier values and to satisfy assumptions of normality of residuals for statistical modeling. Metals, Fe status metrics, and CVLT-C outcomes were z-standardized prior to regression modeling. We estimated Spearman correlation coefficients between the metals and between the CVLT-C outcomes.
2.5.4. Bayesian Kernel Machine Regression.
We used Bayesian Kernel Machine Regression Causal Mediation Analysis (BKMR-CMA) as our primary model to investigate the mediating role of Fe status on associations between the metal mixture (Pb, Mn, Cr, Cu) and verbal learning and memory. BKMR is a highly flexible model that uses a kernel function to model the exposure response surface of the mixture, where individuals in the study population with similar exposure profiles are assumed to have similar neurodevelopment scores (Bobb et al., 2018, 2015). The flexible kernel function allows for non-linearity, metal-metal interactions, higher order interactions (e.g., interactions of an individual metal with the rest of the mixture), and estimation of cumulative effects (Bobb et al., 2018, 2015).
BKMR-CMA is an extension of BKMR used to quantify the mediation of the mixture (Pb, Mn, Cr, Cu) by a third variable, where the mediating variable is also allowed to interact with the mixture by including the mediator (i.e., ferritin, transferrin, hemoglobin) in the kernel function (Devick et al., 2022). Three BKMR models were fit to estimate mediation effects: [1] the outcome model, which quantified the association of the mixture (Pb, Mn, Cr, Cu) with the CVLT-C outcomes when Fe status was included in the kernel function; [2] the mediator model, which quantified the association of the metal mixture (Pb, Mn, Cr, Cu) with Fe status; and [3] the total effects model, which quantified the association of the metal mixture (Pb, Mn, Cr, Cu) with the CVLT-C outcomes when Fe status was excluded from the model.
These models took the following form:
| [1] |
| [2] |
| [3] |
Where represents the kernel function, is the error term, and confounders were assumed to have linear associations with the outcomes.
Each of these models was fit utilizing the default non-informative prior specifications and 50,000 iterations with a 50% burn-in. The component-wise variable selection option was used to estimate posterior inclusion probabilities (PIPs), which describe the relative importance of each component in the kernel function with the outcome while accounting for multiple testing.
Using Equations [1–3], we estimated four mediation effects using previously developed methodology (Devick et al., 2022): the controlled direct effect (CDE), natural direct effect (NDE), natural indirect effect (NIE) and total effect (TE). The CDE described the association of the metal mixture (Pb, Mn, Cr, Cu) with each CVLT-C outcome for an increase in the mixture from its 25th to 75th percentile, holding the mediator (e.g., ferritin) at its 25th, 50th, and 75th percentiles. The NDE quantified the direct association (i.e., not mediated through Fe status) of the mixture (Pb, Mn, Cr, Cu) with each CVLT-C outcome for an increase in the mixture from its 25th to 75th percentiles, holding the mediator constant at the level it would take if the mixture was held at its 25th percentile. The NIE described the indirect association (i.e., mediated through Fe status) of the mixture (Pb, Mn, Cr, Cu) with each CVLT-C outcome when the mixture was held at its 75th percentile, and Fe status was set to the concentration it would have taken when the mixture was set at its 25th percentile compared to its 75th percentile. The TE reflected the sum of both the direct (NDE) and indirect (NIE) pathways. These mediation effects are visualized in Figure 2A. Beta coefficients and 95% credible intervals (CIs) were estimated for all mediation effects.
Fig. 2.
Visualization of the mediation effects estimated from the (A) BKMR-CMA and (B) regression-based models.
BKMR-CMA, Bayesian Kernel Machine Regression Causal Mediation Analysis; TE, total effect; NDE, natural direct effect; NIE, natural indirect effect; CDE, controlled direct effect; Mn, manganese; Pb, lead; Cu, copper; Cr, chromium; CVLT, California Verbal Learning Test; PNDE, pure natural direct effect; TNIE, total natural indirect effect.
We also estimated summary measures to describe associations of the mixture (Pb, Mn, Cr, Cu, Fe status metric) with each CVLT-C outcome (using Equation [1]) and the association of the metal mixture (Pb, Mn, Cr, Cu) with Fe status metrics (using Equation [3]). These summary measures included 1) exposure-response profiles for each exposure variable included in the kernel function, holding all other exposure variables at their medians; 2) exposure-response profiles of each exposure variable included in the kernel function at the 25th, 50th, and 75th percentile of a second exposure variable, while holding other exposure variables at their 50th percentiles; 3) the association for a percentile increase in all exposure variables simultaneously, compared to the 50th percentile of all exposure variables; and 4) the association for each exposure variable included in the kernel function for an increase from its 25th to 75th percentiles, holding all other exposure variables at their 25th, 50th, or 75th percentiles.
2.5.5. Sex-stratified analyses.
Epidemiological evidence suggests that associations of metals with neurodevelopmental outcomes can be sex-specific, and that females are more susceptible to Fe deficiency in adolescence (Bauer et al., 2017; Kounnavong et al., 2020; Llop et al., 2013; Rechtman et al., 2020; Shaw, 1996; Zhu et al., 2021). In exploratory analyses, we fit BKMR-CMA models for each CVLT-C outcome in sex-stratified datasets to examine potential sex-specific effects.
2.5.6. BKMR-CMA sensitivity analyses.
We investigated the sensitivity of our findings to the specification of the priors by fitting the BKMR-CMA models 1) using the gamma prior distribution instead of the default inverse uniform distribution, and 2) changing the degree of smoothness of the function from the default (100) to 50 and 1000 (Bauer et al., 2020a; Valeri et al., 2017). We also performed a complete case analysis, where we fit BKMR-CMA models for one a priori selected CVLT outcome (trial 5 recall) in a restricted sample that included only adolescents with complete data for all biomarkers, CVLT outcomes, and confounders (n= 329).
2.5.7. Generalized additive models (GAMs) and multivariable linear regression.
To investigate the robustness of our BKMR-CMA findings, we additionally used a regression-based causal mediation approach to examine mediation of the association of the individual metals by Fe status. There was limited evidence that the Fe status markers (ferritin, hemoglobin, transferrin) were associated with CVLT-C scores on any subtest, or of mediation of the overall mixture by Fe status, in BKMR-CMA models. We therefore present findings from regression-based approaches only for the association of Cu with trial 5 because Cu was found to drive the beneficial association of the metal mixture with the recall trial outcomes in our previous work (Schildroth et al., 2023).
Because there was evidence of non-linear associations of the metals with Fe status metrics in BKMR-CMA models, we first used Generalized Additive Models (GAMs) to visually inspect the shape of the associations between each metal with the CVLT-C outcomes, each metal with the Fe status metrics, and each Fe status metric with the CVLT-C outcomes. These models were fit using penalized splines (knots= 4) to allow for non-linear associations, and likelihood ratio tests (LRTs) were used to compare fits between the models with and without the penalized splines. GAM plots and LRTs confirmed non-linear associations of the nutrient transition metals (Mn, Cu, Cr) with markers of Fe status observed in the BKMR-CMA models, which is consistent with prior literature (Schildroth et al., 2022a). These essential metals were therefore modeled using GAMs with penalized splines (knots= 4) to account for non-linearity in the mediator regression models that characterized the association between the individual metals and markers of Fe status [Equation 4]. Pb was modeled continuously in these models. Although non-linear associations of the nutrient metals with neurodevelopmental outcomes have been reported previously in the literature (Bauer et al., 2020a; Claus Henn et al., 2010), there was no evidence of non-linear associations of any of the metals or Fe status markers with the CVLT scores. Therefore, all biomarker concentrations were modeled continuously in the outcome linear regression models in Equation [5].
Regression models were fit using the regression-based approach in the CMAverse package in R (Shi et al., 2021; Valeri and VanderWeele, 2013). Mediation effects for the regression-based approach were estimated by fitting an outcome model and a mediator model, specified in Equations [4] and [5], respectively. These models were fully adjusted for all a priori selected confounders, and adjusted for all other metals (Pb, Mn, and Cr).
| [4] |
1These models were fit using GAMs; s() denotes a penalized spline (knots= 4)
| [5] |
1These models were fit using linear regression
As we have previously reported (Schildroth et al., 2023), there was evidence of an interaction between Cu and ferritin for trial 5 recall. Allowing for exposure-mediator interaction is pertinent for correctly specifying the outcome model (VanderWeele, 2016). Therefore, we included an interaction term between Cu and ferritin in the outcome linear regression model when ferritin was considered the mediator.
In the regression-based approach, the total effect (TE) is decomposed into the pure natural direct effect (PNDE) and the total natural indirect effect (TNIE). The PNDE reflects the direct association of the exposure with the outcome when the mediator is set to its natural value at low concentration levels of the exposure, and the TNIE reflects the indirect association of the exposure with the outcome due to both mediation and mediator-exposure interaction (Shi et al., 2021; Valeri and VanderWeele, 2013; Vanderweele, 2014). We report the PNDE and TNIE for the association of Cu with trial 5 when ferritin, transferrin, and hemoglobin were considered the mediators. We also report the CDE for these associations, setting the mediators at their 50th percentiles. These mediation effects are visualized in Figure 2B.
3. RESULTS
About half the participants in the analytic sample were male (53%), lived in the Bagnolo Mella study site (53%) and came from families characterized as medium SES (53%, Table 1). The mean age was 12.3 years (SD: 1.0) and the mean HOME score was 6.0 (SD: 1.7). Median (25th – 75th percentile) hair concentrations for Mn, Cu, and Cr were 0.07 μg/g (0.04 – 0.12 μg/g), 9.4 μg/g (6.6 – 14.8 μg/g), and 0.04 μg/g (0.03 – 0.06 μg/g), respectively. The median blood Pb concentration was 1.3 μg/dL (1.0 – 1.7 μg/g). Females had higher median concentrations of hair Cu (10.3 μg/g; 25th – 75th percentiles: 7.6 – 16.5 μg/g) compared to males (8.6 μg/g; 25th – 75th percentiles: 6.3 – 13.7 μg/g), but males had higher median concentrations of blood Pb (1.4 μg/dL; 25th – 75th percentiles: 1.1 – 2.0 μg/dL) compared to females (1.1 μg/dL; 25th – 75th percentiles: 0.9 – 1.4 μg/dL). Median concentrations of Mn and Cr were similar in males and females (Table S4). Spearman correlation coefficients between the metals were weak and ranged from 0.01 (blood Pb – hair Cu) to 0.35 (hair Mn – hair Cr).
Table 1.
Characteristics of PHIME study participants included in present analysis (n= 383).
| Characteristic | N (percent) or mean ± SD |
|---|---|
|
| |
| Sex | |
| Female | 182 (47.5%) |
| Male | 201 (52.5%) |
| Age (years) | 12.3 ± 1.0 |
| Socioeconomic status index | |
| Low | 89 (23.2%) |
| Medium | 201 (52.5%) |
| High | 93 (24.3%) |
| HOME score | 6.0 ± 1.7 |
| Site | |
| Bagnolo Mella | 204 (53.3%) |
| Garda Lake | 79 (20.6%) |
| Valcamonica | 100 (26.1%) |
| CVLT-C outcomes (raw scores) | |
| Long delay free recall | 11.5 ± 2.1 |
| Long delay cued recall | 11.8 ± 2.1 |
| Trial 5 | 12.3 ± 1.9 |
| Perseveration errors | 7.2 ± 6.1 |
| Forgetting | 0.3 ± 1.6 |
| Metal biomarkers (median, 25th, 75th percentile) | |
| Hair Mn μg/g) | 0.07 (0.04, 0.12) |
| Hair Cu μg/g) | 9.4 (6.6, 14.8) |
| Hair Cr μg/g) | 0.04 (0.03, 0.06) |
| Blood Pb μg/dL) | 1.3 (1.0, 1.7) |
| Iron biomarkers (median, 25th, 75th percentile) | |
| Ferritin (ng/mL) | 32.0 (21.0, 44.0) |
| Transferrin (mg/dL) | 283.0 (260.0, 308.0) |
| Hemoglobin (d/dL) | 13.8 (13.2, 14.4) |
PHIME, Public Health Impact of Metals Exposure Study; HOME, Home Observation Measurement of the Environment; CVLT-C, California Verbal Learning Test for Children; Mn, manganese; Cu, copper; Cr, chromium; Pb, lead.
Median concentrations for serum ferritin (32.0 ng/mL; 25th – 75th percentile: 21.0 – 44.0 ng/mL), serum transferrin (283.0 mg/dL; 25th – 75th percentile: 260.0 – 308.0 mg/dL), and blood hemoglobin (13.8 g/dL; 25th – 75th percentile: 13.2 – 14.4 g/dL) were within normal clinical ranges for adolescents (Gibson, 2005). Males had higher median concentrations of ferritin (33.0 ng/mL vs. 30.0 ng/mL), transferrin (284.0 mg/dL vs. 282.5 mg/dL) and hemoglobin (14.0 g/dL vs. 13.6 g/dL) (Table S4) compared to females, which is typical during the adolescent period (Gibson, 2005).
3.1. Associations of the Metal Mixture with Fe Status
The metal mixture was inconsistently associated with concentrations of Fe status markers. Compared to the 50th percentile of the overall mixture, setting the metal mixture (Pb, Mn, Cr, Cu) to its 90th percentile was associated with lower serum ferritin concentrations (β= −0.19, 95% CI= −0.46, 0.07). Conversely, the 90th percentile of the mixture was associated with a 0.33 SD increase (β= 0.33, 95% CI= 0.03, 0.63) in hemoglobin concentrations, compared to when the metal mixture was set to its 50th percentile. The metal mixture was not materially associated with transferrin concentrations (Figure 3).
Fig. 3.
Joint associations of the metal mixture (Pb, Mn, Cr, Cu) with ferritin, transferrin, and hemoglobin at increasing percentiles (10th, 20th, 30th, 40th, 60th, 70th, 80th, and 90th) of all metals compared to the medians from BKMR models. Metal and ferritin concentrations were log-transformed and Z-standardized. Transferrin and hemoglobin concentrations were also Z-standardized. Models were adjusted for age, sex, SES, and HOME score (n = 383).
Pb, lead; Mn, manganese; Cr, chromium; Cu, copper; BKMR, Bayesian Kernel Machine Regression; SES, socioeconomic status; HOME, Home Observation Measurement of the Environment.
The association of the mixture with ferritin was driven by Pb (PIP= 0.83), where a change in Pb from its 25th to 75th percentiles was associated with a 0.33 SD decrease (95% CI= −0.58, −0.07) in serum ferritin concentrations when the rest of the mixture was held at its 50th percentile (Figure 4). The association of the mixture with hemoglobin concentrations was also driven by Pb; however, a change in Pb from its 25th to 75th percentiles was associated with higher concentrations of hemoglobin (β= 0.43, 95% CI= 0.18, 0.68) when the mixture was held at its 50th percentile (Figure S1). None of the metals in the mixture were materially associated with transferrin concentrations (Figure S2).
Fig. 4.
Exposure response profiles from BKMR models for each metal with ferritin for participants in the PHIME cohort (n = 383). Gray shading represents 95 % credible intervals. Metal and ferritin concentrations are log-transformed and Z-standardized. Associations are adjusted for age, sex, HOME score and SES.
Pb, lead; Mn, manganese; Cr, chromium; Cu, copper; BKMR, Bayesian Kernel Machine Regression; SES, socioeconomic status; HOME, Home Observation Mea-surement of the Environment.
3.2. Associations of the Metal Mixture with CVLT-C Outcomes
Consistent with our previous findings in PHIME (Schildroth et al., 2023), the metal mixture was jointly associated with better performance on the recall trials, especially long delay free recall, when each of the Fe status metrics was included in the mixture model (Figures S3–S11, panel C). Compared to the 50th percentile, the 90th percentile of the mixture was associated with higher scores for long delay free recall scores when ferritin (β= 0.20, 95% CI= −0.15, 0.55), transferrin (β= 0.22, 95% CI= −0.12, 0.55), and hemoglobin (β= 0.22, 95% CI= −0.08, 0.53) were included in the model, respectively (Figure S3). Similar associations were observed for trial 5 recall and long delay cued recall (Figures S6–S11, panel C), though the beta coefficients were smaller in magnitude. The positive association of the mixture with the recall trials was driven primarily by copper (Figures S3–S11).
The metal mixture was also associated with higher scores for perseveration errors, reflecting worse cognitive performance, when each of the Fe status metrics was included as a component of the mixture. The 90th percentile of the mixture, compared to the 50th percentile, was associated with a 0.25 SD increase (95% CI= −0.07, 0.56), 0.23 SD increase (95% CI= −0.15, 0.60), and 0.22 SD increase (95% CI= −0.10, 0.54) in ln-transformed perseveration errors when ferritin, transferrin, and hemoglobin were included in the model, respectively. These associations were primarily driven by the association between Pb and higher number of perseveration errors (Figures S12–S14, panel C).
3.3. Mediation of the Metal Mixture by Fe Status
Figure 5 shows the mediation effects of Fe status for trial 5, long delay free, and long delay cued recall in BKMR-CMA models. Notably, there was no evidence of mediation by Fe status: the NIE, which reflects the indirect association of the mixture with neurodevelopment mediated through Fe status, was null across all three Fe status metrics for trial 5 (Figure 5, panel A), long delay free (Figure 5, panel B), and long delay cued (Figure 5, panel C) recall. Conversely, the NDE, which reflects the direct association of the mixture (for a change from its 25th to 75th percentiles) not mediated by Fe status, was positive for all three recall trials when ferritin, hemoglobin, or transferrin were considered the mediators (Figure 5, panels A-C), suggesting better cognitive performance with increasing metal concentrations, independent of Fe status. The strongest associations were observed for LDFR: the NDE was estimated to be 0.23 (95% CI= 0.01, 0.44), 0.23 (95% CI= 0.02, 0.44), and 0.23 (95% CI= 0.01, 0.45) when ferritin, hemoglobin, and transferrin, respectively, were considered the mediators (Figure 5, panel B). These findings suggest that associations of the metal mixture with the recall trials in these data operate exclusively through the direct pathway and are not mediated by Fe status.
Fig. 5.
Mediation effects of ferritin, transferrin, and hemoglobin on associations between the metal mixture and (A) trial 5 recall, (B) long delay free recall, and (C) long delay cued recall in the PHIME cohort (n = 383). Mediation effects are estimated for a change in the metal mixture from its 25th percentile to its 75th percentile. The CDEs are estimated holding the mediator (ferritin, transferrin, or hemoglobin) at its 25th, 50th, or 75th percentiles. Metals and ferritin are log-transformed and Z- standardized. Hemoglobin and transferrin concentrations are Z-standardized. Associations are adjusted for age, sex, HOME score and SES.
BKMR, Bayesian Kernel Machine Regression; SES, socioeconomic status; HOME, Home Observation Measurement of the Environment; NIE, natural indirect effect; NDE, natural direct effect; TE, total effect; CDE, controlled direct effect.
There was also no evidence of mediation by any Fe status marker for the association between Cu and trial 5 in the regression-based approach (Table S5). For example, when ferritin was considered the mediator, the TNIE was null (β= 0.00, 95% CI= −0.01, 0.01), while the PNDE suggested a beneficial association of Cu with trial 5 (β= 0.21, 95% CI= 0.11, 0.30) that operated exclusively on the direct pathway. Similar associations were also found when hemoglobin or transferrin were considered the mediator (Table S5).
The NIE was also null for perseveration errors, suggesting no evidence of mediation by any Fe status metric (Figure 6). However, the NDE (for a change in the mixture from its 25th to 75th percentiles) was positive for perseveration errors, indicating adverse associations with cognitive performance. The NDE was estimated to be 0.13 (95% CI= −0.08, 0.37), 0.14 (95% CI= −0.08, 0.38), and 0.13 (95% CI= −0.08, 0.36) when ferritin, transferrin, or hemoglobin were considered the mediator. As with the recall trials, these findings suggest that the adverse association of the mixture with perseveration errors operated exclusively via the direct pathway.
Fig. 6.
Mediation effects of ferritin, transferrin, and hemoglobin on associations between the metal mixture and perseveration errors in the PHIME cohort (n = 383). Mediation effects are estimated for a change in the metal mixture from its 25th percentile to its 75th percentile. The CDEs are estimated holding the mediator (ferritin, transferrin, or hemoglobin) at its 25th, 50th, or 75th percentiles. Metals and ferritin are log-transformed and Z-standardized. Hemoglobin and transferrin concen-trations are Z-standardized. Associations are adjusted for age, sex, HOME score and SES.
Pb, lead; Mn, manganese; Cr, chromium; Cu, copper; BKMR, Bayesian Kernel Machine Regression; SES, socioeconomic status; HOME, Home Observation Mea-surement of the Environment; NIE, natural indirect effect; NDE, natural direct effect; TE, total effect; CDE, controlled direct effect.
The mixture was not materially associated with forgetting, and there was similarly no evidence of mediation by any of the Fe status markers (Figure S15).
3.4. Sex-stratified Analyses: Associations of the Metal Mixture with Fe Status
In sex-stratified BKMR-CMA models, the negative association of the mixture (Pb, Mn, Cr, Cu) at its 90th percentile, compared to the 50th percentile, with ferritin was stronger in males (β= −0.21; 95% CI= −0.69, 0.28) compared to females (β= −0.08; 95% CI= −0.44, 0.29, Figure 7, panels A and B). The positive association of the mixture at its 90th percentile, compared to the 50th percentile, with hemoglobin was also stronger in males (β= 0.34; 95% CI= −0.03, 0.70) compared to females (β= 0.16; 95% CI= −0.26, 0.59, Figure 7, panels C and D). Higher concentrations of the mixture (Pb, Mn, Cr, Cu) were not materially associated with transferrin in males (at the 90th percentile, compared to the 50th percentile: β= −0.09; 95% CI= −0.46, 0.28) or females (at the 90th percentile, compared to the 50th percentile: β= −0.12; 95% CI= −0.52, 0.28, Figure 7, panels E and F). As with our main findings, the joint associations of the mixture with ferritin and hemoglobin among males were driven primarily by Pb (Figure S16).
Fig. 7.
Joint associations of the metal mixture (Pb, Mn, Cr, Cu) with ferritin, transferrin, and hemoglobin at increasing percentiles (10th, 20th, 30th, 40th, 60th, 70th, 80th, and 90th) of all metals compared to the medians from BKMR models among males (n = 201) and females (n = 182). Metal and ferritin concentrations were log- transformed and Z-standardized. Transferrin and hemoglobin concentrations were also Z-standardized. Models were adjusted for age, SES, and HOME score. Pb, lead; Mn, manganese; Cr, chromium; Cu, copper; BKMR, Bayesian Kernel Machine Regression; SES, socioeconomic status; HOME, Home Observation Mea-surement of the Environment.
3.5. Sex-stratified Analyses: Associations of the Metal Mixture with CVLT-C Outcomes
As we have previously reported (Schildroth et al., 2023), there was evidence of sex-specific associations of the mixture with our indices of neurodevelopment, though these associations tended to be imprecise. Notably, joint increases in the overall mixture were associated with better recall scores only among females. For example, the 90th percentile of the mixture (compared to the 50th percentile) was associated with a 0.25 SD increase (95% CI= −0.39, 0.90) in trial 5 recall scores among females, but a 0.14 decrease (95% CI= −0.63, 0.36) in males when ferritin was included in the model. Similar associations were observed for the other recall trials, and these sex-specific associations were driven primarily by stronger associations of Cu with the recall trials among females (data not shown). As in the main findings, there was no evidence of mediation by any Fe status metric in either sex (Figures S17–S21).
3.6. BKMR-CMA Sensitivity Analyses
We performed a series of sensitivity analyses to examine the robustness of our main BKMR-CMA findings: 1) a complete case analysis, where we restricted the analytic sample to adolescents with no missing data (n= 329); 2) an analysis changing the default uniform prior distribution to a gamma distribution; and 3) an analysis changing the default smoothness of the function (100) to 50 and 1000.
The mediation effects for trial 5 recall, including the NDE, NIE, TE, and CDEs, from sensitivity analyses that used the gamma prior distribution and changed the smoothness of the function to 50 or 1000 were consistent with our main findings (Figures S22–S24). Findings for the mediation effects for the complete case analysis were also similar to our main findings, though associations tended to be stronger (Figure S25). For example, the NDEs for trial 5 in the complete case analysis for ferritin, transferrin, and hemoglobin were 0.19 (95% CI= −0.04, 0.41; main model: β= 0.12; 95% CI= −0.09, 0.34), 0.18 (95% CI= −0.05, 0.40; main model: β= 0.14; 95% CI= −0.08, 0.35), and 0.18 (95% CI= −0.04, 0.41; main model: β= 0.14; 95% CI= −0.08, 0.36), respectively. There was no evidence of mediation by any Fe status metric in any of the sensitivity analyses.
Associations of the metals with ferritin, transferrin, and hemoglobin also tended to be similar in sensitivity analyses (Figures S26–S37), with one notable exception: the association of Pb with ferritin that we observed in the main model (Figure 3) was null in the analysis that used the gamma distribution (Figure S26) and in the complete case analysis (Figure S35).
4. DISCUSSION
In this study of Italian adolescents residing near ferroalloy production sites, we found that a mixture of Pb, Mn, Cu, and Cr was jointly associated with aspects of verbal learning and memory. As we have previously reported, the associations of the overall mixture with the recall trials and perseveration errors were driven primarily by Cu (beneficial) and Pb (adverse), respectively (Schildroth et al., 2023). The metal mixture was also associated with markers of Fe status, (i.e., ferritin and hemoglobin), but there was no evidence that Fe status mediated the association of the metal mixture with neurodevelopment.
When considering the association of the overall mixture with verbal learning and memory, we found that a joint increase in all components of the mixture (Pb, Mn, Cu, Cr, marker of Fe status) was positively associated with the recall trials when any of the three markers of Fe status (ferritin, hemoglobin, or transferrin) was included in the mixture. These associations were primarily driven by Cu, which we have reported on previously (Schildroth et al., 2023), and may reflect the role of Cu as an essential nutrient needed for catecholamine synthesis, cellular respiration, formation/maintenance of myelin, and long-term potentiation (Gaetke et al., 2014; Opazo et al., 2014). It should also be noted that, although we observed beneficial associations of Cu with cognition, previous studies have reported beneficial, adverse and nonlinear associations of Cu with neurodevelopment outcomes (Amorós et al., 2019; Bauer et al., 2020a; Liu et al., 2018; Zhou et al., 2015), likely reflecting differences in dose, among other factors. Conversely, the overall mixture was concurrently associated with increased perseveration errors, reflecting worse cognitive performance. This association was driven primarily by Pb, which is consistent with the known toxicological mechanisms of Pb (e.g., disruption of neurotransmitter release and neuronal plasticity) and previous research in pediatric cohorts (Neal and Guilarte, 2013; Sanders et al., 2009).
We further found that the mixture was jointly associated with lower concentrations of serum ferritin, and that this association was primarily due to Pb. Increased blood Pb concentrations have previously been associated with decreased concentrations of markers of Fe status in children (Choi and Kim, 2005; Hegazy et al., 2010; Jeong et al., 2015). The hematologic toxicity of Pb is well established: Pb shares mechanisms of uptake and transport with Fe, disrupts enzymes involved in heme synthesis, interferes with the expression of transferrin, disrupts cellular membranes, and has been associated with decreased concentrations of erythropoietin (EPO), the primary hormone that stimulates the production of erythrocytes (Kordas, 2010; Levander, 1979). Although most studies have found Pb-induced hematologic toxicity at concentrations >10 μg/dL, several studies with blood Pb concentrations ≤10 μg/dL have reported decreased platelet counts and inhibition of δ-ALAD, an enzyme active in the production of heme (Agency for Toxic Substances and Disease Registry, 2020). These studies suggest that Pb hematologic toxicity may occur at Pb concentrations <10 μg/dL; however, most prior studies were cross-sectional in design and conducted in adults or in populations with small sample sizes. Other studies in children have alternatively reported higher blood Pb concentrations among children who were Fe-deficient (Ataur Rahman et al., 2012; Bradman et al., 2001; Khan et al., 2011). Because the toxicokinetics and toxicodynamics of Pb are closely related to those of Fe (Agency for Toxic Substances and Disease Registry, 2020), further research in larger pediatric cohorts with longitudinal designs, particularly in populations with low environmental Pb exposure, is warranted.
Conversely, increasing percentiles of the mixture were jointly associated with higher concentrations of hemoglobin in the current analysis, and this association was again driven by Pb. However, given the cross-sectional nature of this study and known hematologic toxicity of Pb, this finding should not be interpreted as a beneficial association of Pb on hematologic function. One alternative explanation of this finding is that EPO production was higher in response to low-level Pb exposure in our Fe-replete population. EPO is secreted by the kidneys, and concentrations increase under certain conditions (e.g., low oxygen, blood loss, damaged or malfunctioning erythrocytes) (Agency for Toxic Substances and Disease Registry, 2020; Suresh et al., 2020). This suggests that EPO may increase following toxicant exposure as a compensatory mechanism against the hematologic toxicity of Pb (e.g., disruption of heme synthesis). Although we did not have EPO concentrations to further investigate this hypothesis in the PHIME cohort, a compensatory mechanism was observed in one study of 5-year-old Fe-replete children, where environmental Pb exposure was associated with increased EPO concentrations (Factor-Litvak et al., 1998). Thus, the hypothesized compensatory mechanism could explain the positive association of blood Pb with Hb in our analysis. Alternatively, this finding could be explained by residual confounding by other nutrients (e.g., vitamin A, vitamin B6, vitamin B12, riboflavin, or folic acid) or dietary factors that have been associated with both Fe status and metals exposure (Al-Attar, 2011; Ferri et al., 2015, 2012; Fishman et al., n.d.; Levander, 1979). For example, we have previously shown that Pb was detectable in soils and Fe-rich vegetables (e.g., spinach) grown in gardens near ferroalloy industry, suggesting diet may be an important confounder in this population (Ferri et al., 2015, 2012). It is also possible that this is a spurious statistical correlation given the cross-sectional nature of our data and the known kinetics of Pb in the body (e.g., >90% of whole blood Pb is bound to hemoglobin) (Collin et al., 2022), highlighting the need for additional studies with longitudinal designs.
Although the overall mixture was associated with indicators of neurodevelopment and markers of Fe status, there was no evidence that Fe status mediated the associations between the metal mixture and verbal learning and memory. These results were consistent across three clinical markers of Fe status. We are aware of only one prior study that considered metals and Fe status in a mediation analysis of neurodevelopmental outcomes. Using cross-sectional data from a population of 5-year old Korean children, Jeong et al. found that blood Pb was a partial mediator of the positive association between ferritin and verbal IQ, whereby exposure to Pb attenuated the beneficial effect of ferritin on neurodevelopment (Jeong et al., 2015). We likely did not observe any mediation by Fe status in the current analysis because Fe status was, on average, sufficient and not strongly related to the neurodevelopmental outcomes in this study population. Fe-deficiency has been associated with worse neurodevelopment in other pediatric cohorts because Fe is required for processes of neuronal development and function (e.g., metabolism, myelination, neurotransmitter synthesis) (Halterman et al., 2001; Jáuregui-Lobera, 2014; Ji et al., 2017; Lukowski et al., 2010; Parkin et al., 2020; Roy et al., 2011; Tseng et al., 2018; Wang et al., 2019, 2017). Jeong et al. classified nearly half of their participants as having either low (<15 ng/mL) or low-normal ferritin levels (15.0 <30.0 ng/mL) (Jeong et al., 2015), whereas the PHIME population had minimal indication of Fe deficiency (median serum ferritin: 32.0 ng/mL). This likely explains, at least in part, the null mediation findings in our study. However, because Fe-deficiency, and specifically anemia, has been consistently associated with neurodevelopment in children (Halterman et al., 2001; Jáuregui-Lobera, 2014; Ji et al., 2017; Lukowski et al., 2010; Parkin et al., 2020; Roy et al., 2011; Tseng et al., 2018; Wang et al., 2019, 2017), mediation by Fe status is still possible, and other prospective studies with larger variations in Pb and Fe levels are warranted.
In sex-stratified models, the beneficial associations of the mixture with the recall trials were stronger among females. Sex-specific associations of Cu with neurodevelopment have been previously reported, such that Cu was more strongly associated with adverse cognitive scores in males (Amorós et al., 2019; Zhou et al., 2015). Animal data are inconsistent: studies have reported higher susceptibility to Cu toxicity among both males and females (Chen et al., 2006; Lamtai et al., 2020). These findings may relate to differences in hormonal modulation of Cu-induced neurotoxicity (Lamtai et al., 2020). In the current study, sexual dimorphic findings may also be due to differential Cu concentrations between the sexes (median: females, 10.3 μg/g; males, 8.6 μg/g). However, further research is needed to better understand sex-specific impacts of Cu on neurodevelopment.
We also found sexual dimorphic associations between the metal mixture and markers of Fe status: the association of the overall mixture, driven by Pb, with lower ferritin concentrations and higher hemoglobin concentrations was stronger in males compared to females. These findings are contrary to a previous epidemiological study in adolescents that found stronger adverse associations of metals (Mn, Pb, cadmium, selenium) or their mixture in females (Schildroth et al., 2022a). However, stronger associations of metals with Fe status among females in this prior analysis were driven primarily by Mn and cadmium, and biomarker concentrations of these metals tended to be higher in females compared to males (Schildroth et al., 2022a). In contrast, the sex-specific associations in the current analysis were driven by Pb, where median Pb concentrations were modestly higher in males (1.4 μg/dL) than in females (1.1 μg/dL). This might partly explain why we observed stronger associations of the metal mixture with markers of Fe status in males compared to females in our study. As with our main analysis in the full cohort, there was no evidence that Fe status mediated the association of the metal mixture with neurodevelopment in sex-stratified analyses.
This analysis had several strengths. This analysis is among the first to use the novel BKMR-CMA approach to examine mediation of any chemical mixture, and this study was the first to assess mediation of any metal or a metal mixture by Fe status in relation to neurodevelopmental outcomes. We were also able to examine mediation by multiple clinically relevant biomarkers for Fe status that each quantify different aspects of Fe status with various sensitivities for reflecting Fe deficiency (Gibson, 2005). We further quantified metals (Pb, Mn, Cr, and Cu) using biomarkers that have been consistently utilized in previous epidemiological studies of neurodevelopment (Bauer et al., 2020a; Caparros-Gonzalez et al., 2019; Carvalho et al., 2018; Oulhote et al., 2014; Torres-Agustín et al., 2013; Wright et al., 2006; Yorifuji et al., 2011). Our study also focused on the adolescent period, an understudied yet critical period for neuronal maturation, physical growth, and possible Fe deficiency (Anttila et al., 1997; Arain et al., 2013; Das et al., 2017; Mesías et al., 2013; Shaw et al., 2020). Lastly, we utilized the CVLT-C to assess neurodevelopment, which is an objective and commonly used test of verbal learning and memory in children and adolescents (Lezak et al., 2012).
The primary limitation of this analysis was its cross-sectional design, where the metals, Fe status, and neurodevelopment were assessed concurrently. Reverse causation is therefore possible, and longitudinal studies are needed to confirm findings. Residual confounding is also possible as we were missing data on key covariates that may be associated with metals, Fe status, and neurodevelopment. For example, we were not able to control for biomarkers of inflammation (e.g., C-reactive protein) that may impact levels of Fe status markers (Gibson, 2005), other co-exposures (e.g., nickel), or past exposures (e.g., in the prenatal and early childhood periods) that have similarly been associated with neurodevelopment in adolescence (Bauer et al., 2021; Lamtai et al., 2018; Rechtman et al., 2022). We had a limited sample size (n= 383), which likely impacted the precision of our estimates.
5. CONCLUSION
In conclusion, we found that an environmentally relevant metal mixture was associated with Fe status and aspects of verbal learning and memory, though mediation of the mixture by Fe status was not observed. Fe status should nonetheless be considered as a possible mediator of metal mixtures in future studies of neurodevelopment, especially in populations with Fe deficiency or higher environmental metal exposure given the known hematologic toxicity of metals like Pb, and the mechanistic overlap of Fe with other metals.
Supplementary Material
HIGHLIGHTS.
Metals have been linked with neurodevelopment, but less is known about the role of iron (Fe) status.
We examined Fe status as a mediator of associations between a metal mixture and learning and memory.
The mixture was associated with neurodevelopment; there was no evidence of mediation by Fe status.
Acknowledgements
Funding for this work was provided by the National Institute of Environmental Health Sciences grants T32-ES014562, F31-ES033507, and R01-ES019222.
Abbreviations
- Pb
lead
- Mn
manganese
- Cu
copper
- Cr
chromium
- Fe
iron
- PHIME
Public Health Impact of Metals Exposure
- IQ
intelligence quotient
- CVLT-C
California Verbal Learning Test for Children
- SES
socioeconomic status
- HOME
Home Observation for Measurement of the Environment
- LOD
limit of detection
- CBC
complete blood count
- DAG
directed acyclic graph
- BKMR-CMA
Bayesian Kernel Machine Regression Causal Mediation Analysis
- PIP
posterior inclusion probability
- CDE
controlled direct effect
- NDE
natural direct effect
- NIE
natural indirect effect
- TE
total effect
- CI
credible interval
- GAM
generalized additive model
- LRT
likelihood ratio test
- PNDE
pure natural direct effect
- TNIE
total natural indirect effect
- SD
standard deviation
Footnotes
Declaration of conflicts of interest:
The authors declare they have nothing to disclose.
Conflicts of Interest. The authors declare no conflicts of interest.
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
REFERENCES
- Adolescent health [WWW Document], n.d. World Health Organization. URL https://www.who.int/health-topics/adolescent-health#tab=tab_1 (accessed 1.6.22). [Google Scholar]
- Agency for Toxic Substances and Disease Registry, 2020. Toxicological Profile for Lead. [PubMed] [Google Scholar]
- Agency for Toxic Substances and Disease Registry, 2012a. Toxicological Profile for Manganese. [PubMed] [Google Scholar]
- Agency for Toxic Substances and Disease Registry, 2012b. Toxicological Profile for Chromium. [PubMed] [Google Scholar]
- Agency for Toxic Substances and Disease Registry, 2004. TOXICOLOGICAL PROFILE FOR COPPER. [PubMed] [Google Scholar]
- Ahamed M, Siddiqui MKJ, 2007. Low level lead exposure and oxidative stress: Current opinions. Clinica Chimica Acta. 10.1016/j.cca.2007.04.024 [DOI] [PubMed] [Google Scholar]
- Akinyemi AJ, Miah MR, Ijomone OM, Tsatsakis A, Soares FAA, Tinkov AA, Skalny AV, Venkataramani V, Aschner M, 2019. Lead (Pb) exposure induces dopaminergic neurotoxicity in Caenorhabditis elegans: Involvement of the dopamine transporter. Toxicol Rep 6, 833–840. 10.1016/J.TOXREP.2019.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Al-Attar AM, 2011. Vitamin E attenuates liver injury induced by exposure to lead, mercury, cadmium and copper in albino mice. Saudi J Biol Sci 18, 395. 10.1016/J.SJBS.2011.07.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Amorós R, Murcia M, González L, Soler-Blasco R, Rebagliato M, Iñiguez C, Carrasco P, Vioque J, Broberg K, Levi M, Lopez-Espinosa MJ, Ballester F, Llop S, 2019. Maternal copper status and neuropsychological development in infants and preschool children. Int J Hyg Environ Health 222, 503–512. 10.1016/j.ijheh.2019.01.007 [DOI] [PubMed] [Google Scholar]
- Anttila R, Cook JD, Siimes MA, 1997. Body iron stores decrease in boys during pubertal development: The transferrin receptor-ferritin ratio as an indicator of iron status. Pediatr Res 41, 224–228. 10.1203/00006450-199702000-00012 [DOI] [PubMed] [Google Scholar]
- Arain M, Haque M, Johal L, Mathur P, Nel W, Rais A, Sandhu R, Sharma S, 2013. Maturation of the adolescent brain. Neuropsychiatr Dis Treat 9, 449. 10.2147/NDT.S39776 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ataur Rahman M, Rahman B, Saeed Ahmad M, Blann A, Ahmed N, 2012. Blood and hair lead in children with different extents of iron deficiency in Karachi. Environ Res 118, 94–100. 10.1016/J.ENVRES.2012.07.004 [DOI] [PubMed] [Google Scholar]
- Barbosa F, Tanus-Santos JE, Gerlach RF, Parsons PJ, 2005. A critical review of biomarkers used for monitoring human exposure to lead: Advantages, limitations, and future needs. Environ Health Perspect. 10.1289/ehp.7917 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barkur RR, Bairy LK, 2015. Assessment of Oxidative Stress in Hippocampus, Cerebellum and Frontal Cortex in Rat Pups Exposed to Lead (Pb) During Specific Periods of Initial Brain Development. Biological Trace Element Research 2015 164:2 164, 212–218. 10.1007/S12011-014-0221-3 [DOI] [PubMed] [Google Scholar]
- Bauer JA, Claus Henn B, Austin C, Zoni S, Fedrighi C, Cagna G, Placidi D, White RF, Yang Q, Coull BA, Smith D, Lucchini RG, Wright RO, Arora M, 2017. Manganese in teeth and neurobehavior: Sex-specific windows of susceptibility. Environ Int 108, 299–308. 10.1016/j.envint.2017.08.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bauer JA, Devick KL, Bobb JF, Coull BA, Bellinger D, Benedetti C, Cagna G, Fedrighi C, Guazzetti S, Oppini M, Placidi D, Webster TF, White RF, Yang Q, Zoni S, Wright RO, Smith DR, Lucchini RG, Claus Henn B, 2020a. Associations of a Metal Mixture Measured in Multiple Biomarkers with IQ: Evidence from Italian Adolescents Living near Ferroalloy Industry. Environ Health Perspect 128, 97002. 10.1289/EHP6803 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bauer JA, Fruh V, Howe CG, White RF, Claus Henn B, 2020b. Associations of Metals and Neurodevelopment: a Review of Recent Evidence on Susceptibility Factors. Curr Epidemiol Rep 7, 237–262. 10.1007/s40471-020-00249-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bauer JA, White RF, Coull BA, Austin C, Oppini M, Zoni S, Fedrighi C, Cagna G, Placidi D, Guazzetti S, Yang Q, Bellinger DC, Webster TF, Wright RO, Smith D, Horton M, Lucchini RG, Arora M, Claus Henn B, 2021. Critical windows of susceptibility in the association between manganese and neurocognition in Italian adolescents living near ferro-manganese industry. Neurotoxicology 87, 51–61. 10.1016/J.NEURO.2021.08.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bertinato J, Zouzoulas A, 2009. Considerations in the Development of Biomarkers of Copper Status, Journal of AOAC INTERNATIONAL. Oxford Academic. 10.1093/JAOAC/92.5.1541 [DOI] [PubMed] [Google Scholar]
- Bobb JF, Claus Henn B, Valeri L, Coull BA, 2018. Statistical software for analyzing the health effects of multiple concurrent exposures via Bayesian kernel machine regression. Environ Health 17, 67. 10.1186/s12940-018-0413-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bobb JF, Valeri L, Claus Henn B, Christiani DC, Wright RO, Mazumdar M, Godleski JJ, Coull BA, 2015. Bayesian kernel machine regression for estimating the health effects of multi-pollutant mixtures. J. F. BOBB AND OTHERS 16, 493–508. 10.1093/biostatistics/kxu058 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borchard S, Bork F, Rieder T, Eberhagen C, Popper B, Lichtmannegger J, Schmitt S, Adamski J, Klingenspor M, Weiss KH, Zischka H, 2018. The exceptional sensitivity of brain mitochondria to copper. Toxicology in Vitro 51, 11–22. 10.1016/J.TIV.2018.04.012 [DOI] [PubMed] [Google Scholar]
- Boudissa SM, Lambert J, Müller C, Kennedy G, Gareau L, Zayed J, 2006. Manganese concentrations in the soil and air in the vicinity of a closed manganese alloy production plant. Science of the Total Environment 361, 67–72. 10.1016/j.scitotenv.2005.05.001 [DOI] [PubMed] [Google Scholar]
- Bradman A, Eskenazi B, Sutton P, Athanasoulis M, Goldman LR, 2001. Iron deficiency associated with higher blood lead in children living in contaminated environments. Environ Health Perspect 109, 1079–1084. 10.1289/ehp.011091079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brain JD, Heilig E, Donaghey TC, Knutson MD, Wessling-Resnick M, Molina RM, 2006. Effects of iron status on transpulmonary transport and tissue distribution of Mn and Fe. Am J Respir Cell Mol Biol 34, 330–337. 10.1165/rcmb.2005-0101OC [DOI] [PMC free article] [PubMed] [Google Scholar]
- Butler L, Gennings C, Peli M, Borgese L, Placidi D, Zimmerman N, Hsu HHL, Coull BA, Wright RO, Smith DR, Lucchini RG, Claus Henn B, 2019. Assessing the contributions of metals in environmental media to exposure biomarkers in a region of ferroalloy industry. J Expo Sci Environ Epidemiol 29, 674–687. 10.1038/s41370-018-0081-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buuren S. van, Groothuis-Oudshoorn K, 2011. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw 45, 1–67. 10.18637/JSS.V045.I03 [DOI] [Google Scholar]
- Caparros-Gonzalez RA, Giménez-Asensio MJ, González-Alzaga B, Aguilar-Carduño C, Lorca-Marín JA, Alguacil J, Gómez-Becerra I, Gómez-Ariza JL, García-Barrera T, Hernandez AF, López-Flores I, Rohlman DS, Romero-Molina D, Ruiz-Pérez I, Lacasaña M, 2019. Childhood chromium exposure and neuropsychological development in children living in two polluted areas in southern Spain. Environmental Pollution 252, 1550–1560. 10.1016/j.envpol.2019.06.084 [DOI] [PubMed] [Google Scholar]
- Carvalho C.F. de, Oulhote Y, Martorelli M, Carvalho C.O. de, Menezes-Filho JA, Argollo N, Abreu N, 2018. Environmental manganese exposure and associations with memory, executive functions, and hyperactivity in Brazilian children. Neurotoxicology 69, 253–259. 10.1016/j.neuro.2018.02.002 [DOI] [PubMed] [Google Scholar]
- Cesana GC, Ferrario M, Vito G. De, Sega R, Grieco A, 1995. Evaluation of the Socioeconomic Status in Epidemiological Surveys: Hypotheses of Research in the Brianza Area MONICA Project. Work, Environment and Health 86, 16–26. [PubMed] [Google Scholar]
- Chandra SV, Ali MM, Saxena DK, Murthy RC, 1981. Behavioral and neurochemical changes in rats simultaneously exposed to manganese and lead. Arch Toxicol 49, 49–56. 10.1007/BF00352071 [DOI] [PubMed] [Google Scholar]
- Chen Z, Meng H, Xing G, Chen C, Zhao Y, Jia G, Wang T, Yuan H, Ye C, Zhao F, Chai Z, Zhu C, Fang X, Ma B, Wan L, 2006. Acute toxicological effects of copper nanoparticles in vivo. Toxicol Lett 163, 109–120. 10.1016/J.TOXLET.2005.10.003 [DOI] [PubMed] [Google Scholar]
- Choi J, Kim S, 2005. Relationships of Lead, Copper, Zinc, and Cadmium Levels Versus Hematopoiesis and Iron Parameters in Healthy Adolescents. Ann Clin Lab Sci 35, 428–434. [PubMed] [Google Scholar]
- Claus Henn B, Ettinger AS, Schwartz J, Téllez-Rojo MM, Lamadrid-Figueroa H, Hernández-Avila M, Schnaas L, Amarasiriwardena C, Bellinger DC, Hu H, Wright RO, 2010. Early postnatal blood manganese levels and children’s neurodevelopment. Epidemiology 21, 433–439. 10.1097/EDE.0b013e3181df8e52 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coetzee DJ, McGovern PM, Rao R, Harnack LJ, Georgieff MK, Stepanov I, 2016. Measuring the impact of manganese exposure on children’s neurodevelopment: Advances and research gaps in biomarker-based approaches. Environ Health. 10.1186/s12940-016-0174-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collin MS, Venkatraman SK, Vijayakumar N, Kanimozhi V, Arbaaz SM, Stacey RGS, Anusha J, Choudhary R, Lvov V, Tovar GI, Senatov F, Koppala S, Swamiappan S, 2022. Bioaccumulation of lead (Pb) and its effects on human: A review. Journal of Hazardous Materials Advances 7, 100094. 10.1016/J.HAZADV.2022.100094 [DOI] [Google Scholar]
- Das JK, Salam RA, Thornburg KL, Prentice AM, Campisi S, Lassi ZS, Koletzko B, Bhutta ZA, 2017. Nutrition in adolescents: physiology, metabolism, and nutritional needs. Ann N Y Acad Sci 1393, 21–33. 10.1111/NYAS.13330 [DOI] [PubMed] [Google Scholar]
- Delis DC, Kramer JH, Kaplan E, Ober BA, 1994. California Verbal Learning Test: Children’s Version. Pearson Education. [Google Scholar]
- Devick KL, Bobb JF, Mazumdar M, Claus Henn B, Bellinger DC, Christiani DC, Wright RO, Williams PL, Coull BA, Valeri L, 2022. Bayesian kernel machine regression-causal mediation analysis. Stat Med 41, 860–876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eastman RR, Jursa TP, Benedetti C, Lucchini RG, Smith DR, 2013. Hair as a biomarker of environmental manganese exposure. Environ Sci Technol 47, 1629–1637. 10.1021/es3035297 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Erikson KM, Shihabi ZK, Aschner JL, Aschner M, 2002. Manganese accumulates in iron-deficient rat brain regions in a heterogeneous fashion and is associated with neurochemical alterations. Biol Trace Elem Res 87, 143–156. 10.1385/BTER:87:1-3:143 [DOI] [PubMed] [Google Scholar]
- Factor-Litvak P, Slavkovich V, Liu X, Popovac D, Preteni E, Capuni-Paracka S, Hadzialievic S, Lekic V, Lolacono N, Kline J, Graziano1’ J, 1998. Hyperproduction of Erythropoietin in Nonanemic Lead-exposed Children. Environ Health Perspect 106, 361–364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fernsebner K, Zorn J, Kanawati B, Walker A, Michalke B, 2014. Manganese leads to an increase in markers of oxidative stress as well as to a shift in the ratio of Fe(II)/(III) in rat brain tissue. Metallomics 6, 921–931. 10.1039/C4MT00022F [DOI] [PubMed] [Google Scholar]
- Ferri R, Donna F, Smith DR, Guazzetti S, Zacco A, Rizzo L, Bontempi E, Zimmerman NJ, Lucchini RG, 2012. Heavy Metals in Soil and Salad in the Proximity of Historical Ferroalloy Emission. J Environ Prot (Irvine, Calif) 3, 374. 10.4236/JEP.2012.35047 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ferri R, Hashim D, Smith DR, Guazzetti S, Donna F, Ferretti E, Curatolo M, Moneta C, Beone GM, Lucchini RG, 2015. Metal contamination of home gardens soils and cultivated vegetables in the province of Brescia, Italy: Implications for human exposure. Sci Total Environ 0, 507. 10.1016/J.SCITOTENV.2015.02.072 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ferroalloy Market Share 2018–2025. Industry Growth Outlook Report [WWW Document], n.d. URL https://www.gminsights.com/industry-analysis/ferroalloy-market (accessed 5.24.21). [Google Scholar]
- Fishman SM, Christian P, West KP, n.d. The role of vitamins in the prevention and control of anaemia. Public Health Nutr 3, 125–150. 10.1017/S1368980000000173 [DOI] [PubMed] [Google Scholar]
- Gaetke LM, Chow-Johnson HS, Chow CK, 2014. Copper: toxicological relevance and mechanisms. Arch Toxicol. 10.1007/s00204-014-1355-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Galaris D, Barbouti A, Pantopoulos K, 2019. Iron homeostasis and oxidative stress: An intimate relationship. Biochimica et Biophysica Acta (BBA) - Molecular Cell Research 1866, 118535. 10.1016/J.BBAMCR.2019.118535 [DOI] [PubMed] [Google Scholar]
- García-Chimalpopoca Z, Hernández-Bonilla D, Cortez-Lugo M, Escamilla-Núñez C, Schilmann A, Riojas-Rodríguez H, Rodríguez-Dozal S, Montes S, Tristán-López LA, Catalán-Vázquez M, Rios C, 2019. Verbal Memory and Learning in Schoolchildren Exposed to Manganese in Mexico. Neurotox Res 36, 827–835. 10.1007/s12640-019-00037-7 [DOI] [PubMed] [Google Scholar]
- Gibson RS, 2005. Principles of Nutritional Assessment, Second Edi. ed, Principles of Nutritional Assessment. Oxford University Press, New York. [Google Scholar]
- Hafeman DM, Schwartz S, 2009. Opening the Black Box: a motivation for the assessment of mediation. Int J Epidemiol 38, 838–845. 10.1093/IJE/DYN372 [DOI] [PubMed] [Google Scholar]
- Halterman JS, Kaczorowski JM, Aligne CA, Auinger P, Szilagyi PG, 2001. Iron deficiency and cognitive achievement among school-aged children and adolescents in the United States. Pediatrics 107, 1381–1386. 10.1542/peds.107.6.1381 [DOI] [PubMed] [Google Scholar]
- Haynes EN, Ryan P, Chen A, Brown D, Roda S, Kuhnell P, Wittberg D, Terrell M, Reponen T, 2012. Assessment of personal exposure to manganese in children living near a ferromanganese refinery. Science of the Total Environment 427–428, 19–25. 10.1016/j.scitotenv.2012.03.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hegazy AA, Zaher MM, Abd El-Hafez MA, Morsy AA, Saleh RA, 2010. Relation between anemia and blood levels of lead, copper, zinc and iron among children. BMC Res Notes 3, 133. 10.1186/1756-0500-3-133 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henríquez-Hernández LA, Boada LD, Carranza C, Pérez-Arellano JL, González-Antuña A, Camacho M, Almeida-González M, Zumbado M, Luzardo OP, 2017. Blood levels of toxic metals and rare earth elements commonly found in e-waste may exert subtle effects on hemoglobin concentration in sub-Saharan immigrants. Environ Int 109, 20–28. 10.1016/j.envint.2017.08.023 [DOI] [PubMed] [Google Scholar]
- Jain NB, Laden F, Guller U, Shankar A, Kasani S, Garshick E, 2005. Relation between blood lead levels and childhood anemia in India. Am J Epidemiol 161, 968–973. 10.1093/aje/kwi126 [DOI] [PubMed] [Google Scholar]
- Jáuregui-Lobera I, 2014. Iron deficiency and cognitive functions. Neuropsychiatr Dis Treat. 10.2147/NDT.S72491 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jeong KS, Park HH, Ha E, Hong YC, Ha M, Park HH, Kim BN, Lee SJ, Lee KY, Kim JH, Kim Y, 2015. Evidence that cognitive deficit in children is associated not only with iron deficiency, but also with blood lead concentration: A preliminary study, Journal of Trace Elements in Medicine and Biology. Elsevier GmbH. 10.1016/j.jtemb.2014.08.014 [DOI] [PubMed] [Google Scholar]
- Ji X, Cui N, Liu J, 2017. Neurocognitive Function Is Associated With Serum Iron Status in Early Adolescents. Biol Res Nurs 19, 269. 10.1177/1099800417690828 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jursa T, Stein CR, Smith DR, 2018. Determinants of Hair Manganese, lead, cadmium and arsenic levels in environmentally exposed children. Toxics 6, 19. 10.3390/toxics6020019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kalita J, Kumar V, Misra UK, Bora HK, 2018. Memory and Learning Dysfunction Following Copper Toxicity: Biochemical and Immunohistochemical Basis. Mol Neurobiol 55, 3800–3811. 10.1007/S12035-017-0619-Y [DOI] [PubMed] [Google Scholar]
- Khan DA, Ansari WM, Khan FA, 2011. Synergistic effects of iron deficiency and lead exposure on blood lead levels in children. World Journal of Pediatrics 7, 150–154. 10.1007/s12519-011-0257-9 [DOI] [PubMed] [Google Scholar]
- Kordas K, 2010. Iron, Lead, and Children’s Behavior and Cognition. Annu Rev Nutr 30, 123–148. 10.1146/annurev.nutr.012809.104758 [DOI] [PubMed] [Google Scholar]
- Kordas K, Stoltzfus RJ, 2004. New Evidence of Iron and Zinc Interplay at the Enterocyte and Neural Tissues. J Nutr 134, 1295–1298. 10.1093/JN/134.6.1295 [DOI] [PubMed] [Google Scholar]
- Kounnavong S, Vonglokham M, Kounnavong T, Kwadwo DD, Essink DR, 2020. Anaemia among adolescents: assessing a public health concern in Lao PDR. 10.1080/16549716.2020.178699713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kreutzer JS, DeLuca J, Caplan B. (Eds.), 2011. Encyclopedia of Clinical Neuropsychology. Springer, New York. [Google Scholar]
- Kutllovci-Zogaj D, Krasniqi S, Elezaj I, Ramadani N, Gjergji T, Zogaj D, Kutllovci A, Jaka A, Ukëhaxhaj A, Gashi S, Bince E, 2014. Correlation between blood lead level and hemoglobin level in mitrovica children. Med Arch 68, 324–328. 10.5455/medarh.2014.68.324-328 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lamtai M, Chaibat J, Ouakki S, Zghari O, Mesfioui A, El Hessni A, Rifi EH, Marmouzi I, Essamri A, Ouichou A, 2018. Effect of Chronic Administration of Nickel on Affective and Cognitive Behavior in Male and Female Rats: Possible Implication of Oxidative Stress Pathway. Brain Sci 8. 10.3390/BRAINSCI8080141 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lamtai M, Zghari O, Ouakki S, Marmouzi I, Mesfioui A, El Hessni A, Ouichou A, 2020. Chronic copper exposure leads to hippocampus oxidative stress and impaired learning and memory in male and female rats. Toxicol Res 36, 359. 10.1007/S43188-020-00043-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larsen B, Bourque J, Moore XTM, Adebimpe A, Calkins ME, Elliott MA, Gur RC, Gur RE, Moberg PJ, Roalf DR, Ruparel K, Turetsky BI, Vandekar SN, Wolf XDH, Shinohara RT, Satterthwaite XTD, 2020. Longitudinal Development of Brain Iron Is Linked to Cognition in Youth. Journal of Neuroscience 40, 1810–1818. 10.1523/JNEUROSCI.2434-19.2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levander OA, 1979. Lead toxicity and nutritional deficiencies. Environ Health Perspect 29, 115. 10.1289/EHP.7929115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lezak M, Howieson D, Bigler E, Tranel D, 2012. Neuropsychological Assessment, Fifth. ed. Oxford University Press, New York. [Google Scholar]
- Liu SH, Bobb JF, Claus Henn B, Gennings C, Schnaas L, Tellez-Rojo M, Bellinger D, Arora M, Wright RO, Coull BA, 2018. Bayesian varying coefficient kernel machine regression to assess neurodevelopmental trajectories associated with exposure to complex mixtures. Stat Med 37, 4680–4694. 10.1002/sim.7947 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu ZH, Shang J, Yan L, Wei T, Xiang L, Wang HL, Cheng J, Xiao G, 2020. Oxidative stress caused by lead (Pb) induces iron deficiency in Drosophila melanogaster. Chemosphere 243, 125428. 10.1016/J.CHEMOSPHERE.2019.125428 [DOI] [PubMed] [Google Scholar]
- Llop S, Lopez-Espinosa MJ, Rebagliato M, Ballester F, 2013. Gender differences in the neurotoxicity of metals in children. Toxicology 311, 3–12. 10.1016/j.tox.2013.04.015 [DOI] [PubMed] [Google Scholar]
- Lucas EL, Bertrand P, Guazzetti S, Donna F, Peli M, Jursa TP, Lucchini R, Smith DR, 2015. Impact of ferromanganese alloy plants on household dust manganese levels: Implications for childhood exposure. Environ Res 138, 279–290. 10.1016/j.envres.2015.01.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lucchini RG, Guazzetti S, Zoni S, Donna F, Peter S, Zacco A, Salmistraro M, Bontempi E, Zimmerman NJ, Smith DR, 2012a. Tremor, olfactory and motor changes in Italian adolescents exposed to historical ferro-manganese emission. Neurotoxicology 33, 687–696. 10.1016/j.neuro.2012.01.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lucchini RG, Zoni S, Guazzetti S, Bontempi E, Micheletti S, Broberg K, Parrinello G, Smith DR, 2012b. Inverse association of intellectual function with very low blood lead but not with manganese exposure in Italian adolescents. Environ Res 118, 65–71. 10.1016/j.envres.2012.08.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lukaski HC, 1999. CHROMIUM AS A SUPPLEMENT. Annu Rev Nutr 19, 279–302. 10.1146/annurev.nutr.19.1.279 [DOI] [PubMed] [Google Scholar]
- Lukowski AF, Koss M, Burden MJ, Jonides J, Nelson CA, Kaciroti N, Jimenez E, Lozoff B, 2010. Iron deficiency in infancy and neurocognitive functioning at 19 years: Evidence of long-term deficits in executive function and recognition memory. Nutr Neurosci 13, 54–70. 10.1179/147683010X12611460763689 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCann S, Amadó MP, Moore SE, 2020. The role of iron in brain development: A systematic review. Nutrients. 10.3390/nu12072001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Menezes-Filho JA, Paes CR, Ângela ÂM, Moreira JC, Sarcinelli PN, Mergler D, 2009. High levels of hair manganese in children living in the vicinity of a ferro-manganese alloy production plant. Neurotoxicology 30, 1207–1213. 10.1016/j.neuro.2009.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Menezes-Filho JA, Souza K.O.F.F. de, Rodrigues JLGG, Santos NR dos, Bandeira M. de J, Koin NL, Oliveira SS do do P, Godoy ALPCC, Mergler D, 2016. Manganese and lead in dust fall accumulation in elementary schools near a ferromanganese alloy plant. Environ Res 148, 322–329. 10.1016/j.envres.2016.03.041 [DOI] [PubMed] [Google Scholar]
- Merced-Nieves FM, Arora M, Wright RO, Curtin P, 2021. Metal mixtures and neurodevelopment: recent findings and emerging principles. Curr Opin Toxicol 26, 28–32. 10.1016/J.COTOX.2021.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mesías M, Seiquer I, Navarro MP, 2013. Iron Nutrition in Adolescence, Critical Reviews in Food Science and Nutrition. Taylor & Francis Group. 10.1080/10408398.2011.564333 [DOI] [PubMed] [Google Scholar]
- National Longitudinal Surveys, 1979. Appendix A: HOME-SF Scales (NLSY79 Child). [Google Scholar]
- Neal AP, Guilarte TR, 2013. Mechanisms of lead and manganese neurotoxicity. Toxicol Res (Camb). 10.1039/c2tx20064c [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Neal SL, Lee JW, Zheng W, Cannon JR, 2014. Subacute manganese exposure in rats is a neurochemical model of early manganese toxicity. Neurotoxicology 44, 303–313. 10.1016/J.NEURO.2014.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Opazo CM, Greenough MA, Bush AI, 2014. Copper: From neurotransmission to neuroproteostasis. Front Aging Neurosci 6, 143. 10.3389/FNAGI.2014.00143/BIBTEX [DOI] [PMC free article] [PubMed] [Google Scholar]
- Oulhote Y, Mergler D, Barbeau B, Bellinger DC, Bouffard T, Brodeur M-È, Saint-Amour D, Legrand M, Sauvé S, Bouchard MF, 2014. Neurobehavioral Function in School-Age Children Exposed to Manganese in Drinking Water. Environ Health Perspect 122, 1343–1350. 10.1289/ehp.1307918 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parkin PC, Koroshegyi C, Mamak E, Borkhoff CM, Birken CS, Maguire JL, Thorpe KE, Aglipay M, Anderson LN, Keown-Stoneman C, Kowal C, Mason D, 2020. Association between Serum Ferritin and Cognitive Function in Early Childhood. Journal of Pediatrics 217, 189–191.e2. 10.1016/j.jpeds.2019.09.051 [DOI] [PubMed] [Google Scholar]
- Peraza MA, Ayala-Fierro F, Barber DS, Casarez E, Rael LT, 1998. Effects of micronutrients on metal toxicity. Environ Health Perspect. 10.1289/ehp.98106s1203 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peters JL, Perry MJ, McNeely E, Wright RO, Heiger-Bernays W, Weuve J, 2021. The association of cadmium and lead exposures with red cell distribution width. PLoS One 16, e0245173. 10.1371/journal.pone.0245173 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rechtman E, Curtin P, Papazaharias DM, Renzetti S, Cagna G, Peli M, Levin-Schwartz Y, Placidi D, Smith DR, Lucchini RG, Wright RO, Horton MK, 2020. Sex-specific associations between co-exposure to multiple metals and visuospatial learning in early adolescence. Translational Psychiatry 2020 10:1 10, 1–10. 10.1038/s41398-020-01041-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rechtman E, Navarro E, de Water E, Tang CY, Curtin P, Papazaharias DM, Ambrosi C, Mascaro L, Cagna G, Gasparotti R, Invernizzi A, Reichenberg A, Austin C, Arora M, Smith DR, Lucchini RG, Wright RO, Placidi D, Horton MK, 2022. Early-Life Critical Windows of Susceptibility to Manganese Exposure and Sex-Specific Changes in Brain Connectivity in Late Adolescence. Biological Psychiatry Global Open Science. 10.1016/J.BPSGOS.2022.03.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riojas-Rodríguez H, Solís-Vivanco R, Schilmann A, Montes S, Rodríguez S, Ríos C, Rodríguez-Agudelo Y, 2010. Intellectual Function in Mexican Children Living in a Mining Area and Environmentally Exposed to Manganese. Environ Health Perspect 118, 1465–1470. 10.1289/ehp.0901229 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rossander-Hultén L, Brune M, Sandström B, Lönnerdal B, Hallberg L, 1991. Competitive inhibition of iron absorption by manganese and zinc in humans. Am J Clin Nutr 54, 152–156. 10.1093/AJCN/54.1.152 [DOI] [PubMed] [Google Scholar]
- Roy A, Hu H, Bellinger DC, Mukherjee B, Modali R, Nasaruddin K, Schwartz J, Wright RO, Ettinger AS, Palaniapan K, Balakrishnan K, 2011. Hemoglobin, lead exposure, and intelligence quotient: Effect modifcation by the DRD2 taq IA polymorphism. Environ Health Perspect 119, 144–149. 10.1289/ehp.0901878 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salvador GA, Uranga RM, Giusto NM, 2011. Iron and mechanisms of neurotoxicity. Int J Alzheimers Dis. 10.4061/2011/720658 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sammallahti S, Tiemeier H, Reiss IKM, Muckenthaler MU, El Marroun H, Vermeulen M, 2022. Maternal early-pregnancy ferritin and offspring neurodevelopment: A prospective cohort study from gestation to school age. Paediatr Perinat Epidemiol 36, 425–434. 10.1111/PPE.12854 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sanders T, Liu Y, Buchner V, Tchounwou PB, 2009. Neurotoxic effects and biomarkers of lead exposure: A review. Rev Environ Health. 10.1515/REVEH.2009.24.1.15 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schildroth S, Friedman A, Bauer J, Claus Henn B, 2022a. Associations of a metal mixture with iron status in U.S. adolescents: Evidence from the National Health and Nutrition Examination Survey. New Directions for Child and Adolescent Health. 10.1002/cad.20457 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schildroth S, Friedman A, White RF, Kordas K, Placidi D, Bauer JA, Webster TF, Coull BA, Cagna G, Wright RO, Smith D, Lucchini RG, Horton M, Claus Henn B, 2023. Associations of an industry-relevant metal mixture with verbal learning and memory in Italian adolescents: The modifying role of iron status. Environ Res 224. 10.1016/J.ENVRES.2023.115457 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schildroth S, Kordas K, Bauer JA, Wright RO, Claus Henn B, 2022b. Environmental Metal Exposure, Neurodevelopment, and the Role of Iron Status: a Review. Current Environmental Health Reports 2022 1–30. 10.1007/S40572-022-00378-0 [DOI] [PubMed] [Google Scholar]
- Shaw GA, Dupree JL, Neigh GN, 2020. Adolescent maturation of the prefrontal cortex: Role of stress and sex in shaping adult risk for compromise. Genes Brain Behav 19. 10.1111/GBB.12626 [DOI] [PubMed] [Google Scholar]
- Shaw N, 1996. Iron deficiency and anemia in school children and adolescents. Journal of the Formosan Medical Association 95, 692–698. [PubMed] [Google Scholar]
- Shi B, Choirat C, Coull BA, Vanderweele TJ, Valeri L, 2021. CMAverse: A Suite of Functions for Reproducible Causal Mediation Analyses. Epidemiology E20–E22. 10.1097/EDE.0000000000001378 [DOI] [PubMed] [Google Scholar]
- Shukla GS, Chandra SV, 1987. Concurrent exposure to lead, manganese, and cadmium and their distribution to various brain regions, liver, kidney, and testis of growing rats. Arch Environ Contam Toxicol 16, 303–310. 10.1007/BF01054947 [DOI] [PubMed] [Google Scholar]
- Smith D, Gwiazda R, Bowler R, Roels H, Park R, Taicher C, Lucchini R, 2007. Biomarkers of Mn exposure in humans. Am J Ind Med 50, 801–811. [DOI] [PubMed] [Google Scholar]
- Soares ATG, Silva A. de C, Tinkov AA, Khan H, Santamaría A, Skalnaya MG, Skalny AV, Tsatsakis A, Bowman AB, Aschner M, Ávila DS, 2020. The impact of manganese on neurotransmitter systems. Journal of Trace Elements in Medicine and Biology 61, 126554. 10.1016/J.JTEMB.2020.126554 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stein CR, Wu H, Bellinger DC, Smith DR, Wolff MS, Savitz DA, 2022. Exposure to metal mixtures and neuropsychological functioning in middle childhood. Neurotoxicology 93, 84–91. 10.1016/J.NEURO.2022.09.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stevens GA, Finucane MM, De-Regil LM, Paciorek CJ, Flaxman SR, Branca F, Peña-Rosas JP, Bhutta ZA, Ezzati M, 2013. Global, regional, and national trends in haemoglobin concentration and prevalence of total and severe anaemia in children and pregnant and non-pregnant women for 1995–2011: A systematic analysis of population-representative data. Lancet Glob Health 1, e16–e25. 10.1016/S2214-109X(13)70001-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Strauss E, Sherman E, Spreen O, 2006. A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary, 3rd ed. Oxford University Press. [Google Scholar]
- Suresh S, Rajvanshi PK, Noguchi CT, 2020. The Many Facets of Erythropoietin Physiologic and Metabolic Response. Front Physiol 10, 1534. 10.3389/FPHYS.2019.01534/BIBTEX [DOI] [PMC free article] [PubMed] [Google Scholar]
- Torres-Agustín R, Rodríguez-Agudelo Y, Schilmann A, Solís-Vivanco R, Montes S, Riojas-Rodríguez H, Cortez-Lugo M, Ríos C, 2013. Effect of environmental manganese exposure on verbal learning and memory in Mexican children. Environ Res 121, 39–44. 10.1016/j.envres.2012.10.007 [DOI] [PubMed] [Google Scholar]
- Tseng PT, Cheng YS, Yen CF, Chen YW, Stubbs B, Whiteley P, Carvalho AF, Li DJ, Chen TY, Yang Wei Cheng, Tang CH, Chu CS, Yang Wei Chieh, Liang HY, Wu CK, Lin PY, 2018. Peripheral iron levels in children with attention-deficit hyperactivity disorder: A systematic review and meta-analysis. Sci Rep. 10.1038/s41598-017-19096-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Valeri L, Mazumdar MM, Bobb JF, Henn BC, Rodrigues E, Sharif OIA, Kile ML, Quamruzzaman Q, Afroz S, Golam M, Amarasiriwardena C, Bellinger DC, Christiani DC, Coull BA, Wright RO, 2017. The joint effect of prenatal exposure to metal mixtures on neurodevelopmental outcomes at 20–40 months of age: Evidence from rural Bangladesh. Environ Health Perspect 125. 10.1289/EHP614 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Valeri L, VanderWeele TJ, 2013. Mediation analysis allowing for exposure-mediator interactions and causal interpretation: theoretical assumptions and implementation with SAS and SPSS macros. Psychol Methods 18, 137. 10.1037/A0031034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- VanderWeele TJ, 2016. Mediation Analysis: A Practitioner’s Guide. 10.1146/annurev-publhealth-032315-021402 37, 17–32. [DOI] [PubMed] [Google Scholar]
- Vanderweele TJ, 2014. A unification of mediation and interaction: a four-way decomposition. Epidemiology 25, 749. 10.1097/EDE.0000000000000121 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walter PB, Knutson MD, Paler-Martinez A, Lee S, Xu Y, Viteri FE, Ames BN, 2002. Iron deficiency and iron excess damage mitochondria and mitochondrial DNA in rats. Proceedings of the National Academy of Sciences 99, 2264–2269. 10.1073/PNAS.261708798 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang H, Shi H, Chang L, Zhang X, Li J, Yang Y, Jiang Y, 2012. Association of blood lead with calcium, iron, zinc and hemoglobin in children aged 0–7 years: a large population-based study. Biol Trace Elem Res 149, 143–147. 10.1007/S12011-012-9413-X [DOI] [PubMed] [Google Scholar]
- Wang Y, Huang L, Zhang L, Qu Y, Mu D, 2017. Iron status in attention-deficit/hyperactivity disorder: A systematic review and meta-analysis. PLoS One. 10.1371/journal.pone.0169145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang Y, Wu Y, Li T, Wang X, Zhu C, 2019. Iron Metabolism and Brain Development in Premature Infants. Front Physiol 10, 463. 10.3389/fphys.2019.00463 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weinhouse C, Ortiz EJ, Berky AJ, Bullins P, Hare-Grogg J, Rogers L, Morales A-M, Hsu-Kim H, Pan WK, 2017. Hair Mercury Level is Associated with Anemia and Micronutrient Status in Children Living Near Artisanal and Small-Scale Gold Mining in the Peruvian Amazon. Am J Trop Med Hyg 97, 1886. 10.4269/AJTMH.17-0269 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wise JP, Young JL, Cai J, Cai L, 2022. Current understanding of hexavalent chromium [Cr(VI)] neurotoxicity and new perspectives. Environ Int 158, 106877. 10.1016/J.ENVINT.2021.106877 [DOI] [PMC free article] [PubMed] [Google Scholar]
- World Health Organization, 1988. MONICA Psychosocial Optional Study: MOPSY suggested measurement instruments. WHO Regional Office for Europe. [Google Scholar]
- Wright RO, Amarasiriwardena C, Woolf AD, Jim R, Bellinger DC, 2006. Neuropsychological correlates of hair arsenic, manganese, and cadmium levels in school-age children residing near a hazardous waste site. Neurotoxicology 27, 210–216. 10.1016/j.neuro.2005.10.001 [DOI] [PubMed] [Google Scholar]
- Yorifuji T, Debes F, Weihe P, Grandjean P, 2011. Prenatal exposure to lead and cognitive deficit in 7- and 14-year-old children in the presence of concomitant exposure to similar molar concentration of methylmercury. Neurotoxicol Teratol 33, 205–211. 10.1016/j.ntt.2010.09.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhou G, Ji X, Cui N, Cao S, Liu C, Liu J, 2015. Association between serum copper status and working memory in schoolchildren. Nutrients 7, 7185–7196. 10.3390/nu7095331 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhou X-H, Eckert GJ, Tierney WM, 2001. Multiple imputation in public health research. Stat Med 20, 1541–1549. 10.1002/sim.689 [DOI] [PubMed] [Google Scholar]
- Zhu Z, Sudfeld CR, Cheng Y, Qi Q, Li S, Elhoumed M, Yang W, Chang S, Dibley MJ, Zeng L, Fawzi WW, 2021. Anemia and associated factors among adolescent girls and boys at 10–14 years in rural western China. BMC Public Health 2021 21:1 21, 1–14. 10.1186/S12889-021-10268-Z [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.







