Abstract
Purpose of Review:
Children’s environmental health researchers are increasingly interested in identifying time intervals during which individuals are most susceptible to adverse impacts of environmental exposures. We review recent advances in methods for assessing susceptible periods.
Recent Findings:
We identified three general classes of modeling approaches aimed at identifying susceptible periods in children’s environmental health research: multiple informant models, distributed lag models, and Bayesian approaches. Benefits over traditional regression modeling include the ability to formally test period effect differences, to incorporate highly time-resolved exposure data, or to address correlation among exposure periods or exposure mixtures.
Summary:
Several statistical approaches exist for investigating periods of susceptibility. Assessment of susceptible periods would be advanced by additional basic biological research, further development of statistical methods to assess susceptibility to complex exposure mixtures, validation studies evaluating model assumptions, replication studies in different populations, and consideration of susceptible periods from before conception to disease onset.
Keywords: critical windows, susceptibility, vulnerability, children’s health, environmental epidemiology, statistical methods
Introduction
Periods of heightened susceptibility (also known as critical windows) are developmental periods during which exposure to some agent (chemical or non-chemical) results in a greater effect on an outcome than does exposure to that same agent at other times. Examining susceptible periods can have several advantages for environmental epidemiology studies of children’s health. First, investigators may compare associations of exposures measured at different time intervals with the aim of elucidating biological mechanisms based on known underlying developmental processes. Second, the ability to optimize timing of exposure measurements for the most susceptible period(s) can reduce exposure misclassification and improve effect estimation. Third, knowledge of the most susceptible periods can inform targeted exposure interventions or recommendations to maximize public health impact.
The importance of investigating susceptible periods in children’s health research has been emphasized for more than two decades (1, 2), and identifying periods of susceptibility was a specific goal of the National Institute of Environmental Health Sciences (NIEHS) 2012–2017 Strategic Plan (3). Despite increased emphasis on this topic, identifying susceptible periods remains a key challenge in the field of children’s environmental health research (4).
Reduced cost of biomarker assays, novel biomarker measurements, and advances in exposure modeling have resulted in a greater number of studies with repeated measures of a multitude of exposures. These advances necessitate methods capable of modeling high-dimensional repeated exposure data to maximize its utility for inference. While familiar statistical approaches for estimating effects of repeated exposure measures can be applied to the study of susceptible periods, recent methodological work has focused on developing approaches to overcome the limitations of standard methods and new challenges. Exposures measured at multiple time intervals may be highly correlated due to common sources, necessitating control for confounding among periods. When simultaneously considering susceptible periods and multiple exposures, the problem of correlation is magnified by both within and between measure correlation. Methods for assessing exposure mixtures have been rapidly developing, though most approaches consider mixtures measured at a single time interval (recently reviewed in (5) and (6)).
This review discusses novel statistical approaches for identifying susceptible periods, with emphasis on methods developed for the setting of highly time-resolved or correlated exposure data. After providing an overview and rationale for assessing susceptible periods, we describe key articles published in the past five years and make recommendations for additional research and methodological development.
Biological Rationale
The idea of periods of heightened susceptibility has a long history in epidemiology and clinical medicine, with origins in the study of teratogens. Teratogenic agents can cause adverse effects when exposure occurs during well-defined time intervals such as gestation when major organ systems undergo rapid and synchronized development at discrete periods (7). Perturbation of sensitive biological processes during discrete periods of gestation can increase the risk of a variety of birth defects. For example, thalidomide, a pharamaceutical agent used in the 1950–1960s to treat nausea in pregnant women, is one of the most infamous teratogens. Thalidomide caused limb defects in thousands of children born to women who used the drug (8). Notably, the presence of limb defects depended on the timing of thalidomide use, where exposure between 21 and 36 days after conception was necessary to cause these birth defects. The effect of teratogens is not limited to limb or organ malformations. For instance, primary cytomegalovirus infection during pregnancy is the one of the leading non-genetic causes of sensorineural hearing loss and is also associated with other developmental deficits (9).
Terminology around the concept of susceptible periods is variable, with authors referring to a number of related terms: window vs. period as well as critical vs. susceptible vs. vulnerable. We prefer period over window because the former is routinely used in the developmental biology literature to distinguish between critical and sensitive periods. Critical periods are well-defined time intervals during which an exposure can affect an outcome. For example, teratogens typically have effects only when exposure occurs during a very narrow period during fetal development (10), as noted above. Sensitive periods are less discrete; the effect of an exposure may be greatest during a given period while also having lesser or different effects at other periods (e.g., cytomegalovirus infection) (11). Next, we note the distinction between susceptible and vulnerable. Susceptibility refers to the induction of health effects after exposure, whereas vulnerability additionally considers the probability of exposure and capacity of response (e.g., coping and adaptability) (12). In environmental epidemiology, we are typically concerned with determining susceptibility given that we assess health effects resulting from exposure in extant populations for which exposure and response have already occurred. When considering public health implications of such research, the resulting interventions, policies, and recommendations typically deal with vulnerability as they consider susceptibility in conjunction with likelihood of exposure and response capacity of the target population.
Statistical Approaches
Periods of susceptibility are often operationalized based on developmental stages of interest, such as trimesters during pregnancy or stages of child development. Exposure during each period is typically assigned a priori based on a single measurement during the period or by creating period-averaged exposure variables. A common statistical approach is to estimate associations of exposure during each period with the outcome to determine which effect estimate has the greatest magnitude. Such period-specific effects are estimated in either separate regression models for each period or in a simultaneously-adjusted model to account for correlation in exposure over time. Raz et al. provides an illustrative example in the context of particulate matter (PM) exposures in relation to autism spectrum disorders (13). The authors examined five unique developmental periods by operationalizing period-averaged PM2.5 during the 9 months prior to conception, each trimester of pregnancy, and 9 months after birth. The magnitude of association was strongest during the third trimester, which the authors’ describe as evidence supporting a prenatal origins of autism spectrum disorders (13), a finding that has been replicated (14).
Limitations of the above approach include the inability to formally test for differences among periods, difficulty in addressing missing data or unequally timed exposure measures, multiple comparisons, multi-collinearity, and loss of information or measurement error due to period-averaging (15–17). Many of these limitations can be addressed by examining exposure periods continuously rather than as discrete periods (16) and applying approaches to account for repeated exposure measures over time. We refer the reader to previous reviews discussing linear and generalized additive mixed effects models for examining susceptible periods, which compare and contrast model assumptions and utility in various settings (15, 16). Notably, Chen et al. compares nine approaches for examining repeated exposure data in relation to a time-fixed outcome including the traditional approaches above and several mixed model and clustering- based methods (15). The authors also compare results of the nine approaches using an application to repeated phthalate biomarkers during pregnancy and preterm birth (15). The authors conclude that the two mixed effects models evaluated performed best for identifying susceptible periods.
We focus the remainder of our discussion on novel methods for identifying susceptible periods with applications to children’s environmental health published in the past five years. We identified three general classes of approaches: multiple informant models, distributed lag models, and Bayesian approaches. Key features of these statistical methods for identifying periods of susceptibility are summarized in Table 1.
Table 1.
Key features of selected statistical approaches to identify periods of susceptibility in children’s environmental health research
Approach | Adjusts for confounding by exposure in other periods | Formally tests period effect heterogeneity | Accommodates highly time- resolved exposure data | Stabilizes highly correlated exposure periods | Key references |
---|---|---|---|---|---|
Single-period regression models | N/A | ||||
Multiple-period regression models | X | N/A | |||
Generalized linear mixed models | X | X | (15) | ||
Multiple informant models | X | (16) | |||
Distributed lag models | X | X | X | (17, 31) | |
Bayesian extensions of distributed lag models | X | X | X | X | (32, 50) |
Bayesian spatial-temporal hierarchical probit model | X | X | X | X | (51) |
Multiple Informant Models
Multiple informant models, originally developed to evaluate data from different sources that relate to the same underlying construct (18, 19), can be adapted to the setting of multiple exposure measures from the same individual (16). This model jointly estimates exposure-outcome associations for each period, defined a priori, and produces a statistical test of whether the period-specific estimates differ from one another. Models can be fit using generalized estimating equations or maximum likelihood (see (16) for details and code). This method can be applied in settings with a single exposure with sparse measures over time; however, it is not well-suited to high-dimensional or highly correlated data. Moreover, the method does not jointly adjust the exposure-outcome association at one period for the exposure-outcome associations in other periods.
In the Health Outcomes and Measures of the Environment (HOME) Study, we have applied multiple informant methods to identify susceptible periods to several classes of environmental chemicals in studies of child neurobehavior and thyroid hormone levels (20–29). Notably, we found that urinary triclosan concentrations at the time of delivery, but not during pregnancy or childhood, were inversely associated with child intelligence quotient at age 8 years (29). In addition, we found that urinary bisphenol A concentrations during pregnancy but not childhood were associated with more parent-reported behavioral problems in girls from ages 2 to 8 years (30).
Distributed Lag Models
Extensions of distributed lag models (DLMs) can be used to examine susceptible periods when exposures are measured with fine temporal resolution, such as weeks (31, 32). Generally, DLMs describe exposure-lag-response relationships of a time-varying exposure with a time-fixed outcome, and distributed lag non-linear models apply a smoothing function or penalty to flexibly model the time-varying exposure effects (33). Because DLMs use a data-driven approach for estimating period effects rather than averaging over pre-defined periods (e.g. trimesters of pregnancy), they can identify narrow or protracted periods of susceptibility (17).
In a simulation study, DLMs provided unbiased estimates and correctly identified susceptible periods while models using pre-specified, period-averaged exposure (with or without simultaneous adjustment) resulted in biased estimates (17). Susceptible periods for perinatal and pediatric health outcomes have been investigated using DLMs in studies of air pollutants (34–37), temperature (38–41), and tooth manganese levels (42). For example, Chiu et al. estimated associations of PM2.5 with child neurodevelopment using 1) pre-specified trimester- or pregnancy-averaged PM2.5 exposure modeled using multivariable linear regression models, and 2) weekly-averaged PM2.5 exposure modeled with DLMs (34). DLMs identified susceptible periods that were not evident using period-averaged models.
Others have extended the DLM framework to assess susceptible periods for exposure mixtures by developing lagged weighted quantile sum (WQS) regression and a tree-based DLM (43). The lagged WQS approach, based on penalized regression, models longitudinal exposure mixture trajectories over time and can accommodate missing or unequally-timed exposure data (43). A limitation of lagged WQS is the requirement that effects of all exposures at all periods are constrained to be in the same direction (i.e., positive or negative), which may not be reasonable in some settings. The tree-based method applies a non-parametric random forest algorithm to model summed mixture effects of exposures that must be measured at identical, discrete time intervals for all subjects (43). In simulations, both of these novel approaches performed better than generalized additive models using thin-plate splines in settings with more than 3 chemicals and 5 periods. The authors demonstrate the two DLM-based methods using a study of neurobehavior in relation to longitudinal metal exposures measured in deciduous teeth, where both approaches found similar periods of susceptibility in relation to the metal mixture and identified manganese as the largest contributor to the mixture effect (43).
Bayesian Approaches
Bayesian extensions of DLMs have been developed to investigate susceptible periods in complicated data structures. Bayesian DLMs can incorporate prior information on the shape of period-specific effects over time (44) and have been applied to identify susceptible periods without the need to specify time intervals a priori (45). Bayesian distributed lag interaction models were developed to formally investigate and test susceptible periods in the context of effect measure modification, where the timing of susceptible periods may depend on a modifier (32). This method has been applied to examine whether child’s sex or maternal stress modify the timing of susceptibility in studies of early life pollutant exposures and perinatal or pediatric health outcomes (46–49).
Lagged Bayesian kernel machine regression (LKMR) combines the DLM framework with Bayesian Kernel Machine Regression (BKMR) to identify periods of susceptibility to exposure mixtures (50). LKMR allows the effect of a mixture on an outcome to differ over time, allowing for non-linear and non-additive effects as well as interactions among exposures and within exposures over time. When applying LKMR to examine tooth metal mixtures in relation to child neurodevelopment, Liu et al. identified a time-varying association of manganese with visual spatial ability that was modified by zinc level (50). While LKMR is fit in a DLM framework, it is best-suited to exposure data with low temporal resolution such as biomarker data (50).
Warren and colleagues developed a flexible Bayesian spatial-temporal hierarchical probit regression model that applies a data-driven approach to determining susceptible periods for multiple pollutants, allowing that susceptible periods may differ spatially and by pollutant (51, 52). By incorporating spatial flexibility, this model accommodates the fact that air pollution constituents vary regionally and may lead to different biological effects. Warren and colleagues have applied this method to examine susceptible periods for associations of weekly-averaged air pollution exposures with preterm birth, cardiac defects, and low birthweight (51–53). Joint modeling of multiple outcomes and multiple exposures is also possible in this framework, such as the assessment of susceptible periods for multiple species of PM2.5 in relation to the development of multiple classes of cardiac defects (52, 54). This model was adapted to examine time-varying exposure effects on time-to-event outcomes, and notably applied to assess associations of PM2.5 with preterm birth that allowed associations to depend both on timing of exposure and timing of preterm birth treated as a time-to-event outcome (55).
Considerations for Future Research
Ideally, evaluation of susceptible periods is informed by developmental biology or toxicology studies that provide insight into the importance of exposure timing on disease etiology. In the absence of prior data for specific environmental exposures, investigating susceptible periods is often warranted based on the general concept of developmental plasticity or by analogy to effects of other exposures on the outcome of interest. Continued basic biological and toxicological research to understand developmental processes and susceptible periods will strengthen future epidemiologic work. Likewise, findings of unique susceptible periods in epidemiologic studies can inform experimental work exploring mechanisms underlying heightened susceptibility. Of particular importance for both experimental and observational research is assessment of susceptible periods outside of gestation, including preconception and adolescence (4).
Examination of susceptible periods requires repeated exposure measurements collected at times corresponding to the underlying susceptible period(s). For studies using biomarker assessments of exposure, longitudinal biospecimens are logistically difficult to collect and repeated assays are expensive to perform. While within-subject pooling can reduce exposure measurement error by providing a better estimate of long-term exposure, it precludes analysis of susceptible periods within the timeframe of the pooled samples and may even increase measurement error if specimens collected during a susceptible period are pooled with those from irrelevant periods (56). A balance in terms of cost might be achieved by collecting repeated samples but initially analyzing biomarkers in within-subject pooled samples; if an association is observed, archived samples can be subsequently analyzed to identify susceptible periods. While we are not aware of an application, an alternative approach warranting further study is to analyze repeated samples in a subset of participants and apply measurement error correction methods (57–59) to estimate period-specific associations.
As exposures are measured in a greater number of susceptible periods, we expect a shift in assessing independent effects of single exposures during single periods towards the examination of joint effects of several exposures in multiple susceptible periods. Such work will build on toxicological studies identifying multiple susceptible periods for the same health effect (60) and an expanding literature assessing effects of exposure mixtures (61, 62). Epidemiologists will need statistical tools capable of leveraging high-dimensional longitudinal data to answer such questions. To our knowledge, LKMR is the only statistical approach that has been applied to identify susceptible periods that allows for interaction between multiple exposures and among exposures over time (50). Additional work evaluating potential bias arising from correlation among repeated exposure measures is also needed as few studies have investigated the influence of exposure measurement error (63), correlated exposure measurement error (64, 65), or amplification bias (66) in the setting of multiple or repeated exposures.
Finally, it will be critical to determine if periods of heightened susceptibility are observed across populations. Given the potential for spurious results when examining numerous exposures in multiple time intervals, there is a compelling need for replication in separate study populations. However, lack of replication may also be due to differences in factors that modify susceptibility to environmental exposures at different developmental periods. In the United States, the NIH Environmental Influences on Child Health Outcomes (ECHO) Consortium is one resource that could be useful and well-powered for replication studies given that it includes several cohorts that have repeatedly assessed multiple exposures at similar developmental stages.
Conclusions
Statistical approaches to investigate susceptible periods have been developed for a range of complex data settings. Whereas traditional approaches require a priori specification of exposure periods, distributed lag models and Bayesian approaches allow for data-driven determination of periods of heightened susceptibility that may provide more nuanced insight into underlying mechanisms. We find Bayesian methods to be highly customizable, with the ability to assess susceptible periods while addressing correlated exposure data, high-dimensional data, effect measure modification, and other common statistical challenges. As approaches continue to be developed and validated, availability of software packages will be critical to facilitate their uptake by children’s environmental health researchers interested in examining periods of susceptibility.
Acknowledgments
Funding:
JPB and GBH: 5U24OD023382
JMB: R01 ES025214, R01 ES024381, R01 ES027408, and UG3 OD023313.
Footnotes
Conflict of Interest:
Joseph M. Braun was financially compensated for serving as an expert witness for plaintiffs in litigation related to tobacco smoke exposures. Ghassan B. Hamra reports grants from NIH, during the conduct of the study. Jessie P. Buckley declares that they have no conflict of interest.
Human and Animal Rights:
This article does not contain any studies with human or animal subjects performed by any of the authors.
References
** 15. Chen et al. 2015: Compares several methods for examining susceptible periods with repeated biomarker measures in relation to a time-fixed binary outcome
** 32. Wilson et al. 2017b: Demonstrates bias when using trimester-averaged exposure that is not present when using distributed lag models to identify susceptible periods
* 17. Wilson et al. 2017a: Allows for the timing of susceptible periods to depend on a modifier
* 55. Chang et al. 2015: Addresses susceptible periods when the outcome is time-varying
* 43. Bello et al. 2017: Extends distributed lag models to address periods of susceptibility to exposure mixtures using weighted quantile sum or tree-based methods
* 50. Liu et al. 2018: Examines periods of susceptibility to exposure mixtures using a highly flexible extension of distributed lag models based on Bayesian Kernel Machine Regression
- 1.Barr M Jr., DeSesso JM, Lau CS, Osmond C, Ozanne SE, Sadler TW, et al. Workshop to identify critical windows of exposure for children’s health: cardiovascular and endocrine work group summary. Environ Health Perspect. 2000;108 Suppl 3:569–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Selevan SG, Kimmel CA, Mendola P. Identifying critical windows of exposure for children’s health. Environ Health Perspect. 2000;108 Suppl 3:451–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.NIEHS. Advancing Science, Improving Health: A Plan for Environmental Health Research; 2012. [Google Scholar]
- 4.Braun JM, Gray K. Challenges to studying the health effects of early life environmental chemical exposures on children’s health. PLoS Biol. 2017;15(12):e2002800. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hamra GB, Buckley JP. Environmental Exposure Mixtures: Questions and Methods to Address Them. Current Epidemiology Reports. 2018;5(2):160–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Stafoggia M, Breitner S, Hampel R, Basagana X. Statistical Approaches to Address Multi-Pollutant Mixtures and Multiple Exposures: the State of the Science. Curr Environ Health Rep. 2017;4(4):481–90. [DOI] [PubMed] [Google Scholar]
- 7.Larsen WJ. Human Embryology. Philadelphia, PA: Churchill Livingstone; 2001. [Google Scholar]
- 8.Kim JH, Scialli AR. Thalidomide: the tragedy of birth defects and the effective treatment of disease. Toxicol Sci. 2011;122(1):1–6. [DOI] [PubMed] [Google Scholar]
- 9.Goderis J, De Leenheer E, Smets K, Van Hoecke H, Keymeulen A, Dhooge I. Hearing loss and congenital CMV infection: a systematic review. Pediatrics. 2014;134(5):972–82. [DOI] [PubMed] [Google Scholar]
- 10.Larsen W Human Embryology. Philadelphia, PA: Churchill Livingstone; 2001. [Google Scholar]
- 11.Rawlinson WD, Boppana SB, Fowler KB, Kimberlin DW, Lazzarotto T, Alain S, et al. Congenital cytomegalovirus infection in pregnancy and the neonate: consensus recommendations for prevention, diagnosis, and therapy. Lancet Infect Dis. 2017;17(6):e177–e88. [DOI] [PubMed] [Google Scholar]
- 12.Diderichsen F, Hallqvist J, Whitehead M. Differential vulnerability and susceptibility: how to make use of recent development in our understanding of mediation and interaction to tackle health inequalities. Int J Epidemiol. 2018. [DOI] [PubMed] [Google Scholar]
- 13.Raz R, Roberts AL, Lyall K, Hart JE, Just AC, Laden F, et al. Autism spectrum disorder and particulate matter air pollution before, during, and after pregnancy: a nested case-control analysis within the Nurses’ Health Study II Cohort. Environ Health Perspect. 2015;123(3):264–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Kalkbrenner AE, Windham GC, Serre ML, Akita Y, Wang X, Hoffman K, et al. Particulate matter exposure, prenatal and postnatal windows of susceptibility, and autism spectrum disorders. Epidemiology (Cambridge, Mass). 2015;26(1):30–42. [DOI] [PubMed] [Google Scholar]
- 15.Chen YH, Ferguson KK, Meeker JD, McElrath TF, Mukherjee B. Statistical methods for modeling repeated measures of maternal environmental exposure biomarkers during pregnancy in association with preterm birth. Environ Health. 2015;14:9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Sanchez BN, Hu H, Litman HJ, Tellez-Rojo MM. Statistical methods to study timing of vulnerability with sparsely sampled data on environmental toxicants. Environ Health Perspect. 2011;119(3):409–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Wilson A, Chiu YM, Hsu HL, Wright RO, Wright RJ, Coull BA. Potential for Bias When Estimating Critical Windows for Air Pollution in Children’s Health. Am J Epidemiol. 2017;186(11):1281–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Horton NJ, Laird NM, Zahner GEP. Use of multiple informant data as a predictor in psychiatric epidemiology. International Journal of Methods in Psychiatric Research. 1999;8(1):6–18. [Google Scholar]
- 19.Litman HJ, Horton NJ, Hernandez B, Laird NM. Incorporating missingness for estimation of marginal regression models with multiple source predictors. Stat Med. 2007;26(5):1055–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Stacy SL, Papandonatos GD, Calafat AM, Chen A, Yolton K, Lanphear BP, et al. Early life bisphenol A exposure and neurobehavior at 8years of age: Identifying windows of heightened vulnerability. Environ Int. 2017;107:258–65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Vuong AM, Yolton K, Poston KL, Xie C, Webster GM, Sjodin A, et al. Prenatal and postnatal polybrominated diphenyl ether (PBDE) exposure and measures of inattention and impulsivity in children. Neurotoxicol Teratol. 2017;64:20–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Vuong AM, Yolton K, Xie C, Webster GM, Sjodin A, Braun JM, et al. Childhood polybrominated diphenyl ether (PBDE) exposure and neurobehavior in children at 8 years. Environ Res. 2017;158:677–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Braun JM, Chen A, Hoofnagle A, Papandonatos GD, Jackson-Browne M, Hauser R, et al. Associations of early life urinary triclosan concentrations with maternal, neonatal, and child thyroid hormone levels. Hormones and behavior. 2018;101:77–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Vuong AM, Braun JM, Webster GM, Thomas Zoeller R, Hoofnagle AN, Sjodin A, et al. Polybrominated diphenyl ether (PBDE) exposures and thyroid hormones in children at age 3years. Environ Int. 2018;117:339–47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Vuong AM, Braun JM, Yolton K, Wang Z, Xie C, Webster GM, et al. Prenatal and childhood exposure to perfluoroalkyl substances (PFAS) and measures of attention, impulse control, and visual spatial abilities. Environ Int. 2018;119:413–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Vuong AM, Yolton K, Poston KL, Xie C, Webster GM, Sjodin A, et al. Childhood polybrominated diphenyl ether (PBDE) exposure and executive function in children in the HOME Study. International journal of hygiene and environmental health. 2018;221(1):87–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Vuong AM, Yolton K, Wang Z, Xie C, Webster GM, Ye X, et al. Childhood perfluoroalkyl substance exposure and executive function in children at 8years. Environ Int. 2018;119:212–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Zhang H, Yolton K, Webster GM, Ye X, Calafat AM, Dietrich KN, et al. Prenatal and childhood perfluoroalkyl substances exposures and children’s reading skills at ages 5 and 8years. Environ Int. 2018;111:224–31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Jackson-Browne MS, Papandonatos GD, Chen A, Calafat AM, Yolton K, Lanphear BP, et al. Identifying Vulnerable Periods of Neurotoxicity to Triclosan Exposure in Children. Environ Health Perspect. 2018;126(5):057001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Stacy SL, Papandonatos GD, Calafat AM, Chen A, Yolton K, Lanphear BP, et al. Early life bisphenol A exposure and neurobehavior at 8years of age: Identifying windows of heightened vulnerability. Environment international. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Gasparrini A Modeling exposure-lag-response associations with distributed lag nonlinear models. Stat Med. 2014;33(5):881–99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Wilson A, Chiu YM, Hsu HL, Wright RO, Wright RJ, Coull BA. Bayesian distributed lag interaction models to identify perinatal windows of vulnerability in children’s health. Biostatistics (Oxford, England). 2017;18(3):537–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Gasparrini A, Scheipl F, Armstrong B, Kenward MG. A penalized framework for distributed lag non-linear models. Biometrics. 2017. [DOI] [PubMed] [Google Scholar]
- 34.Chiu YH, Hsu HH, Coull BA, Bellinger DC, Kloog I, Schwartz J, et al. Prenatal particulate air pollution and neurodevelopment in urban children: Examining sensitive windows and sex-specific associations. Environ Int. 2016;87:56–65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Hsu HH, Chiu YH, Coull BA, Kloog I, Schwartz J, Lee A, et al. Prenatal Particulate Air Pollution and Asthma Onset in Urban Children. Identifying Sensitive Windows and Sex Differences. Am J Respir Crit Care Med. 2015;192(9):1052–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Martens DS, Cox B, Janssen BG, Clemente DBP, Gasparrini A, Vanpoucke C, et al. Prenatal Air Pollution and Newborns’ Predisposition to Accelerated Biological Aging. JAMA Pediatr. 2017;171(12):1160–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Raz R, Levine H, Pinto O, Broday DM, Yuval, Weisskopf MG. Traffic-Related Air Pollution and Autism Spectrum Disorder: A Population-Based Nested Case-Control Study in Israel. Am J Epidemiol. 2018;187(4):717–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Vicedo-Cabrera AM, Olsson D, Forsberg B. Exposure to seasonal temperatures during the last month of gestation and the risk of preterm birth in Stockholm. International journal of environmental research and public health. 2015;12(4):3962–78. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Vicedo-Cabrera AM, Iniguez C, Barona C, Ballester F. Exposure to elevated temperatures and risk of preterm birth in Valencia, Spain. Environ Res. 2014;134:210–7. [DOI] [PubMed] [Google Scholar]
- 40.Benmarhnia T, Auger N, Stanislas V, Lo E, Kaufman JS. The Relationship Between Apparent Temperature and Daily Number of Live Births in Montreal. Matern Child Health J. 2015;19(12):2548–51. [DOI] [PubMed] [Google Scholar]
- 41.Cox B, Vicedo-Cabrera AM, Gasparrini A, Roels HA, Martens E, Vangronsveld J, et al. Ambient temperature as a trigger of preterm delivery in a temperate climate. J Epidemiol Community Health. 2016. [DOI] [PubMed] [Google Scholar]
- 42.Claus Henn B, Austin C, Coull BA, Schnaas L, Gennings C, Horton MK, et al. Uncovering neurodevelopmental windows of susceptibility to manganese exposure using dentine microspatial analyses. Environ Res. 2018;161:588–98. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Bello GA, Arora M, Austin C, Horton MK, Wright RO, Gennings C. Extending the Distributed Lag Model framework to handle chemical mixtures. Environ Res. 2017;156:253–64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Welty LJ, Peng RD, Zeger SL, Dominici F. Bayesian distributed lag models: estimating effects of particulate matter air pollution on daily mortality. Biometrics. 2009;65(1):282–91. [DOI] [PubMed] [Google Scholar]
- 45.Roberts EM, English PB. Bayesian modeling of time-dependent vulnerability to environmental hazards: an example using autism and pesticide data. Stat Med. 2013;32(13):2308–19. [DOI] [PubMed] [Google Scholar]
- 46.Lee A, Leon Hsu HH, Mathilda Chiu YH, Bose S, Rosa MJ, Kloog I, et al. Prenatal fine particulate exposure and early childhood asthma: Effect of maternal stress and fetal sex. J Allergy Clin Immunol. 2018;141(5):1880–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Chiu YM, Hsu HL, Wilson A, Coull BA, Pendo MP, Baccarelli A, et al. Prenatal particulate air pollution exposure and body composition in urban preschool children: Examining sensitive windows and sex-specific associations. Environ Res. 2017;158:798–805. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Bose S, Chiu YM, Hsu HL, Di Q, Rosa MJ, Lee A, et al. Prenatal Nitrate Exposure and Childhood Asthma. Influence of Maternal Prenatal Stress and Fetal Sex. Am J Respir Crit Care Med. 2017;196(11):1396–403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Brunst KJ, Sanchez-Guerra M, Chiu YM, Wilson A, Coull BA, Kloog I, et al. Prenatal particulate matter exposure and mitochondrial dysfunction at the maternal-fetal interface: Effect modification by maternal lifetime trauma and child sex. Environ Int. 2018;112:49–58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Liu SH, Bobb JF, Lee KH, Gennings C, Claus Henn B, Bellinger D, et al. Lagged kernel machine regression for identifying time windows of susceptibility to exposures of complex mixtures. Biostatistics (Oxford, England). 2018;19(3):325–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Warren J, Fuentes M, Herring A, Langlois P. Spatial-temporal modeling of the association between air pollution exposure and preterm birth: identifying critical windows of exposure. Biometrics. 2012;68(4):1157–67. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Warren J, Fuentes M, Herring A, Langlois P. Bayesian Spatial-temporal Model for Cardiac Congenital Anomalies and Ambient Air Pollution Risk Assessment. Environmetrics. 2012;23(8):673–84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Warren JL, Fuentes M, Herring AH, Langlois PH. Air pollution metric analysis while determining susceptible periods of pregnancy for low birth weight. ISRN Obstet Gynecol. 2013;2013:387452. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Warren JL, Stingone JA, Herring AH, Luben TJ, Fuentes M, Aylsworth AS, et al. Bayesian multinomial probit modeling of daily windows of susceptibility for maternal PM2.5 exposure and congenital heart defects. Stat Med. 2016;35(16):2786–801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Chang HH, Warren JL, Darrow LA, Reich BJ, Waller LA. Assessment of critical exposure and outcome windows in time-to-event analysis with application to air pollution and preterm birth study. Biostatistics (Oxford, England). 2015;16(3):509–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Perrier F, Giorgis-Allemand L, Slama R, Philippat C. Within-subject Pooling of Biological Samples to Reduce Exposure Misclassification in Biomarker-based Studies. Epidemiology (Cambridge, Mass). 2016;27(3):378–88. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Kuchenhoff H, Mwalili SM, Lesaffre E. A general method for dealing with misclassification in regression: the misclassification SIMEX. Biometrics. 2006;62(1):85–96. [DOI] [PubMed] [Google Scholar]
- 58.Cole SR, Chu H, Greenland S. Multiple-imputation for measurement-error correction. Int J Epidemiol. 2006;35(4):1074–81. [DOI] [PubMed] [Google Scholar]
- 59.Rosner B, Willett WC, Spiegelman D. Correction of logistic regression relative risk estimates and confidence intervals for systematic within-person measurement error. Stat Med. 1989;8(9):1051–69;discussion 71–3 [DOI] [PubMed] [Google Scholar]
- 60.Gore AC, Chappell VA, Fenton SE, Flaws JA, Nadal A, Prins GS, et al. EDC-2: The Endocrine Society’s Second Scientific Statement on Endocrine-Disrupting Chemicals. Endocr Rev. 2015;36(6):E1–E150. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Carlin DJ, Rider CV, Woychik R, Birnbaum LS. Unraveling the health effects of environmental mixtures: an NIEHS priority. Environ Health Perspect. 2013;121(1):A6–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Braun JM, Gennings C, Hauser R, Webster TF. What Can Epidemiological Studies Tell Us about the Impact of Chemical Mixtures on Human Health? Environmental health perspectives. 2016;124(1):A6–A9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Warren JL, Son JY, Pereira G, Leaderer BP, Bell ML. Investigating the Impact of Maternal Residential Mobility on Identifying Critical Windows of Susceptibility to Ambient Air Pollution During Pregnancy. Am J Epidemiol. 2018;187(5):992–1000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Dionisio KL, Chang HH, Baxter LK. A simulation study to quantify the impacts of exposure measurement error on air pollution health risk estimates in copollutant time-series models. Environ Health. 2016;15(1):114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Keller JP, Drton M, Larson T, Kaufman JD, Sandler DP, Szpiro AA. Covariate-Adaptive Clustering of Exposures for Air Pollution Epidemiology Cohorts. Ann Appl Stat. 2017;11(1):93–113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Weisskopf MG, Seals RM, Webster TF. Bias Amplification in Epidemiologic Analysis of Exposure to Mixtures. Environ Health Perspect. 2018;126(4):047003. [DOI] [PMC free article] [PubMed] [Google Scholar]