Abstract
Background:
The National Institute of Environmental Health Sciences (NIEHS) continues to prioritize research to better understand the health effects resulting from exposure to mixtures of chemical and nonchemical stressors. Mixtures research activities over the last decade were informed by expert input during the development and deliberations of the 2011 NIEHS Workshop “Advancing Research on Mixtures: New Perspectives and Approaches for Predicting Adverse Human Health Effects.” NIEHS mixtures research efforts since then have focused on key themes including a) prioritizing mixtures for study, b) translating mixtures data from in vitro and in vivo studies, c) developing cross-disciplinary collaborations, d) informing component-based and whole-mixture assessment approaches, e) developing sufficient similarity methods to compare across complex mixtures, f) using systems-based approaches to evaluate mixtures, and g) focusing on management and integration of mixtures-related data.
Objectives:
We aimed to describe NIEHS driven research on mixtures and combined exposures over the last decade and present areas for future attention.
Results:
Intramural and extramural mixtures research projects have incorporated a diverse array of chemicals (e.g., polycyclic aromatic hydrocarbons, botanicals, personal care products, wildfire emissions) and nonchemical stressors (e.g., socioeconomic factors, social adversity) and have focused on many diseases (e.g., breast cancer, atherosclerosis, immune disruption). We have made significant progress in certain areas, such as developing statistical methods for evaluating multiple chemical associations in epidemiology and building translational mixtures projects that include both in vitro and in vivo models.
Discussion:
Moving forward, additional work is needed to improve mixtures data integration, elucidate interactions between chemical and nonchemical stressors, and resolve the geospatial and temporal nature of mixture exposures. Continued mixtures research will be critical to informing cumulative impact assessments and addressing complex challenges, such as environmental justice and climate change. https://doi.org/10.1289/EHP14340
Introduction
Biomonitoring programs1–3 indicate that people experience diverse chemical exposures from their use of personal care and household products, diet, lifestyle choices, occupational exposures, and incidental contact with environmental contaminants. People are also exposed to numerous nonchemical stressors,4 which include biological (e.g., viruses) and physical (e.g., noise, radiation) factors and psychosocial stressors (e.g., fear of violence, lack of social networks). Exposure patterns can vary widely with life stage (e.g., infancy, pregnancy, senectitude) and occupation. Racial/ethnic disparities in chemical and psychosocial stressor burdens can contribute to increased vulnerability in black and Hispanic communities.5 Despite this complex landscape, risk evaluations have traditionally focused on single chemicals and have addressed mixtures in more limited contexts (e.g., cumulative assessment of pesticides6 within mechanism-based classes, co-exposures at Superfund sites7).
Mixtures research—the study of the combined effects of chemicals and nonchemical stressors—is needed to provide the scientific basis for regulatory frameworks that fully account for real world exposures. This was highlighted in recent US Environmental Protection Agency (EPA) efforts to update practices associated with the Toxic Substances Control Act (TSCA),8 update the guidelines for cumulative risk assessment,9 and develop research priorities for addressing cumulative impacts.10 The overarching goal of mixtures research is to understand the contribution of complex environmental exposures to human disease. Component-based (i.e., bottom-up) research reduces the complexity of real-world exposures by focusing on known components (i.e., mixture components with available exposure and toxicity data) and evaluating defined mixtures with quantified constituents (Figure 1). Component-based approaches, typical in toxicology, gather data on individual chemicals and combinations thereof to evaluate hypotheses about the joint action of chemicals.11 Alternatively, top-down research starts with complex exposures (e.g., the totality of exposures over a lifetime or “exposome,” exposures measured in epidemiological cohorts, whole mixtures with some unidentified fraction) and attempts to deconvolute the connections between those complex exposures and observed responses and identify toxicity drivers (Figure 1). Top-down research approaches can range from epidemiological studies that include real-world exposures12 to toxicology studies that evaluate complex mixtures.13
Figure 1.
Approaches to mixtures research. Mixtures research can be “bottom-up” by reducing real-world mixtures to components (i.e., individual chemicals) and using additivity models to predict mixture effects or “top down” wherein complex whole mixtures related to the real-world exposure are evaluated. Whole mixtures can be variable, and approaches that compare across related mixtures are needed to ensure that data generated on one whole mixture can be used to estimate the risk associated with sufficiently similar data-poor mixtures. Both bottom-up and top-down approaches aim to inform intervention and exposure mitigation strategies to improve public health.
The National Institute of Environmental Health Sciences (NIEHS) has supported diverse mixtures research through both intramural and extramural programs.14–18 In 2010, NIEHS created the Cross-Divisional Combined Exposures and Mixtures (CEM) Focus Group to consolidate information, provide strategic guidance, and foster collaboration between its intramural [Division of Intramural Research (DIR) and the Division of Translational Toxicology (DTT)—formerly the Division of the National Toxicology Program] and extramural [Division of Extramural Research and Training (DERT)] divisions. To craft an NIEHS mixtures research strategy, the group organized a workshop in 2011 titled “Advancing Research on Mixtures: New Perspectives and Approaches for Predicting Adverse Human Health Effects.”16 Experts in exposure science, toxicology, epidemiology, statistics, and risk analysis representing all sectors (i.e., government, industry, academia, nongovernmental organizations) gathered to discuss critical areas for advancing the field. Cross-cutting themes that emerged from the workshop have influenced NIEHS mixtures research over the past decade (Table 1). Since 2012, the NIEHS Strategic Plan33,34 has prioritized combined exposures and mixtures, recently highlighting them among five cross-divisional research focus areas targeted for programmatic development along with environmental health disparities, metabolomics, microbiome, and neuroscience.
Table 1.
Mixtures research needs identified in the 2011 NIEHS workshop “Advancing Research on Mixtures: New Perspectives and Approaches for Predicting Adverse Human Health Effects” and related activities over the past decade.
| Theme | NIEHS activities |
|---|---|
| Prioritization of chemicals/mixtures (e.g., use of NHANES, EWAS, maximum cumulative ratio) | Exposure and exposome grants,19,20 intramural and extramural biostatistics projects21,22,23 |
| Translating mixtures research from in vitro to in vivo end points | Polycyclic Aromatic Compound Mixtures Assessment Program (PAC-MAP)24 |
| Cross-disciplinary efforts (e.g., coordination between epidemiology and toxicology) | PRIME,12 intramural epidemiology work,25–27 Superfund Research Program (SRP)17 |
| Development/refinement of both component-based and whole mixtures approaches | Component-based research efforts11 (e.g., PAC-MAP, PFAS); whole mixtures research28 (e.g., botanicals, SRP) |
| Sufficient similarity as a key approach | Botanicals29,30 |
| Systems-based approaches for studying mixtures | Atherosclerosis workshop, Converging on Cancer workshop, chemical and nonchemical stressor projects31 |
| Data collection and management | Botanical Safety Consortium32 |
Note: EWAS, environment-wide association studies; NHANES, National Health and Nutrition Examination Survey; NIEHS, National Institute of Environmental Health Sciences; PFAS, per- and polyfluoroalkyl substances.
In addition to NIEHS’s strong support for intramural mixtures research, funding for extramural work on mixtures has increased. The Superfund Research Program (SRP), mandated under the Superfund Amendments and Reauthorization Act of 1986,35 addresses complex issues relevant to hazardous substances36 and is particularly well-suited for supporting mixtures research. SRP Centers at Duke University, Harvard School of Public Health, Oregon State University, and Texas A&M have an explicit focus on mixtures. Beyond SRP funding, NIEHS also funds a significant body of investigator-initiated research on mixtures. A recent cursory portfolio analysis using the National Institutes of Health (NIH) RePORTER database (https://reporter.nih.gov/) resulted in almost 600 mixtures-focused projects funded and administered by NIEHS from fiscal year (FY) 2011 to FY 2021, compared to just over 350 projects from FY 2000 to FY 2010 when the word “mixtures” was used as a search term. Although, this portfolio has almost doubled in the past 10 years, grant recipients and reviewers have communicated to the authors that they have experienced challenges in the review process due to the complexity of mixtures research and the small number of experts focused on this research area (e.g., limited mixtures experts on grant review panels). The analysis does not account for the recent growth in the exposome grant portfolio37 and the increased focus on nonchemical stressors (e.g., noise, temperature, social factors, lack of health care, socioeconomic stressors, and circadian rhythm disruption) combined with environmental chemical stressors within the NIEHS health disparities and environmental justice portfolio of grants.38
In this commentary, we detail progress from the last decade and highlight persistent challenges requiring dedicated efforts. We also identify emerging issues that could shape mixtures research in the coming decade. Throughout, we highlight cross-disciplinary efforts, collaborative science, and policy implications.
Prioritization of Chemicals and Mixtures
Due to the staggering number of possible chemical combinations, the authors propose that approaches are required to prioritize mixtures that pose the greatest risk to public health. A first step is characterizing exposure patterns within diverse populations. The exposome concept39,40 offers the most comprehensive starting point. The exposome, a term first coined by Wild39 to encompass the totality of environmental exposures a person experiences, was later expanded to include all external and internal exposures throughout a person’s lifetime.40 While the exposome represents the ultimate real-world mixture, we distinguish it from the term “mixture,” which we are using to describe a snapshot of combined exposures in time that does not typically include endogenous responses to external stimuli. NIEHS supports considerable research in the areas of exposure science and the exposome.19,37 For example, the NIEHS Human Health Exposure Analysis Resource (HHEAR) program was developed to better understand how environmental exposures lead to disease and to promote the characterization of the exposome.41 Specifically, it enables NIH-funded researchers to measure environmental exposures and integrate their data with other datasets by providing access to laboratory, statistical, and data science analysis services.41 HHEAR-related projects have assessed exposures including phthalates,42 phenols,42 metals,5 per- and polyfluoroalkyl substances (PFAS),43 and flame retardants44 and associated biological responses including oxidative stress,45 DNA damage,46 and epigenomics.47 Diseases of interest have included asthma,48 diabetes,49 autism,50 and pregnancy outcomes.51 A list of all HHEAR publications can be found on the website.52
The proliferation of exposome research has galvanized advances in nontargeted analysis (e.g., metabolomics), which uses high-resolution mass spectrometry (HRMS), chemical databases, and computational tools to detect and identify unknown chemicals.53 Indeed, NIEHS supports intramural and extramural core laboratories (e.g., NIEHS Metabolomics Core, HHEAR, NIEHS Exposome Program) that conduct nontargeted analyses. These efforts have greatly enhanced our understanding of joint exposures and have identified contaminants of emerging concern.54
Important obstacles remain in fully realizing the potential of the exposome concept.55,56 Challenges include detecting the entire range of chemicals present in limited biological samples (e.g., blood), dealing with complex matrices and potential loss of unknown analytes during clean up steps, detecting very-low-level chemicals, lacking analytical standards for confirmation and quantification, identifying chemicals based on features detected in high-resolution mass spectrometry data, and accounting for changes over time.55 A 2021 NIEHS workshop discussed the importance of geospatial resolution of exposure data.57 The cross-disciplinary workshop discussion identified research areas that utilize geospatially resolved exposure data to inform epidemiological studies, including reduction of measurement errors and uncertainty in exposure estimates, as well as challenges in integration of data across multiple scales and sources.57 Despite these challenges, we contend that information gathered for the purpose of establishing the exposome (e.g., human biomonitoring, environmental measurements using personal monitoring devices, stationary area monitoring, and nontargeted analysis) provide an excellent starting place for mixture prioritization efforts.
The potential of biomonitoring and exposure data for prioritizing mixtures can be seen in large cohort studies such as NIEHS’ PEGS (Personalized Environment and Genes Study).21 Recently, Lowe et al.22 examined the association of chemical mixtures to psoriasis and eczema. They found that a multipollutant model accounting for cumulative exposures elucidated contributions that would not have been identified using single-chemical analyses.22
Two methods for prioritizing mixtures for study are the maximum cumulative ratio and environment-wide association studies (EWAS).16 The maximum cumulative ratio, proposed by Price and Han,58 represents the hazard index divided by the highest individual chemical risk quotient and is used to identify whether a single chemical is driving hazard vs. multiple chemicals contributing, thereby warranting a cumulative risk assessment. Recent examples of its application include identifying priority mixtures in European populations based on biomonitoring data3 and in a US watershed to identify priority areas for targeted ecological risk assessment activities.59 The maximum cumulative ratio also has clear policy implications based on its inclusion in the European Food Safety Authority’s (EFSA’s) guidance on harmonized methodologies for human health, animal health, and ecological risk assessment of combined exposure to multiple chemicals.60
Environment-wide association studies (EWAS) were introduced in 2010 for prioritizing mixtures based on agnostic and nontargeted investigation of chemical associations with a particular disease.61 EWAS borrowed statistical approaches developed for genome-wide association studies to identify environmental exposures that could be linked to biomarkers of disease—both measured in biomonitoring efforts (e.g., the National Health and Nutrition Examination Survey). NIEHS scientists leveraged the PEGS cohort to investigate associations between environmental factors and cardiovascular disease.23 While numerous EWAS have been conducted in the past decade, a recent review of EWAS identified challenges including standardization of study designs to allow for data integration and refining statistical testing methods.62 The authors concluded that EWAS offers a promising framework for generating hypotheses but requires further development to ensure replicability and reproducibility.62
In addition, in vitro high-throughput screening of individual chemicals and combinations thereof was recommended for prioritization of chemical mixtures, which could be followed by targeted in vitro or in vivo studies to confirm findings or test specific mixture hypotheses. Large-scale high-throughput screening programs such as Tox21, a collaboration between the NIEHS, the EPA, the National Center for Advancing Translational Sciences, and the Food and Drug Administration (FDA),63 have evaluated thousands of individual chemicals as well as several targeted mixtures in over 70 in vitro assays. NIEHS Superfund Center grantees have used a combination of exposure and in vitro screening data to prioritize mixtures for further study.64 A cross-disciplinary team used silicone wrist bands as personal monitoring devices to measure over 1,500 chemicals and identified 14 frequently detected chemicals. They then used in vitro [i.e., primary normal human bronchial epithelial (NHBE) cells] and in vivo (i.e., developmental zebrafish) models to evaluate both the individual chemicals and their mixtures.64 This approach minimizes the use of mammals, can determine the potential health effects in a faster timeframe, and can screen large numbers of chemicals at a time. We assert that these types of studies allow for the evaluation of interactions of chemicals and may assist in the prioritization of chemical mixtures for further study.
Translating Mixtures Research from in Vitro to in Vivo Endpoints
New Approach Methodologies (NAMs) do not have a harmonized definition65 but generally refer to in silico, in vitro, and nonmammalian whole animal (e.g., developmental zebrafish, C. elegans) approaches for evaluating hazard and risk, with intact animals excluded from some definitions.66 Regulatory agencies are keen on using predictive NAMs for evaluating risk and decreasing traditional animal testing (e.g., rodents, dogs, primates).66,67 Technological advances such as three-dimensional (3D) culture models68 and enriched databases for in silico evaluation like integrated chemical environment (ICE) developed by the National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM)69 have increased the credibility of NAMs. The concept of adverse outcome pathways (AOPs) has provided a framework for linking early molecular and cellular events to apical end points that provide the basis for risk evaluation.70 The use of NAMs in mixtures research is complicated by the potential for unanticipated interactions among mixture components as well as the compounding of the typical issues associated with NAMs (e.g., artifacts due to physicochemical properties like lipophilicity and volatility, matrix interference). NIEHS is dedicating significant intramural and extramural effort to evaluating and refining NAMs for mixture testing.
NIEHS DTT aims to incorporate in vitro and in silico evaluations into existing in vivo testing programs to compare results across methodologies, explore mechanisms of joint action, build confidence in NAM application to mixtures, and better define the domain of applicability for priority mixtures. These efforts reflect the broader shift from a hazard identification focus to a more translational mission within the DTT. For example, in collaboration with EPA scientists, mixtures of polycyclic aromatic compounds (PACs) are being evaluated in 28-d immunotoxicity studies in mice and an in vitro assay measuring aryl hydrocarbon receptor activation as part of the PAC Mixtures Assessment Program (PAC-MAP). In addition, in silico methods have been used to better define the PAC class and add context to the data currently being generated.24 Similarly, PFAS mixtures tested in vivo will also be evaluated in human in vitro liver models. NIEHS grantees are using in vitro systems (i.e., human receptors transfected into COS cells) to evaluate the joint effects of PFAS mixtures at the peroxisome proliferator activated receptor () level by comparing observed mixture responses to those predicted using a generalized concentration addition model that accommodates full and partial agonists.71 We submit that case studies comparing mixtures data from NAMs and traditional in vivo studies are needed to understand the domains of applicability of different NAMs and build confidence in using resulting data for public health decision-making.
Cross-Disciplinary Efforts
The complexity of mixtures research requires multidisciplinary collaboration. There are fundamental differences in the way various disciplines approach mixtures research (Figure 1). Toxicology tends to reduce mixtures to controlled and manageable components, while epidemiology starts with the complexity of real-world exposures.72 We contend that effective public health decision-making requires cross-disciplinary collaboration and data integration. Several NIEHS-driven efforts have been aimed at developing multidisciplinary collaborations and programs to address key questions in mixtures research.
In 2015, the NIEHS organized a workshop on “Statistical Approaches for Assessing Health Effects of Environmental Chemical Mixtures in Epidemiology” that brought together experts in epidemiology, toxicology, and statistics.73 The workshop aimed to explore novel statistical approaches designed to analyze complex chemical mixtures data in simulated and real-world epidemiological data sets. Key takeaways from the workshop were that the statistical method should be selected based upon consideration of the specific hypothesis or scientific question. Participants also stressed the need for sharing more simulated and real-world mixtures datasets among the research community to refine statistical methodologies.73
Following the workshop, NIEHS created the Powering Research Through Innovative Methods in Epidemiology (PRIME) Request for Applications (RFA) to support projects on developing innovative statistical methods to address the methodological challenges of mixtures analysis while considering toxicology in modeling strategies and providing statistical approach resources to the broader research community.74 Joubert et al.12 reviewed progress on the PRIME program. Thus far, the PRIME Program has supported six projects focused on statistical approaches involving response surface methods,75 Bayesian methods with variable selection,76 principal component pursuit methods,77 factor analysis for interactions,78 lagged weighted quantile sum regression,79 and explained variation methods,80 among others. The workshop and subsequent PRIME funding mechanism have had a significant impact, helping to stimulate a notable increase in epidemiological studies using novel statistical methods to examine multiple exposures.
Discussions from the NIEHS Cross-Divisional CEM Focus Group led to a 2022 NIEHS and NCI workshop on “Complex Exposures in Breast Cancer: Unraveling the Role of Environmental Mixtures,” which brought together epidemiologists, cancer biologists, toxicologists, and statisticians. The workshop highlighted recent NIEHS intramural81,82 and extramural83,84 research on breast cancer and mixtures. Other cross-disciplinary collaborations emerging from the focus group include work to evaluate the chemical and toxicological variability of botanical products in the marketplace85 and a pilot study measuring the bioactivity in samples collected from the Sister Study cohort, which are also undergoing nontargeted chemical analysis.
In addition to NIEHS collaborations involving intramural staff, the NIEHS supports a model of cross-disciplinary effort in mixtures research through the SRP, which includes research centers and other grant mechanisms for the past 35 years focused on biomedical and environmental science and engineering.36 Specific SRP mixtures-focused programs and projects are discussed in more detail throughout.
Development/Refinement of Both Component-Based and Whole-Mixtures Approaches
The 2000 EPA Supplementary Guidance for Conducting Health Risk Assessment of Chemical Mixtures86 presented three risk assessment paths (Figure 2). Based on data availability, these paths focus on the mixture in question, a similar mixture, or the known components of a mixture. Each path involves challenges and uncertainties that require research attention. NIEHS intramural and extramural research programs are aimed at informing both whole-mixture approaches that rely on either data from the mixture of interest or a related mixture(s) and component-based mixture approaches.
Figure 2.
Cumulative risk assessment options adapted from the 2000 US Environmental Protection Agency Supplementary Guidance for Conducting Health Risk Assessment of Chemical Mixtures.86 Based on data availability, risk assessments can be conducted using data from the whole mixture of interest, data from a sufficiently similar mixture(s), or data from known mixture constituents.
Component-Based Mixtures Work
Component-based approaches reduce complex mixtures to a defined set of constituents for which adequate data are available. A recent EPA white paper describes advances in the component-based approach of dose addition commonly applied to chemical mixtures.87 Although pragmatic, component-based approaches rely on several assumptions about the joint action of the chemicals. Polycyclic aromatic hydrocarbons (PAHs) provide an example of the component-based relative potency factor approach for estimating carcinogenic risk from exposure to mixtures.88,89 There are many uncertainties and limitations of the component-based approach, as noted with PAHs—and relevant to other chemical classes.90 PAHs represent a large class of structurally related compounds that are ubiquitous contaminants. They are created through incomplete combustion of organic matter and always exist as complex and dynamic mixtures. Although it is difficult to estimate the total number of PAHs and related compounds (i.e., heterocyclic and substituted PAHs), only a small fraction of PAHs has sufficient toxicity data available for use in quantitative cumulative risk evaluation. Furthermore, there are limited mixture data demonstrating that PAHs act through a common mechanism and display dose additivity (no interactions).90 Recommendations for strengthening the scientific basis for cumulative risk assessment include expanding the number of PAHs that are monitored and leveraging short-term and NAM data to develop relative potencies for a wider swath of PAHs.
Current efforts within the NIEHS DTT are aimed at addressing some of the important issues identified in supporting component-based risk assessments of PAHs.89,90 One of the objectives of the DTT’s CEM Program is to generate empirical evidence on component-based approaches and compare results to alternative whole-mixture approaches for assessing hazard. PACs, including parent PAHs as well as heterocyclic and substituted PAHs, are being used as a case study to rigorously evaluate select assumptions involved in the relative potency factor approach, refining statistical tools used in component-based mixture evaluations, expanding the scope to include structurally diverse PACs and noncarcinogenic effects of PACs (i.e., immunotoxicity), and exploring the utility of NAMs in PAC evaluation.91 Additionally, the DTT is collaborating with NIEHS grantees at Texas A&M University to evaluate global gene expression changes in liver tissues following exposure to individual PACs and PAC mixtures. Future component-based mixture evaluations will focus on environmentally relevant PFAS mixtures.
The SRP’s center grant mechanism (i.e., P42) has a long history of promoting component-based mixtures work. The Colorado State University SRP center focused on physiologically based-pharmacokinetic/pharmacodynamic (PB-PK/PD) modeling for mixtures, effects of a seven-chemical mixture on tumor promotion in a rodent hepatocarcinogenesis model, and ecosystem responses to a mixture of heavy metals.92,93 The Boston University SRP Center focused on refining component-based models for dose additivity in the generalized additivity model94,95 and evaluating exposure to nonchemical stressors (e.g., socioeconomic factors, social adversity), in combination with early life chemical exposures, that may alter adolescent and adult behavior.96,97
The Oregon State University SRP Center studies include how humans metabolize carcinogenic PAHs and developmental toxicities of PAH mixtures using a high-throughput zebrafish model.98 They have also deployed passive sampling devices to assess PAHs at Superfund sites to determine the effectiveness of remediation strategies as well as exposure assessment with the use of wearable wristbands.99 Finally, they have employed new analytical approaches to assessing chemical changes in PAHs at Superfund sites and have collaborated with Native American communities to measure personal exposure to PAH mixtures.100–103
Other SRP Centers are well-poised to support future mixtures research {e.g., Northeastern SRP Center (e.g., phthalate mixtures); University of Louisville SRP Center [e.g., volatile organic compound (VOC)] mixtures}, and Louisiana State University SRP Center [e.g., environmentally persistent free radicals (EPFRs)]. The SRP also maintains an R01 grant portfolio which focuses on remediation and prevention/intervention approaches to hazardous substances. For example, SRP funded investigator-initiated work to understand the effects of metals and their mixtures on the physical, chemical, and ecological environment in a contaminated stream system at the North Fork Clear Creek (NFCC) Superfund Site in central Colorado.104,105
Whole-Mixtures Work
Whole-mixture approaches are frequently limited by the paucity of whole-mixture toxicity data, uncertainty about toxicity-drivers within complex mixtures, and a lack of established methods for evaluating sufficient similarity of related mixtures. In this section, we will focus on efforts to generate data on whole mixtures and to identify toxic constituents.
Natural disasters, such as hurricanes, can result in significant contamination events. Resulting mixtures of concern can be complex and dynamic, challenging cleanup efforts. SRP grantees are working to better understand the complex mixtures resulting from natural disasters. Work by the Texas A&M University SRP Center has been focused on mitigating the human health consequences of exposure to hazardous mixtures during environmental emergency-related contamination events focusing on sites in the Galveston Bay/Houston Ship Channel area.106–109 Their other goal is to establish predictive in vitro methods for quantitative evaluation of the complex mixture-perturbed adverse outcome pathways and intra- and interindividual variability in toxicity.110
Mixtures resulting from biomass burning (e.g., wildfires, cookstove emissions) have important public health implications. In a 2014 NIEHS-organized symposium on “Assessing Exposures and Health Effects Related to Indoor Biomass Fuel Burning,” experts discussed best practices for measuring exposure to complex biomass burning emissions and research to improve cookstove technologies and interventions. Collaborative research stemming from the symposium engaged NIEHS, EPA, and RTI International researchers in evaluating the stability of cookstove emission samples generated under laboratory and simulated field conditions.111 Current NIEHS efforts focus on preparing a monograph for the Report on Carcinogens on wood smoke.112 Complementary to this, NIEHS-funded work has been aimed at understanding which constituents in wildfire smoke drive observed toxicity.113
The DTT has previously evaluated botanical dietary supplements such as black cohosh extract,114–116 ephedra,117 and Ginkgo biloba extract.118 Botanical ingredients are complex mixtures that typically contain hundreds to thousands of constituents, which can vary in composition depending on multiple environmental and processing factors.119 Additionally, botanicals are an important public health concern due to widespread exposure at relatively high doses, variable quality across the marketplace, and examples of adverse events in consumers.119 As such, botanical ingredients are ideal for developing methods to improve testing and aid in data interpretation of complex mixtures to better understand potential health effects. Current DTT work is focused on generating toxicological data on botanicals and developing tools to interpret complex mixture data with projects on evaluating polypharmacokinetics (using metabolomics to follow the pharmacokinetics of complex mixtures)120 and using bioassay guided fractionation.121 Finally, the DTT is playing a critical role in the Botanical Safety Consortium, a public–private partnership established through a memorandum of understanding between NIEHS, the FDA, and the Health and Environmental Sciences Institute (HESI), to provide scientific support for the use of in silico and in vitro approaches in the safety evaluation of botanicals.32
Future work will extend tools and approaches developed using botanicals to other environmentally relevant complex mixtures. High-priority intramural research on complex mixtures includes evaluating different formulations of aqueous film forming foam (AFFF) using in vitro liver models (building on individual PFAS work, e.g., Rowan-Carroll et al.122) assessing glyphosate formulations for genetic toxicity,123 and exploring the associations of personal care products with disease in epidemiological studies.124–128
Sufficient Similarity as a Key Approach
It is crucial to develop an evidence-based approach to determine when two related mixtures are sufficiently similar for data extrapolation.28 Sufficient similarity determinations typically involve chemical analysis of complex mixtures, bioactivity profiling, and multivariate statistical methods. They have been applied to various complex mixtures including drinking water disinfection byproducts,129 pyrethroid pesticides,130 and petroleum substances.131,132 We propose that continued method development and real-world case studies are necessary for regulatory application. Signaling the importance of these methods in mixtures risk assessment, the US EPA has developed a Mixtures Similarity Tool (MiST) based on the sufficient similarity approach described in Marshall et al.,130 to aid in the evaluation of polychlorinated biphenyls.133
The DTT has developed several case studies on determining sufficient similarity with black cohosh,29 Echinacea,29 and Ginkgo biloba30 extract that incorporate nontargeted chemical analysis and in vitro bioassays. An ongoing cross-divisional project between DTT and DIR scientists aims to use nuclear magnetic resonance (NMR), mass spectrometry, and bioactivity profiling to evaluate sufficient similarity of blue cohosh, yohimbe, and goldenseal samples.85 While the current focus of DTT’s complex mixtures research centers on botanicals, future plans include applying the methods to other complex mixtures (e.g., PAC-containing environmental samples).
Systems-Based Approaches for Studying Mixtures
We think that developing models that reflect the complexity of biological systems is important in mixtures research due to the potential for mixture constituents to interact with different cellular and molecular pathways that converge on common adverse outcomes. To address the goal of applying a systems biology approach to mixtures research, the NIEHS focused on atherosclerosis and carcinogenesis. The first workshop in 2018 cosponsored by NIEHS with the National Heart, Lung, and Blood Institute (NHLBI) was titled “Understanding the Combined Effects of Environmental Chemical and Non-Chemical Stressors: Atherosclerosis as a Model.” Workshop participants applied an AOP framework to elucidate the role of environmental chemicals and nonchemical stressors in atherosclerosis and discussed evidence for the impact and mechanisms of nonchemical stressors (e.g., depression/anxiety, poor sleep) on atherosclerosis. Participants recognized the complexity of studying the health effects posed by the combination of chemical and nonchemical stressors (personal communication). During the workshop, we noted that using the AOP framework to organize knowledge was useful for hypothesis generation, even though specific interaction pathway(s) were not definitively identified.
A second workshop organized by NIEHS in collaboration with EPA and University of California Berkeley (UC Berkeley) was held in 2019 and titled “Converging on Cancer.” Informed by the Halifax Project on exploring low-dose mixtures contribution to cancer,134,135 this workshop focused on using our knowledge of complex cancer biology and characteristics of carcinogens to inform research on how combinations of chemicals could contribute jointly to cancer development. A subsequent publication captured recommendations for designing mixtures studies.31
NIEHS prioritizes developing research projects to increase our understanding of how chemical and nonchemical stressors can contribute cumulatively to disease development. This complements efforts at the US EPA136 and by EuroMix researchers137 that use AOP Networks to develop and test hypotheses about the joint action of chemicals with divergent mechanisms of action. Initial project exploration has focused on design considerations in building a mixtures program to evaluate combinations of chemicals that target cancer-relevant targets.31 Future research in this area promises to shift the paradigm of cumulative risk assessment from a focus on narrowly defined and similarly acting chemicals (e.g., organophosphates) to a more comprehensive evaluation of chemical and nonchemical stressors that target common diseases.
Data Collection and Management
Literature searches for mixtures research often encounter a significant number of studies on single chemicals. Despite discussion on developing a federal database to collect and curate data from mixtures studies, we could not identify meaningful progress in this endeavor. The Interaction Profiles for Toxic Substances, maintained by the Agency for Toxic Substances and Disease Registry (ATSDR) provide the only dedicated source for mixture-specific interaction information.138 Software tools such as the Health Assessment Workplace Collaborative (HAWC) developed by DTT Integrative Health Assessments branch and the International Agency for Research on Carcinogens and Table Builder139 can be leveraged to deconvolute large literature pools. Advances in literature extraction methods have driven the development of approaches to predict causal relationships (e.g., ) from existing literature using statistical machine learning or deep learning.140 The NIH 2023 Data Sharing policy141 promises to significantly increase data sharing among mixtures researchers. Moving forward, it will be important to avoid identified pitfalls, such as legal and regulatory considerations, technical aspects, validation of data, misinterpretation of data, and difficulty with large data transfers.142 The NIEHS SRP, which supports cross-disciplinary focused centers, has also been a pioneer in the realm of data-sharing.143
Large-scale efforts to combine and harmonize data from multiple collection efforts will provide computational toxicologists with rich datasets for mixtures evaluation. Examples of this include a collaborative effort to screen chemicals for developmental neurotoxicity,144 the Consortium Linking Academic and Regulatory Insights on Bisphenol A Toxicity (CLARITY-BPA) project,145 and the Botanical Safety Consortium.32
Knowledge Gaps and Future Directions
Despite a significant amount of research effort dedicated to mixtures at NIEHS, there is still a long journey ahead with important knowledge gaps in understanding their health effects. While the mixtures research priorities at NIEHS reflect those of the wider mixtures research community, there are some important areas of research in which we are not currently engaged. For example, there are significant efforts in Europe to establish effect-based trigger values for mixtures assessments146 and to derive mixtures assessment (or allocation) factors for use in risk assessment.147
As discussed above, we are entering the age of data science and integration across large and diverse datasets, which brings both opportunities (e.g., building more predictive models for identifying and characterizing mixtures health risks) and significant challenges. Implementation of the NIH Data Sharing Policy in January 2023141 moves toward generating data that abides by the FAIR (findable, accessible, interoperable, and reproducible) principles.148 Study design, access to data, organization of data, machine learning, artificial intelligence, and novel statistical approaches will all be key in optimizing use of mixtures-relevant datasets. The increased availability of complex analysis approaches offers promise for increasing the utility of large datasets and generating new hypotheses. However, we also recognize the need for careful consideration in matching the appropriate model to the question at hand and avoiding the pitfalls of “overfitting” data (i.e., finding patterns in background noise).149,150 In addition, training the next generation of computational toxicologists will be critical. Development of datasets and training materials with mixtures-related examples, such as the InTelligence and Machine Learning (TAME) toolkit, will be particularly useful.151
There is growing interest from researchers, communities, and regulatory agencies for capturing a more comprehensive picture of risk from exposure to chemical and nonchemical stressors. The EPA recently published recommendations for cumulative impacts research10 in response to Executive Orders 13985 (FR Doc. 2021-01753) and 14008 (FR Doc. 2021-02177) aimed at advancing racial equity and supporting underserved communities and to address the climate crisis, respectively. Cumulative impact research involves evaluation of nonchemical stressors, which present challenges in epidemiological (e.g., biases in questionnaire data, the need to incorporate perception of stress) and toxicological (e.g., difficulty in developing animal models that accurately reflect human stressors) contexts. Furthermore, development of biomarkers that reflect cumulative stress (e.g., cortisol in hair and nails152) requires additional research attention. Community engagement is required to determine mixtures exposures of concern and priority diseases with links to environmental exposures. Finally, we contend that better use of biomonitoring and geospatially resolved data is needed to move forward.153
In our opinion, progress in exposomic research should be leveraged to inform prioritization of mixtures for study and to develop hypotheses that can be tested through mixtures research. Researchers at the UC Berkeley SRP Center have been actively pursuing the exposome,154–156 especially early life exposures, effects of chemical mixtures and their impacts on remediation efforts, and the complex transformation of chemicals to reactive intermediates. Additional work is needed to harness exposomic data for evaluating the health impacts of mixtures. Furthermore, there has been little progress on better understanding how the timing of combined exposures can impact health outcomes.
Finally, progress on addressing these critical areas will require cross-disciplinary and collaborative research. We recommend the development of an international community of practice mixtures group comprised of researchers and end-users (risk analysists) that could serve as a resource for vetting mixtures research plans and evaluating the success of ongoing research.
Conclusions
Continued mixtures research will be critical to informing cumulative impact assessments and addressing complex challenges like environmental justice and climate change. NIEHS’s strategic planning for 2023–2028 has identified multiple areas related to mixtures as high priorities for research, including climate change and joint effects of chemical and nonchemical stressors. Epidemiological, toxicological, and statistical cross-disciplinary mixtures work will continue within the intramural divisions of NIEHS. Extramurally, multiple SRP Centers have increased work on mixtures issues, and we anticipate continued increases in investigator-initiated mixtures research.
Acknowledgments
The authors would like to thank Paul Windsor for help with graphics, Manashree Malpe and Justin Crane for assistance with editing, and Nigel Walker and Michelle Heacock for their review of the manuscript.
This work was supported by the Intramural Research Program of the NIH, National Institute of Environmental Health Sciences, Intramural Research project ZIA ES103373.
Conclusions and opinions are those of the individual authors and do not necessarily reflect the policies or views of EHP Publishing or the National Institute of Environmental Health Sciences.
References
- 1.Sobus JR, DeWoskin RS, Tan Y-M, Pleil JD, Phillips MB, George BJ, et al. 2015. Uses of NHANES biomarker data for chemical risk assessment: trends, challenges, and opportunities. Environ Health Perspect 123(10):919–927, PMID: 25859901, 10.1289/ehp.1409177. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Gilles L, Govarts E, Rambaud L, Vogel N, Castaño A, Esteban López M, et al. 2021. HBM4EU combines and harmonises human biomonitoring data across the EU, building on existing capacity - The HBM4EU survey. Int J Hyg Environ Health 237:113809, PMID: 34455198, 10.1016/j.ijheh.2021.113809. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Socianu S, Bopp SK, Govarts E, Gilles L, Buekers J, Kolossa-Gehring M, et al. 2022. Chemical mixtures in the EU population: composition and potential risks. Int J Environ Res Public Health 19(10):6121, PMID: 35627658, 10.3390/ijerph19106121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Hibbert K, Tulve NS. 2019. State-of-the-science review of non-chemical stressors found in a child’s social environment. Int J Environ Res Public Health 16(22):4417, PMID: 31718056, 10.3390/ijerph16224417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Geron M, Cowell W, Amarasiriwardena C, Andra SS, Carroll K, Kloog I, et al. 2022. Racial/ethnic and neighborhood disparities in metals exposure during pregnancy in the northeastern United States. Sci Total Environ 820:153249, PMID: 35065119, 10.1016/j.scitotenv.2022.153249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.US EPA (US Environmental Protection Agency). 2002. Guidance on Cumulative Risk Assessment of Pesticide Chemicals that have a Common Mechanism of Toxicity. Washington, DC: US EPA. [Google Scholar]
- 7.US EPA. 1989. Risk Assessment Guidance for Superfund Volume I Human Health Evaluation Manual (Part A). Washington, DC: US EPA. [Google Scholar]
- 8.US EPA. 2023. Draft Proposed Principles of Cumulative Risk Assessment under the Toxic Substances Control Act. Washington, DC: US EPA. [Google Scholar]
- 9.US EPA. 2023. Guidelines for Cumulative Risk Assessment Planning and Problem Formulation - Draft for Public Comment. Washington, DC: US EPA. [Google Scholar]
- 10.US EPA. 2022. Cumulative Impacts Research: Recommendations for EPA’s Office of Research and Development. Washington, DC: US EPA. [Google Scholar]
- 11.Rider CV. 2022. Mixture math: deciding what to add in a cumulative risk assessment. Curr Opin Toxicol 31:100358, PMID: 35813121, 10.1016/j.cotox.2022.100358. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Joubert BR, Kioumourtzoglou M-A, Chamberlain T, Chen HY, Gennings C, Turyk ME, et al. 2022. Powering research through innovative methods for mixtures in epidemiology (PRIME) program: novel and expanded statistical methods. Int J Environ Res Public Health 19(3):1378, PMID: 35162394, 10.3390/ijerph19031378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.de Oliveira Galvao MF, Sadiktsis I, Marques Pedro T, Dreij K. 2022. Determination of whole mixture-based potency factors for cancer risk assessment of complex environmental mixtures by in vitro testing of standard reference materials. Environ Int 166:107345, PMID: 35717713, 10.1016/j.envint.2022.107345. [DOI] [PubMed] [Google Scholar]
- 14.Suk WA, Olden K, Yang RS. 2002. Chemical mixtures research: significance and future perspectives. Environ Health Perspect 110(suppl 6):891–892, PMID: 12634115, 10.1289/ehp.110-1241268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Rider CV, Carlin DJ, Devito MJ, Thompson CL, Walker NJ. 2013. Mixtures research at NIEHS: an evolving program. Toxicology 313(2–3):94–102, PMID: 23146757, 10.1016/j.tox.2012.10.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Carlin DJ, Rider CV, Woychik R, Birnbaum LS. 2013. Unraveling the health effects of environmental mixtures: an NIEHS priority. Environ Health Perspect 121(1):A6–A8, PMID: 23409283, 10.1289/ehp.1206182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Carlin DJ, Henry H, Heacock M, Trottier B, Drew CH, Suk WA. 2018. The national institute of environmental health sciences superfund research program: a model for multidisciplinary training of the next generation of environmental health scientists. Rev Environ Health 33(1):53–62, PMID: 29055939, 10.1515/reveh-2017-0024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Yang RS, Rauckman EJ. 1987. Toxicological studies of chemical mixtures of environmental concern at the national toxicology program: health effects of groundwater contaminants. Toxicology 47(1–2):15–34, PMID: 3686528, 10.1016/0300-483x(87)90158-2. [DOI] [PubMed] [Google Scholar]
- 19.Cui Y, Balshaw DM, Kwok RK, Thompson CL, Collman GW, Birnbaum LS. 2016. The exposome: embracing the complexity for discovery in environmental health. Environ Health Perspect 124(8):A137–A140, PMID: 27479988, 10.1289/EHP412. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.NIEHS (National Institute of Environmental Health Sciences). 2021. Exposure Biology and the Exposome. https://www.niehs.nih.gov/research/supported/exposure/bio/index.cfm [accessed 11 July 2023].
- 21.NIEHS. 2024. PEGS: Personalized Environment and Genes Study. https://www.niehs.nih.gov/research/atniehs/labs/crb/studies/pegs [accessed 23 April 2024].
- 22.Lowe ME, Akhtari FS, Potter TA, Fargo DC, Schmitt CP, Schurman SH, et al. 2023. The skin is no barrier to mixtures: air pollutant mixtures and reported psoriasis or eczema in the personalized environment and genes study (PEGS). J Expo Sci Environ Epidemiol 33(3):474–481, PMID: 36460922, 10.1038/s41370-022-00502-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Lee EY, Akhtari F, House JS, Simpson RJ, Schmitt CP, Fargo DC, et al. 2022. Questionnaire-based exposome-wide association studies (ExWAS) reveal expected and novel risk factors associated with cardiovascular outcomes in the personalized environment and genes study. Environ Res 212(pt D):113463, PMID: 35605674, 10.1016/j.envres.2022.113463. [DOI] [PubMed] [Google Scholar]
- 24.Hsieh JH, Sedykh A, Mutlu E, Germolec DR, Auerbach SS, Rider CV. 2021. Harnessing in silico, in vitro, and in vivo data to understand the toxicity landscape of polycyclic aromatic compounds (PACs). Chem Res Toxicol 34(2):268–285, PMID: 33063992, 10.1021/acs.chemrestox.0c00213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Bommarito PA, Welch BM, Keil AP, Baker GP, Cantonwine DE, McElrath TF, et al. 2021. Prenatal exposure to consumer product chemical mixtures and size for gestational age at delivery. Environ Health 20(1):68, PMID: 34112176, 10.1186/s12940-021-00724-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Keil AP, Buckley JP, O’Brien KM, Ferguson KK, Zhao S, White AJ. 2020. A quantile-based g-computation approach to addressing the effects of exposure mixtures. Environ Health Perspect 128(4):47004, PMID: 32255670, 10.1289/EHP5838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.van den Dries MA, Ferguson KK, Keil AP, Pronk A, Spaan S, Ghassabian A, et al. 2021. Prenatal exposure to nonpersistent chemical mixtures and offspring IQ and emotional and behavioral problems. Environ Sci Technol 55(24):16502–16514, PMID: 34878787, 10.1021/acs.est.1c04455. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Rager JE, Rider CV. 2023. Wrangling whole mixtures risk assessment: recent advances in determining sufficient similarity. Curr Opin Toxicol 35:100417, PMID: 37790747, 10.1016/j.cotox.2023.100417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ryan KR, Huang MC, Ferguson SS, Waidyanatha S, Ramaiahgari S, Rice JR, et al. 2019. Evaluating sufficient similarity of botanical dietary supplements: combining chemical and in vitro biological data. Toxicol Sci 172(2):316–329, PMID: 31504990, 10.1093/toxsci/kfz189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Catlin NR, Collins BJ, Auerbach SS, Ferguson SS, Harnly JM, Gennings C, et al. 2018. How similar is similar enough? A sufficient similarity case study with Ginkgo biloba extract. Food Chem Toxicol 118:328–339, PMID: 29752982, 10.1016/j.fct.2018.05.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Rider CV, McHale CM, Webster TF, Lowe L, Goodson WH, La Merrill MA, et al. 2021. Using the key characteristics of carcinogens to develop research on chemical mixtures and cancer. Environ Health Perspect 129(3):35003, PMID: 33784186, 10.1289/EHP8525. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Mitchell CA, Dever JT, Gafner S, Griffiths JC, Marsman DS, Rider C, et al. 2022. The botanical safety consortium: a public-private partnership to enhance the botanical safety toolkit. Regul Toxicol Pharmacol 128:105090, PMID: 34863907, 10.1016/j.yrtph.2021.105090. [DOI] [PubMed] [Google Scholar]
- 33.NIEHS (National Institute of Environmental Health Sciences). 2018. 2018–2023 Strategic Plan: Advancing Environmental Health Sciences, Improving Health. Bethesda, MD: National Institutes of Health. [Google Scholar]
- 34.NIEHS. 2012. 2012–2017 Strategic Plan Advancing Science, Improving Health: A Plan for Environmental Research. Bethesda, MD: National Institutes of Health. [Google Scholar]
- 35.Landrigan PJ, Wright RO, Cordero JF, Eaton DL, Goldstein BD, Hennig B, et al. 2015. The NIEHS superfund research program: 25 years of translational research for public health. Environ Health Perspect 123(10):909–918, PMID: 25978799, 10.1289/ehp.1409247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.NIEHS. 2024. Superfund Research Program. https://www.niehs.nih.gov/research/supported/centers/srp [accessed 23 April 2024].
- 37.NIEHS. 2021. Exposure Biology and the Exposome. https://www.niehs.nih.gov/research/supported/exposure/bio [accessed 23 April 2024].
- 38.NIEHS. 2024. Environmental Health Disparities and Environmental Justice. https://www.niehs.nih.gov/research/supported/translational/justice [accessed 23 April 2024].
- 39.Wild CP. 2005. Complementing the genome with an “exposome”: the outstanding challenge of environmental exposure measurement in molecular epidemiology. Cancer Epidemiol Biomarkers Prev 14(8):1847–1850, PMID: 16103423, 10.1158/1055-9965.EPI-05-0456. [DOI] [PubMed] [Google Scholar]
- 40.Vermeulen R, Schymanski EL, Barabasi AL, Miller GW. 2020. The exposome and health: where chemistry meets biology. Science 367(6476):392–396, PMID: 31974245, 10.1126/science.aay3164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Viet SM, Falman JC, Merrill LS, Faustman EM, Savitz DA, Mervish N, et al. 2021. Human health exposure analysis resource (HHEAR): a model for incorporating the exposome into health studies. Int J Hyg Environ Health 235:113768, PMID: 34034040, 10.1016/j.ijheh.2021.113768. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Yoon LS, Binder AM, Pereira A, Calafat AM, Shepherd J, Corvalán C, et al. 2022. Variability in urinary phthalates, phenols, and parabens across childhood and relation to adolescent breast composition in Chilean girls. Environ Int 170:107586, PMID: 36302292, 10.1016/j.envint.2022.107586. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Chang C-J, Ryan PB, Smarr MM, Kannan K, Panuwet P, Dunlop AL, et al. 2021. Serum per- and polyfluoroalkyl substance (PFAS) concentrations and predictors of exposure among pregnant African American women in the Atlanta area, Georgia. Environ Res 198:110445, PMID: 33186575, 10.1016/j.envres.2020.110445. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ma J, Zhu H, Kannan K. 2019. Organophosphorus flame retardants and plasticizers in breast milk from the United States. Environ Sci Technol Lett 6(9):525–531, PMID: 31534982, 10.1021/acs.estlett.9b00394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Martinez-Moral MP, Kannan K. 2022. Analysis of 19 urinary biomarkers of oxidative stress, nitrative stress, metabolic disorders, and inflammation using liquid chromatography-tandem mass spectrometry. Anal Bioanal Chem 414(6):2103–2116, PMID: 35013809, 10.1007/s00216-021-03844-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Rocha BA, Asimakopoulos AG, Honda M, da Costa NL, Barbosa RM, Barbosa F, et al. 2018. Advanced data mining approaches in the assessment of urinary concentrations of bisphenols, chlorophenols, parabens and benzophenones in Brazilian children and their association to DNA damage. Environ Int 116:269–277, PMID: 29704805, 10.1016/j.envint.2018.04.023. [DOI] [PubMed] [Google Scholar]
- 47.McCabe CF, LaBarre JL, Domino SE, Treadwell MC, Baylin A, Burant CF, et al. 2022. Maternal and neonatal one-carbon metabolites and the epigenome-wide infant response. J Nutr Biochem 101:108938, PMID: 35017001, 10.1016/j.jnutbio.2022.108938. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Louis LM, Buckley JP, Kuiper JR, Meeker JD, Hansel NN, McCormack MC, et al. 2023. Exposures to organophosphate esters and respiratory morbidity among school-aged children with asthma. Environ Sci Technol 57(16):6435–6443, PMID: 37040548, 10.1021/acs.est.2c05911. [DOI] [PubMed] [Google Scholar]
- 49.Zhu Y, Barupal DK, Ngo AL, Quesenberry CP, Feng J, Fiehn O, et al. 2022. Predictive metabolomic markers in early to mid-pregnancy for gestational diabetes mellitus: a prospective test and validation study. Diabetes 71(8):1807–1817, PMID: 35532743, 10.2337/db21-1093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Ames JL, Burjak M, Avalos LA, Braun JM, Bulka CM, Croen LA, et al. 2023. Prenatal exposure to per- and polyfluoroalkyl substances and childhood autism-related outcomes. Epidemiology 34(3):450–459, PMID: 36630444, 10.1097/EDE.0000000000001587. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Eick SM, Barr DB, Brennan PA, Taibl KR, Tan Y, Robinson M, et al. 2023. Per- and polyfluoroalkyl substances and psychosocial stressors have a joint effect on adverse pregnancy outcomes in the Atlanta African American maternal-child cohort. Sci Total Environ 857(pt 2):159450, PMID: 36252672, 10.1016/j.scitotenv.2022.159450. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.HHEAR (Human Health Exposure Analysis Resource). 2023. HHEAR and CHEAR Publications. https://hhearprogram.org/chear-publications [accessed 23 April 2024].
- 53.Manz KE, Feerick A, Braun JM, Feng Y-L, Hall A, Koelmel J, et al. 2023. Non-targeted analysis (NTA) and suspect screening analysis (SSA): a review of examining the chemical exposome. J Expo Sci Environ Epidemiol 33(4):524–536, PMID: 37380877, 10.1038/s41370-023-00574-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Pourchet M, Debrauwer L, Klanova J, Price EJ, Covaci A, Caballero-Casero N, et al. 2020. Suspect and non-targeted screening of chemicals of emerging concern for human biomonitoring, environmental health studies and support to risk assessment: from promises to challenges and harmonisation issues. Environ Int 139:105545, PMID: 32361063, 10.1016/j.envint.2020.105545. [DOI] [PubMed] [Google Scholar]
- 55.David A, Chaker J, Price EJ, Bessonneau V, Chetwynd AJ, Vitale CM, et al. 2021. Towards a comprehensive characterisation of the human internal chemical exposome: challenges and perspectives. Environ Int 156:106630, PMID: 34004450, 10.1016/j.envint.2021.106630. [DOI] [PubMed] [Google Scholar]
- 56.Zhang P, Carlsten C, Chaleckis R, Hanhineva K, Huang M, Isobe T, et al. 2021. Defining the scope of exposome studies and research needs from a multidisciplinary perspective. Environ Sci Technol Lett 8(10):839–852, PMID: 34660833, 10.1021/acs.estlett.1c00648. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Cui Y, Eccles KM, Kwok RK, Joubert BR, Messier KP, Balshaw DM. 2022. Integrating multiscale geospatial environmental data into large population health studies: challenges and opportunities. Toxics 10(7):403, PMID: 35878308, 10.3390/toxics10070403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Price PS, Han X. 2011. Maximum cumulative ratio (MCR) as a tool for assessing the value of performing a cumulative risk assessment. Int J Environ Res Public Health 8(6):2212–2225, PMID: 21776227, 10.3390/ijerph8062212. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Maloney EM, Villeneuve DL, Jensen KM, Blackwell BR, Kahl MD, Poole ST, et al. 2023. Evaluation of complex mixture toxicity in the Milwaukee Estuary (WI, USA) using whole-mixture and component-based evaluation methods. Environ Toxicol Chem 42(6):1229–1256, PMID: 36715369, 10.1002/etc.5571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.More SJ, Bampidis V, Benford D, Bennekou SH, Bragard C, Halldorsson TI, et al. 2019. Guidance on harmonised methodologies for human health, animal health and ecological risk assessment of combined exposure to multiple chemicals. EFSA J 17(3):e05634, PMID: 32626259, 10.2903/j.efsa.2019.5634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Patel CJ, Bhattacharya J, Butte AJ. 2010. An environment-wide association study (EWAS) on type 2 diabetes mellitus. PLoS One 5(5):e10746, PMID: 20505766, 10.1371/journal.pone.0010746. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Zheng Y, Chen Z, Pearson T, Zhao J, Hu H, Prosperi M. 2020. Design and methodology challenges of environment-wide association studies: a systematic review. Environ Res 183:109275, PMID: 32105887, 10.1016/j.envres.2020.109275. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Tice RR, Austin CP, Kavlock RJ, Bucher JR. 2013. Improving the human hazard characterization of chemicals: a Tox21 update. Environ Health Perspect 121(7):756–765, PMID: 23603828, 10.1289/ehp.1205784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Rivera BN, Wilson LB, Kim DN, Pande P, Anderson KA, Tilton SC, et al. 2022. A comparative multi-system approach to characterizing bioactivity of commonly occurring chemicals. Int J Environ Res Public Health 19(7):3829, PMID: 35409514, 10.3390/ijerph19073829. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.OECD (Organisation for Economic Co-operation and Development). 2020. Overview of Concepts and Available Guidance related to Integrated Approaches Testing and Assessment (IATA). Paris, France: OECD. [Google Scholar]
- 66.US EPA. 2021. EPA New Approach Methods Work Plan. Washington, DC: US EPA. [Google Scholar]
- 67.Parish ST, Aschner M, Casey W, Corvaro M, Embry MR, Fitzpatrick S, et al. 2020. An evaluation framework for new approach methodologies (NAMs) for human health safety assessment. Regul Toxicol Pharmacol 112:104592, PMID: 32017962, 10.1016/j.yrtph.2020.104592. [DOI] [PubMed] [Google Scholar]
- 68.Wang H, Brown PC, Chow ECY, Ewart L, Ferguson SS, Fitzpatrick S, et al. 2021. 3D cell culture models: drug pharmacokinetics, safety assessment, and regulatory consideration. Clin Transl Sci 14(5):1659–1680, PMID: 33982436, 10.1111/cts.13066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Bell S, Abedini J, Ceger P, Chang X, Cook B, Karmaus AL, et al. 2020. An integrated chemical environment with tools for chemical safety testing. Toxicol In Vitro 67:104916, PMID: 32553663, 10.1016/j.tiv.2020.104916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Leist M, Ghallab A, Graepel R, Marchan R, Hassan R, Bennekou SH, et al. 2017. Adverse outcome pathways: opportunities, limitations and open questions. Arch Toxicol 91(11):3477–3505, PMID: 29051992, 10.1007/s00204-017-2045-3. [DOI] [PubMed] [Google Scholar]
- 71.Nielsen G, Heiger-Bernays WJ, Schlezinger JJ, Webster TF. 2022. Predicting the effects of per- and polyfluoroalkyl substance mixtures on peroxisome proliferator-activated receptor alpha activity in vitro. Toxicology 465:153024, PMID: 34743024, 10.1016/j.tox.2021.153024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Howard GJ, Webster TF. 2013. Contrasting theories of interaction in epidemiology and toxicology. Environ Health Perspect 121(1):1–6, PMID: 23014866, 10.1289/ehp.1205889. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Taylor KW, Joubert BR, Braun JM, Dilworth C, Gennings C, Hauser R, et al. 2016. Statistical approaches for assessing health effects of environmental chemical mixtures in epidemiology: lessons from an innovative workshop. Environ Health Perspect 124(12):A227–A229, PMID: 27905274, 10.1289/EHP547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.NIEHS. 2023. Powering Research Through Innovative Methods for Mixtures in Epidemiology (PRIME) Program. https://www.niehs.nih.gov/research/supported/exposure/mixtures/prime_program [accessed 23 April 2024].
- 75.McGee G, Wilson A, Coull BA, Webster TF. 2023. Incorporating biological knowledge in analyses of environmental mixtures and health. Stat Med 42(17):3016–3031, PMID: 37161723, 10.1002/sim.9765. [DOI] [PubMed] [Google Scholar]
- 76.Kowal DR, Bravo M, Leong H, Bui A, Griffin RJ, Ensor KB, et al. 2021. Bayesian variable selection for understanding mixtures in environmental exposures. Stat Med 40(22):4850–4871, PMID: 34132416, 10.1002/sim.9099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Gibson EA, Zhang J, Yan J, Chillrud L, Benavides J, Nunez Y, et al. 2022. Principal component pursuit for pattern identification in environmental mixtures. Environ Health Perspect 130(11):117008. PMID: 36416734, 10.1289/EHP10479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Ferrari F, Dunson DB. 2021. Bayesian factor analysis for inference on interactions. J Am Stat Assoc 116(535):1521–1532, PMID: 34898761, 10.1080/01621459.2020.1745813. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Gennings C, Curtin P, Bello G, Wright R, Arora M, Austin C. 2020. Lagged WQS regression for mixtures with many components. Environ Res 186:109529, PMID: 32371274, 10.1016/j.envres.2020.109529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Chen HY, Li H, Argos M, Persky VW, Turyk ME. 2022. Statistical methods for assessing the explained variation of a health outcome by a mixture of exposures. Int J Environ Res Public Health 19(5):2693, PMID: 35270383, 10.3390/ijerph19052693. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Niehoff NM, Terry MB, Bookwalter DB, Kaufman JD, O’Brien KM, Sandler DP, et al. 2022. Air pollution and breast cancer: an examination of modification by underlying familial breast cancer risk. Cancer Epidemiol Biomarkers Prev 31(2):422–429, PMID: 34906967, 10.1158/1055-9965.EPI-21-1140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Kay JE, Cardona B, Rudel RA, Vandenberg LN, Soto AM, Christiansen S, et al. 2022. Chemical effects on breast development, function, and cancer risk: existing knowledge and new opportunities. Curr Environ Health Rep 9(4):535–562, PMID: 35984634, 10.1007/s40572-022-00376-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Koval LE, Dionisio KL, Friedman KP, Isaacs KK, Rager JE. 2022. Environmental mixtures and breast cancer: identifying co-exposure patterns between understudied vs breast cancer-associated chemicals using chemical inventory informatics. J Expo Sci Environ Epidemiol 32(6):794–807, PMID: 35710593, 10.1038/s41370-022-00451-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Polemi KM, Nguyen VK, Heidt J, Kahana A, Jolliet O, Colacino JA. 2021. Identifying the link between chemical exposures and breast cancer in African American women via integrated in vitro and exposure biomarker data. Toxicology 463:152964, PMID: 34600088, 10.1016/j.tox.2021.152964. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Quiroz-Delfi GO, Rider CV, Ferguson S, Jarmusch AK, Mueller GA. 2023. Non-targeted chemical analysis of consumer botanical products labelled as blue cohosh (Caulophyllum thalictroides), goldenseal (Hydrastis Canadensis), or yohimbe bark (Pausinystalia johimbe) by NMR and MS. Anal Bioanal Chem 416(1):175–189, PMID: 37910202, 10.1007/s00216-023-05004-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.US EPA. 2000. Supplementary Guidance for Conducting Health Risk Assessment of Chemical Mixtures. Washington, DC: US EPA. [Google Scholar]
- 87.US EPA. 2023. Advances in Dose Addition for Chemical Mixtures: a White Paper. Washington, DC: US EPA. [Google Scholar]
- 88.US EPA. 1993. Provisional Guidance for Quantitative Risk Assessment of Polycyclic Aromatic Hydrocarbons. Washington, DC: US EPA. [Google Scholar]
- 89.Flowers L, Rieth SH, Cogliano VJ, Foureman GL, Hertzberg R, Hofmann EL, et al. 2002. Health assessment of polycyclic aromatic hydrocarbon mixtures: current practices and future directions. Polycyclic Aromatic Compounds 22(3–4):811–821, 10.1080/10406630290103960. [DOI] [Google Scholar]
- 90.Haber LT, Pecquet AM, Vincent MJ, White LM. 2022. The long goodbye: finally moving on from the relative potency approach to a mixtures approach for polycyclic aromatic hydrocarbons (PAHs). Int J Environ Res Public Health 19(15):9490, PMID: 35954852, 10.3390/ijerph19159490. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Hsieh NH, Chen Z, Rusyn I, Chiu WA. 2021. Risk characterization and probabilistic concentration-response modeling of complex environmental mixtures using new approach methodologies (NAMs) data from organotypic in vitro human stem cell assays. Environ Health Perspect 129(1):17004, PMID: 33395322, 10.1289/EHP7600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Bae D-S, Handa RJ, Yang RSH, Campain JA. 2003. Gene expression patterns as potential molecular biomarkers for malignant transformation in human keratinocytes treated with MNNG, arsenic, or a metal mixture. Toxicol Sci 74(1):32–42, PMID: 12773770, 10.1093/toxsci/kfg124. [DOI] [PubMed] [Google Scholar]
- 93.Gustafson DL, Long ME, Thomas RS, Benjamin SA, Yang RS. 2000. Comparative hepatocarcinogenicity of hexachlorobenzene, pentachlorobenzene, 1,2,4,5-tetrachlorobenzene, and 1,4-dichlorobenzene: application of a medium-term liver focus bioassay and molecular and cellular indices. Toxicol Sci 53(2):245–252, 10.1093/toxsci/53.2.245. [DOI] [PubMed] [Google Scholar]
- 94.Howard GJ, Schlezinger JJ, Hahn ME, Webster TF. 2010. Generalized concentration addition predicts joint effects of aryl hydrocarbon receptor agonists with partial agonists and competitive antagonists. Environ Health Perspect 118(5):666–672, PMID: 20435555, 10.1289/ehp.0901312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Howard GJ, Webster TF. 2009. Generalized concentration addition: a method for examining mixtures containing partial agonists. J Theor Biol 259(3):469–477, PMID: 19345693, 10.1016/j.jtbi.2009.03.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Vieira VM, Fabian MP, Webster TF, Levy JI, Korrick SA. 2017. Spatial variability in ADHD-related behaviors among children born to mothers residing near the new Bedford Harbor Superfund Site. Am J Epidemiol 185(10):924–932, PMID: 28444119, 10.1093/aje/kww208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Gallagher LG, Webster TF, Aschengrau A. 2017. Exploring associations between prenatal solvent exposures and teenage drug and alcohol use: a retrospective cohort study. Environ Health 16(1):26, PMID: 28283038, 10.1186/s12940-017-0232-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Shankar P, Geier MC, Truong L, McClure RS, Pande P, Waters KM, et al. 2019. Coupling genome-wide transcriptomics and developmental toxicity profiles in zebrafish to characterize polycyclic aromatic hydrocarbon (PAH) hazard. Int J Mol Sci 20(10):2570, PMID: 31130617, 10.3390/ijms20102570. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.O’Connell SG, Kincl LD, Anderson KA. 2014. Silicone wristbands as personal passive samplers. Environ Sci Technol 48(6):3327–3335, PMID: 24548134, 10.1021/es405022f. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Forsberg ND, Stone D, Harding A, Harper B, Harris S, Matzke MM, et al. 2012. Effect of Native American fish smoking methods on dietary exposure to polycyclic aromatic hydrocarbons and possible risks to human health. J Agric Food Chem 60(27):6899–6906, PMID: 22690788, 10.1021/jf300978m. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Hummel JM, Madeen EP, Siddens LK, Uesugi SL, McQuistan T, Anderson KA, et al. 2018. Pharmacokinetics of [(14)C]-benzo[a]pyrene (BaP) in humans: impact of co-administration of smoked salmon and BaP dietary restriction. Food Chem Toxicol 115:136–147, PMID: 29518434, 10.1016/j.fct.2018.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Madeen E, Corley RA, Crowell S, Turteltaub K, Ognibene T, Malfatti M, et al. 2015. Human in vivo pharmacokinetics of [(14)C]dibenzo[def,p]chrysene by accelerator mass spectrometry following oral microdosing. Chem Res Toxicol 28(1):126–134, PMID: 25418912, 10.1021/tx5003996. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Rohlman D, Donatuto J, Heidt M, Barton M, Campbell L, Anderson KA, et al. 2019. A case study describing a community-engaged approach for evaluating polycyclic aromatic hydrocarbon exposure in a Native American community. Int J Environ Res Public Health 16(3):327, PMID: 30682857, 10.3390/ijerph16030327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Traudt EM, Ranville JF, Meyer JS. 2017. Effect of age on acute toxicity of cadmium, copper, nickel, and zinc in individual-metal exposures to Daphnia magna neonates. Environ Toxicol Chem 36(1):113–119, PMID: 27225713, 10.1002/etc.3507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Traudt EM, Ranville JF, Smith SA, Meyer JS. 2016. A test of the additivity of acute toxicity of binary-metal mixtures of ni with Cd, Cu, and Zn to Daphnia magna, using the inflection point of the concentration–response curves. Environ Toxicol Chem 35(7):1843–1851, PMID: 26681657, 10.1002/etc.3342. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Camargo K, Vogelbein MA, Horney JA, Dellapenna TM, Knap AH, Sericano JL, et al. 2022. Biosensor applications in contaminated estuaries: implications for disaster research response. Environ Res 204(pt A):111893, PMID: 34419473, 10.1016/j.envres.2021.111893. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Camargo KM, Foster M, Buckingham B, McDonald TJ, Chiu WA. 2021. Characterizing baseline legacy chemical contamination in urban estuaries for disaster-research through systematic evidence mapping: a case study. Chemosphere 281:130925, PMID: 34289609, 10.1016/j.chemosphere.2021.130925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Casillas GA, Johnson NM, Chiu WA, Ramirez J, McDonald TJ, Horney JA. 2021. Polycyclic aromatic hydrocarbons in Houston parks after Hurricane Harvey. Environ Justice 14(4):277–287, PMID: 34484557, 10.1089/env.2020.0073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.Chen Z, Jang S, Kaihatu JM, Zhou Y-H, Wright FA, Chiu WA, et al. 2021. Potential human health hazard of post-Hurricane Harvey sediments in Galveston Bay and Houston ship channel: a case study of using in vitro bioactivity data to inform risk management decisions. Int J Environ Res Public Health 18(24):13378, PMID: 34948986, 10.3390/ijerph182413378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Valdiviezo A, Luo YS, Chen Z, Chiu WA, Rusyn I. 2021. Quantitative in vitro-to-in vivo extrapolation for mixtures: a case study of superfund priority list pesticides. Toxicol Sci 183(1):60–69, PMID: 34142158, 10.1093/toxsci/kfab076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111.Mutlu E, Cristy T, Stiffler B, Waidyanatha S, Chartier R, Jetter J, et al. 2023. Do storage conditions affect collected cookstove emission samples? Implications for field studies. Anal Lett 56(12):1911–1931, PMID: 37200484, 10.1080/00032719.2022.2150772. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 112.NTP (National Toxicology Program). 2024. NTP Review of Wood Smoke. https://ntp.niehs.nih.gov/whatwestudy/assessments/cancer/ongoing/woodsmoke [accessed 23 April 2024].
- 113.Rager JE, Clark J, Eaves LA, Avula V, Niehoff NM, Kim YH, et al. 2021. Mixtures modeling identifies chemical inducers versus repressors of toxicity associated with wildfire smoke. Sci Total Environ 775:145759, PMID: 33611182, 10.1016/j.scitotenv.2021.145759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Mercado-Feliciano M, Cora MC, Witt KL, Granville CA, Hejtmancik MR, Fomby L, et al. 2012. An ethanolic extract of black cohosh causes hematological changes but not estrogenic effects in female rodents. Toxicol Appl Pharmacol 263(2):138–147, PMID: 22687605, 10.1016/j.taap.2012.05.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.Smith-Roe SL, Swartz CD, Shepard KG, Bryce SM, Dertinger SD, Waidyanatha S, et al. 2018. Black cohosh extracts and powders induce micronuclei, a biomarker of genetic damage, in human cells. Environ Mol Mutagen 59(5):416–426, PMID: 29668046, 10.1002/em.22182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 116.Cora MC, Gwinn W, Wilson R, King D, Waidyanatha S, Kissling GE, et al. 2017. A black cohosh extract causes hematologic and biochemical changes consistent with a functional cobalamin deficiency in female B6C3F1/N mice. Toxicol Pathol 45(5):614–623, PMID: 28618975, 10.1177/0192623317714343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 117.Dunnick JK, Kissling G, Gerken DK, Vallant MA, Nyska A. 2007. Cardiotoxicity of Ma Huang/caffeine or ephedrine/caffeine in a rodent model system. Toxicol Pathol 35(5):657–664, PMID: 17676524, 10.1080/01926230701459978. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 118.Rider CV, Nyska A, Cora MC, Kissling GE, Smith C, Travlos GS, et al. 2014. Toxicity and carcinogenicity studies of Ginkgo biloba extract in rat and mouse: liver, thyroid, and nose are targets. Toxicol Pathol 42(5):830–843, PMID: 23960164, 10.1177/0192623313501235. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 119.Shipkowski KA, Betz JM, Birnbaum LS, Bucher JR, Coates PM, Hopp DC, et al. 2018. Naturally complex: perspectives and challenges associated with botanical dietary supplement safety assessment. Food Chem Toxicol 118:963–971, PMID: 29626579, 10.1016/j.fct.2018.04.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 120.Waidyanatha S, Ryan K, Roe AL, Jia W, Paine MF, Ferguson S, et al. 2018. Follow that botanical: challenges and recommendations for assessing absorption, distribution, metabolism and excretion of botanical dietary supplements. Food Chem Toxicol 121:194–202, PMID: 30170118, 10.1016/j.fct.2018.08.062. [DOI] [PubMed] [Google Scholar]
- 121.Roberts GK, Gardner D, Foster PM, Howard PC, Lui E, Walker L, et al. 2019. Finding the bad actor: challenges in identifying toxic constituents in botanical dietary supplements. Food Chem Toxicol 124:431–438, PMID: 30582954, 10.1016/j.fct.2018.12.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 122.Rowan-Carroll A, Reardon A, Leingartner K, Gagné R, Williams A, Meier MJ, et al. 2021. High-throughput transcriptomic analysis of human primary hepatocyte spheroids exposed to per- and polyfluoroalkyl substances as a platform for relative potency characterization. Toxicol Sci 181(2):199–214, PMID: 33772556, 10.1093/toxsci/kfab039. [DOI] [PubMed] [Google Scholar]
- 123.Smith-Roe SL, Swartz CD, Rashid A, Christy NC, Sly JE, Chang X, et al. 2023. Evaluation of the herbicide glyphosate, (aminomethyl)phosphonic acid, and glyphosate-based formulations for genotoxic activity using in vitro assays. Environ Mol Mutagen 64(4):202–233, PMID: 36880770, 10.1002/em.22534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 124.Taylor KW, Baird DD, Herring AH, Engel LS, Nichols HB, Sandler DP, et al. 2017. Associations among personal care product use patterns and exogenous hormone use in the NIEHS sister study. J Expo Sci Environ Epidemiol 27(5):458–464, PMID: 28120835, 10.1038/jes.2016.82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 125.Taylor KW, Troester MA, Herring AH, Engel LS, Nichols HB, Sandler DP, et al. 2018. Associations between personal care product use patterns and breast cancer risk among white and black women in the Sister Study. Environ Health Perspect 126(2):027011, PMID: 29467107, 10.1289/EHP1480. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 126.Chang C-J, O’Brien KM, Keil AP, Gaston SA, Jackson CL, Sandler DP, et al. 2022. Use of straighteners and other hair products and incident uterine cancer. J Natl Cancer Inst 114(12):1636–1645, PMID: 36245087, 10.1093/jnci/djac165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 127.White AJ, Gregoire AM, Taylor KW, Eberle C, Gaston S, O’Brien KM, et al. 2021. Adolescent use of hair dyes, straighteners and perms in relation to breast cancer risk. Int J Cancer 148(9):2255–2263, PMID: 33252833, 10.1002/ijc.33413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 128.Taylor KW, Howdeshell KL, Bommarito PA, Sibrizzi CA, Blain RB, Magnuson K, et al. 2023. Systematic evidence mapping informs a class-based approach to assessing personal care products and pubertal timing. Environ Int 181:108307, PMID: 37948866, 10.1016/j.envint.2023.108307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 129.Rice GE, Teuschler LK, Bull RJ, Simmons JE, Feder PI. 2009. Evaluating the similarity of complex drinking-water disinfection by-product mixtures: overview of the issues. J Toxicol Environ Health A 72(7):429–436, PMID: 19267305, 10.1080/15287390802608890. [DOI] [PubMed] [Google Scholar]
- 130.Marshall S, Gennings C, Teuschler LK, Stork LG, Tornero-Velez R, Crofton KM, et al. 2013. An empirical approach to sufficient similarity: combining exposure data and mixtures toxicology data. Risk Anal 33(9):1582–1595, PMID: 23398277, 10.1111/risa.12015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 131.Grimm FA, Iwata Y, Sirenko O, Chappell GA, Wright FA, Reif DM, et al. 2016. A chemical-biological similarity-based grouping of complex substances as a prototype approach for evaluating chemical alternatives. Green Chem 18(16):4407–4419, PMID: 28035192, 10.1039/c6gc01147k. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 132.House JS, Grimm FA, Klaren WD, Dalzell A, Kuchi S, Zhang S-D, et al. 2021. Grouping of UVCB substances with new approach methodologies (NAMs) data. ALTEX 38(1):123–137, PMID: 33086383, 10.14573/altex.2006262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 133.US EPA. 2022. Polychlorinated Biphenyls (PCBs). https://cfpub.epa.gov/ncea/iris_drafts/recordisplay.cfm?deid=354040 [accessed 23 April 2024].
- 134.Goodson WH, Lowe L, Carpenter DO, Gilbertson M, Manaf Ali A, Lopez de Cerain Salsamendi A, et al. 2015. Assessing the carcinogenic potential of low-dose exposures to chemical mixtures in the environment: the challenge ahead. Carcinogenesis 36(suppl 1):S254–S296, PMID: 26106142, 10.1093/carcin/bgv039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 135.Goodson WH, Lowe L, Gilbertson M, Carpenter DO. 2020. Testing the low dose mixtures hypothesis from the Halifax project. Rev Environ Health 35(4):333–357, PMID: 32833669, 10.1515/reveh-2020-0033. [DOI] [PubMed] [Google Scholar]
- 136.Conley JM, Lambright CS, Evans N, Cardon M, Medlock-Kakaley E, Wilson VS, et al. 2021. A mixture of 15 phthalates and pesticides below individual chemical no observed adverse effect levels (NOAELs) produces reproductive tract malformations in the male rat. Environ Int 156:106615, PMID: 34000504, 10.1016/j.envint.2021.106615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 137.Lichtenstein D, Luckert C, Alarcan J, de Sousa G, Gioutlakis M, Katsanou ES, et al. 2020. An adverse outcome pathway-based approach to assess steatotic mixture effects of hepatotoxic pesticides in vitro. Food Chem Toxicol 139:111283, PMID: 32201337, 10.1016/j.fct.2020.111283. [DOI] [PubMed] [Google Scholar]
- 138.Przybyla J, McClure PR, Zaccaria KJ, Pohl HR. 2021. Chemical interactions and mixtures in public health risk assessment: an analysis of ATSDR’s interaction profile database. Regul Toxicol Pharmacol 125:104981, PMID: 34186140, 10.1016/j.yrtph.2021.104981. [DOI] [PubMed] [Google Scholar]
- 139.Shapiro AJ, Antoni S, Guyton KZ, Lunn RM, Loomis D, Rusyn I, et al. 2018. Software tools to facilitate systematic review used for cancer hazard identification. Environ Health Perspect 126(10):104501, PMID: 30392397, 10.1289/EHP4224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 140.Yang J, Caren Han S, Poon J. 2022. A survey on extraction of causal relations from natural language text. Knowl Inf Syst 64(5):1161–1186, 10.1007/s10115-022-01665-w. [DOI] [Google Scholar]
- 141.NIH (National Institutes of Health). 2020. NOT-OD-21-013: Final NIH Policy for Data Management and Sharing. https://grants.nih.gov/grants/guide/notice-files/NOT-OD-21-013.html [accessed 19 July 2023].
- 142.Watson H, Gallifant J, Lai Y, Radunsky AP, Villanueva C, Martinez N, et al. 2023. Delivering on NIH data sharing requirements: avoiding open data in appearance only. BMJ Health Care Inform 30(1):100771, PMID: 37344002, 10.1136/bmjhci-2023-100771. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 143.Heacock ML, Amolegbe SM, Skalla LA, Trottier BA, Carlin DJ, Henry HF, et al. 2020. Sharing SRP data to reduce environmentally associated disease and promote transdisciplinary research. Rev Environ Health 35(2):111–122, PMID: 32126018, 10.1515/reveh-2019-0089. [DOI] [PubMed] [Google Scholar]
- 144.Behl M, Ryan K, Hsieh J-H, Parham F, Shapiro AJ, Collins BJ, et al. 2019. Screening for developmental neurotoxicity at the national toxicology program: the future is here. Toxicol Sci 167(1):6–14, PMID: 30496580, 10.1093/toxsci/kfy278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 145.CLARITY-BPA Research Program. 2021. Consortium Linking Academic and Regulatory Insights on Bisphenol A Toxicity (CLARITY-BPA): A Compendium of Published Findings: Research Report 18. Bethesda, MD: NIH. [Google Scholar]
- 146.Escher BI, Aït-Aïssa S, Behnisch PA, Brack W, Brion F, Brouwer A, et al. 2018. Effect-based trigger values for in vitro and in vivo bioassays performed on surface water extracts supporting the environmental quality standards (EQS) of the European water framework directive. Sci Total Environ 628–629:748–765, PMID: 29454215, 10.1016/j.scitotenv.2018.01.340. [DOI] [PubMed] [Google Scholar]
- 147.Backhaus T. 2023. The mixture assessment or allocation factor: conceptual background, estimation algorithms and a case study example. Environ Sci Eur 35(1):55, 10.1186/s12302-023-00757-w. [DOI] [Google Scholar]
- 148.Wilkinson MD, Dumontier M, Aalbersberg IJJ, Appleton G, Axton M, Baak A, et al. 2016. The FAIR guiding principles for scientific data management and stewardship. Sci Data 3:160018, PMID: 26978244, 10.1038/sdata.2016.18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 149.Gibson EA, Goldsmith J, Kioumourtzoglou MA. 2019. Complex mixtures, complex analyses: an emphasis on interpretable results. Curr Environ Health Rep 6(2):53–61, PMID: 31069725, 10.1007/s40572-019-00229-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 150.Schmidt CW. 2020. Into the black box: what can machine learning offer environmental health research? Environ Health Perspect 128(2):22001, PMID: 32101024, 10.1289/EHP5878. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 151.Roell K, Koval LE, Boyles R, Patlewicz G, Ring C, Rider CV, et al. 2022. Development of the InTelligence and Machine LEarning (TAME) toolkit for introductory data science, chemical-biological analyses, predictive modeling, and database mining for environmental health research. Front Toxicol 4:893924, PMID: 35812168, 10.3389/ftox.2022.893924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 152.Pageau LM, Ng TJ, Ling J, Given BA, Robbins LB, Deka P, et al. 2023. Associations between hair cortisol and blood pressure: a systematic review and meta-analysis. J Hypertens 41(6):875–887, PMID: 37016924, 10.1097/HJH.0000000000003412. [DOI] [PubMed] [Google Scholar]
- 153.Eccles KM, Karmaus AL, Kleinstreuer NC, Parham F, Rider CV, Wambaugh JF, et al. 2023. A geospatial modeling approach to quantifying the risk of exposure to environmental chemical mixtures via a common molecular target. Sci Total Environ 855:158905, PMID: 36152849, 10.1016/j.scitotenv.2022.158905. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 154.Bessonneau V, Pawliszyn J, Rappaport SM. 2017. The saliva exposome for monitoring of individuals’ health trajectories. Environ Health Perspect 125(7):077014, PMID: 28743678, 10.1289/EHP1011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 155.Rappaport SM, Smith MT. 2010. Epidemiology. Environment and disease risks. Science 330(6003):460–461, PMID: 20966241, 10.1126/science.1192603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 156.Smith MT, de la Rosa R, Daniels SI. 2015. Using exposomics to assess cumulative risks and promote health. Environ Mol Mutagen 56(9):715–723, PMID: 26475350, 10.1002/em.21985. [DOI] [PMC free article] [PubMed] [Google Scholar]


