Skip to main content
Toxics logoLink to Toxics
. 2022 Aug 1;10(8):441. doi: 10.3390/toxics10080441

A Population-Based Human In Vitro Approach to Quantify Inter-Individual Variability in Responses to Chemical Mixtures

Lucie C Ford 1,2, Suji Jang 1,2, Zunwei Chen 1,2, Yi-Hui Zhou 3,4, Paul J Gallins 4, Fred A Wright 3,4, Weihsueh A Chiu 1,2, Ivan Rusyn 1,2,*
Editor: Martí Nadal
PMCID: PMC9413237  PMID: 36006120

Abstract

Human cell-based population-wide in vitro models have been proposed as a strategy to derive chemical-specific estimates of inter-individual variability; however, the utility of this approach has not yet been tested for cumulative exposures in mixtures. This study aimed to test defined mixtures and their individual components and determine whether adverse effects of the mixtures were likely to be more variable in a population than those of the individual chemicals. The in vitro model comprised 146 human lymphoblastoid cell lines from four diverse subpopulations of European and African descent. Cells were exposed, in concentration–response, to 42 chemicals from diverse classes of environmental pollutants; in addition, eight defined mixtures were prepared from these chemicals using several exposure- or hazard-based scenarios. Points of departure for cytotoxicity were derived using Bayesian concentration–response modeling and population variability was quantified in the form of a toxicodynamic variability factor (TDVF). We found that 28 chemicals and all mixtures exhibited concentration–response cytotoxicity, enabling calculation of the TDVF. The median TDVF across test substances, for both individual chemicals or defined mixtures, ranged from a default assumption (101/2) of toxicodynamic variability in human population to >10. The data also provide a proof of principle for single-variant genome-wide association mapping for toxicity of the chemicals and mixtures, although replication would be necessary due to statistical power limitations with the current sample size. This study demonstrates the feasibility of using a set of human lymphoblastoid cell lines as an in vitro model to quantify the extent of inter-individual variability in hazardous properties of both individual chemicals and mixtures. The data show that population variability of the mixtures is unlikely to exceed that of the most variable component, and that similarity in genome-wide associations among components may be used to accrue additional evidence for grouping of constituents in a mixture for cumulative assessments.

Keywords: population-wide, inter-individual variability, toxicodynamics, chemical mixtures, defined mixtures, human health risk assessment, uncertainty factors, genome-wide association study

1. Introduction

Humans are exposed to a wide variety of chemicals from both dietary and non-dietary sources; therefore, developing approaches for the risk assessment of combined exposures to multiple agents is the pressing challenge in regulatory science [1]. Evaluation of mixtures and complex substances, which are the primary types of combined exposures, is hindered by the challenges of determining their chemical composition [2,3]. Mixtures are categorized into intentional and unintentional types. The former are mixtures with largely known chemical constituents (e.g., paint, food additives, pesticide formulations), while the latter include discharge, coincidental, and environmental mixtures [4]. Discharge mixtures are defined as substances released from a single installation during production, transportation, or waste disposal processes. Coincidental mixtures are those that originate from multiple sources, thus further increasing their complexity. Environmental mixtures are defined as a combination of chemical constituents from multiple sources that occur in various exposure settings (e.g., air pollution) [3].

Due to the chemical complexity of mixtures, there are no harmonized methodologies for their risk assessment; recent efforts by a number of regulatory agencies worldwide aim to devise a standardized approach [3,5,6,7]. Two methods are commonly used for assessing mixtures, the whole mixture and component-based approaches. The whole mixture approach is challenging as it assumes invariable composition of a substance which is not a realistic scenario [8,9,10]; it also requires testing of the whole substance which presents unique analytical challenges if the components are not water soluble [11]. The component-based approach uses exposure and toxicity data from either individual chemicals or groups of chemicals (i.e., component assessment groups) to conduct the assessment. This approach is predicated on the availability of information on the “marker” chemical constituent(s) in a mixture, which is both an analytical (i.e., availability of standards and instrumentation to quantify constituents) and practical (i.e., temporal changes and batch-to-batch variability in composition) challenge [7]. Solutions to address these challenges have been proposed in the areas of both analytical chemistry and in vitro toxicology, still, their implementation has yet to be widely adopted [12].

One of the particularly challenging components of the risk characterization step in assessments of both individual chemicals and mixtures is the estimation of the extent of population variability in toxicity [13]. Considerations of intra-species variability are typically addressed through the use of a default assumption in calculations of the margin of exposure [14]. As an alternative to using the defaults [15], a number of experimental approaches have been recently proposed to derive chemical-specific estimates of human variability [16]; however, few studies have applied these novel experimental models to mixtures. Due to the need to test either numerous components of a mixture or many “whole” mixtures, in vitro approaches using human cells would be most sensible in terms of necessary throughput. Still, only limited options exist for such studies, human lymphoblastoid cell lines [17] and induced pluripotent stem cells (iPSC) [18]. Large sets of chemicals have been tested in lymphoblasts and iPSC-derived cardiomyocytes, thus providing experimental data for chemical-specific assessments [19,20,21]. The examples for mixtures are fewer, with one study evaluating human population variability in toxicity of whole mixtures of pesticides using lymphoblast cells [22].

Opportunities exist to apply population-based human in vitro models, such as lymphoblasts, to whole- and component-based mixtures assessments by testing the validity of dose and variability assumptions using defined (i.e., with known components) mixtures. The aim of this study was to test defined mixtures and their individual components and determine whether adverse effects of the mixtures were likely to be more variable in a population than those of the individual chemicals. Therefore, we hypothesized that a population of lymphoblasts can be used to screen both individual chemicals and defined mixtures to determine the extent of variability of cytotoxic effects across individuals. A panel of 146 lymphoblastoid cell lines from four subpopulations were used to screen 42 individual chemicals and eight defined mixtures in concentration–response. Cytotoxicity was evaluated as the endpoint of interest, from which the points of departure were derived to quantify chemical- and mixture-specific estimates of variability, and to identify potential molecular drivers of variability.

2. Experimental Section

2.1. Chemicals and Biologicals

RPMI 1640 maintenance media (Cat#11875119) and penicillin-streptomycin (Cat#10378016) were obtained from LifeTechnologies (Grand Island, NY, USA). Premium grade Fetal Bovine Serum (FBS) was obtained from VWR (Cat#97068-085, Radnor, PA, USA). Tissue-culture treated T75 cell culture flasks were obtained from Fisher Scientific (Cat#156499, Waltham, MA, USA). Tissue-culture treated 384-well black/clear bottom plates were obtained from Corning (Cat#3764, Kennebunk, ME, USA) and Greiner Bio-One (Cat#781091, Kremsmünster, Austria). Tissue culture grade dimethyl sulfoxide (DMSO, CAS#67-68-5, Cat#sc-358801) was obtained from Santa Cruz Biotechnology (Dallas, TX, USA). Trypan Blue 0.4% solution was obtained from MilliporeSigma (Cat#T8154-100 ML, Burlington, MA, USA). The CellTiter-Glo assay kit was obtained from Promega (Madison, WI, USA). Tetra-octyl ammonium bromide (TAB, CAS#14866-33-2, Cat# D2438) was obtained from SigmaAldrich (St. Louis, MO, USA). Test chemicals (n = 42, Table S1) were from various sources as indicated therein.

2.2. Cell Lines

A set of immortalized lymphoblast cell lines was from the Coriell Institute (Camden, NJ, USA; n = 146, Table S2). The cells are human B-lymphocytes that were originally collected by the 1000 Genomes Project [23]. The cell lines used herein were from four human subpopulations that represent geographical diversity in their ancestral origins and were also tested in previous studies of environmental mixtures [22]. The populations included were Utah residents with European ancestry (CEU), Tuscans in Italy (TSI), British from England and Scotland (GBR), and Yoruban from Ibadan, Nigeria (YRI). The lymphoblast cell lines were selected to have equal male to female representation.

2.3. Cell Culture

For technical reasons, the cell lines were divided into seven testing batches, with equal representation from each subpopulation and sex in each batch. The cells were cultured in T75 flasks at 37 °C with 5% CO2 in RPMI 1640 media supplemented with 15% FBS and 1% penicillin-streptomycin. Media was changed every other day. Cell count and viability were assessed during media changes using the Cellometer™ Auto T4 Plus (Nexelom Bioscience, Lawrence, MA, USA). The cells were expanded up to a minimum concentration of 106 cells/mL and viability of ≥85% prior to plating and chemical exposure. Before transfer to 384-well plates for chemical treatments, the cells were centrifuged and re-suspended in the fresh media. Cell density and viability were evaluated and the cells were plated into tissue culture-treated 384-well black/clear bottom plates at a density of 5000 cells/well in 12.5 μL of media. To evaluate experimental reproducibility, each cell line was seeded in three identical 384-well plates and each chemical and mixture were tested on each plate (see Figure S1 for the plate design). After chemical addition, the cells were incubated for 24 h at 37 °C with 5% CO2.

2.4. Chemicals and Mixtures

The individual chemicals for testing were selected as previously detailed [24] based on the following criteria: (i) chemicals listed on the Agency for Toxic Substances and Disease Registry priority list; (ii) chemicals frequently detected at the U.S. National Priority list sites (also known as Superfund sites); (iii) representation of various chemical classes [pesticides (n = 20), high production volume chemicals (HPV) (n = 8), heavy metals (n = 7), polycyclic aromatic hydrocarbons (PAHs) (n = 5), and phthalates (n = 2)]; (iv) established human “safe exposure” levels; (v) reverse toxicokinetic and exposure data available on U.S. Environmental Protection Agency (U.S. EPA) dashboard; and (vi) available data from other in vitro studies through ToxCast™/Tox21. Each chemical was first dissolved in 100% DMSO at 20 mM, then, five 10× serial dilutions were prepared with 100% DMSO. Then, each sample was further diluted 100-fold in corresponding cell culture media to yield 2× working solutions in 1% DMSO. Finally, 12.5 μL of 2× solution with chemical/mixture was added to each well with cells using the automated liquid handler in the FLIPR tetra (Molecular Devices, San Jose, CA, USA) for the final concentrations of 100, 10, 1, 0.1, or 0.01 μM, and 0.5% DMSO in each well. The concentration of DMSO in assay wells at 0.5% (v/v) was consistent with previous reports and by itself had no effect on lymphoblast viability [25].

The mixtures were assembled based on various assumptions to model environmental scenarios as previously detailed [26]. In summary, each chemical was present in every mixture in amounts based on the following assumptions: (i) points of departure (POD) from in vivo studies in experimental animals used for determining regulatory oral non-cancer reference doses (RfD); (ii) the RfD derived from the experimental animal data and converted to oral equivalent dose in humans [27]; (iii) human exposure estimates from ExpoCast [28]; and (iv) in vitro toxicity data (active concentration 50%, AC50) from ToxCast/Tox21 [29]. In each assumption, we created two mixtures to represent the median (termed “low”) or upper 95th percentile (termed “high”) to account for the human toxicokinetic variability. The concentration of each chemical in the eight tested mixtures is provided in Table S3. The chemicals were first dissolved in 100% cell culture-grade DMSO at a concentration of 20 mM each and then aliquoted at different proportions to create stocks for each mixture. All mixtures were then tested using five 10× serial dilutions to generate concentration–response data. For testing, stocks were further diluted 200× with cell culture media as detailed above for the chemicals.

2.5. Cell Viability Screening

After the 24 h incubation with the individual chemicals or mixtures, intracellular ATP concentration was measured as a marker for cell viability. Microplates were equilibrated at room temperature for 30 min and the CellTiter-Glo reagent (25 μL) was added in equal volumes to each well. The plates were first mixed for two minutes on a plate shaker to induce cell lysis and then incubated at room temperature for 10 min in the dark. The luminescence signal was read using a FLIPR Tetra and Screenworks 4.0 (Molecular Devices).

2.6. Assessment of Experimental Reproducibility

Experimental reproducibility was evaluated both within and among plates. Within each plate, two chemicals were tested as intra-plate replicates: 2,4,5-trichlorophenol and mercuric chloride. First, raw luminescence counts in each experimental well were normalized to the average of the wells containing vehicle (0.5% DMSO). Then, normalized values at each tested concentration were used to assess Pearson correlation coefficient and associated p-values were calculated for both chemicals (Table S4). Inter-plate reproducibility was evaluated using data from each cell line that were screened on three individual plates. Normalized values for each well from two out of three plates (randomly selected) were used to calculate Pearson correlation coefficient and the corresponding p-values (Table S5). Both tests were performed for each cell line.

2.7. Derivation of Chemical and Mixture-Specific Concentration–Response Profiles

After normalization and quality control (coefficient of variability <20% for vehicle-treated wells and 100% cytotoxicity in wells exposed to 100 μM tetra-octyl ammonium bromide), a concentration–response model was fit for each chemical and mixture using hierarchical Bayesian random effects Hill models as described in [30]. For each chemical or mixture and individual cell line, it was assumed that the concentration–response data follow a “downward” Hill model [30,31] where response y as a function of concentration x follows the equation:

y=y01xx0n1+xx0n+ϵ

The variable y0 is the baseline value, x0 is the concentration at a 50% decrease from the baseline response (EC50), n is the Hill coefficient, and ϵ is the residual error. Fitting of y0 was needed to address “drifting” baseline values even after normalization via negative controls. To prevent anomalous fits with very shallow concentration–response curves, the Hill coefficient was restricted to be 1, as noted previously [26]. All parameters, after natural log-transformation, were assumed to have normal random effects so that individuals in the population were distributed normally given population mean and standard deviation hyperparameters. Prior distributions for hyperparameters were normal for population means and half-normal for population standard deviations. The error ϵ between estimated and actual values was assumed to follow a scaled Student’s t distribution with scale parameter σ where ϵ/σ has a standard Student’s t distribution, with ν=5 degrees of freedom, to be robust for outliers [30].

We used the Markov chain Monte Carlo (MCMC) algorithm to sample the posterior distribution using the R Stan package [32]. Four chains were set for each chemical or mixture and each chain initially contained 4000 iterations. The first half iterations for each chain were used as warm-up data and discarded, with the rest used for inference. In order to assess convergence indicating the adequacy of sampling, the potential scale reduction factor R^ was used to compare between- and within-chain variability, with values of R^ ≤ 1.2 considered adequately converged [33]. Chain length was doubled until convergence, with no dataset requiring more than 16,000 iterations.

2.8. Derivation of Chemical and Mixture-Specific Point of Departure (POD) and Toxicodynamic Variability Factor (TDVF05)

For the point of departure (POD), the effective concentration at which a 10% change in cytotoxicity in comparison to vehicle (EC10) was selected as the benchmark response based on the US EPA guidance for dose–response modeling and determination of the point-of-departure values [34], and consistent with previously published work using in vitro model and cytotoxicity endpoints [19,30,31]. The EC10 was calculated for each individual i using the equation EC10,i=x0,i0.1/0.91/ni,, where x0,i and ni are the individual-specific values (MCMC samples) for the EC50 and the Hill parameter, respectively. A chemical or mixture was considered “inactive” if the population median EC10 > 3× the maximum tested concentration (100 μM for individual chemicals, see Table S3 for mixtures), and further corroborated by visual inspection of the concentration–response data.

For the analysis of inter-individual variability in toxicodynamic response, the toxicodynamic variability factor at 5% (TDVF05) is defined as the ratio of the POD for the median individual to the POD for the most sensitive 5th percentile individual: TDVF05 = EC10,median/EC10,5th percentile. Given the EC10 values for all individuals in the population, the median and 5th percentile quantiles across individuals were calculated, with their ratio set equal to the TDVF05. This procedure was repeated for each MCMC sample, so that the result is a distribution representing the uncertainty in the TDVF05 for each chemical or mixture. The default uncertainty factor for toxicodynamic variability is generally considered to be 101/2, TDVF = 3.16 [35], which was used as a comparison benchmark.

2.9. Genome-Wide Association Mapping

Genome-wide association mapping of the EC10 values could be performed because genotypes for these cell lines are available from the 1000 Genomes resource (www.internationalgenome.org/data/ (accessed on 1 June 2022)). While the statistical power for mapping of toxicity as a complex trait is low for the current dataset, we conducted this analysis as a proof of principle for exploration, and the results were recorded for replication or inclusion in future meta-analyses. Genotypes were recoded as the number of copies of the minor allele (0, 1, 2). Due to the limited sample size, ~1.3 million single nucleotide polymorphisms (SNPs) with minor allele frequency (MAF) ≥0.05 were used for the mapping analysis. A standard linear regression model for additive allele effects was employed, using sex and three genotype-based principal components as covariates. Batch effects were examined by genotype principal components, with no discernable effects (results not shown). SNP associations were evaluated using the t-statistic p-value for the SNP coefficient in the linear model. Quantile–quantile plots of association showed no evidence of significance inflation (Figure S2). Manhattan plots and regional visualizations were produced using the LocusZoom software (locuszoom.org) and by reference to the UCSC Genome Browser (https://genome.ucsc.edu/ (accessed on 1 June 2022)). We used p < 10−5 as indicative of suggestive significance, and p < 5 × 10−8 as genome-wide significant [36].

Although the use of genotype principal components as covariates in linear models is well established [37], for completeness we also used an alternate mixed-linear-model association (MLMA) method [38]. First, we estimated the genetic relatedness between pairs of individuals using the SNPs and generated a genetic relationship matrix. We analyzed the individuals from the populations of European descent (n = 106) and of African descent (n = 40) separately, adjusting for relatedness and including sex and principal components as covariates. Then we ran a meta-analysis by weighting z-scores according to the relative sample sizes from each ancestry group to generate final SNP p-values (Figure S3 and Table S6).

3. Results

3.1. Population Variability Screening of Chemicals and Mixtures in Human Lymphoblasts

This study tested inter-individual variability in the effects of 42 chemicals and eight defined mixtures using a population-based human in vitro model. We used cells from a total of 146 donors representing four subpopulations, three from European descent and one African descent, balanced for sex ratio. Figure 1 shows the overall study design and data analysis pipelines. Both chemicals and mixtures were tested in concentration–response from which EC10 values were derived as the PODs, these were used to calculate the TDVF05 and conduct genome-wide association analysis.

Figure 1.

Figure 1

Experimental design for population-based human in vitro toxicity assessments of environmental chemicals and mixtures. A sample of 146 human lymphoblast cell lines from four subpopulations with equal male to female representation were used in this study. All cell lines were exposed to 42 chemicals and eight environmental mixtures in concentration–response to derive points of departure (PODs) which were then used to calculate the TDVF05 and conduct GWAS analyses.

Compounds selected for this study spanned a number of chemical classes (e.g., pesticides, high production volume chemicals, heavy metals, polycyclic aromatic hydrocarbons, and phthalates) to be largely representative of the structural diversity of the chemicals with documented use and exposure potential across various US EPA chemical product categories [39]. Specifically, the principal components analysis plot (Figure 2A) shows that the chemicals tested herein are distributed across the compendium of chemicals selected by the Collaborative Estrogen Receptor Activity Prediction Project (n = 32,464 chemicals) [39]. Due to the difference in assumptions for defined mixture preparation (see Section 2. Experimental), concentrations of the individual chemicals in each mixture varied widely (Figure 2B). For example, the ToxCast database mixtures were most balanced in terms of relative composition, but exposure-based mixtures were dominated by the presence of zinc chloride. Overall, we aimed to represent very diverse mixture scenarios and the variability in composition was by design.

Figure 2.

Figure 2

Diversity in the chemical structure of selected chemicals and defined mixture composition. (A) Principal component analysis (PCA) plot demonstrating the structural diversity of the chemicals tested in this study as compared to the representative environmental compound set included in the Collaborative Estrogen Receptor Activity Prediction Project (CERAPP, n = 32,464) [39]. We used 48 chemical descriptors (after omitting NA or constant descriptors) calculated using the open-source Chemistry Development Kit (implemented in the R package rcdk) [40] to illustrate the spatial distribution of both datasets. Principal component analysis was conducted using prcomp from the R stats package, and visualization was conducted with the R plot3D package. The axes were truncated at the 95% confidence interval of each principal component. (B) Defined mixtures boxplots of the percent of total concentration for each individual chemical across eight defined mixtures. The boxplots are arranged by individual chemicals and chemical classes [orange = pesticides (n = 20), yellow = HPV (n = 8), green = heavy metals (n = 7), blue = PAHs (n = 5), purple = phthalates (n = 2)].

In order to ensure that this complex (in terms of the number of cell lines tested and variables interrogated) experiment was technically sound, we first evaluated intra- and inter-plate concordance (Figure 3). Experimental reproducibility was assessed by including chemicals that were screened as intra-plate replicates, as well as testing the chemicals and mixtures on a number of independent plates for each donor. Both chemicals that were screened as intra-plate replicates, mercuric chloride and 2,4,5-trichlorophenol were without effect across many donors; however, in the lines that had an effect, intra-plate replicates were significantly correlated (Figure 3A,C). The inter-plate reproducibility was even higher (Figure 3B,C). While correlations were greater in the individuals that were susceptible to the effects of tested compounds (e.g., GBR-HG00132) because of a wider spread of responses to individual treatments, even in resistant individuals (e.g., CEU-NA12249) the correlation coefficients were highly significant. Overall, experimental reproducibility was demonstrated by both the intra-plate replicates and the inter-plate replicates thus, increasing confidence in the follow-up analyses.

Figure 3.

Figure 3

Technical reproducibility of in vitro cell viability assays across all donors. (A) Intra-plate reproducibility correlation plots of the two intra-plate replicate substances: 2,4,5-trichlorophenol and mercuric chloride, correlations include the entire concentration–response profile for all cell lines tested. (B) Inter-plate reproducibility correlation plots. Of the three plate replicates available, two were randomly selected for correlation analysis. Representative plots are shown for the most susceptible cell line GBR-HG00132 (i.e., highest variability across all chemical-specific PODs, left) and the most resistant cell line CEU-NA12249 (i.e., lowest variability across all PODs, right). (C) Distribution of Pearson correlation coefficients and the corresponding p-values for intra- and inter-plate replicates across all cell lines.

3.2. Concentration–Response Analyses of the Effects of Chemicals and Mixtures

As indicated by the EC10 POD values (see Table S7 for raw data, Table S8 for EC10 values, and Figure S4 for the concentration–response curves), a wide range of susceptibility to the individual chemicals (28 out of 42 had cytotoxic effects in at least one cell line) was observed across tested cell lines (Figure 4A), consistent with our previous observations [19,25]. The median EC10 values across all cell lines ranged from 14.6 μM to 261 μM. The intra-cell variability was lower in cell lines that were more susceptible. With respect to the mixtures, we observed a similar phenomenon, with the median EC10 values across all cell lines ranging from 12.8 to 282 μM (Figure 4B). There were highly significant correlations in sensitivity of the cell lines to chemicals and mixtures (r2 = 0.73, p < 0.001). Interestingly, no subpopulation was more susceptible than the others to either individual chemicals (Figure 4C) or mixtures (Figure 4D).

Figure 4.

Figure 4

Cell-line specific distribution of chemical and mixture PODs. Distribution of the PODs (EC10 values) for all chemicals (A) and mixtures (B) arranged by each cell line’s median value. Colors represent the subpopulations (see inset). Each line is the inter-quartile range of the PODs, with the middle dot representing the median value. Overall distribution of median POD values for chemicals (C) and mixtures (D) across each subpopulation. Box-and-whisker plots show the interquartile range (boxes) and the 10th and 90th percentile (whiskers) of the distribution for each of the four subpopulations (colors are identical to those in panel (A)).

Figure 5A shows the inter-individual variability in response to each active chemical and mixture, using the median posterior POD estimate for each individual. Wide variability was observed in each case with the full range of PODs from about 10-fold (e.g., disulfoton) to as much as 1000-fold (e.g., dieldrin). Of the 28 chemicals that had cytotoxic effects, 17 of them were pesticides, whereas none of the PAHs exhibited activity in the lymphoblasts, indicating one potential limitation of this in vitro model (e.g., lacking metabolism to cytotoxic moieties). The two chemicals with the lowest EC10 were heavy metals, mercuric chloride (median EC10 of 12.9 μM) and potassium chromate (median EC10 of 4.21 μM). Among mixtures, the “AC50 high” was the most cytotoxic mixture, as expected because it contained chemical concentrations at the upper 95th percentile of AC50 values across ToxCast assays; it was also the mixture with the largest variability across all cells. Overall, the median and distribution of PODs for individual chemicals and environmental mixtures were similar (Figure 5B).

Figure 5.

Figure 5

Concentration–response analysis of the inter-individual variability in chemical and mixture effects across all lymphoblast cell lines. (A) Distribution of the PODs for individual chemical (white) and defined mixtures (grey) is shown as box (interquartile range)-and-whiskers (5th and 95th percentiles) plots. Asterisks (*) denote compounds that were technical on-plate replicates. (B) Overall distribution of PODs for chemicals and defined mixtures.

3.3. Analysis of the Inter-Individual Variability in Effects of Chemicals and Mixtures

It was previously shown that inter-individual variability is chemical-specific, both in human clinical studies [41] and in human in vitro models [19,21], often exceeding the default assumption of 10. Similar chemical-specific variability was observed in our study (Figure 5); therefore, we next quantified the range of the variability in the form of the toxicodynamic variability factor 5% (TDVF05) defined as the ratio of the POD (i.e., EC10 values) for the median individual to the POD for the most sensitive 5th percentile individual. Figure 6A shows the uncertainty distribution (based on posterior MCMC samples) of TDVF05 values for the active chemicals and all mixtures (see Table S9 for the median and range values). Most of the chemical and mixtures variability was within the default total inter-individual variability factor for toxicokinetics and toxicodynamics combined of 10, but all exceeded the default TDVF05 of 101/2. The median TDVF05 for both chemicals and mixtures were similar (Figure 6B). For both chemicals and mixtures, there was significant inverse Pearson correlation (−0.79 and −0.41, respectively) between EC10 and TDVF05.

Figure 6.

Figure 6

Distribution of TDVF05 for chemicals and mixtures across all cell lines. (A) Distribution of TDVF05 values for individual chemicals and mixtures is shown as box (interquartile range)-and-whiskers (5th and 95th percentiles) plots. Asterisks (*) denote compounds that were technical on-plate replicates. (B) Overall distribution of the TDVF05 for chemicals and mixtures. The vertical dashed line represents the default toxicodynamic variability factor of 101/2 and the vertical dotted line represents a default total variability factor of 10.

3.4. Genome-Wide Association Study (GWAS) Analyses

The design of the study and the use of these cell lines with available genotypes made it possible to conduct exploratory analysis of genome-wide associations between cytotoxicity (EC10 values) and polymorphisms. Linear regression GWAS analyses with correction for ancestry were performed for each chemical with effects and for mixtures, with no evidence of inflation of significance due to ancestry variations (Figures S2, S3 and S5). Multiple candidate genes with associations that were either suggestive (p < 10−5) or significant (p < 5 × 10−8) of an association relationship between polymorphic loci and susceptibility to cytotoxicity were identified. Figure 7A shows an example genome-wide plot for disulfoton. A large number of loci exceed the suggestive threshold and one region located on chromosome X reached the significant threshold (Table S10). Figure 7B shows a zoomed-in plot of the 0.25 Mb region where the most significant association was recorded, the locus encodes for the Family with Sequence Similarity 9 Member B (FAM9B) gene. The most significant polymorphism in this locus were in linkage disequilibrium with a number of other polymorphisms. Interestingly, the same region was identified with suggestive associations for a number of other chemicals and mixtures (Figure 7C), among those were other pesticides and exposure-based mixtures. Similarly, high concordance among chemicals that “hit” the same locus were observed for a number of other genomic regions (Table S10), two additional examples are shown for the Glutamate Ionotropic Receptor NMDA Type Subunit 3A (GRIN3A) on chromosome 9 (Figure 7D) and Contactin 5 (CNTN5) gene on chromosome 11 (Figure 7E). The SNPs, p-values, and regression coefficients (beta values), are provided in Tables S6 and S11, respectively.

Figure 7.

Figure 7

GWAS of population variability in cytotoxicity (covariate-corrected linear regression, see all raw data for each test chemical and mixture in Table S6). (A) A plot of the GWAS results for disulfoton (selected as a representative chemical) shows all analyzed SNPs arranged by their genomic position and corresponding -log10(p). Highlighted box (in red) demonstrates a locus that corresponds to the FAM9B gene. (B) A zoomed-in plot of the most significant region from A. (C) Plots of significance for SNPs in the 50kb region surrounding the FAM9B gene on chromosome X for chemicals and mixtures with overlapping GWAS results. (D,E) Plots similar to C for GRIN3A gene on chromosome 9 and CNTN5 gene on chromosome 11. Blue horizontal line at 10−5 indicates the significance threshold for suggestive association for the cytotoxicity phenotype and the red horizontal line at 5 × 10−8 represents the corrected genome-wide significance threshold for all SNPs and phenotypes.

Results from the alternate mixed model approach were similar to the linear regression analyses, with most analyses showing rank correlation >0.9 between the p-value of the two approaches Figures S3 and S5. However, the mixed model approach posed somewhat greater challenges in appropriate control of genomic significance inflation (genomic control lambda [42] outside the range 0.9–1.1), and so we consider these results to be used as auxiliary information.

4. Discussion

For most chemicals, both individually and as components in mixtures, there are little if any empirical data on the degree of human inter-individual variability or its genetic underpinnings [43]. Estimation of the degree of inter-individual variability in the population is a required step in assessment of human health hazards from chemicals [44], it is also desired in higher tier mixture assessments [45]. Options to fill data gaps in refining inter-individual variability estimates for specific substances, rather than relying on default assumptions, exist using either modeling or experimentation. The former is most developed for estimating toxicokinetic variability and is largely based on the knowledge of polymorphisms and associated functional heterogeneity of xenobiotic metabolism genes in the human population [46,47,48,49]. Whilst most toxicokinetic models are designed to evaluate single chemicals, the applications of these models to combined exposures and mixtures have also been demonstrated [50,51]. Population-based models to collect chemical-specific data through new experiments comprise both human and animal cell-based options, as well as genetically-diverse and -defined panels of rodents [16]. Studies in multi-strain panels of mice are time- and resource-consuming and are impractical as a tool for collecting experimental data on a large number of chemicals, or on whole mixtures. In vitro-based models are now widely used to provide both hazard and mode of action information [52,53,54,55]; still, few cell-based assays that are now routinely used in the large-scale toxicity screening programs are designed to address inter-individual variability [56]. Importantly, the availability of the genetically-diverse and -defined renewable sources of human cells, such as lymphoblasts from the HapMap [57] and 1000 Genomes [58] projects, enables in vitro toxicity testing at the population scale. Indeed, the feasibility of the in vitro population-based approach has been demonstrated for hundreds of chemicals [19,21,59] and several mixtures [22]. Therefore, we aimed to extend the use of novel human population-based in vitro models for characterization of inter-individual variability to understand differences between individual chemicals and mixtures.

Mixture assessments are far more complex than those for the individual chemicals; risk assessors are primarily concerned with characterization of the chemical composition of mixtures and data availability on their components of concern. Still, the inter-individual variability does factor into the outcome of these assessments at the risk characterization step where the margin of exposure or hazard index is typically derived based on the default assumptions [3,7,45]. A previous study with the in vitro model identical to that used herein showed that toxicodynamic variability could be experimentally-derived for two defined mixtures of pesticides [22]. These data were informative for comparing not only the potencies, but also the variability of two mixtures tested, thus providing useful data for risk characterization. However, the previous study was essentially a whole mixture investigation and was not suitable for a component-based assessment of the variability because it did not test the components of those mixtures. Indeed, experimental studies of chemical mixtures are few in spite of the agreement that cell-based testing may hold promise in reducing uncertainties in assessment of the health effects of mixtures [60]. The lack of such data is largely due to combinatorial complexity of creating defined mixtures for experimental testing; this formidable challenge has been addressed through studies of binary [61,62] to more multi-factorial [26,63] mixtures.

We reason that our study is a valuable case example for how a population-based human in vitro model could be applied in the assessment of mixtures. First, we show that for the diverse chemicals that were tested in lymphoblast cell lines, these cells, while limited in their metabolic capacity, had comparable ranges of cytotoxicity EC10 values to those in different human iPSC-based models (Figure S6). In the case of the defined mixtures, the cytotoxic range across the lymphoblast cell lines was more conservative in comparison to the other in vitro models; however, the overall range in cytotoxicity overlapped across various in vitro models (excluding iPSC-derived neurons and endothelial cells). These findings are important because lymphoblast cells are far easier to culture than iPSC-based models and they can be passaged (e.g., amplified), while the former are terminally differentiated cells. We suggest that large-scale initial screening studies can be done in lymphoblasts without sacrificing the sensitivity for establishing conservative hazard estimates, while also providing very useful information on the potential inter-individual variability. Population size for future screening studies that may not need to involve genetic mapping will be informative with samples sizes of as few as ~20 individuals; follow-up experiments, if needed to establish high confidence in chemical-specific variability estimates, may be performed using sample sizes of ~50–100 [30].

Second, we confirm previous observations [22] that the variability estimates from this in vitro model are close to default for most compounds tested, yet the high-variability chemicals and mixtures can be flagged. This finding is reassuring as it provides additional empirical evidence to human in vivo data from clinical and epidemiological studies [64], and data from population-based in vitro studies with human lymphoblasts [19], as well as other cell types such as fibroblasts [59] and iPSC-derived cardiomyocytes [31]. Furthermore, our finding that variability estimates for the mixtures were in range with those of the individual chemicals suggests that the variability may not be additive or multiplicative in the context of combined exposures. This finding needs to be verified with a formal analysis of variability reconstruction. Future work will focus on using the dose–response data from the mixtures to evaluate concentration addition and independent action assumptions and determine if dose reconstruction can be used to quantify the variability in addition to calculating the PODs for the mixtures. Further, the individual chemical data can potentially be used to reconstruct other mixtures as well as determine chemical-specific TDVF05 that can be used in other assessments.

Although lymphoblasts lack robust metabolic capacity, they are proliferative cells and can serve as a sensible in vitro model when considering effects of the chemicals that may cause adverse effects by disturbing key toxicity pathways such as cell cycle regulation, DNA repair, and membrane transport [17]. Indeed, the genome-wide association analyses identified a number of candidate susceptibility loci in these pathways. It is noteworthy that a large number of these loci were concordant across multiple chemicals and mixtures, this indicates potential similarity in downstream cell signaling pathways that may have been perturbed by the tested compounds.

On the one hand, the similarities in loci of susceptibility may be used as additional information for grouping chemicals for mixture “assessment groups” [7]. Specifically, the guidance on scientific criteria for grouping chemicals into assessment groups for human risk assessment of combined exposure to multiple chemicals calls for the use of “mechanistic information on toxicity as the gold standard where available (i.e., common mode of action or adverse outcome pathway) through a structured weight of evidence approach.” We propose that similarity in the susceptibility genes may be a reasonable indication of similarity of the mechanisms of toxicity in absence of other data.

On the other hand, the candidate genes are also of interest because they indicate common pathways of susceptibility that may also be of importance in vivo. For example, the genome-wide association analysis identified FAM9B, CNTN5, and GRIN3A as common putative susceptibility loci across eleven, eight, and seven chemicals or mixtures, respectively. Even though these candidate genes lack evidence regarding their potential role in toxicity pathways, the information available on their general function is highly relevant to cell stress responses. The FAM9B gene plays a role in regulating cell division as it codes for a protein in the synaptonemal complex that plays a critical role in meiosis in germ cells [65]. FAM9B and related genes have been shown to be upregulated in tumor cells [66] and also induced by DNA damaging agents [67]. CNTN5 is a protein coding gene that functions to mediate cell adhesion interactions during neural development and has been linked to inflammation [68]. Recently, it was identified as a potential pharmacogene that may affect drug clearance [69], albeit the association has not been independently verified. GRIN3A is a gene encoding an ion channel that is critical during neural development [70]. A study of organophosphates toxicity in mice identified increased expression of the GRIN3A gene after treatments with chlorpyrifos and diazinon [71]. Another candidate gene, FANCA, was a suggestive locus for susceptibility to a number of heavy metals including cadmium chloride, cobalt chloride, and mercuric chloride. Interestingly, the FANCA gene is involved in DNA replication, has high expression in lymphoblasts, and is rich in cysteine residues which have a strong affinity for heavy metals [72]. The FANCA gene polymorphisms are known to affect the cell’s capacity for inter-strand crosslinking in the process of DNA replication [73]. We emphasize that the GWAS findings, for this limited sample size, should be interpreted with caution; still, the results provided herein can be used by future researchers for replication or inclusion in meta-analyses.

This study has a number of limitations. Specifically, this model system is reflective of acute high-dose treatments that may not be indicative of the potential repeat exposure effects. Recapitulating chronic exposure or repeat dosing regimens presents a challenge for in vitro models in general, and it has been suggested that studies that aim to characterize the toxicodynamics of a response need to not only be designed in terms of concentration–response, but also include repeat exposures [74]. Another limitation is that the likely route of exposure to these chemicals and mixtures was not incorporated into the experimental design. In addition, for the chemicals thar require metabolic activation (e.g., polycyclic aromatic hydrocarbons), any in vitro model that lacks metabolism may be insufficient unless additional measures are taken [75]. However, to address these limitations, future work can study quantitative in vitro to in vivo extrapolation and use in vitro data coupled with preexisting exposure data to calculate oral doses that can be compared to chronic exposure scenarios while addressing the relevant routes of exposure [76]. The unknown composition of mixtures, health effects, and exposure assessment present challenges in mixtures risk assessment. In particular, understanding and screening realistic exposure scenarios has recently become more feasible with the increased availability and accessibility to monitor and model environmental exposures [77]. As more exposure data becomes available, these concepts of defined mixtures can be applied for toxicity screenings to conduct region-specific exposure assessments. Furthermore, while this study included a number of chemical classes, it is still limited in representing other important classes of toxicants and mixtures. Still, future work can apply a population-based approach to test mixtures of other chemicals of concern.

In summary, our data shows that population variability of the mixtures is unlikely to exceed that of the most variable component, but further work using additivity models is needed to better understand the extent to which population variability of mixtures can be reconstructed from variability in their components. Additionally, we found that similarity in genome-wide associations among components may be informative for mechanism-based grouping of constituents in a mixture for cumulative assessments. Overall, this study demonstrates that a human population-based in vitro model of lymphoblastoid cell lines is a reasonable approach to quantify inter-individual variability and can also be applied to mixtures, thus potentially reducing uncertainties associated with complex exposure scenarios, and helping to fill a critical gap in cumulative risk assessment.

Acknowledgments

We are grateful to anonymous reviewers for their valuable feedback.

Abbreviations

AC50 high/low, active concentration 50%; CEU, Utah residents with European ancestry; CNTN5, Contactin 5; DMSO, dimethyl sulfoxide; EC10, effective concentration at which a 10% change in cytotoxicity in comparison to vehicle; Expo high/low, exposure; FAM9B, family with Sequence Similarity 9 Member B; FANCA, Fanconi Anemia Complementation Group A; GBR, British from England and Scotland; GRIN3A, Glutamate Ionotropic Receptor NMDA Type Subunit 3A; GWAS, genome-wide association study; HPV, high-production volume chemicals; iPSC, induced pluripotent stem cells; LCLs, lymphoblast cell lines; MAF, minor allele frequency; MCMC, Markov chain Monte Carlo; PAHs, polycyclic aromatic hydrocarbons; POD, point of departure; QQplots, quantile-quantile plots; RfD high/low, reference dose; SNPs, single nucleotide polymorphisms; TDVF, toxicodynamic variability factor; TSI, Tuscans in Italy; YRI, Yoruban from Ibadan, Nigeria.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/toxics10080441/s1, Figure S1: Plate design layout, Figure S2: QQplots, Figure S3: Manhattan plots with mixed model analyses, Figure S4: Cell-line specific concentration–response curves, Figure S5: Chemical and mixture-specific Manhattan plot visualizations, Figure S6: Cytotoxicity comparisons for chemicals and mixtures across various in vitro models, Table S1: Chemical identification information, Table S2: Individual lymphoblast cell line identification, Table S3: Defined mixture information, Table S4: Pearson correlation coefficients for intraplate replicates across all cell lines, Table S5: Pearson correlation coefficients for interplate replicates for all cell lines, Table S6: SNP ID and corresponding p-values for chemicals (with effect) and all mixtures, Table S7: Chemical and mixture raw and normalized cytotoxicity data across all cell lines, Table S8: Median EC10 values for individual chemicals and mixtures, Table S9: Chemical and mixtures toxicodynamic variability factor summary data, Table S10: Genome-wide association study candidate genes, corresponding p-values, Table S11: Genome-wide association study SNPs with beta coefficients.

Author Contributions

Conceptualization, W.A.C., F.A.W. and I.R.; Methodology, L.C.F., Z.C. and S.J.; Validation, L.C.F. and S.J.; Formal Analysis, L.C.F., S.J., P.J.G. and Y.-H.Z.; Writing—Original Draft Preparation, L.C.F.; Writing—Review and Editing, L.C.F., S.J., W.A.C., F.A.W. and I.R.; Visualization, L.C.F., S.J., W.A.C. and I.R.; Supervision, I.R.; Funding Acquisition, I.R. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

This study is not subject to institutional review.

Informed Consent Statement

Not applicable.

Data Availability Statement

All pertinent data are included in Supplementary Materials. Table S6 is available at https://doi.org/10.5281/zenodo.6784584.

Conflicts of Interest

The authors declare no conflict of interest.

Funding Statement

This work was supported, in part, by grants from the National Institute of Environmental Health Sciences (P42 ES027704 and T32 ES026568) and the U.S. Environmental Protection Agency (RD84045001). The views expressed in this manuscript do not reflect those of the funding agencies. The use of specific commercial products in this work does not constitute endorsement by the funding agencies.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Kumar V., Boobis A.R., Moretto A. Test and risk assessment strategies for combined exposure to multiple chemicals. Food Chem. Toxicol. 2020;144:111607. doi: 10.1016/j.fct.2020.111607. [DOI] [PubMed] [Google Scholar]
  • 2.Sexton K., Hattis D. Assessing cumulative health risks from exposure to environmental mixtures—Three fundamental questions. Environ. Health Perspect. 2007;115:825–832. doi: 10.1289/ehp.9333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.OECD . Considerations for Assessing the Risks of Combined Exposure to Multiple Chemicals, Series on Testing and Assessment No. 296, Evironment, Health and Safety Division, Environment Directorate. Organisation for Economic Co-Operation and Development; Paris, France: 2018. [Google Scholar]
  • 4.Kienzler A., Bopp S.K., van der Linden S., Berggren E., Worth A. Regulatory assessment of chemical mixtures: Requirements, current approaches and future perspectives. Regul. Toxicol. Pharmacol. 2016;80:321–334. doi: 10.1016/j.yrtph.2016.05.020. [DOI] [PubMed] [Google Scholar]
  • 5.U.S. Environmental Protection Agency . Framework for Cumulative Risk Assessment. U.S. Environmental Protection Agency; Washington, DC, USA: 2003. [Google Scholar]
  • 6.U.S. Environmental Protection Agency . Cumulative Assessments of Risk from Pesticides. Office of Pesticide Programs, U.S. Environmental Protection Agency; Washington, DC, USA: 2016. [Google Scholar]
  • 7.Efsa Scientific Committee. More S.J., Bampidis V., Benford D., Bragard C., Hernandez-Jerez A., Bennekou S.H., Halldorsson T.I., Koutsoumanis K.P., Lambre C., et al. Guidance document on scientific criteria for grouping chemicals into assessment groups for human risk assessment of combined exposure to multiple chemicals. EFSA J. 2021;19:e07033. doi: 10.2903/j.efsa.2021.7033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.National Research Council . Phthalates and Cumulative Risk Assessment: The Tasks Ahead. National Academies Press; Washington, DC, USA: 2008. [PubMed] [Google Scholar]
  • 9.U.S. Environmental Protection Agency . Concepts, Methods, and Data Sources for Cumulative Health Risk Assessment of Multiple Chemicals, Exposure and Effects: A Resource Document. United States Environmental Protection Agency; Washington, DC, USA: 2008. [Google Scholar]
  • 10.European Centre for Ecotoxicology and Toxicology of Chemicals . Workshop on Combined Exposure to Chemicals. European Centre for Ecotoxicology and Toxicology of Chemicals; Berlin, Germany: 2011. [Google Scholar]
  • 11.OECD . Guidance Document on Aqueous-Phase Aquatic Toxicity Testing of Difficult Test Chemicals. OECD; Paris, France: 2019. [Google Scholar]
  • 12.Luo Y.S., Chen Z., Hsieh N.H., Lin T.E. Chemical and biological assessments of environmental mixtures: A review of current trends, advances, and future perspectives. J. Hazard. Mater. 2022;432:128658. doi: 10.1016/j.jhazmat.2022.128658. [DOI] [PubMed] [Google Scholar]
  • 13.Zeise L., Bois F.Y., Chiu W.A., Hattis D., Rusyn I., Guyton K.Z. Addressing human variability in next-generation human health risk assessments of environmental chemicals. Environ. Health Perspect. 2013;121:23–31. doi: 10.1289/ehp.1205687. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Wilkinson C.F., Christoph G.R., Julien E., Kelley J.M., Kronenberg J., McCarthy J., Reiss R. Assessing the risks of exposures to multiple chemicals with a common mechanism of toxicity: How to cumulate? Regul. Toxicol. Pharmacol. 2000;31:30–43. doi: 10.1006/rtph.1999.1361. [DOI] [PubMed] [Google Scholar]
  • 15.Rusyn I., Chiu W.A. Decision-making with new approach methodologies: Time to replace default uncertainty factors with data. [(accessed on 1 June 2022)];Toxicol. Sci. 2022 :kfac033. doi: 10.1093/toxsci/kfac033. Available online: https://pubmed.ncbi.nlm.nih.gov/35404442/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Rusyn I., Chiu W.A., Wright F.A. Model systems and organisms for addressing inter- and intra-species variability in risk assessment. Regul. Toxicol. Pharmacol. 2022;132:105197. doi: 10.1016/j.yrtph.2022.105197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Wheeler H.E., Dolan M.E. Lymphoblastoid cell lines in pharmacogenomic discovery and clinical translation. Pharmacogenomics. 2012;13:55–70. doi: 10.2217/pgs.11.121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Fermini B., Coyne S.T., Coyne K.P. Clinical trials in a dish: A perspective on the coming revolution in drug development. Slas Discov. 2018;23:765–776. doi: 10.1177/2472555218775028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Abdo N., Xia M., Brown C.C., Kosyk O., Huang R., Sakamuru S., Zhou Y.H., Jack J.R., Gallins P., Xia K., et al. Population-based in vitro hazard and concentration-response assessment of chemicals: The 1000 genomes high-throughput screening study. Environ. Health Perspect. 2015;123:458–466. doi: 10.1289/ehp.1408775. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Eduati F., Mangravite L.M., Wang T., Tang H., Bare J.C., Huang R., Norman T., Kellen M., Menden M.P., Yang J., et al. Prediction of human population responses to toxic compounds by a collaborative competition. Nat. Biotechnol. 2015;33:933–940. doi: 10.1038/nbt.3299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Burnett S.D., Blanchette A.D., Chiu W.A., Rusyn I. Cardiotoxicity hazard and risk characterization of toxcast chemicals using human induced pluripotent stem cell-derived cardiomyocytes from multiple donors. Chem. Res. Toxicol. 2021;34:2110–2124. doi: 10.1021/acs.chemrestox.1c00203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Abdo N., Wetmore B.A., Chappell G.A., Shea D., Wright F.A., Rusyn I. In vitro screening for population variability in toxicity of pesticide-containing mixtures. Environ. Int. 2015;85:147–155. doi: 10.1016/j.envint.2015.09.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.1000 Genomes Project Consortium. Abecasis G.R., Auton A., Brooks L.D., DePristo M.A., Durbin R.M., Handsaker R.E., Kang H.M., Marth G.T., McVean G.A. An integrated map of genetic variation from 1,092 human genomes. Nature. 2012;491:56–65. doi: 10.1038/nature11632. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Chen Z., Liu Y., Wright F.A., Chiu W.A., Rusyn I. Rapid hazard characterization of environmental chemicals using a compendium of human cell lines from different organs. ALTEX. 2020;37:623–638. doi: 10.14573/altex.2002291. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Lock E.F., Abdo N., Huang R., Xia M., Kosyk O., O’Shea S.H., Zhou Y.H., Sedykh A., Tropsha A., Austin C.P., et al. Quantitative high-throughput screening for chemical toxicity in a population-based in vitro model. Toxicol. Sci. 2012;126:578–588. doi: 10.1093/toxsci/kfs023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Hsieh N.H., Chen Z., Rusyn I., Chiu W.A. Risk characterization and probabilistic concentration-response modeling of complex environmental mixtures using new approach methodologies (nams) data from organotypic in vitro human stem cell assays. Environ. Health Perspect. 2021;129:17004. doi: 10.1289/EHP7600. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Wignall J.A., Shapiro A.J., Wright F.A., Woodruff T.J., Chiu W.A., Guyton K.Z., Rusyn I. Standardizing benchmark dose calculations to improve science-based decisions in human health assessments. Environ. Health Perspect. 2014;122:499–505. doi: 10.1289/ehp.1307539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Wambaugh J.F., Setzer R.W., Reif D.M., Gangwal S., Mitchell-Blackwood J., Arnot J.A., Joliet O., Frame A., Rabinowitz J., Knudsen T.B., et al. High-throughput models for exposure-based chemical prioritization in the expocast project. Environ. Sci. Technol. 2013;47:8479–8488. doi: 10.1021/es400482g. [DOI] [PubMed] [Google Scholar]
  • 29.Williams A.J., Grulke C.M., Edwards J., McEachran A.D., Mansouri K., Baker N.C., Patlewicz G., Shah I., Wambaugh J.F., Judson R.S., et al. The comptox chemistry dashboard: A community data resource for environmental chemistry. J. Cheminformatics. 2017;9:61. doi: 10.1186/s13321-017-0247-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Chiu W.A., Wright F.A., Rusyn I. A tiered, bayesian approach to estimating of population variability for regulatory decision-making. ALTEX. 2017;34:377–388. doi: 10.14573/altex.1608251. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Blanchette A.D., Burnett S.D., Grimm F.A., Rusyn I., Chiu W.A. A bayesian method for population-wide cardiotoxicity hazard and risk characterization using an in vitro human model. Toxicol. Sci. 2020;178:391–403. doi: 10.1093/toxsci/kfaa151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Gelman A., Goodrich B., Gabry J., Vehtari A. R-squared for bayesian regression models. Am. Stat. 2019;73:307–309. doi: 10.1080/00031305.2018.1549100. [DOI] [Google Scholar]
  • 33.Gelman A., Rubin D.B. Inference from iterative simulation using multiple sequences. Stat. Sci. 1992;7:457–472. doi: 10.1214/ss/1177011136. [DOI] [Google Scholar]
  • 34.US EPA . Benchmark Dose Technical Guidance. US EPA; Washington, DC, USA: 2012. Risk Assessment Forum. [Google Scholar]
  • 35.WHO/IPCS . Chemical-Specific Adjustment Factors for Interspecies Differences in Human Variability: Guidance Document for Use of Data in Dose/Concentration-Response Assessment. World Health Organization; Geneva, Switzerland: 2005. [Google Scholar]
  • 36.Dudbridge F., Gusnanto A. Estimation of significance thresholds for genomewide association scans. Genet. Epidemiol. 2008;32:227–234. doi: 10.1002/gepi.20297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Price A.L., Zaitlen N.A., Reich D., Patterson N. New approaches to population stratification in genome-wide association studies. Nat. Rev. Genet. 2010;11:459–463. doi: 10.1038/nrg2813. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Yang J., Zaitlen N.A., Goddard M.E., Visscher P.M., Price A.L. Advantages and pitfalls in the application of mixed-model association methods. Nat. Genet. 2014;46:100–106. doi: 10.1038/ng.2876. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mansouri K., Abdelaziz A., Rybacka A., Roncaglioni A., Tropsha A., Varnek A., Zakharov A., Worth A., Richard A.M., Grulke C.M., et al. Cerapp: Collaborative estrogen receptor activity prediction project. Environ. Health Perspect. 2016;124:1023–1033. doi: 10.1289/ehp.1510267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Guha R. Chemical informatics functionality in R. J. Stat. Softw. 2007;18:1–16. doi: 10.18637/jss.v018.i05. [DOI] [Google Scholar]
  • 41.Hattis D., Lynch M.K. Empirically observed distributions of pharmacokinetic and pharmacodynamic variability in humans-implications for the derivation of single point component uncertainty factors providing equivalent protection as existing rfds. In: Lipscomb J.C., Ohanian E.V., editors. Toxicokinetics in Risk Assessment. Informa Healthcare, USA, Inc.; NewYork, NY, USA: 2007. pp. 69–93. [Google Scholar]
  • 42.Devlin B., Roeder K. Genomic control for association studies. Biometrics. 1999;55:997–1004. doi: 10.1111/j.0006-341X.1999.00997.x. [DOI] [PubMed] [Google Scholar]
  • 43.Chiu W.A., Rusyn I. Advancing chemical risk assessment decision-making with population variability data: Challenges and opportunities. Mamm. Genome. 2018;29:182–189. doi: 10.1007/s00335-017-9731-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.National Research Council . Science and Decisions: Advancing Risk Assessment. National Academies Press; Washington, DC, USA: 2009. [PubMed] [Google Scholar]
  • 45.EFSA Scientific Committee. More S.J., Bampidis V., Benford D., Bennekou S.H., Bragard C., Halldorsson T.I., Hernández-Jerez A.F., Koutsoumanis K., Naegeli H. Guidance on harmonised methodologies for human health, animal health and ecological risk assessment of combined exposure to multiple chemicals. EFSA J. 2019;17:e05634. doi: 10.2903/j.efsa.2019.5634. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Dorne J.L., Amzal B., Bois F., Crepet A., Tressou J., Verger P. Population effects and variability. Methods Mol. Biol. 2012;929:521–581. doi: 10.1007/978-1-62703-050-2_20. [DOI] [PubMed] [Google Scholar]
  • 47.Bois F.Y., Hsieh N.H., Gao W., Chiu W.A., Reisfeld B. Well-tempered mcmc simulations for population pharmacokinetic models. J. Pharmacokinet. Pharmacodyn. 2020;47:543–559. doi: 10.1007/s10928-020-09705-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Kostewicz E.S., Aarons L., Bergstrand M., Bolger M.B., Galetin A., Hatley O., Jamei M., Lloyd R., Pepin X., Rostami-Hodjegan A., et al. Pbpk models for the prediction of in vivo performance of oral dosage forms. Eur. J. Pharm. Sci. 2014;57:300–321. doi: 10.1016/j.ejps.2013.09.008. [DOI] [PubMed] [Google Scholar]
  • 49.Jamei M., Marciniak S., Edwards D., Wragg K., Feng K., Barnett A., Rostami-Hodjegan A. The simcyp population based simulator: Architecture, implementation, and quality assurance. Silico Pharm. 2013;1:9. doi: 10.1186/2193-9616-1-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Caldwell J.C., Evans M.V., Krishnan K. Cutting edge pbpk models and analyses: Providing the basis for future modeling efforts and bridges to emerging toxicology paradigms. J. Toxicol. 2012;2012:852384. doi: 10.1155/2012/852384. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Quignot N., Wiecek W., Amzal B., Dorne J.L. The yin-yang of cyp3a4: A bayesian meta-analysis to quantify inhibition and induction of cyp3a4 metabolism in humans and refine uncertainty factors for mixture risk assessment. Arch. Toxicol. 2019;93:107–119. doi: 10.1007/s00204-018-2325-6. [DOI] [PubMed] [Google Scholar]
  • 52.US EPA . New Approach Methods Work Plan: Reducing Use of Animals in Chemical Testing. US Environmental Protection Agency; Washington, DC, USA: 2020. [Google Scholar]
  • 53.US EPA . Strategic Plan to Promote the Development and Implementation of Alternative Test Methods within the TSCA Program. Office of Chemical Safety and Pollution Prevention, US Environmental Protection Agency; Washington, DC, USA: 2018. [Google Scholar]
  • 54.ECHA . The Use of Alternatives to Testing on Animals for the Reach Regulation: Fourth Report (2020) under Article 117(3) of the Reach Regulation. European Chemicals Agency; Helsinki, Finland: 2020. [Google Scholar]
  • 55.ECHA . Read-Across Assessment Framework (RAAF)-Considerations on Multi-Constituent Substances and UVCBs. European Chemical Agency; Helsinki, Finland: 2017. [Google Scholar]
  • 56.Rusyn I., Daston G.P. Computational toxicology: Realizing the promise of the toxicity testing in the 21st century. Environ. Health Perspect. 2010;118:1047–1050. doi: 10.1289/ehp.1001925. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.International HapMap Consortium A haplotype map of the human genome. Nature. 2005;437:1299–1320. doi: 10.1038/nature04226. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Altshuler D., Durbin R.M., Abecasis G.R., Bentley D.R., Chakravarti A., Clark A.G., Collins F.S., De la Vega F.M., Donnelly P., Egholm M., et al. A map of human genome variation from population-scale sequencing. Nature. 2010;467:1061–1073. doi: 10.1038/nature09534. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Burnett S.D., Karmakar M., Murphy W.J., Chiu W.A., Rusyn I. A new approach method for characterizing inter-species toxicodynamic variability. J. Toxicol. Environ. Health Part A. 2021;84:1020–1039. doi: 10.1080/15287394.2021.1966861. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Drakvik E., Altenburger R., Aoki Y., Backhaus T., Bahadori T., Barouki R., Brack W., Cronin M.T.D., Demeneix B., Hougaard Bennekou S., et al. Statement on advancing the assessment of chemical mixtures and their risks for human health and the environment. Environ. Int. 2020;134:105267. doi: 10.1016/j.envint.2019.105267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Carnesecchi E., Svendsen C., Lasagni S., Grech A., Quignot N., Amzal B., Toma C., Tosi S., Rortais A., Cortinas-Abrahantes J., et al. Investigating combined toxicity of binary mixtures in bees: Meta-analysis of laboratory tests, modelling, mechanistic basis and implications for risk assessment. Environ. Int. 2019;133:105256. doi: 10.1016/j.envint.2019.105256. [DOI] [PubMed] [Google Scholar]
  • 62.Howard G.J., Schlezinger J.J., Hahn M.E., Webster T.F. Generalized concentration addition predicts joint effects of aryl hydrocarbon receptor agonists with partial agonists and competitive antagonists. Environ. Health Perspect. 2010;118:666–672. doi: 10.1289/ehp.0901312. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Hadrup N., Taxvig C., Pedersen M., Nellemann C., Hass U., Vinggaard A.M. Concentration addition, independent action and generalized concentration addition models for mixture effect prediction of sex hormone synthesis in vitro. PLoS ONE. 2013;8:e70490. doi: 10.1371/journal.pone.0070490. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.WHO/IPCS . Guidance Document on Evaluating and Expressing Uncertainty in Hazard Characterization. 2nd ed. World Health Organization & International Programme on Chemical Safety; Geneva, Switzerland: 2018. p. 159. [Google Scholar]
  • 65.Zhuang X.J., Feng X., Tang W.H., Zhu J.L., Li M., Li J.S., Zheng X.Y., Li R., Liu P., Qiao J. Fam9b serves as a novel meiosis-related protein localized in meiotic chromosome cores and is associated with human gametogenesis. PLoS ONE. 2021;16:e0257248. doi: 10.1371/journal.pone.0257248. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Dong Y., Zhang T., Li X., Yu F., Guo Y. Comprehensive analysis of coexpressed long noncoding rnas and genes in breast cancer. J. Obstet. Gynaecol. Res. 2019;45:428–437. doi: 10.1111/jog.13840. [DOI] [PubMed] [Google Scholar]
  • 67.Fan X., Zhu Y., Wang N., Zhang B., Zhang C., Wang Y. Therapeutic dose of hydroxyurea-induced synaptic abnormalities on the mouse spermatocyte. Front. Physiol. 2021;12:666339. doi: 10.3389/fphys.2021.666339. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Yoshihara Y., Kawasaki M., Tamada A., Nagata S., Kagamiyama H., Mori K. Overlapping and differential expression of big-2, big-1, tag-1, and f3: Four members of an axon-associated cell adhesion molecule subgroup of the immunoglobulin superfamily. J. Neurobiol. 1995;28:51–69. doi: 10.1002/neu.480280106. [DOI] [PubMed] [Google Scholar]
  • 69.Haas D.W., Abdelwahab M.T., van Beek S.W., Baker P., Maartens G., Bradford Y., Ritchie M.D., Wasserman S., Meintjes G., Beeri K., et al. Pharmacogenetics of between-individual variability in plasma clearance of bedaquiline and clofazimine in South Africa. [(accessed on 1 June 2022)];J. Infect. Dis. 2022 :jiac024. doi: 10.1093/infdis/jiac024. Available online: https://pubmed.ncbi.nlm.nih.gov/35091749/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Kehoe L.A., Bernardinelli Y., Muller D. Glun3a: An nmda receptor subunit with exquisite properties and functions. Neural Plast. 2013;2013:145387. doi: 10.1155/2013/145387. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Slotkin T.A., Seidler F.J. Comparative developmental neurotoxicity of organophosphates in vivo: Transcriptional responses of pathways for brain cell development, cell signaling, cytotoxicity and neurotransmitter systems. Brain Res. Bull. 2007;72:232–274. doi: 10.1016/j.brainresbull.2007.01.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Park S.J., Ciccone S.L., Beck B.D., Hwang B., Freie B., Clapp D.W., Lee S.H. Oxidative stress/damage induces multimerization and interaction of fanconi anemia proteins. J. Biol. Chem. 2004;279:30053–30059. doi: 10.1074/jbc.M403527200. [DOI] [PubMed] [Google Scholar]
  • 73.Castella M., Pujol R., Callen E., Trujillo J.P., Casado J.A., Gille H., Lach F.P., Auerbach A.D., Schindler D., Benitez J., et al. Origin, functional role, and clinical impact of fanconi anemia fanca mutations. Blood. 2011;117:3759–3769. doi: 10.1182/blood-2010-08-299917. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Macko P., Palosaari T., Whelan M. Extrapolating from acute to chronic toxicity in vitro. Toxicol. In Vitro. 2021;76:105206. doi: 10.1016/j.tiv.2021.105206. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Deisenroth C., DeGroot D.E., Zurlinden T., Eicher A., McCord J., Lee M.Y., Carmichael P., Thomas R.S. The alginate immobilization of metabolic enzymes platform retrofits an estrogen receptor transactivation assay with metabolic competence. Toxicol. Sci. 2020;178:281–301. doi: 10.1093/toxsci/kfaa147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Wetmore B.A. Quantitative in vitro-to-in vivo extrapolation in a high-throughput environment. Toxicology. 2015;332:94–101. doi: 10.1016/j.tox.2014.05.012. [DOI] [PubMed] [Google Scholar]
  • 77.U.S. EPA Guidelines for the health risk assessment of chemical mixtures. Fed. Regist. 1986;51:34014–34025. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

All pertinent data are included in Supplementary Materials. Table S6 is available at https://doi.org/10.5281/zenodo.6784584.


Articles from Toxics are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES