Skip to main content
Toxicological Sciences logoLink to Toxicological Sciences
. 2017 May 2;158(1):199–212. doi: 10.1093/toxsci/kfx085

High-Throughput Screening Data Interpretation in the Context of In Vivo Transcriptomic Responses to Oral Cr(VI) Exposure

Julia E Rager *, Caroline L Ring *, Rebecca C Fry †,, Mina Suh §, Deborah M Proctor §, Laurie C Haws *, Mark A Harris , Chad M Thompson ¶,1
PMCID: PMC5837509  PMID: 28472532

Abstract

The toxicity of hexavalent chromium [Cr(VI)] in drinking water has been studied extensively, and available in vivo and in vitro studies provide a robust dataset for application of advanced toxicological tools to inform the mode of action (MOA). This study aimed to contribute to the understanding of Cr(VI) MOA by evaluating high-throughput screening (HTS) data and other in vitro data relevant to Cr(VI), and comparing these findings to robust in vivo data, including transcriptomic profiles in target tissues. Evaluation of Tox21 HTS data for Cr(VI) identified 11 active assay endpoints relevant to the Ten Key Characteristics of Carcinogens (TKCCs) that have been proposed by other investigators. Four of these endpoints were related to TP53 (tumor protein 53) activation mapping to genotoxicity (KCC#2), and four were related to cell death/proliferation (KCC#10). HTS results were consistent with other in vitro data from the Comparative Toxicogenomics Database. In vitro responses were compared to in vivo transcriptomic responses in the most sensitive target tissue, the duodenum, of mice exposed to ≤ 180 ppm Cr(VI) for 7 and 90 days. Pathways that were altered both in vitro and in vivo included those relevant to cell death/proliferation. In contrast, pathways relevant to p53/DNA damage were identified in vitro but not in vivo. Benchmark dose modeling and phenotypic anchoring of in vivo transcriptomic responses strengthened the finding that Cr(VI) causes cell stress/injury followed by proliferation in the mouse duodenum at high doses. These findings contribute to the body of evidence supporting a non-mutagenic MOA for Cr(VI)-induced intestinal cancer.

Keywords: dose–response modeling, hexavalent chromium, high-throughput screening, mode of action, transcriptomics, risk assessment


There is increasing impetus towards transforming toxicity testing and the assessment of potential human health risks through incorporation of new technologies, including high-throughput screening (HTS), toxicogenomics, bioinformatics, systems biology, and computational toxicology (NRC, 2007; Richard et al., 2016). The continued expansion of HTS data through the ToxCast/Tox21 consortium has resulted in a large publicly available repository of in vitro toxicity data currently spanning >1800 chemicals, generated with the goal of supporting the development of improved toxicity prediction (Richard et al., 2016). Toxicogenomic analyses have also become increasingly prevalent as a result of decreasing costs and increasing feasibility of genome-wide screening technologies (Fry, 2015). Strategies to incorporate these methods and corresponding datasets into assessments of potential human health risks and regulatory decisions are current topics of growing interest (Bourdon-Lacombe et al., 2015; Moffat et al., 2015; Richard et al., 2016); however, more studies are still needed to evaluate the required steps and utility of such efforts.

In 2008, findings were released from a 2-year cancer bioassay in mice and rats exposed to hexavalent chromium [Cr(VI)] in drinking water (NTP, 2008). These studies indicated that Cr(VI) induced tumors in the small intestines of mice and in the oral mucosa of rats. A comprehensive research program was subsequently initiated to investigate the mode of action (MOA) underlying the tumorigenic responses observed in these target tissues. This MOA research program has resulted in the generation of an extensive body of histopathologic, pharmacokinetic, genotoxic, and biochemical data from the carcinogenic target tissues in rats and mice (Cullen et al., 2016; O'Brien et al., 2013; Thompson et al., 2012, 2015a,b,c). Transcriptomic data were also collected in target tissues after both short-term (7 days) and long-term (90 days) exposures (Kopec et al., 2012a,b). This rich dataset affords the opportunity to compare in vivo toxicity responses to Cr(VI) to in vitro high throughput and high content data.

Cr(VI) is a known human carcinogen by inhalation and has long been recognized as genotoxic, based primarily on in vitro data (IARC, 1990), and, primarily for these reasons, it has been assumed that Cr(VI) acts by a directly genotoxic MOA in causing tumors at all sites (OEHHA, 2011; U.S. EPA, 2010). However, more recent research has shown that Cr(VI) does not increase mutant frequency in the oral cavity of rats (Thompson et al., 2015c), and that Cr(VI) causes intestinal tumors by chronic cytotoxicity in intestinal villi leading to chronic regenerative hyperplasia that increases the risk of crypt stem cell transformation and tumorigenesis (Thompson et al., 2013). Some regulatory agencies have used these data to support the development of threshold toxicity criteria for the intestinal tumors (Health Canada, 2015; TCEQ, 2016).

The Tox21 consortium recently released in vitro bioactivity data for Cr(VI) that has yet to be incorporated into the understanding of Cr(VI) MOA for tumorigenic responses. The current study set out to do the following: (1) to analyze these recently generated HTS data and compare results against a large repository of public literature [ie, the Comparative Toxicogenomic Database (CTD)] to evaluate consistency between in vitro responses to Cr(VI); (2) to update the data processing, statistical analysis, and dose–response modeling of transcriptomics data originally published by Kopec et al. (2012a); and (3) to evaluate the utility of the HTS in vitro data for purposes of informing the Cr(VI) MOA by comparing the in vitro responses to the in vivo responses at the pathway-level across all doses evaluated. Study findings contribute to the growing understanding of Cr(VI) MOA while demonstrating potential strengths and limitations of in vitro HTS data in the context of risk assessment.

MATERIALS AND METHODS

Tox21 data collection and organization

In vitro HTS data for Cr(VI), in the form of sodium dichromate dihydrate (SDD), are available through the Tox21 consortium, a federal collaboration between the National Toxicology Program at the National Institute of Environmental Health Sciences and the National Center for Advancing Translational Sciences, the Food and Drug Administration, and the United States Environmental Protection Agency (U.S. EPA). For the current investigation, processed Tox21 data for SDD were extracted from the U.S. EPA’s Summary Files (invitrodb_v2, released Oct 2015) (U.S. EPA, 2015), including assay summary activity (hit) call, AC50 (concentration at which the activity reaches 50% of its maximal values for an assay-chemical pair), Z-score (indicator of the distance from cytotoxicity distribution), and cytotoxicity data. It should be noted that there are several additional ways to access the Tox21 database [eg, through the National Institutes of Health (NIH) website]. However, the resource provided through the U.S. EPA was used because, at the time of the analysis, it represented the most accessible route to the data and provided other summary-level assay statistics such as the hit calls, AC50 values, and Z-scores, described in further detail below. No data were available for SDD in the ToxCast assay suite.

Chemical-assay activity was characterized by hit calls, represented by values of 1, 0, or −1. A value of 1 indicated an “active” chemical, a value of 0 indicated an “inactive” chemical, and a value of −1 indicated that the activity could not be determined. Hit calls were based on criteria previously defined by the U.S. EPA (Judson et al., 2015, 2016). Z-scores were also used to evaluate the relationship between chemical-assay activity and assay cytotoxicity distributions. A higher Z-score (eg, Z-score > 2) indicated assay activity that occurred at a concentration far below the “cytotoxic signal burst” region, and a lower Z-score (eg, Z-score ≤ 2) indicated assay activity that occurred at a concentration at or above the “cytotoxic signal burst” region (Judson et al., 2016). As was implemented in a recent evaluation of ToxCast data (Auerbach et al., 2016), chemical-assay pairs with Z-scores ≤ 2 were excluded to account for this potential cytotoxicity interference. It is notable that a Z-score cutoff of 3 has recently been proposed (Judson et al., 2016); however, a Z-score of 2 was selected for the purposes of the current investigation to increase inclusivity in potential assay activity results. Tox21 data were also evaluated in the context of the Ten Key Characteristics of Carcinogens (TKCC) recently proposed by Smith et al. (2016), using assay-characteristic mappings previously implemented by the International Agency for Research on Cancer (IARC) in Monograph Volume 112 (IARC, 2015).

Identifying in vitro responses to Cr(VI) with comparative toxicogenomics database

In order to compare Tox21 HTS results to other previous in vitro findings, the CTD was queried for chemical-gene/protein interactions relevant to Cr(VI). The CTD is a publicly available database containing manually curated information on chemical-gene-disease relationships from previously published scientific literature (Davis et al., 2015). At the time of the analysis, CTD contained ∼42 000 genes (spanning 565 organisms) and ∼12 000 chemicals, resulting in ∼1.4 million curated chemical-gene/protein interactions. The following Cr(VI)-relevant compounds were analyzed through CTD’s batch query (with chemical names listed according to CTD inventory): chromium hexavalent ion (CAS 18540-29-9), potassium chromate(VI) (CAS 7789-00-6), and sodium bichromate/sodium dichromate (CAS 10588-01-9) (CTD, 2016). Note that studies using SDD (CAS 7789-12-0) were annotated to sodium dichromate/sodium bichromate in CTD. In order to identify which chemical-gene/protein interactions were from in vitro study designs, all study titles and abstracts were manually reviewed through PubMed (NCBI, 2016). All chemical-gene/protein interactions were used, including alterations in gene expression, protein expression, and protein activation.

Pathway enrichment and upstream regulator analysis

Pathway enrichment analysis was carried out on in vitro (CTD) and in vivo (see below) data using the Ingenuity® Pathway Analysis (IPA) Knowledgebase (v27821452, Ingenuity® Systems, Redwood City, CA) with the aim of identifying canonical pathways associated with responses to Cr(VI) exposure. The Ingenuity database provides a collection of biological interactions and functional annotations created from millions of individually modeled relationships between proteins, genes, complexes, cells, tissues, drugs, and disease curated from full-text review of articles from scientific journals. The knowledgebase includes ∼650 canonical pathways, which are well-characterized metabolic and cell signaling pathways curated and drawn from expert review of journal articles, review articles, text books, and the Encyclopedia of Human Genes and Metabolism (HumanCyc). Consistent with IPA recommended best practices, statistical significance of each canonical pathway was calculated using a right-tailed Fisher’s exact test using a competitive null hypothesis. Pathways with p < .05 were considered significant and included for further analysis. Multiple test corrected p-values of pathway enrichment (using the Benjamini and Hochberg multiple test correction) were also calculated.

Molecular upstream regulators were also computationally predicted using the Ingenuity Knowledgebase, using previously published methods (Kramer et al., 2014). Activation Z-scores were generated to predict the activation states of predicted upstream regulators that could explain the observed gene/protein expression changes. p-Values were also produced using the Fisher’s Exact Test to measure whether there was a statistically significant overlap between the Cr(VI)-responsive molecules and the molecules that are regulated by an upstream regulator. In order to be predicted as a regulator of the observed molecular changes, upstream regulators were required to have Z-score > ±2 and p < .05.

In vivo study design

To compare in vitro responses to in vivo responses in a primary site of Cr(VI)-induced tumorigenesis, a toxicogenomic analysis was carried out in duodenal tissue of mice exposed to Cr(VI) via drinking water for 13 weeks. These data have been previously described and analyzed (Kopec et al., 2012a,b), but were re-processed and analyzed here using updated methods, tools, and databases for interpretation (see below). Tissues used for toxicogenomic assessment were from animals exposed to varying concentrations of Cr(VI) in the form of SDD for 7 or 90 days, as previously described (Thompson et al., 2011, 2012).

As described by Thompson et al. (2011, 2012), dose formulations were prepared at concentrations of 0.3, 4, 14, 60, 170, and 520 mg/l SDD (CAS 7789-12-0) in tap water, which is equivalent to ∼0.1, 1.4, 5, 20.9, 59.3, and 180 ppm Cr(VI). On the first, third, fifth, and seventh (final) batch preparations, samples of formulations for each dose group, including the control, were collected and analyzed for Cr(VI) content at Brooks Rand Laboratories (Seattle, WA) in accordance with EPA Method SW-7196A. Batch preparations found to differ from the target concentration by ±10% were not used.

Details regarding animals, vendors, and animal husbandry were described previously (Thompson et al., 2011, 2012). In brief, female B6C3F1 mice (Charles River, Raleigh, NC) were received at 4–5 weeks of age and allowed to acclimate for ∼2 weeks. Mice were 13.3–22.9 g of weight at the start of exposure. All animals were allowed ad libitum access to irradiated NTP-2000 chow (Zeigler Bros., Gardners, PA) and drinking water (including test article) until study termination at days 8 or 91 of exposure. The in-life portion of these studies were conducted at Southern Research Institute (Birmingham, AL), the same research facility that conducted the NTP Cr(VI) bioassays (NTP, 2007, 2008).

Preparation of mouse duodenum samples was carried out by collecting and flushing intestinal sections with ice-cold phosphate buffered saline. Duodenal sections were cut longitudinally, and the epithelium was scraped using sterile plastic spatulas (VWR International) into vials containing TRIzol (Invitrogen, Carlsbad, CA), snap-frozen in liquid nitrogen, and stored at −80 °C. These frozen tissue samples were homogenized using a Mixer Mill 300 tissue homogenizer (Retsch, Germany). Total RNA was isolated according to the manufacturer's TRIzol extraction protocol with an additional acid phenol:chloroform extraction. Isolated RNA was resuspended in RNA storage solution (Ambion Inc., Austin, TX), quantified, and quality assessed by evaluation of A260/A280 ratios and by visual inspection of 1 µg total RNA on a denaturing gel. Only high quality RNA samples (A260/280 > 1.9) were further examined.

Transcriptomic analyses

Gene expression changes resulting from Cr(VI) exposure in duodenal tissues were examined using mouse 4 × 44 K Agilent whole-genome oligonucleotide microarrays (version 1, Agilent Technologies, Inc., Santa Clara, CA). The tissue samples and microarrays were processed shortly after collection (ie, ca. 2012), and data were previously analyzed using posterior probabilities based on an empirical Bayes method using model-based t-values and genes filtered using fold change  ≥ ±1.5 and P1(t) value > 0.999 (Kopec et al., 2012a; Kopec et al., 2012b). In the current study, microarray data were re-analyzed using methods consistent with microarray assessment guidelines for use in risk assessment (Bourdon-Lacombe et al., 2015). Microarrays incorporated independent labeling of each sample with two different dyes that were scanned using a GenePix 4000B scanner at 532 nm for Cy3 labeling (green dye), and 635 nm for Cy5 labeling (red dye). The mRNA microarray data were analyzed by pulling data for the median Cy3 dye signal, because the Cy5 dye signal has been shown to be susceptible to laboratory-introduced biases/errors (eg, ozone) (Fare et al., 2003). Microarray data quality was assessed by reviewing probe signal intensity distributions and through principal component analysis (R v3.2.4) (Thompson et al., 2016). Microarray data are publicly available at www.Cr6study.info and NCBI’s Gene Expression Omnibus, accessible through GEO Series accession number GSE87262 (Edgar et al., 2002).

Microarray data were normalized by quantiles (Partek Genomics Suite, St Louis, Missouri), and background noise was eliminated by removing mRNA probes with signal intensities less than the median signal across the majority of samples. RNA samples were assessed in biological triplicate in all dose groups (0, 0.03, 4, 14, 60, 170, and 520 mg/l SDD at day 8 and day 91) except for the 4 mg/l SDD exposure group from day 91, which was analyzed in biological duplicate due to potential microarray quality issues. Statistical comparisons were carried out using analysis of variance (ANOVA) between exposed versus unexposed samples across all doses. Differentially expressed genes (DEGs) were defined as those with a significant difference in mRNA levels between exposed versus unexposed samples with a fold change of ≥±2 (average exposed vs average unexposed) and FDR q < 0.05 (Storey, 2003). These methods and statistical parameters are similar to those implemented in recent publications using Agilent array data (Bartman et al., 2014; Rager et al., 2014) and are in line with current guidelines for microarray analyses (Bourdon-Lacombe et al., 2015). A subset of DEGs identified in the current analysis were confirmed by comparing to quantitative real-time polymerase chain reaction (qRT-PCR) results in the previously published analyses (Kopec et al., 2012a).

Dose–response modeling of in vivo transcriptomic changes

Dose–response modeling of the DEGs associated with Cr(VI) exposure in the mouse duodenum was conducted with BMDExpress v1.4 using methods previously detailed (Moffat et al., 2015; Yang et al., 2007). Briefly, analyses were carried out on the lists of DEGs (represented by their respective microarray probesets) against Cr(VI) dose (mg SDD/L)1 using four models: Hill, power, linear, and 2° polynomial. The models were run assuming constant variance, and a benchmark response (BMR) factor of 1.349 was used, representing the number of standard deviations required to shift the mean transcriptional response 10% over the assumed background rate of response, defining the benchmark dose (BMD). Models with the best fit were selected as those that (1) described the data with the least complexity, (2) had a nested likelihood ratio test p < .05, and (3) had the lowest Akaike information criterion (AIC). The Hill model was considered only when the k parameter (representing the slope) was more than one third of the lowest dose tested, in order to avoid artificial minimization of BMDs. Other parameters used in the analysis included setting the maximum iterations to 250 and the confidence level to 0.95. Probesets were removed if they showed either BMD/BMDL (BMD lower confidence limit) ratios >20, BMD values less than 10-fold below the lowest SDD concentration tested, and/or BMD values greater than the highest concentration tested in order to avoid model extrapolation. In order for the models to adequately describe potential dose–response trends in gene expression, curves were required to have goodness-of-fit p > .1 (likelihood ratio test) (Moffat et al., 2015; Yang et al., 2007). Genes showing adequate dose–response curve fits were identified as showing dose–response relationships with Cr(VI) exposure.

Pathway and upstream regulator analysis of in vivo transcriptomic changes

Pathway enrichment analyses of the DEGs showing dose–response relationships with Cr(VI) exposure were carried out using IPA, as described above. Pathways with enrichment p < .05 were included for further analysis, paralleling the statistical filters used in toxicogenomics-based analyses used for chemical risk assessment purposes (Farmahin et al., 2016; Jackson et al., 2014; Moffat et al., 2015). To provide a specific example, a recent publication reviewed multiple approaches for calculating points of departure using transcriptomic data, wherein all approaches used BMDs calculated from IPA pathways with enrichment p < .05 (Farmahin et al., 2016). Multiple test corrected p-values of enrichment were also calculated and reported in the current analysis.

The resulting pathways and their related molecules were extracted, BMD values for each pathway-relevant molecule were pulled, and overall pathway-level median BMD values were calculated using R (v3.2.4). In the case that multiple probes showed adequate dose–response relationships to Cr(VI) for the same gene, probes with the highest goodness-of-fit p-value were used in calculating median BMD values. For data interpretation purposes, enriched canonical pathways were also organized into larger categories in an objective manner, using annotations provided by the Ingenuity’s Signaling Pathway Categories. Pathway-level findings were linked to previously published histopathological findings in order to phenotypically anchor the observed transcriptomic responses to potential key events involved in Cr(VI) MOA. Potential key events involved in Cr(VI) MOA were identified by reviewing MOAs suggested through recent peer-reviewed publications (McCarroll et al., 2010; Thompson et al., 2011). Among the available signaling pathway categories, four were involved in potential key events: (1) cell stress and injury (including genotoxic responses), (2) apoptosis, (3) cell growth, proliferation and development, and (4) cancer (as the eventual adverse outcome). Molecular upstream regulators of the DEGs were computationally predicted using methods described in the above text.

RESULTS

Tox21 Results Showed Cr(VI)-Induced Changes in TP53 Activation and Cell Proliferation

Cr(VI) (as SDD) data were available across 113 Tox21 assay endpoints, 40 of which were identified as active in response to SDD exposure (Table 1). An important aspect to consider when interpreting HTS data is the concentration at which cytotoxicity occurs, as activity that occurs near or above concentrations inducing cytotoxicity may reflect non-specific assay activation or activity associated with general disruption of cellular machinery that can lead to cell stress/death (ie, “cytotoxic signal burst”), rather than disruption of specific biomolecular targets or pathways (Judson et al., 2016). SDD caused cytotoxicity in the active assays at a median AC50 of 30.3 µM. Rather than directly comparing the chemical-assay versus cytotoxicity AC50, a statistical approach was implemented through a Z-score filter, as implemented in recent publications (Auerbach et al., 2016; Judson et al., 2016). Of the 40 active assay endpoints, 20 showed Z-scores > 2 (Tables 1 and 2), representing assay endpoints that likely indicate specific disruption of biomolecular targets or pathways rather than cytotoxicity interference.

Table 1.

Summary of the Number of HTS Assay Endpoints Used to Evaluated Cr(VI) Bioactivity Through the Tox21 Database, as Organized According to the TKCC

TKCC Number TKCC Name Number of Assay Endpoints Tested Number of Active Assay Endpoints Number of Active Assays Endpoints with Z-score>2
1 Act as an electrophile either directly or after metabolic activation 1 1 1
2 Is genotoxic 5 5 4
3 Alter DNA repair or cause genomic instability 0 NAa NA
4 Induce epigenetic changes 0 NA NA
5 Induce oxidative stress 3 1 1
6 Induce chronic inflammation 1 0 0
7 Be immunosuppressive 0 NA NA
8 Modulate receptor-mediated effects 20 7 1
9 Cause immortalization 0 NA NA
10 Alter cell proliferation, cell death, or nutrient supply 22 13 4
NA Not mapped to TKCC 61 13 9
Sum 113 40 20

TKCC = Ten Key Characteristics of Carcinogens as described in Smith et al. (2016) and mapped according to IARC monograph volume 112 (IARC, 2015).

a

NA, not applicable.

Table 2.

Tox21 Active Assay Endpoints Associated With SDD Treatment In Vitro, Organized According to the TKCC

TKCC Number Assay Endpoint Name AC50 (µM) Z-scorea Gene Target Organism Tissue Cell Type Biological Process Target
1 TOX21_Aromatase_Inhibition 2.05 5.73 CYP19A1 Human Breast MCF-7 Regulation of transcription factor activity
2 TOX21_p53_BLA_p5_ratio 7.39 3.00 TP53 Human Intestinal HCT116 Regulation of transcription factor activity
2 TOX21_p53_BLA_p1_ratio 4.59 4.02 TP53 Human Intestinal HCT116 Regulation of transcription factor activity
2 TOX21_p53_BLA_p2_ratio 4.44 4.09 TP53 Human Intestinal HCT116 Regulation of transcription factor activity
2 TOX21_p53_BLA_p3_ratio 2.58 5.24 TP53 Human Intestinal HCT116 Regulation of transcription factor activity
5 TOX21_ARE_BLA_agonist_ratio 11.00 2.16 NFE2L2 Human Liver HepG2 Regulation of transcription factor activity
8 TOX21_GR_BLA_Antagonist_ratio 5.15 3.77 NR3C1 Human Cervix HeLa Regulation of transcription factor activity
10 TOX21_p53_BLA_p4_viability 11.77 2.01 NAb Human Intestinal HCT116 Cell proliferation
10 TOX21_p53_BLA_p3_viability 8.63 2.67 NA Human Intestinal HCT116 Cell proliferation
10 TOX21_GR_BLA_Antagonist_viability 2.86 5.02 NA Human Cervix HeLa Cell proliferation
10 TOX21_AR_BLA_Antagonist_viability 1.51 6.39 NA Human Kidney HEK293T Cell proliferation
NA TOX21_ARE_BLA_Agonist_ch2 10.50 2.26 NA Human Liver HepG2 Regulation of transcription factor activity
NA TOX21_PPARd_BLA_agonist_ch2 8.37 2.74 NA Human Kidney HEK293T Regulation of transcription factor activity
NA TOX21_GR_BLA_Antagonist_ch2 6.46 3.29 NA Human Cervix HeLa Regulation of transcription factor activity
NA TOX21_p53_BLA_p1_ch2 6.02 3.44 NA Human Intestinal HCT116 Regulation of transcription factor activity
NA TOX21_AR_BLA_Agonist_ch2 5.54 3.62 NA Human Kidney HEK293T Regulation of transcription factor activity
NA TOX21_p53_BLA_p5_ch2 3.78 4.43 NA Human Intestinal HCT116 Regulation of transcription factor activity
NA TOX21_p53_BLA_p2_ch2 2.93 4.97 NA Human Intestinal HCT116 Regulation of transcription factor activity
NA TOX21_p53_BLA_p3_ch2 2.08 5.70 NA Human Intestinal HCT116 Regulation of transcription factor activity
NA TOX21_TR_LUC_GH3_Antagonist 0.84 7.64 NA Rat Pituitary gland GH3 Regulation of transcription factor activity

TKCC = Ten Key Characteristics of Carcinogens as described in Smith et al. (2016) and mapped according to IARC monograph volume 112 (IARC, 2015).

a

Z-scores are based on comparing chemical-assay AC50 against chemical cytotoxicity distribution, with SDD showing a median cytotoxicity AC50 of 30.3 µM.

b

NA, not applicable.

Interpreting HTS findings in the context of the TKCC, two key characteristics showed the highest number (n = 4) of active assay endpoints with Z-scores > 2: genotoxic (KCC#2) and cell proliferation, cell death, or nutrient supply (KCC#10). All of the active assays mapping to KCC#2 were indicative of human tumor protein 53 (TP53) DNA binding activation (Table 2). These assay data were generated with an inducible reporter (detected with fluorescence intensity signals by GAL4 beta lactamase reporter gene technology) using a human intestinal cell line (HCT116) treated with SDD at varying concentrations (0–100 µM) for 24 h. It is important to note that although p53 activation can be triggered by DNA damage (Levine et al., 2006), these TP53 assay endpoints did not directly measure genotoxicity. All of the active assays mapping to KCC#10 represented cell viability assay endpoints that were categorized with the biological process target of cell proliferation (Table 2). In addition to the assays showing activity, it is also important to note that inactive assay endpoints mapped to other KCCs, including chronic inflammation (KCC#6) and modulation of receptor-mediated effects (KCC#8), showing the following number of active/total assays: 0/1 and 1/20 (Table 1).

In Vitro Responses to Cr(VI) Identified Through CTD

To determine whether Tox21 HTS results are consistent with other published in vitro findings, the CTD was queried for chemical-gene/protein interactions relevant to Cr(VI) exposure and filtered for interactions identified in vitro. Querying chromium hexavalent ion, potassium chromate(VI), and sodium bichromate/sodium dichromate resulted in the identification of 525, 5168, and 641 in vitro chemical-gene/protein interactions from 70, 13, and 19 references, respectively (Supplementary Table 1). The majority of these chemical-gene/protein interactions (5757 out of 6334 interactions) represented changes in gene expression. Together, a total of 3502 unique molecules were identified as altered by in vitro exposure to Cr(VI) through CTD. Of these molecules, 2028 were identified by two or more references and 435 were identified by three or more references. Notably, TP53 alterations associated with in vitro Cr(VI) exposure were identified in 10 studies.

In Vitro Responses to Cr(VI) Are Enriched for Apoptosis, p53, and DNA Damage Response Signaling

Pathway enrichment analysis was carried out using the Ingenuity® Pathway Analysis knowledgebase with the aim of identifying canonical pathways associated with responses to Cr(VI) exposure in vitro. Analyses were completed for the genes/proteins with alterations identified through the CTD repository, using three separate lists: (1) molecules identified by ≥ 1 study (n = 3502), (2) molecules identified by ≥ 2 studies (n = 2028), and (3) molecules identified by ≥ 3 studies (n = 435). Due to the large number of molecules shown to be altered by Cr(VI) exposure, many canonical pathways were identified as enriched (Supplementary Table 2). Amongst the most significantly enriched pathways across all three lists were apoptosis signaling (p = 3.98 × 10−13, p = 5.01 × 10−11, and p = 6.31 × 10−17 for molecules identified by ≥ 1 study, ≥2 studies, and ≥3 studies, respectively), ATM (ataxia telangiectasia mutated) signaling (p = 1.00 × 10−12, 1.58 × 10−15, and 1.58 × 10−15), and p53 signaling (p = 1.58 × 10−13, 3.98 × 10−15, and 7.94 × 10−15). Notably, these pathways also showed significance after correction for multiple testing (Supplementary Table 2). These findings demonstrate consistency between in vitro Tox21 HTS results (p53 activity and cell proliferation/cell death alterations) and in vitro CTD results (alterations in p53, DNA damage, and apoptosis).

Transcriptomic Changes Associated With In Vivo Exposure to Cr(VI)

Transcriptomic analyses were carried out using mouse duodenum tissue, the target tissue shown to undergo tumorigenesis with the highest incidence in mice chronically exposed to high doses of Cr(VI) via drinking water (NTP, 2008). Transcriptomic analyses, along with qRT-PCR verification, were published previously using an empirical Bayes method (Kopec et al., 2012a,b). The present updated analysis includes advancements in genomics-based tools and methods specifically relevant to risk assessment. Notably, the new analyses were consistent with previous qRT-PCR results (Supplementary Figure 1). Transcriptomic analysis identified a total of 3029 genes (represented by 4041 probe sets) with differential expression resulting from 7 days of exposure in at least one dose group (Supplementary Table 3), and a total of 1099 genes (represented by 1449 probe sets) with differential expression resulting from 90 days of exposure (Supplementary Table 4). In general, the number of DEGs with altered expression increased with increasing Cr(VI) exposure concentrations (Figure 1). Notably, significant gene expression alterations did not occur until 60 mg/l SDD (∼20 ppm Cr(VI)) in mice exposed for 90 days (Figure 1B).

Figure 1.

Figure 1

Genes with differential expression associated with exposure to Cr(VI) in the mouse duodenum. The number of DEGs identified by comparing exposed versus unexposed samples (FC ≥ 2, q < 0.05) after (A) 7 days and (B) 90 days of exposure to varying concentrations of Cr(VI) (as SDD in drinking water). DEGs that showed both differential expression in exposed versus unexposed samples (FC ≥ 2, q < 0.05) and dose-dependent changes in expression identified through BMD modeling (curve fit p > .10) after (C) 7 days and (D) 90 days of exposure to Cr(VI). Heat maps display fold change (FC) in expression (exposed/unexposed) for each DEG, with the concentrations of SDD (in mg/l) listed on the top.

Dose–Response Analysis of Transcriptomic Changes

DEGs associated with Cr(VI) treatment in the mouse duodenum were analyzed for dose-dependent changes using BMDExpress, with the goals of identifying genes that show dose-dependent changes in expression and comparing estimated doses at which changes in pathways relevant to Cr(VI) key events occur. Out of the 3029 DEGs resulting from 7 days of exposure in at least one dose group, 938 showed dose-dependent changes (Figure 1C, Supplementary Table 5). The median BMD estimate was 42 mg SDD/l, and the median BMDL estimate was 26 mg SDD/l (Table 3). Out of the 1099 DEGs resulting from 90 days of exposure in at least one dose group, 665 showed dose-dependent changes (Figure 1D, Supplementary Table 5). The median BMD estimate was 38 mg SDD/l, and the median BMDL estimate was 28 mg SDD/l (Table 3). Example dose–response curve plots are provided in supplementary material (Supplementary Figure 2).

Table 3.

BMD and BMDL Estimates for In Vivo Transcriptomic Responses to Cr(VI) in the Mouse Duodenum

Day 8 BMD EstimatesMean, Median (Min–Max) Day 8 BMDL EstimatesMean, Median (Min–Max) Day 91 BMD EstimatesMean, Median (Min–Max) Day 91 BMDL EstimatesMean, Median (Min–Max)
DEGs that show dose-dependent changes
63, 42 (0.045–505) 40, 26 (0.004–337) 51, 38 (0.397–513) 35, 28 (0.052–293)
Median pathway-level BMD values across all enriched canonical pathways
51, 52 (8–108) 33, 30 (2–71) 48, 45 (18–132) 33, 31 (13–97)
Median pathway-level BMD values across categories relevant to key events
Cell stress and injury 38, 44 (19–60) 25, 28 (9–43) 41, 39 (34–47) 30, 30 (23–34)
Apoptosis None None 54, 44 (29–132) 39, 31 (20–97)
Cell growth, proliferation and development 35, 26 (19–71) 21, 14 (9–47) 43, 45 (29–61) 33, 34 (21–51)
Cancer 80, 80 (79–82) 59, 59 (52–67) 42, 42 (39–44) 31, 31 (30–31)

Values are provided in mg SDD/L in drinking water.

Pathway Enrichment Analysis of In Vivo Dose-Dependent Genes

The DEGs showing good dose–response curve fits were analyzed in the context of canonical pathways. A total of 55 pathways were identified as associated with genes showing dose-dependent changes after 7 days of exposure, and 62 pathways with genes showing dose-dependent changes after 90 days of exposure (Supplementary Table 2). Median BMD values across all molecules in each pathway were calculated, as used in previous transcriptomic BMD assessments (Thomas et al., 2012b), and resulted in the generation of pathway-level median BMD estimates (Supplementary Table 6). These pathway-level median BMD estimates ranged from 8 to 108 mg SDD/l for the day 8 results, and 18–132 mg SDD/l for the day 91 results (Table 3).

The individual canonical pathways associated with Cr(VI) exposure were organized in an objective and reproducible manner into larger signaling pathway categories, as provided by the Ingenuity knowledgebase (Supplementary Table 6). Among the available signaling pathway categories, four are involved in potential Cr(VI) MOA key events, with key events extracted from previous Cr(VI) MOA reviews (McCarroll et al., 2010; Thompson et al., 2011): (1) cell stress and injury, (2) apoptosis, (3) cell growth, proliferation and development, and (4) cancer (as the eventual adverse outcome). Notably, the cell stress and injury pathway includes genotoxicity, which was a major early key event proposed by McCarroll et al. (2010). All enriched pathways that relate to these categories are shown in Table 4 with pathway-level median BMD and BMDL estimates. In general, pathways related to cell stress and injury included genes with majority increased expression associated with Cr(VI) exposure. Pathways related to the larger category of apoptosis (which included the canonical apoptosis pathway, among others) were not enriched at day 8; yet showed enrichment at day 91. These pathways included genes with majority decreased expression associated with Cr(VI), suggesting that decreased apoptosis-related signaling occurred. Consistent with this finding, almost all pathways related to cell growth, proliferation and development included genes with majority increased expression at day 8 and 91. Evaluation of the pathway-level median BMD estimates showed that at day 8, pathway alterations related to key events occurred between 19 and 82 mg SDD/l. The median pathway-level BMD estimates at day 91 were higher than day 8, ranging from 29 to 132 mg SDD/l for pathways related to key events (Table 3).

Table 4.

Pathway-Level BMD Estimates for Signaling Categories Relevant to Cr(VI) MOA. Enriched canonical pathways associated with transcriptomic responses in the duodenum of mice exposed to ≤ 520 mg SDD/l water at (A) day 8 and (B) day 91. Pathways are organized according to major signaling pathway categories and phenotypically anchored based on apical responses.a

Enriched Canonical Pathways Total Number of Transcripts with Dose-Dependent Differential Expression Number of Transcripts with Dose-Dependent Increased, Decreased Expression Median BMD (mg SDD/l) Median BMDL (mg SDD/l) Signaling Pathway Categories Phenotypic Anchoring
(A) Day 8
EIF2 Signaling 43 42, 1 18.6 9.3 Cellular Stress and Injury Villous atrophy and blunting
Regulation of eIF4 and p70S6K Signaling 27 25, 2 25.3 14.6
Nucleotide Excision Repair Pathway 8 8, 0 43.5 32.6
p38 MAPK Signaling 12 8, 4 44.1 27.2
HIF1alpha Signaling 9 9, 0 59.7 43.3
EIF2 Signaling 43 42, 1 18.6 9.3 Cellular Growth, Proliferation and Development Epithelial hyperplasia and crypt elongation
Regulation of eIF4 and p70S6K Signaling 27 25, 2 25.3 14.6
mTOR Signaling 26 24, 2 26.5 13.3
RAN Signaling 4 4, 0 71.2 47.5
Bladder Cancer Signaling 9 8, 1 78.6 51.9 Cancer Adverse outcome (2 years, high doses)
Ovarian Cancer Signaling 11 11, 0 82.4 67.0
(B) Day 91
HIF1alpha Signaling 9 4, 5 34.1 23.2 Cellular Stress and Injury Villous atrophy and blunting
Autophagy 5 1, 4 38.1 28.9
Hypoxia Signaling in the Cardiovascular System 6 2, 4 39.4 29.7
Regulation of eIF4 and p70S6K Signaling 22 21, 1 44.9 33.3
EIF2 Signaling 46 46, 0 46.7 34.2
Retinoic acid Mediated Apoptosis Signaling 5 0, 5 28.8 20.3 Apoptosis Epithelial hyperplasia and crypt elongation
Death Receptor Signaling 9 1, 8 33.5 25.8
Apoptosis Signaling 7 2, 5 40.9 30.7
Type I Diabetes Mellitus Signaling 8 1, 7 43.7 32.4
Calcium-induced T Lymphocyte Apoptosis 6 1, 5 49.7 31.5
Cytotoxic T Lymphocyte-mediated Apoptosis of Target Cells 5 0, 5 50.0 36.4
TWEAK Signaling 4 1, 3 132.1 96.6
Cdc42 Signaling 10 1, 9 29.4 23.0 Cellular Growth, Proliferation and Development
VEGF Signaling 7 5, 2 32.3 21.3
Regulation of eIF4 and p70S6K Signaling 22 21, 1 44.9 33.3
mTOR Signaling 24 18, 6 46.1 34.0
EIF2 Signaling 46 46, 0 46.7 34.2
RAN Signaling 3 3, 0 61.5 51.4
Hypoxia Signaling in the Cardiovascular System 6 2, 4 39.4 29.7 Cancer Adverse outcome (2 years, high doses)
Molecular Mechanisms of Cancer 18 3, 15 44.3 31.4
a

References supporting phenotypic observations are detailed in Table 5, except for the adverse outcome of cancer observed in a 2-year bioassay study (NTP, 2008).

Phenotypic Anchoring of In Vivo Transcriptomic Findings

The pathway categories identified as associated with transcriptomic responses to Cr(VI) are consistent with previously published histopathological data (Table 5). For instance, pathways related to increased cell stress and injury are consistent with intestinal villus atrophy and blunting that have been observed in mice exposed to ≥ 60 mg SDD/l for 90 days (Cullen et al., 2016). Decreased signaling related to apoptosis and increased signaling related to cell growth, proliferation, and development is also supported at the histopathology level through observed increases in intestinal crypt length in exposed mice (Thompson et al., 2015a,b). In vivo duodenal micronucleus (MN) assays indicate a lack of genotoxicity in the crypt compartment (O'Brien et al., 2013; Thompson et al., 2015b), which is also consistent with transcriptomic responses showing a lack of p53/DNA damage response signaling alterations. Moreover, these findings are also consistent with X-ray fluorescence mapping of chromium in the unstained duodenal sections from mice exposed to 180 ppm Cr(VI) for 7 and 90 days (Thompson et al., 2015a,b), which indicates that chromium localizes to intestinal villi, but not the crypt regions where cell proliferation occurs.

Table 5.

Phenotypic Evidence for Intestinal Transcriptomic Responses Found in Mice Exposed to SDD (≤520 mg SDD/l) Through Drinking Water

In Vivo Transcriptomic Findings In Vivo Phenotypic Evidence References
7 days of exposure
Increased signaling related to cell growth, proliferation and development Cell proliferation observed through crypt epithelial hyperplasia in transverse duodenal H&Eb stained sections (Thompson et al., 2011)
Cell proliferation observed through increased numbers of crypt enterocytes in Feulgen stained Swiss roll duodenal sections (Thompson et al., 2015b)
Increased signaling related to cell stress and injury (including one pathway relevant to genotoxicity, nucleotide excision repair pathwaya) Lack of genotoxicity observed through lack of crypt micronucleus induction in Feulgen stained transverse duodenal sections (O'Brien et al., 2013)
Lack of genotoxicity observed through lack of crypt micronucleus induction in Feulgen stained Swiss roll duodenal sections (Thompson et al., 2015b)
Tissue dosimetry observed through XRFc mapping, indicating chromium localized to the intestinal villi, and little (if any) in the crypt (Thompson et al., 2015b)
90 days of exposure
Increased signaling related to cell growth, proliferation and development Cell proliferation observed through crypt epithelial hyperplasia in transverse duodenal H&E stained sections (Cullen et al., 2016; Thompson et al., 2011)
Cell proliferation observed through increased numbers of crypt enterocytes in Feulgen stained transverse duodenal sections (O'Brien et al., 2013)
Cell proliferation observed through increased crypt length (µm) in Feulgen stained transverse duodenal sections (Thompson et al., 2015a)
No enrichment for DNA damage response pathways Lack of genotoxicity observed through lack of crypt micronucleus induction in Feulgen stained transverse duodenal sections (O'Brien et al., 2013)
Tissue dosimetry observed through XRF mapping, indicating chromium localized to the intestinal villi, and little (if any) in the crypt (Thompson et al., 2015a)
Significant, robust changes in transcriptomic profiles are consistent with tissue dosimetry Tissue dosimetry observed through mass spectrometry, indicating increased total chromium in the duodenum (Thompson et al., 2011)
a

The nucleotide excision repair pathway consisted of eight genes showing increased expression associated with Cr(VI), all of which are also involved in general DNA transcription and cell cycle signaling: cyclin H (Ccnh), general transcription factor genes (Gtf2h1 and Gtf2h3), RNA polymerase II genes (Polr2e, Polr2f, Polr2h, Polr2l), and replication protein A3 (Rpa3).

b

H&E, Haemotoxylin and Eosin.

c

XRF, X-ray fluorescence microscopy.

Alterations in cancer signaling can potentially be anchored to the adverse outcome of tumor formation in the mouse duodenum tissue observed in 2-year Cr(VI) bioassays (NTP, 2008); however, pre-neoplastic lesions have not been observed in mice or rats exposed to ≤180 ppm Cr(VI) for 90 days (NTP, 2007; Thompson et al., 2011, 2012), and tumors were not observed in mice until well after one year of exposure (NTP, 2008). Therefore, caution is needed when anchoring the “cancer” pathway changes because the time- and dose-matched tissues were not diagnosed as neoplastic or pre-neoplastic. For example, the increases in cancer-related signaling observed at day 8 (Figure 2A) largely resulted from increased expression of matrix metalloproteases, including Mmp2, Mmp7, Mmp9, Mmp10, and Mmp13. Notably, Mmp10 and Mmp13 also showed dose-dependent increases in expression at day 91. These genes are known to be involved in tissue remodeling, cell migration, immune cell recruitment, and angiogenesis (Klein and Bischoff, 2011), representing functions that can overlap with carcinogenesis. Matrix metalloproteases also show increased expression in the intestine linked to tissue remodeling in gluten enteropathy (ie, celiac disease) (Ciccocioppo et al., 2005; Salmela et al., 2001), representing an intestinal disease state that shares some common histopathological phenotypes with Cr(VI) (eg, villus atrophy and crypt hyperplasia). It is notable that other enriched pathways that were not annotated to the larger “cancer” signaling pathway (through IPA) could be argued to play a role in carcinogenesis. However, only pathways annotated to “cancer” through the IPA knowledgebase were included in this category to maintain objectivity and reproducibility (although all results are detailed in Supplemental Table 6).

Figure 2.

Figure 2

Apoptosis and p53 signaling related to Cr(VI) exposure. Molecules altered by in vitro exposure to Cr(VI), as identified through HTS Tox21 data and CTD, are enriched for (A) apoptosis signaling and (C) p53 signaling. Genes showing dose-dependent changes in expression after 90 days of exposure to Cr(VI) in the mouse duodenum are enriched for (B) apoptosis signaling but not (D) p53 signaling. No genes relevant to p53/DNA damage signaling within the canonical apoptosis pathway showed altered expression in vivo, as marked by the red asterisks. Note that pathways associated with 7 days of exposure to Cr(VI) in the mouse duodenum are not displayed, as there was no enrichment for apoptosis or p53 signaling in these tissues.

Comparison of In Vitro versus In Vivo Pathways and Upstream Regulators Associated With Cr(VI)

Comparing the in vitro versus in vivo pathway-level responses to Cr(VI) indicates that both experimental models exhibited signaling related to cell death and cell proliferation (Supplementary Table 2). However, despite the use of a p < 0.05 pathway enrichment filter (representing a less stringent filter than a multiple test corrected p-value), pathway changes related to p53/DNA damage were evident in vitro but not in vivo. This was specifically evidenced by the canonical apoptosis pathway including changes relevant to p53/DNA damage in vitro, but not in vivo (Figure 2A and 2B). Furthermore, the canonical p53 signaling pathway showed enrichment in vitro but not in vivo (Figure 2C and 2D). It is worth emphasizing that this lack of p53 signaling was observed across a wide range of in vivo exposure levels (non-responsive, non-carcinogenic, and carcinogenic concentration) and durations (7 and 90 days of exposure).

Other canonical pathways relevant to DNA damage that were associated with only in vitro responses included ATM signaling, cell cycle: G2/M DNA damage checkpoint regulation, DNA damage-induced 14-3-3sigma signaling, DNA double-strand break repair by homologous recombination, DNA double-strand break repair by non-homologous end joining, mismatch repair in eukaryotes, and role of BRCA1 in DNA damage response (Supplementary Table 2). A canonical pathway enriched at day 8 was relevant to DNA damage in vivo, the nucleotide excision repair pathway (Table 4, Supplementary Table 2). This pathway consisted of eight genes showing increased expression associated with Cr(VI), all of which are also involved in general DNA transcription and cell cycle signaling: cyclin H (Ccnh), general transcription factor genes (Gtf2h1 and Gtf2h3), RNA polymerase II genes (Polr2e, Polr2f, Polr2h, Polr2l), and replication protein A3 (Rpa3). The increased expression levels of these genes at day 8 is therefore consistent with the finding that proliferative responses and tissue remodeling is likely occurring in these tissues.

As TP53 alterations often occur post-translationally (Levine et al., 2006), it was important to also consider the potential for TP53 changes resulting from Cr(VI) exposure at the protein level through transcription factor enrichment analysis. This upstream regulator prediction analysis provided further evidence supporting TP53 as a likely transcriptional regulator of in vitro responses (activation Z-score = 4.51, p = 3.92 × 10−78 for molecules identified by at least one study in CTD). However, TP53 was not within the list of ∼250 molecules predicted to potentially regulate in vivo responses to Cr(VI) (Supplementary Table 7). These findings further support the lack of involvement of TP53 in intestinal cancer resulting from Cr(VI) oral exposure in mice.

DISCUSSION

This study informs the MOA underlying intestinal tumors induced by Cr(VI) in mice through the evaluation of HTS data, a large database of published in vitro responses to Cr(VI) (ie, CTD), and toxicogenomics data from the intestine of mice exposed to Cr(VI). HTS data from the Tox21 consortium were determined to be generally consistent with in vitro Cr(VI) data in the open literature, accumulated through CTD, exemplifying the utility of publicly available HTS data in identifying in vitro responses to chemicals. Analysis of these data showed that in vitro Cr(VI) exposure was associated with alterations in p53 signaling and cell death/proliferation signaling. In vivo transcriptomic data for Cr(VI), in contrast, were associated with changes in cell death/proliferation, but not p53 signaling, in the small intestine. Consistent with earlier analyses of transcriptomic responses in the duodenum (Kopec et al., 2012a,b), this updated analysis supports a non-mutagenic MOA for Cr(VI)-induced intestinal cancer. These in vivo transcriptomic analyses are consistent with phenotypic anchoring: histopathological evidence of regenerative hyperplasia, lack of in vivo genotoxicity, and relatively late onset of tumor formation.

Analyses from the present study found that transcriptomic responses in the mouse intestine showed enrichment for pathways related to increased cell stress and injury, paralleling phenotypic observations of intestinal villus atrophy and blunting in exposed mice (Cullen et al., 2016). Gene expression profiles were generally decreased for pathways involved in apoptosis and increased for pathways related to cell growth, proliferation, and development. These findings are supported by histopathology indicating increased crypt length in exposed mice (Thompson et al., 2015a,b). Cancer signaling was also associated with the in vivo transcriptomic responses at day 8 and 91; however, exposed mice did not exhibit tumors until after at least one year of exposure to ≥30 ppm Cr(V) in drinking water (NTP, 2008). Increased cancer-related signaling at day 8 largely reflected increased expression of matrix metalloproteases, which are involved in functions that can overlap with carcinogenesis, including tissue remodeling, cell migration, immune cell recruitment, and angiogenesis (Klein and Bischoff, 2011). Specifically in the intestine, matrix metalloproteases have shown increased expression related to tissue remodeling in cases of gluten enteropathy (ie, celiac disease) (Ciccocioppo et al., 2005; Salmela et al., 2001), an intestinal disease with histopathological changes in common with Cr(VI) (eg, villus atrophy and crypt hyperplasia). These pathway changes are relevant to key events involved in Cr(VI) MOA and were estimated to start at median benchmark concentrations of 19 mg/l SDD [equivalent to 7 ppm Cr(VI)] after 7 days of exposure and 29 mg/l [equivalent to 11 ppm Cr(VI)] SDD after 90 days of exposure. To provide context for the BMD estimates, the average concentration of Cr(VI) in U.S. drinking water is ∼0.001 ppm, and the 95th upper percentile is 0.0034 ppm (U.S. EPA, 2014).

Recent examples of HTS applications in chemical assessments have involved the use of in vitro HTS data to prioritize chemical(s) for further toxicological evaluation (Auerbach et al., 2016; Rotroff et al., 2014). Some prioritization efforts have also considered the potential for human exposure, and thus show further applicability to the field of risk assessment (Rager et al., 2016; Wambaugh et al. 2014; Wetmore et al., 2015). Fewer examples are currently available showing HTS data interpretation in the context of regulatory decision making. Recent cancer monographs published by the International Agency for Research on Cancer (IARC) represent examples of how HTS data could potentially contribute to the understanding of chemical mechanisms involved in human carcinogenicity, with specific emphasis on the TKCCs (IARC, 2015). Previous in vivo cancer prediction models using ToxCast HTS data have, however, shown limited predictability (Anthony et al., 2016; Thomas et al., 2012a), and it is therefore important to consider potential ranges of applicability and limitations of in vitro HTS data interpretation.

The current study expanded on the application of HTS strategies by first organizing Tox21 data according to the TKCCs, and identifying KCCs that may be involved in mechanistic events linking Cr(VI) exposure to cancer. This method resulted in the identification of two KCCs, genotoxic (KCC#2) and alter cell proliferation, cell death and nutrient supply (KCC#10), that might have been prioritized for further evaluation in the context of Cr(VI) MOA. These two categories of molecular responses also represent key events under consideration in earlier MOA discussions for Cr(VI) (McCarroll et al., 2010; Thompson et al., 2011). The research described herein revealed evidence primarily for KCC#10, consistent with a more recently proposed MOA for Cr(VI) (Thompson et al., 2013), as well as risk assessments based on these data (Haney, 2015; Health Canada, 2015; TCEQ, 2016). This retrospective case study therefore demonstrates the potential utility of HTS data in prioritizing key events for further evaluation in chemical MOA, which in turn, after additional research, may impact chemical safety criteria and regulatory decision making.

A potential limitation in using HTS data to inform Cr(VI) MOA was evident after finding that in vitro responses were not entirely consistent with in vivo responses in the mouse small intestine, a target tissue of Cr(VI) carcinogenesis. Specifically, analysis of Tox21 data identified four active assay endpoints for Cr(VI) in human intestinal cells relevant to p53 transcriptional activation, which were mapped to genotoxic (KCC#2). Other in vitro studies identified through CTD corroborate the finding that p53 pathway alterations occur in response to in vitro exposure to Cr(VI), as evidenced through pathway-level and upstream regulator prediction analyses. However, analysis of in vivo transcriptomic responses in the mouse duodenum showed a clear lack of p53 pathway alterations and potential TP53 upstream regulator activity.

There are several potential explanations for the differences between in vitro and in vivo responses to Cr(VI). For instance, the Tox21 HTS assays evaluating TP53 activation used human intestinal cancer cells, whereas the in vivo responses evaluated here were from mouse intestinal non-cancerous tissue. While both model systems directly absorbed Cr(VI), and both model systems contain cells that can express and activate TP53, there could be differences in responses dependent upon species as well as the cellular disease state (normal vs transformed). Regarding cell state, it is important to realize that in vitro HTS methods (acute by nature) are intended to screen for potential adverse effects and thus should serve as proxies for normal human tissues. As such, the toxicity comparisons herein between non-cancerous in vivo tissue and in vitro Tox21 models ought to be valid if the in vitro models are to have predictive value. In support of these comparisons, specifically regarding TP53, both cancer and non-cancer cells have been shown to undergo in vitro Cr(VI)-associated DNA damage and eventual apoptosis dependent upon p53 activation and its upregulation of downstream targets (Russo et al., 2005). Therefore, the finding that Cr(VI) altered p53/DNA damage response signaling in vitro (with Tox21 data from cancer cells and CTD data from cancer and non-cancer cells) but not in vivo (with non-cancer cells) is informative towards HTS data interpretation in the context of in vivo MOA.

Other explanations for the differences between in vitro versus in vivo responses include Cr(VI) kinetics, cell cycle, exposure durations (acute versus chronic), components within the media/surrounding fluid, and intracellular reductants. Regarding cell cycle, in vitro exposure systems typically evaluate effects in proliferating cells. In the mouse model, Cr(VI) was absorbed by mature, non-dividing cells in the intestinal villus (Thompson et al., 2015a,b). Regarding reduction kinetics, the intracellular ascorbate levels available to reduce Cr(VI) to Cr(III) may differ in vitro versus in vivo. In vitro responses to Cr(VI) differ depending on whether low cellular ascorbate levels are “restored” to in vivo levels (Luczak et al., 2016). Unrestored cells treated with Cr(VI) exhibit significant ATM activation possibly through glutathione (GSH)-mediated Cr(VI) reduction, whereas restored cells rely more on ascorbate-mediated reduction of Cr(VI) which does not appear to activate ATM (Luczak et al., 2016). Considering that rodents synthesize ascorbate, and that GSH levels and GSH synthesis pathways have been shown to be upregulated in the duodenum of mice treated with Cr(VI) for 90 days (Kopec et al., 2012a; Thompson et al., 2011), both reduction pathways are likely active in the mouse. Importantly, p53 activity is upregulated in vitro in both Asc-restored and non-restored cells after Cr(VI) exposure (Luczak et al., 2016), which does not appear to occur in vivo in the duodenum based on the analyses herein. Moreover, the ATM signaling pathway was identified as altered through the in vitro analysis but not within the in vivo transcriptomic responses. These aforementioned differences not only potentially explain the differential outcomes between in vitro and in vivo data, but are highly relevant for risk assessment, as the in vivo model more closely recapitulates human dosimetry and intestinal tissue structure and can thus inform MOA to a greater extent than HTS-based toxicity predictions alone.

In conclusion, this study provides an analysis of HTS and genomics-based data on a compound that is of high interest from the regulatory perspective. Emerging methods were used to evaluate the HTS data, including mapping of assays to TKCCs, incorporation of potential cytotoxicity interference, and comparison to other publicly available in vitro data to support findings. Comparing in vitro responses to in vivo transcriptomic responses, similarities were identified between cell death/proliferation alterations occurring in response to Cr(VI). Differences in p53/DNA damage signaling pathway alterations were apparent, with p53 pathway changes occurring in vitro but not in vivo. This example therefore demonstrates both the potential strengths and limitations of HTS data. Here, we retrospectively demonstrated that HTS data could be used to identify potential key events in chemical MOA that may be prioritized for further evaluation. Still, findings show that target tissue in vivo data remain a critical component for establishing the MOA for specific chemical-induced tumor outcomes. Future studies comparing in vitro versus in vivo responses induced by other chemicals with differing physicochemical properties and target tissues will further inform potential ranges of applicability for the utility of HTS in predictive toxicology.

SUPPLEMENTARY DATA

Supplementary data are available at Toxicological Sciences online.

FUNDING

The Hexavalent Chromium Panel of the American Chemistry Council.

Supplementary Material

Supplementary Data

ACKNOWLEDGMENTS

The authors acknowledge Drs. Anna Kopec and Timothy Zacharewski for their original contributions to this study, including tissue processing, microarray hybridization and scanning. The authors also acknowledge Paige Bommarito for her contributions to the transcriptomics data analyses.

Footnotes

1

PBPK models for Cr(VI) are available; however, the dose metric for flux of Cr(VI) through intestinal enterocytes into portal blood is not comparable to in vitro cell systems and thus the PBPK model was not employed.

REFERENCES

  1. Anthony TCL., Popken D. A., Kaplan A. M., Plunkett L. M., Becker R. A. (2016). How well can in vitro data predict in vivo effects of chemicals? Rodent carcinogenicity as a case study. Regul. Toxicol. Pharmacol. 77, 54–64. [DOI] [PubMed] [Google Scholar]
  2. Auerbach S., Filer D., Reif D., Walker V., Holloway A. C., Schlezinger J., Srinivasan S., Svoboda D., Judson R., Bucher J. R., et al. (2016). Prioritizing environmental chemicals for obesity and diabetes outcomes research: A screening approach using ToxCast high throughput data. Environ. Health Perspect. 124, 1141–1154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bartman C. M., Egelston J., Kattula S., Zeidner L. C., D'Ippolito A., Doble B. W., Phiel C. J. (2014). Gene expression profiling in mouse embryonic stem cells reveals glycogen synthase kinase-3-dependent targets of phosphatidylinositol 3-kinase and Wnt/beta-catenin signaling pathways. Front. Endocrinol. (Lausanne) 5, 133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bourdon-Lacombe J. A., Moffat I. D., Deveau M., Husain M., Auerbach S., Krewski D., Thomas R. S., Bushel P. R., Williams A., Yauk C. L. (2015). Technical guide for applications of gene expression profiling in human health risk assessment of environmental chemicals. Regul. Toxicol. Pharmacol. 72, 292–309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Ciccocioppo R., Di Sabatino A., Bauer M., Della Riccia D. N., Bizzini F., Biagi F., Cifone M. G., Corazza G. R., Schuppan D. (2005). Matrix metalloproteinase pattern in celiac duodenal mucosa. Lab. Invest. 85, 397–407. [DOI] [PubMed] [Google Scholar]
  6. Comparative Toxicogenomics Database (CTD). (2016). MDI Biological Laboratory and NC State University. Available at: http://ctdbase.org/. Accessed July 21, 2016.
  7. Cullen J. M., Ward J. M., Thompson C. M. (2016). Reevaluation and classification of duodenal lesions in B6C3F1 mice and F344 rats from 4 studies of hexavalent chromium in drinking water. Toxicol. Pathol. 44, 279–289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Davis A. P., Grondin C. J., Lennon-Hopkins K., Saraceni-Richards C., Sciaky D., King B. L., Wiegers T. C., Mattingly C. J. (2015). The Comparative Toxicogenomics Database's 10th year anniversary: Update 2015. Nucleic Acids Res. 43, D914–D920. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Edgar R., Domrachev M., Lash A. E. (2002). Gene Expression Omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res. 30, 207–210. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Fare T. L., Coffey E. M., Dai H., He Y. D., Kessler D. A., Kilian K. A., Koch J. E., LeProust E., Marton M. J., Meyer M. R. (2003). Effects of atmospheric ozone on microarray data quality. Anal Chem. 75(17), 4672–4675. [DOI] [PubMed] [Google Scholar]
  11. Farmahin R., Williams A., Kuo B., Chepelev N. L., Thomas R. S., Barton-Maclaren T. S., Curran I. H., Nong A., Wade M. G., Yauk C. L. (2016). Recommended approaches in the application of toxicogenomics to derive points of departure for chemical risk assessment. Arch. Toxicol. 91, 2045–2065. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Fry R. C. (2015). Systems Biology in Toxicology and Environmental Health. New York: Academic Press. [Google Scholar]
  13. Haney J., Jr. (2015). Consideration of non-linear, non-threshold and threshold approaches for assessing the carcinogenicity of oral exposure to hexavalent chromium. Regul. Toxicol. Pharmacol. 73, 834–852. [DOI] [PubMed] [Google Scholar]
  14. Health Canada. (2015). Chromium in Drinking Water: Document for Public Consultation. Federal-Provincial-Territorial Committee on Drinking Water. Available at: http://www.healthycanadians.gc.ca/health-system-systeme-sante/consultations/chromium-chrome/document-eng.php. Accessed March 29, 2017.
  15. IARC. (1990). Chromium, nickel and welding. IARC Monogr. Eval. Carcinog. Risks Hum. 49, 1–648. [PMC free article] [PubMed] [Google Scholar]
  16. IARC. (2015). Volume 112. Some Organophosphate Insecticides and Herbicides: Diazinon, Glyphosate, Malathion, Parathion, and Tetrachlorvinphos. Annex 1. Supplementary Material to Volume 112. Available at: http://monographs.iarc.fr/ENG/Monographs/Vol15801/index.php. Accessed May 23, 2016.
  17. Jackson A. F., Williams A., Recio L., Waters M. D., Lambert I. B., Yauk C. L. (2014). Case study on the utility of hepatic global gene expression profiling in the risk assessment of the carcinogen furan. Toxicol. Appl. Pharmacol. 274, 63–77. [DOI] [PubMed] [Google Scholar]
  18. Judson R., Houck K., Martin M., Richard A. M., Knudsen T. B., Shah I., Little S., Wambaugh J., Woodrow Setzer R., Kothya P., et al. (2016). Analysis of the effects of cell stress and cytotoxicity on in vitro assay activity across a diverse chemical and assay space. Toxicol. Sci. 153, 409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Judson R. S., Magpantay F. M., Chickarmane V., Haskell C., Tania N., Taylor J., Xia M., Huang R., Rotroff D. M., Filer D. L., et al. (2015). Integrated model of chemical perturbations of a biological pathway using 18 in vitro high-throughput screening assays for the estrogen receptor. Toxicol. Sci. 148, 137–154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Klein T., Bischoff R. (2011). Physiology and pathophysiology of matrix metalloproteases. Amino Acids 41, 271–290. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Kopec A. K., Kim S., Forgacs A. L., Zacharewski T. R., Proctor D. M., Harris M. A., Haws L. C., Thompson C. M. (2012a). Genome-wide gene expression effects in B6C3F1 mouse intestinal epithelia following 7 and 90days of exposure to hexavalent chromium in drinking water. Toxicol. Appl. Pharmacol. 259,13–26. [DOI] [PubMed] [Google Scholar]
  22. Kopec A. K., Thompson C. M., Kim S., Forgacs A. L., Zacharewski T. R. (2012b). Comparative toxicogenomic analysis of oral Cr(VI) exposure effects in rat and mouse small intestinal epithelia. Toxicol. Appl. Pharmacol. 262, 124–138. [DOI] [PubMed] [Google Scholar]
  23. Kramer A., Green J., Pollard J. Jr, Tugendreich S. (2014). Causal analysis approaches in ingenuity pathway analysis. Bioinformatics 30, 523–530. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Levine A. J., Feng Z., Mak T. W., You H., Jin S. (2006). Coordination and communication between the p53 and IGF-1-AKT-TOR signal transduction pathways. Genes Dev. 20, 267–275. [DOI] [PubMed] [Google Scholar]
  25. Luczak M. W., Green S. E., Zhitkovich A. (2016). Different ATM signaling in response to chromium(VI) metabolism via ascorbate and nonascorbate reduction: Implications for in vitro models and toxicogenomics. Environ. Health Perspect. 124, 61–66. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. McCarroll N., Keshava N., Chen J., Akerman G., Kligerman A., Rinde E. (2010). An evaluation of the mode of action framework for mutagenic carcinogens case study II: Chromium (VI). Environ. Mol. Mutagen. 51, 89–111. [DOI] [PubMed] [Google Scholar]
  27. Moffat I., Chepelev N. L., Labib S., Bourdon-Lacombe J., Kuo B., Buick J. K., Lemieux F., Williams A., Halappanavar S., Malik A. I., et al. (2015). Comparison of toxicogenomics and traditional approaches to inform mode of action and points of departure in human health risk assessment of benzo[a]pyrene in drinking water. Crit. Rev. Toxicol. 45, 1–43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. NCBI. (2016). PubMed (National Center for Biotechnology Information). Available at: http://www.ncbi.nlm.nih.gov/pubmed. Accessed July 22, 2016.
  29. NRC. (2007). Toxicity Testing in the 21st Century: A Vision and A Strategy. Washington, DC: National Research Council.
  30. NTP. (2007). National Toxicology Program technical report on the toxicity studies of sodium dichromate dihydrate (CAS No. 7789-12-0) administered in drinking water to male and female F344/N rats and B6C3F1 mice and male BALB/c and am3-C57BL/6 mice. NTP Toxicity Report Series Number 72, NIH Publication No. 07-5964.
  31. NTP. (2008). National Toxicology Program technical report on the toxicology and carcinogenesis studies of sodium dichromate dihydrate (CAS No. 7789-12-0) in F344/N rats and B6C3F1 mice (drinking water studies), NTP Toxicity Report Series Number 546. NIH Publication No. 08-5887. [PubMed]
  32. O'Brien T. J., Ding H., Suh M., Thompson C. M., Parsons B. L., Harris M. A., Winkelman W. A., Wolf J. C., Hixon J. G., Schwartz A. M., et al. (2013). Assessment of K-Ras mutant frequency and micronucleus incidence in the mouse duodenum following 90-days of exposure to Cr(VI) in drinking water. Mutat. Res. 754, 15–21. [DOI] [PubMed] [Google Scholar]
  33. OEHHA. (2011). Public Health Goal for Hexavalent Chromium (Cr VI) in Drinking Water. Sacramento, CA: Pesticide and Environmental Toxicology Branch, Office of Environmental Health Hazard Assessment, California Environmental Protection Agency.
  34. Rager J. E., Moeller B. C., Miller S. K., Kracko D., Doyle-Eisele M., Swenberg J. A., Fry R. C. (2014). Formaldehyde-associated changes in microRNAs: Tissue and temporal specificity in the rat nose, white blood cells, and bone marrow. Toxicol. Sci. 138, 36–46. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Rager J. E., Strynar M. J., Liang S., McMahen R. L., Richard A. M., Grulke C. M., Wambaugh J. F., Isaacs K. K., Judson R., Williams A. J., et al. (2016). Linking high resolution mass spectrometry data with exposure and toxicity forecasts to advance high-throughput environmental monitoring. Environ. Int. 88, 269–280. [DOI] [PubMed] [Google Scholar]
  36. Richard A. M., Judson R. S., Houck K. A., Grulke C. M., Volarath P., Thillainadarajah I., Yang C., Rathman J., Martin M. T., Wambaugh J. F., et al. (2016). ToxCast chemical landscape: Paving the road to 21st century toxicology. Chem. Res. Toxicol. 29, 1225–1251. [DOI] [PubMed] [Google Scholar]
  37. Rotroff D. M., Martin M. T., Dix D. J., Filer D. L., Houck K. A., Knudsen T. B., Sipes N. S., Reif D. M., Xia M., Huang R., et al. (2014). Predictive endocrine testing in the 21st century using in vitro assays of estrogen receptor signaling responses. Environ. Sci. Technol. 48, 8706–8716. [DOI] [PubMed] [Google Scholar]
  38. Russo P., Catassi A., Cesario A., Imperatori A., Rotolo N., Fini M., Granone P., Dominioni L. (2005). Molecular mechanisms of hexavalent chromium-induced apoptosis in human bronchoalveolar cells. Am. J. Respir. Cell Mol. Biol. 33, 589–600. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Salmela M. T., Pender S. L., Reunala T., MacDonald T., Saarialho-Kere U. (2001). Parallel expression of macrophage metalloelastase (MMP-12) in duodenal and skin lesions of patients with dermatitis herpetiformis. Gut 48, 496–502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Smith M. T., Guyton K. Z., Gibbons C. F., Fritz J. M., Portier C. J., Rusyn I., DeMarini D. M., Caldwell J. C., Kavlock R. J., Lambert P. F., et al. (2016). Key characteristics of carcinogens as a basis for organizing data on mechanisms of carcinogenesis. Environ. Health Perspect. 124, 713–721. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Storey J. D. (2003). The positive false discovery rate: A Bayesian interpretation and the q-value. Ann. Stat. 31, 2013–2035. [Google Scholar]
  42. TCEQ. (2016). Hexavalent Chromium Oral Reference Dose. Development Support Document Proposed. CAS Registry Number: 18540-29-9. Austin, TX: TCEQ.
  43. Thomas R. S., Black M. B., Li L., Healy E., Chu T. M., Bao W., Andersen M. E., Wolfinger R. D. (2012a). A comprehensive statistical analysis of predicting in vivo hazard using high-throughput in vitro screening. Toxicol. Sci. 128, 398–417. [DOI] [PubMed] [Google Scholar]
  44. Thomas R. S., Clewell H. J. 3rd, Allen B. C., Yang L., Healy E., Andersen M. E. (2012b). Integrating pathway-based transcriptomic data into quantitative chemical risk assessment: A five chemical case study. Mutat. Res. 746, 135–143. [DOI] [PubMed] [Google Scholar]
  45. Thompson C. M., Proctor D. M., Haws L. C., Hebert C. D., Grimes S. D., Shertzer H. G., Kopec A. K., Hixon J. G., Zacharewski T. R., Harris M. A. (2011). Investigation of the mode of action underlying the tumorigenic response induced in B6C3F1 mice exposed orally to hexavalent chromium. Toxicol. Sci. 123, 58–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Thompson C. M., Proctor D. M., Suh M., Haws L. C., Hebert C. D., Mann J. F., Shertzer H. G., Hixon J. G., Harris M. A. (2012). Comparison of the effects of hexavalent chromium in the alimentary canal of F344 rats and B6C3F1 mice following exposure in drinking water: Implications for carcinogenic modes of action. Toxicol. Sci. 125, 79–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Thompson C. M., Proctor D. M., Suh M., Haws L. C., Kirman C. R., Harris M. A. (2013). Assessment of the mode of action underlying development of rodent small intestinal tumors following oral exposure to hexavalent chromium and relevance to humans. Crit. Rev. Toxicol. 43, 244–274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Thompson C. M., Rager J. E., Suh M., Ring C. L., Proctor D. M., Haws L. C., Fry R. C., Harris M. A. (2016). Transcriptomic responses in the oral cavity of F344 rats and B6C3F1 mice following exposure to Cr(VI): Implications for risk assessment. Environ. Mol. Mutagen. 57, 706–716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Thompson C. M., Seiter J., Chappell M. A., Tappero R. V., Proctor D. M., Suh M., Wolf J. C., Haws L. C., Vitale R., Mittal L., et al. (2015a). Synchrotron-based imaging of chromium and gamma-H2AX immunostaining in the duodenum following repeated exposure to Cr(VI) in drinking water. Toxicol. Sci. 143, 16–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Thompson C. M., Wolf J. C., Elbekai R. H., Paranjpe M. G., Seiter J. M., Chappell M. A., Tappero R. V., Suh M., Proctor D. M., Bichteler A., et al. (2015b). Duodenal crypt health following exposure to Cr(VI): Micronucleus scoring, gamma-H2AX immunostaining, and synchrotron X-ray fluorescence microscopy. Mutat. Res. Genet. Toxicol. Environ. Mutagen. 789–790, 61–66. [DOI] [PubMed] [Google Scholar]
  51. Thompson C. M., Young R. R., Suh M., Dinesdurage H. R., Elbekai R. H., Harris M. A., Rohr A. C., Proctor D. M. (2015c). Assessment of the mutagenic potential of Cr(VI) in the oral mucosa of Big Blue® transgenic F344 rats. Environ. Mol. Mutagen. 56, 621–628. [DOI] [PubMed] [Google Scholar]
  52. U.S. EPA. (2010). Toxicological review of hexavalent chromium in support of summary information on the integrated risk information system (IRIS). External Review DRAFT. Washington, DC: U.S. Environmental Protection Agency.
  53. U.S. EPA (2014). The Third Unregulated Contaminant Monitoring Rule (UCMR3): Occurrence Data. Washington, DC: U.S. Environmental Protection Agency.
  54. U.S. EPA (2015). ToxCast & Tox21 Summary Files from invitrodb_v2. Available at: https://www.epa.gov/chemical-research/toxicity-forecaster-toxcasttm-data. Accessed November 2015.
  55. Wambaugh J. F., Wang A., Dionisio K. L., Frame A., Egeghy P., Judson R., Setzer R. W. (2014). High throughput heuristics for prioritizing human exposure to environmental chemicals. Environ Sci Technol. 48(21), 12760–12767. [DOI] [PubMed] [Google Scholar]
  56. Wetmore B. A., Wambaugh J. F., Allen B., Ferguson S. S., Sochaski M. A., Setzer R. W., Houck K. A., Strope C. L., Cantwell K., Judson R. S., et al. (2015). Incorporating high-throughput exposure predictions with dosimetry-adjusted in vitro bioactivity to inform chemical toxicity testing. Toxicol. Sci. 148, 121–136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Yang L., Allen B. C., Thomas R. S. (2007). BMDExpress: A software tool for the benchmark dose analyses of genomic data. BMC Genomics 8, 387.. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Data

Articles from Toxicological Sciences are provided here courtesy of Oxford University Press

RESOURCES