Abstract
The primary aim of this study was to determine the degree to which a multivariable principal component model based on several potentially carcinogenic metals and pesticides could explain the county‐level pediatric cancer rates across Idaho. We contend that human exposure to environmental contaminants is one of the reasons for increased pediatric cancer incidence in the United States. Although several studies have been conducted to determine the relationship between environmental contaminants and carcinogenesis among children, research gaps exist in developing a meaningful association between them. For this study, pediatric cancer data was provided by the Cancer Data Registry of Idaho, concentrations of metals and metalloids in groundwater were collected from the Idaho Department of Water Resources, and pesticide use data were collected from the United States Geological Survey. Most environmental variables were significantly intercorrelated at an adjusted P‐value <0.01 (97 out of 153 comparisons). Hence, a principal component analysis was employed to summarize those variables to a smaller number of components. An environmental burden index (EBI) was constructed using these principal components, which categorized the environmental burden profiles of counties into low, medium, and high. EBI was significantly associated with pediatric cancer incidence (P‐value <0.05). The rate ratio of high EBI profile to low EBI profile for pediatric cancer incidence was estimated as 1.196, with lower and upper confidence intervals of 1.061 and 1.348, respectively. A model was also developed in the study using EBI to estimate the county‐level pediatric cancer incidence in Idaho (Nash‐Sutcliffe Efficiency = 0.97).
Keywords: pediatric cancer, environmental burden index, pesticides, multivariable statistical analysis, principal component analysis
Key Points
This study analyzed the relationships of pediatric cancer rates to an aggregate of several potentially carcinogenic metals and pesticides
An environmental burden index (EBI) was constructed and categorized the environmental profiles of counties in Idaho as low, medium, and high
A statistical model was developed using the EBI to estimate pediatric cancer incidence in Idaho
1. Introduction
Several studies have analyzed the geospatial distribution of pediatric cancer globally (Corley et al., 2018; Farazi et al., 2018; Goujon et al., 2018; Lawson & Rotejanaprasert, 2014; Ramis et al., 2015; Thompson et al., 2007; Wheeler, 2007) and its potential associations to several environmental agents (Filippini et al., 2019; Konstantinoudis et al., 2020; Little et al., 2018; Wakeford, 2013; Zachek et al., 2015). For instance, geospatial studies on pediatric cancer have been undertaken in the U.S (Siegel et al., 2018), pediatric leukemia in Ohio (Wheeler, 2007), pediatric leukemia and Hodgkin lymphoma in Texas (Thompson et al., 2007), childhood brain cancer in Florida (Lawson & Rotejanaprasert, 2014). On the other hand, studies focused on associations between pediatric cancer and environmental agents do not model how multiple potential cancer initiators may act together (Moretto et al., 2017). Rather than focusing on an individual contaminant and its relationship to pediatric cancer, there is a need to shift towards the cumulative assessment of contaminants for addressing the combined exposure to multiple chemicals (Evans et al., 2019; Meek et al., 2011; Moretto et al., 2017; NRC, 2009; SCHER, 2013; Sexton, 2015).
While using a multivariable approach, statistical techniques, such as principal component analysis (PCA), may explain the association between the cancer data and multiple environmental agents. For instance, Lobdell et al. (2014) used PCA to analyze the cumulative impact of many environmental agents and identified that PCA is an effective tool to summarize the environmental quality variables to assess the relationship to adverse health outcomes. However, to our knowledge, there are no studies that used PCA to explain the association of environmental agents to pediatric cancer. On the other hand, previous studies have used PCA to study several factors associated with cancer. These include: (a) modeling risk‐based biomarkers (Shigemizu et al., 2019), (b) gene expression profiling (D.‐T. Chen et al., 2011; Hsu et al., 2014; Pomeroy et al., 2002; Price et al., 2006), (c) reducing data dimensionality when classifying patients with tumors into several sub‐groups (Khan et al., 2001), (d) diagnosing tissue samples as normal or neoplastic based on diffuse reflectance spectra (Skala et al., 2007), (e) reducing multiple biomarkers to generate a new optimized biomarker panel for lung cancer detection (Flores‐Fernández et al., 2012), and (f) comparing the metabolic profiles from human rectal cancer biopsies and colorectal xenografts (Seierstad et al., 2008). However, while the approach has proven successful in the studies listed above, PCA to model cancer incidence in conjunction with multiple environmental agents has yet to be performed.
The associations between pesticides and pediatric cancer have received considerable attention in the past (M. Chen et al., 2015; Daniels et al., 1997; Hernández & Menéndez, 2016; LaFiura et al., 2007; Leiss & Savitz, 1995; Pogoda & Preston‐Martin, 1997; Van Maele‐Fabry et al., 2017; Wigle et al., 2008; Zahm & Ward, 1998). For instance, studies have identified associations between parental, prenatal, and childhood exposures to pesticides and pediatric leukemia in residential and occupational settings (Reynolds et al., 2003; Scélo et al., 2009; Steffen et al., 2004; Vinceti et al., 2012). Supporting this, global‐scale studies have explored the association between environmental agents such as pesticides and pediatric cancer and have identified that acute myeloid leukemia was associated with paternal exposure to herbicides and insecticides (Patel et al., 2020). Similarly, maternal exposure to herbicides such as diuron and propanil, along with exposure to insecticides such as phosmet, were found to have a close association with an elevated risk for leukemia (Park et al., 2020). In addition, the Park et al. (2020) study implicated 2,6‐dinitroanilines and anilides relative to elevated risk. Furthermore, M. Chen et al. (2015) identified a significant association of insecticides to childhood leukemia and lymphoma and an association between herbicides and childhood leukemia.
Additionally, several studies have identified a significant association between metals and pediatric cancer incidence, including the associations between arsenic and pediatric cancer incidence (Abernathy et al., 2003; Heck et al., 2014; Hong et al., 2014), cadmium and pediatric cancer (Sherief et al., 2015), and chromium and pediatric cancer (Beaumont et al., 2008; Halasova et al., 2009; Yang & Massey, 2019; Zhitkovich, 2011). Relative to drinking water, Drozd et al. (2015) identified significant relationships between childhood thyroid cancer and the nitrates in drinking water. Barrett et al. (1998) also identified a similar relationship between pediatric brain cancer and nitrates. However, there were no supportive studies to confirm the claim.
The study's objective was to determine the degree to which a multivariable principal component model based on several potentially carcinogenic metals and pesticides explains county‐level rates of pediatric cancer in Idaho. Although the pediatric cancer incidence in Idaho has increased at a rate of 0.6% per year from 1975 to 2018 (Johnson et al., 2020), few studies have focused on environmental carcinogens in the state and their association with pediatric cancer incidence. The current study compiled pediatric cancer data from the Cancer Data Registry of Idaho and compared cancer incidence rates to concentrations of metals in groundwater and the mass of specific pesticides used across the state on a county basis.
2. Materials and Methods
2.1. Pediatric Cancer Data
Pediatric cancer data was provided under a data‐sharing agreement with the Cancer Data Registry of Idaho for age at diagnosis 0–4 years, 5–9 years, 10–14 years, and 15–19 years for the period 1990–2015 at county resolution. The pediatric cancer incidence by county was estimated using Equation 1, after summing up all the pediatric cancer cases from 1990 to 2015. The county population was calculated by summing up the pediatric population using the census data from 1990 to 2015 (Census‐Bureau, 2020).
| (1) |
The age stratum‐specific pediatric cancer incidence was also estimated for ages 0–4, 5–9, 10–14, and 15–19 ages using Equation 1, and its spatial distribution is shown in Figure 1. A visual inspection of the maps suggests that the incidence is highest within the 0–4 age stratum, followed by 15–19, 10–14, and 5–9 age strata, respectively. The pediatric cancer incidence also varies spatially, with counties in the southwestern, southeastern, and northwestern regions of Idaho having higher incidence rates compared to other counties.
Figure 1.

Age‐stratum specific pediatric cancer incidence rate for (a) 0–4 years, (b) 5–9 years, (c) 10–14 years, and (d) 15–19 years.
2.2. Environmental Data
The environmental datasets considered for use in this study included 198 groundwater quality variables (mg/L) from 3,548 well locations, sampled between 1990 and 2015, as collected by the Idaho Department of Water Resources (IDWR). Data from each wellhead location were averaged across the entire 25‐year period. The groundwater well locations are shown in Figure 2a. The groundwater variables were then mapped to county resolution. Since the data were not continuous and there were gaps in data acquisition, a data filtering process was adopted to remove the data with significant gaps. For instance, information on cobalt was only available for the years 2001–2005; consequently, it was not included in any further statistical analysis. Among the 198 groundwater quality variables, only 30 had continuous datasets with measurement for each year for at least one county in Idaho. Those 30 datasets, as listed in Table 1, are selected for the next step (Section 2.2.1). This study selected groundwater data as a proxy for the environmental exposures as the groundwater is the major water source supplying drinking water to 95% of Idaho citizens (IDEQ, 2021).
Figure 2.

(a) Groundwater well locations in Idaho, (b) Total pesticide mass (out of 25 pesticides) in Idaho (kg/acre/year).
Table 1.
The Thirty Groundwater Variables (mg/L) Chosen for Subsequent Data Analysis After Data Filtering Eliminated Variables That had Considerable Gaps in the Overall Datasets
| Alkalinity (as CaCO3) | Chromium | Phosphate |
| Ammonia | Copper | Orthophosphate |
| Arsenic | Ethylbenzene | Potassium |
| Barium | Fluoride | Selenium |
| Boron | Iron | Silica |
| Bicarbonate | Lead | Silver |
| Bromine | Magnesium | Sodium |
| Cadmium | Manganese | Sulphate |
| Calcium | Nitrate | Toluene |
| Chloride | Nitrite | Zinc |
Note. Data Source: IDWR–Environmental data management system
Data regarding pesticide mass (kg/acre/county) were collected from the United States Geographic Survey Pesticide National Synthesis Project (USGS‐PNSP) at county resolution for 2017. While the database contains pesticide use estimates for over 500 different pesticides, this study focused on the 25 most applied conventional pesticide active ingredients in the agricultural market sector from 2008 to 2012 (as per Atwood and Paisley‐Jones (2017)). Table 2 lists the selected 25 pesticides after data filtering. Figure 2b shows the spatial distribution of the total mass of pesticides per unit acre for each county in Idaho for the year 2017. Data on the pesticides Metam (Na) and Metam (K) were combined into a single variable metam; likewise, data on the pesticides metolachlor and metolachlor‐S were combined into a single variable metolachlor. It should be noted that the pesticide data was the usage data by county (kg/acre), while the water quality data was concentration data (mg/L).
Table 2.
The Twenty‐Five Pesticides (kg/acre/County/Year) Chosen for Subsequent Data Analysis (Data Source: USGS–Pesticide National Synthesis Project)
| 2,4‐D | Paraquat | Hydrated lime |
| Acetochlor | Pendimethalin | Mancozeb |
| Atrazine | Propanil | Chloropicrin |
| Dicamba | Trifluralin | di‐chloropropene |
| Glufosinate | Acephate | Metam |
| Glyphosate | Chlorpyrifos | Metam potassium |
| Metolachlor | Chlorothalonil | Methyl bromide |
| Metolachlor‐s | Copper hydroxide | Decan‐1‐ol |
| Ethephon |
2.2.1. Environmental Carcinogen Identification
A total of 30 groundwater contaminant concentrations (mg/L) (Table 1) and an additional 25 pesticide use profiles (kg/county) were considered for inclusion in the PCA (Table 2). Of those variables, eighteen were listed as carcinogens by various sources (e.g., USEPA, IARC, CDC), as shown in Table 3. The other variables were removed from further analysis due to the lack of evidence of carcinogenicity.
Table 3.
Carcinogenic Groundwater Variables and Pesticides Used in the Principal Component Analysis
| Chemical | Type and units | References |
|---|---|---|
| Arsenic | Groundwater (mg/L) | International Agency for Research on Cancer (IARC, 2012, 2019) |
| Cadmium | National Cancer Institute (Huff et al., 2007; McElroy et al., 2006) | |
| Chromium | The United States Environmental Protection Agency (USEPA, 2004) | |
| Lead | International Agency for Research on Cancer (IARC, 2012, 2019) | |
| Nitrate | ||
| Nitrite | ||
| Silica | United States Occupational Health and Safety Administration (OSHA, 2010; Steenland & Ward, 2014) | |
| 2,4‐D | Pesticide use (kg/county/year) | International Agency for Research on Cancer (IARC, 2012, 2019) |
| Acetochlor | The United States Environmental Protection Agency (USEPA, 2004) | |
| Atrazine | ||
| Chloropicrin | California Office of Environmental Health Hazard Assessment (COEHHA, 2012) | |
| Chlorpyrifos | The United States Environmental Protection Agency (USEPA, 2004) | |
| Di‐chloropropene | Centers for Disease Control and Prevention (CDC, 2006) | |
| Glyphosate | International Agency for Research on Cancer (IARC, 2012, 2019) | |
| Mancozeb | The United States Environmental Protection Agency (USEPA, 2004) | |
| Metalochlor | ||
| Metam | ||
| Trifluralin |
Note. The references included in the table provide evidence that these chemicals are potentially carcinogenic.
2.3. Multivariable Statistical Analysis and Modeling
The relationships among the selected 18 environmental carcinogens were evaluated using the Spearman correlation coefficient, as shown in Table 4. The relationships which are statistically significant at adjusted p‐value <0.01 are highlighted with an asterisk. The p‐value was adjusted to account for multiple comparisons using the false discovery rate method (Benjamini & Hochberg, 1995; Benjamini & Yekutieli, 2001). Of 153 comparisons, 97 were statistically significant, illustrating a strong intercorrelation between the environmental variables.
Table 4.
Correlation Matrix of the 18 Environmental Variables Selected for Including in the Principal Component Analysis
| Correlation | Metam | Glyphosate | 2,4‐D | Acetochlor | Atrazine | Chloropicrin | Chlorpyrifos | Di‐chloropropene | Mancozeb | Metalochlor | Trifluralin | Arsenic | Cadmium | Chromium | Lead | Nitrate | Nitrite | Silica |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Metam | 1.0 | 0.4 a | 0.5 a | 0.6 a | 0.6 a | 0.9 a | 0.7 a | 0.9 a | 0.7 a | 0.5 a | 0.6 a | 0.4 a | 0.2 | 0.5 a | 0.2 | 0.5 a | 0.4 | 0.3 |
| Glyphosate | 1.0 | 0.6 a | 0.6 a | 0.7 a | 0.3 | 0.7 a | 0.2 | 0.8 a | 0.9 a | 0.8 a | 0.4 | 0.2 | 0.4 a | 0.4 | 0.7 a | 0.3 | 0.6 a | |
| 2,4‐D | 1.0 | 0.1 | 0.3 | 0.5 a | 0.5 a | 0.4 a | 0.7 a | 0.7 a | 0.9 a | −0.1 | 0.1 | 0.2 | 0.2 | 0.3 | 0.1 | 0.2 | ||
| Acetochlor | 1.0 | 0.9 a | 0.5 a | 0.8 a | 0.5 a | 0.6 a | 0.5 a | 0.3 | 0.6 a | 0.2 | 0.7 a | 0.3 | 0.7 a | 0.4 | 0.5 a | |||
| Atrazine | 1.0 | 0.6 a | 0.9 a | 0.5 a | 0.7 a | 0.7 a | 0.5 a | 0.6 a | 0.2 | 0.7 a | 0.3 | 0.8 a | 0.5 a | 0.5 a | ||||
| Chloropicrin | 1.0 | 0.6 a | 0.9 a | 0.6 a | 0.5 a | 0.5 a | 0.5 a | 0.2 | 0.5 a | 0.3 | 0.5 a | 0.4 a | 0.3 | |||||
| Chlorpyrifos | 1.0 | 0.5 a | 0.7 a | 0.6 a | 0.5 a | 0.6 a | 0.1 | 0.6 a | 0.3 | 0.7 a | 0.5 a | 0.4 a | ||||||
| Di‐chloropropene | 1.0 | 0.6 a | 0.5 a | 0.5 a | 0.4 | 0.2 | 0.5 a | 0.2 | 0.3 | 0.4 | 0.2 | |||||||
| Mancozeb | 1.0 | 0.9 a | 0.9 a | 0.4 | 0.2 | 0.4 a | 0.3 | 0.6 a | 0.4 a | 0.5 a | ||||||||
| Metalochlor | 1.0 | 0.9 a | 0.3 | 0.2 | 0.4 a | 0.4 | 0.6 a | 0.4 | 0.5 a | |||||||||
| Trifluralin | 1.0 | 0.1 | 0.2 | 0.3 | 0.3 | 0.5 a | 0.3 | 0.4 | ||||||||||
| Arsenic | 1.0 | 0.4 a | 0.7 a | 0.4 | 0.7 a | 0.7 a | 0.7 a | |||||||||||
| Cadmium | 1.0 | 0.5 a | 0.6 a | 0.4 | 0.4 | 0.6 a | ||||||||||||
| Chromium | 1.0 | 0.5 a | 0.6 a | 0.4 a | 0.7 a | |||||||||||||
| Lead | 1.0 | 0.4 | 0.3 | 0.5 a | ||||||||||||||
| Nitrate | 1.0 | 0.7 a | 0.8 a | |||||||||||||||
| Nitrite | 1.0 | 0.6 a | ||||||||||||||||
| Silica | 1.0 |
The correlations that are statistically significant at P‐value <0.01.
Since many environmental carcinogens are intercorrelated, a multivariable regression model with these variables may result in over‐parameterization. Hence, PCA was employed in this study to reduce input redundancy (Abdi & Williams, 2010; Wold et al., 1987). PCA is a multivariate statistical technique by which dominant patterns of a data matrix are extracted in the form of a set of loading and score vectors (Wold et al., 1987). This method helps to decrease the dimensionality of the large data set by replacing some correlated variables with a more compact set of orthogonal predictors (e.g., Joseph et al. (2019, 2020)). Each of these new predictors is defined by a linear association of the original variables (I. Jolliffe, 2002). The components are defined so that the first component corresponds to the maximum variance, the second component corresponds to the second maximum variance in the direction orthogonal to the first component, and so on (Rencher, 2002).
The input variables for PCA included pesticides (kg/acre/county/year) and groundwater variables (mg/L). Since the variables are in different units, the input data set was standardized by subtracting the mean and dividing by standard deviation. This standardized data was used for PCA, where it was consolidated into principal components. The generated principal components were then selected in place of the original variables for further analysis. The number of components to be retained was identified using eigenvalue spectra analysis (I. T. Jolliffe, 1986). Eigenvalue spectra is a line plot of eigenvalues of principal components sorted from largest to smallest to determine the number of components retained in the analysis (Guo et al., 2009). The number of components to be retained was identified based on the line plot's slope nearing zero. Further, the fraction of variability explained by each component was estimated. A range of 70%–90% explanation of variability was selected to finalize the number of components (I. Jolliffe, 2002).
The principal components based on the eigenvalue spectra analysis were summarized into a single environmental burden index (EBI). The counties were analyzed for the factor loading of all four components. This was performed by estimating the median of the magnitude of the selected components. The median of the magnitude value was selected as the magnitude indicates the relevance of that variable (Ouyang, 2005), and the median was used as a consolidation measure. This measure of EBI was used to categorize the counties into low, medium, and high EBI profiles. The low EBI profile corresponded to the lower tertile of EBI (≤0.33), the high EBI profile corresponded to the higher tertile (≥0.66), and the medium EBI profile corresponded to the medium tertile (>0.33, <0.66).
2.3.1. Modeling Pediatric Cancer Incidence
Mixed‐effects regression with a Poisson distribution and log link was adopted to model the cancer incidence data, as the Pearson Chi‐square dispersion statistic was equal to one (Loukas & Kemp, 1986). The modeling was performed using the MATLAB R2019a tool (MATLAB, 2019). The mean response variable was pediatric cancer frequency with person‐years as the offset. Age was included as a fixed effect in the model. The fit method selected was Laplace, with the county as intercept. The model coefficients were evaluated using F‐statistics and P‐value.
The sensitivity of pediatric cancer incidence to EBI profiles was estimated by choosing different cut points for the EBI tertiles. Additionally, EBI profiles classified based on 25th percentile (4 groups) and 20th percentile (5 groups) to evaluate whether the association of EBI to pediatric cancer still holds similar in both cases. In addition to the statistical parameters, the rate ratio of pediatric cancer incidence was also estimated, which is defined as the ratio of the pediatric crude incidence rate of high exposure to low exposure. The final model results were then evaluated using Nash‐Sutcliffe Efficiency (NSE). NSE is a statistical measure to quantify the efficiency of hydrological models (Nash & Sutcliffe, 1970). It measures the relative magnitude of residual variance compared to observed data (Moriasi et al., 2007).
3. Results
3.1. Multivariable Analysis Results
Principal component analysis was performed on the data set of environmental carcinogens to avoid input redundancy. A scree plot (eigenvalue spectra), representing eigenvalues sorted from largest to smallest, is shown in Figure 3a. After the inclusion of PC5, the scree plot flattened, indicating that additional components did not significantly increase the model's explanatory power. Figure 3b shows the fraction of variability explained by each component plotted against the number of components. The first component represents approximately 45% of the total variability of the original set of variables (eleven pesticides and seven groundwater variables), the first two components together 66%, the first three components together 79%, and the first four components together 88%. Since the first four components represent the original data set's variability within the range of 70%–90% and close to the upper threshold of 90%, these four components were used as an alternative to the original set of variables.
Figure 3.

(a) Eigenvalue spectra, and (b) Number of principal component's against the fraction of variability explained by the components.
The most dominant variables within the first principal component (PC1) were glyphosate and atrazine; the most dominant within the second (PC2) were 2,4‐D and metam; the most dominant for the third (PC3) component were di‐chloropropene and chloropicrin; fourth (PC4) were trifluralin and metam. The most dominant components were pesticide variables, as expressed in kg/acre of application on a county‐by‐county scale.
3.2. Environmental Burden Index
Figure 4 shows the spatial distribution of the EBI, developed from the consolidated components, categorizing them into low, medium, and high environmental profiles in Idaho. Many of the counties in the southern Snake River region of Idaho and a few counties in the northern region of Idaho have the largest environmental burden. It is important to note that many counties falling within the high environmental burden profile have higher pediatric cancer incidence.
Figure 4.

Environmental burden index (EBI)—Low, Medium, and High EBI profiles at county scale in Idaho.
Figure 5 shows the box plot of pediatric cancer incidence corresponding to low, medium, and high EBI profiles. The pediatric cancer crude incidence (per 100,000) for the high EBI profile is the highest (mean = 18.97, median = 17.19), compared to medium EBI profile (mean = 18.77, median = 16.13), and low EBI profile (mean = 14.44, median = 12.22). The rate ratio for EBI high profile to EBI low profile was also estimated as 1.196 with lower and upper confidence intervals of 1.061 and 1.348, respectively. These results indicate the significant increase of pediatric cancer incidence when shifting from a low to a high EBI profile.
Figure 5.

Box plot of total pediatric cancer incidence for the various environmental profiles.
3.3. Model Results
A mixed‐effects regression model with Poisson distribution was applied to model the pediatric cancer incidence in Idaho. The estimated coefficients of the model with standard error, t‐statistic, and P‐value are shown in Table 5. A type‐3 test for fixed effects was also performed, and the results are shown in Table S1 in the Supporting Information S1. The results indicate that EBI was statistically significant to pediatric cancer incidence in Idaho (P‐value <0.05). The intercept variable, county, was highly significant in the model, which indicates that the inter‐county differences remain even after adjusting for the environmental variables. We also conducted sensitivity tests by choosing different cut points for the EBI, as shown in Tables S2 and S3 in the Supporting Information S1. Furthermore, EBI profiles for 25 percentile and 20 percentiles were also estimated as shown in Tables S4 and S5 in the Supporting Information S1, respectively. The results were similar in the model runs, confirming the statistical significance of the EBI profile in all the cases.
Table 5.
Estimated Coefficients of the Model for Total Pediatric Cancer Incidence With Standard Error, t‐statistic, P‐value, and Confidence Intervals
| Name | Estimate | SE | t‐stat | P‐value | Lower C.I. | Upper C.I. |
|---|---|---|---|---|---|---|
| Intercept | −8.5901 | 0.065776 | −130.6 | 2.01E−172 | −8.7199 | −8.4602 |
| Age Group 5–9 | −0.42718 | 0.065964 | −6.4759 | 9.74E−10 | −0.55739 | −0.29696 |
| Age Group 10–14 | −0.42357 | 0.065367 | −6.4799 | 9.54E−10 | −0.55261 | −0.29454 |
| Age Group 15–19 | 0.07654 | 0.057326 | 1.3352 | 0.1836 | −0.03662 | 0.1897 |
| EBI Profile Medium | 0.1258 | 0.078369 | 1.6053 | 0.11029 | −0.0289 | 0.28051 |
| EBI Profile High | 0.17925 | 0.06123 | 2.9275 | 0.003886 | 0.05838 | 0.30012 |
Note. SE, Standard error; t‐stat, t‐statistic; C.I., Confidence interval.
Figure 6 shows the modeled and observed pediatric cancer incidence for the ages 0–4, 5–9, 10–14, and 15–19. The modeled results match the observed data with NSE of 0.989, 0.974, 0.961, and 0.92 for ages 0–4, 5–9, 10–14, and 15–19, respectively. The modeled against observed pediatric cancer incidence for all ages is also shown in Figure S1 in the Supporting Information S1 (NSE = 0.97).
Figure 6.

Modeled and observed pediatric cancer incidence for ages 0–4, 5–9, 10–14, and 15–19. The x‐axis corresponds to the 44 counties in Idaho.
4. Discussion
The objective of this study was to determine the degree to which a multivariable principal component model based on several potentially carcinogenic metals and pesticides can be used to explain county‐level pediatric cancer in Idaho. To our knowledge, this is the first study that has pediatric cancer incidence data and then related it to water quality parameters and pesticide application rates (kg/county) across the state. Using a multivariable analysis approach, this study consolidated several environmental variables into four consolidated principal components and developed an EBI at the county scale. Based on EBI, the counties in Idaho were classified into low, medium, and high environmental burden profiles. The findings indicated that EBI was significantly associated with pediatric cancer incidence at P‐value <0.05. The variables predominantly contributing to the environmental burden index were pesticides. A statistical model was also developed which accurately estimated the pediatric cancer incidence in Idaho (NSE = 0.97). The findings from the study indicate that the consolidated analysis of environmental variables provides insights into the geospatial distribution of pediatric cancer incidence in Idaho.
4.1. Use of PCA in Cancer Research
PCA has been used in cancer research to analyze high‐dimensional data and extract relevant features for various applications (Abdelrehim et al., 2018; Adiwijaya et al., 2018; D.‐T. Chen et al., 2011; De Stefani et al., 2010; Hsu et al., 2014; Price et al., 2006; Silvera et al., 2011). For example, PCA was used in discoveries involving genomic profiling and personalized medicine (Hunter et al., 2007; Pomeroy et al., 2002; Price et al., 2006; Seierstad et al., 2008). It has also been used by Brown et al. (2013) to analyze the relationships between various adverse childhood experiences, such as physical, emotional, or sexual abuse, family/household member's mental illness, incarceration, and substance abuse, and cancer incidences. Silvera et al. (2011) used PCA to evaluate the impact of various dietary and lifestyle patterns (food habits, tobacco and alcohol usage, occupational history, use of medications, etc.) on cancer incidence and identified that nitrate/nitrite intake is associated with an elevated risk of cancer incidence.
4.2. Importance of Pesticides as Predictors of Pediatric Cancer
While conducted in a more traditional manner, several published studies have demonstrated a link between pesticides and pediatric cancer (M. Chen et al., 2015; Coste et al., 2020; Daniels et al., 1997; Hernández & Menéndez, 2016; Iqbal et al., 2021; Karalexi et al., 2021; LaFiura et al., 2007; Leiss & Savitz, 1995; Pascale & Laborde, 2020; Soldin et al., 2009; Van Maele‐Fabry et al., 2017). In this current study, several pesticides were identified as major contributors to the consolidated principal components. Among these pesticides, metam and chloropicrin are considered high‐ranking pesticides relative to cancer risk (Gunier et al. (2001). Supporting this, Reynolds et al. (2005) found that exposure to metam was linked to a two‐fold increase in the odds ratio for pediatric leukemia. Evidence regarding a link between the pesticides such as glyphosate (Andreotti et al., 2018; A. J. De Roos et al., 2005; Mink et al., 2012), atrazine (Freeman et al., 2011; Rhoades et al., 2013; Rusiecki et al., 2004), and trifluralin (A. De Roos et al., 2003; Kang et al., 2008) are mixed, or in the case of di‐chloropropene much less compelling (Lee et al., 2002) than that for metam and chloropicrin.
This study used pesticide information from USGS‐PNSP at county resolution for evaluating its association to pediatric cancer incidence in Idaho. Previous studies focusing on pesticides and pediatric cancer collected data through a parental interview (e.g., Gunier et al. (2017)). One of the limitations of survey‐based approach is the lack of statistical power to investigate associations with individual pesticide active ingredient, which was overcome by this study to an extent.
Although this study did not focus on specific cancer sites such as leukemia or lymphoma, age at diagnosis was a parameter considered. The embryonal tumors (hepatoblastoma, medulloblastoma, retinoblastoma, Wilms, neuroblastoma) are generally diagnosed in very early childhood prior to age 5. Acute lymphoblastic leukemia (ALL) diagnoses peaks ages 3–4, and it is lymphomas and germ cell tumors that rise in adolescence (Howell et al., 2007; Withrow et al., 2019). Thus, the stratified analyses by age are a proxy into what cancer types might be most associated with pesticides.
4.3. Comparison of Consolidated Analysis in This Study to Existing Environmental Burden Indices
More to the point of this current research, Scott et al. (2019) developed and used an environmental burden index focusing on socioeconomic and demographic variables including poverty, income, food access, and race (Lantz & Pritchard, 2010; Parrish, 2010), which they then correlated with overall cancer death rates (NCHS & CDC, 2014). While relevant, the environmental burden index proposed by Scott et al. (2019) does not contain any empirically measured environmental data used in this current study.
Similarly to the consolidated analysis of environmental variables performed in this study, USEPA (United States Environmental Protection Agency) has developed the Environmental Quality Index (EQI) (Lobdell et al., 2014), and Yale University has developed the Environmental Performance Index (EPI) (Emerson et al., 2012), focusing on several environmental domains. While relevant, these indices are developed at a national level and used datasets at a coarser resolution. For instance, many of the environmental datasets used in these indices are collected at state scale due to the data scarcity in spatial and temporal coverage (Messer et al., 2014). Moreover, the study was conducted for the whole U.S., and many environmental datasets were downscaled or extrapolated using multiple statistical methods, increasing the uncertainty of the modeling approach. To this point, this study has accessed datasets from the USGS‐PNSP, Idaho Department of Water Resources, and correlated with pediatric cancer incidence datasets from Cancer Data Registry of Idaho within Idaho at county resolution.
It is important to note that most of the variables in the consolidated principal components are pesticide use by county and not the concentration of metals/metalloids in groundwater. The groundwater data may not have been particularly explanatory because the value used was a mean concentration (mg/L) averaged over a 25‐year period with no regard paid to the timing of groundwater sampling, both annually and seasonally. Given that the concentration of potentially hazardous chemicals in groundwater may vary seasonally or vary from year to year, it may not be surprising that an average value has low inter‐county variability, and hence it had little explanatory power. Due to the lack of a standardized sample regime, averaging the low concentration of groundwater variables in months such as February and high concentration of groundwater variables in months such as July may bias the final concentration reported.
In contrast to the groundwater samples, the kg of pesticides used in each county across Idaho is a fairly robust measurement. While the amount of pesticide used may vary from year to year, the rank order of the counties relative to their pesticide use probably does not vary appreciably from 1 year to the next, as counties, where the landscape is dominated by row crops, will invariably use large amounts of pesticides, while counties dominated by forested areas will consistently use low amounts of pesticide. As an example of this, the Spearman Rank Correlation between the use of metam (the primary pesticide in PC1) in 2013 and 2017 for 24 Idaho counties was extremely high (R > 0.99). We did the analysis for 24 counties as metam was applied only on these 24 counties.
4.4. Limitations and Future Directions
Recent studies have explored the global associations between all cancer incidence and climate change on a global scale (Nogueira et al., 2020; Piacentini et al., 2018; Vineis et al., 2021), pediatric cancer incidence, and socioeconomic variables in the U.S. (Swensen et al., 1997), or specific cancer incidences such as lung cancer and gender differences (Hanagiri et al., 2007; Zang & Wynder, 1996). These studies are uncovering geospatial relationships between cancer incidence and other variables, but to date, little has been done with respect to the use of water quality criteria or pesticide application as they pertain to large geospatial distributions of cancer. The results of this current study illustrate that such analysis may prove to be fruitful.
This study did not consider the temporality of exposure measurements relative to disease onset, including lag time between exposure and disease. Part of the reason we chose pediatric cancers was because of the short latency period between exposure and onset of disease. Moreover, we are using the pesticide mass in kg/acre/county as the input variable, which is an indirect measurement of exposure at county scale. We hypothesize that the greater the use of pesticide in the county, the more probability there would be for human exposure.
One other limitation of the current study is that the differences in pediatric cancer incidence across different races such as Hispanic population, or with differences in parental age at the birth of a child are neglected. This was primarily because of the lack of a data set available. Moreover, this study did not analyze the pediatric cancer incidence by site, instead focused on the total pediatric cancer incidence. The future scope of the study is to include these parameters after considerable data mining, and to evaluate its association to specific cancer sites such as leukemia.
This study did not analyze cancer incidences by various sites primarily due to the low sample size issue. Idaho is a low population state, with several counties being frontier counties (population density < 6/square miles). The total number of pediatric cancer incidence in Idaho across counties, categorized by age‐group itself is very low. The three major pediatric cancer types in Idaho are leukemia, lymphoma, and CNS. For leukemia, 83% of the counties have less than or equal to 3 incidences when categorized by age group. The corresponding percentage for lymphoma is 89% and for CNS is 80%.
Furthermore, the results from this study depend on the spatial unit selected (county) and may vary with analyzing at a different spatial resolution, which is referred to as the modifiable areal unit problem (Openshaw, 1984). Moreover, this study did not perform an exposure‐based assessment, rather correlated the mass of pesticides applied in counties of Idaho (kg/county/area/year) and water quality variables (mg/L) to pediatric cancer incidence. While this study overcame the limitations of recent studies such as Scott et al. (2019), by using potential carcinogenic pesticides and groundwater quality variables in the analysis, exposure routes were neglected. The future scope of this work is to overcome these limitations and collect additional temporal datasets on environmental variables and pediatric cancer in Idaho, and to perform exposure‐based assessments. This would help comprehensively analyze pediatric cancer distribution in Idaho concerning specific environmental contaminants based on the biological plausibility between exposure and incidence.
Conflict of Interest
The authors declare no conflicts of interest relevant to this study.
Supporting information
Supporting Information S1
Acknowledgments
The authors gratefully acknowledge partial financial support from the Idaho Water Resources Research Institute, the University of Idaho, and the National Institute of General Medical Sciences of the National Institutes of Health under Award Number P20GM104420. Cancer incidence data were provided by the Cancer Data Registry of Idaho on 09 October 2019. We thank Dr. Erich Seamon of the Institute for Modeling Collaboration and Innovation at the University of Idaho for supporting the data analysis. Dr. Carrie Roever and Dr. Lucas Sheneman of the Northwest Knowledge Network at the University of Idaho supported the data collection and management. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or any other participating entity.
Joseph, N. , & Kolok, A. S. (2022). Assessment of pediatric cancer and its relationship to environmental contaminants: An ecological study in Idaho. GeoHealth, 6, e2021GH000548. 10.1029/2021GH000548
Data Availability Statement
Pediatric cancer incidence data of current work is not open to the public as the health information is confidential as required by state law (Idaho Code §57‐1706). Investigators seeking pediatric cancer incidence data in Idaho should directly make a request to the Cancer Data Registry of Idaho at https://www.idcancer.org/index.html. Pesticide data can be accessed from the United States Geographic Survey Pesticide National Synthesis Project (USGS‐PNSP) at https://water.usgs.gov/nawqa/pnsp/usage/maps/compound_listing.php. Groundwater quality data in Idaho can be accessed from the Idaho Department of Water Resources at https://idwr.idaho.gov/water-data.
References
- Abdelrehim, M. G. , Mahfouz, E. M. , Ewis, A. A. , Seedhom, A. E. , Afifi, H. M. , & Shebl, F. M. (2018). Dietary factors associated with pancreatic cancer risk in Minia, Egypt: Principal component analysis. Asian Pacific Journal of Cancer Prevention: Asian Pacific Journal of Cancer Prevention, 19(2), 449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Abdi, H. , & Williams, L. J. (2010). Principal component analysis. Wiley interdisciplinary reviews: Computational Statistics, 2(4), 433–459. 10.1002/wics.101 [DOI] [Google Scholar]
- Abernathy, C. O. , Thomas, D. J. , & Calderon, R. L. (2003). Health effects and risk assessment of arsenic. Journal of Nutrition, 133(5), 1536S–1538S. 10.1093/jn/133.5.1536s [DOI] [PubMed] [Google Scholar]
- Adiwijaya, W. U. , Lisnawati, E. , Aditsania, A. , & Kusumo, D. S. (2018). Dimensionality reduction using principal component analysis for cancer detection based on microarray data classification. Journal of Computer Science, 14(11), 1521–1530. 10.3844/jcssp.2018.1521.1530 [DOI] [Google Scholar]
- Andreotti, G. , Koutros, S. , Hofmann, J. N. , Sandler, D. P. , Lubin, J. H. , Lynch, C. F. , et al. (2018). Glyphosate use and cancer incidence in the agricultural health study. JNCI: Journal of the National Cancer Institute, 110(5), 509–516. 10.1093/jnci/djx233 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Atwood, D. , & Paisley‐Jones, C. (2017). Pesticides industry sales and usage: 2008–2012 market estimates. US Environmental Protection Agency. [Google Scholar]
- Barrett, J. H. , Parslow, R. C. , McKinney, P. A. , Law, G. R. , & Forman, D. (1998). Nitrate in drinking water and the incidence of gastric, esophageal, and brain cancer in Yorkshire, England. Cancer Causes & Control, 9(2), 153–159. 10.1023/a:1008878126535 [DOI] [PubMed] [Google Scholar]
- Beaumont, J. J. , Sedman, R. M. , Reynolds, S. D. , Sherman, C. D. , Li, L.‐H. , Howd, R. A. , et al. (2008). Cancer mortality in a Chinese population exposed to hexavalent chromium in drinking water. Epidemiology, 12–23. 10.1097/ede.0b013e31815cea4c [DOI] [PubMed] [Google Scholar]
- Benjamini, Y. , & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57(1), 289–300. 10.1111/j.2517-6161.1995.tb02031.x [DOI] [Google Scholar]
- Benjamini, Y. , & Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Annals of Statistics, 1165–1188. 10.1214/aos/1013699998 [DOI] [Google Scholar]
- Brown, M. J. , Thacker, L. R. , & Cohen, S. A. (2013). Association between adverse childhood experiences and diagnosis of cancer. PLoS One, 8(6), e65524. 10.1371/journal.pone.0065524 [DOI] [PMC free article] [PubMed] [Google Scholar]
- CDC . (2006). Centers for Disease Control Prevention, United States Department of Health and Human Services. National Institutes of Health. Treatment of opportunistic infections.
- Census‐Bureau . (2020). U.S. Population data ‐ 1969 ‐ 2019: County‐level population files ‐ 19 age groups. From surveillance, Epidemiology, and End results program. National Cancer Institute. [Google Scholar]
- Chen, D.‐T. , Hsu, Y.‐L. , Fulp, W. J. , Coppola, D. , Haura, E. B. , Yeatman, T. J. , & Cress, W. D. (2011). Prognostic and predictive value of a malignancy‐risk gene signature in early‐stage non–small cell lung cancer. Journal of the National Cancer Institute, 103(24), 1859–1870. 10.1093/jnci/djr420 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen, M. , Chang, C.‐H. , Tao, L. , & Lu, C. (2015). Residential exposure to pesticide during childhood and childhood cancers: A meta‐analysis. Pediatrics, 136(4), 719–729. 10.1542/peds.2015-0006 [DOI] [PubMed] [Google Scholar]
- COEHHA (2012). The proposition 65 list. California Office of Environmental Health Hazard Assessment. Retrieved from https://oehha.ca.gov/proposition-65/proposition-65-list [Google Scholar]
- Corley, B. , Bartelt‐Hunt, S. , Rogan, E. , Coulter, D. , Sparks, J. , Baccaglini, L. , et al. (2018). Using watershed boundaries to map adverse health outcomes: Examples from Nebraska, USA. Environmental Health Insights, 12, 1178630217751906. 10.1177/1178630217751906 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coste, A. , Bailey, H. D. , Kartal‐Kaess, M. , Renella, R. , Berthet, A. , & Spycher, B. D. (2020). Parental occupational exposure to pesticides and risk of childhood cancer in Switzerland: A census‐based cohort study. BMC Cancer, 20(1), 1–11. 10.1186/s12885-020-07319-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daniels, J. L. , Olshan, A. F. , & Savitz, D. A. (1997). Pesticides and childhood cancers. Environmental Health Perspectives, 105(10), 1068–1077. 10.1289/ehp.971051068 [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Roos, A. , Zahm, S. , Cantor, K. , Weisenburger, D. , Holmes, F. , Burmeister, L. , & Blair, A. (2003). Integrative assessment of multiple pesticides as risk factors for non‐Hodgkin's lymphoma among men. Occupational and Environmental Medicine, 60(9), e11. 10.1136/oem.60.9.e11 [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Roos, A. J. , Blair, A. , Rusiecki, J. A. , Hoppin, J. A. , Svec, M. , Dosemeci, M. , et al. (2005). Cancer incidence among glyphosate‐exposed pesticide applicators in the Agricultural Health Study. Environmental Health Perspectives, 113(1), 49–54. 10.1289/ehp.7340 [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Stefani, E. , Ronco, A. L. , Deneo‐Pellegrini, H. , Boffetta, P. , Aune, D. , Acosta, G. , et al. (2010). Dietary patterns and risk of advanced prostate cancer: A principal component analysis in Uruguay. Cancer Causes & Control, 21(7), 1009–1016. 10.1007/s10552-010-9527-4 [DOI] [PubMed] [Google Scholar]
- Drozd, V. M. , Saenko, V. A. , Brenner, A. V. , Drozdovitch, V. , Pashkevich, V. I. , Kudelsky, A. V. , et al. (2015). Major factors affecting incidence of childhood thyroid cancer in Belarus after the Chernobyl accident: Do nitrates in drinking water play a role? PLoS One, 10(9), e0137226. 10.1371/journal.pone.0137226 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Emerson, J. , Esty, D. , Hsu, A. , Levy, M. , De Sherbinin, A. , Mara, B. , & Jaiteh, M. (2012). Environmental performance index and pilit trend environmental performance index‐full report. Yale Center for Environmental Law and Policy, Yale University, Columbia University. [Google Scholar]
- Evans, S. , Campbell, C. , & Naidenko, O. V. (2019). Cumulative risk analysis of carcinogenic contaminants in United States drinking water. Heliyon, 5(9), e02314. 10.1016/j.heliyon.2019.e02314 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Farazi, P. , Watanabe‐Galloway, S. , Westman, L. , Rettig, B. , Hunt, P. , Cammack, R. , et al. (2018). Temporal and geospatial trends of pediatric cancer incidence in Nebraska over a 24‐year period. Cancer epidemiology, 52, 83–90. 10.1016/j.canep.2017.12.006 [DOI] [PubMed] [Google Scholar]
- Filippini, T. , Hatch, E. E. , Rothman, K. J. , Heck, J. E. , Park, A. S. , Crippa, A. , et al. (2019). Association between outdoor air pollution and childhood leukemia: A systematic review and dose–response meta‐analysis. Environmental Health Perspectives, 127(4), 046002. 10.1289/ehp4381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flores‐Fernández, J. M. , Herrera‐López, E. J. , Sánchez‐Llamas, F. , Rojas‐Calvillo, A. , Cabrera‐Galeana, P. A. , Leal‐Pacheco, G. , et al. (2012). Development of an optimized multi‐biomarker panel for the detection of lung cancer based on principal component analysis and artificial neural network modeling. Expert Systems with Applications, 39(12), 10851–10856. 10.1016/j.eswa.2012.03.008 [DOI] [Google Scholar]
- Freeman, L. E. B. , Rusiecki, J. A. , Hoppin, J. A. , Lubin, J. H. , Koutros, S. , Andreotti, G. , et al. (2011). Atrazine and cancer incidence among pesticide applicators in the agricultural health study (1994–2007). Environmental Health Perspectives, 119(9), 1253–1259. 10.1289/ehp.1103561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goujon, S. , Kyrimi, E. , Faure, L. , Guissou, S. , Hémon, D. , Lacour, B. , & Clavel, J. (2018). Spatial and temporal variations of childhood cancers: Literature review and contribution of the French national registry. Cancer medicine, 7(10), 5299–5314. 10.1002/cam4.1774 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gunier, R. B. , Harnly, M. E. , Reynolds, P. , Hertz, A. , & Von Behren, J. (2001). Agricultural pesticide use in California: Pesticide prioritization, use densities, and population distributions for a childhood cancer study. Environmental Health Perspectives, 109(10), 1071–1078. 10.1289/ehp.011091071 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gunier, R. B. , Kang, A. , Hammond, S. K. , Reinier, K. , Lea, C. S. , Chang, J. S. , et al. (2017). A task‐based assessment of parental occupational exposure to pesticides and childhood acute lymphoblastic leukemia. Environmental Research, 156, 57–62. 10.1016/j.envres.2017.03.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guo, H. , Marfurt, K. J. , & Liu, J. (2009). Principal component spectral analysis. Geophysics, 74(4), P35–P43. 10.1190/1.3119264 [DOI] [Google Scholar]
- Halasova, E. , Matakova, T. , Kavcova, E. , Musak, L. , Letkova, L. , Adamkov, M. , et al. (2009). Human lung cancer and hexavalent chromium exposure. Neuroendocrinology Letters, 30(1), 182–185. [PubMed] [Google Scholar]
- Hanagiri, T. , Sugio, K. , Uramoto, H. , So, T. , Ichiki, Y. , Sugaya, M. , et al. (2007). Gender difference as a prognostic factor in patients undergoing resection of non‐small cell lung cancer. Surgery Today, 37(7), 546–551. 10.1007/s00595-006-3453-9 [DOI] [PubMed] [Google Scholar]
- Heck, J. E. , Park, A. S. , Qiu, J. , Cockburn, M. , & Ritz, B. (2014). Risk of leukemia in relation to exposure to ambient air toxics in pregnancy and early childhood. International Journal of Hygiene and Environmental Health, 217(6), 662–668. 10.1016/j.ijheh.2013.12.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hernández, A. F. , & Menéndez, P. (2016). Linking pesticide exposure with pediatric leukemia: Potential underlying mechanisms. International Journal of Molecular Sciences, 17(4), 461. 10.3390/ijms17040461 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hong, Y.‐S. , Song, K.‐H. , & Chung, J.‐Y. (2014). Health effects of chronic arsenic exposure. Journal of preventive medicine and public health, 47(5), 245. 10.3961/jpmph.14.035 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Howell, D. L. , Ward, K. C. , Austin, H. D. , Young, J. L. , & Woods, W. G. (2007). Access to pediatric cancer care by age, race, and diagnosis, and outcomes of cancer treatment in pediatric and adolescent patients in the state of Georgia. Journal of Clinical Oncology, 25(29), 4610–4615. 10.1200/jco.2006.07.6992 [DOI] [PubMed] [Google Scholar]
- Hsu, Y.‐L. , Huang, P.‐Y. , & Chen, D.‐T. (2014). Sparse principal component analysis in cancer research. Translational Cancer Research, 3(3), 182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huff, J. , Lunn, R. M. , Waalkes, M. P. , Tomatis, L. , & Infante, P. F. (2007). Cadmium‐induced cancers in animals and in humans. International Journal of Occupational and Environmental Health, 13(2), 202–212. 10.1179/oeh.2007.13.2.202 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunter, D. J. , Kraft, P. , Jacobs, K. B. , Cox, D. G. , Yeager, M. , Hankinson, S. E. , et al. (2007). A genome‐wide association study identifies alleles in FGFR2 associated with risk of sporadic postmenopausal breast cancer. Nature Genetics, 39(7), 870–874. 10.1038/ng2075 [DOI] [PMC free article] [PubMed] [Google Scholar]
- IARC . (2012). Agents classified by the international agency for research on cancer monographs (Vol. 1–106). Retrieved from http://monographs.iarc.fr/ENG/Classification/index.php [Google Scholar]
- IARC . (2019). International Agency for Research on Cancer monographs on the identification of carcinogenic hazards to humans. World Health Organization. [Google Scholar]
- IDEQ . (2021). Groundwater: Idaho department of environmental quality. Retrieved from https://www.deq.idaho.gov/water-quality/ground-water/
- Iqbal, S. , Ali, S. , & Ali, I. (2021). Maternal pesticide exposure and its relation to childhood cancer: An umbrella review of meta‐analyses. International Journal of Environmental Health Research, 1–19. 10.1080/09603123.2021.1900550 [DOI] [PubMed] [Google Scholar]
- Johnson, C. J. , Morawski, B. M. , & Rycroft, R. K. (2020). Cancer in Idaho ‐ 2018, cancer data Registry of Idaho, Boise, Idaho. Retrieved from https://www.idcancer.org/ContentFiles/AnnualReports/Cancer%20in%20Idaho%202018.pdf [Google Scholar]
- Jolliffe, I. (2002). Principal component analysis. Wiley Online Library. [Google Scholar]
- Jolliffe, I. T. (1986). Principal components in regression analysis. In Principal component analysis (pp. 129–155). Springer. 10.1007/978-1-4757-1904-8_8 [DOI] [Google Scholar]
- Joseph, N. , Ryu, D. , Malano, H. M. , George, B. , & Sudheer, K. (2019). Estimation of industrial water demand in India using census‐based statistical data. Resources, Conservation and Recycling, 149, 31–44. 10.1016/j.resconrec.2019.05.036 [DOI] [Google Scholar]
- Joseph, N. , Ryu, D. , Malano, H. M. , George, B. , & Sudheer, K. (2020). Investigation into sustainable water use in India using combined large‐scale earth system‐based modelling and census‐based statistical data. Journal of Hydrology, 124930. 10.1016/j.jhydrol.2020.124930 [DOI] [Google Scholar]
- Kang, D. , Park, S. K. , Beane‐Freeman, L. , Lynch, C. F. , Knott, C. E. , Sandler, D. P. , et al. (2008). Cancer incidence among pesticide applicators exposed to trifluralin in the Agricultural Health Study. Environmental Research, 107(2), 271–276. 10.1016/j.envres.2008.01.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Karalexi, M. A. , Tagkas, C. F. , Markozannes, G. , Tseretopoulou, X. , Hernández, A. F. , Schüz, J. , et al. (2021). Exposure to pesticides and childhood leukemia risk: A systematic review and meta‐analysis. Environmental Pollution, 285, 117376. 10.1016/j.envpol.2021.117376 [DOI] [PubMed] [Google Scholar]
- Khan, J. , Wei, J. S. , Ringner, M. , Saal, L. H. , Ladanyi, M. , Westermann, F. , et al. (2001). Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nature Medicine, 7(6), 673–679. 10.1038/89044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Konstantinoudis, G. , Schuhmacher, D. , Ammann, R. A. , Diesch, T. , Kuehni, C. E. , & Spycher, B. D. (2020). Bayesian spatial modelling of childhood cancer incidence in Switzerland using exact point data: A nationwide study during 1985–2015. International Journal of Health Geographics, 19, 1–13. 10.1186/s12942-020-00211-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- LaFiura, K. M. , Bielawski, D. M. , Posecion, N. C., Jr. , Ostrea, E. M., Jr. , Matherly, L. H. , Taub, J. W. , & Ge, Y. (2007). Association between prenatal pesticide exposures and the generation of leukemia‐associated T (8; 21). Pediatric Blood and Cancer, 49(5), 624–628. 10.1002/pbc.21283 [DOI] [PubMed] [Google Scholar]
- Lantz, P. M. , & Pritchard, A. (2010). Socioeconomic indicators that matter for population health. Preventing Chronic Disease, 7(4). [PMC free article] [PubMed] [Google Scholar]
- Lawson, A. B. , & Rotejanaprasert, C. (2014). Childhood brain cancer in Florida: A Bayesian clustering approach. Statistics and Public Policy, 1(1), 99–107. 10.1080/2330443x.2014.970247 [DOI] [Google Scholar]
- Lee, S. , McLaughlin, R. , Harnly, M. , Gunier, R. , & Kreutzer, R. (2002). Community exposures to airborne agricultural pesticides in California: Ranking of inhalation risks. Environmental Health Perspectives, 110(12), 1175–1184. 10.1289/ehp.021101175 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leiss, J. K. , & Savitz, D. A. (1995). Home pesticide use and childhood cancer: A case‐control study. American Journal of Public Health, 85(2), 249–252. 10.2105/ajph.85.2.249 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Little, M. P. , Wakeford, R. , Borrego, D. , French, B. , Zablotska, L. B. , Adams, M. J. , et al. (2018). Leukaemia and myeloid malignancy among people exposed to low doses (<100 mSv) of ionising radiation during childhood: A pooled analysis of nine historical cohort studies. The Lancet Haematology, 5(8), e346–e358. 10.1016/s2352-3026(18)30092-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lobdell, D. , Jagai, J. , Messer, L. , Rappazo, K. , Messier, K. , & Smith, G. (2014). Creating an overall environmental quality index—technical report. [Google Scholar]
- Loukas, S. , & Kemp, C. (1986). The index of dispersion test for the bivariate Poisson distribution (pp. 941–948). Biometrics. 10.2307/2530708 [DOI] [Google Scholar]
- MATLAB . (2019). 9.6. 0 (R2019a). The MathWorks Inc., 431.
- McElroy, J. A. , Shafer, M. M. , Trentham‐Dietz, A. , Hampton, J. M. , & Newcomb, P. A. (2006). Cadmium exposure and breast cancer risk. Journal of the National Cancer Institute, 98(12), 869–873. 10.1093/jnci/djj233 [DOI] [PubMed] [Google Scholar]
- Meek, M. , Boobis, A. R. , Crofton, K. M. , Heinemeyer, G. , Van Raaij, M. , & Vickers, C. (2011). Risk assessment of combined exposure to multiple chemicals: A WHO/IPCS framework. Regulatory Toxicology and Pharmacology, 60(2), S1–S14. [DOI] [PubMed] [Google Scholar]
- Messer, L. C. , Jagai, J. S. , Rappazzo, K. M. , & Lobdell, D. T. (2014). Construction of an environmental quality index for public health research. Environmental Health, 13(1), 1–22. 10.1186/1476-069x-13-39 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mink, P. J. , Mandel, J. S. , Sceurman, B. K. , & Lundin, J. I. (2012). Epidemiologic studies of glyphosate and cancer: A review. Regulatory Toxicology and Pharmacology, 63(3), 440–452. 10.1016/j.yrtph.2012.05.012 [DOI] [PubMed] [Google Scholar]
- Moretto, A. , Bachman, A. , Boobis, A. , Solomon, K. R. , Pastoor, T. P. , Wilks, M. F. , & Embry, M. R. (2017). A framework for cumulative risk assessment in the 21st century. Critical Reviews in Toxicology, 47(2), 85–97. 10.1080/10408444.2016.1211618 [DOI] [PubMed] [Google Scholar]
- Moriasi, D. N. , Arnold, J. G. , Van Liew, M. W. , Bingner, R. L. , Harmel, R. D. , & Veith, T. L. (2007). Model evaluation guidelines for systematic quantification of accuracy in watershed simulations. Transactions of the ASABE, 50(3), 885–900. 10.13031/2013.23153 [DOI] [Google Scholar]
- Nash, J. E. , & Sutcliffe, J. V. (1970). River flow forecasting through conceptual models part I—A discussion of principles. Journal of Hydrology, 10(3), 282–290. 10.1016/0022-1694(70)90255-6 [DOI] [Google Scholar]
- NCHS, & CDC . (2014). United States NVSS mortality data. National Center for Health Statistics, Centers for Disease Control and Prevention. [Google Scholar]
- Nogueira, L. M. , Yabroff, K. R. , & Bernstein, A. (2020). Climate change and cancer. CA: A cancer journal for clinicians, 70(4), 239–244. 10.3322/caac.21610 [DOI] [PubMed] [Google Scholar]
- NRC . (2009). Science and decisions: Advancing risk assessment. National Research Council, National Academies Press. [PubMed] [Google Scholar]
- Openshaw, S. (1984). The modifiable areal unit problem. Geo books. [Google Scholar]
- OSHA . (2010). Safety and health topics: Carcinogens. Occupational Safety and health administration (p. 22). United States Department of Labor. [Google Scholar]
- Ouyang, Y. (2005). Evaluation of river water quality monitoring stations by principal component analysis. Water Research, 39(12), 2621–2635. 10.1016/j.watres.2005.04.024 [DOI] [PubMed] [Google Scholar]
- Park, A. S. , Ritz, B. , Yu, F. , Cockburn, M. , & Heck, J. E. (2020). Prenatal pesticide exposure and childhood leukemia–A California statewide case‐control study. International Journal of Hygiene and Environmental Health, 226, 113486. 10.1016/j.ijheh.2020.113486 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parrish, R. G. (2010). Measuring population health outcomes. Preventing Chronic Disease, 7(4), A71. [PMC free article] [PubMed] [Google Scholar]
- Pascale, A. , & Laborde, A. (2020). Impact of pesticide exposure in childhood. Reviews on Environmental Health, 35(3), 221–227. 10.1515/reveh-2020-0011 [DOI] [PubMed] [Google Scholar]
- Patel, D. M. , Jones, R. R. , Booth, B. J. , Olsson, A. C. , Kromhout, H. , Straif, K. , et al. (2020). Parental occupational exposure to pesticides, animals and organic dust and risk of childhood leukemia and central nervous system tumors: Findings from the International Childhood Cancer Cohort Consortium (I4C). International Journal of Cancer, 146(4), 943–952. 10.1002/ijc.32388 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Piacentini, R. D. , Della Ceca, L. S. , & Ipiña, A. (2018). Climate change and its relationship with non‐melanoma skin cancers. Photochemical and Photobiological Sciences, 17(12), 1913–1917. 10.1039/c7pp00405b [DOI] [PubMed] [Google Scholar]
- Pogoda, J. M. , & Preston‐Martin, S. (1997). Household pesticides and risk of pediatric brain tumors. Environmental Health Perspectives, 105(11), 1214–1220. 10.1289/ehp.971051214 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pomeroy, S. L. , Tamayo, P. , Gaasenbeek, M. , Sturla, L. M. , Angelo, M. , McLaughlin, M. E. , et al. (2002). Prediction of central nervous system embryonal tumour outcome based on gene expression. Nature, 415(6870), 436–442. 10.1038/415436a [DOI] [PubMed] [Google Scholar]
- Price, A. L. , Patterson, N. J. , Plenge, R. M. , Weinblatt, M. E. , Shadick, N. A. , & Reich, D. (2006). Principal components analysis corrects for stratification in genome‐wide association studies. Nature Genetics, 38(8), 904–909. 10.1038/ng1847 [DOI] [PubMed] [Google Scholar]
- Ramis, R. , Gómez‐Barroso, D. , Tamayo, I. , García‐Pérez, J. , Morales, A. , Romaguera, E. P. , & López‐Abente, G. (2015). Spatial analysis of childhood cancer: A case/control study. PLoS One, 10(5), e0127273. 10.1371/journal.pone.0127273 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rencher, A. C. (2002). Principal component analysis. Methods of multivariate analysis, (2nd ed., pp. 380–407).
- Reynolds, P. , Von Behren, J. , Gunier, R. B. , Goldberg, D. E. , Harnly, M. , & Hertz, A. (2005). Agricultural pesticide use and childhood cancer in California. Epidemiology, 93–100. 10.1097/01.ede.0000147119.32704.5c [DOI] [PubMed] [Google Scholar]
- Reynolds, P. , Von Behren, J. , Gunier, R. B. , Goldberg, D. E. , Hertz, A. , & Smith, D. F. (2003). Childhood cancer incidence rates and hazardous air pollutants in California: An exploratory analysis. Environmental Health Perspectives, 111(4), 663–668. 10.1289/ehp.5986 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rhoades, M. G. , Meza, J. L. , Beseler, C. L. , Shea, P. J. , Kahle, A. , Vose, J. M. , et al. (2013). Atrazine and nitrate in public drinking water supplies and non‐Hodgkin lymphoma in Nebraska. Environmental health insights, EHI, 7, S10629. 10.4137/ehi.s10629 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rusiecki, J. A. , De Roos, A. , Lee, W. J. , Dosemeci, M. , Lubin, J. H. , Hoppin, J. A. , et al. (2004). Cancer incidence among pesticide applicators exposed to atrazine in the Agricultural Health Study. Journal of the National Cancer Institute, 96(18), 1375–1382. 10.1093/jnci/djh264 [DOI] [PubMed] [Google Scholar]
- Scélo, G. , Metayer, C. , Zhang, L. , Wiemels, J. L. , Aldrich, M. C. , Selvin, S. , et al. (2009). Household exposure to paint and petroleum solvents, chromosomal translocations, and the risk of childhood leukemia. Environmental Health Perspectives, 117(1), 133–139. 10.1289/ehp.11927 [DOI] [PMC free article] [PubMed] [Google Scholar]
- SCHER, S. (2013). SCCS (scientific committee on health and environmental risks, scientific committee on emerging and newly identified health risks and scientific committee on consumer Safety), Addressing the new challenges for risk assessment.
- Scott, L. C. , Barker, L. E. , & Richardson, L. C. (2019). Peer reviewed: Using population health measures to evaluate the environmental burden of cancer at the county level. Preventing Chronic Disease, 16. 10.5888/pcd16.180530 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Seierstad, T. , Røe, K. , Sitter, B. , Halgunset, J. , Flatmark, K. , Ree, A. H. , et al. (2008). Principal component analysis for the comparison of metabolic profiles from human rectal cancer biopsies and colorectal xenografts using high‐resolution magic angle spinning 1 H magnetic resonance spectroscopy. Molecular Cancer, 7(1), 33. 10.1186/1476-4598-7-33 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sexton, K. (2015). Cumulative health risk assessment: Finding new ideas and escaping from the old ones. Human and Ecological Risk Assessment: An International Journal, 21(4), 934–951. 10.1080/10807039.2014.946346 [DOI] [Google Scholar]
- Sherief, L. M. , Abdelkhalek, E. R. , Gharieb, A. F. , Sherbiny, H. S. , Usef, D. M. , Almalky, M. A. , et al. (2015). Cadmium status among pediatric cancer patients in Egypt. Medicine, 94(20). 10.1097/md.0000000000000740 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shigemizu, D. , Akiyama, S. , Asanomi, Y. , Boroevich, K. A. , Sharma, A. , Tsunoda, T. , et al. (2019). Risk prediction models for dementia constructed by supervised principal component analysis using miRNA expression data. Communications biology, 2(1), 1–8. 10.1038/s42003-019-0324-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Siegel, D. A. , Li, J. , Henley, S. J. , Wilson, R. J. , Lunsford, N. B. , Tai, E. , & Van Dyne, E. A. (2018). Geographic variation in pediatric cancer incidence—United States, 2003–2014. Morbidity and Mortality Weekly Report, 67(25), 707. 10.15585/mmwr.mm6725a2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Silvera, S. A. N. , Mayne, S. T. , Risch, H. A. , Gammon, M. D. , Vaughan, T. , Chow, W.‐H. , et al. (2011). Principal component analysis of dietary and lifestyle patterns in relation to risk of subtypes of esophageal and gastric cancer. Annals of Epidemiology, 21(7), 543–550. 10.1016/j.annepidem.2010.11.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Skala, M. C. , Palmer, G. M. , Vrotsos, K. M. , Gendron‐Fitzpatrick, A. , & Ramanujam, N. (2007). Comparison of a physical model and principal component analysis for the diagnosis of epithelial neoplasias in vivo using diffuse reflectance spectroscopy. Optics Express, 15(12), 7863–7875. 10.1364/oe.15.007863 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soldin, O. P. , Nsouly‐Maktabi, H. , Genkinger, J. M. , Loffredo, C. A. , Ortega‐Garcia, J. A. , Colantino, D. , et al. (2009). Pediatric acute lymphoblastic leukemia and exposure to pesticides. Therapeutic Drug Monitoring, 31(4), 495. 10.1097/ftd.0b013e3181aae982 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steenland, K. , & Ward, E. (2014). Silica: A lung carcinogen. CA:A cancer journal for clinicians, 64(1), 63–69. 10.3322/caac.21214 [DOI] [PubMed] [Google Scholar]
- Steffen, C. , Auclerc, M. , Auvrignon, A. , Baruchel, A. , Kebaili, K. , Lambilliotte, A. , et al. (2004). Acute childhood leukaemia and environmental exposure to potential sources of benzene and other hydrocarbons; a case‐control study. Occupational and Environmental Medicine, 61(9), 773–778. 10.1136/oem.2003.010868 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Swensen, A. R. , Ross, J. A. , Severson, R. K. , Pollock, B. H. , & Robison, L. L. (1997). The age peak in childhood acute lymphoblastic leukemia: Exploring the potential relationship with socioeconomic status. Cancer: Interdisciplinary International Journal of the American Cancer Society, 79(10), 2045–2051. [DOI] [PubMed] [Google Scholar]
- Thompson, J. A. , Carozza, S. E. , & Zhu, L. (2007). An evaluation of spatial and multivariate covariance among childhood cancer histotypes in Texas (United States). Cancer Causes & Control, 18(1), 105–113. 10.1007/s10552-006-0085-8 [DOI] [PubMed] [Google Scholar]
- USEPA . (2004). Integrated risk information system (IRIS)‐chemical assessment summary. US Environmental Protection Agency‐National Center for Environmental Assessment. [Google Scholar]
- Van Maele‐Fabry, G. , Gamet‐Payrastre, L. , & Lison, D. (2017). Residential exposure to pesticides as risk factor for childhood and young adult brain tumors: A systematic review and meta‐analysis. Environment International, 106, 69–90. 10.1016/j.envint.2017.05.018 [DOI] [PubMed] [Google Scholar]
- Vinceti, M. , Rothman, K. J. , Crespi, C. M. , Sterni, A. , Cherubini, A. , Guerra, L. , et al. (2012). Leukemia risk in children exposed to benzene and PM 10 from vehicular traffic: A case–control study in an Italian population. European Journal of Epidemiology, 27(10), 781–790. 10.1007/s10654-012-9727-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vineis, P. , Huybrechts, I. , Millett, C. , & Weiderpass, E. (2021). Climate change and cancer: Converging policies. Molecular Oncology, 15(3), 764–769. 10.1002/1878-0261.12781 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wakeford, R. (2013). The risk of childhood leukaemia following exposure to ionising radiation—A review. Journal of Radiological Protection, 33(1), 1. 10.1088/0952-4746/33/1/1 [DOI] [PubMed] [Google Scholar]
- Wheeler, D. C. (2007). A comparison of spatial clustering and cluster detection techniques for childhood leukemia incidence in Ohio, 1996–2003. International Journal of Health Geographics, 6(1), 1–16. 10.1186/1476-072x-6-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wigle, D. T. , Arbuckle, T. E. , Turner, M. C. , Bérubé, A. , Yang, Q. , Liu, S. , & Krewski, D. (2008). Epidemiologic evidence of relationships between reproductive and child health outcomes and environmental chemical contaminants. Journal of Toxicology and Environmental Health, Part B, 11(5–6), 373–517. 10.1080/10937400801921320 [DOI] [PubMed] [Google Scholar]
- Withrow, D. R. , de Gonzalez, A. B. , Lam, C. J. , Warren, K. E. , & Shiels, M. S. (2019). Trends in pediatric central nervous system tumor incidence in the United States, 1998–2013. Cancer Epidemiology and Prevention Biomarkers, 28(3), 522–530. 10.1158/1055-9965.epi-18-0784 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wold, S. , Esbensen, K. , & Geladi, P. (1987). Principal component analysis. Chemometrics and Intelligent Laboratory Systems, 2(1–3), 37–52. 10.1016/0169-7439(87)80084-9 [DOI] [Google Scholar]
- Yang, F. , & Massey, I. Y. (2019). Exposure routes and health effects of heavy metals on children. Biometals, 32(4), 563–573. [DOI] [PubMed] [Google Scholar]
- Zachek, C. M. , Miller, M. D. , Hsu, C. , Schiffman, J. D. , Sallan, S. , Metayer, C. , & Dahl, G. V. (2015). Children's cancer and environmental exposures: Professional attitudes and practices. Journal of pediatric hematology/oncology, 37(7), 491. 10.1097/mph.0000000000000416 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zahm, S. H. , & Ward, M. H. (1998). Pesticides and childhood cancer. Environmental Health Perspectives, 106(suppl 3), 893–908. 10.2307/3434207 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zang, E. A. , & Wynder, E. L. (1996). Differences in lung cancer risk between men and women: Examination of the evidence. JNCI: Journal of the National Cancer Institute, 88(3–4), 183–192. 10.1093/jnci/88.3-4.183 [DOI] [PubMed] [Google Scholar]
- Zhitkovich, A. (2011). Chromium in drinking water: Sources, metabolism, and cancer risks. Chemical Research in Toxicology, 24(10), 1617–1629. 10.1021/tx200251t [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supporting Information S1
Data Availability Statement
Pediatric cancer incidence data of current work is not open to the public as the health information is confidential as required by state law (Idaho Code §57‐1706). Investigators seeking pediatric cancer incidence data in Idaho should directly make a request to the Cancer Data Registry of Idaho at https://www.idcancer.org/index.html. Pesticide data can be accessed from the United States Geographic Survey Pesticide National Synthesis Project (USGS‐PNSP) at https://water.usgs.gov/nawqa/pnsp/usage/maps/compound_listing.php. Groundwater quality data in Idaho can be accessed from the Idaho Department of Water Resources at https://idwr.idaho.gov/water-data.
