Abstract
Laboratory experiments have established that exposure to certain endocrine-active substances prior to and/or during the period of sexual differentiation can lead to skewed sex ratios in fish. However, the potential long-term population impact of biased sex ratio depends on multiple factors including the life history of the species and whether the ratio is male or female-biased. In the present study, we describe a novel multidimensional, density-dependent matrix model that analyzes age class-structure of both males and females over time, allowing for the quantitative evaluation of the effects of biased sex ratio on population status. This approach can be used in conjunction with field monitoring efforts and/or laboratory testing to link effects on sex ratio due to chemical and/or nonchemical stressors to adverse outcomes in whole organisms and populations. For demonstration purposes, we applied the model to evaluate population trajectories for fathead minnow (Pimephales promelas) exposed to prochloraz, an aromatase inhibitor, during sexual differentiation. The model also was used to explore the population impact in a more realistic exposure scenario in which both adult and early life stages of fish are exposed concurrently to prochloraz, which, in addition to altering sex ratio during development, can decrease vitellogenin and egg production in adult females. For each exposure scenario, the model was used to analyze total population size, numbers of females and of males, and sex specific recruitment of the F1 generation. The present study illustrates the utility of multidimensional matrix population models for ecological risk assessment in terms of integrating effects across a population of an organism even when chemical effects on individuals are manifested via different pathways depending on life stage.
Keywords: Endocrine active chemical, Adverse outcome pathway, Fathead minnow, Population model, Ecological risk assessment
INTRODUCTION
Potential ecological effects of chemicals that interact with the vertebrate hypothalamic pituitary gonadal and/or thyroidal (HPG/T) axes continue to be of scientific and regulatory concern throughout the world (Matthiessen et al., 2017). A variety of in vitro and in vivo assays have been developed to help identify endocrine-active chemicals (EACs) with the potential to affect different aspects of estrogen, androgen and thyroid hormone signaling in vertebrate wildlife (Coady et al., 2017). Many of these assays involve evaluation of molecular, biochemical, cellular and tissue-level changes that reflect perturbation of HPG/T function. While changes at these biological levels of organization can be highly diagnostic of perturbation of specific pathways, there remains the challenge of translating them into potential adverse effects meaningful to risk assessors/managers. The adverse outcome pathway (AOP) framework (Ankley et al., 2010) seeks to establish transparent, causal linkages between responses at different levels of organization and, hence, has been proposed as a basis for utilizing data from pathway-based EAC assays for higher-level risk assessments (Browne et al., 2017; Coady et al., 2017; Knapen et al., 2020; McCardle et al., 2020). One of the challenges in developing AOPs relevant to assessment of EAC risk(s) has been establishing linkages between changes in apical responses in individuals and potential impacts on populations. In making causal linkages between changes in individuals and populations, it is necessary both to identify assay endpoints relevant to population status and develop flexible modeling constructs that employ these endpoints (Kramer et al., 2011; Marty et al., 2017).
The relative number of functional males and females in a reproducing cohort is an important parameter potentially influencing population status which can be affected both by chemical and nonchemical stressors (Dang & Kienzler, 2019; Norris & Carr, 2020; Yamamoto, 1969). Studies in fish have established that changes in normal sex ratios can be caused by different types of EACs that alter signaling controlled by endogenous estrogens and androgens (ECHA 2008; OECD 2018). These changes can occur in conjunction with EAC exposure both during early development (organizational effects) and in reproductively mature adults (activational events; Ankley & Johnson, 2004; Guillette et al., 1995). Effects of EACs on sex ratios can either be direct, caused by chemicals that mimic or block the actions of endogenous steroids with estrogen and/or androgen receptors, or indirect through alteration of the synthesis of endogenous steroids (Ankley & Johnson, 2004; Guillette et al., 1995).
Reports of masculinized or male-biased fish populations in the field are less common than female-skewed populations (Matthiessen & Weltje, 2015) but have been reported in conjunction with runoff from animal feedlots or pulp and paper mill discharges, some of which contain androgen receptor agonists (Bortone & Cody, 1999; Durhan et al., 2006; Hanson et al., 2005; Howell et al., 1980; Larsson et al., 2000; Orlando et al., 2004; Parks et al., 2001; Soto et al., 2004). In fact, natural and synthetic androgens have been used for many years in aquaculture to intentionally produce male-biased populations in a variety of fish species (e.g., Arslan & Phelps, 2004; Galvez et al., 1996; Kitano et al., 2000; Singh, 2013). Bogers et al. (2006) showed that exposure of fathead minnows (Pimephales promelas) to the synthetic androgen receptor agonist methyl dihydrotestosterone during early development produced populations skewed toward males as determined through inspection of gonad morphology/histology. Male-biased fish populations also can be produced by chemicals, such as the model EAC fadrozole, that inhibit the activity of aromatase (cytochrome P450191a1; CYP19), which catalyzes the conversion of endogenous androgens such as testosterone to 17β-estradiol (Kitano et al., 2000; Kwon et al., 2000; Le Page et al., 2010; Piferrer et al., 1994). Other chemicals that can inhibit CYP19 activity such as some conazole fungicides also can produce male-biased populations when fish are exposed during the period of sexual differentiation (Matthiessen & Weltje, 2015). For example, exposures of non-sexually differentiated early life stages of both zebrafish (Danio rerio) and fathead minnow to the conazole prochloraz has been shown to produce male-biased sex ratios based on gonad differentiation (Holbech et al., 2012; Kinnberg et al., 2007; Thorpe et al., 2011). The ability of aromatase inhibitors to affect sex differentiation in fish has been well enough characterized that a putative AOP capturing the process has been developed (Society for the Advancement of Adverse Outcome Pathways [SAAOP], 2016; AOP346).
Alterations in phenotypic sex ratios in fish have been used in a variety of screening and testing assays designed to detect EACs in a regulatory setting (Ankley & Johnson, 2004; Dang & Kienzler, 2019). A relevant example of this is the Fish Sexual Development Test (FSDT) developed and validated through activities coordinated by the Organisation for Economic Co-operation and Development (Holbech et al., 2012; OECD 2018). The FSDT (OECD TG 234) is a multi-endpoint assay initiated with newly fertilized embryos and proceeding through early adulthood. The design can accommodate testing with several model small fish species, including zebrafish and fathead minnow (Holbech et al., 2012). Endpoints evaluated include those that can be used as a basis to estimate sex ratios, such as gonad differentiation and secondary sex characteristics, and responses indicative of other aspects of HPG axis function (e.g., gonadal abnormalities, vitellogenin [VTG]; egg yolk protein precursor protein] expression or production). Consequently, the assay is capable of detecting changes associated with multiple molecular initiating events (MIEs) relevant to AOPs (e.g., SAAOP, 2016; AOPs 346, 25, 23).
To employ data from assays such as the FSDT to estimate ecological risks to fish populations, a flexible population modeling approach that can incorporate multi-generational responses is ideal. Since their introduction over 50 years ago, structured population models have become a central modeling formalism, and are commonly used in ecology (Caswell, 2001; Ellner, 2009). The use of matrix population models within ecological risk assessments is advantageous because such models can integrate effects across the life cycle, link endpoints observed in the individual to ecological risk for the population as a whole, and project outcomes over future timespans allowing for management planning scenarios.
A matrix model includes analysis of the dynamics of the total population, whereby changes are predicted from the collective of the individuals comprising the population. Matrix population models originally were designed to classify individuals by a single characteristic (Leslie, 1945; Lewis, 1942). Using this approach, population dynamics are described in terms of a single dimension (for example, age) of individuals making up the population (Caswell, 2001; Metz & Dickmann, 1986). The model projects the distribution of the population as a set of possible outcomes assigned to the dimension over time (i.e., age classes), where individuals move among these possible outcomes (age classes) according to vital rates presented in a Leslie matrix. However, as data collection methods have advanced and more sophisticated data sets are produced in the laboratory and field settings (a relevant example being the FDST assay), utilizing multiple dimensions (i.e. age, size, sex) within demographic models will become increasingly important. A multidimensional, density dependent matrix population model for assessing risk of stressors to fish populations was recently described by Miller et al. (2020). Such an approach allows for the inclusion of density dependent effects, the ability to incorporate higher dimensions into matrix models, and the extension of demographic state spaces, as well as directly impacting data usage to guide conservation and population management practices.
Traditional matrix modeling approaches use a single dimension to describe population dynamics. An assumed sex ratio is implicitly built into the model. Most often, the model is female based (Caswell, 2001; Ellner, 2009; Gotelli, 1998). In this way the model predicts recruitment of females, by females, and all age classes refer to surviving females over time. If the sex ratio is assumed to be constant at 50% female and 50% male, then the total population size can be determined by scaling the output of the projection accordingly. Alternatively, if a form of the logistic equation is used along with the assumption of an equal sex ratio, then the total population size can be expressed as a fraction of carrying capacity (Miller et al.,, 2013, 2015; Thursby, 2009, 2016; Thursby et al., 2018).
In the present study, we describe and apply a multidimensional density dependent matrix model to examine the impact of a chemical stressor that results in a male-biased sex ratio over time. The model allows for the sex ratio of the population to be explicitly defined, such that population dynamics of both females and males are explicitly quantified under scenarios using varying sex ratios. Furthermore, we demonstrate how the model can be applied to examine the impact of simultaneous effects on both sexual differentiation (sex ratio; i.e., AOP 346) and adult female fecundity (i.e., AOP 25; Conolly et al., 2017; Miller et al., 2007) on exposure of an entire cohort of fish to an EAC. Overall, the model provides support for a causal link between a male-biased sex ratio and reduced population trajectory (i.e., https://aopwiki.org/relationships/2147, accessed January 31, 2021) for species with a life history analogous to that of fathead minnows.
METHODS
Theory and conceptual demonstration
The present multidimensional model builds on the population modeling approach originally described by Miller and Ankley (2004), which is a density-dependent logistic matrix model constructed using a Leslie projection matrix (Leslie, 1945) in combination with the logistic equations and had been used for a variety of species and applications (Miller & Ankley, 2004, Miller et al., 2007, Ankley et al., 2008, Miller et al., 2013, Miller et al., 2015):
(1) |
(2) |
In the context of the present model, nt+1 is the vector of population age and sex structure at time t + 1, nt is the vector of population age and sex structure at time t, r is the intrinsic rate of increase, Pt is the population size at time t, K is carrying capacity, and M1 is the Leslie matrix containing vital rates (survivorship and fertility) that have been adjusted to include an age-specific and/or sex-specific percentage reductions in fertility and/or survival over the time step t resulting from an exposure to chemical and/or nonchemical stressors. Thus, within Equation 2, Ct is a matrix representing the discount to vital rates resulting from exposure to the stressor(s) at time t (Miller et al., 2013). In addition, the density dependence accounted for by the model acts cumulatively on the population over life stages and generations resulting in stabilization of the population. The formulation of the model of Equation 1 and Equation 2 provides a link between life-history parameters that can be directly measured in the laboratory or at the field site, the logistic equation, and Leslie's original projection matrix.
Using birth pulse survival probabilities, birth pulse fertilities, and a prebreeding census (Caswell, 2001; Gotelli, 1998), the Leslie matrix, as used in the present study (Equation 3), can be written as a multidimensional projection matrix with two binary sexes within three age classes (with two non-overlapping sex classes per age class):
(3) |
In examining the vital rates within the matrix M, fertility rates are indexed first by the age class producing offspring, second by the sex of the fish being produced, and third by the sex of the fish producing offspring. For example, F3,F,F corresponds to recruitment of female offspring of by Age 3 fish that are female. Survival rates are indexed first by current age class, second by sex of the fish that will move into the sequential age class over the time step t. Thus, S2,F would represent the survival rate of Age 2 females moving from age Class 2 into age Class 3 over the time step t. Within the matrix M, fertility rates are calculated by adjusting fecundity by the percentage of maturity and age class 0 survival (Gotelli, 1998, Caswell, 2001). The dominant eigenvalue of the Leslie matrix represents the finite rate of increase. Taking the natural log of the dominant eigenvalue of the Leslie matrix results in the intrinsic rate of increase, an estimate of the per capita rate of population increase associated with a population represented by the rates in the matrix.
In simple qualitative terms, application of the density-dependent logistic matrix model of Equations 1 and 2 requires no additional parameters beyond what is found in a combined life and fecundity table that contains sex ratio estimates by age, which is converted to the projection matrix (Equation 3). The model also requires an estimate of carrying capacity and an estimate of the effect of the chemical stressor on the vital rates of fertility and survivorship as found in the projection matrix.
A multi-dimensional projection matrix (Equation 3) was developed for fathead minnow. Life history characteristics for the fathead minnow were collected and analyzed from multiple studies (Duda, 1989; Gleason & Nacci, 2001; Westman, 1938; Zischke et al., 1983), and are summarized in Table 1. Fathead minnows breed annually within a breeding period that lasts 2–3 months. Female fathead minnows mature at age 1 year and reproduce annually with reproductive output that varies with age (Duda, 1989; Gleason & Nacci, 2001; Westman, 1938; Zischke et al., 1983). A corresponding multidimensional projection matrix that utilized a formulation containing birth pulse fertilities and a pre-breeding census based on Equation 3 was constructed (Figure 1).
TABLE 1:
Age (years) | Survival (per year) | Fecundity (eggs/year) |
---|---|---|
0 | 1 | 0 |
1 | 0.001 | 750 |
2 | 0.00039 | 1500 |
3 | 0.0001521 | 3000 |
4 | 0 | N/A |
We conducted simulations investigating how an environmental stressor that causes multigenerational effects including male-biased sex ratio and altered reproductive capacity would theoretically impact total population size, age structure and sex structure for a fathead minnow population initially at carrying capacity. For all simulations, the population was initiated with the population having an equal sex ratio. At time Step 1 in each simulation, the population projection was altered in favor of male over female production. We investigated a range of potential male-biased sex ratios including 60% male and 40% female, 70% male and 30% female, 80% male and 20% female, and 90% male and 10% female. In addition, for each simulation, trends in total males and total females were analyzed over time to allow for an understanding of differences in the increase of males versus females as a component of total population size. Each simulation was initiated at stable age distribution as calculated from the projection matrix. Stable age distribution was determined from the matrix by finding an eigenvector (right eigenvector) associated with the dominant eigenvalue of the matrix and rescaling the eigenvector (Caswell, 2001; Gotelli, 1998). To provide an indication of relative impact, output of the model can be expressed invariant of actual carrying capacity by plotting population size proportional to carrying capacity at each time step in the model. In demonstrating model output in this manner; a value of 1.0 represents a population at carrying capacity and values between 0 and 1.0 represent a population below the carrying capacity threshold (Miller et al., 2013, 2015, 2020). The population model was executed over a 10-year simulation period, and results were recorded using an annual time step. All model projections utilized the intrinsic rate of increase as calculated from the Leslie matrix.
Case study: Modeling exposure to prochloraz
We evaluated performance of the model construct using data from a FSDT study with prochloraz, a model inhibitor of CYP19 (Holbech et al., 2012; Table 2). Sex ratio data were used as input to the multidimensional density dependent population model in Equations 1 and 2. We calculated several measures including total population size over time, and number of male and female fish in the population over time, as a function of the sex ratio changes caused by prochloraz.
TABLE 2:
Control |
31 µg/L |
106 µg/L |
301 µg/L |
||||
---|---|---|---|---|---|---|---|
Sex | Percentage In population | Percentage In population | Relative change From control | Percentage In population | Relative change From control | Percentage In population | Relative change From control |
Female % | 47 | 44 | −6.4 | 40 | −14.9 | 7 | −85.1 |
Male % | 47 | 44 | −6.4 | 54 | +14.9 | 79 | +68 |
Undifferentiated % | 6 | 12 | +100 | 6 | 0 | 14 | +133 |
Undifferentiated fish at 120 days post hatch are considered to be uncapable of breeding.
Next, we expanded the application of the multidimensional density dependent population model to predict multigenerational effects caused by inhibition of CYP19 in both early development and adult life stages. Again, data used to evaluate model performance came from the fathead minnow FSDT reported by Holbech et al. (2012). In addition to the sex ratio data (Table 2), Holbech et al. (2012) also reported the effects of prochloraz on VTG concentrations in adult females from the exposure (Table 3). The approach of Miller et al. (2007) was used to predict egg production based on VTG concentrations in females using a linear model (Equation 4; Conolly et al., 2017; Miller et al., 2007):
(4) |
TABLE 3:
Exposure | VTG ng/g homogenate | Relative VTGa | Relative Fecundityb |
---|---|---|---|
Control | 300 000 | N/A | N/A |
31 µg/L | 100 000 | 33.33% | 31.6215 |
106 µg/L | 30 000 | 10% | 9.458 |
301 µg/L | 50 | 0.0001% | 0c |
Relative change is calculated in relation to VTG of control fish.
Relative fecunidity is predicted in relation to the fecundity of control fish using the equation: (Relative Fecundity) = −0.042 + 0.95 × (Relative VTG) taken from Miller et al. (2007).
Estimated relative fecundity canť be negative.
This relationship was integrated into the multidimensional density dependent population model to translate changes in VTG concentrations of female fathead minnows to alterations in reproductive capacity that would thus impact population trajectory.
Simulation results were structured into a progressive format. First, we calculated total population size over time, number of male fish in the population over time, and number of female fish in the population over time as a consequence of prochloraz-induced decreases in VTG. Second, we calculated the same population-level measures (i.e., total population size, number of male and female fish in the population) quantifying the combined effects resulting from both altered sex ratio and decreased VTG in prochloraz-exposed fish. For all simulations in the case study, the population of fathead minnow initially existed at carrying capacity and was subsequently exposed to prochloraz.
All calculations were performed using a combination of software packages including Microsoft Excel for Microsoft 365, SPSS, and Mathcad. Example calculations demonstrating the application of the model can be found in Supporting Information.
RESULTS
Conceptual demonstration: Consequences of a male-biased sex ratio
The multidimensional matrix yielded an intrinsic rate of increase of 0.337 in a control fathead minnow population (Figure 1). The annual vital rates of fertility across the age classes within the projection matrix were subsequently adjusted to account for different degrees of a male-biased population, ranging from 60% to 90% male, and projected trends in total population size over time were calculated as a function of baseline carrying capacity with Equations 1 and 2 (Figure 2). A fathead minnow population at carrying capacity exposed to a stressor that resulted in a male-biased sex ratio of 60:40 exhibited an approximate 7.9% decrease in population size after 2 years, a 26.8% reduction in population size after 5 years, and a 36.1% reduction in population size after 10 years (Figure 2). At the other end of the spectrum, a male-biased sex ratio of 90:10 had a 31.6% reduction in population size after years, an 87.6% reduction in population size after 5 years, and a 99.1% reduction in population size after 10 years (Figure 2).
Output consisting of time series trends in population status over time were also generated specific to a given dimension of the matrix to examine patterns in abundance of total males versus total females. For example, trajectories for males and females over time for a fathead minnow population initially at carrying capacity and subsequently exposed to a stressor that resulted in a male-biased sex ratio of 70:30 is shown in Figure 3. In contrast to a total population size that remains unchanged at the carrying capacity after one time step, the male-biased sex ratio resulted in an immediate increase in males from 50% to approximately 64.8% and a corresponding decrease in females. This is the highest point for both sexes, after which population decline results from the male-bias (as these fish reach breeding capability).
Practical demonstration: Effects of an EAC
We subsequently evaluated performance of the model using data from controlled studies with a known EAC, prochloraz (Holbech et al., 2012; Table 2). Fertility rates within the projection matrix corresponding to the recruitment of males and females were based on sex ratio data for the 31, 106 and 301 μg/L treatment groups. All the prochloraz treatments resulted in a predicted decline in total population size over time (Figure 4). For example, observed changes in sex ratio at 31 μg prochloraz /L would cause a 2.5% decrease in average population size after 2 years, an 8.8% reduction in population size after 5 years, and a 11.4% reduction in population size after 10 years. Considering effects on sex ratio alone, exposure to 301 μg prochloraz/L was projected to cause an approximate 33.6% decrease in predicted population size after 2 years, a 91.8% reduction after 5 years and, basically, complete extinction (99.7% reduction) after 10 years. The model predicted declining trends in both total male fish and total female fish in the population that were more prevalent with increased exposure concentration (Figure 5).
In applying the multidimensional model to evaluate only reduced VTG production by adult females on population size, exposure to all concentrations of prochloraz resulted in reduced reproductive capacity of adult female fish that translated into a decline in total population size over time (Figure 6). For example, a fathead minnow population at carrying capacity and subsequently exposed to prochloraz at 31 μg/L resulted in an approximate 68.0% decrease after 2 years, a 89.5% reduction after 5 years, and a 97.8% reduction after 10 years. Consequences of decreased VTG in adult females on predicted population size in the 106 and 301 μg prochloraz/L treatments exhibited similar concentration-dependent temporal trends (Figure 6). Model-predicted decreases in population size due to prochloraz-induced reductions of VTG were expressed to the same degree in both males and females (data not shown).
Finally, the model was applied to consider the combined effects of both the altered sex ratio and impacts on adult female VTG concentrations (Figure 7). All three concentrations of prochloraz affected sex ratio and reduced reproductive capacity of adult female fish, which together translated into a decline in total population size over time. The effects of prochloraz on VTG in adult females elicited a more immediate and greater impact on total population size than observed changes in sex ratio in a given treatment group (Figure 7). For example, the combined effects of a male-skewed sex ratio and decreased VTG in females in fish exposed to 31 μg prochloraz/L, resulted in an approximate 68.3% decrease in average population size after 2 years, a 91.3% reduction after 5 years, and a 98.3% reduction after 10 years. These values were virtually the same as predictions based only on reduced VTG (Figure 6). Trends in overall population size were concentration-dependent, with population extinction occurring within 10 and years in the 106 and 301 μg prochloraz/L treatments, respectively (Figure 7). Again, these predictions were the same as those generated using reductions in VTG only (Figure 6). However, in the forecasts considering both the effect on sex ratio and VTG concentrations in adult females, there was a greater relative decrease in females than in males compared to predicted population impacts due to reductions in VTG alone (Figure 8).
DISCUSSION
Occurrence and potential impacts of EACs in fish and wildlife species are an ongoing concern worldwide. Screening/testing and monitoring programs for EACs entering or already present in the environment typically involve two considerations: (a) evaluation of whether a chemical (or chemical mixture) actually alters HPG/T function, and (b) whether this alteration has the potential to produce adverse effects in individuals and populations (Matthiessen et al., 2017). A variety of novel in vitro and in vivo assays employing molecular, biochemical and cellular endpoints have been developed to address the potential for chemicals to interact with endocrine pathways in nonmammalian vertebrates (Coady et al., 2017). However, bridging the gap from results of these mechanistic assays to determination of whether changes in basic endocrine function in fact cause adverse effects in individuals and populations has been challenging (Matthiessen et al., 2017). The focus of the AOP concept on assessing and depicting causal linkages in responses across biological levels of organization provides a logical basis for making the key connection between changes in HPG/T axis function and impacts meaningful to risk assessment (e.g., Browne et al., 2017; Coady et al., 2017; Knapen et al., 2020; McCardle et al., 2020). But, even within the context of the AOP framework, linking changes in individuals to population status remains a vexing problem and one that, apart from a few notable efforts (e.g., Kidd et al., 2007), has not been addressed for EACs based on experimental data. Consequently, there is a need for robust modeling approaches to predict the consequences of endocrine-relevant changes in individuals on population status (Kramer et al., 2011; Marty et al., 2017). We believe that the model described in the present study meets these needs in the context of providing a flexible, easily implemented approach to enhance prediction of population level impacts of EACs with the potential to affect multiple endpoints at different lifestages. The present model is easily adaptable to any species for which a life table containing vital rates of survivorship and fecundity, sex and age measurements of the population, and the effect of stressors on vital rates is available.
Various population level analysis (i.e., individual based models, Beverton-Holt models, matrix projection models) have been considered as relevant tools to examine changes in population viability resulting from impacts on fish due to endocrine disruption (Brown et al., 2015; Hanson et al., 2005; Hazlerigg et al., 2014; Meng et al., 2006; Miller & Ankley, 2004). In the present study, we evince the ability to effectively employ sex ratio data relative to predicting population effects, and demonstrate that skewed sex ratio has the potential to impact population sustainability over time. Sex ratio is an endpoint known to be altered by EACs that affect estrogen/androgen signaling (and one used in extant EAC testing assays, e.g., Ankley & Johnson, 2004; Holbech et al., 2012). Female-biased populations are a concern with respect to exposures to environmental estrogens (e.g., Purdom et al., 1994; World Health Organization, 2002). However, experimental data show that perturbation of some HPG pathways of concern (e.g., androgen receptor activation, aromatase inhibition) can produce male-biased populations (Ankley & Johnson, 2004; Guillette et al., 1995) potentially producing effects in the field (Bortone & Cody, 1999; Durhan et al., 2006; Hanson et al., 2005; Howell et al., 1980; Larsson et al., 2000; Orlando et al., 2004; Parks et al., 2001; Soto et al., 2004). The present model circumvents the limitation of previous models that employ Leslie projection matrices that consider only females, by allowing for explicit quantification and consideration of how dynamics of both sexes induce changes in population status. Formulation of the model in this way allows for effects from a stressor to be quantified for fish in the population specific to any given combination of sex and age.
The modeling approach demonstrated in the present study enables simultaneous consideration of impacts of EACs on multiple life-stages. Many types of EACs are capable of affecting multiple HPG pathways, potentially dependent on the life stage exposed. Exposures to EACs in field settings are complex often involving multiple chemicals that could impact different HPG pathways. Such exposures also will often be relevant to multiple generations within a population, particularly if inputs of an EAC(s) are constant, as would be the case for persistent or pseudo-persistent chemicals (Ankley et al., 2007). Consequently, population models that can consider the combined effects of an EAC(s) on different pathways relevant to different life-stages can provide a more realistic prediction of EAC impacts on a population than previous models. Practical applicability of the model of Equations 1 and 2 to consider multigenerational EAC effects was demonstrated using a dataset from a FSDT design that enables collection of HPG-responsive endpoints at different life-stages (Holbech et al., 2012; OECD 2018). The modeling demonstrated that although either the effect on sex ratio (AOP 346) or the impact on VTG production in adult females (AOP 25) could be expected to have a population-level effect, in combination it was the effect on female fecundity (via the reduced VTG) that was the more significant of the two impacts. A multidimensional modeling construct as presented herein could be used in this manner for other types of EACs/exposure scenarios to discern most susceptible endpoints/lifestages.
While the modeling and case study employed in the present study focused on potential impacts of EACs, other environmental stressors also have potential to bias sex ratios in fish and some other vertebrates. For example, many reptiles and some fish are known to have temperature dependent sex determination (Ospina-Álvarez & Piferrer, 2008; Shen & Wang, 2014; Yamaguchi & Iwasa, 2018) and warmer waters associated with global climate change have potential to masculinize some wild populations (Geffroy & Wedekind, 2020; Honeycutt et al., 2019). Alterations in habitat color or exposure to stress hormones like cortisol have also been shown to potentially create male bias in some species (Mankiewicz et al., 2013). Consequently, the multidimensional model illustrated in the present study can be expected to have applications beyond EACs and the specific AOPs examined.
Conceptually, the model can also be applied to a diversity of species. However, life history in relation to exposure dynamics and the mechanism(s) of sex determination employed in different fish species are an important consideration. The subject of the present modeling effort, the fathead minnow, is viewed as a r-selected species that produces a large number of offspring, each with a fairly low probability of survival. However, certain fish species are K-selected and produce comparatively few offspring, have longer times to sexual maturity, and an overall greater chance of reaching reproductive maturity. Adjustment of the vital rates within the life table (that result in the corresponding survivorship curves and maternity schedules) to the species of interest is critical in successful application of the model. For example, Thursby (2009) describes a methodology for formulating the survivorship curve for R versus K-selected species using a Weibull function. In addition, although aromatase activity and the ratios of estrogen to androgen concentration during differentiation appears critical to sex ratio determination in many species (see AOP 346; https://aopwiki.org/relationships/2167; accessed January 31, 2021), the same mechanism(s) may not hold in all species. Thus, reproductive strategy, mechanisms of differentiation, and even habitat with regard to potential for immigration and emigration all come into play when considering application to other species.
The model of Equations 1 and 2 utilized the assumption of a closed system. However, a metapopulation modeling approach (Galic et al., 2010) that integrates multi-patch spatial dynamics within Equation 1 can accommodate both immigration and emigration scenarios using the addition of population vectors to represent individuals of each age class entering or exiting the population at each time step. For example, expanding Equation 1 yields:
(5) |
where it is a vector of age structure at time t entering the population through immigration, and et is a vector of age structure at time t exiting the population through emigration. Application of a model construct whereby immigration and emigration fluxes are included will affect the resulting population trajectories because of the influence of the age structure, sex, and exposure history of fish moving into and out of the population at each time step. Such an approach would be appropriate for examining habitats that are spatially complex or for fish stocking programs whereby the immigration vector acts to include fish stocked, potentially of a specific age and/or sex.
In summary, the multidimensional matrix modeling approach employed in the present study can project population age structure for both females and males under conditions for which the sex ratio of the population varies over any given length of exposure time series. The model provides support for an inferred causal connection between male-biased sex ratio and potential adverse population-level consequences (AOP 346; https://aopwiki.org/relationships/2147). Further, this model allows for analysis that integrates multiple dimensions, such as evaluation of a given age class of a given sex. The modeling construct was successfully demonstrated to investigate complex multigenerational responses anchored to separate AOPs acting in concert on an exposed population of fish. The population model derived and applied in the present study facilitates inclusion of more than one attribute of the individual, as determined in field monitoring efforts (e.g., through effects-based monitoring programs) and/or laboratory experiments to link effects resulting from exposure to stressors to adverse outcomes in individuals and populations.
Supplementary Material
Acknowledgment—
We thank J. Sumpter for his advice early on in the work concerning consequences of male-skewed populations. We thank H. Holbech, K. Watanabe-Sailor, and two anonymous reviewers for their valuable review of this manuscript.
Footnotes
Supporting Information—The Supporting information are available on the Wiley Online Library at https://doi.org/10.1002/etc.5287.
Conflict of Interests—The author declares that there are no conflict of interests.
Disclaimer—This manuscript is original, has not been published before, and is not currently being considered for publication elsewhere. The information in this document has been funded wholly by the US Environmental Protection Agency. It has been subjected to review by the Center for Computational Toxicology and Exposure and approved for publication. Approval does not signify that the contents reflect the views of the Agency, nor does mention of trade names or commercial products constitute endorsement or recommendation for use.
Data Availability Statement—
Data, associated metadata, and calculation tools are available from the corresponding author (miller.davidh@epa.gov).
REFERENCES
- Ankley GT, Bennett RS, Erickson RJ, Hoff DJ, Hornung MW, Johnson RD, Mount DR, Nichols JW, Russom CL, Schmieder PK, Serrano JA, Tietge JE, & Villeneuve DL (2010). Adverse outcome pathways: A conceptual framework to support ecotoxicology research and risk assessment. Environmental Toxicology and Chemistry, 29, 730–741. [DOI] [PubMed] [Google Scholar]
- Ankley GT, Brooks BW, Huggett DB, & Sumpter JP (2007). Repeating history: Pharmaceuticals in the environment. Environmental Science and Technology, 40, 8211–8217. [DOI] [PubMed] [Google Scholar]
- Ankley GT, & Johnson RD (2004). Small fish models for identifying and assessing the effects of endocrine-disrupting chemicals. Institute of Laboratory Animal Resources, 45, 469–483. [DOI] [PubMed] [Google Scholar]
- Ankley GT, Miller DH, Jensen KM, Villeneuve DL, & Martinovic D (2008). Relationship of plasma sex steroid concentrations in female fathead minnows to reproductive success and population status. Aquatic Toxicology, 88, 69–74. [DOI] [PubMed] [Google Scholar]
- Arslan T, & Phelps RP (2004). Production of monosex male black crappie, Promoxis nigromaculatus, populations by multiple androgen immersion. Aquaculture, 234, 561–573. [Google Scholar]
- Bogers R, De Vries-Buitenweg S, Van Gils M, Baltussen E, Hargreaves A, van de Waart B, De Roode D, Legler J, & Murk A (2006). Development of chronic tests for endocrine active chemicals. Part 2: An extended fish early-life stage test with an androgenic chemical in the fathead minnow (Pimephales promelas). Aquatic Toxicology, 80, 119–130. [DOI] [PubMed] [Google Scholar]
- Bortone SA, & Cody RP (1999). Morphological masculinization in poeciliid females from a paper-mill effluent-receiving tributary of the St Johns River, Florida. Bulletin of Environmental Contamination and Toxicology, 63, 150–158. [DOI] [PubMed] [Google Scholar]
- Brown AR, Owen SF, Peters J, Zhang Y, Soffker M, Paull GC, Hosken DJ, Wahab MA, & Tyler CR (2015). Climate change and pollution speed declines in zebrafish populations. Proceedings of the National Academy of Sciences, USA, 112(11), 1237–1246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Browne P, Noyes PD, Casey W, & Dix DJ (2017). Application of adverse outcome pathways to USEPA's endocrine disruptor screening program. Environmental Health Perspectives, 125(9), 096001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Caswell H (2001). Matrix Population Models Sinauer Associates. [Google Scholar]
- Coady KK, Biever RC, Denslow ND, Gross M, Guiney PD, Holbech H, Karouna-Renier NK, Katsiadaki I, Kruger H, Levine SL, Maack G, Williams M, Wolf JC, & Ankley GT (2017). Current limitations and recommendations to improve testing for environmental assessment of endocrine active chemicals. Integrated Environmental Assessment and Management, 13, 302–316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Conolly RB, Ankley GT, Cheng W-Y, Mayo ML, Miller DH, Perkins EJ, Villeneuve DL, & Watanabe KH (2017). Quantitative adverse outcome pathways and their application to predictive toxicology. Environmental Science and Technology, 51, 4661–4672. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dang Z, & Kienzler A (2019). Changes in fish sex ratio as a basis for regulating endocrine disruptors. Environment International, 130, 1–22. [DOI] [PubMed] [Google Scholar]
- Duda SW (1989). Controlled spawning of laboratory reared fathead minnows (Pimephales promelas) and effect of different diets on survival and growth of the fry (M.S. Thesis) State University of New York [Google Scholar]
- Durhan EJ, Lambright CS, Makynen EA, Lazorchak J, Hartig PC, Wilson VS, Gray LE, & Ankley GT (2006). Identification of metabolites of trenbolone acetate in androgenic runoff from a beef feedlot. Environmental Health Perspectives, 114(Suppl 1), 65–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ellner SP (2009). Lectures on theoretical ecology Department of Ecology and Evolutionary Biology, Cornell University. http://www.eeb.cornell.edu/Ellner/lte/TheoreticalEcology2009.pdf [Google Scholar]
- European Chemicals Agency (ECHA). (2008). Guidance for the Implementation of REACH ECHA. https://echa.europa.eu/guidance-documents/guidance-on-reach [Google Scholar]
- Galic N, Hommen U, Baveco JM, & van den Brink PJ (2010). Potential application of population models in the European ecological risk assessment of chemicals. II. Review of models and their potential to address environmental protection aims. Integrated Environmental Assessment and Management, 6, 338–360. [DOI] [PubMed] [Google Scholar]
- Galvez JI, Morrison JR, & Phelps RP (1996). Efficacy of trenbolone acetate in sex inversion of the blue tilapia Oreochromis aureus. Journal of World Aquaculture Society, 27, 483–486. [Google Scholar]
- Geffroy B, & Wedekind C (2020). Effects of global warming on sex ratios in fishes. Journal of Fish Biology, 97(3), 596–606. [DOI] [PubMed] [Google Scholar]
- Gleason T, & Nacci DE (2001). Risks of endocrine-disrupting compounds to wildlife: Extrapolating from effects on individuals to population response. Human and Ecological Risk Assessment, 7, 1027–1042. [Google Scholar]
- Gotelli NJ (1998). A Primer of ecology Sinauer Associates. [Google Scholar]
- Guillette LJ, Crain DA, Rooney AA, & Pickford DP (1995). Organization versus activation: The role of endocrine-disrupting chemicals (EDCs) during embryonic development in wildlife. Environmental Health Perspectives, 103(Suppl 7), 157–164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanson N, Aberg P, & Sundelof A (2005). Population-level effects of male-biased broods in eelpout (Zoarces viviparus). Environmental Toxicology and Chemistry, 24, 1235–41. [DOI] [PubMed] [Google Scholar]
- Hazlerigg CRE, Tyler CR, Lorenzen K, Wheeler JR, & Thorbek P (2014). Population relevance of toxicant mediated changes in sex ratio in fish: An assessment using an individual-based zebrafish (Danio rerio) model. Ecological Modelling, 280, 76–88. [Google Scholar]
- Holbech H, Kinnberg KL, Brande-Lavridsen N, Bjerregaard P, Petersen GI, Norrgren L, Orn S, Braunbeck T, Baumann L, Bomke C, Dorgerloh M, Bruns E, Ruehl-Fehlert C, Green JW, Springer TA, & Gourmelon A (2012). Comparison of zebrafish (Danio rerio) and fathead minnow (Pimephales promelas) as test species in the Fish Sexual Development Test (FSDT). Comparative Biochemistry and Physiology. Toxicology & Pharmacology: CBP, 155, 407–415. [DOI] [PubMed] [Google Scholar]
- Honeycutt JL, Deck CA, Miller SC, Severance ME, Atkins EB, Luckenbach JA, Buckel JA, Daniels HV, Rice JA, Borski RJ, & Godwin J (2019). Warmer waters masculinize wild populations of a fish with temperature-dependent sex determination. Scientific Reports, 9(1), 6527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Howell WM, Black DA, & Bortone SA (1980). Abnormal expression of secondary sex characters in a population of mosquitofish Gambusia affinis holbrooki: Evidence for environmentally-induced masculinization. Copeia, 1980, 676–81. [Google Scholar]
- Kidd KA, Blanchfield PJ, Mills KH, Palace VP, Evans RE, Lazorchak JM, & Flick RW (2007). Collapse of a fish population after exposure to a synthetic estrogen. Proceedings of the National Academy of Sciences USA, 104, 8897–8891. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kinnberg K, Holbech H, Petersen GI, & Bjerregaard P (2007). Effects of the fungicide prochloraz on the sexual development of zebrafish (Danio rerio). Comparative Biochemistry and Physiology. C: Comparative Pharmacology and Toxicology, 145, 165–170. [DOI] [PubMed] [Google Scholar]
- Kitano T, Takamune K, Nagahama Y, & Abe S (2000). Aromatase inhibitor and 17α-methyltestosterone cause sex-reversal from genetical females to phenotypic males and suppression of P450 aromatase gene expression in Japanese flounder (Paralichthys olivaceus). Molecular Reproduction and Development, 56, 1–5. [DOI] [PubMed] [Google Scholar]
- Knapen D, Stinckens E, Cavallin JE, Ankley GT, Holbech H, Villeneuve DL, & Vergauwen L (2020). Toward an AOP network-based tiered testing strategy for assessment of thyroid hormone disruption. Environmental Science and Technology, 54, 8491–8499. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kramer VJ, Etterson MA, Hecker M, Murphy CA, Roesijadi G, Spade DJ, Stromberg JA, Wang M, & Ankley GT (2011). Adverse outcome pathways and risk assessment: Bridging to population level effects. Environmental Toxicology and Chemistry, 30, 64–76. [DOI] [PubMed] [Google Scholar]
- Kwon JY, Haghpanah V, Kogson-Hurtado LM, McAndrew BJ, & Penman DJ (2000). Masculinization of genetic female Nile tilapia (Oreochromis niloticus) by dietary administration of an aromatase inhibitor during sexual differentiation. Journal of Experimental Zoology, 287, 46–53. [PubMed] [Google Scholar]
- Larsson DGJ, Hällman H, & Förlin L (2000). More male fish embryos near a pulp mill. Environmental Toxicology and Chemistry, 19, 2911–17. [Google Scholar]
- Le Page Y, Diotel N, Vaillant C, Pellegrini E, Anglade I, Merot Y, & Kah O (2010). Aromatase, brain sexualization and plasticity: The fish paradigm. European Journal of Neuroscience, 32, 2105–2115. [DOI] [PubMed] [Google Scholar]
- Leslie PH (1945). On the use of matrices in certain population mathematics. Biometrika, 35, 183–212. [DOI] [PubMed] [Google Scholar]
- Lewis EG (1942). On the generation and growth of a population. Sankhya, the Indian Journal of Statistics, 6, 93–96. [Google Scholar]
- Mankiewicz JL, Godwin J, Holler BL, Turner PM, Murashige R, Shamey R, Daniels HV, & Borski RJ (2013). Masculinizing effect of background color and cortisol in a flatfish with environmental sex-determination. Integrative and Comparative Biology, 53(4), 755–65. [DOI] [PubMed] [Google Scholar]
- Marty MS, Blankinship A, Chambers J, Constantine L, Kloas W, Kumar A, Lagadic L, Meador J, Pickford D, Schwarz T, & Verslycke T (2017). Population relevant endpoints in the evaluation of endocrine-active substances (EAS) for ecotoxicological hazard and risk assessment. Integrated Environmental Assessment and Management, 13, 317–330. [DOI] [PubMed] [Google Scholar]
- Matthiessen P, Ankley GT, Biever R, Bjerregaard P, Borgert C, Brugger K, Blankenship A, Chambers J, Coady K, Constantine L, Dang Z, Denslow N, Dreier DA, Dungey S, Gray LE, Gross M, Guiney P, Hecker M, Holbech H, … Yamazaki K (2017). Recommended approaches to the scientific evaluation of ecotoxicological hazards and risks of endocrine-active substances. Integrated Environmental Assessment and Management, 13, 267–279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Matthiessen P, & Weltje L (2015). A review of the effects of azole compounds in fish and their possible involvement in masculinization of wild fish populations. Critical Reviews in Toxicology, 45(5), 453–467. [DOI] [PubMed] [Google Scholar]
- McCardle M, Freeman EL, Stavely J, Ortega L, Coady K, Weltjie L, Weyers A, Wheeler JR, & Bone AJ (2020). Critical review of read across potential in testing for endocrine related effects in vertebrate ecological receptors. Environmental Toxicology and Chemistry, 39, 739–750. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meng YB, Lin B-L, Tominaga M, & Nakanishi J (2006). Simulation of the population level effects of 4-nonylphenol on the wild Japanese medaka (Oryzias latipes). Ecological Modelling, 197, 350–360. [Google Scholar]
- Metz JAJ, & Dickmann O (1986). The dynamics of physiologically structured populations, Lecture notes in Biomathematics Springer-Verlag. [Google Scholar]
- Miller DH, & Ankley GT (2004). Modeling impacts on populations: Fathead minnow (Pimephales promelas) exposure to the endocrine-disruptor 17β-trenbolone as a case study. Ecotoxicology and Environmental Safety, 59(1), 1–9. [DOI] [PubMed] [Google Scholar]
- Miller DH, Clark BW, & Nacci DE (2020). A multidimensional density dependent matrix population model for assessing risk of stressors to fish populations. Ecotoxicology and Environmental Safety, 201, 110786. 10.1016/j.ecoenv.2020.110786 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller DH, Tietge JE, McMaster ME, Munkittrick KR, Xia X, & Ankley GT (2013). Assessment of status of white sucker (Catostomus commersoni) populations exposed to bleached kraft pulp mill effluent. Environmental Toxicology and Chemistry, 32(7), 1592–1603. [DOI] [PubMed] [Google Scholar]
- Miller DH, Tietge JE, McMaster ME, Munkittrick KR, Xia X, Griesmer DA, & Ankley GT (2015). Linking mechanistic toxicology to population models in forecasting recovery from chemical stress: A case study from Jackfish Bay, Ontario, Canada. Environmental Toxicology and Chemistry, 34(7), 1623–1633. [DOI] [PubMed] [Google Scholar]
- Miller DH, Jensen KM, Villeneuve DE, Kahl MD, Makynen EA, Durhan EJ, & Ankley GT (2007). Linkage of biochemical responses to population-level effects: A case study with vitellogenin in the fathead minnow (Pimephales promelas). Environmental Toxicology and Chemistry, 26(3), 521–527. [DOI] [PubMed] [Google Scholar]
- Norris D, & Carr J (2020). Vertebrate Endocrinology (6th ed., p. 656). Academic Press. [Google Scholar]
- Organisation for Economic Co-operation and Development (OECD). (2018). Revised guidance document 150 on standardised test guidelines for evaluating chemicals for endocrine disruption, OECD Series on Testing and Assessment, No. 150 OECD Publishing. Available online: 10.1787/9789264304741-en [DOI] [Google Scholar]
- Orlando EF, Kolok AS, Binzcik GA, Gates JL, Horton MK, Lambright CS, Gray LE, Soto AM, & Guillette LJ (2004). Endocrine-disrupting effects of cattle feedlot effluent on an aquatic sentinel species, the fathead minnow. Environmental Health Perspectives, 112, 353–358. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ospina-Álvarez N, & Piferrer F (2008). Temperature-dependent sex determination in fish revisited: Prevalence, a single sex ratio response pattern, and possible effects of climate change. PLoS One, 3(7), e2837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parks LG, Lambright CS, Orlando EF, Guillette LJ, Ankley GT, & Gray LE (2001). Masculinization of female mosquitofish in kraft mill effluent contaminated Fenholloway River water is associated with androgen receptor agonist activity. Toxicological Sciences, 62, 257–267. [DOI] [PubMed] [Google Scholar]
- Piferrer F, Zanuy S, Carrillo M, Solar II, Devlin RH, & Donaldson EM (1994). Brief treatment with an aromatase inhibitor during sex differentiation causes chromosomally female salmon to develop as normal, functional males. Journal of Experimental Zoology, 270, 255–262. [Google Scholar]
- Purdom CE, Harriman PA, Bye VVJ, Eno NC, Tyler CR, & Sumpter JP (1994). Estrogenic effects of effluent from sewage treatment works. Chemistry and Ecology, 8, 275–285. [Google Scholar]
- Shen Z, & Wang H (2014). Molecular players involved in temperature-dependent sex determination and sex differentiation in Teleost fish. Genetics, Selection, Evolution, 46, 26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Singh AK (2013). Introduction of modern endocrine techniques for the production of monosex population of fishes. General and Comparative Endocrinology, 181, 146–55. [DOI] [PubMed] [Google Scholar]
- Society for the Advancement of Adverse Outcome Pathways (SAAOP). (2016). Welcome to the Collaborative Adverse Outcome Pathway Wiki (AOP-Wiki) Retrieved October 29, 2020, from: https://aopwiki.org/
- Soto AM, Calabro JM, Prechtl NV, Yau AY, Orlando EF, Daxenberger A, Kolok AS, Guilette LJ Jr., le Bizec B, Lange IG, & Sonnenschein C (2004). Androgenic and estrogenic activity in water bodies receiving cattle feedlot effluent in eastern Nebraska, USA. Environmental Health Perspectives, 112, 346–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thorpe KL, Pereira ML, Schiffer H, Burkhardt-Holm P, Weber K, & Wheeler JR (2011). Mode of sexual differentiation and its influence on the relative sensitivity of the fathead minnow and zebrafish in the fish sexual development test. Aquatic Toxicology, 105, 412–420. [DOI] [PubMed] [Google Scholar]
- Thursby G, Sappington K, & Etterson M (2018). Coupling toxicokinetic–toxicodynamic and population models for assessing aquatic ecological risks to time-varying pesticide exposures. Environmental Toxicology and Chemistry, 37(10), 2633–2644. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thursby GB (2009). Americamysis bahia stochastic matrix population model for laboratory populations: Technical documentation (EPA/600/R-09/121) US Environmental Protection Agency. [Google Scholar]
- Thursby GB (2016). Matrix population modeling for estimating effects from time-varying aquatic exposures: Technical documentation (EPA/600/R-16/062) US Environmental Protection Agency [Google Scholar]
- Westman TH (1938). Studies on the reproduction and growth of the fathead minnow. Copeia, 2, 57–61. [Google Scholar]
- World Health Organization. (2002). ICPS global assessment of the state-of-the-science of endocrine disruptors (WHO/PCS/EDC/02.2) International Programme on Chemical Safety. [Google Scholar]
- Yamamoto T (1969). Sex differentiation. In Hoar WS, & Randall DJ (Eds.), Fish physiology (pp. 117–177). Academic Press. [Google Scholar]
- Yamaguchi S, & Iwasa Y (2018). Temperature-dependent sex determination, realized by hormonal dynamics with enzymatic reactions sensitive to ambient temperature. Journal of Theoretical Biology, 453, 146–155. [DOI] [PubMed] [Google Scholar]
- Zischke JA, Arthur JW, Nordlie KJ, Hermanutz RO, Standen DA, & Henry TP (1983). Acidification effects on macro invertebrates and fathead minnows (Pimephales promela) in outdoor experimental channels. Water Research, 17, 47–63. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Data, associated metadata, and calculation tools are available from the corresponding author (miller.davidh@epa.gov).