Skip to main content
eLife logoLink to eLife
. 2020 Sep 28;9:e58604. doi: 10.7554/eLife.58604

Testicular hormones mediate robust sex differences in impulsive choice in rats

Caesar M Hernandez 1,2,, Caitlin Orsini 2,, Alexa-Rae Wheeler 1, Tyler W Ten Eyck 1, Sara M Betzhold 2, Chase C Labiste 1, Noelle G Wright 1, Barry Setlow 2, Jennifer L Bizon 1,
Editors: Shelly B Flagel3, Kate M Wassum4
PMCID: PMC7521924  PMID: 32985975

Abstract

Impairments in choosing optimally between immediate and delayed rewards are associated with numerous psychiatric disorders. Such ‘intertemporal’ choice is influenced by genetic and experiential factors; however, the contributions of biological sex are understudied and data to date are largely inconclusive. Rats were used to determine how sex and gonadal hormones influence choices between small, immediate and large, delayed rewards. Females showed markedly greater preference than males for small, immediate over large, delayed rewards (greater impulsive choice). This difference was neither due to differences in food motivation or reward magnitude perception, nor was it affected by estrous cycle. Ovariectomies did not affect choice in females, whereas orchiectomies increased impulsive choice in males. These data show that male rats exhibit less impulsive choice than females and that this difference is at least partly maintained by testicular hormones. These differences in impulsive choice could be linked to gender differences across multiple neuropsychiatric conditions.

Research organism: Rat

Introduction

Pronounced sex differences are evident in a range of neuropsychiatric disorders, but the underlying biological and behavioral phenotypes that contribute to such differences remain poorly understood. One aspect of behavior that associates with many neuropsychiatric conditions is intertemporal decision making (Heerey et al., 2007; Bickel et al., 2012; Bickel et al., 2014; Steinglass et al., 2012; Wilbertz et al., 2013; Hoptman, 2015; Steward et al., 2017), which involves choices between small rewards delivered immediately and larger rewards delivered in the future. Individuals choose large over small rewards in the absence of delays but will discount the value of the large rewards as a function of the delay before their delivery. Variation in intertemporal choice predicts a variety of life outcomes, with extreme biases in either direction associated with neuropsychiatric disease. For example, an inability to forgo immediate rewards in favor of larger rewards delivered in the future, or greater ‘impulsive choice’, associates with attention deficit hyperactivity disorder (Wilbertz et al., 2013) and substance use disorders (Bickel et al., 2012; Bickel et al., 2014). In contrast, a hallmark feature of the eating disorder anorexia nervosa is a maladaptive preference for delayed gratification (Steinglass et al., 2012; Steward et al., 2017). Notably, the prevalence of these conditions is sex-biased, with males exhibiting higher rates of ‘impulsive’ disorders (e.g., substance use, attention deficit hyperactivity disorder) and females exhibiting disproportionate rates of anorexia nervosa (Rolls et al., 1991; Becker et al., 2017).

Despite such associations, there remains a surprising lack of consensus regarding how biological sex influences impulsive choice. Some studies in humans report that males show greater impulsive choice than females (Kirby and Maraković, 1996) whereas others report the opposite (Logue and Anderson, 2001; Reynolds et al., 2006; Smith and Hantula, 2008; Beck and Triplett, 2009) or a lack of gender differences altogether (Mischel and Underwood, 1974; Kirby and Maraković, 1995; Silverman, 2003; Bembenutty, 2007). Studies in rodents have been equally inconclusive, with findings ranging from no sex differences (Perry et al., 2008; Eubig et al., 2014; Sackett et al., 2019) to males being more impulsive than females (Panfil et al., 2020), to females being more impulsive than males (Van Haaren et al., 1988; Perry et al., 2007; Weafer and de Wit, 2014).

Even fewer studies have addressed the contributions of gonadal hormones to impulsive choice. Testosterone and estrogen are the primary hormonal drivers of developmental traits and characteristics in males and females, respectively (Wieland et al., 1971; Wilson et al., 1981; Rogol et al., 2002). Circulating levels of these hormones both during brain development and in fully mature adults can influence a variety of cognitive functions (Korol, 2004; Spritzer et al., 2011; Frick et al., 2015; Wagner et al., 2018; Koss and Frick, 2019). Studies show that circulating levels of these hormones associate with impulsive choice in both men and women (Takahashi et al., 2006; Doi et al., 2015). Similarly, impulsive choice can vary across the menstrual cycle in women (Smith et al., 2014; Diekhof, 2015; Stanton, 2017). Notably, however, while exogenous administration of supraphysiological levels of testosterone decreases impulsive choice in male rats (Wood et al., 2013), this effect is not observed in humans, at least at relatively low (replacement level) doses (Ortner et al., 2013). Moreover, it is unclear in either sex whether physiological levels of gonadal hormones are necessary for regulating impulsive choice.

Elucidating the role of sex and gonadal hormones in impulsive choice could offer important insights into both the etiology and treatment of neuropsychiatric diseases. The current study thus had two primary goals. The first was to thoroughly evaluate sex differences in naive adult male and female rats. The second was to determine whether gonadal hormones are necessary for sex-typical patterns of impulsive choice in each sex.

Results

A timeline of the sequence of experimental procedures is shown in Figure 1A. The effects of sex on intertemporal choice were initially evaluated in naïve male and female rats. Subsequently, rats underwent sham or gonadectomy surgery followed by retesting.

Figure 1. Intertemporal choice task and experiment timeline.

Figure 1.

(A) Timeline of experiments. (B) Schematic of the intertemporal choice task illustrating the choices and trial blocks across which the duration of the delay to the large reward increased. On each trial, rats were presented with two response levers that differed with respect to the magnitude and timing of associated reward delivery. A press on one lever delivered a small (one food pellet), immediate reward, whereas a press on the other lever delivered a large (four food pellets), delayed reward. Trials were presented in a blocked design, such that the delay to the large reward increased across successive blocks of trials in a session.

Effect of sex on intertemporal choice performance

Rats were food restricted and trained in operant chambers on a fixed delay intertemporal choice task in which they made discrete-trial choices between two levers, one that yielded a small food reward delivered immediately and another that yielded a large food reward delivered after a delay that ranged from 0 to 60 s (Figure 1B). Male and female rats did not differ in the numbers of free-choice trials completed in the task (percentage of trials omitted, t(30) = −1.39, p=0.174). Moreover, in this experiment and all others reported below, all rats reduced their choice of the large reward as the delay to its delivery increased (main effects of delay, all ps < 0.005). Importantly, males and females significantly differed in their choices between the large, delayed and small, immediate rewards. As shown in Figure 2A (see Figure 2—source data 1 for raw data), females made fewer choices of large, delayed rewards than males (two-factor ANOVA, main effect of sex: F(1,30)=10.586, p=0.003), particularly when longer delays preceded delivery of the large reward (sex × delay interaction: F(4,120)=8.572; p<0.001). Note, however, that choice performance in females was not modulated by estrous cycle phase (main effect of phase: F(3,45)=1.618, p=0.221; phase × delay interaction: F(12,180)=1.765, p=0.168; Figure 2B, see Figure 2—source data 2 for raw data).

Figure 2. Effect of sex on impulsive choice.

Figure 2.

(A) Mean percent choice of the large reward in male and female rats. Female rats showed greater impulsive choice relative to males. (B) Impulsive choice in females did not fluctuate across the estrous cycle. In all panels, error bars represent the standard error of the mean (SEM). **p<0.01, main effect of sex; ××××p < 0.001, sex × delay interaction; +p<0.05, ++p<0.01, +++p<0.001, post-hoc t-tests sex difference at each delay. Raw data for these graphs are provided in Figure 2—source data 1 and 2.

Figure 2—source data 1. Figure 2A Sex difference in intertemporal choice.
Figure 2—source data 2. Figure 2B Effect of estrous cycle phase on intertemporal choice.

Other performance measures were assessed to provide additional insight into male and female differences in choice behavior. Specifically, rats’ latencies to press the two levers and to omit responding on the forced-choice trials that began each trial block were evaluated to provide a measure of motivation to obtain the small and large rewards associated with each lever (Setlow et al., 2003; Mai et al., 2012; Hernandez et al., 2017). A three-factor, repeated measures ANOVA (sex × delay × lever) was used to analyze the lever press latencies and indicated main effects of sex (F(1,27)=10.047, p=0.004), delay (F(4,108)=65.403, p<0.001), and lever (F(1,27)=14.258, p=0.001). Moreover, as shown in Figure 3A (see Figure 3—source data 1 for raw data), all interactions among these variables were significant (delay × sex: F(4,108)=9.206, p<0.001; delay × lever: F(4,108)=36.690, p<0.001; sex × lever: F(1,27)=17.510, p<0.001; and sex × lever × delay: F(4,108)=7.823, p<0.001). To further elucidate these interactions, two-factor, repeated-measures ANOVAs (lever × delay) were used to analyze lever press latencies in males and females separately. While analyses of both males and females revealed main effects of delay (males: F(4,60)=17.453, p<0.001; females: F(4,40)=28.762, p<0.001) and delay × lever interactions (males: F(4,60)=8.603, p<0.001; females: F(4,48)=27.137, p<0.001), a main effect of lever was only present in females (males: F(1,15)=0.089, p=0.769; females: F(1,12)=30.349, p<0.001). Consistent with female preference for the small, immediate reward on free-choice trials, females showed much longer latencies to press the large compared to the small reward lever on forced-choice trials. In contrast, males showed comparable latencies for both levers. The percentage of omitted forced-choice trials was analyzed in a similar manner. As with the latency analysis, a three-factor repeated measures ANOVA (sex × lever × delay) conducted on the percentage of forced-choice trials omitted revealed main effects of sex (F(1,30)=16.363, p<0.001), lever (F(1,30)=15.995, p<0.001), and delay (F(4,120)=20.695, p<0.001) as well as interactions across factors (sex × lever: F(1,30)=8.602, p=0.006; sex × delay: F(4,120)=8.411, p<0.001, lever × delay: F(4,120)=5.540, p<0.001; sex × lever × delay: F(4,120)=5.156, p=0.001; Figure 3B, see Figure 3—source data 2 for raw data). Follow up analyses for males and females performed separately showed that females omitted more forced-choice trials on the large compared to small reward lever, particularly at the longest delays (main effect of lever: F(1,15)=13.988, p=0.002; lever × delay: F(4,60)=7.526, p<0.001). In contrast, no such differences were observed in males (main effect of lever: F(1,15)=2.015, p=0.176; lever × delay: F(4,60)=0.214, p=0.888). The longer response latencies and greater percentage of trial omissions associated with the large reward lever in females during forced-choice trials are consistent with females exhibiting greater impulsive choice and being less tolerant of delays than males. In addition, the fact that males and females did not differ in either response latencies or forced-choice trial omissions associated with the small reward lever indicates that females were as motivated as males to perform the task and seek rewards.

Figure 3. Effect of sex on forced-choice lever response latency and omissions.

Figure 3.

(A) As delays to large reward delivery increased, latency to press the large reward lever during forced-choice trials also increased in both sexes; however, this effect was more robust in females such that there was a main effect of lever in females but not in males. (B) While forced-choice trial omissions did not increase in males as a function of delay, females omitted significantly more forced-choice trials corresponding to the large reward lever at longer delays. In all panels, error bars represent standard error of the mean (SEM). ****p<0.001, main effect of lever; ××××p < 0.001, lever × delay interaction. +p<0.05, ++p<0.01, +++p<0.001, post-hoc t-tests lever latency/omission difference at each delay. Raw data for these graphs are provided in Figure 3—source data 1 and 2.

Figure 3—source data 1. Figure 3A Sex difference in forced choice lever response latencies.
Figure 3—source data 2. Figure 3B Sex difference in forced choice trial omissions.

Effect of food motivational state on intertemporal choice performance in males and females

Adult male rats weigh substantially more than females and have greater ad libitum food intake (Klump et al., 2013). To determine whether potential sex differences in hunger level produced by the food restriction regimen might influence male and female differences in impulsive choice, rats were tested under two different satiation conditions. Specifically, in two separate experiments, rats were tested in the intertemporal choice task following 1 hr and 24 hr ad libitum access to their home cage chow. The 1 hr ad libitum schedule influenced overall motivation to perform the task, as evident by a main effect of feeding schedule on the percentage of free-choice trials omitted (F(1,30)=9.115, p=0.005; Figure 4C, see Figure 4—source data 3 for raw data). Importantly, however, this increase in free-choice trial omissions was present irrespective of sex (main effect of sex: F(1,30)=0.294, p=0.592; schedule × sex: F(1,30)=0.294, p=0.592). Note that two male and five female rats omitted entire blocks of free-choice trials, such that their data had to be excluded from analyses of choice behavior. A three-factor repeated measures ANOVA (sex × feeding schedule × delay) performed on choice data showed that the main effects of sex (F(1,23)=26.753, p<0.001) and sex × delay interaction (F(4,92)=11.227, p<0.001; Figure 4A, see Figure 4—source data 1 for raw data) were still present following the 1 hr ad libitum feeding. In addition, 1 hr ad libitum feeding significantly decreased choice of large, delayed rewards (main effect of feeding schedule: F(1,23)=5.861, p=0.024; Figure 4B, see Figure 4—source data 2 for raw data), in a delay-independent manner (feeding schedule × delay: F(4,92)=1.368, p=0.251). Most importantly, this effect of feeding schedule on choice behavior was independent of sex (schedule × sex: F(1,23)=0.417, p=0.525; schedule × sex × delay: F(4,92)=1.270, p=0.288).

Figure 4. Effect of ad libitum feeding schedule on choice performance.

Figure 4.

(A) Relative to a food restriction feeding schedule, ad libitum feeding for 1 hr prior to testing shifted rats’ preference towards small, immediate rewards, but did not differentially affect choice performance in males and females. (B) There was a main effect of ad libitum feeding relative to food-restricted feeding, averaged across all delays shown in A. Each rat’s percentage choice of the large reward averaged across all delays is represented by an individual data point. (C) As expected, 1 hr of ad libitum feeding prior to testing increased free-choice trial omissions in all rats. (D-F) Similar methodology and data presentation as A-C except that data were collected after ad libitum feeding for 24 hr prior to testing. As with the 1 hr ad libitum schedule, the 24 hr ad libitum feeding did not differentially affect choice performance in males and females. In all panels, error bars represent standard error of the mean (SEM). *p<0.05, **p<0.01, ***p<0.001. Raw data for these graphs are provided in Figure 4—source data 16.

Figure 4—source data 1. Figure 4A Effect of 1-hour ad libitum feeding on intertemporal choice.
Figure 4—source data 2. Figure 4B Effect of 1-hour ad libitum feeding on intertemporal choice (collapsed across delays).
Figure 4—source data 3. Figure 4C Effect of 1-hour ad libitum feeding on free-choice trial omissions.
Figure 4—source data 4. Figure 4D Effect of 24-hour ad libitum feeding on intertemporal choice.
Figure 4—source data 5. Figure 4E Effect of 24-hour ad libitum feeding on intertemporal choice (collapsed across delays).
Figure 4—source data 6. Figure 4F Effect of 24-hour ad libitum feeding on free-choice trial omissions.

The 24 hr ad libitum schedule also influenced overall motivation to perform the task as evident by a main effect of feeding schedule on the percentage of free-choice trials omitted (main effect of schedule: F(1,30)=13.400, p=0.001; Figure 4F, see Figure 4—source data 6 for raw data) that was independent of sex (main effect of sex: F(1,30)=2.297, p=0.140; schedule × sex: F(1,30)=2.839, p=0.102). The 24 hr ad libitum feeding schedule caused three female rats to omit entire blocks of free-choice trials and therefore their data were excluded from analyses of choice behavior. A three-factor repeated measures ANOVA (sex × feeding schedule × delay) nevertheless demonstrated main effects of sex (F(1,27)=13.414, p=0.001) as well as a sex × delay interaction (F(4,108)=7.899, p<0.001; Figure 4D, see Figure 4—source data 4 for raw data). Unlike the 1 hr ad libitum schedule, there was no decrease in choice of the large, delayed reward following the 24 hr ad libitum feeding schedule (F(1,27)=2.302, p=0.141; schedule × sex: F(1,27)=0.021, p=0.887; schedule × delay: F(4,108)=0.179, p=0.949; schedule × sex × delay: F(4,108)=1.433, p=0.228; Figure 4E, see Figure 4—source data 5 for raw data). To summarize, given that robust differences in choice behavior between males and females were still evident following free access to food that was sufficient to reduce rats’ motivation to perform the task, these data argue against the sex differences in intertemporal choice being attributable to differences in hunger or food motivation.

Effects of gonadectomy on intertemporal choice

Prior to gonadectomy (GDX), males were divided into sham and orchiectomy groups, and females were divided into sham and ovariectomy groups. Baseline choice performance was matched across surgery groups separately for males and females. Due to post-operative complications, however, four female rats were euthanized and excluded for the remainder of the study. Pre-operative choice performance was equivalent between the male groups assigned to sham and orchiectomy conditions (no effect of group nor group × delay interactions: Fs(1-4,14-56)=0.016–0.114, ps=0.900–0.977). Despite the attrition due to post-operative complications, pre-operative choice performance was equivalent between females assigned to sham and ovariectomy conditions (no effect of group nor group × delay interactions: Fs(1-4,10-40)=2.146–2.257, ps=0.080–0.174).

Following ovariectomy surgeries, rats were confirmed as acyclic via vaginal lavage and cytology. A three-factor, repeated measures ANOVA (surgical group [ovariectomy vs. sham] × phase [pre- vs. post-surgery] × delay) was used to analyze the percentage of large reward choices and indicated no main effects or interactions involving ovariectomy (main effect of surgical group: F(1,10)=2.245, p=0.165; main effect of phase: F(1,10)=0.003, p=0.957; surgical group × phase: F(1,10)=0.001, p=0.971; phase × delay: F(4,40)=1.557, p=0.204; surgical group × delay: F(4,40)=1.655, p=0.179; surgical group × phase × delay: F(4,40)=1.698, p=0.170; Figure 5A, see Figure 5—source data 1 for raw data). There were also no effects of phase on the percentage of trials omitted (main effect of phase: F(1,10)=2.390, p=0.153; main effect of surgical group: F(1,10)=2.726, p=0.130; surgical group × phase: F(1,10)=0.850, p=0.378; Figure 5B, see Figure 5—source data 2 for raw data). To address the possibility that the absence of effects of ovariectomy on choice performance was due to a floor effect (i.e., because rats already showed low levels of preference for the large, delayed reward), female rats were subsequently trained using a shorter set of delays to large reward delivery (0, 2, 4, 8, 16 s). One sham rat was excluded from this analysis due to omissions of complete blocks of trials, and one ovariectomy rat was excluded due to premature death. A two-factor, repeated measures ANOVA (surgical group × delay) revealed no effects of ovariectomy under the shorter delay set (main effect of surgical group: F(1,8)=0.006, p=0.938; surgical group × delay: F(4,32)=0.407, p=0.802), suggesting that the failure of ovariectomy to influence choice performance was not due insufficient parametric space in which to observe such effects (Figure 5C, see Figure 5—source data 3 for raw data). Instead, these data are consistent with the interpretation that circulating ovarian hormones in adult females do not drive sex differences observed in intertemporal choice and are not critical for maintenance of the female-typical pattern of intertemporal choice behavior.

Figure 5. Effect of ovariectomy (OVX) on choice performance in female rats.

Figure 5.

(A) There were no significant changes in choice performance in either OVX or sham females after surgery. (B) Free-choice trial omissions in sham and ovariectomized female groups prior to and post surgeries. OVX had no effect on free-choice trial omissions. (C) Adjusting the intertemporal choice task to incorporate shorter delays did not reveal an effect of OVX. In all panels, error bars represent standard error of the mean (SEM). Raw data for these graphs are provided in Figure 5—source data 13.

Figure 5—source data 1. Figure 5A Effect of ovariectomy on intertemporal choice.
Figure 5—source data 2. Figure 5B Effect of ovariectomy on free-choice trial omissions.
Figure 5—source data 3. Figure 5C Effect of ovariectomy on intertemporal choice (shorter delays).

In males, orchiectomies were confirmed by measuring blood serum levels of testosterone using ELISA. Testosterone levels were detectable in sham but not orchiectomized rats (t(14) = 2.315, p=0.036; sham: 1.892 ng/mL ±0.817 SEM; orchiectomized: 0 ng/mL ±0 SEM). Using a three-factor repeated measures ANOVA, the analysis of choice data (surgical group [orchiectomy vs. sham] × phase [pre- vs. post-surgery] × delay) revealed a trend toward a surgical group × phase interaction (F(1,14)=3.750, p=0.073), and a significant surgical group × phase × delay interaction (F(4,56)=2.569, p=0.048; Figure 6A, see Figure 6—source data 1 for raw data), with no other effects reaching significance (main effect of surgical group: F(1,14)=0.661, p=0.430; main effect of phase: F(1,14)=2.153, p=0.164; phase × delay: F(4,56)=0.951, p=0.429; surgical group × delay: F(4,56)=0.560, p=0.692). Figure 6B shows that orchiectomized but not sham rats reduced their choice of the large, delayed reward post-surgery compared to pre-surgery conditions. To confirm this observation, additional two-factor, repeated measures ANOVAs were used to analyze choice data in orchiectomized and sham groups separately. These analyses indicated a trend toward a main effect of phase (F(1,7)=4.829, p=0.064; Figure 6B, see Figure 6—source data 2 for raw data) and a significant phase × delay interaction (F(4,28)=3.029, p=0.034) in orchiectomized rats, such that choice of the large reward decreased post-surgery, particularly at the longest delays. In contrast, there was neither a main effect of phase nor a phase × delay interaction in sham rats (main effect of phase: F(1,7)=0.138, p=0.722; phase × delay: F(4,28)=0.407, p=0.687). Finally, orchiectomy did not influence the percentage of free-choice trials omitted (main effect of surgical group: F(1,14)=0.467, p=0.505; main effect of phase: F(1,14)=0.087, p=0.773; surgical group × phase: F(1,14)=1.836, p=0.197; Figure 6C, see Figure 6—source data 3 for raw data).

Figure 6. Effect of orchiectomy (ORX) on choice performance in male rats.

Figure 6.

(A) Choice performance in shams was unchanged post-surgery relative to pre-surgery; however, ORX caused an increase in impulsive choice post-surgery relative to pre-surgery. (B) Main effect of surgery in both sham and orchiectomized rats. Each rat’s percent choice of the large reward (averaged across all delays) is represented by an individual data point. (C) Free-choice trial omissions in sham and orchiectomized male groups prior to and post surgeries. ORX had no effect on free-choice trial omissions. In all panels, error bars represent standard error of the mean (SEM). ×p<0.05, group × phase × delay interaction. #p<0.07, post-hoc t-tests group difference at each delay. Raw data for these graphs are provided in Figure 6—source data 13.

Figure 6—source data 1. Figure 6A Effect of orchiectomy on intertemporal choice.
Figure 6—source data 2. Figure 6B Effect of orchiectomy on intertemporal choice (collapsed across delays).
Figure 6—source data 3. Figure 6C Effect of orchiectomy on free-choice trial omissions.

To further evaluate the effects of orchiectomy, additional analyses (of latencies and omissions on forced-choice trials) were conducted specifically in the orchiectomy group. A three-factor repeated measures ANOVA (phase × lever × delay) was used to analyze lever press latencies and revealed significant phase × lever (F(1,7)=51.858, p<0.001), lever × delay (F(4,28)=8.950, p=0.003), and phase × lever × delay (F(4,28)=3.619, p=0.017) interactions (Figure 7A, see Figure 7—source data 1 for raw data). To further elucidate these interactions, separate two-factor, repeated measures ANOVAs (lever × delay) were used to analyze lever press latencies pre- and post-surgery. While there were no differences in latencies to press levers pre-surgery (main effect of lever: F(1,7)=0.340, p=0.578; lever × delay interaction: F(4,28)=2.774, p=0.103), latencies to press the large reward lever were significantly greater than those for the small reward lever post-surgery, particularly at the longest delays (main effects of lever: F(1,7)=5.911, p=0.045; lever × delay interaction: F(4,28)=11.501, p<0.001). Orchiectomized males also showed a significant increase in the percentage of omitted forced-choice trials corresponding to the large reward at the longest delays (Figure 7B, see Figure 7—source data 2 for raw data); the main effects of lever (F(1,7)=5.804, p=0.047) and delay (F(4,28)=2.982, p=0.036), however, were evident both pre- and post-surgery (main effect of phase: F(1,7)=1.288, p=0.294; phase × lever: F(1,7)=0.881, p=0.379; phase × delay: F(4,28)=1.782, p=0.160; lever × delay: F(4,28)=1.894, p=0.139; phase × lever × delay: F(4,28)=0.645, p=0.635). Taken together, these data show that removal of testicular hormones shifts male rats’ behavior toward a phenotype more similar to that of gonadally-intact females, such that both impulsive choice and delay intolerance are increased.

Figure 7. Effect of orchiectomies on forced-choice lever response latency and omissions.

Figure 7.

(A) As delays to large reward delivery increased, large reward lever response latency during forced-choice trials also increased in males in the orchiectomy group; however, the effect was more robust after orchiectomy, such that there was a main effect of lever that was absent pre-surgery. (B) While forced-choice trial omissions did not increase at longer delays prior to surgery in orchiectomized rats, after surgery, the rats numerically (though not significantly) omitted more large reward forced-choice trials at longer delays. In all panels, error bars represent standard error of the mean (SEM). *p<0.05, main effect of lever; ××××p < 0.001, lever × delay block interaction. #p<0.07, +p<0.05, +++p<0.001, post-hoc t-tests lever latency difference at each delay. Raw data for these graphs are provided in Figure 7—source data 1 and 2.

Figure 7—source data 1. Figure 7A Effect of orchiectomy on forced choice lever response latencies.
Figure 7—source data 2. Figure 7B Effect of orchiectomy on forced choice trial omissions.

Discussion

The current study used a rat model to explicitly evaluate the contributions of sex and gonadal hormones to intertemporal choice behavior. Relative to males, female rats were markedly more impulsive in their choices, preferring small, immediate over larger delayed rewards. This effect was not due to differences in reward magnitude discrimination, as both males and females consistently chose the large reward when there was no delay to its delivery. The effect was also not due to differences in task engagement (free-choice trial omissions) nor to differences in hunger-dependent states between males and females, as ad libitum feeding prior to testing did not alter the observed sex differences. Instead, the current data are consistent with the interpretation that female rats are much less tolerant of delays than males. Importantly, while these sex-dependent effects were not influenced by removal of ovarian hormones, removal of testicular hormones resulted in greater impulsive choice in male rats, indicating a critical role for testicular but not ovarian hormones in maintenance of sex-typical patterns of impulsive choice.

Females are more delay intolerant than males

One possible explanation for greater impulsive choice in females relative to males is a greater sensitivity to delay (or delay intolerance), as suggested by the analyses of the latencies to press the small, immediate vs. the large, delayed reward lever on forced-choice trials. Response latencies may provide insight into the affective and/or motivational processing underlying a response; longer latencies may indicate negative affect or reduced motivation for an action, whereas shorter response latencies may indicate positive affect or heightened motivation (Crespi, 1942; Amsel, 1950; Setlow et al., 2003; Mai et al., 2012; Orsini et al., 2015; Shimp et al., 2015; Hernandez et al., 2017). Consistent with this interpretation, both males and females in the current study had shorter latencies to respond for the large reward relative to the small reward under no delay conditions, and large reward response latencies in both sexes increased as delays to the large reward increased. Relative to males, however, females took significantly longer in responsding to the large reward in the presence of delays. Females also displayed an increase in the number of omitted large reward forced-choice trials in the presence of the longest delays, consistent with delay intolerance (i.e., at those delays, the large reward was so reduced in value as to not be worth pursuing at all). The current data indicate, however, that females were not less sensitive to reward than males. Indeed, females responded as rapidly as males in the absence of a delay. Hence, at least in the context of the food rewards and delays employed here, females and males are similarly sensitive to reward magnitude but females are substantially less tolerant of delays compared to males. Interestingly, these results parallel findings from across species that females are more sensitive to punishment than males (Miettunen et al., 2007; Rood et al., 2009; Cross et al., 2011; Orsini et al., 2016; Chowdhury et al., 2019; Grissom and Reyes, 2019; Liley et al., 2019). In this context, females may perceive the delays in the intertemporal choice task as a form of ‘cost’ that shares overlapping features with explicit punishment.

Delay intolerance in females as a primary driver of sex differences in intertemporal choice could account for some of the disparate findings in the rodent literature. Several prior studies failed to detect sex differences on intertemporal choice tasks (Perry et al., 2008; Sackett et al., 2019) whereas the results of other studies largely agree with the current findings (Van Haaren et al., 1988; Perry et al., 2007; Koot et al., 2009; Eubig et al., 2014; Lukkes et al., 2016). In particular, the relatively long delays employed in the present study (0–60 s) may have been optimal for detecting sex differences driven by delay intolerance. Indeed, several studies using shorter delays (0–40 s or 0–20 s) failed to detect sex differences (Eubig et al., 2014; Sackett et al., 2019).

In addition to the use of longer delays, other factors could have contributed to the robust sex difference observed in the present study, relative to previous findings of smaller or equivocal differences. Several prior studies found that females had numerically but not significantly greater impulsive choice compared to males (Eubig et al., 2014; Lukkes et al., 2016). These studies, however, employed relatively small group sizes (n = 6–9/sex) compared to the current study (n = 16/sex), which could account in part for their failure to detect significant sex effects. Another difference between the current and prior studies concerns the age at which the animals were tested. In the current study, rats began testing at 6 months of age, whereas rats in prior studies in which sex differences were not detected began testing at 3–4 months of age (Perry et al., 2008; Sackett et al., 2019). Impulsive choice in both sexes is reported to decrease from adolescence (younger than 2 months) to young adulthood (greater than 2 months; Doremus-Fitzwater et al., 2012) and in male rats it decreases further from 6 months to 24 months (Simon et al., 2010; Hernandez et al., 2017). To our knowledge, changes in impulsive choice over the course of young adult maturation have not been investigated. Thus, it is possible that sex differences in impulsive choice become more pronounced over the course of young adulthood. It is not likely that the design of the intertemporal choice task alone (fixed delays proceeding in an ascending order) accounts for the presence of robust sex differences, as previous studies that both have and have not detected sex differences have employed this design as well as adjusting delay designs (Perry et al., 2007; Perry et al., 2008; Sackett et al., 2019; Panfil et al., 2020). Finally, it should be noted that previous studies have not evaluated sex differences in intertemporal choice in Fischer 344 × Brown Norway F1 hybrid rats, and thus it is possible that sex differences are particularly pronounced in this strain. Sex differences in many aspects of cognition (including other forms of cost-benefit decision making) have been observed in several rat strains (van den Bos et al., 2012; Peak et al., 2015; Orsini et al., 2016; Blaes et al., 2019; Liley et al., 2019), and several studies have shown differences in impulsive choice between rat strains (Huskinson et al., 2012; Garcia and Kirkpatrick, 2013). To our knowledge, however, no studies have directly compared sex differences in impulsive choice between strains, suggesting that this will be an important avenue of future research.

Greater impulsive choice in females is not dependent on differential hunger/satiety

Prior studies have reported that the degree of food restriction can affect impulsive choice (Bradshaw and Szabadi, 1992; Wogar et al., 1992; Ho et al., 1997), such that greater restriction leads to lower levels of impulsive choice. Because the rats in the current study were food-restricted to 85% of their free-feeding body weights, one possible explanation for greater impulsive choice in females relative to males is that females experienced a subjectively different level of food restriction than males. Manipulation of restriction level through ad libitum feeding modestly decreased choices of large, delayed rewards, but this effect did not differ by sex. Additionally, although more females than males omitted entire blocks of free-choice trials under satiated conditions, there was a similar increase in the overall number of free-choice trial omissions in males and females, suggesting that both sexes experienced a comparable degree of satiation. As such, these findings argue against the interpretation that greater impulsive choice in females is due to a difference in hunger state.

Testicular but not ovarian hormones are necessary for sex-specific patterns of impulsive choice

There is evidence that impulsive choice in women varies across the menstrual cycle, suggesting that preference for small, immediate vs. large, delayed rewards can be modulated by fluctuations in ovarian hormones within the physiological range (Kaighobadi and Stevens, 2013; Smith et al., 2014; Diekhof, 2015). To determine whether this variation is also evident in rats, impulsive choice was evaluated across phases of the estrous cycle. Although previous work shows that some aspects of cognition and behavior in rats can fluctuate across the estrous cycle (Shansky et al., 2006; Tuscher et al., 2015; Becker and Koob, 2016; Blume et al., 2017; Pellman et al., 2017; Yagi et al., 2017), there was no effect of estrous phase on impulsive choice in the current study. This finding is consistent with those from previous studies of sex differences in decision making involving risk of punishment or delayed punishment, in which estrous cycle does not modulate choice behavior (Orsini et al., 2016; Liley et al., 2019). Similarly, estrous phase does not influence rats’ accuracy in a delayed response working memory task, performance on which is correlated with impulsive choice (Shimp et al., 2015; Blaes et al., 2019).

Removal of ovarian hormones through ovariectomy can alter some forms of learning and memory (Bimonte-Nelson et al., 2003; Qu et al., 2013; Frick et al., 2015; Kim et al., 2016), and a study in rats performing an effort-based decision-making task found that ovariectomy increased rats’ choice of large, high-effort over small, low-effort rewards relative to their pre-surgery performance (Uban et al., 2012). To determine if sex differences in impulsive choice are influenced by gonadal hormones, males and females underwent either gonadectomy or sham surgeries. Consistent with the absence of estrous cycle effects on choice behavior, ovariectomies did not alter task performance, suggesting that if ovarian hormones contribute to the greater impulsive choice observed in females, their effects may be organizational rather than activational. Alternatively, local androgen synthesis in the brain (Tobiansky et al., 2018) might compensate for loss of circulating ovarian hormones to allow maintenance of pre-surgical patterns of choice behavior in females.

In contrast to the null effect of ovariectomies, orchiectomies increased impulsive choice relative to pre-surgery performance. Analyses of response latencies and trial omissions on forced-choice trials revealed patterns of performance in orchiectomized rats more akin to those in female rats than intact males (i.e., longer response latencies and more trial omissions at longer delays), suggesting that orchiectomy causes a shift toward reduced tolerance for delayed rewards. Importantly, these results are not explained simply by motivational deficits, as orchiectomies did not increase omissions on free-choice trials. These findings are consistent with the results of a prior study in which a supraphysiological dose of testosterone administered to intact male rats caused a decrease in impulsive choice (Wood et al., 2013). Hence, testicular hormone signaling may allow bidirectional modulation of impulsive choice in adult rats.

The fact that orchiectomy shifted impulsive choice implies that testicular hormones do not solely contribute to the male-typical pattern of impulsive choice in an organizational manner, but that they play an activational role as well. Impulsive choice is mediated by a network of corticolimbic-basal ganglia structures, including prefrontal cortex, basolateral amygdala, and nucleus accumbens, as well as dopaminergic and serotonergic innervation of these structures (see Floresco et al., 2008; Peters and Büchel, 2011; Bailey et al., 2016; Fobbs and Mizumori, 2017; Frost and McNaughton, 2017 for review). Androgen receptors are found within all of these brain regions, and their functions can be modulated by manipulations of testicular hormones (Tobiansky et al., 2018). Hence, it is likely that the effects of orchiectomy on impulsive choice are mediated at least in part via hormonal effects on these brain systems. Future studies involving manipulations of hormonal signaling within specific brain regions will be needed to address this issue.

Limitations and conclusions

The results in the current study highlight two major findings. First, there was a significant and robust difference in impulsive choice between males and females that was not readily attributable to differences in food motivation or reward sensitivity. Second, we describe the novel finding that testicular hormones are necessary for maintaining the bias toward delayed gratification typical of males, whereas ovarian hormones do not appear to be necessary for maintaining the female-typical bias toward immediate gratification. Finally, the robust differences between males and females, as well as the differential roles of gonadal hormones, highlight the importance of assessing both sexes in studies of cost-benefit decision making (see van den Bos et al., 2013; Orsini and Setlow, 2017 for reviews).

The current study had some of the largest group sizes to date in an assessment of sex differences in impulsive choice; however, it is limited in that rats of only a single strain and age were evaluated on a single task design using a fixed set of delays. As such, although the use of rodents avoids factors that can bias studies of impulsive choice in human subjects (such as age, education, and socioeconomic status), it is not clear to what extent the current results are representative of human behavior. Indeed, a meta-analysis of studies assessing impulsive choice in human subjects found no sex difference, although the heterogeneity in subject ages and task designs renders it challenging to draw generalities (Cross et al., 2011). Particularly given that (in both rodents and humans) females appear to be more sensitive than males to punishment (Cross et al., 2011; Orsini and Setlow, 2017), it may be the case that greater impulsive choice among females will be most evident in circumstances involving actual (experienced, rather than hypothetical) rewards and delays.

Given the strong associations between extremes in impulsive choice and sex-prevalent psychiatric disorders (e.g., ADHD and substance use disorders associated with greater impulsive choice in males, and anorexia nervosa associated with reduced impulsive choice in females), it is interesting to speculate as to how such disorders might be related to sex differences in impulsive choice. Notably, the sex differences observed here (greater impulsive choice in females than males) are opposite of those predicted by the sex prevalence of psychiatric disorders associated with alterations in impulsive choice such as ADHD, SUDs, and anorexia nervosa. The results of the current study depict sex-atypical patterns of impulsive choice relative to sex differences in psychiatric disorders with which they are associated. In other words (and if the present findings in rats were extended to humans) male-prevalent psychiatric disorders are associated with male-atypical patterns of impulsive choice, whereas female-prevalent psychiatric disorders are associated with female-atypical patterns of impulsive choice. Although it is not clear whether and how such relationships are relevant to the etiology or symptoms of psychiatric disorders, future studies employing more targeted manipulations of gonadal hormone signaling may begin to address these questions.

Materials and methods

Subjects

Adult male (n = 16) and female (n = 16) Fischer 344 × Brown Norway F1 hybrid (FBN) rats were obtained at 6 months of age from the National Institute on Aging colony (Charles River Laboratories) and individually housed in the Association for Assessment and Accreditation of Laboratory Animal Care International-accredited vivarium facility in the McKnight Brain Institute building at the University of Florida. This study was performed in strict accordance with the recommendations in the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health. All animal procedures were conducted according to protocols approved by the University of Florida Institutional Animal Care and Use Committee (protocol # 201904961). The facility was maintained at a consistent temperature of 25° with a 12 hr light/dark cycle (lights on at 0700) and free access to food and water except as otherwise noted. Rats were acclimated in this facility and handled for at least one week prior to initiation of any procedures. Group sizes were based on previous work from our labs that has assessed sex differences in decision making and PFC-dependent cognition (Orsini et al., 2016; Blaes et al., 2019). In this work, n = 8 rats/sex was determined to be needed to detect sex differences. Group sizes of n = 16/sex were employed to have sufficient rats of each sex for both GDX and sham conditions. Rats were tested in three separate cohorts, each separated by 6–12 months.

Behavioral testing procedures

Apparatus

Testing was conducted in eight identical standard rat behavioral test chambers (Coulbourn Instruments) with metal front and back walls, transparent Plexiglas side walls, and a floor composed of steel rods (0.4 cm in diameter) spaced 1.1 cm apart. Each test chamber was housed in a sound-attenuating cubicle and was equipped with a recessed food pellet delivery trough located 2 cm above the floor in the center of the front wall. The trough was fitted with a photobeam to detect head entries and a 1.12 W lamp for illumination. Food rewards consisted of 45 mg soy-free food pellets (5TUL, 1811155; Test Diet, Richmond, IN, USA). Two retractable levers were positioned to the left and right of the food trough (11 cm above the floor). An additional 1.12 W house light was mounted near the top of the rear wall of the sound-attenuating cubicle. A computer interfaced with the behavioral test chambers and equipped with Graphic State 4 software (Coulbourn Instruments) was used to control experiments and collect data.

Behavioral shaping

Prior to shaping, rats were food restricted to 85% of their ad libitum weight. The intertemporal choice task was based on a design by Evenden and Ryan, 1996 and was used previously to demonstrate age-related alterations in decision making in both Fischer 344 (Simon et al., 2010) and FBN (Hernandez et al., 2017) rats. Rats were initially shaped to lever press to initiate delivery of a food pellet into the food trough and were then trained to nosepoke in the food trough to initiate lever extension. Each nosepoke triggered extension of either the left or right lever (randomized across pairs of trials), a press on which yielded a single food pellet. After two consecutive days of reaching criterion performance (45 presses on each lever within 60 min), rats began testing on the intertemporal choice task.

Intertemporal choice task

Each 80 min session consisted of 5 blocks of 12 trials each. Each 80 s trial began with a 10 s illumination of the food trough and house lights. A nosepoke into the food trough during this time extinguished the food trough light and triggered extension of either a single lever (forced-choice trials) or both levers simultaneously (free-choice trials). Each block began with two forced-choice trials (one for each lever) followed by 10 free-choice trials. The forced-choice trials were designed to remind rats of the delay contingencies in effect for that block. A press on one lever (either left or right, counterbalanced across age groups) resulted in one food pellet (the small reward) delivered immediately. A press on the other lever resulted in four food pellets (the large reward) delivered after a variable delay. The identities of the levers remained consistent throughout testing. Failure to press either lever within 10 s of its extension resulted in the levers being retracted and lights extinguished, and the trial was scored as an omission. Once either lever was pressed, both levers were retracted for the remainder of the trial. The duration of the delay preceding large reward delivery increased between each block of trials (0, 10, 20, 40, 60 s; or 0, 2, 4, 8, 16 for females after ovariectomies), but remained constant within each block. See Figure 1B for task schematic.

Estrous cycle tracking

After stable behavioral performance was achieved, vaginal lavages were conducted in females. Briefly, after daily behavioral testing, vaginal lavage samples were smeared on electrostatic glass slides and observed under a compound light microscope for cycle verification as in our previous work (Orsini et al., 2016). Each of the four phases of the estrous cycle was identified using specific criteria (Marcondes et al., 2002). For experimental consistency, male rats were handled in a manner similar to the females.

Surgical procedures

Ovariectomy

Females underwent either ovariectomy (OVX) or sham surgeries following stable baseline performance in the intertemporal choice task. Rats were anesthetized with isoflurane gas (1–5% in O2) and were administered meloxicam (1 mg/kg), buprenorphine (0.05 mg/kg) and sterile saline (10 mL) subcutaneously. Rats were placed on their ventral side and the incision area on the back was swabbed with chlorhexidine. A 7 mm incision was then made through the outer skin and the underlying fascia was separated with hemostats. An additional 5 mm incision was made through the latissimus dorsi muscle to allow access to the peritoneal cavity. After clearing away adipose tissue, the uterine horns and ovaries were located, and the ovaries were retracted from the peritoneal cavity with forceps. The tissue between the ovaries and uterus was clamped with hemostats and ligated with absorbable sutures. Both ovaries were removed, and the uterus and associated tissue were placed back into the peritoneal cavity. The incision in the muscle was closed with absorbable sutures and the skin incision was closed with surgical clips. For sham surgeries, incisions were made through both the skin and muscle and closed with surgical clips and sutures, respectively. Immediately after surgery, rats received subcutaneous injections of warm saline. Buprenorphine was also administered 24 hr post-operation, and meloxicam 48–72 hr post-operation. A topical ointment was applied to facilitate wound healing, and all rats were placed on a heating pad for recovery. Clips were removed after 10–14 days and rats recovered for at least 2 weeks before food restriction and behavioral testing were reintroduced. Vaginal lavages were then conducted in OVX females for 7 days to confirm termination of estrous cycling, which manifested as a preponderance of leukocytes (as is seen in the diestrus phase in an intact female; Montes and Luque, 1988; Larson and Carroll, 2007). Sham females were handled in a similar manner across the same 7 days.

Orchiectomies

Males underwent either orchiectomy or sham surgeries once they reached stable baseline performance. Rats were anesthetized with isoflurane gas (1–5% in O2) and were administered meloxicam (1 mg/kg), buprenorphine (0.05 mg/kg) and sterile saline (10 mL) subcutaneously. Rats were placed on their ventral side and after disinfecting the area with chlorhexdine, a small incision was made at the tip of the scrotum and each testicle was separated. Another small incision was made in the scrotal sac to express the testicle with the tunica intact. The connective tissue was gently teased away and then the testis and epididymis were isolated. The vascular tissue of the spermatic cord was clamped, and the cord was then ligated 0.5 cm distal from the testis. The testis were then severed from the cord. These procedures were repeated for the second testicle. Once both testes were removed, the skin incision was sutured closed. For males receiving sham surgeries, an incision was made at the tip of the scrotum and then closed with sutures. Immediately after surgery, rats received subcutaneous injections of warm saline. Buprenorphine was also administered 24 hr post-operation, and meloxicam 48–72 hr post-operation. A topical ointment was applied to facilitate wound healing, and all rats were placed on a heating pad for recovery. Sutures were removed after 10–14 days and rats recovered for at least 2 weeks before food restriction and behavioral testing were reintroduced.

Two weeks after orchiectomy surgeries, blood was collected via tail nicks from sham and orchiectomized rats to determine serum testosterone levels using a testosterone ELISA kit (Abcam 108666). Briefly, blood was allowed to clot at room temperature for a minimum of 30 min, and samples were then centrifuged at 4,500 RPM for 15 min at 4°C. The supernatant was transferred to a clean microcentrifuge tube and stored at −80°C until usage. All other steps were performed as per the manufacturer's suggestions except that sample serum volume was doubled (from 25 µL to 50 µL) to place serum testosterone levels within the level of detection. Sample dilution factors were accounted for in the analyses.

Experimental design and statistical analyses

Evaluation of sex differences in intertemporal choice

For experimental timeline, see Figure 1A. Raw data files were extracted using a Graphic State 4.0 analysis template that was custom-designed to extract the number of presses on each lever (large or small reward) during forced-choice and free-choice trials in each block of trials. The percentage of free-choice trials in each delay block on which rats chose the large, delayed reward was used as the primary measure of performance. Rats were trained for daily 15 sessions, after which performance was compared daily across a sliding five-session window using a two-factor, repeated measures ANOVA (delay × session) as in our previous work (Simon et al., 2007; Simon et al., 2010; Hernandez et al., 2017). Stability was defined as the absence of both a main effect of session and a session × delay interaction. Data from the first stable 5-session window were averaged to calculate a mean percent choice of the large reward at each delay (0, 10, 20, 40, 60 s). Sex comparisons were conducted using a two-factor, repeated measures ANOVA, with sex as a between-subjects factor and delay as a within-subjects factor. Lever response latencies and total trials completed were also compared between sexes. Response latency data (the time between lever extension and a lever press) were collected on forced-choice trials. Previous work shows that response latencies can differ for large and small reward levers (Hernandez et al., 2017) and may reflect differences in motivation to obtain differently-preferred rewards (Crespi, 1942; Setlow et al., 2003; Mai et al., 2012; Shimp et al., 2015). Sex comparisons of latency data were conducted using a three-factor, repeated measures ANOVA, with sex as a between-subjects factor and both lever type (small and large) and delay as within-subjects factors. Note that only completed trials were included in the analyses of response latencies (i.e., omitted trials were not included). Forced-choice trial omissions were analyzed using the same repeated measures ANOVA as the latency analyses. Either independent-sample or paired-sample t-tests were used to determine differences (either group or lever) within a delay. Finally, the percentages of free-choice trial omissions were compared using an independent samples t-test. All analyses were conducted in SPSS 26, and the alpha was set to 0.05.

Evaluation of food motivation in intertemporal choice

To determine if sex differences in choice performance were due to differences in motivation to obtain food under food restriction conditions, rats were tested in the intertemporal choice task following both a 1 hr and a 24 hr ad libitum feeding schedule. To counterbalance testing, half of the males and females in the cohort were placed on a 1 hr ad libitum feeding schedule prior to testing on the intertemporal choice task on the first day. On the following day, all rats were tested under the usual food-restricted conditions (as a ‘washout period’ for the 1 hr ad libitum feeding schedule). On the third day, the second half of the cohort was given the 1 hr ad libitum feeding schedule. After a 48 hr washout period, rats were given a 24 hr ad libitum feeding schedule using the same design as the 1 hr feeding schedule. Comparisons of choice performance under the two ad libitum feeding conditions were conducted using a three-factor, repeated measures ANOVA, with sex as a between-subjects factor and both feeding condition (ad libitum vs. food-restricted) and delay as within-subjects factors. The percentages of free-choice trial omissions were compared using a two-factor, repeated measures ANOVA with sex as a between-subjects factor and feeding condition (ad libitum vs. food restricted) as a within-subjects factor.

Evaluation of gonadectomy in intertemporal choice

Procedures used to analyze data after surgery were identical to those used to analyze data prior to surgery. Data from a stable five session window were averaged to calculate a mean percent choice of the large reward at each delay (0, 10, 20, 40, 60 s). Group comparisons were conducted in males and females separately using a three-factor, repeated measures ANOVA, with surgery group (sham vs. gonadectomy) as a between-subjects factor and surgery phase (pre- vs. post-surgery) and delay as within-subjects factors. Comparisons of forced-choice lever response latency and forced-choice trial omission data were conducted within each surgical group using a three-factor, repeated measures ANOVA, with surgery phase (pre- vs. post-surgery), lever type (small vs. large), and delay as within-subjects factors. Finally, the percentages of free-choice trial omissions were compared using a two-factor, repeated measures ANOVA with surgery group (sham vs. gonadectomy) as a between-subjects factor and surgery phase (pre- vs. post-surgery) as a within-subjects factor.

Acknowledgements

We thank Vicky S Kelly, Matthew M Bruner, Shannon C Wall, and Bonnie I McLaurin for technical assistance. Supported by R01AG029421 and the McKnight Brain Research Foundation (JLB), RF1AG060778 (JLB, BS, CJF), a McKnight Predoctoral Fellowship and the Pat Tillman Foundation (CMH), and a Thomas H Maren Fellowship and K99DA041493 (CAO).

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Contributor Information

Jennifer L Bizon, Email: bizonj@ufl.edu.

Shelly B Flagel, University of Michigan, United States.

Kate M Wassum, University of California, Los Angeles, United States.

Funding Information

This paper was supported by the following grants:

  • National Institutes of Health R01AG029421 to Jennifer L Bizon.

  • National Institutes of Health RF1AG060778 to Barry Setlow, Jennifer L Bizon.

  • National Institutes of Health K99DA041493 to Caitlin Orsini.

  • McKnight Brain Research Foundation to Jennifer L Bizon.

  • McKnight Foundation to Caesar M Hernandez.

  • Pat Tillman Foundation to Caesar M Hernandez.

  • Thomas H. Maren Foundation to Caitlin Orsini.

Additional information

Competing interests

No competing interests declared.

Author contributions

Conceptualization, Data curation, Formal analysis, Supervision, Investigation, Writing - original draft, Project administration, Writing - review and editing.

Investigation, Methodology, Writing - review and editing.

Conceptualization, Formal analysis, Supervision, Investigation, Writing - review and editing.

Formal analysis, Investigation, Writing - review and editing.

Formal analysis, Investigation, Writing - review and editing.

Formal analysis, Methodology, Writing - review and editing.

Formal analysis, Investigation, Writing - review and editing.

Supervision, Funding acquisition, Project administration, Writing - review and editing.

Conceptualization, Supervision, Funding acquisition, Project administration, Writing - review and editing.

Ethics

Animal experimentation: This study was performed in strict accordance with the recommendations in the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health. All animal procedures were conducted according to protocols approved by the University of Florida Institutional Animal Care and Use Committee (protocol # 201904961).

Additional files

Transparent reporting form

Data availability

All data generated during this study are included in the manuscript and supporting files.

References

  1. Amsel A. The combination of a primary appetitional need with primary and secondary emotionally derived needs. Journal of Experimental Psychology. 1950;40:1–14. doi: 10.1037/h0063415. [DOI] [Google Scholar]
  2. Bailey MR, Simpson EH, Balsam PD. Neural substrates underlying effort, time, and risk-based decision making in motivated behavior. Neurobiology of Learning and Memory. 2016;133:233–256. doi: 10.1016/j.nlm.2016.07.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Beck RC, Triplett MF. Test-retest reliability of a group-administered paper-pencil measure of delay discounting. Experimental and Clinical Psychopharmacology. 2009;17:345–355. doi: 10.1037/a0017078. [DOI] [PubMed] [Google Scholar]
  4. Becker JB, McClellan ML, Reed BG. Sex differences, gender and addiction. Journal of Neuroscience Research. 2017;95:136–147. doi: 10.1002/jnr.23963. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Becker JB, Koob GF. Sex differences in animal models: focus on addiction. Pharmacological Reviews. 2016;68:242–263. doi: 10.1124/pr.115.011163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bembenutty H. Self-Regulation of learning and academic delay of gratification: gender and ethnic differences among college students. Journal of Advanced Academics. 2007;18:586–616. doi: 10.4219/jaa-2007-553. [DOI] [Google Scholar]
  7. Bickel WK, Jarmolowicz DP, Mueller ET, Koffarnus MN, Gatchalian KM. Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacology & Therapeutics. 2012;134:287–297. doi: 10.1016/j.pharmthera.2012.02.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bickel WK, Koffarnus MN, Moody L, Wilson AG. The behavioral- and neuro-economic process of temporal discounting: a candidate behavioral marker of addiction. Neuropharmacology. 2014;76 Pt B:518–527. doi: 10.1016/j.neuropharm.2013.06.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Bimonte-Nelson HA, Singleton RS, Hunter CL, Price KL, Moore AB, Granholm AC. Ovarian hormones and cognition in the aged female rat: I. Long-term, but not short-term, ovariectomy enhances spatial performance. Behavioral Neuroscience. 2003;117:1395–1406. doi: 10.1037/0735-7044.117.6.1395. [DOI] [PubMed] [Google Scholar]
  10. Blaes SL, Orsini CA, Holik HM, Stubbs TD, Ferguson SN, Heshmati SC, Bruner MM, Wall SC, Febo M, Bruijnzeel AW, Bizon JL, Setlow B. Enhancing effects of acute exposure to Cannabis smoke on working memory performance. Neurobiology of Learning and Memory. 2019;157:151–162. doi: 10.1016/j.nlm.2018.12.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Blume SR, Freedberg M, Vantrease JE, Chan R, Padival M, Record MJ, DeJoseph MR, Urban JH, Rosenkranz JA. Sex- and Estrus-Dependent differences in rat basolateral amygdala. The Journal of Neuroscience. 2017;37:10567–10586. doi: 10.1523/JNEUROSCI.0758-17.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Bradshaw CM, Szabadi E. Choice between delayed reinforcers in a Discrete-Trials schedule: the effect of deprivation level. The Quarterly Journal of Experimental Psychology. 1992;44:1–16. doi: 10.1080/02724999208250599. [DOI] [PubMed] [Google Scholar]
  13. Chowdhury TG, Wallin-Miller KG, Rear AA, Park J, Diaz V, Simon NW, Moghaddam B. Sex differences in reward- and punishment-guided actions. Cognitive, Affective, & Behavioral Neuroscience. 2019;19:1404–1417. doi: 10.3758/s13415-019-00736-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Crespi LP. Quantitative variation of incentive and performance in the white rat. The American Journal of Psychology. 1942;55:467–517. doi: 10.2307/1417120. [DOI] [Google Scholar]
  15. Cross CP, Copping LT, Campbell A. Sex differences in impulsivity: a meta-analysis. Psychological Bulletin. 2011;137:97–130. doi: 10.1037/a0021591. [DOI] [PubMed] [Google Scholar]
  16. Diekhof EK. Be quick about it endogenous estradiol level, menstrual cycle phase and trait impulsiveness predict impulsive choice in the context of reward acquisition. Hormones and Behavior. 2015;74:186–193. doi: 10.1016/j.yhbeh.2015.06.001. [DOI] [PubMed] [Google Scholar]
  17. Doi H, Nishitani S, Shinohara K. Sex difference in the relationship between salivary testosterone and inter-temporal choice. Hormones and Behavior. 2015;69:50–58. doi: 10.1016/j.yhbeh.2014.12.005. [DOI] [PubMed] [Google Scholar]
  18. Doremus-Fitzwater TL, Barreto M, Spear LP. Age-related differences in impulsivity among adolescent and adult Sprague-Dawley rats. Behavioral Neuroscience. 2012;126:735–741. doi: 10.1037/a0029697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Eubig PA, Noe TE, Floresco SB, Sable JJ, Schantz SL. Sex differences in response to amphetamine in adult Long-Evans rats performing a delay-discounting task. Pharmacology Biochemistry and Behavior. 2014;118:1–9. doi: 10.1016/j.pbb.2013.12.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Evenden JL, Ryan CN. The pharmacology of impulsive behaviour in rats: the effects of drugs on response choice with varying delays of reinforcement. Psychopharmacology. 1996;128:161–170. doi: 10.1007/s002130050121. [DOI] [PubMed] [Google Scholar]
  21. Floresco SB, St Onge JR, Ghods-Sharifi S, Winstanley CA. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cognitive, Affective, & Behavioral Neuroscience. 2008;8:375–389. doi: 10.3758/CABN.8.4.375. [DOI] [PubMed] [Google Scholar]
  22. Fobbs WC, Mizumori SJ. A framework for understanding and advancing intertemporal choice research using rodent models. Neurobiology of Learning and Memory. 2017;139:89–97. doi: 10.1016/j.nlm.2017.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Frick KM, Kim J, Tuscher JJ, Fortress AM. Sex steroid hormones matter for learning and memory: estrogenic regulation of hippocampal function in male and female rodents. Learning & Memory. 2015;22:472–493. doi: 10.1101/lm.037267.114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Frost R, McNaughton N. The neural basis of delay discounting: a review and preliminary model. Neuroscience & Biobehavioral Reviews. 2017;79:48–65. doi: 10.1016/j.neubiorev.2017.04.022. [DOI] [PubMed] [Google Scholar]
  25. Garcia A, Kirkpatrick K. Impulsive choice behavior in four strains of rats: evaluation of possible models of Attention-Deficit/Hyperactivity disorder. Behavioural Brain Research. 2013;238:10–22. doi: 10.1016/j.bbr.2012.10.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Grissom NM, Reyes TM. Let's call the whole thing off: evaluating gender and sex differences in executive function. Neuropsychopharmacology. 2019;44:86–96. doi: 10.1038/s41386-018-0179-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Heerey EA, Robinson BM, McMahon RP, Gold JM. Delay discounting in schizophrenia. Cognitive Neuropsychiatry. 2007;12:213–221. doi: 10.1080/13546800601005900. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Hernandez CM, Vetere LM, Orsini CA, McQuail JA, Maurer AP, Burke SN, Setlow B, Bizon JL. Decline of prefrontal cortical-mediated executive functions but attenuated delay discounting in aged Fischer 344 × brown Norway hybrid rats. Neurobiology of Aging. 2017;60:141–152. doi: 10.1016/j.neurobiolaging.2017.08.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Ho MY, Wogar MA, Bradshaw CM, Szabadi E. Choice between delayed reinforcers: interaction between delay and deprivation level. The Quarterly Journal of Experimental Psychology. 1997;50:193–202. [Google Scholar]
  30. Hoptman MJ. Impulsivity and aggression in schizophrenia: a neural circuitry perspective with implications for treatment. CNS Spectrums. 2015;20:280–286. doi: 10.1017/S1092852915000206. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Huskinson SL, Krebs CA, Anderson KG. Strain differences in delay discounting between Lewis and Fischer 344 rats at Baseline and following acute and chronic administration of d-amphetamine. Pharmacology Biochemistry and Behavior. 2012;101:403–416. doi: 10.1016/j.pbb.2012.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Kaighobadi F, Stevens JR. Does fertility status influence impulsivity and risk taking in human females? adaptive influences on intertemporal choice and risky decision making. Evolutionary Psychology. 2013;11:700–717. doi: 10.1177/147470491301100314. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Kim TW, Kim CS, Kim JY, Kim CJ, Seo JH. Combined exercise ameliorates ovariectomy-induced cognitive impairment by enhancing cell proliferation and suppressing apoptosis. Menopause. 2016;23:18–26. doi: 10.1097/GME.0000000000000486. [DOI] [PubMed] [Google Scholar]
  34. Kirby KN, Maraković NN. Modeling myopic decisions: evidence for hyperbolic Delay-Discounting within subjects and amounts. Organizational Behavior and Human Decision Processes. 1995;64:22–30. doi: 10.1006/obhd.1995.1086. [DOI] [Google Scholar]
  35. Kirby KN, Maraković NN. Delay-discounting probabilistic rewards: rates decrease as amounts increase. Psychonomic Bulletin & Review. 1996;3:100–104. doi: 10.3758/BF03210748. [DOI] [PubMed] [Google Scholar]
  36. Klump KL, Racine S, Hildebrandt B, Sisk CL. Sex differences in binge eating patterns in male and female adult rats. International Journal of Eating Disorders. 2013;46:729–736. doi: 10.1002/eat.22139. [DOI] [PubMed] [Google Scholar]
  37. Koot S, van den Bos R, Adriani W, Laviola G. Gender differences in delay-discounting under mild food restriction. Behavioural Brain Research. 2009;200:134–143. doi: 10.1016/j.bbr.2009.01.006. [DOI] [PubMed] [Google Scholar]
  38. Korol DL. Role of estrogen in balancing contributions from multiple memory systems. Neurobiology of Learning and Memory. 2004;82:309–323. doi: 10.1016/j.nlm.2004.07.006. [DOI] [PubMed] [Google Scholar]
  39. Koss WA, Frick KM. Activation of androgen receptors protects intact male mice from memory impairments caused by aromatase inhibition. Hormones and Behavior. 2019;111:96–104. doi: 10.1016/j.yhbeh.2019.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Larson EB, Carroll ME. Estrogen receptor beta, but not alpha, mediates estrogen's effect on cocaine-induced reinstatement of extinguished cocaine-seeking behavior in ovariectomized female rats. Neuropsychopharmacology. 2007;32:1334–1345. doi: 10.1038/sj.npp.1301249. [DOI] [PubMed] [Google Scholar]
  41. Liley AE, Gabriel DBK, Sable HJ, Simon NW. Sex differences and effects of predictive cues on delayed punishment discounting. Eneuro. 2019;6:ENEURO.0225-19.2019. doi: 10.1523/ENEURO.0225-19.2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Logue AW, Anderson YD. Higher-education administrators: when the future does not make a difference. Psychological Science. 2001;12:276–281. doi: 10.1111/1467-9280.00351. [DOI] [PubMed] [Google Scholar]
  43. Lukkes JL, Thompson BS, Freund N, Andersen SL. The developmental inter-relationships between activity, novelty preferences, and delay discounting in male and female rats. Developmental Psychobiology. 2016;58:231–242. doi: 10.1002/dev.21368. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Mai B, Sommer S, Hauber W. Motivational states influence effort-based decision making in rats: the role of dopamine in the nucleus accumbens. Cognitive, Affective, & Behavioral Neuroscience. 2012;12:74–84. doi: 10.3758/s13415-011-0068-4. [DOI] [PubMed] [Google Scholar]
  45. Marcondes FK, Bianchi FJ, Tanno AP. Determination of the estrous cycle phases of rats: some helpful considerations. Brazilian Journal of Biology. 2002;62:609–614. doi: 10.1590/S1519-69842002000400008. [DOI] [PubMed] [Google Scholar]
  46. Miettunen J, Veijola J, Lauronen E, Kantojärvi L, Joukamaa M. Sex differences in Cloninger's temperament dimensions--a meta-analysis. Comprehensive Psychiatry. 2007;48:161–169. doi: 10.1016/j.comppsych.2006.10.007. [DOI] [PubMed] [Google Scholar]
  47. Mischel W, Underwood B. Instrumental ideation in delay of gratification. Child Development. 1974;45:1083–1088. doi: 10.2307/1128098. [DOI] [PubMed] [Google Scholar]
  48. Montes GS, Luque EH. Effects of ovarian steroids on vaginal smears in the rat. Acta Anatomica. 1988;133:192–199. doi: 10.1159/000146639. [DOI] [PubMed] [Google Scholar]
  49. Orsini CA, Trotta RT, Bizon JL, Setlow B. Dissociable roles for the basolateral amygdala and orbitofrontal cortex in Decision-Making under risk of punishment. Journal of Neuroscience. 2015;35:1368–1379. doi: 10.1523/JNEUROSCI.3586-14.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Orsini CA, Willis ML, Gilbert RJ, Bizon JL, Setlow B. Sex differences in a rat model of risky decision making. Behavioral Neuroscience. 2016;130:50–61. doi: 10.1037/bne0000111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Orsini CA, Setlow B. Sex differences in animal models of decision making. Journal of Neuroscience Research. 2017;95:260–269. doi: 10.1002/jnr.23810. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Ortner GR, Wibral M, Becker A, Dohmen T, Klingmüller D, Falk A, Weber B. No evidence for an effect of testosterone administration on delay discounting in male university students. Psychoneuroendocrinology. 2013;38:1814–1818. doi: 10.1016/j.psyneuen.2012.12.014. [DOI] [PubMed] [Google Scholar]
  53. Panfil K, Bailey C, Davis I, Mains A, Kirkpatrick K. A time-based intervention to treat impulsivity in male and female rats. Behavioural Brain Research. 2020;379:112316. doi: 10.1016/j.bbr.2019.112316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Peak JN, Turner KM, Burne TH. The effect of developmental vitamin D deficiency in male and female Sprague-Dawley rats on decision-making using a rodent gambling task. Physiology & Behavior. 2015;138:319–324. doi: 10.1016/j.physbeh.2014.09.007. [DOI] [PubMed] [Google Scholar]
  55. Pellman BA, Schuessler BP, Tellakat M, Kim JJ. Sexually dimorphic risk mitigation strategies in rats. Eneuro. 2017;4:ENEURO.0288-16.2017. doi: 10.1523/ENEURO.0288-16.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Perry JL, Nelson SE, Anderson MM, Morgan AD, Carroll ME. Impulsivity (delay discounting) for food and cocaine in male and female rats selectively bred for high and low saccharin intake. Pharmacology Biochemistry and Behavior. 2007;86:822–837. doi: 10.1016/j.pbb.2007.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Perry JL, Nelson SE, Carroll ME. Impulsive choice as a predictor of acquisition of IV cocaine self- administration and reinstatement of cocaine-seeking behavior in male and female rats. Experimental and Clinical Psychopharmacology. 2008;16:165–177. doi: 10.1037/1064-1297.16.2.165. [DOI] [PubMed] [Google Scholar]
  58. Peters J, Büchel C. The neural mechanisms of inter-temporal decision-making: understanding variability. Trends in Cognitive Sciences. 2011;15:227–239. doi: 10.1016/j.tics.2011.03.002. [DOI] [PubMed] [Google Scholar]
  59. Qu N, Wang L, Liu ZC, Tian Q, Zhang Q. Oestrogen receptor α agonist improved long-term ovariectomy-induced spatial cognition deficit in young rats. International Journal of Neuropsychopharmacology. 2013;16:1071–1082. doi: 10.1017/S1461145712000958. [DOI] [PubMed] [Google Scholar]
  60. Reynolds B, Ortengren A, Richards JB, de Wit H. Dimensions of impulsive behavior: personality and behavioral measures. Personality and Individual Differences. 2006;40:305–315. doi: 10.1016/j.paid.2005.03.024. [DOI] [Google Scholar]
  61. Rogol AD, Roemmich JN, Clark PA. Growth at puberty. Journal of Adolescent Health. 2002;31:192–200. doi: 10.1016/S1054-139X(02)00485-8. [DOI] [PubMed] [Google Scholar]
  62. Rolls BJ, Fedoroff IC, Guthrie JF. Gender differences in eating behavior and body weight regulation. Health Psychology. 1991;10:133–142. doi: 10.1037/0278-6133.10.2.133. [DOI] [PubMed] [Google Scholar]
  63. Rood L, Roelofs J, Bögels SM, Nolen-Hoeksema S, Schouten E. The influence of emotion-focused rumination and distraction on depressive symptoms in non-clinical youth: a meta-analytic review. Clinical Psychology Review. 2009;29:607–616. doi: 10.1016/j.cpr.2009.07.001. [DOI] [PubMed] [Google Scholar]
  64. Sackett DA, Moschak TM, Carelli RM. Prelimbic cortical neurons track preferred reward value and reflect impulsive choice during delay discounting behavior. The Journal of Neuroscience. 2019;39:3108–3118. doi: 10.1523/JNEUROSCI.2532-18.2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Setlow B, Schoenbaum G, Gallagher M. Neural encoding in ventral striatum during olfactory discrimination learning. Neuron. 2003;38:625–636. doi: 10.1016/S0896-6273(03)00264-2. [DOI] [PubMed] [Google Scholar]
  66. Shansky RM, Rubinow K, Brennan A, Arnsten AF. The effects of sex and hormonal status on restraint-stress-induced working memory impairment. Behavioral and Brain Functions : BBF. 2006;2:8. doi: 10.1186/1744-9081-2-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Shimp KG, Mitchell MR, Beas BS, Bizon JL, Setlow B. Affective and cognitive mechanisms of risky decision making. Neurobiology of Learning and Memory. 2015;117:60–70. doi: 10.1016/j.nlm.2014.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Silverman IW. Gender differences in delay of gratification: a Meta-Analysis. Sex Roles. 2003;49:451–463. doi: 10.1023/A:1025872421115. [DOI] [Google Scholar]
  69. Simon NW, Mendez IA, Setlow B. Cocaine exposure causes long-term increases in impulsive choice. Behavioral Neuroscience. 2007;121:543–549. doi: 10.1037/0735-7044.121.3.543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Simon NW, LaSarge CL, Montgomery KS, Williams MT, Mendez IA, Setlow B, Bizon JL. Good things come to those who wait: attenuated discounting of delayed rewards in aged Fischer 344 rats. Neurobiology of Aging. 2010;31:853–862. doi: 10.1016/j.neurobiolaging.2008.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Smith CT, Sierra Y, Oppler SH, Boettiger CA. Ovarian cycle effects on immediate reward selection Bias in humans: a role for estradiol. Journal of Neuroscience. 2014;34:5468–5476. doi: 10.1523/JNEUROSCI.0014-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Smith CL, Hantula DA. Methodological considerations in the study of delay discounting in intertemporal choice: a comparison of tasks and modes. Behavior Research Methods. 2008;40:940–953. doi: 10.3758/BRM.40.4.940. [DOI] [PubMed] [Google Scholar]
  73. Spritzer MD, Daviau ED, Coneeny MK, Engelman SM, Prince WT, Rodriguez-Wisdom KN. Effects of testosterone on spatial learning and memory in adult male rats. Hormones and Behavior. 2011;59:484–496. doi: 10.1016/j.yhbeh.2011.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Stanton SJ. The role of testosterone and estrogen in consumer behavior and social & economic decision making: a review. Hormones and Behavior. 2017;92:155–163. doi: 10.1016/j.yhbeh.2016.11.006. [DOI] [PubMed] [Google Scholar]
  75. Steinglass JE, Figner B, Berkowitz S, Simpson HB, Weber EU, Walsh BT. Increased capacity to delay reward in anorexia nervosa. Journal of the International Neuropsychological Society. 2012;18:773–780. doi: 10.1017/S1355617712000446. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Steward T, Mestre-Bach G, Vintró-Alcaraz C, Agüera Z, Jiménez-Murcia S, Granero R, Fernández-Aranda F. Delay discounting of reward and impulsivity in eating disorders: from anorexia nervosa to binge eating disorder. European Eating Disorders Review. 2017;25:601–606. doi: 10.1002/erv.2543. [DOI] [PubMed] [Google Scholar]
  77. Takahashi T, Sakaguchi K, Oki M, Homma S, Hasegawa T. Testosterone levels and discounting delayed monetary gains and losses in male humans. Neuro Endocrinology Letters. 2006;27:439–444. [PubMed] [Google Scholar]
  78. Tobiansky DJ, Wallin-Miller KG, Floresco SB, Wood RI, Soma KK. Androgen regulation of the mesocorticolimbic system and executive function. Frontiers in Endocrinology. 2018;9:279. doi: 10.3389/fendo.2018.00279. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Tuscher JJ, Fortress AM, Kim J, Frick KM. Regulation of object recognition and object placement by ovarian sex steroid hormones. Behavioural Brain Research. 2015;285:140–157. doi: 10.1016/j.bbr.2014.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Uban KA, Rummel J, Floresco SB, Galea LA. Estradiol modulates effort-based decision making in female rats. Neuropsychopharmacology. 2012;37:390–401. doi: 10.1038/npp.2011.176. [DOI] [PMC free article] [PubMed] [Google Scholar]
  81. van den Bos R, Jolles J, van der Knaap L, Baars A, de Visser L. Male and female wistar rats differ in decision-making performance in a rodent version of the iowa gambling task. Behavioural Brain Research. 2012;234:375–379. doi: 10.1016/j.bbr.2012.07.015. [DOI] [PubMed] [Google Scholar]
  82. van den Bos R, Homberg J, de Visser L. A critical review of sex differences in decision-making tasks: focus on the iowa gambling task. Behavioural Brain Research. 2013;238:95–108. doi: 10.1016/j.bbr.2012.10.002. [DOI] [PubMed] [Google Scholar]
  83. Van Haaren F, Van Hest A, Van De Poll NE. Self-control in male and female rats. Journal of the Experimental Analysis of Behavior. 1988;49:201–211. doi: 10.1901/jeab.1988.49-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Wagner BA, Braddick VC, Batson CG, Cullen BH, Miller LE, Spritzer MD. Effects of testosterone dose on spatial memory among castrated adult male rats. Psychoneuroendocrinology. 2018;89:120–130. doi: 10.1016/j.psyneuen.2017.12.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Weafer J, de Wit H. Sex differences in impulsive action and impulsive choice. Addictive Behaviors. 2014;39:1573–1579. doi: 10.1016/j.addbeh.2013.10.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Wieland RG, Chen JC, Zorn EM, Hallberg MC. Correlation of growth, pubertal staging, growth hormone, gonadotropins, and testosterone levels during the pubertal growth spurt in males. The Journal of Pediatrics. 1971;79:999–1002. doi: 10.1016/S0022-3476(71)80197-X. [DOI] [PubMed] [Google Scholar]
  87. Wilbertz G, Trueg A, Sonuga-Barke EJ, Blechert J, Philipsen A, Tebartz van Elst L. Neural and psychophysiological markers of delay aversion in attention-deficit hyperactivity disorder. Journal of Abnormal Psychology. 2013;122:566–572. doi: 10.1037/a0031924. [DOI] [PubMed] [Google Scholar]
  88. Wilson JD, George FW, Griffin JE. The hormonal control of sexual development. Science. 1981;211:1278–1284. doi: 10.1126/science.7010602. [DOI] [PubMed] [Google Scholar]
  89. Wogar MA, Bradshaw CM, Szabadi E. Choice between delayed reinforcers in an adjusting-delay schedule: the effects of absolute reinforcer size and deprivation level. The Quarterly Journal of Experimental Psychology. 1992;45:1–13. [PubMed] [Google Scholar]
  90. Wood RI, Armstrong A, Fridkin V, Shah V, Najafi A, Jakowec M. 'Roid rage in rats? Testosterone effects on aggressive motivation, impulsivity and tyrosine hydroxylase. Physiology & Behavior. 2013;111:6–12. doi: 10.1016/j.physbeh.2012.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  91. Yagi S, Drewczynski D, Wainwright SR, Barha CK, Hershorn O, Galea LAM. Sex and estrous cycle differences in immediate early gene activation in the Hippocampus and the dorsal striatum after the cue competition task. Hormones and Behavior. 2017;87:69–79. doi: 10.1016/j.yhbeh.2016.10.019. [DOI] [PubMed] [Google Scholar]

Decision letter

Editor: Shelly B Flagel1
Reviewed by: Shelly B Flagel2

In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.

Acceptance summary:

The reported findings suggest that sex differences in impulsive responding in rats are due to testicular hormones. This research make a significant contribution to the field, enhancing our understanding of sex differences in impulsivity.

Decision letter after peer review:

Thank you for submitting your article "Testicular hormones mediate robust sex differences in impulsive choice" for consideration by eLife. Your article has been reviewed by three peer reviewers, including Shelly B Flagel as the Reviewing Editor and Reviewer #1, and the evaluation has been overseen by Kate Wassum as the Senior Editor.

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

We would like to draw your attention to changes in our revision policy that we have made in response to COVID-19 (https://elifesciences.org/articles/57162). Specifically, we are asking editors to accept without delay manuscripts, like yours, that they judge can stand as eLife papers without additional data, even if they feel that they would make the manuscript stronger. Thus the revisions requested below only address clarity and presentation.

Summary:

The authors investigate the impact of sex and gonadal hormones on impulsive responding in rats. While this topic is not novel, the results in the literature are mixed, and the authors attempted to dissociate sex and hormonal factors using a strong within-subject design. They report sex differences, with females showing more impulsive responding relative to males and conclude that this difference is likely due to testicular hormones, as gonadectomy affected male, but not female, responding. These gonadectomy results were considered to be a valuable contribution to the understanding of the influence of sex on impulsivity.

The reviewers agreed that this manuscript is well-written, that the data are easy to assimilate and beautifully graphed, and that the concluding paragraph in particular gives much food for thought. However, they feel that the conclusions need to be tempered and that further analyses and discussion are warranted surrounding some of the points highlighted below.

Essential revisions:

1) One primary concern with this manuscript is that it is aiming to resolve a big question that others have tried to resolve before this group, namely whether there are sex differences in performance of delay discounting tasks. The current data clearly imply that there are, and that females are more impulsive, but previous groups were likely just as confident in their assessment. Why should this study be taken as being more definitive than any of the others that preceded it? What was done better or differently than others? Is this strain of rats more likely to represent the human condition, or is the behavioral methodology better for comparative psychology? The strengths and weakness of the current approach should be made explicit in the Discussion.

2) To be clear, the above questions do not invalidate the scientific study done here- in fact, review of the studies cited suggests that this is the largest study done to date (n = 16 per group vs. n = 4 (van Haaren)/6 (Eubig)/9-10 (Sackett)etc.) but it is still only a small number of animals. Although this is a typical sample size for an animal study, due to the greater experimental control inherent when using animal models, it is still possible to get results that are not indicative of the whole population, especially as commercial rodent suppliers generally tend to ship siblings rather than genetically diverse cohorts. Likewise, individual experiments using human subjects may find evidence for or against sex/gender differences due to a relatively small n. However, a meta-analysis found no gender differences in delay discounting tasks across 277 studies using human subjects (Cross et al., 2011).

3) Beyond the issue of sample size, there are also strain differences in delay discounting tasks (e.g. (Garcia and Kirkpatrick, 2012; Huskinson et al., 2012)) So, again, if this study is aiming to definitively demonstrate sex difference in delay discounting, large numbers of animals should be used and the effect should hold across multiple strains. I therefore urge the authors to temper their title and conclusions: although compelling, the current data are unlikely to resolve the issue of whether sex differences are present in the performance of delay-discounting tasks, but will simply be added in to the collection of studies, adding weight to one side of the argument, but certainly not ending it.

4) The repeated testing warrants further discussion. In relation, it seems that comparing males and females (with and without surgery) would be important in order to make claims about whether or not hormones are truly mediating the sex differences. Given the current analysis, it is difficult to say if gonadectomy rendered males more similar to females.

5) It is not clear that the described differences are not due to overall differences in motivation or reward magnitude. While the data suggest that males and females respond similarly to restricted feeding, it doesn't directly address the motivational state of females at the time of the original test. Further, the sex differences in latency and omitted trials highlights potential differences in motivational states. Additional analyses might be telling in this regard. For example, if only non-omitted trials are included, are there still sex differences in latency? Further, in their restricted feeding tests, more females than males are excluded due to omitted trials and this could be a meaningful sex difference. This warrants further discussion.

6) In relation to the point above, the food restriction data are useful, but suffer from a small effect size. It is hard to see how the females could become any more impulsive, and the lines seem to be on top of one another, yet there is no main effect of sex in the omnibus ANOVA. Given that these results are integral in proving that the effect in females is not dependent on differences in satiety for sugar pellets, it would be useful to analyse the data from females only and show there is a clear effect of food restriction in these rats.

7) Further, it seems that the longer response latencies and greater percentage of trial omissions seen in females on the forced choice trials for the larger reward could also indicate that this large reward isn't as rewarding for females as males? This is partially addressed by the 24-hr ad lib feeding study but not entirely as ad lib feeding seems to affect females differently than males (note the decrease in % choice at the 0 sec delay and the increase in omissions seen in females after 24hr ad lib feeding).

8) Post-hoc comparisons should be included in the primary text when appropriate. For example, it is stated, "As shown in Figure 2A, females made fewer choices of large, delayed rewards than males (two-factor ANOVA, main effect of sex: F(1,30)=10.586, p=0.003), particularly when longer delays preceded delivery of the large reward (sex x delay interaction, F(4,120)=8.572; p<0.001). However, the graph suggests that sex differences were more robust at shorter delays. Post-hoc comparisons should be included for each delay.

9) In the Introduction, the authors mention previous work showing that testosterone administration in rats can influence impulsive choice whereas work in humans does not recapitulate these effects. The authors should discuss how this incongruity in the literature may influence the translational interpretation of their findings.

eLife. 2020 Sep 28;9:e58604. doi: 10.7554/eLife.58604.sa2

Author response


Essential revisions:

1) One primary concern with this manuscript is that it is aiming to resolve a big question that others have tried to resolve before this group, namely whether there are sex differences in performance of delay discounting tasks. The current data clearly imply that there are, and that females are more impulsive, but previous groups were likely just as confident in their assessment. Why should this study be taken as being more definitive than any of the others that preceded it? What was done better or differently than others? Is this strain of rats more likely to represent the human condition, or is the behavioral methodology better for comparative psychology? The strengths and weakness of the current approach should be made explicit in the Discussion.

We thank the reviewer for their comments. We agree that other groups were likely just as confident in their findings, but we believe that our data provide the most convincing evidence to date for greater impulsive choice in female compared to male rats. Prior rodent studies in agreement with our findings either had small sample sizes or were not designed to explicitly test sex differences. One study employing an intertemporal choice task in which delays for the large reward were varied across sessions in 4 male and 4 female Wistar rats found that females discounted large food rewards to a greater extent than males when the delay to delivery increased from 9 to 36 s (van Haaren et al., 1988). Similarly, another study using rats bred for variability in saccharin preference employed an adjusting delays task and found that female rats were more impulsive relative to males (Perry et al., 2007). This sex difference was conditional, however, in that it was only evident in rats with low preference for saccharin (but not high preference for saccharine).

Two more recent studies also reported evidence for numerically greater impulsive choice in female than male rats, although the differences did not reach statistical significance (Eubig et al., 2014; Lukkes et al., 2016). In the first study, Eubig et al. employed an intertemporal choice task design similar to that used in our study and found that female rats had numerically fewer choices of large, delayed rewards relative to males. In the second study, Lukkes et al. also employed an intertemporal choice task design similar to that used in our study to evaluate impulsive choice in adolescent and adult male and female rats. These authors reported a numerically lower indifference point (greater impulsive choice) in female relative to male rats. It is possible that neither of these studies were sufficiently powered to detect statistically significant sex differences, given their smaller group sizes (Eubig et al.: n=6/sex; Lukkes et al.: n=8-9/sex) compared to our study (n=16/sex).

One study using mice in an intertemporal choice task in which mice had to nosepoke into food troughs that delivered a small immediate food reward vs. a large, delayed food reward reported that females were more impulsive than males (Koot et al., 2009). Like the Perry et al., 2007 study described above, however, these results were conditional in that the sex difference was only present in “high-discounting” mice, whereas there were no sex differences in “low-discounting” mice.

In contrast to the (limited) evidence for greater impulsive choice in female relative to male rodents described above, two studies reported neither numerical nor statistically significant sex differences in impulsive choice (Perry et al., 2008; Sackett et al., 2019). Although Perry and colleagues previously reported greater impulsive choice in females relative to males (Perry et al., 2007), these authors reported no such difference in a subsequent study (Perry et al., 2008). The null effect in the 2008 study could have been due to strain differences, as their previously reported sex differences (Perry et al., 2007) were in a subset of Sprague-Dawley rats bred for saccharin preference, whereas the lack of differences in the 2008 paper was in Wistar rats. The Sackett et al., 2019 study tested Long-Evans rats in an intertemporal choice task similar to that used in our study and found no differences between males and females in their choice behavior. Despite a null effect of sex in this study, however, when the authors used rats’ individual variability in choice behavior to sort them into high discounters (i.e., more impulsive choice) and low discounters (i.e., less impulsive choice), the high discounter group contained double the number of females relative to males, whereas the low discounting group contained double the males relative to females.

The results of the current study explicitly and unequivocally show a greater preference for small, immediate rewards in females relative to males and are in agreement (at least numerically if not statistically) with the bulk of the rodent literature on the topic, across rodent species and strains. Although the strain used in our study could certainly account for the large sex difference (relative to most previous work), we suspect that the larger sample sizes and the use of longer delays to the large reward delivery relative to most previous studies played a greater role in our ability to detect sex differences. Note that we cannot claim that the Fischer 344 × Brown Norway F1 hybrid rats used in our study is more representative of humans than other strains.

We now provide a more expanded discussion of these issues in the Discussion section.

2) To be clear, the above questions do not invalidate the scientific study done here- in fact, review of the studies cited suggests that this is the largest study done to date (n = 16 per group vs. n = 4 (van Haaren)/6 (Eubig)/9-10 (Sackett)etc.) but it is still only a small number of animals. Although this is a typical sample size for an animal study, due to the greater experimental control inherent when using animal models, it is still possible to get results that are not indicative of the whole population, especially as commercial rodent suppliers generally tend to ship siblings rather than genetically diverse cohorts. Likewise, individual experiments using human subjects may find evidence for or against sex/gender differences due to a relatively small n. However, a meta-analysis found no gender differences in delay discounting tasks across 277 studies using human subjects (Cross et al., 2011).

The reviewer emphasizes an important point. Ideally, we would reproduce these results across multiple strains using identical methodology to support our claim; however, it is important to note that among rodent studies (including several using different rat strains), the preponderance of evidence seems to point to greater impulsive choice in females (see response to Point 1 above). Notably, we observed considerable individual variability among male rats this variability was less evident in females, likely due to a floor effect; (see Figure 4B and E). It will be important in future work to follow up on these individual differences, as there is considerable evidence (largely from male rats) that variability in impulsive choice predicts numerous other behavioral phenotypes relevant to neuropsychiatric disorders. One additional important point to make is that the rats in this study were run in 3 separate cohorts each separated by 12-24 months. As such, our detection of sex differences cannot be solely attributed to the use of rats from only a few different litters (i.e., reduced genetic variability). This latter point is now noted in the subsection “Subjects”.

Regarding the null findings of the meta-analysis done by Cross et al., 2011, we agree it could call into question the broader translational relevance of our findings, but we also believe that gender differences in impulsive choice may be conditional and nuanced. There are several studies in the human literature to suggest sex differences consistent with our findings (e.g., Logue and Anderson, 2001, Reynolds et al., 2006, Smith and Hantula, 2008, Beck and Triplett, 2009); however, factors such as the use of real vs. hypothetical rewards may influence the magnitude and direction of gender differences in impulsive choice (Kirby and Maraković, 1995; Kirby and Maraković, 1996; Weafer and de Wit, 2014). Considered together, it is possible that inconsistencies in gender/sex differences in impulsive choice can be attributed to the types of rewards used or the weights placed on distinct features of rewards. Particularly if delays are viewed as more “costly” or “punishing” by females (who tend to be more sensitive to punishments than males; Cross et al., 2011), it may be the case that greater impulsive choice among females will be most evident in circumstances that more closely model actual (experienced, rather than hypothetical) delays. We now mention this point in the subsection “Limitations and Conclusions”.

3) Beyond the issue of sample size, there are also strain differences in delay discounting tasks (e.g. (Garcia and Kirkpatrick, 2012; Huskinson et al., 2012)) So, again, if this study is aiming to definitively demonstrate sex difference in delay discounting, large numbers of animals should be used and the effect should hold across multiple strains. I therefore urge the authors to temper their title and conclusions: although compelling, the current data are unlikely to resolve the issue of whether sex differences are present in the performance of delay-discounting tasks, but will simply be added in to the collection of studies, adding weight to one side of the argument, but certainly not ending it.

We thank the reviewer for this comment, and again we agree. We have now changed the title to clarify that the study was conducted in rats and have incorporated a more detailed discussion of the rodent literature within the manuscript (Discussion). We believe that our data are in agreement with the majority of prior evidence for greater impulsive choice in female rodents (see responses above). Indeed, across strains, to our knowledge, there are more studies showing greater impulsive choice in female rodents than not, although we concede the limitations of the use of a single rodent strain and task design in our study (subsection “Limitations and Conclusions”).

4) The repeated testing warrants further discussion. In relation, it seems that comparing males and females (with and without surgery) would be important in order to make claims about whether or not hormones are truly mediating the sex differences. Given the current analysis, it is difficult to say if gonadectomy rendered males more similar to females.

Repeated testing of the same animals before and after surgery allowed us to incorporate both within- and between-subjects comparisons of the effects of gonadectomy (GDX). In our view, this was the strongest possible experimental design as it allowed us to include both surgical condition and timepoint as variables (which in turn enabled us to determine the contributions of GDX vs. simply the passage of time from pre- to post-surgery). The reviewer makes a good point regarding claims about whether or not hormones mediate the sex difference. Although we would argue that the results in castrated males are certainly suggestive, additional experiments would be necessary to strongly draw this conclusion, and thus we have moderated our language on this point in the revised manuscript (Discussion).

5) It is not clear that the described differences are not due to overall differences in motivation or reward magnitude. While the data suggest that males and females respond similarly to restricted feeding, it doesn't directly address the motivational state of females at the time of the original test. Further, the sex differences in latency and omitted trials highlights potential differences in motivational states. Additional analyses might be telling in this regard. For example, if only non-omitted trials are included, are there still sex differences in latency? Further, in their restricted feeding tests, more females than males are excluded due to omitted trials and this could be a meaningful sex difference. This warrants further discussion.

The reviewer brings up an important point regarding the potential contributions of sex differences in motivation, and we have attempted to clarify this issue throughout the Results section. In particular, we did not distinguish well in our original manuscript between omissions on free- vs. forced-choice trials, which we have attempted to do throughout the revised manuscript.

We now clarify (subsection “Effect of sex on intertemporal choice performance”) that there was no sex difference in the number of omitted free-choice trials during the original comparison of performance under food restricted conditions (i.e., for the data shown in Figure 2). As shown by the data in Figure 4C and F, pre-feeding (which should reduce motivation to obtain food during subsequent task performance) causes an increase in free-choice trial omissions, suggesting that the number of free-choice trial omissions is a reasonable proxy for food motivation (see Simon et al. 2009, Neuropsychopharmacology for similar findings). Note that there were also no sex differences in omitted free-choice trials during these pre-feeding tests as well (subsection “Effect of food motivational state on intertemporal choice performance in males and females”). Given these data (as well as the absence of sex differences in choice behavior in the effects of varying degrees of pre-feeding), we believe that the data argue for no sex differences in primary motivation to obtain food, at least under the conditions required for intertemporal choice task performance.

Regarding the sex differences in response latencies and trial omissions on forced-choice trials (Figure 3), we agree with the reviewer that these data highlight sex differences in motivation; however, we argue that these data are more consistent with sex differences in motivation specifically to obtain the large, delayed reward rather than differences in food motivation in general. In females, the increases in latency and omitted trials were largely limited to choices of the large reward. Indeed, latencies to obtain the small reward did not change at all across blocks of trials in females (Figure 3A), and on neither measure did small reward latencies or small reward trial omissions differ by sex. If females were less food motivated than males (either in general or as a function of satiation as they progressed through the blocks of trials), we would expect this to be reflected in longer latencies and more trial omissions to an equivalent degree on both small and large reward trials. As the changes in latency and trial omissions in females were mostly selective to the large reward, we conclude that this was due to greater impulsive choice/delay intolerance in females. This argument is now presented in greater detail in the subsection “Effect of sex on intertemporal choice performance”.

Regarding the latency measures, we now clarify that only completed trials were included in the analyses of latency data (i.e., omitted trials were excluded from this analysis – this is now clarified in the subsection “Evaluation of sex differences in intertemporal choice”). The reviewer makes a good point regarding the greater number of excluded females than males in the pre-feeding test, however, and we now mention this point in the subsection “Greater impulsive choice in females is not dependent on differential hunger/satiety”.

6) In relation to the point above, the food restriction data are useful, but suffer from a small effect size. It is hard to see how the females could become any more impulsive, and the lines seem to be on top of one another, yet there is no main effect of sex in the omnibus ANOVA. Given that these results are integral in proving that the effect in females is not dependent on differences in satiety for sugar pellets, it would be useful to analyse the data from females only and show there is a clear effect of food restriction in these rats.

We thank the reviewer for catching our errors in statistical reporting! In the revised manuscript we now clarify the results from the pre-feeding experiment. The 1-hr ad libitum feeding schedule caused n=2 male and n=5 female rats to omit enough choices to be excluded from the analysis of choice performance (leaving n=14 male and n=11 female) but not the analysis of free-choice trial omissions (for which all rats were included). For choice behavior, a multi-factor ANOVA (sex × feeding schedule × delay) confirmed the expected main effects of sex (F(1,23)=26.753, p<0.001), delay (F(4,92)=112.833, p<0.001) and the sex × delay interaction (F(4,92)=11.227, p<0.001; Figure 4A). The 1-hr ad libitum feeding schedule decreased choice of large, delayed rewards (main effect of schedule: F(1,23)=5.861, p=0.024; Figure 4B) in a non-delay-dependent manner (schedule × delay: F(4,92)=1.368, p=0.251). Most importantly, however (and most relevant to the point being tested in this experiment), there were no interactions between sex and the 1-hr ad libitum feeding schedule (schedule × sex: F(1,23)=0.417, p=0.525; schedule × sex × delay: F(4,92)=1.270, p=0.288), suggesting that different levels of hunger/satiation in males and females did not account for the sex difference in choice performance. Note that there was a main effect of feeding schedule (F(1,30)=9.115, p=0.005; Figure 4C) on the percentage of free-choice trials omitted such that 1-hr ad libitum significantly increased trial omissions irrespective of sex (main effect of sex: F(1,30)=0.294, p=0.592; schedule × sex: F(1,30)=0.294, p=0.592) – see also the response to Point 5 above.

The 24-hr ad libitum feeding schedule caused n=3 female rats to omit enough choices to be excluded from the choice but not the trial omission analysis. A multi-factor ANOVA (sex × feeding schedule × delay) confirmed the expected main effects of sex (F(1,27)=13.414, p=0.001) and delay (F(4,108)=81.398, p<0.001) and the sex × delay interaction (F(4,108)=7.899, p<0.001; Figure 4D). Unlike the 1-hr ad libitum schedule, there was no decrease in the choice of large, delayed rewards as a result of the 24-hr ad libitum feeding schedule (main effect of feeding schedule F(1,27)=2.302, p=0.141; Figure 4E). Most importantly (and as with the 1-hr schedule), however, there was no interaction between sex and schedule (schedule × sex: F(1,27)=0.021, p=0.887; schedule × sex × delay: F(4,108)=1.433, p=0.228), indicating that a sex difference in food motivation likely does not account for the sex difference in choice performance. Importantly, as with the 1-hr ad libitum schedule, there was a significant of effect of feeding schedule on trial omissions such that more trials were omitted during the 24-hr ad libitum period (main effect of schedule: F(1,30)=13.400, p=0.001; Figure 4F) irrespective of sex (main effect of sex: F(1,30)=2.297, p=0.140; schedule × sex: F(1,30)=2.839, p=0.102). We now include the corrected statistics for this experiment in the text (subsection “Effect of sex on intertemporal choice performance”).

7) Further, it seems that the longer response latencies and greater percentage of trial omissions seen in females on the forced choice trials for the larger reward could also indicate that this large reward isn't as rewarding for females as males? This is partially addressed by the 24-hr ad lib feeding study but not entirely as ad lib feeding seems to affect females differently than males (note the decrease in % choice at the 0 sec delay and the increase in omissions seen in females after 24hr ad lib feeding).

The reviewers bring up an excellent point. We have now highlighted the absence of difference between males and females in free-choice trial omissions under baseline conditions (subsection “Effect of sex on intertemporal choice performance”), suggesting a comparable willingness to engage in the task (see also the response to point 5 above). We also now discuss the rats’ performance at the 0 s delay (Figures 2 and 3). Specifically, the fact that males and females show equivalent preference for the large reward in the absence of delays (Figure 2A) suggests robust detection of reward magnitude differences and preference for the larger reward in females. At the 0 s delay, females did show slightly (though not significantly) longer latencies than males to choose the large reward (Figure 3A, t(27) = -2.031, p=0.052; mean difference -0.222 s), but this sex difference was an order of magnitude smaller than the sex difference at longer delays such as 40 s (t(27) = -5.453, p<0.001; mean difference -3.33 s) or 60 sec (t(27) = -3.103, p=0.004; mean difference -2.26 s). In addition, there was no sex difference in the number of forced choice large reward trial omissions at 0 sec delays (Figure 3B, t(30)=1.192, p=0.243). Considered together, these data provide little to no evidence that females were less motivated by the large reward per se, but rather are consistent with the idea that any reductions in motivation for the large reward were due to the delays imposed before its delivery in later blocks of trials.

In addition, we compared males and females at the 0 sec delay in both restricted and ad libitum conditions and did not observe any significant differences under restricted (t(23) = 1.888, p=0.072) or ad libitum (t(23) = 1.401, p=0.175) conditions (Figure 4A). Furthermore, paired samples t-tests comparing restricted and ad libitum conditions at 0 sec within sexes revealed no significant difference in males (t(13) = 1.0, p=0.336) or females (t(10) = 1.019, p=0.332). Closer inspection of the data highlighted that n=1 female rat decreasing choice of the large reward at 0 sec from 90% to 60% was responsible for driving the numerical difference.

8) Post-hoc comparisons should be included in the primary text when appropriate. For example, it is stated, "As shown in Figure 2A, females made fewer choices of large, delayed rewards than males (two-factor ANOVA, main effect of sex: F(1,30)=10.586, p=0.003), particularly when longer delays preceded delivery of the large reward (sex x delay interaction, F(4,120)=8.572; p<0.001). However, the graph suggests that sex differences were more robust at shorter delays. Post-hoc comparisons should be included for each delay.

We thank the reviewer for their comment. We now indicate in each figure the delays at which the groups or conditions differed significantly.

9) In the Introduction, the authors mention previous work showing that testosterone administration in rats can influence impulsive choice whereas work in humans does not recapitulate these effects. The authors should discuss how this incongruity in the literature may influence the translational interpretation of their findings.

We thank the reviewer for their comment. The previous work in rats involved very high levels of testosterone administration (the intention in this study was to model anabolic steroid abuse). In humans, whereas exogenous testosterone (at doses an order of magnitude lower than those used in abuse settings) does not seem to modulate impulsive choice (Ortner et al., 2013), salivary testosterone levels do associate with discounting of delayed gains (Takahashi et al., 2006), suggesting that testosterone levels within the physiological range may play a role in impulsive choice. We have now clarified this point in the Introduction.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Figure 2—source data 1. Figure 2A Sex difference in intertemporal choice.
    Figure 2—source data 2. Figure 2B Effect of estrous cycle phase on intertemporal choice.
    Figure 3—source data 1. Figure 3A Sex difference in forced choice lever response latencies.
    Figure 3—source data 2. Figure 3B Sex difference in forced choice trial omissions.
    Figure 4—source data 1. Figure 4A Effect of 1-hour ad libitum feeding on intertemporal choice.
    Figure 4—source data 2. Figure 4B Effect of 1-hour ad libitum feeding on intertemporal choice (collapsed across delays).
    Figure 4—source data 3. Figure 4C Effect of 1-hour ad libitum feeding on free-choice trial omissions.
    Figure 4—source data 4. Figure 4D Effect of 24-hour ad libitum feeding on intertemporal choice.
    Figure 4—source data 5. Figure 4E Effect of 24-hour ad libitum feeding on intertemporal choice (collapsed across delays).
    Figure 4—source data 6. Figure 4F Effect of 24-hour ad libitum feeding on free-choice trial omissions.
    Figure 5—source data 1. Figure 5A Effect of ovariectomy on intertemporal choice.
    Figure 5—source data 2. Figure 5B Effect of ovariectomy on free-choice trial omissions.
    Figure 5—source data 3. Figure 5C Effect of ovariectomy on intertemporal choice (shorter delays).
    Figure 6—source data 1. Figure 6A Effect of orchiectomy on intertemporal choice.
    Figure 6—source data 2. Figure 6B Effect of orchiectomy on intertemporal choice (collapsed across delays).
    Figure 6—source data 3. Figure 6C Effect of orchiectomy on free-choice trial omissions.
    Figure 7—source data 1. Figure 7A Effect of orchiectomy on forced choice lever response latencies.
    Figure 7—source data 2. Figure 7B Effect of orchiectomy on forced choice trial omissions.
    Transparent reporting form

    Data Availability Statement

    All data generated during this study are included in the manuscript and supporting files.


    Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

    RESOURCES