Abstract
Introduction
Rates of relapse to drug use during abstinence are among the highest for opioid use disorder (OUD). In preclinical studies, reinstatement to drug-seeking has been extensively studied as a model of relapse–but the work has been primarily in males. We asked whether biological sex contributes to behaviors comprising self-administration of the prescription opioid oxycodone in rats, and we calculated the relative contribution of these behavioral measures to reinstatement in male and female rats.
Materials and methods
Rats were trained to self-administer oxycodone (8 days, training phase), after which we examined oxycodone self-administration behaviors for an additional 14 days under three conditions in male and female rats: short access (ShA, 1 h/d), long access (LgA, 6 h/d), and saline self-administration. All rats were then tested for cue-induced reinstatement of drug-seeking after a 14-d forced abstinence period. We quantified the # of infusions, front-loading of drug intake, non-reinforced lever pressing, inter-infusion intervals, escalation of intake, and reinstatement responding on the active lever.
Results
Both male and female rats in LgA and ShA conditions escalated oxycodone intake to a similar extent. However, males had higher levels of non-reinforced responding than females under LgA conditions, and females had greater levels of reinstatement responding than males. We then correlated each addiction-related measure listed above with reinstatement responding in males and females and ranked their respective relative contributions. Although the majority of behavioral measures associated with oxycodone self-administration did not show sex differences on their own, when analyzed together using partial least squares regression, their relative contributions to reinstatement were sex-dependent. Front-loading behavior was calculated to have the highest relative contribution to reinstatement in both sexes, with long and short inter-infusion intervals having the second greatest contribution in females and males, respectively.
Discussion
Our results demonstrate sex differences in some oxycodone self-administration measures. More importantly, we demonstrate that a sex- dependent constellation of self-administration behaviors can predict the magnitude of reinstatement, which holds great promise for relapse prevention in people.
Keywords: escalation, front-loading, female, vulnerability, opioid, relapse, sex difference
Introduction
Recent attention has focused on the dramatic increase in extensive abuse of prescription opioid drugs and heroin by women, which can lead to opioid use disorder (OUD) and even death through overdose. The 2020 “National Survey on Drug Use and Health: Women” reviewed sex/gender differences in prescription opioid medications and heroin use in the USA from 2015 to 2020 and found that the number of women using heroin is increasing at a faster rate than for men, even though non-medical prescription opioid drug misuse is declining for both sexes (SAMHSA, 2020). A consistent finding has been that the likelihood of substance abuse does not differ between men and women when controlling for access (McHugh et al., 2018). This suggests that vulnerability to initiate drug use is not a major source of sex differences in the addiction cycle. Rather, sex differences in high resolution patterns of opioid use and how these contribute to drug craving and reinstatement are more likely to provide information useful for treatment.
OUD is characterized by chronic cycles of compulsive drug-taking, a loss of control in limiting intake, withdrawal-induced negative affective states, craving, and relapse (Koob, 2020). Clinical evidence points to the negative emotional states of withdrawal combined with high rates of relapse as the major barrier to successful treatment of OUD (Hunt et al., 1971; O’Brien, 2005; Chartoff and Connery, 2014). Considerable research over the past 2–3 decades has identified experimental parameters, neural circuits, and a vast array of molecular substrates underlying both withdrawal-induced aversive states and relapse-like behavior (Chartoff et al., 2006; Russell et al., 2016; Hearing, 2019; Koob, 2020). What remains unknown is how behavioral patterns that manifest during escalation of opioid self-administration directly contribute to the vulnerability and magnitude of reinstatement of drug-seeking after periods of abstinence. Compounding this gap in knowledge is that even less is known about basic behavioral responses to opioid self-administration in females, let alone their ability to predict reinstatement (Becker and Chartoff, 2019). The primary goals of this study were to (1) quantify and compare addiction-relevant behavioral measures observed during oxycodone self-administration in male and female rats to determine if there are sex differences in any individual behavioral measures, and (2) rank the relative contributions of all behavioral measures to post-abstinence reinstatement-responding in male and female rats. Importantly, the question of how each behavioral measures contributes to reinstatement in males and females does not require there to be sex differences in those measures per se. Each goal is significant for different reasons. First, the more granular data we can obtain about self-administration behaviors in males and females, the more we can learn about underlying neurobiological mechanisms. Second, the ability to weigh the relative contributions of behaviors displayed during drug self-administration to reinstatement—in males and females separately—suggests this approach may facilitate the ability to accurately predict risk of relapse in men and women with OUD.
To determine how measures and patterns of oxycodone self-administration might be used to predict relapse-like behavior, we used a rat model of OUD that incorporates key features of OUD in people, including escalation of drug intake when availability of drug is extended (i.e., long-access, LgA)(Ahmed et al., 2000; Belin-Rauscent et al., 2016; Towers et al., 2019), followed by 14 days of forced abstinence and a subsequent reinstatement test in which rats underwent a standard self-administration session with the same cues and contexts previously paired with oxycodone, but presses on the active lever did not deliver drug (Zhou et al., 2009; Venniro et al., 2016). We focused on self-administration behavioral measures relevant to OUD in people for analysis of their predictive ability: oxycodone infusions, escalation of intake, front-loading, and inter-infusion intervals. The concept of using addiction-like behaviors to generate individualized measures that can predict vulnerability to reinstatement or relapse to SUD itself is not new (Kruzich et al., 1999; Belin et al., 2009; O’Neal et al., 2020; Panlilio et al., 2020), but has not, to our knowledge, been examined in both males and females or within the context of abused prescription painkillers like oxycodone.
Materials and methods
Animals
Adult female (N = 52) and male (N = 51) Sprague-Dawley rats (Charles River Laboratory, Wilmington, MA) were used. Body weights upon arrival were 200–225 g (female) and 250–275 g (male). Upon arrival, rats were group housed (4 rats/cage) and were acclimated for 1 week in a 12-h light-/dark-cycle (7:00 am/7:00 pm lights on/off) with food and water available ad libitum. Following surgeries, all rats remained singly housed. All experiments were conducted during the light phase. All guidelines recommended by the Institutional Animal Care and Use Committee of McLean Hospital and by the National Institutes of Health guidelines for the care and use of laboratory animals were followed.
The data analyzed for this study is a combination of data generated by 3 different investigators in the lab for their individual projects. All 3 experiments were run in the same operant chambers and used the same IVSA paradigm shown in Figure 1: an 8-d training phase (1-h/d), a 14-d escalation phase (either 1 or 6 h/d), a 14-d forced abstinence phase, and a cue-induced reinstatement test. The first experiment included 26 female and 26 male rats. Approximately 6 weeks prior to catheterization surgery for oxycodone self-administration, intracranial self-stimulation (ICSS) stimulating electrodes were surgically implanted in the medial forebrain bundle at the level of the lateral hypothalamus, as in Carlezon and Chartoff (2007) and Ebner et al. (2010). The IVSA paradigm used in rats from Experiment 1 was identical to the other groups and is described below in the Methods. See Supplementary methods for details of the ICSS portion of Experiment 1. The second experiment included 21 female (saline, N = 10; oxycodone, N = 13) and 22 male (saline, N = 9; oxycodone, N = 11) rats that underwent the IVSA paradigm described below. The third experiment included 3 male and 5 female rats that underwent the IVSA paradigm described below. For simplicity, data from the rats of Experiments 2 and 3 have been combined.
An important question is whether the presence of the ICSS electrode and/or ICSS behavior altered self-administration behavior such that combining data from these experimental cohorts is not feasible. As such, examples of IVSA data from Experiment 1 (IVSA + ICSS) and Experiment 2 (IVSA alone) are compared in Supplementary Figure 1. We show no significant differences between experimental groups for self-administration infusions, front-loading behavior, and reinstatement responding.
Intravenous catheter implantation
All rats were implanted with chronic indwelling silastic intravenous (i.v.) jugular vein catheters (0.51 mm internal diameter; SAI Infusion Technologies, IL, USA) as described (Mavrikaki et al., 2017, 2020). Briefly, rats were anesthetized with a ketamine/xylazine mixture (ketamine, 80 mg/kg; xylazine 8 mg/kg, IP), and catheters were implanted into the right jugular vein, secured to the vein with non-absorbable sutures, and the tubing passed subcutaneously to exit dorsally from the rat’s back. After surgery, rats were injected once with ketoprofen (5 mg/kg, SC) to reduce pain. For maintenance, catheters were flushed daily with 0.2 ml of heparinized saline (30 USP units/ml) and once a week with 0.2 ml gentamicin (10 mg/ml). Catheter patency was tested at least once per week by i.v. infusion of 150–200-μl methohexital sodium (2 mg in 200 μl for the males and 1.5 mg in 150 μl for the females, i.v.) and assessing loss of righting reflex. If the latency to loss of righting was greater than 10 s, the catheter was not considered patent, and the rat was not tested.
Intravenous self-administration
Intravenous self-administration (IVSA) was performed during the light phase in operant conditioning chambers (11.625” L 9.78” W 10.75” H; Med Associates, St. Albans, VT, USA) with grid floors and contained in sound- and light-attenuating outer chambers (ENV-007CT; Med Associates). A syringe pump located outside each chamber was connected to a swivel within each chamber to permit IV drug infusions. After 1-week recovery from catheter implantation surgery, rats were trained to self-administer oxycodone (provided by the NIDA Drug Supply Program) at 60 μg/kg per infusion on a fixed ratio 1 (FR1) schedule of reinforcement. For training, 1-h sessions [i.e., short access (ShA)] were conducted once per day (M-F) for 8 d, as in Schlosburg et al. (2013) and Mavrikaki et al. (2019). Rats then entered the escalation phase, comprising 14 d of oxycodone self-administration (M-F) under either ShA (1 h/day) or long access (LgA; 6 h/day) conditions. A subset of rats underwent this IVSA paradigm with saline instead of oxycodone (N = 10 females, 9 males). Each self-administration trial began with the chamber house light turning on and the extension of two lever manipulanda signaling drug availability. A press on the active lever resulted in illumination of a cue light over the active lever and the house light turning off. Coincident with presentation of cues, a syringe pump delivered 100 μl of oxycodone (60 μg/kg per infusion) lasting 4 s. Following the 4-s infusion was a 6-s timeout period during which any press on the active lever had no consequence. Following the full 10-s cycle, the cue light turned off and the house light turned on to again signal drug availability. Presses on the inactive lever were recorded but had no consequences. We recorded and analyzed total infusions, active lever presses (those that led to a drug infusion and those that occurred during a timeout), and inactive lever presses.
Cue-induced reinstatement test
After the last IVSA day, rats were returned to their home cages in the vivarium for 14-d of forced abstinence; a design based on studies using heroin (Zhou et al., 2009; Fanous et al., 2012). After the abstinence period, rats were placed in the same operant chambers in which they had previously self-administered oxycodone. A 2-h reinstatement test was conducted, with conditions identical to those during self-administration except a press on the active lever did not result in drug (oxycodone or saline) infusion. Both Zhou et al. (2009) and Fanous et al. (2012) showed that cue-induced reinstatement responding on the active lever is significantly higher after 14 days compared to 1 day of forced abstinence, consistent with time-dependent increases in drug-seeking; i.e., incubation of craving (Shalev et al., 2001). In our study, we only conduct one cue-induced reinstatement test (after 14-d abstinence), which means we are not directly measuring the incubation phenomenon. As such, we compare reinstatement responding in males and females among the three treatment groups (LgA, ShA, and saline self-administration).
Statistical analyses
Behavioral data was collected using automated procedures (MedPC-IV, MedAssociates) and processed using custom written scripts in R (R Core Team, 2019). Further preparation of data and statistical analysis was done with R and GraphPad Prism 9 (GraphPad Software, San Diego, CA, USA). For treatment by sex by time comparisons, 3-way ANOVAs with repeated measures on time were used. In the event of significant interactions or main effects, data were collapsed into the relevant two factors, and 2-way ANOVAs were performed. For sex by time comparisons, 2-way ANOVAs with repeated measures on time were used. In the event of significant interactions or main effects, Sphericity was not assumed, so the Geisser-Greenhouse correction was used. To understand the difference between various time-points, multiple comparison tests were performed.
One goal of these studies was to identify key behaviors measured during the escalation phase of oxycodone self-administration that correlate with reinstatement-responding after prolonged abstinence from self-administration. Various measures of drug self-administration behavior have been related to addiction severity (O’Neal et al., 2020). We tested for correlations between reinstatement responding and 6 measures of oxycodone self-administration behavior. The six behavioral measures were all taken from the escalation phase of oxycodone self-administration (days 9–22), and are as follows (1) infusion score, the average total number of infusions; (2) front-loading, the average number of infusions during the first 15 mins of the self-administration day; (3) Active (no reward), the average number of non-reinforced active lever presses normalized to the number of infusions; (4) escalation score, the difference in oxycodone infusions between day 9 and 22); (5 and 6) inter-infusion interval (long and short), the average of the mode of time-difference (s) between two successive bursts of oxycodone infusions. Inter-infusion intervals showed a bimodal distribution, suggesting there were two predominant time-differences (long and short). First univariate (Pearson’s) correlation analysis was performed to determine if each of these behavioral measures were significantly associated with active lever presses during the reinstatement test. Additionally, Pearson’s correlation between these measures was performed to determine whether the measures themselves were correlated with each other, also known as collinearity. To understand how measures of addiction-like behavior (that are correlated with each other) differentially affect reinstatement of drug-seeking in females and males, multivariate (partial least squares) regression analysis was used (Kuhn and Johnson, 2018) and variable importance in projection was measured. Variable importance in projection is a measure calculated using the weighted sums of the absolute regression coefficients (Kuhn, 2008). See Figure 1 for an Experimental Schematic.
Results
Male and female rats escalate oxycodone intake under both long access and short access conditions
Currently, there is relatively little information comparing oxycodone self-administration behaviors between male and female rats. Here we report data on several behavioral measures associated with oxycodone self-administration during an escalation phase in which male and female rats have either long access (LgA) or short access (ShA) to drug, or in which male and female rats self-administer saline. It has typically been found that laboratory animals will escalate drug intake when allowed LgA, but not ShA, to drug (Ahmed and Koob, 1998; Ahmed et al., 2000). Escalation of heroin intake has been reported in male and female mice (Towers et al., 2019), suggesting similar effects will be observed with oxycodone. In our study, rats underwent an 8-d training phase, in which rats could self-administer oxycodone (60 mg/kg/infusion) for 1 h/day (1 h/d, M-F), followed by a 14-d escalation phase in which rats could self-administer oxycodone under ShA (1-h/d) or LgA (6-h/d) conditions (M-F). A separate group of rats self-administered saline under LgA conditions. The number of infusions and active lever presses increased over the course of the escalation phase (days 9–22) under both LgA and ShA conditions. Main effects of Day were found for Infusions (LgA: F(4.53, 240.1) = 10.20, p < 0.0001, Figure 2A; ShA: F(4.50, 115.6) = 5.81, p < 0.0001, Figure 2B) and Active Lever presses (LgA: F(2.79, 148.0) = 8.96, p < 0.0001, Figure 2D; ShA: F(3.88, 101) = 2.618, p = 0.041, Figure 2E). Rats that self-administered saline did not show an increase in responding throughout the escalation phase (Figures 2C,F). No Sex × Day interactions or main effects of Sex were observed under either LgA or ShA conditions. To control for possible non-specific motor effects, which could indicate a lack or reduction of learning the drug-lever pairing—we found no significant changes in inactive lever presses over time or by sex (Supplementary Figure 2).
Despite the lack of sex effects in oxycodone self-administration over the course of the escalation phase, the number of infusions and active lever presses was visually higher in males than females. To determine if there was a sex difference in overall drug intake or lever pressing, we compared total infusions and active lever presses in males and females during the escalation phase (days 9–22). Unpaired t-tests for all each (Figures 2G,H) showed no significant sex effects. In addition, we calculated the difference in oxycodone infusions (Figure 2I) and active lever presses (Figure 2J) between escalation days 9 and 22 as a measure of escalation and compared this escalation score between males and females. Unpaired t-tests for each treatment condition revealed no significant sex differences.
To specifically determine if rats escalated their drug intake, we compared the number of infusions and active lever presses in males and females on day 22 to those on day 9 for each treatment condition (LgA, ShA, saline). Two-way ANOVA (Sex × Day) with repeated measures on Day showed no Sex × Day interactions or main effects of Sex under any condition. However, there were main effects of Day for infusions and active lever presses under all conditions. Bonferroni’s multiple comparison tests showed that both males and females had significantly higher oxycodone infusions and active lever presses on escalation day 22 (ESC d22) compared to ESC d9 in LgA and ShA rats (Supplementary Figure 3). Main effect of Day for Infusions [LgA: F(1, 54) = 29.72, p < 0.0001, (A); ShA: F(1, 26) = 20.43, p = 0.0001, (B); Sal: F(1, 17) = 6.12, p = 0.024, (C)] and main effect of Day for Active lever presses [LgA: F(1, 49) = 23.56, p < 0.0001, (D); ShA: F(1, 26) = 17.64, p = 0.0003, (E); Sal: F(1, 17) = 9.56, p = 0.007, (F)].
Reinstatement responding is higher in female compared to male rats after 14-d of forced abstinence from oxycodone self-administration
A major goal of these studies was to determine if behavioral measures observed during oxycodone self-administration—relevant to DSM-5 criteria for OUD (American Psychiatric Association, 2013)—can be ranked in importance to their contribution to reinstatement of drug-seeking after a period of abstinence. As such, our experimental design included a 14-d forced abstinence period after the last self-administration day (day 22) followed by a cue-induced reinstatement test. This design was intended to approximate a common experience in people with substance use disorder in which periods of heavy drug use are followed by periods of abstinence (often forced, e.g., incarceration) followed again by reinstatement to drug-taking (Reiner et al., 2018).
Importantly, there is a large body of literature showing that craving for drug can “incubate” (increase), resulting in different levels of reinstatement in a time- and drug-dependent manner (Reiner et al., 2018). In our study, all rats experienced 14 days of abstinence, which did not allow measurement of the incubation of craving. As such, we compared the magnitude of reinstatement responding between males and females among the three treatment conditions (LgA, ShA, Sal). Active lever pressing during the reinstatement test was higher in females compared to males across treatment groups (Figure 3), which depended on a main effect of Sex (F(1, 85) = 4.57, p = 0.035). Reinstatement responding was highest in rats that had self-administered oxycodone under LgA conditions, which depended on a main effect of Treatment (F(2, 85) = 17.06, p < 0.0001).
Female and male rats exhibit front-loading self-administration behavior
It is well established that drug self-administration typically starts with a “front-loading phase,” in which an animal makes several lever presses in rapid succession to quickly bring blood/brain drug levels to a concentration that is reinforcing. This is followed by a “maintenance phase” in which drug self-administration occurs at more regular intervals thought to maintain sufficient drug levels to sustain the desired hedonic set point (Wise and Bozarth, 1987; Gerber and Wise, 1989). However, repeated opioid use usually leads to tolerance and dependence (Wise and Koob, 2014); conditions in which progressively increasing intake is required to front-load and maintain drug effectiveness (Ahmed and Koob, 1998, 2005).
To determine if male and female rats exhibit front-loading behavior during the escalation phase of self-administration and if front-loading changes from the beginning to the end of escalation (d9 vs d22), we analyzed the first hour of self-administration data in 15-min bins on escalation day 9 (ESC d9) and ESC d22 (Figure 4). We found that oxycodone (or saline) infusions and active lever presses were greatest in the first 15 min of the self-administration sessions on both ESC d9 and ESC d22 under every treatment condition (LgA, ShA, and Sal). This robust evidence for front-loading depended on either Day × Time interactions (Figures 4A,D,E) or main effects of Time (Figures 4B,C,F) in the 3-way ANOVAs (Sex × Day × Time) conducted for each treatment condition. An example of a Day × Time interaction is found in active lever pressing in LgA rats (Figure 4D): (F(2.17, 99.68) = 3.83, p = 0.022), and an example of a main effect of time is found in infusions in Sal rats (Figure 4C): (F(3.0, 51.0) = 20.46, p < 0.0001). The fact that rats self-administering saline had higher infusions (Figure 4C) and active lever presses (Figure 4F) in the first 15 min of the sessions suggests that a portion of front-loading behavior can be attributed to locomotor stimulation from placing the rats in the operant chambers each day. The 3-way ANOVAs for this front-loading data also revealed that oxycodone, but not saline, self-administration behavior was higher across the first hour of ESC d22 compared to ESC d9 in LgA and ShA rats, consistent with development of tolerance. There were no effects of sex on front-loading behavior.
Temporal features of long access oxycodone self-administration sessions at the beginning and end of the escalation phase
Male and female rats do not differ in the number of oxycodone infusions or active lever presses during LgA sessions of the escalation phase (d9–22; Figures 2A,D). However, it is not known whether self-administration behavior fluctuates within a 6-h session or between early (d9) and late (d22) 6-h sessions in male and female rats. As such, we quantified oxycodone infusions (Figure 5A) and active lever presses (Figure 5B) for each hour of the 6-h IVSA sessions in LgA rats on escalation days 9 (ESC d9) and ESC d22. We found that rats exhibited front-loading behavior at the hourly level, as the number of infusions was highest in the first hour of the 6-h session on both ESC d9 and ESC d22. This depended on a main effect of Hour in the 3-way ANOVA (Sex × Day × Hour) for infusions: (F(5.0, 230) = 3.62, p = 0.004). Front-loading was not observed with active lever presses, and no significant effects of sex were found in any condition. Finally, hourly infusions and active lever pressing were higher across the 6-h sessions on ESC d9 compared to ESC d22, which depended on main effects of Day in the 3-way ANOVAs for infusions (F(0.76, 34.94) = 29.29, p < 0.001) and active lever presses (F(0.45, 20.61) = 17.88, p = 0.003).
Males have higher levels of non-reinforced active lever presses compared to females during the escalation phase of long access oxycodone self-administration
Each active lever press that leads to drug delivery triggers a 4-s infusion (100 μl) followed by a 6-s time out period. Any active lever presses that occur during the total 10 s after an infusion-triggering active lever press are not reinforced with drug delivery. To quantify continued lever pressing during these non-reinforced periods, we summed the normalized non-reinforced lever presses for each day of IVSA using the formula [(active press—infusion)/infusion]. The more non-reinforced lever presses per session, the higher the value of this output. A value of 1 means there were at least twice as many active lever presses as infusions, whereas a value between 0 and 1 means the number of active lever presses was less than twice the number of infusions. We observed that both male and female rats self-administering oxycodone in 1-h sessions—during the training or escalation phases—had a normalized, non-reinforced active lever press value of ∼1 (Figures 6A,B). This suggests that rats typically press the active lever about twice as often as they receive oxycodone infusions. In rats self-administering saline; however, we observed a normalized, non-reinforced active lever press value of ∼0.5 (Figure 6C). Taken together, these observations are consistent with a higher motivation to seek and acquire reinforcing stimuli (e.g., oxycodone) but not non-reinforcing stimuli (e.g., saline).
During the escalation phase under LgA, but not ShA or saline, conditions, a sex difference emerged such that normalized, non-reinforced active lever presses were higher in males compared to females (Figure 6A). This depended on a main effect of Sex (F(1.0, 46) = 4.15, p = 0.047). A main effect of Day was also found (F(4.44, 204.2) = 4.83, p = 0.0006), but pairwise comparisons revealed no significant differences among escalation days. The sex difference in normalized, non-reinforced active lever presses was also observed when these data were summed over the escalation phase in LgA rats (Figure 6D), but not ShA or Sal rats (Figures 6E,F, respectively).
The time (interval) between bursts of oxycodone infusions decreases as escalation of intake increases in male and female long access rats
Development of a burst-like pattern of drug self-administration has been associated with addiction-like behavior in cocaine self-administration studies (Belin et al., 2009). Historically, burst-like patterns are defined by a minimum number of drug infusions over a specified time-window. However, this approach does not account for the variable pattern of infusions during a burst nor the dynamic nature of burst-like patterns over time. To address this, we used inter-infusion intervals (s) as a proxy for drug self-administration patterns. An evenly spaced drug self-administration pattern would have a normal/gaussian distribution of inter-infusion intervals. A burst-like drug self-administration pattern would have a bimodal distribution (Figures 7A–C). Based on empirical observation of oxycodone infusion histograms from self-administration sessions (e.g., Figure 7A), the larger mode (long-mode) typically indicates time elapsed between two burst-like bouts of oxycodone self-administration, whereas the smaller mode (short-mode) typically indicates time elapsed between two successive infusions within a burst-like bout. Both LgA and ShA rats undergoing oxycodone self-administration showed this bimodal distribution of inter-infusion intervals. In male and female LgA rats, the long-mode intervals decreased as drug escalation increased from days 9 to 22 (Figure 7D). This was supported by a main effect of Day (F(1.0, 43) = 16.88, p = 0.002) and Bonferroni’s multiple comparison tests. In contrast, the short-mode intervals remained unchanged (Figure 7F). Together, these findings suggest that the nature of the bursts remains the same, but their frequency increases.
Sex differences in the relative contributions of oxycodone self-administration behaviors to reinstatement responding
An important goal of this study was to determine how the various measures of addiction-like behavior reported here contribute to reinstatement responding, with the relative contributions of behaviors ranked for females and males separately. The behaviors we ranked for this analysis are: (1) Infusions during the escalation phase, (2) Front-loading of drug intake in the first 15 min of each self-administration session during the escalation phase, (3) Non-reinforced lever presses during the escalation phase, (4) Short, and (5) Long inter-infusion intervals during the escalation phase, and (6) Escalation of drug intake (day 22 infusions minus day 9 infusions for each rat). To accomplish this, univariate (Pearson’s) correlation analysis was performed separately on male and female data to determine the extent to which each behavioral measure was associated with active lever presses during the reinstatement test (Figures 8A,B; gray highlighted plots). For females, we found significant correlations between reinstatement responding and Infusions, Front-loading, and Long inter-infusion intervals (Figure 8A; R scores listed in each matrix box). For males, we found significant correlations between reinstatement responding and Infusions, Front-loading, Non-reinforced active lever presses, and Short inter-infusion intervals (Figure 8B).
Since many of these behavioral measures were also significantly correlated with each other (Figures 8A,B; unshaded plots), this indicated collinearity of the data. Therefore, to rank the importance of each measure to reinstatement responding in males and in females, we used partial least squares regression, a form of multi-variable linear regression analysis (diagrammed in Figure 8D). The various collinear measures were weighted and combined to generate a single component (“Component,” Figure 8D), which was optimally correlated with post-abstinence reinstatement responding (Figure 8D orange plot, females; Figure 8D blue plot, males). The relative contribution of each measure to active lever presses during the post-abstinence reinstatement test was reported in a sex-specific manner (Figure 8E). Front-loading (average number of infusions during the first 15 mins of each self-administration day during the escalation phase) was most strongly associated with reinstatement responding for both sexes. The behavioral measures with the second highest relative contribution to reinstatement were long-mode inter-infusion intervals for females and short-mode inter-infusion intervals males. The number of oxycodone infusions was ranked third in relative contribution to reinstatement for both females and males. For females, only those three behavioral measures (front-loading, long inter-infusion intervals, and infusion number) were significantly correlated with reinstatement responding, so the relative contributions of other behaviors (Figure 8E, behaviors listed below horizontal dashed line) were deemed insignificant. In contrast, non-reinforced active lever presses also contributed significantly to reinstatement responding in males. Interestingly, escalation itself did not show a significant correlation with reinstatement in either sex (Figures 8A,B; first row, last column).
Discussion
In this study we found that the majority of addiction-like behavioral components that comprise escalation of oxycodone self-administration and reinstatement of drug-seeking after a 2-week forced abstinence period are similar in male and female Sprague Dawley rats. However, our approach of analyzing more granular components of the process from acquisition of self-administration behavior to patterns of self-administration during the escalation phase and reinstatement showed that the number of non-reinforced active lever presses (those that occur between infusions) was significantly higher in males than females self-administering oxycodone under LgA conditions. In addition, reinstatement responding on the active lever previously paired with oxycodone was significantly higher in females. The second goal of this study was to compute the relative contribution of these granular components of self-administration behavior to the magnitude of reinstatement-responding. We found that many of the same behavioral components contributed the most to reinstatement responding in both males and females, but the rank order of their contribution was sex-dependent. For example, inter-infusion intervals during the escalation phase of self-administration was the second highest contributor for both sexes, except for females the intervals referred to those between bursts of oxycodone infusions and for males the intervals referred to those between individual infusions. We do not think it appropriate to try to directly relate either the behavioral components themselves or the sex differences within to the human condition of OUD or gender differences in OUD. However, we suggest that our findings highlight that broad behaviors (self-administration) and human conditions (OUD) are composed of numerous factors, each of which may reveal sex-dependent mechanistic processes and that it is possible to generate algorithms based on active self-administration (drug-taking) data that can help predict the magnitude of reinstatement to drug-seeking.
In both humans and animal models of addiction-like behavior, it is accepted that the transition from initial drug use to substance use disorder (SUD) involves numerous steps at the behavioral and neurobiological level (Self and Nestler, 1995; Robinson and Berridge, 2001; Wise and Koob, 2014). In this study, we used the extended drug access rodent model of addiction, which is thought to mimic many of these steps (Ahmed and Koob, 1998) because it leads to escalation of drug intake—an essential feature of SUD. Within this construct, we focused our analyses on 6 behavioral measures comprising oxycodone self-administration during the escalation phase (see schematic, Figure 1) that are related to the progression to addiction-like behavior. These included the total number of infusions, front-loading of drug intake, non-reinforced active lever presses, escalation of intake, inter-infusion, and inter-burst intervals. Since relapse to drug-taking is a primary barrier to recovery from SUD, and perhaps OUD in particular (Hunt et al., 1971; O’Brien, 2005), we used reinstatement of oxycodone-seeking after forced abstinence to complete our animal model of addiction-like behavior (Shalev et al., 2002; Venniro et al., 2016). Our experimental design was sensitive to possible sex differences in each of these behavioral components and to reinstatement responding. The fact that sex differences were only observed in non-reinforced active lever presses during oxycodone self-administration and reinstatement responding after abstinence suggests that opioid self-administration as a whole is similar in males and females, but individual steps contributing to reinstatement can be sex-dependent. Although this study was not intended to probe neurobiological mechanisms underlying the behavioral components measured here, it is likely that molecular, hormonal, and pharmacokinetic mechanisms all play a role in male and female behavioral processes contributing to addiction-like behavior. Of note, we have previously shown no sex differences in plasma or brain levels of oxycodone after i.v. infusion (Mavrikaki et al., 2017). It is important to recognize that males and females can show similar outward behaviors that are driven by different underlying mechanisms (Becker and Chartoff, 2019).
In our study, the majority of self-administration behavioral components were similar in males and females. There were no significant sex differences in infusions, active or inactive lever responses during the acquisition or escalation phases (either LgA or ShA conditions). These results are consistent with several recent studies specifically examining male and female rat opioid self-administration behavior under extended access conditions, forced abstinence periods, and reinstatement tests (Venniro et al., 2017, 2019; Fredriksson et al., 2020; Bossert et al., 2022). Even the more granular measures such as front-loading of oxycodone, maintenance of self-administration behavior over the 6-h sessions, and inter-infusions intervals were similar between males and females. In contrast, males, but not females, showed an increase in the number of non-reinforced active lever presses over the course of the escalation phase (days 9–22). These are lever presses that occurred during the ∼10-s period of a drug infusion cycle in which drug was not available. Studies using intermittent access self-administration paradigms typically refer to these non-reinforced active lever presses as “drug-seeking” (O’Neal et al., 2020; Bakhti-Suroosh et al., 2021). However, caution must be used here, as the periods in which drug was not available were much shorter (10 s) than in intermittent access protocols. It is just as likely the increase in non-reinforced active lever pressing reflects oxycodone-induced psychomotor stimulant action or a type of impulsive motor behavior.
Our finding that cue-induced reinstatement is higher in both LgA and ShA females than males after a 14-d forced abstinence period contrasts with the recent studies mentioned above (Venniro et al., 2017, 2019; Fredriksson et al., 2020; Bossert et al., 2022). In those studies, no sex differences in reinstatement were observed. The experimental designs were not identical to ours, as they typically included a reinstatement test after 1 day of abstinence as well as after a prolonged forced abstinence. However, a critical difference is that those studies were conducted during the dark phase of the light cycle (reverse light cycle) whereas ours was conducted during the light phase. It is well known that there are sex differences in the circadian timing system that play important roles in determining responses to both endogenous and exogenous factors (Bailey and Silver, 2014), and it has been shown that time of day/circadian rhythms affect the reinforcing properties of opioids (Webb et al., 2015). We do not claim that circadian rhythms are specifically responsible for our finding that reinstatement responding is higher in females than males, but the “hidden variable” (Butler-Struben et al., 2022) of time of day is likely to be a major factor in the conflicting results emerging in sex difference research. Another factor that likely contributes to conflicting results in studies of sex differences is that estrous cycle can impact drug-seeking behavior (Carroll and Anker, 2010; Becker and Koob, 2016)—although relatively few studies have investigated the effect of estrous cycle on opioid-induced behavior. Indeed, we did not track estrous cycle stages in our studies, as most behavioral endpoints spanned days or weeks, making it practically impossible to tag an estrous cycle stage with a particular behavior.
Our second goal was to determine if the behavioral measures comprising self-administration could be ranked in a sex-dependent manner according to their relative importance to the magnitude of reinstatement-responding. A number of studies report measuring relapse vulnerability and addiction severity by the magnitude of reinstatement responding (Deroche-Gamonet et al., 2004; Belin et al., 2009). For example, it has been proposed that the amount and maintenance of responding for the drug-paired lever during the reinstatement test could predict reinstatement to drug-seeking (Kruzich et al., 1999). But those very behaviors constitute reinstatement and seem not be helpful in a clinical setting. A more useful biomarker would be measurable before relapse occurred, not in retrospect. We first demonstrated that a subset of behavioral measures correlated significantly with reinstatement in males (i.e., infusions, front-loading, non-reinforced active lever presses, and short inter-infusion intervals) and a slightly different subset was found in females (i.e., infusions, front-loading, long inter-infusion intervals). Partial least squares regression analysis then allowed us to rank the relative contribution of each behavior to reinstatement. We found that front-loading behavior, in which rats self-administer more drug at the beginning of each session than at the end, had the highest relative contribution to reinstatement in both sexes. After front-loading, the behavioral measures that ranked the highest for their contribution to reinstatement were sex-dependent. The second ranked contributor was long inter-infusion intervals for females and short inter-infusion intervals for males, followed by number of infusions for both sexes and finally non-reinforced active lever presses for males but not females. The important conclusion from these data is not that we have identified a magic set of factors that “cause” addiction, as the analysis was limited to the measures we input into the analyses. Rather, these findings are significant because they demonstrate that a battery of concrete behavioral measures reflecting active drug-taking behavior can be compared to a human-specific correlation matrix similar to the one we generated in Figure 2 to predict the magnitude, and ultimately the risk, of relapse. Our data also highlight that the predictive behavioral measures and/or their rank order may be sex-dependent, which is consistent with findings that men and women with OUD report different reasons for continued opioid abuse (McHugh et al., 2018).
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
This animal study was reviewed and approved by McLean Hospital Institutional Animal Care and Use Committee.
Author contributions
EC conceived the experimental questions and the required analysis methods, wrote the manuscript, and secured funding. SG, YA-C, and JB conceived of the experiments that generated the data used in this study. SG, YA-C, JB, GD, MN, NC, TL, and EK performed experiments. EC, SG, YA-C, and GD analyzed data. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by grants from the National Institute on Drug Abuse (DA045000) to EC and KOODA053527 to YA-C.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnbeh.2022.1035350/full#supplementary-material
References
- Ahmed S. H., Koob G. F. (1998). Transition from moderate to excessive drug intake: Change in hedonic set point. Science 282 298–300. 10.1126/science.282.5387.298 [DOI] [PubMed] [Google Scholar]
- Ahmed S. H., Koob G. F. (2005). Transition to drug addiction: A negative reinforcement model based on an allostatic decrease in reward function. Psychopharmacology 180 473–490. 10.1007/s00213-005-2180-z [DOI] [PubMed] [Google Scholar]
- Ahmed S. H., Walker J. R., Koob G. F. (2000). Persistent increase in the motivation to take heroin in rats with a history of drug escalation. Neuropsychopharmacology 22 413–421. 10.1016/S0893-133X(99)00133-5 [DOI] [PubMed] [Google Scholar]
- American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders. Washington, DC: American Psychiatric Association. [Google Scholar]
- Bailey M., Silver R. (2014). Sex differences in circadian timing systems: Implications for disease. Front. Neuroendocrinol. 35 111–139. 10.1016/j.yfrne.2013.11.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bakhti-Suroosh A., Towers E. B., Lynch W. J. (2021). A buprenorphine-validated rat model of opioid use disorder optimized to study sex differences in vulnerability to relapse. Psychopharmacology 238 1029–1046. 10.1007/s00213-020-05750-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Becker J. B., Chartoff E. (2019). Sex differences in neural mechanisms mediating reward and addiction. Neuropsychopharmacology 44 166–183. 10.1038/s41386-018-0125-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Becker J. B., Koob G. F. (2016). Sex differences in animal models: Focus on addiction. Pharmacol. Rev. 68 242–263. 10.1124/pr.115.011163 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Belin D., Balado E., Piazza P. V., Deroche-Gamonet V. (2009). Pattern of intake and drug craving predict the development of cocaine addiction-like behavior in rats. Biol. Psychiatry 65 863–868. 10.1016/j.biopsych.2008.05.031 [DOI] [PubMed] [Google Scholar]
- Belin-Rauscent A., Fouyssac M., Bonci A., Belin D. (2016). How preclinical models evolved to resemble the diagnostic criteria of drug addiction. Biol. Psychiatry 79 39–46. 10.1016/j.biopsych.2015.01.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bossert J. M., Townsend E. A., Altidor L. K.-P., Fredriksson I., Shekara A., Husbands S., et al. (2022). Sex differences in the effect of chronic delivery of the buprenorphine analogue BU08028 on heroin relapse and choice in a rat model of opioid maintenance. Br. J. Pharmacol. 179 227–241. 10.1111/bph.15679 [DOI] [PubMed] [Google Scholar]
- Butler-Struben H. M., Kentner A. C., Trainor B. C. (2022). What’s wrong with my experiment?: The impact of hidden variables on neuropsychopharmacology research. Neuropsychopharmacology 47 1285–1291. 10.1038/s41386-022-01309-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carlezon W. A., Jr., Chartoff E. H. (2007). Intracranial self-stimulation (ICSS) in rodents to study the neurobiology of motivation. Nat. Protoc. 2 2987–2995. 10.1038/nprot.2007.441 [DOI] [PubMed] [Google Scholar]
- Carroll M. E., Anker J. J. (2010). Sex differences and ovarian hormones in animal models of drug dependence. Horm. Behav. 58 44–56. 10.1016/j.yhbeh.2009.10.001 [DOI] [PubMed] [Google Scholar]
- Chartoff E. H., Connery H. S. (2014). It’s MORe exciting than mu: Crosstalk between mu opioid receptors and glutamatergic transmission in the mesolimbic dopamine system. Front. Pharmacol. 5:116. 10.3389/fphar.2014.00116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chartoff E. H., Mague S. D., Barhight M. F., Smith A. M., Carlezon W. A., Jr. (2006). Behavioral and molecular effects of dopamine D1 receptor stimulation during naloxone-precipitated morphine withdrawal. J. Neurosci. 26 6450–6457. 10.1523/JNEUROSCI.0491-06.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deroche-Gamonet V., Belin D., Piazza P. V. (2004). Evidence for addiction-like behavior in the rat. Science 305 1014–1017. 10.1126/science.1099020 [DOI] [PubMed] [Google Scholar]
- Ebner S. R., Roitman M. F., Potter D. N., Rachlin A. B., Chartoff E. H. (2010). Depressive-like effects of the kappa opioid receptor agonist salvinorin A are associated with decreased phasic dopamine release in the nucleus accumbens. Psychopharmacology 210 241–252. 10.1007/s00213-010-1836-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fanous S., Goldart E. M., Theberge F. R. M., Bossert J. M., Shaham Y., Hope B. T. (2012). Role of orbitofrontal cortex neuronal ensembles in the expression of incubation of heroin craving. J. Neurosci. 32 11600–11609. 10.1523/JNEUROSCI.1914-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fredriksson I., Applebey S. V., Minier-Toribio A., Shekara A., Bossert J. M., Shaham Y. (2020). Effect of the dopamine stabilizer (-)-OSU6162 on potentiated incubation of opioid craving after electric barrier-induced voluntary abstinence. Neuropsychopharmacology 45 770–779. 10.1038/s41386-020-0602-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gerber G. J., Wise R. A. (1989). Pharmacological regulation of intravenous cocaine and heroin self-administration in rats: A variable dose paradigm. Pharmacol. Biochem. Behav. 32 527–531. 10.1016/0091-3057(89)90192-5 [DOI] [PubMed] [Google Scholar]
- Hearing M. (2019). Prefrontal-accumbens opioid plasticity: Implications for relapse and dependence. Pharmacol. Res. 139 158–165. 10.1016/j.phrs.2018.11.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunt W. A., Barnett L. W., Branch L. G. (1971). Relapse rates in addiction programs. J. Clin. Psychol. 27 455–456. 10.1002/1097-4679(197110)27:4 [DOI] [PubMed] [Google Scholar]
- Koob G. F. (2020). Neurobiology of opioid addiction: Opponent process, hyperkatifeia, and negative reinforcement. Biol. Psychiatry 87 44–53. 10.1016/j.biopsych.2019.05.023 [DOI] [PubMed] [Google Scholar]
- Kruzich P. J., Grimm J. W., Rustay N. R., Parks C. D., See R. E. (1999). Predicting relapse to cocaine-seeking behavior: A multiple regression approach. Behav. Pharmacol. 10 513–521. 10.1097/00008877-199909000-00009 [DOI] [PubMed] [Google Scholar]
- Kuhn M. (2008). Building predictive models in R using the caret package. J. Stat. Softw. 28, 1–26. 10.18637/jss.v028.i0527774042 [DOI] [Google Scholar]
- Kuhn M., Johnson K. (2018). Applied predictive modeling. New York, NY: Springer. [Google Scholar]
- Mavrikaki M., Anastasiadou E., Ozdemir R. A., Potter D., Helmholz C., Slack F. J., et al. (2019). Overexpression of miR-9 in the nucleus accumbens increases oxycodone self-administration. Int. J. Neuropsychopharmacol. 22, 383–393. 10.1093/ijnp/pyz015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mavrikaki M., Lintz T., Constantino N., Page S., Chartoff E. (2020). Chronic opioid exposure differentially modulates oxycodone self-administration in male and female rats. Addict. Biol. 26:e12973. 10.1111/adb.12973 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mavrikaki M., Pravetoni M., Page S., Potter D., Chartoff E. (2017). Oxycodone self-administration in male and female rats. Psychopharmacology 234 977–987. 10.1007/s00213-017-4536-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McHugh R. K., Votaw V. R., Sugarman D. E., Greenfield S. F. (2018). Sex and gender differences in substance use disorders. Clin. Psychol. Rev. 66 12–23. 10.1016/j.cpr.2017.10.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Brien C. P. (2005). Anticraving medications for relapse prevention: A possible new class of psychoactive medications. Am. J. Psychiatry 162 1423–1431. 10.1176/appi.ajp.162.8.1423 [DOI] [PubMed] [Google Scholar]
- O’Neal T. J., Nooney M. N., Thien K., Ferguson S. M. (2020). Chemogenetic modulation of accumbens direct or indirect pathways bidirectionally alters reinstatement of heroin-seeking in high- but not low-risk rats. Neuropsychopharmacology 45 1251–1262. 10.1038/s41386-019-0571-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Panlilio L. V., Stull S. W., Bertz J. W., Burgess-Hull A. J., Kowalczyk W. J., Phillips K. A., et al. (2020). Beyond abstinence and relapse: Cluster analysis of drug-use patterns during treatment as an outcome measure for clinical trials. Psychopharmacology 237 3369–3381. 10.1007/s00213-020-05618-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- R Core Team (2019). R: A language and environment for statistical computing. Vienna: R Core Team. [Google Scholar]
- Reiner D. J., Fredriksson I., Lofaro O. M., Bossert J. M., Shaham Y. (2018). Relapse to opioid seeking in rat models: Behavior, pharmacology and circuits. Neuropsychopharmacology 44 465–477. 10.1038/s41386-018-0234-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robinson T. E., Berridge K. C. (2001). Incentive-sensitization and addiction. Addiction 96 103–114. [DOI] [PubMed] [Google Scholar]
- Russell S. E., Puttick D. J., Sawyer A. M., Potter D. N., Mague S., Carlezon W. A., Jr., et al. (2016). Nucleus accumbens AMPA receptors are necessary for morphine-withdrawal-induced negative-affective states in rats. J. Neurosci. 36 5748–5762. 10.1523/JNEUROSCI.2875-12.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- SAMHSA (2020). U.S. Department of health and human services, substance abuse and mental health services administration, center for behavioral health statistics and quality (2022). National survey on drug use and health 2020. Rockville, MD: SAMHSA. [Google Scholar]
- Schlosburg J. E., Whitfield T. W., Jr., Park P. E., Crawford E. F., George O., Vendruscolo L. F., et al. (2013). Long-term antagonism of κ opioid receptors prevents escalation of and increased motivation for heroin intake. J. Neurosci. 33, 19384–19392. 10.1523/JNEUROSCI.1979-13.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Self D. W., Nestler E. J. (1995). Molecular mechanisms of drug reinforcement and addiction. Annu. Rev. Neurosci. 18 463–495. [DOI] [PubMed] [Google Scholar]
- Shalev U., Grimm J. W., Shaham Y. (2002). Neurobiology of relapse to heroin and cocaine seeking: A review. Pharmacol. Rev. 54 1–42. [DOI] [PubMed] [Google Scholar]
- Shalev U., Morales M., Hope B., Yap J., Shaham Y. (2001). Time-dependent changes in extinction behavior and stress-induced reinstatement of drug seeking following withdrawal from heroin in rats. Psychopharmacology 156 98–107. 10.1007/s002130100748 [DOI] [PubMed] [Google Scholar]
- Towers E. B., Tunstall B. J., McCracken M. L., Vendruscolo L. F., Koob G. F. (2019). Male and female mice develop escalation of heroin intake and dependence following extended access. Neuropharmacology 151 189–194. 10.1016/j.neuropharm.2019.03.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Venniro M., Caprioli D., Shaham Y. (2016). Animal models of drug relapse and craving: From drug priming-induced reinstatement to incubation of craving after voluntary abstinence. Prog. Brain Res. 224 25–52. 10.1016/bs.pbr.2015.08.004 [DOI] [PubMed] [Google Scholar]
- Venniro M., Russell T. I., Zhang M., Shaham Y. (2019). Operant social reward decreases incubation of heroin craving in male and female rats. Biol. Psychiatry 86 848–856. 10.1016/j.biopsych.2019.05.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Venniro M., Zhang M., Shaham Y., Caprioli D. (2017). Incubation of methamphetamine but not heroin craving after voluntary abstinence in male and female rats. Neuropsychopharmacology 42 1126–1135. 10.1038/npp.2016.287 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Webb I. C., Lehman M. N., Coolen L. M. (2015). Diurnal and circadian regulation of reward-related neurophysiology and behavior. Physiol. Behav. 143 58–69. 10.1016/j.physbeh.2015.02.034 [DOI] [PubMed] [Google Scholar]
- Wise R. A., Bozarth M. A. (1987). A psychomotor stimulant theory of addiction. Psychol. Rev. 94 469–492. [PubMed] [Google Scholar]
- Wise R. A., Koob G. F. (2014). The development and maintenance of drug addiction. Neuropsychopharmacology 39 254–262. 10.1038/npp.2013.261 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhou W., Zhang F., Liu H., Tang S., Lai M., Zhu H., et al. (2009). Effects of training and withdrawal periods on heroin seeking induced by conditioned cue in an animal of model of relapse. Psychopharmacology 203 677–684. 10.1007/s00213-008-1414-2 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.