Skip to main content
International Journal of Neuropsychopharmacology logoLink to International Journal of Neuropsychopharmacology
. 2017 May 6;20(7):593–601. doi: 10.1093/ijnp/pyx031

A New Paradigm for Evaluating Avoidance/Escape Motivation

Iku Tsutsui-Kimura 1,, Youcef Bouchekioua 1, Masaru Mimura 1, Kenji F Tanaka 1
PMCID: PMC5492826  PMID: 28482015

Abstract

Background:

Organisms have evolved to approach pleasurable opportunities and to avoid or escape from aversive experiences. These 2 distinct motivations are referred to as approach and avoidance/escape motivations and are both considered vital for survival. Despite several recent advances in understanding the neurobiology of motivation, most studies addressed approach but not avoidance/escape motivation. Here we develop a new experimental paradigm to quantify avoidance/escape motivation and examine the pharmacological validity.

Methods:

We set up an avoidance variable ratio 5 task in which mice were required to press a lever for variable times to avoid an upcoming aversive stimulus (foot shock) or to escape the ongoing aversive event if they failed to avoid it. We i.p. injected ketamine (0, 1, or 5 mg/kg) or buspirone (0, 5, or 10 mg/kg) 20 or 30 minutes before the behavioral task to see if ketamine enhanced avoidance/escape behavior and buspirone diminished it as previously reported.

Results:

We found that the performance on the avoidance variable ratio 5 task was sensitive to the intensity of the aversive stimulus. Treatment with ketamine increased while that with buspirone decreased the probability of avoidance from an aversive stimulus in the variable ratio 5 task, being consistent with previous reports.

Conclusion:

Our new paradigm will prove useful for quantifying avoidance/escape motivation and will contribute to a more comprehensive understanding of motivation.

Keywords: avoidance, escape, instrumental, motivation, ketamine


Significance Statement

Evaluating the avoidance/escape motivation with existing behavioral assays has been a challenge, since they are inflexible to modulate the amount of effort required to avoid or escape the aversive event. We developed a new behavioral paradigm, an avoidance variable ratio 5 task, which overcomes this limitation and enables researchers to quantify avoidance/escape motivation. In this task, mice were required to press a lever for variable times to avoid a subsequent aversive stimulus or to escape the aversive event if mice failed to avoid it. We confirmed the pharmacological validity of this paradigm by using ketamine and buspirone. Our new paradigm will contribute to the development of effective therapeutic approaches to psychiatric disorders associated with maladaptive avoidance/escape responses.

Introduction

Motivation drives us to execute actions and provides the vigor needed to overcome obstacles and achieve goals. Decades of research have led to the recognition that motivated behavior is complex, consisting of multiple interacting components that can be dissociated at both the behavioral and neural levels (Salamone and Correa, 2002; Robinson and Berridge, 2013; Kelley, 2004; Natsubori et al., 2017; Tsutsui-Kimura et al., 2017). According to a widely accepted view, motivation can be divided into 2 subcategories: reward gain-based and aversion avoidance/escape-based motivation (Elliot, 1999; Elliot and Thrash, 2002; Campese et al., 2015). These 2 subcategories differ as a function of valence: in approach motivation, behavior is instigated or directed by a positive/desirable event or possibility; in avoidance/escape motivation, behavior is instigated or directed by a negative/undesirable predicted or actual event. Despite several recent advances in understanding the neurobiology of motivation (Salamone and Correa, 2002; Tsutsui-Kimura et al., 2017), only a few studies have addressed avoidance/escape motivation (Salamone, 1994; Perrotti et al., 2013). A more comprehensive understanding of motivation would be possible with a strategy of implementing behavioral assays that can assess avoidance/escape motivation.

Evaluating the latter type of motivation with existing behavioral assays has been a challenge. For instance, the active avoidance test with 2 shuttle boxes, so-called 2-way active avoidance, is one of the widely used animal models (Da Cunha et al., 2009; Boschen et al., 2011). In this task, the animal learns to predict the occurrence of an aversive event (typically a foot shock) based on the presentation of a specific stimulus (typically a tone) to avoid the aversive event by moving to a different compartment. The number of avoidances (the number of crossings to the other compartment during the warning signal) is taken as an index of avoidance motivation. The number of escapes (the number of crossings to the other compartment during receiving the aversive event) is taken as an index of escape motivation. However, these dependent variables can easily reach a ceiling level, making them useless in assessing motivation. The main reason for this issue resides in the inflexibility to modulate the amount of effort required to avoid or escape the aversive event.

Here we developed a new strategy that overcomes this limitation and enables us to quantify avoidance/escape motivation. In our new paradigm, mice were required to press a lever, instead of shuttling the box, for avoiding or escaping from an aversive event. As the task requires a variable number of lever presses, it will dampen the response-outcome association and will prevent their performances from reaching ceiling levels. We called this task the avoidance variable ratio 5 (VR-5) task. We first validated the avoidance VR task as a measure of avoidance/escape motivation by showing that it is sensitive to the magnitude of the aversive stimulus. Next, to evaluate the effectiveness of this strategy, we looked at how performance on the avoidance VR-5 task was affected by lower doses of ketamine (KET; 1 or 5 mg/kg), which is known to induce avoidance/escape behaviors in helpless animals (Maeng et al., 2008; Belujon and Grace, 2014), and by the doses of buspirone hydrochloride (BUS; 5 or 10 mg/kg), which is known to reduce avoidance/escape behaviors (Liang et al., 1998).

Materials and Methods

Ethical Statement

All animal procedures were conducted in accordance with the National Institutes of Health Guide for the Care and Use of Laboratory Animals and approved by the Animal Research Committee of Keio University.

Animals

Subjects were 19 129SvEvTac male mice older than 120 days of age and weighing 26 to 30 g at the start of the experiment. This strain is known to show stable performance on operant tasks (Thomsen and Caine, 2006; Haluk and Wickman, 2010). They were food deprived to motivate them to earn dustless precision pellets (Bio-serv) as a reward. Thereafter, their body weight was maintained at 85% of free-feeding weight. Food restriction was conducted only during shaping-1 and -2 in the training phase. To control the food deprivation level equally in each animal, the animals were housed individually. Water was available ad libitum in home cages throughout the entire experiment. Subjects were maintained on a 12-hour-light/-dark schedule (lights on 8 am) and tested during the light phase. The sample size employed in this study was determined according to previous reports (Liang et al, 1998; Maeng et al., 2008; Belujon and Grace, 2014).

Apparatus

Aluminum operant chambers measuring W22×D26×H18 cm (Med Associates Inc.) were used. It was equipped with a food magazine located on a wall of the chamber, 2 retractable levers, and one speaker on either side of the food magazine. The apparatus was controlled by a computer program written in MED-PC language (Med Associates Inc.). As the behavioral parameters were automatically collected by the PC system, any possible bias from experimenters should have been avoided.

Behavioral Procedures

Training

Food-restricted mice were initially trained to press the lever to earn a food pellet (shaping-1, Figure 1A). A trial started with the 2 levers presentation. Only one lever is designated as “active” (triggering delivery of food reward) and the right/left allocation of active lever was counterbalanced between mice. A single active lever press resulted in food reward delivery and retraction of both levers. Then, 60 seconds of inter-trial interval was added, followed by the automatic starting of the next trial.

Figure 1.

Figure 1.

Training and testing procedures of avoidance variable ratio 5 (VR-5) task. (A) Training procedures. Mice were food restricted during shaping-1 and -2. In both training phases, an active lever (right in this figure) press was reinforced by a palatable pellet. The alarm tone was synchronously presented with levers and terminated after the active lever press in shaping-2. In conditioning, the alarm tone was paired with an aversive stimulus 20 times. Mice were required to press the active lever during alarm tone presentation in the avoidance FR-1 task. (B) Testing procedure. Mice had to press the active lever variable times (1, 3, 5, 7, or 9) to avoid or escape from the foot shock during the warning or shock periods, respectively.

Following 2 successive sessions of obtaining ≧50 pellets, the schedule moved to shaping-2 in which an alarm tone (100 dB, 1900 Hz, 0.5 seconds intermittently) was presented simultaneously with the lever presentation. A single active lever press resulted in the retraction of levers, the termination of the alarm tone, and the delivery of the food reward. Following 5 to 10 days of daily shaping-2 sessions, the schedule moved to the next step.

Then, the alarm tone was paired with an aversive stimulus (conditioning, Figure 1A). A trial was started with the alarm tone presentation without lever presentation. After 60 seconds of the alarm tone exposure, mice received a foot shock (0.15 mA, 10 seconds continuously), followed by the termination of the foot shock and the alarm tone. Each trial was divided by a 60-second inter-trial interval. Conditioning consisted of only one session (20 trials).

On the following day, mice received avoidance FR-1 (Figure 1A), in which an alarm tone (100 dB, 1900 Hz, 0.5 seconds intermittently) was presented simultaneously with the lever presentation (warning period, 60 seconds). A single active lever press during the warning period resulted in the start of a 30-second safety period (retraction of the levers and termination of the alarm tone) without delivery of food reward. This behavior was counted as an avoidance lever press and regarded as an index of avoidance motivation. If the mice failed to press the active lever during the warning period, they received 10 seconds of foot shock (shock period). If they pressed the active lever during the shock period, it resulted in the start of a safety period. If the mice failed to both avoid and escape from the shock, such trial was regarded as an omission. The number of magazine entries was also counted to address the level of food seeking.

All the training sessions were conducted for 60 minutes per session and 1 session per day. Food reward was delivered only in the shaping-1 and shaping-2 trainings.

Test

Following 2 successive sessions of obtaining ≥50 avoidance lever presses in the avoidance FR-1, the schedule moved to avoidance variable ratio-5 (VR-5). In this task, the mice had to press the active lever variable times (1, 3, 5, 7, or 9) to avoid or escape during the warning or shock periods, respectively. The number of active lever presses during the warning period was regarded as an index of avoidance motivation, and that within the foot shock period was regarded as an index of escape motivation. The other procedures were equal to that of avoidance FR-1 (Figure 1B).

Physiological (variable shock intensity) and pharmacological (KET or BUS injection) manipulations were conducted after the performance on the VR-5 schedule of reinforcement was considered stable when the percentage of omissions in a session deviated by ≤10% for at least 3 consecutive days.

Test sessions were conducted for 60 min per session and 1 session per day.

Parameters

We used 9 behavioral parameters described as follows:

  • (a) Total trials completed (count per session)

  • (b) %Avoidance: (the number of avoidance trials/total trial number) × 100

  • (c) %Escape: (the number of escape trials/total trial number) × 100

  • (d) %Omissions: (total trial number - the number of avoidance - the number of escape /total trial number) × 100

  • (e) First lever press latency(s): the mean time from the trial start to the first active lever press

  • (f) Time spent to complete the VR(s): the mean time elapsed from the first active lever press to the achievement of the required number of active lever presses

  • (g) Inactive lever presses (count per session)

  • (h) Magazine entries (count per session)

  • (i) Immobility(s): time spent in immobile behavior manually counted

Stimulus Intensity in the Avoidance VR-5 Task

We initially addressed the minimum shock intensity to induce immobility using 5 naïve mice; 0.15 mA is the minimum intensity to induce immobility in all mice tested. We then examined the effect of the shock intensity in the VR-5 schedule from 0.15 to 0.35 mA with a 0.05-mA increment using 8 mice. The order of application of varied shock intensities was counterbalanced. Data were averaged over the 2 days of testing at each intensity.

Drug Injections in the Avoidance VR-5 Task

KET, a noncompetitive NMDA receptor antagonist, was purchased from Daiichi-Sankyo, Inc. and BUS, a 5-HT1A partial agonist, was purchased from Wako Pure Chemical Industries, Ltd.

A subanesthetic and subanalgesic (Kissin et al., 2000) dose of KET (dissolved in saline, 1 or 5 mg/kg, i.p.) or saline (10 mL/kg, i.p.) was injected 20 minutes before the start of the avoidance VR-5 task (Belujon and Grace, 2014). BUS (dissolved in saline, 5 or 10 mg/kg, i.p.) or saline (10 mL/kg, i.p.) was injected 30 minutes before the start of the behavioral session (Liang et al, 1998).

Nine mice were used in this pharmacological study. Each mouse was injected with both drugs at 3 different dosages (zero, low, high). The orders of injections and drugs were counterbalanced. Intervals between different dosages were more than 2 days and intervals between different drugs were more than 7 days. This study lasted for about 5 weeks and the VR-5 task was conducted on weekdays.

Data Analysis

For all experiments including basal performance, physiological validity, and pharmacological studies, each behavioral parameter was analyzed separately using a repeated-measures ANOVA. Multiple comparisons test using the Bonferroni’s method was performed when a significant main effect was observed.

The alpha level was set to .05. All statistical procedures were conducted using SPSS (version 20).

Results

Basal Performance on the Avoidance VR-5 Task

The median number of training sessions required for each stage was 6 (minimum 4 and maximum 9), 7 (minimum 5 and maximum 9), and 5 (minimum 3 and maximum 9) for shaping-1, shaping-2, and avoidance FR-1, respectively. We trained 19 animals and 17 of them were used in the experiments (2 animals failed to achieve the avoidance VR-5 task). After completion of the training phases, subjects were tested on the avoidance VR-5 task (Figure 1B). The number of magazine entry was significantly decreased after the conditioning phase, indicating that the reinforcing property of the food reward was diminished in the avoidance task (n = 8, main effect of task types: F4, 28 = 7.32, P<.01; multiple comparisons of Bonferroni method: P<.05 for avoidance FR-1 vs. Shaping-1 or -2, and avoidance VR-5 vs. others, Figure 2A).

Figure 2.

Figure 2.

Basal performances in the avoidance variable ratio 5 (VR-5) task. (A) The number of magazine entries per session (n = 8). Magazine entries were rarely observed after moving to the avoidance VR-5 task, indicating that lever press behaviors were not reinforced by food reward in this task. (B-D) Long-term performances on the avoidance VR-5 task (n = 8). (B) %avoidance, (C) %escape, and (D) %omissions were stable during 4 weeks. Lines indicate SEM. *P < .05 with Bonferroni method.

Basal %avoidance (main effect of week: F4, 28 = 0.97, P=.12; Figure 2B), %escape (main effect of week: F4, 28 = 0.81, P=.25; Figure 2C), and %omissions (main effect of week: F4, 28 = 1.27, P=.09; Figure 2D) were stable within 4 weeks.

Physiological Validity of the Avoidance VR-5 Task

To validate that the avoidance VR-5 task was sensitive to differences in motivation, we manipulated the level of a parameter known to alter motivated responding: the level of shock intensity. Performances in the avoidance, but not escape, VR-5 task were affected by the different levels of foot shock intensity (n=8, main effect of intensity, %avoidance: F4, 28 = 8.02, P<.01; %escape: F4, 28 = 0.43, P=.79; %omissions: F4, 28 = 10.31, P<.01) (Figure 3A-C). Multiple comparisons of Bonferroni’s method revealed that subjects were the most motivated to work for avoiding the 0.2-mA foot shock as they made more lever presses for avoiding the aversive stimulus at this particular intensity (0.2 mA vs other intensities: P<.05). Percent omissions were also significantly decreased with a 0.2-mA foot shock compared with greater intensities (P<.05). Accordingly, immobile duration was significantly prolonged with higher shock intensity (main effect of intensity, F4, 28 = 25.89, P<.001), resulting in impaired avoidance motivation. In turn, 0.2-mA shock intensity would not induce conditioned fear responses that precludes an evaluation of motivated behavior. Thus, the goal-oriented avoidance behavior was sensitive to the aversive stimulus magnitude and the optimal foot shock intensity inducing avoidance behavior was 0.2 mA.

Figure 3.

Figure 3.

Foot shock intensities in the avoidance variable ratio 5 (VR-5) task. (A-C) Performances related to avoidance/escape motivation underlying several foot shock intensities (n = 8). The 0.2 mA of intensity was most effective for inducing avoidance behaviors and reducing response failures. (D) The immobile duration of mice during the avoidance VR-5 task with variable shock intensities (n = 8). The higher intensities of foot shock prolonged immobility duration. Lines indicate SEM. *P < .05 with Bonferroni method.

KET, but Not BUS, Leads to Greater Persistence in the Avoidance VR-5 Task

A lower dose of KET has been reported to ameliorate impaired avoidance and/or escape responses in rats undergoing helplessness assessments (Maeng et al., 2008; Belujon and Grace, 2014). We thus tested mice in FR-1 and VR-5 schedules of avoidance to determine whether KET would lead to an increase in avoidance and/or escape performances.

KET administration did not affect any behavioral parameters in the avoidance FR-1 task (Supplemental Figure 1). In the avoidance VR-5 task, treatment with KET led to a significant increase in %avoidance (n=9, main effect of doses, F2,16=3.757, P<.05; Figure 4A), %escape (F2,16=3.63, P<.05; Figure 4B), a decrease in failure to avoid and escape from the aversive stimulus (F2,16=5.02, P<.05; Figure 4C), shortening in the latency of the initial lever press (F2,16=3.36, P<.05; Figure 4D), and the time spent to complete the VR (F2,16=5.98, P<.05; Figure 4E), without affecting the number of total trials completed (F2,16=0.55, P=.59; Figure 4F). Multiple comparisons of Bonferroni’s method revealed that 5 mg/kg of KET enhanced avoidance motivation (P<.05). Neither 1 nor 5 mg/kg of KET affected immobile duration (Supplemental Figure 2A), the number of inactive lever press (Supplemental Figure 2B), or magazine entries (Supplemental Figure 2C), suggesting that KET-mediated increase of behavior was specific to avoidance/escape motivation and KET improved performances in the avoidance VR-5 task.

Figure 4.

Figure 4.

Pharmacological interventions on the performances of avoidance variable ratio 5 (VR-5) task (A-F). The effects of ketamine (KET) on avoidance/escape motivation (n = 9). Repeated-measures ANOVA showed that KET administration increased (A) %avoidance, (B) %escape, (C) decreased %omission, shortened (D) the latency of the first lever press, and (E) shortened the time spent to complete the VR. (F) The number of trials completed were unchanged by the treatment. (G-L) The effects of BUS on avoidance/escape motivation (n = 9). Repeated measures ANOVA showed that BUS administration decreased (G) %avoidance and increased (I) %omission, while unchanged (H) %escape, (J) the latency of the first lever press, (K) the time spent to complete the VR, and (L) the number of trials completed. Shock intensity = 0.2 mA. Lines indicate SEM. *P < .05 with Bonferroni method.

We also tested the effects of BUS, an anxiolytic psychotropic drug, on the performances in a VR-5 task. Treatment with BUS significantly decreased %avoidance (n=9, main effect of doses, F2,16=5.204, P<.05, Figure 4G) and increased %omission (F2,16=4.760, P<.05, Figure 4I), but did not affect %escape (F2,16=2.89, P=.09; Figure 4H), the latency of the initial lever press (F2,16=2.24, P=.14; Figure 4J), the time spent to complete the VR (F2,16=1.91, P=.18; Figure 4K), or the number of total trials completed (F2,16=2.45, P=.12; Figure 4L). Multiple comparisons of Bonferroni’s method revealed that 10 mg/kg of BUS impaired avoidance motivation (P<.05), increased failure to avoid/escape from the shock, and increased immobile behavior (Supplemental Figure 2D) but did not affect the number of inactive lever press (Supplemental Figure 2E) or magazine entries (Supplemental Figure 2F). Therefore, BUS administration impaired performances in the avoidance VR-5 task as previous reported; however, we have to note that BUS induced immobile behavior.

Discussion

To evaluate avoidance/escape motivation, we combined active avoidance strategy and variable ratio schedule, and established the avoidance VR-5 task. In this task, we demonstrate that the application of optimized shock intensity is capable of increasing in goal-directed lever presses and decreasing avoidance/escape failures. To test the efficacy of our new strategy, we used drugs that were already tested in the 2-way active avoidance test (0, 1, or 5 mg/kg of KET and 0, 5, or 10 mg/kg of BUS) as a tool to address the behavioral profiles of mice during the avoidance VR-5 task. Treatment with KET led to increases in the probability of avoidance/escape and decreases of avoidance/escape failures in the task, while treatment with BUS decreased the probability of avoidance and increased avoidance/escape failures in the tasks. Our results demonstrate the efficacy of the avoidance VR-5 task to address avoidance/escape motivation in mice.

In our pilot study, we experienced that mice did not press lever to avoid the shock (n=9, data not shown). Therefore, we employed a reward-based approach strategy to shape the lever press behavior in initial training phases (shaping-1 and -2) and conducted conditioning before the avoidance FR-1 (Figure 1). The number of magazine entries significantly decreased after moving to the avoidance tasks (Figure 2A), indicating that the mice switched the strategy from reward oriented to avoidance oriented. Although the precise mechanisms underlying such learning strategy used in this study are largely unknown, we succeeded in shaping the mice to press the lever in order to avoid the upcoming aversive stimulus.

We obtained an inverse bell-shaped intensity-response curve in the avoidance VR-5 task (Figures 3A). This was not surprising because it is well known that the expectation of a strong aversive stimulus can bias the animal’s decision more to flight rather than fight against (Crawford and Masterson, 1982). Indeed, the mice spent more time in immobility in higher stimulus intensities (Figure 3D).

KET with moderately high doses (50–75 mg/kg) is known to have a general locomotor stimulant effect in rodents (Leite et al., 2008; Ribeiro et al., 2013). In this study, 5 mg/kg of KET increased %avoidance and decreased %omissions (Figure 4A, C). Since the number of inactive lever presses or magazine entries were not affected by the KET treatment (Supplemental Figure 2B,C), KET-enhanced avoidance/escape behaviors cannot be accounted for by an increase of non-goal-directed hyperactive responses. This interpretation is consistent with previous reports using low doses of KET (1–10 mg/kg) (Ghasemi et al., 2010; Belujon and Grace, 2014). A low dose of KET is also known to have an analgesic effect in humans and animals (Kator et al., 2016; Hillhouse and Negus, 2016). The analgesic effect, however, cannot explain the KET-enhanced avoidance/escape behaviors, because if the mice became less sensitive to the aversive stimulus, the avoidance/escape behaviors should have decreased (Figure 3A). Taken together, this evidence suggests that a low dose of KET enhanced avoidance/escape motivation in our new task.

KET is known to produce fast (<24 hours) and slow (>24 hours) antidepressant effects in humans (Berman et al., 2000; Zarate et al., 2006) and rodents (Maeng et al., 2008; Belujon and Grace, 2014). In this study, the effects of KET on avoidance motivation were observed after 20 minutes of the administration (Figure 4A) but disappeared after 24 hours (Supplemental Figure S3), implying that KET exerts fast but not slow effects on avoidance motivation.

The neural mechanisms of KET-induced enhanced avoidance/escape motivation remain unclear. Numerous studies have proposed specific effects of dopamine (DA) on avoidance learning. Depletion of DA neurons or axons by 6-hydroxydopamine in the substantia nigra pars compacta (SNc) (Cooper et al., 1973; Jackson et al., 1977), nucleus accumbens (NAc) (Mc Cullough et al., 1993), or prefrontal cortex (PFC) (Sokolowski et al., 1994) impaired the development and maintenance of active avoidance and escape strategies. The D2 antagonist injections into NAc did not impair acquisition but reduced avoidance response, whereas D1 antagonist injections into NAc impaired both acquisition and active avoidance (Boschen et al., 2011; Wietzikoski et al., 2012). Although the precise mechanisms are not clear, systemic KET injection increases DA neuron firing in the VTA (Belujon and Grace, 2014) and the release of DA in the NAc (Moghaddam et al., 1997). Therefore, we speculate that KET-mediated enhanced mesolimbic DA activity is involved in the KET-induced increase of avoidance responses.

BUS is known to decrease avoidance behaviors in the 2-way active avoidance test (Liang et al., 1998). Similar to the previous report, our study demonstrated that the high dose (10 mg/kg) of BUS decreased avoidance and increased omission in the avoidance VR-5 task (Figure 4G, I). As the numbers of inactive lever presses and magazine entries were intact, it is likely that the general locomotor activity was not impaired (Supplemental Figure 2E,F). Rather, the high dose of BUS induced prolonged immobile behavior (Supplemental Figure 2D). These findings suggest that the effect of BUS in our study was partly accounted for the increased conditioned fear.

Maladaptive avoidance/escape behaviors are well characterized in several psychiatric disorders. Avoidance/escape deficits are observed in anxiety and depressive disorders (e.g., avoiding social events in social phobia, avoiding places or thoughts in posttraumatic stress disorder, and helplessness in depressive patients). Recently, persistent avoidance was found to be a key feature of obsessive-compulsive disorder (Gillan et al., 2014, 2015). Our new paradigm will guide the way to develop effective therapeutic approaches to alleviate maladaptive avoidance/escape responses observed in psychiatric disease models.

Statement of Interest

None.

Supplementary Material

170426_SI

Acknowledgments

We thank the 6N9 lab members for supporting the research environmental improvement necessary for this study.

This work was supported by Grant for Research Fellow of the Japan Society for the Promotion of Science (2640100) to I.T.K., Grant-in-Aid for Scientific Research on Innovative Area ‘‘Willdynamics’’ (17H06062), and “Oscillology” (16H01621) from the MEXT to K.F.T.

References

  1. Belujon P, Grace AA. (2014) Restoring mood balance in depression: ketamine reverses deficit in dopamine-dependent synaptic plasticity. Biol Psychiatry 76:927–936. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Berman RM, Cappiello A, Anand A, Oren DA, Heninger GR, Charney DS, Krystal JH. (2000) Antidepressant effects of ketamine in depressed patients. Biol Psychiatry 47:351–354. [DOI] [PubMed] [Google Scholar]
  3. Boschen SL, Wietzikoski EC, Winn P, Da Cunha C. (2011) The role of nucleus accumbens and dorsolateral striatal D2 receptors in active avoidance conditioning. Neurobiol Learn Mem 96:254–262. [DOI] [PubMed] [Google Scholar]
  4. Campese VD, Sears RM, Moscarello JM, Diaz-Mataix L, Cain CK, LeDoux JE. (2015) The Neural Foundations of Reaction and Action in Aversive Motivation. Curr Top Behav Neurosci 27:171–195. [DOI] [PubMed] [Google Scholar]
  5. Cooper BR, Breese GR, Grant LD, Howard JL. (1973) Effects of 6-hydroxydopamine treatments on active avoidance responding: evidence for involvement of brain dopamine. J Pharmacol Exp Ther. 185:358–370. [PubMed] [Google Scholar]
  6. Crawford M, Masterson FA. (1982) Species-specific defense reactions and avoidance learning. An evaluative review. Pavlov J Biol Sci 17:204–214. [DOI] [PubMed] [Google Scholar]
  7. Da Cunha C, Wietzikoski EC, Dombrowski P, Bortolanza M, Santos LM, Boschen SL, Miyoshi E (2009) Learning processing in the basal ganglia: a mosaic of broken mirrors. Behav Brain Res 199:156–169. [DOI] [PubMed] [Google Scholar]
  8. Elliot AJ. (1999) Approach and avoidance/escape motivation and achievement goals. Educ Psychol 34:169–189. [Google Scholar]
  9. Elliot AJ, Thrash TM. (2002) Approach-avoidance/escape motivation in personality: approach and avoidance temperaments and goals. J Pers Soc Psychol 82:804–818. [DOI] [PubMed] [Google Scholar]
  10. Ghasemi M, Raza M, Dehpour A. (2010) NMDA receptor antagonists augment antidepressant-like effects of lithium in the mouse forced swimming test. J Psychopharmacol 24:585–594. [DOI] [PubMed] [Google Scholar]
  11. Gillan CM, Morein-Zamir S, Urcelay GP, Sule A, Voon V, Apergis-Schoute AM, Fineberg NA, Sahakian BJ, Robbins TW. (2014) Enhanced avoidance habits in obsessive-compulsive disorder. Biol Psychiatry 75:631–638. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Gillan CM, Apergis-Schoute AM, Morein-Zamir S, Urcelay GP, Sule A, Fineberg NA, Sahakian BJ, Robbins TW. (2015) Functional neuroimaging of avoidance habits in obsessive-compulsive disorder. Am J Psychiatry 172:284–293. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Haluk DM, Wickman K. (2010) Evaluation of study design variables and their impact on food-maintained operant responding in mice. Behav Brain Res 207:394–401. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Hillhouse TM, Negus SS. (2016) Effects of the noncompetitive N-methyl-d-aspartate receptor antagonists ketamine and MK-801 on pain-stimulated and pain-depressed behaviour in rats. Eur J Pain 20:1229–1240. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Jackson DM, Ahlenius S, Andén NE, Engel J. (1977) Antagonism by locally applied dopamine into the nucleus accumbens or the corpus striatum of alpha-methyltyrosine-induced disruption of conditioned avoidance behaviour. J Neural Transm 41:231–239. [DOI] [PubMed] [Google Scholar]
  16. Kator S, Correll DJ, Ou JY, Levinson R, Noronha GN, Adams CD. (2016) Assessment of low-dose i.v. ketamine infusions for adjunctive analgesia. Am J Health Syst Pharm 73:S22–29. [DOI] [PubMed] [Google Scholar]
  17. Kelley AE. (2004) Ventral striatal control of appetitive motivation: role in ingestive behavior and reward-related learning. Neurosci Biobehav Rev 27:765–776. [DOI] [PubMed] [Google Scholar]
  18. Kissin I, Bright CA, Bradley EL., Jr (2000) The effect of ketamine on opioid-induced acute tolerance: Can it explain reduction of opioid consumption with ketamine-opioid analgesic combinations? Anesth Analg 91:1483–1488. [DOI] [PubMed] [Google Scholar]
  19. Leite JV, Guimarães FS, Moreira FA. (2008) Aripiprazole, an atypical antipsychotic, prevents the motor hyperactivity induced by psychotomimetics and psychostimulants in mice. Eur J Pharmacol 578:222–227. [DOI] [PubMed] [Google Scholar]
  20. Liang KC, Tsui KY, Tyan YM, Chiang TC. (1998) Buspirone impaired acquisition and retention in avoidance tasks: involvement of the hippocampus. Chin J Physiol 41:33–44. [PubMed] [Google Scholar]
  21. Maeng S, Zarate CA, Jr, Du J, Schloesser RJ, McCammon J, Chen G, Manji HK. (2008) Cellular mechanisms underlying the antidepressant effects of ketamine: role of alpha-amino-3-hydroxy-5-methylisoxazole-4-propionic acid receptors. Biol Psychiatry 63:349–352. [DOI] [PubMed] [Google Scholar]
  22. McCullough LD, Sokolowski JD, Salamone JD. (1993) A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience 52:919–925. [DOI] [PubMed] [Google Scholar]
  23. Moghaddam B, Adams B, Verma A, Daly D. (1997) Activation of glutamatergic neurotransmission by ketamine: A novel step in the pathway from NMDA receptor blockade to dopaminergic and cognitive disruptions associated with the prefrontal cortex. J Neurosci 17:2921–2927. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Natsubori A, Tsutsui-Kimura I, Nishida H, Bouchekioua Y, Sekiya H, Uchigashima M, Watanabe M, de Kerchove d’Exaerde A, Mimura M, Takata N, Tanaka KF. (2017) Ventrolateral striatal medium spiny neurons positively regulate food-incentive, goal-directed behavior independently of D1 and D2 selectivity. J Neurosci 37:2723–2733. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Perrotti LI, Dennis TS, Jiao X, Servatius RJ, Pang KC, Beck KD. (2013) Activation of extracellular signal-regulated kinase (ERK) and ΔFosB in emotion-associated neural circuitry after asymptotic levels of active avoidance behavior are attained. Brain Res Bull 98:102–110. [DOI] [PubMed] [Google Scholar]
  26. Ribeiro PO, Rodrigues PC, Valentim AM, Antunes LM. (2013) A single intraperitoneal injection of ketamine does not affect spatial working, reference memory or neurodegeneration in adult mice: an animal study. Eur J Anaesthesiol 30:618–626. [DOI] [PubMed] [Google Scholar]
  27. Robinson MJ, Berridge KC. (2013) Instant transformation of learned repulsion into motivational “wanting”. Curr Biol 23:282–289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Salamone JD. (1994) The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav Brain Res 61:117–133. [DOI] [PubMed] [Google Scholar]
  29. Salamone JD, Correa M. (2002) Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137:3–25. [DOI] [PubMed] [Google Scholar]
  30. Sokolowski JD, McCullough LD, Salamone JD. (1994) Effects of dopamine depletions in the medial prefrontal cortex on active avoidance and escape in the rat. Brain Res 651: 293–299. [DOI] [PubMed] [Google Scholar]
  31. Thomsen M, Caine SB. (2006) Cocaine self-administration under fixed and progressive ratio schedules of reinforcement: comparison of C57BL/6J, 129X1/SvJ, and 129S6/SvEvTac inbred mice. Psychopharmacology (Berl) 184:145–154. [DOI] [PubMed] [Google Scholar]
  32. Tsutsui-Kimura I Takiue H Yoshida K Xu M Yano M Ohta H Nishida H Bouchekioua Y Okano H Uchigashima M, Watanabe M Takata N Drew MR Sano H Mimura M Tanaka KF (2017) Dysfunction of ventrolateral striatal dopamine receptor type 2-expressing medium spiny neurons impairs instrumental motivation. Nat Commun 8:14304. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Wietzikoski EC, Boschen SL, Miyoshi E, Bortolanza M, Dos Santos LM, Frank M, Brandão ML, Winn P, Da Cunha C. (2012) Roles of D1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance responses. Psychopharmacology (Berl) 219:159–169. [DOI] [PubMed] [Google Scholar]
  34. Zarate CA, Jr, Singh JB, Carlson PJ, Brutsche NE, Ameli R, Luckenbaugh DA, Charney DS, Manji HK. (2006) A randomized trial of an N-methyl-D-aspartate antagonist in treatment-resistant major depression. Arch Gen Psychiatry 63:856–864. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

170426_SI

Articles from International Journal of Neuropsychopharmacology are provided here courtesy of Oxford University Press

RESOURCES