Abstract
Cues predicting rewards can gain motivational properties and initiate reward-seeking behaviors. Dopamine projections from the ventral tegmental area (VTA) to the nucleus accumbens (NAc) are critical in regulating cue-motivated responding. Although, approximately one third of mesoaccumbal projection neurons are GABAergic, it is unclear how this population influences motivational processes and cue processing. This is largely due to our inability to pharmacologically probe circuit level contributions of VTA-GABA, which arises from diverse sources, including multiple GABA afferents, interneurons, and projection neurons. Here we used a combinatorial viral vector approach to restrict activating Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) to GABA neurons in the VTA of wild-type rats trained to respond during a distinct audiovisual cue for sucrose. We measured different aspects of motivation for the cue or primary reinforcer, while chemogenetically activating either the VTA-GABA neurons or their projections to the NAc. Activation of VTA-GABA neurons decreased cue-induced responding and accuracy, while increasing latencies to respond to the cue and obtain the reward. Perseverative and spontaneous responses decreased, yet the rats persisted in entering the reward cup when the cue and reward were absent. However, activation of the VTA-GABA terminals in the accumbens had no effect on any of these behaviors. Together, we demonstrate that VTA-GABA neuron activity preferentially attenuates the ability of cues to trigger reward-seeking, while some aspects of the motivation for the reward itself are preserved. Additionally, the dense VTA-GABA projections to the NAc do not influence the motivational salience of the cue.
Subject terms: Gene delivery, Motivation
Introduction
When neutral cues are repeatedly paired with a reward, they can become powerful incentives for reward-seeking, a process that is heavily dependent upon mesoaccumbal dopamine (DA) [1–3]. Yet, γ-aminobutyric acid (GABA) neurons are also present in the ventral tegmental area (VTA), and their role in regulating VTA mediated reward processes is not well understood. Pharmacological studies show that intra-VTA microinfusions of GABA agonists attenuate reward-predictive cue behavior, cue-evoked firing of target neurons in the nucleus accumbens (NAc), and disrupt both sucrose self-administration and feeding [4–6]. However, pre- and post-synaptic GABA receptors are ubiquitous throughout the VTA [7, 8], which also receives numerous GABA afferents from the NAc [9–11], the pedunculopontine tegmental nucleus, and the lateral hypothalamus ([8], [12] [13]), making it unclear if these pharmacological effects are attributable to resident GABA neurons within the VTA, signaling directly through GABA receptors on DA neurons, or by modulating GABA and/or glutamate afferents.
VTA-GABA neurons are thought to consist primarily of GABA interneurons, while an estimated 20% project to other areas, including the NAc [7, 14, 15]. In fact, approximately one third of mesoaccumbal projecting neurons are GABAergic [16]. These unique GABA projection neurons likely have distinct influences on reward-seeking behaviors, however compared to DA, relatively little is known about the functional role of either VTA-GABA neurons or the mesoaccumbal GABA projections in reward-cue processing.
Recent advances in genetics have permitted the direct examination and manipulation of VTA-GABA neurons in mice, however behavioral assessments on cue processing have produced mixed results. For example, VTA-GABA neurons displayed enhanced firing in response to a reward-predictive odor cue [17]. Yet, while one study demonstrated that optogenetic activation of VTA-GABA cell bodies disrupted anticipatory licking to a sucrose-predictive odor [18], another failed to show an effect on anticipatory licking induced by a predictive light-tone cue [19]. In an appetitive Pavlovian conditioning paradigm, inhibition of VTA-GABA neurons tended to delay task acquisition [13].
Studies employing optogenetic stimulation of VTA-GABA terminals in the NAc are sparse but have likewise produced confounding results. In one study, activation of these GABA terminals had no effect on sucrose consumption [19]. Yet another study showed that activation of VTA-GABA terminals in the NAc during training enhanced discrimination learning, such that in later testing the mice were able to discriminate between a cue predicting an aversive stimulus and a similar but unpaired cue [20]. These studies indicate that either the mesoaccumbal GABA projections influence only negative reinforcement, or that the anticipatory licking behavior could not capture the effects of activating these projections on reward-predictive cues.
In this study, we sought to determine how VTA-GABA neurons influence instrumental responding to reward-predictive cues in a rat Pavlovian instrumental task, and whether mesoaccumbal GABA projections also contribute to these behaviors. Targeted activation of VTA-GABA neurons was achieved using a novel combinatorial viral approach to deliver activating DREADDs (Designer Receptors Exclusively Activated by Designer Drugs, hM3D) to VTA-GABA neurons in wild-type rats. This circuit level approach overcomes the promiscuity of locally delivered pharmacological agents. Further, our sophisticated operant model is sensitive to GABAergic pharmacological manipulations [6], and requires a robust behavioral response which integrates multiple reward-related processes, including attending to a predictive cue, seeking out the reward, and consuming it. Thus, our approach provides a better understanding of how VTA-GABA neurons and mesoaccumbal GABA projections influence cue motivated responding and definitely determine if these VTA-GABA neurons influence responding to reward-predictive cues.
Methods and materials
Subjects
Long-Evans rats (Envigo, Indianapolis, IN) weighing ~290–320 g were individually housed under a 12 h/12 h light/dark cycle (lights on at 3 PM), with all behavioral experiments conducted at 9 AM. Food and water were available ad libitum. Male Sprague Dawley rats (200–300 g) were used for electrophysiological experiments. All procedures complied with the Guide for the Care and Use of Laboratory Animals (NIH, Publication 865–23) and were approved by the Institutional Care and Use Committee at the University at Buffalo.
Adeno-associated virus (AAV)
To target GABA neurons, we used a combinatorial viral vector approach in which Cre recombinase expression is driven by the rat glutamate decarboxylase 1 (GAD1) promoter [21], while the excitatory DREADD (hM3D) or channelrhodopsin-2 (ChR2) was provided in a Cre dependent DIO (Double-floxed Inverse Orientation) configuration, which requires Cre recombinase to flip it in line with the generalized EF1α promoter. Specifically, DIO-ChR2-EYFP-AAV2/10 (electrophysiology) or DIO-hM3D-mCherry-AAV2/10 (electrophysiology and behavior) were co-infused with GAD1-Cre-AAV2/10 into the VTA (Fig. 1a). Previously we used this combinatorial approach to restrict ChR2 to tyrosine hydroxylase positive neurons in the VTA [22–24].
Stereotaxic virus injection surgery
Rats (n = 23) were bilaterally infused with either 1 μl of virus (333 nl of GAD1-Cre co-infused with either 667 nl of DIO-hM3D-mCherry or DIO-ChR2-EYFP) or 0.5 μl of virus (167 nl of GAD1-Cre co-infused with 333 nl of DIO-hM3D-mCherry) into the VTA (in mm from bregma: AP −5.6, ML ± 1.0, DV −7.8) over 2 min using a Drummond Nanoject injector equipped with a glass capillary, and 8 of these were then implanted with double 26 ga cannulae (PlasticsOne, Roanoke, VA) in the NAc (in mm from bregma: AP, +1.5, ML, ±1.1, DV, −5.5) in a procedure detailed elsewhere [25]. Rats trained on the incentive cue (IC) task were allowed a minimum of 5 days before resuming behavioral sessions, and all rats were allowed >2 weeks before undergoing their respective drug treatments or procedures. Additional rats (n = 15) were infused with GFP control virus to serve as sham controls for various behavioral measures and electrophysiological experiments; of these 6 were also implanted with cannulae in the NAc as described above.
Drugs and treatment
For activation of VTA-GABA cell bodies, clozapine N-oxide (CNO, National Institutes of Drug Abuse Drug Supply Program, Baltimore, MD) was dissolved with 0.9% sterile saline and 0.3 mg/kg administered intraperitoneally (i.p.) 30 min prior to the session [26, 27]. CNO and saline injections were randomized and occurred at least 3 days apart. To selectively activate VTA-GABA terminals in the NAc, rats implanted with cannula were bilaterally infused with 0.3 µl of saline or 1 mM CNO (300 µmol total) dissolved in 0.9% sterile saline [28] at 0.15 μl/min in a procedure adapted from others [25] and detailed further in Supplementary materials and methods. In order to rule out a potential role of clozapine on behavioral responses, clozapine (CZP, Enzo Life Sciences, Inc., Farmingdale, NY) was dissolved with 0.9% sterile saline and 0.3 mg/kg administered i.p. 30 min prior to the session.
Behavioral apparatus
Testing occurred in operant chambers (Med-Associates, Georgia, VT) within a sound-attenuating cubicle, equipped with two illuminated infrared nosepoke ports surrounding a centrally located liquid receptacle equipped with an infrared entry detector. A white houselight and a tone generator speaker were located on the opposite wall. Each chamber was equipped with a pump to deliver 10% sucrose. Locomotor testing occurred in open-field activity monitors (Med-Associates, Georgia, VT) within a sound-attenuating cubicle. A white houselight was located in the corner of the cubicle and a ventilation fan provided white noise.
Training and behavioral paradigm
IC task training
The IC task is modified from others described elsewhere [6, 25, 29] and in detail in Supplementary methods.
Free drinking
A free drinking session was conducted in the operant chambers, where head entry into the reward receptacle activated the pump, delivering sucrose continuously into the cup until the rat left the receptacle. The first 2-min was analyzed as the total volume consumed in this period was equivalent to that consumed after saline pretreatment during the IC sessions. Chambers were checked after each session to confirm all the liquid had been consumed. Head entries in the previously active or inactive nosepoke port had no programmed consequences.
Locomotor activity
Activity was assessed in a subset of rats (hM3D, n = 7; GFP, n = 6) in open-field chambers for 20 min. Rats were acclimatized to the chambers for two consecutive days, and pretreatment with CNO or saline 30 min prior to the session on the third day.
Histological verification
Histological verification of virus and cannula placements were conducted for all subjects using immunohistochemistry, as detailed in Supplementary methods, and described elsewhere [22].
Electrophysiology and LED photostimulation
Neurons in the VTA were visualized using an Olympus BX-51-WI fluorescent microscope. Somatic recordings were obtained from EYFP negative putative DA neurons (n = 4) with patch electrodes (3–5 MΩ) filled with a solution containing (in mM): 120 cesium methanesulfonic acid; Cs-Cl; 10 Na2-phosphocreatine, 10 HEPES; 1 MgCl2; 1 EGTA; 2 Na2-ATP; 0.25 Na-GTP (pH = 7.3; adjusted with Cs-OH; Osmolarity: 280 to 290 mOsmol/l) or a solution containing: 120 potassium gluconate, 10 Na2-phosphocreatine, 10 KCl, 10 HEPES, 1 MgCl2, 1 EGTA, 2 Na2-ATP, and 0.25 Na-GTP (pH = 7.3). All recordings were performed in the presence of 6,7-dinitroquinoxaline-2,3-dione (DNQX; 20 µM), D-(-)-2-Amino-5-phosphonopentanoic acid (D-APV; 20 µM) to block AMPA (α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid) and NMDA (N-Methyl-D-aspartic acid) receptors, respectively. LED photostimulation was delivered using a Prizmatix LED module (465 nm). Light was delivered through 200-µm path optical cable with a bare 1 cm glass exposed. Optically induced currents were triggered at a frequency of 0.005 Hz with light pulses (duration: 5 ms, intensity: 2–5 mW). For chemogenetic experiments, CNO was applied at concentrations of 0.1, 0.3, or 1.0 μM for 15–20 min followed by a wash out period.
Measures and data analysis
We quantified four basic metrics in the incentive cue task: the response ratio for the IC predicting availability of sucrose (#nosepokes resulting in a reward/#ICs), the nosepoke latency (time; T) to emit a rewarded nosepoke (Tnosepoke-TIC), the reward cup latency to enter the cup after a rewarded nosepoke (Treceptacle-Tnosepoke), and the nosepoke accuracy (#rewarded nosepokes/#total nosepokes). We also counted the number of ICs before the rats earned their first reward. We classified unrewarded active nosepokes as “perseverative” if they occurred while the reward was being delivered (during the CS+ and pump on), “near misses” if they occurred 0–8 s after an unrewarded IC, or “spontaneous” if they occurred in the variable interval between IC presentations. Overall reward-cup behavior was quantified as the total cup entries per reward earned. To characterize common action patterns associated in response to an IC during the task, we quantified the number of times rats engaged in rewarded sequences: a successful nosepoke during an IC presentation followed by entry into the reward receptacle (IC (A+)→nosepoke (B)→reward cup (C)), or a reward cup entry prior to a successful nosepoke response during an IC (A+→C→B→C). Three unrewarded action patterns were quantified: entering the reward receptacle only during an IC (A+→C), ignoring the IC and then entering the reward cup when the IC was off (i.e., A0→C), and when the rat did not respond during or between the IC presentations (A0). The total volume consumed during a free-drinking session was derived from the length of time the rat remained inside the reward receptacle and the flowrate of the pump. Locomotion was quantified as distance traveled in the session.
Statistical comparisons were conducted using t-tests, Wilcoxon matched-pairs signed-rank tests, One-way, Two-way repeated-measures (RM), and mixed design ANOVA, followed by a Holms-Sidak correction for pairwise comparisons, where appropriate. Normality was tested with a Shapiro–Wilk test. Significance was set to α = 0.05. Additional details on the statistical tests are provided in the relevant results or figure legends.
Results
To validate the dual virus targeting system, we first co-infused the EF1α-DIO-ChR2-EYFP-AAV2/10 virus with the GAD1-Cre-AAV2/10 virus into the VTA. Double immunofluorescence for EYFP and TH revealed that ChR2-EYFP expression occurred primarily in non-DA neurons (Fig. 1b) in reported proportions for DA and GABA neurons in the VTA (~74% of total neurons were TH+ /ChR2-, ~25% TH-/ChR2+, and <0.5% TH+/ChR2+, 406 total, n = 4, Fig. 1c, [30, 31]). Numerous ChR2-EYFP+ terminals were also observed in the NAc (Fig. 1d). To verify that the ChR2+ neurons were GABAergic, we examined whether photoactivation of ChR2 triggers GABA-mediated synaptic currents in putative DA neurons. We found that in the presence of AMPA and NMDA receptor antagonists, local photostimulation elicited robust optical inhibitory post-synaptic currents (oIPSCs) in putative DA neurons (Fig. 1e, f). oIPSCs were recorded at various holding potentials (Fig. 1f, each trace is the average of 10 trials at 0.05 Hz). These oIPSCs reversed polarity at the equilibrium potential of chloride ions (i.e., −58 mV) determined in our experimental condition and were blocked by the GABAA receptor antagonist picrotoxin (100 µM, Fig. 1e, inset is an example oIPSC collected before and during picrotoxin application). Collectively, this experiment indicates that ChR2+ neurons in the VTA are indeed GABAergic and their activation induces a robust GABA-IPSC in putative VTA-DA neurons. Additional rats were co-infused with EF1α-DIO-hM3D-mCherry-AAV2/10 and GAD1-Cre-AAV2/10 viruses into the VTA (Fig. 1a). Robust and widespread hM3D-mCherry expression was observed in the VTA (Fig. 1g). Note that although some yellow is observed in the bottom panel, the objective used to generate this image cannot resolve closely located signals. Importantly, as in Fig. 1b, hM3D-mCherry+ neurons did not co-localize with TH+ neurons (Fig. 1h). Additional recordings were performed to test CNO effects. We showed that bath applied CNO at 10 µM had no effects on the spontaneous firing of a DA neuron recorded from a GFP sham control rat (Fig. 1i, top panel) while the same concentration of CNO completely inhibited neuron firing in a DA neuron which recovered after wash out. In addition, the spontaneous firing of DA neurons was completely inhibited at lower CNO concentrations (0.1, 0.3, and 1 µM; n = 3; Fig. 1i, bottom panel). In all of these neurons, spontaneous firing returned upon wash out of CNO. These viruses were then applied to a new cohort of rats, which were trained on the IC task (Fig. 1j, Supplementary methods).
Effect of VTA-GABA stimulation on performance in the incentive cue task
We initially assessed the effects of systemic and intra-NAc CNO administration on overall IC task performance during the entire 1-h session in rats expressing either hM3D or sham GFP controls (Fig. 2). When pretreated systemically by i.p. CNO (Fig. 2a), there was a significant Treatment × Virus interaction, decreasing mean response ratios (F1,28 = 48.02, p < 0.0001) and accuracy (F1, 28 = 9.39, p = 0.005) while increasing nosepoke (F1,28 = 45.05, p < 0.0001) and reward (F1,28 = 15.60, p < 0.0001) latencies only in rats expressing hM3D. Of note, CNO itself did not have a behavioral effect in any of the IC task metrics in rats infused with a sham GFP virus. Activation of GABA terminals in the NAc alone by intra-NAc CNO infusions had no effect on any of the performance metrics in either rats expressing hM3D or sham GFP controls (Fig. 2b). Importantly, this dose of microinfused CNO is effective in other studies ([28], unpublished results).
We further examined the effect of systemic VTA-GABA chemogenetic activation on task performance in a subset of rats (Fig. 3a). Rats maintained a stable baseline of responding over the 1-h session after saline pretreatment, and did not differ significantly from GFP controls pretreated with saline or CNO (Figure S1A). However, when pretreated with CNO i.p., rats showed a significant decrease in response ratio compared to saline performance (Two-way RM ANOVA, main effect of Time F3,27 = 5.58, p = 0.0041, treatment, p < 0.0001, F1,9 = 6.18, Time × Treatment F3,27 = 5.51, p = 0.0044) and overall accuracy (main effect of Treatment, F1,9 = 6.41, p = 0.0321). Rats also uniformly increased their latency to nosepoke (main effect of Treatment F1,9 = 69.2, p < 0.0001), and obtain the reward (main effect of Treatment F1,9 = 29.8, p = 0.0004). All other effects and interactions were not significant.
We next examined the type of nosepokes emitted (Fig. 3b) to determine whether changes in accuracy after VTA-GABA stimulation (Fig. 3a) result from either decreased responding to the IC or increases in inappropriate nosepoking between ICs. In systemically treated rats, there was a significant Treatment × Virus interaction (Fig. 3b, F1,57 = 33.27, p < 0.0001) and a significant Treatment × Nosepoke type interaction (F1,57 = 26.64, p < 0.0001) indicating that VTA-GABA neuron activation decreased rewarded nosepokes in rats expressing the DREADD but not GFP controls. Furthermore, there was no effect of stimulating the NAc projections directly (Fig. 3b). We next categorized the nosepokes as spontaneous (occurring between IC), perseverative (multiple nosepokes during IC and subsequent 4-s CS+) and near misses (occurring immediately after the IC ended). Systemic VTA-GABA activation did not alter perseverative, near miss, or spontaneous nosepokes compared to saline or GFP controls (Supplementary Figure S1B). Overall, the decrease in accuracy in Fig. 3a is therefore attributable to decreased rewarded nosepokes, rather than an increase in inappropriate responding when the reward was not available.
We also examined behavior in relation to the reward cup. After VTA-GABA activation, there was a Treatment × Virus interaction, due to a decrease in the number of reward cup entries during the session in hM3D rats after CNO pretreatment (Fig. 4a, F1,28 = 6.04, p = 0.02). VTA-GABA activation also decreased the mean number of rewards earned in the same rats (F1,28 = 89.77, p < 0.0001), but not proportionally, such that saline treated and GFP control rats entered the reward cup ~1.5-times/reward earned, while VTA-GABA neuron activation increased this to ~4-times/reward (Treatment × Virus interaction, F1,28 = 6.44, p = 0.017). There were no changes in these metrics after intra-accumbal CNO administration. Together this suggests that activating VTA-GABA neurons disrupts responding during the IC, while some reward-seeking behaviors (e.g., cup entries) are preserved.
We next sought to determine whether the effects of VTA-GABA neuron activation occurred from the beginning of the session or required the rats to experience the reward. Rats normally respond to the first IC (1.12 ± 0.08th IC; ~33 s from start of session, Fig. 4b), but after VTA-GABA activation, the rats responded to a later IC (1.94 ± 0.33rd IC; ~60 s from start of session, planned two-tailed Wilcoxon matched-pairs signed-rank test, W = 40, p = 0.019). Again, there was no effect on first IC responded to when VTA-GABA terminals are activated by intra-NAc CNO infusions (Fig. 4b). Intra-accumbal cannula placements were also confirmed in Fig. 4b. These data indicate that the effects of VTA-GABA were present at the onset of the session, but again mesoaccumbal GABA does not have a role in these effects.
Given the apparent increase in cup entries when the reward was not available, we next sought to determine how VTA-GABA activation influenced the actions initiated after each IC (Fig. 4c). After saline, rats generally responded during an IC with a nosepoke and then reward cup entry to obtain the reward (A+→B→C; Fig. 1g). Occasionally, the reward cup was entered first, before nosepoking during an IC (A+→C→B→C). After VTA-GABA activation, the number of A+→B→C rewarded action sequences significantly decreased (Fig. 4c, Treatment × Virus interaction, F1,28 = 88.39, p < 0.0001). Effects on the other, less efficient A+→C→B→C pattern were not significant. Unrewarded sequences simultaneously increased (Fig. 4c). Most frequently, rats stopped responding to the IC entirely and none of the action sequences examined were emitted (A0, Treatment × Virus interaction, F1,28 = 27.92, p < 0.0001), but reward cup entries between ICs also increased (A0→C, Treatment × Virus interaction, F1,28 = 18.61, p < 0.0001), as well as reward cup entries during the IC (A+→C, Treatment × Virus interaction, F1,28 = 9.10, p = 0.005). Thus, even though reward cup entries declined overall, unrewarded entries increased. Rats engaged less in the most direct actions to obtain the reward (A+→B→C) and either ignored the IC (A0), sought the reward in absence of the IC (A0→C), or erroneously entered the reward cup instead of the nosepoke during the IC (A+→C).
Control experiments to determine whether VTA-GABA activation affects palatability, activity, or if metabolism of CNO to CZP impacts IC responding
To determine whether the effects of VTA-GABA stimulation could be attributed to changes in palatability of sucrose, we examined free drinking consumption. Under free drinking conditions, rats will drink in 2-min an equivalent amount of sucrose obtained during the entire 1-h IC task at baseline or after saline (Fig. 5a). VTA-GABA activation did not alter the amount of sucrose consumed in 2-min under free drinking conditions, even though the volume of sucrose consumed after VTA-GABA activation during the IC task decreased dramatically (Fig. 5b, two-tailed paired t-test, t16 = 10.97, p < 0.0001). These data indicate that the palatability of sucrose was unchanged and cannot account for the decreased responding to the ICs. In terms of generalized locomotor activity levels, the total distance traveled in an open-field after saline or VTA-GABA activation was not significantly altered via a Treatment × Virus interaction, again indicating that the primary results in the IC task did not arise from gross disruptions in overall locomotor activity. Finally, due to recent evidence that CNO is metabolized to CZP in vivo [32], we sought to determine whether any of the effects on the IC task were attributable to activity at receptors other than hM3D. We determined that an equivalent systemic CZP dose (0.3 mg/kg, i.p.) did not impact any of the metrics of the IC task (Fig. 5c) in rats that do not express hM3D, indicating that metabolism to CZP is not contributing to the primary results of VTA-GABA activation in our earlier experiments.
Discussion
This study produced three key findings. First, that activation of VTA-GABA neurons strongly reduced responding to cues predictive of reward availability by altering the cue’s motivational salience. Second, targeted activation of VTA-GABA projections in the NAc did not impact this process. Third, this disruption was cue specific, and other, less efficient reward-seeking behaviors were preserved.
Pursuing and earning a reward in a dynamic environment is not a unitary process, but employs multiple reward-related systems with overlapping neural circuits [7, 33, 34]. Several reward processes have been ascribed to the mesolimbic circuitry, including attributing motivational properties to neutral stimuli (i.e., incentive salience [35]). It is therefore surprising that optogenetic studies have not found a strong and consistent effect of VTA-GABA activation on cue-induced reward-seeking. Indeed, these previous studies either could not distinguish between decreases in the motivational salience of the cue from decreases in reward consummatory behaviors [18], or determined that the primary effect of VTA-GABA activation is decreases in reward consumption, with no effect on non-instrumental responding to the reward-predictive cue [19]. We therefore chose to examine this question using a sophisticated and sensitive operant model, and found that VTA-GABA activation does in fact greatly inhibit instrumental responding to reward-predictive cues. Our results support earlier pharmacological evidence that in a task heavily dependent on incentive cues, VTA-GABA neurotransmission attenuates task performance [6]. We have extended these findings by demonstrating that VTA-GABA neuron activation alone is sufficient for producing this effect, establishing that the numerous mesoaccumbal GABA projections do not contribute, and by thoroughly characterizing the nature of the VTA-GABA disruption on ICinstrumental responding.
One proposed hallmark of changes in motivation underlying incentive motivational processes is that such changes should occur at the onset of the session, independent of exposure to the reward [35]. In our study, the rats demonstrated a CNO-induced decrease in motivation for the cue from the onset of the session, before having a chance to assess the value of the reward by consuming it. In addition, VTA-GABA activation did not change sucrose consumption during free-drinking, in that rats will readily consume a similar volume of sucrose compared to saline, and as earned during the IC task (Fig. 5a). Together, these results indicate VTA-GABA activation did not impact consummatory processes, such as reducing the palatability of the reward.
Our data indicate that VTA-GABA has a substantial effect on instrumental responding. The decrease in accuracy of nosepoking after VTA-GABA stimulation (Figs. 2a and 3a) may result from behavioral disinhibition and responding inappropriately to the cue, an effect also observed after pharmacological inactivation of the NAc in a similar task [6, 29]. However, while VTA-GABA stimulation profoundly decreased responding during the IC (Fig. 3b), inappropriate perseverative, near-miss, and spontaneous nosepokes did not change (Supplementary Figure S1B). Thus, the change in accuracy resulted from a drop in responding to the cue, and not behavioral disinhibition leading to inappropriate nosepoking. The decreases in responding also likely do not result from a generalized suppression of locomotor activity (Fig. 5b). It should be noted that this IC task depends both on the ability of IC to elicit a motivated response, and the instrumental response itself. Therefore, it is not possible to completely dissociate the impact of VTA-GABA neuron activation on cue processing in the current behavior.
To determine whether VTA-GABA activation shifted motivational significance to the reward cup, we mapped the initial sequence of actions after each cue (Fig. 4c). Normally, the rats responded to the cue in the most efficient way (i.e., entering the reward cup immediately after nosepoking during the cue and rarely selected inefficient or incorrect responses). During VTA-GABA activation, rats most commonly did not respond to the cues (A0, Fig. 4c). However, other inappropriate response patterns appeared, including bypassing the nosepoke for the reward-cup during the cue and reward-cup entries outside the presentation of the cue. Indeed, rats entered the reward cup ~4-times more often per earned reward (Fig. 4a). Thus, there was a decreased responding to the IC coupled with an increased sampling of the reward cup between ICs, suggesting the preservation in the motivation to seek the reward while disrupting responding to the IC directly. While it is possible that other motoric, perseverative or even stereotyped behaviors could account for disruption of IC responding, it seems unlikely given the lack of perseverative nosepoking, alterations in locomotor activity, or free-drinking behaviors.
Surprisingly, activation of VTA-GABA terminals in the NAc did not impact responding to reward-predictive cues in our behavioral task (Figs. 2b, 3b, 4a,b). Others have suggested that VTA-GABA neurons contribute to associative learning processes, which evaluate the outcome of a goal-directed action against a learned value [17, 18], and that VTA-GABA projections to the NAc may facilitate this process, possibly by disinhibiting local cholinergic interneurons [20]. However, VTA-GABA projection neurons send efferents to a wide range of other brain areas including the prefrontal cortex and amygdala ([7, 15, 16]). VTA-GABA projections likely have unique influences on reward-seeking behavior, yet comparatively little is known about their contribution to motivated behaviors. In transgenic mice, optogenetic activation of VTA-GABA terminals in the NAc failed to alter sucrose consumption (i.e., licking, [19]) yet activation during training in a conditioned aversion paradigm enhanced predictive cue discrimination to an aversive stimulus [20]. The lack of effect from activating VTA-GABA accumbal projections in our well-trained rats may reflect that the motivational value of the cue remained constant throughout the session, leaving open the possibility that these projections have a role in associative learning. It should also be noted that systemic CNO would activate VTA-GABA interneurons and projection neurons in our study. Thus, the results reported here may be the result of either activating VTA-GABA interneurons, or activating a combination of interneurons and/or different VTA-GABA projection systems in the NAc or elsewhere. Future studies examining these learning processes may expose the role of the VTA-GABA projections to the NAc.
Notably, the validity of DREADD manipulations has recently been questioned, with a recent study showing that CNO is converted to CZP in vivo and is the primary metabolite to activate DREADDs [32]. Proper control studies are therefore important to interpret our results to determine whether activity at non-hM3D contributes to our effects. The dose of CNO used in these studies (0.3 mg/kg i.p.) is low compared to other published studies [36], and well below the dose considered active in many DA related behaviors [37]. Importantly, this dose of CNO has no effect on any of the metrics of the IC task in sham treated rats that lack DREADDs (Figs. 2–5), nor does the 300 µmol of CNO infused directly into the NAc (Figs. 2–4). We also observed a complete inhibition of firing of DA neurons when we applied 0.1 μM of CNO in slices from hM3D expressing rats, and likewise this concentration appears to be much lower than other studies report (e.g., 5 μM, see refs. [38, 39]). We attribute our ability to successfully use this low dose to the high levels of transgene expression the AAV2/10 serotype affords. Alternatively, the VTA-GABA neurons may be more sensitive to hM3D activation. Additionally, even if all of the CNO is converted to CZP, 0.3 mg/kg of CZP administered i.p. has been ineffective in altering other operant behaviors and likewise we showed no effect of this dose in our IC task (Fig. 5c). Thus we are confident that our results are not attributable to off-target effects of CNO.
In summary, we found that VTA-GABA neurons preferentially regulate processes contributing to the attribution of incentive salience, which are dissociable from other reward-seeking in consumption behaviors in a dynamic and robust operant model. VTA-GABA terminals do not disrupt incentive salience processes or responding to incentive cues, and future studies will need to determine what precise contributions these mesoaccumbal GABA projections have to the behavioral output of mesolimbic circuits.
Electronic supplementary material
Acknowledgements
We thank Dr. David C. Lyon for providing the GAD1 promoter used in these experiments. We thank Raquel Lima, Karie Chen, and Martin Leigh for technical assistance and Dr. Paul Meyer for very helpful comments on the manuscript. We also thank Dr. Wade Sigurdson and the University at Buffalo Confocal Microscopy Core for invaluable assistance. This research was supported by the State University of New York BRAIN Network of Excellence Postdoctoral Fellow program and T32 AA007583 (K.T.W.), the Whitehall Foundation 2017-08-43 (J.P.); 2017-12-98 (C.E.B.), as well as R01 AA024112 and R21 DA043190, (C.E.B.).
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Supplementary Information accompanies this paper at (10.1038/s41386-018-0097-6).
References
- 1.Berridge KC, Robinson TE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev. 1998;28:309–69. doi: 10.1016/S0165-0173(98)00019-8. [DOI] [PubMed] [Google Scholar]
- 2.Berridge KC, Robinson TE. Liking, wanting, and the incentive-sensitization theory of addiction. Am Psychol. 2016;71:670–9. doi: 10.1037/amp0000059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Berridge KC, Robinson TE, Aldridge JW. Dissecting components of reward: ‘liking’, ‘wanting’, and learning. Curr Opin Pharmacol. 2009;9:65–73. doi: 10.1016/j.coph.2008.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Hodge CW, Haraguchi M, Chappelle AM, Samson HH. Effects of ventral tegmental microinjections of the GABAA agonist muscimol on self-administration of ethanol and sucrose. Pharmacol Biochem Behav. 1996;53:971–7. doi: 10.1016/0091-3057(95)02146-9. [DOI] [PubMed] [Google Scholar]
- 5.Miner P, Borkuhova Y, Shimonova L, Khaimov A, Bodnar RJ. GABA-A and GABA-B receptors mediate feeding elicited by the GABA-B agonist baclofen in the ventral tegmental area and nucleus accumbens shell in rats: reciprocal and regional interactions. Brain Res. 2010;1355:86–96. doi: 10.1016/j.brainres.2010.07.109. [DOI] [PubMed] [Google Scholar]
- 6.Yun IA, Wakabayashi KT, Fields HL, Nicola SM. The ventral tegmental area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J Neurosci. 2004;24:2923–33. doi: 10.1523/JNEUROSCI.5282-03.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Fields HL, Hjelmstad GO, Margolis EB, Nicola SM. Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu Rev Neurosci. 2007;30:289–316. doi: 10.1146/annurev.neuro.30.051606.094341. [DOI] [PubMed] [Google Scholar]
- 8.Sesack SR, Grace AA. Cortico-Basal Ganglia reward network: microcircuitry. Neuropsychopharmacology. 2010;35:27–47. doi: 10.1038/npp.2009.93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Watabe-Uchida M, Zhu L, Ogawa SK, Vamanrao A, Uchida N. Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron. 2012;74:858–73. doi: 10.1016/j.neuron.2012.03.017. [DOI] [PubMed] [Google Scholar]
- 10.Xia Y, Driscoll JR, Wilbrecht L, Margolis EB, Fields HL, Hjelmstad GO. Nucleus accumbens medium spiny neurons target non-dopaminergic neurons in the ventral tegmental area. J Neurosci. 2011;31:7811–6. doi: 10.1523/JNEUROSCI.1504-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Zahm DS, Heimer L. Specificity in the efferent projections of the nucleus accumbens in the rat: comparison of the rostral pole projection patterns with those of the core and shell. J Comp Neurol. 1993;327:220–32. doi: 10.1002/cne.903270205. [DOI] [PubMed] [Google Scholar]
- 12.Geisler S, Zahm DS. Afferents of the ventral tegmental area in the rat-anatomical substratum for integrative functions. J Comp Neurol. 2005;490:270–94. doi: 10.1002/cne.20668. [DOI] [PubMed] [Google Scholar]
- 13.Yau HJ, Wang DV, Tsou JH, Chuang YF, Chen BT, Deisseroth K, et al. Pontomesencephalic tegmental afferents to VTA non-dopamine neurons are necessary for appetitive pavlovian learning. Cell Rep. 2016;16:2699–710. doi: 10.1016/j.celrep.2016.08.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Creed MC, Ntamalti NR, Tan KR. VTA GABA neurons modulate specific learning behaviors through the control of dopamine and cholinergic systems. Front Behav Neurosci. 2014;8:8. doi: 10.3389/fnbeh.2014.00008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Taylor SR, Badurek S, Dileone RJ, Nashmi R, Minichiello L, Picciotto MR. GABAergic and glutamatergic efferents of the mouse ventral tegmental area. J Comp Neurol. 2014;522:3308–34. doi: 10.1002/cne.23603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Van Bockstaele EJ, Pickel VM. GABA-containing neurons in the ventral tegmental area project to the nucleus accumbens in rat brain. Brain Res. 1995;682:215–21. doi: 10.1016/0006-8993(95)00334-M. [DOI] [PubMed] [Google Scholar]
- 17.Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature. 2012;482:85–8. doi: 10.1038/nature10754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Eshel N, Bukwich M, Rao V, Hemmelder V, Tian J, Uchida N. Arithmetic and local circuitry underlying dopamine prediction errors. Nature. 2015;525:243–6. doi: 10.1038/nature14855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.van Zessen R, Phillips JL, Budygin EA, Stuber GD. Activation of VTA GABA neurons disrupts reward consumption. Neuron. 2012;73:1184–94. doi: 10.1016/j.neuron.2012.02.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Brown MT, Tan KR, O’Connor EC, Nikonenko I, Muller D, Luscher C. Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature. 2012;492:452–6. doi: 10.1038/nature11657. [DOI] [PubMed] [Google Scholar]
- 21.Liu YJ, Ehrengruber MU, Negwer M, Shao HJ, Cetin AH, Lyon DC. Tracing inputs to inhibitory or excitatory neurons of mouse and cat visual cortex with a targeted rabies virus. Curr Biol. 2013;23:1746–55. doi: 10.1016/j.cub.2013.07.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gompf HS, Budygin EA, Fuller PM, Bass CE. Targeted genetic manipulations of neuronal subtypes using promoter-specific combinatorial AAVs in wild-type animals. Front Behav Neurosci. 2015;9:152. doi: 10.3389/fnbeh.2015.00152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Illiano P, Bass CE, Fichera L, Mus L, Budygin EA, Sotnikova TD, et al. Recombinant adeno-associated virus-mediated rescue of function in a mouse model of Dopamine Transporter Deficiency Syndrome. Sci Rep. 2017;7:46280. doi: 10.1038/srep46280. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mikhailova MA, Bass CE, Grinevich VP, Chappell AM, Deal AL, Bonin KD, et al. Optogenetically-induced tonic dopamine release from VTA-nucleus accumbens projections inhibits reward consummatory behaviors. Neuroscience. 2016;333:54–64. doi: 10.1016/j.neuroscience.2016.07.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wakabayashi KT, Fields HL, Nicola SM. Dissociation of the role of nucleus accumbens dopamine in responding to reward-predictive cues and waiting for reward. Behav Brain Res. 2004;154:19–30. doi: 10.1016/j.bbr.2004.01.013. [DOI] [PubMed] [Google Scholar]
- 26.Anaclet C, Pedersen NP, Ferrari LL, Venner A, Bass CE, Arrigoni E, et al. Basal forebrain control of wakefulness and cortical rhythms. Nat Commun. 2015;6:8744. doi: 10.1038/ncomms9744. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Pedersen NP, Ferrari L, Venner A, Wang JL, Abbott SB, Vujovic N, et al. Supramammillary glutamate neurons are a key node of the arousal system. Nat Commun. 2017;8:1405. doi: 10.1038/s41467-017-01004-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Mahler SV, Vazey EM, Beckley JT, Keistler CR, McGlinchey EM, Kaufling J, et al. Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking. Nat Neurosci. 2014;17:577–85. doi: 10.1038/nn.3664. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Ambroggi F, Ghazizadeh A, Nicola SM, Fields HL. Roles of nucleus accumbens core and shell in incentive-cue responding and behavioral inhibition. J Neurosci. 2011;31:6820–30. doi: 10.1523/JNEUROSCI.6491-10.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Nair-Roberts RG, Chatelain-Badie SD, Benson E, White-Cooper H, Bolam JP, Ungless MA. Stereological estimates of dopaminergic, GABAergic and glutamatergic neurons in the ventral tegmental area, substantia nigra and retrorubral field in the rat. Neuroscience. 2008;152:1024–31. doi: 10.1016/j.neuroscience.2008.01.046. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Swanson LW. The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res Bull. 1982;9:321–53. doi: 10.1016/0361-9230(82)90145-9. [DOI] [PubMed] [Google Scholar]
- 32.Gomez JL, Bonaventura J, Lesniak W, Mathews WB, Sysa-Shah P, Rodriguez LA, et al. Chemogenetics revealed: DREADD occupancy and activation via converted clozapine. Science. 2017;357:503–7. doi: 10.1126/science.aan2475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kelley AE, Berridge KC. The neuroscience of natural rewards: relevance to addictive drugs. J Neurosci. 2002;22:3306–11. doi: 10.1523/JNEUROSCI.22-09-03306.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Meyer PJ, King CP, Ferrario CR. Motivational processes underlying substance abuse disorder. Curr Top Behav Neurosci. 2016;27:473–506. doi: 10.1007/7854_2015_391. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Berridge KC. From prediction error to incentive salience: mesolimbic computation of reward motivation. Eur J Neurosci. 2012;35:1124–43. doi: 10.1111/j.1460-9568.2012.07990.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Trevitt JT, Lyons M, Aberman J, Carriero D, Finn M, Salamone JD. Effects of clozapine, thioridazine, risperidone and haloperidol on behavioral tests related to extramyramidal motor function. Psychopharmacology. 1997;132:74–81. doi: 10.1007/s002130050322. [DOI] [PubMed] [Google Scholar]
- 37.MacLaren DA, Browne RW, Shaw JK, Krishnan Radhakrishnan S, Khare P, Espana RA, et al. Clozapine N-oxide administration produces behavioral effects in long-evans rats: implications for designing DREADD experiments. eNeuro. 2016;3:e0219_16:016 1–14. [DOI] [PMC free article] [PubMed]
- 38.López AJ, Kramár E, Matheos DP, White AO, Kwapis J, Vogel-Ciernia A, et al. Promoter-specific effects of DREADD modulation on hippocampal synaptic plasticity and memory formation. J Neurosci. 2016;36:3588–99. doi: 10.1523/JNEUROSCI.3682-15.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Buchta WC, Mahler SV, Harlan B, Aston‐Jones GS, Riegel AC. Dopamine terminals from the ventral tegmental area gate intrinsic inhibition in the prefrontal cortex. Physiol Rep. 2017;5:e13198. doi: 10.14814/phy2.13198. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.