Abstract
Motivation to work for potential rewards is critically dependent on dopamine (DA) in the nucleus accumbens (NAc). DA release from NAc axons can be controlled by at least two distinct mechanisms: (1) action potentials propagating from DA cell bodies in the ventral tegmental area (VTA), and (2) activation of β2* nicotinic receptors by local cholinergic interneurons (CINs). How CIN activity contributes to NAc DA dynamics in behaving animals is not well understood. We monitored DA release in the NAc Core of awake, unrestrained rats using the DA sensor RdLight1, while simultaneously monitoring or manipulating CIN activity at the same location. CIN stimulation rapidly evoked DA release, and in contrast to slice preparations, this DA release showed no indication of short-term depression or receptor desensitization. The sound of unexpected food delivery evoked a brief joint increase in CIN population activity and DA release, with a second joint increase as rats approached the food. In an operant task, we observed fast ramps in CIN activity during approach behaviors, either to start the trial or to collect rewards. These CIN ramps co-occurred with DA release ramps, without corresponding changes in the firing of lateral VTA DA neurons. Finally, we examined the effects of blocking CIN influence over DA release through local NAc infusion of DHβE, a selective antagonist of β2* nicotinic receptors. DHβE dose-dependently interfered with motivated approach decisions, mimicking the effects of a DA antagonist. Our results support a key influence of CINs over motivated behavior via the local regulation of DA release.
Research organism: Rat
Introduction
Obtaining rewards typically takes work: time-consuming sequences of unrewarded actions before the reward is reached. Deciding when such work is worthwhile is an essential aspect of adaptive behavior. Dopamine (DA) in the nucleus accumbens (NAc) is a critical modulator of such motivated decision-making (Berke, 2018; Salamone and Correa, 2012), especially choices to approach potential rewards (Ikemoto and Panksepp, 1999; Nicola, 2010). Yet how NAc DA release is itself dynamically regulated to achieve appropriate motivation is not well understood.
Some features of DA release mirror the spiking of DA cell bodies. Burst firing (or strong artificial stimulation) of ventral tegmental area (VTA) DA cell bodies is accompanied by a corresponding pulse of NAc DA release (Mohebi et al., 2019; Phillips et al., 2003; Suaud-Chagny et al., 1992). This pulse can encode reward prediction error (RPE), an important learning signal (Schultz et al., 1997). Other aspects of DA release appear to be dissociated from spiking. Enhancing motivation by increasing reward availability does not change VTA DA cell firing rates (Cohen et al., 2012; Mohebi et al., 2019), but does boost NAc Core DA levels, as measured on a time scale of minutes by microdialysis (Hamid et al., 2016; McCullough and Salamone, 1992). On faster time scales (seconds), many groups have reported ramps in NAc DA as animals approach rewards (Hamid et al., 2016; Howe et al., 2013; Roitman et al., 2004; Wassum et al., 2012). These ramps may reflect discounted estimates of future reward (value), a useful motivational signal. Yet we found no evidence for corresponding ramps in spiking rate among identified DA cells in the lateral VTA (Mohebi et al., 2019), which provide the major DA input to NAc Core (Breton et al., 2019).
An alternative means of controlling DA release involves local circuit components within the NAc (Sulzer et al., 2016). Prominent among these are cholinergic interneurons (CINs) which, despite constituting only 1–2% of striatal neurons, provide a very dense network of fibers releasing acetylcholine (ACh) intermeshed with the DA axon network (Descarries et al., 1996). DA axons possess nicotinic ACh receptors (nAChRs) that specifically contain the β2 subunit (β2*; Jones et al., 2002). Activation of nAChRs is sufficient to locally evoke action potentials in DA axons, and consequent DA release, even in the absence of DA cell bodies (Liu et al., 2022; Threlfell et al., 2012; Cachope and Cheer, 2014; Zhou et al., 2001).
Yet how CINs contribute to NAc DA dynamics in behaving animals is largely unknown. Slice studies suggest that DA release is evoked only by highly synchronous activation of multiple CINs (Threlfell et al., 2012), as might occur in response to a salient cue (Kimura et al., 1984). Furthermore, DA release in slices shows a lack of summation to repetitive CIN stimulation (Threlfell et al., 2012) and strong paired-pulse depression (Cachope et al., 2012; Wang et al., 2014). This is apparently due to rapid desensitization of nAChRs (Giniatullin et al., 2005; Quick and Lester, 2002) and feedback inhibition of CINs via DA D2 receptors (Shin et al., 2017). These features might limit the ability of CINs to sculpt motivation-related DA release, including ramping. Furthermore, results on CIN contributions to motivation are mixed. Suppression of CINs has been reported to produce a depression-like state in some behavioral tests (Warner-Schmidt et al., 2012) but to boost motivation in others (Collins et al., 2019).
We examined the relationships between CIN activity, DA release, and motivation. We took advantage of recent advances in optical DA sensors (Patriarchi et al., 2020) and a specific operant task in which we previously found a dissociation between DA spiking and release (Mohebi et al., 2019). We report that CINs can indeed control DA release in awake behaving animals, but with quite distinct temporal characteristics compared to slices. We find that CIN population activity ramps up during approach behaviors in parallel with DA ramps. Furthermore, selective pharmacological blockade of NAc β2* nAChRs interferes with motivated approach, as does blockade of DA receptors. Our results provide convergent evidence supporting the possibility that CINs are a key mechanism regulating motivation via local control of DA release.
Results
ACh reliably drives DA release in NAc, without rapid depression
To study the rapid influence of CINs over striatal DA release in freely moving animals, we employed an all-optical approach. We expressed the excitatory opsin ChR2 in NAc CINs, using ChAT-Cre rats (Witten et al., 2011) and Cre-dependent expression from a virus (AAV5::DIO::EF1a::ChR2::eYFP). In the same region, we expressed the red-shifted DA sensor RdLight1 (Patriarchi et al., 2020) using another virus (AAV-DJ::CAG::RdLight1). We recorded DA release dynamics by fiber photometry while driving CINs through the same fiber, in awake unrestrained rats not performing any particular task (Figure 1a). CIN stimulation immediately increased the DA signal, and this increase was maintained as long as stimulation was applied (up to 4 s; Figure 1b and c). In contrast to results in slices (Threlfell et al., 2012), the amplitude of DA release scaled with the duration and frequency of laser pulses (Figure 1d and e). CIN-evoked DA release remained robust to the second of a pair of pulses across a range of inter-pulse intervals (Figure 1f), indicating that neither the directly evoked ACh release nor the consequent DA release show rapid synaptic depression in behaving animals (see also Collins et al., 2019 for related results with choline measurements). To assess short-term plasticity at higher stimulation frequencies, we conducted an additional quantitative analysis (Koester and Sakmann, 2000; ). We compared the observed DA response to four CIN stimulation pulses to that predicted by linearly summating the response to a single pulse, four times. Regardless of stimulation frequency, the ratio between observed and predicted peak response remained close to 1 (Figure 1—figure supplement 1), confirming the absence of short-term depression in CIN-evoked DA release.
Figure 1. Cholinergic interneuron (CIN) stimulation drives dopamine (DA) release in freely moving rats.
(a) Rat brain atlas section (Paxinos and Watson, 2006) showing the approximate location of fiber tips. (b) Representative traces of DA release (565 nm excitation, red) and isosbestic control (405 nm, purple), recorded from the location marked by a triangle in (a). Laser stimulation was delivered as two trains of pulses (470 nm, 10 mW, 4 ms, 16 Hz). Scale bars: 1 s, 1% dF/F. (c) Top: example session showing DA release in response to 16 Hz optogenetic stimulation of nucleus accumbens (NAc) CINs, with 1, 4, 16, 32, or 64 pulses, in pseudo-random order. Dashed lines demarcate trials with similar stimulation parameters. Bottom: normalized dF/F from RdLight aligned to the first pulse in a train of laser stimulation of NAc CINs (Stim parameters: 4 ms pulse, 16 Hz, 10 mW; n = 4 rats). Band shows ± SEM. dF/F traces for each recording were normalized to the maximum response evoked by 64 stimulation pulses. (d) DA release in response to a single laser pulse of varying duration (1, 2, 4, 6 ms) at 10 mW. Responses are normalized to 1 ms width evoked response for each subject and averaged. Band shows ± SEM. The magnitude of DA release depends on the pulse width (ANOVA: F(3,12) = 5.52, p=0.013). (e) DA release in response to four laser pulses (4 ms) of varying frequency (4, 8, 16 Hz; all 10 mW). Release patterns are normalized to the single pulse response of the same width and power for each subject, and averaged. Band shows ± SEM. The magnitude of DA release depends on the frequency of stimulation (bottom, ANOVA: F(3,12) = 9.17, p=0.002). (f) Paired-pulse ratio test: DA release patterns in response to a pair of 4 ms, 10 mW pulses. A two-way ANOVA revealed that there was no statistically significant interaction between the pulse order (first or second) and the delay between two pulses (F(2,6) = 1.05, p=0.35), and there were no main effects of inter-pulse interval (p=0.47) or pulse order (p=0.06).
Figure 1—figure supplement 1. No evidence for short-term depression of cholinergic interneuron (CIN)-evoked dopamine (DA) release even at high stimulation frequencies.
CIN activity and DA release each respond to reward-related cues and ramp up during motivated approach
We next examined how CIN activity and DA release co-vary in freely moving rats. We expressed the Ca2+ indicator GCaMP6f in CINs (AAV5::Syn::Flex::GCaMP6f) and RdLight1 in the same area (AAV-DJ::CAG::RdLight1). This allowed us to monitor DA release and CIN Ca2+ dynamics through the same fiber (Figure 2a). CIN activity and DA release showed distinct time courses (Figure 2b), but both showed rapid increases in response to the unexpected sound of reward delivery (food hopper ‘Click,’ occurring at random intervals drawn from a uniform distribution of 15–30 s). After delivery, rats took a variable amount of time to collect the food rewards, allowing us to distinguish between neural changes associated with the sensory cue and those associated with the subsequent food retrieval. Aligning signals on food port entry revealed that both CIN GCaMP and DA release rapidly ramped up as rats approached the food port (Figure 2c and d).
Figure 2. Cholinergic interneuron (CIN) activity and dopamine (DA) release similarly respond to reward delivery and ramp up with the reward approach.
(a) Dual-color photometry of CIN activity and DA fluctuations measured simultaneously through the same fiber. The locations of recording fiber tips are shown projected onto the nearest rat brain atlas section (Paxinos and Watson, 2006). (b) Example of simultaneous recording of spontaneous activity, from the triangle location in (a). Green: CIN GCaMP6f signal (excitation: 470 nm); red: RdLight1 (565 nm); purple: isosbestic control (405 nm). Dashed lines: unexpected food hopper clicks, delivering a sucrose pellet. Inset shows a zoomed-in epoch around a reward click. Note that CIN GCaMP and DA signals are distinct: transients in one signal are not always accompanied by transients in the other. Scale: 1% dF/F, 5 s. (c) A representative session with simultaneous CIN GCaMP6f and RdLight1 recording, aligned to hopper clicks. Trials are sorted by the reward collection time (the black dot indicates food-port entry). Both CIN activity and DA fluctuations show a rapid response to the click, and a separate ramping increase during the food-port approach is apparent for longer collection times. Color scale indicates z-scored signal range. (d) Top: average traces showing CIN activity and DA fluctuations aligned to the hopper click, peak responses (within 1 s from click) significantly differed from peak values aligned to random time points in the task (n = 1000 shuffles). Bottom: the slope of the signal ramps was significantly different from ramp slopes aligned to random time points throughout the session. The slope was determined by fitting a line that connects the maximum and minimum signal, 0.5 s before the food-port entry. Filled gray rectangles show chance levels (95% confidence ranges, from 1000 shuffles).
CIN ramps can account for DA release ramps in the absence of DA firing changes
We next turned to a trial-and-error operant task, in which we have previously observed increases in NAc DA release during motivated approach (Hamid et al., 2016) without apparent increases in DA cell firing (at least in the lateral VTA; Mohebi et al., 2019). In brief, each trial starts with the illumination of a center port (Figure 3a). To obtain sucrose pellet rewards, rats approach and place their nose in this center port, and wait for a variable period (500–1500 ms) until an auditory Go cue. They then nose-poke an adjacent port to the left or right. These left/right choices are probabilistically rewarded (10, 50, or 90%, probabilities change independently after blocks of 35–45 trials). Rewarded trials are made apparent by a hopper click, after which rats approach the food port to collect the pellets (Figure 3b).
Figure 3. In an operant task, cholinergic interneuron (CIN) activity and dopamine (DA) release ramp up without corresponding increases in ventral tegmental area (VTA) DA cell firing.
(a) Illustration at top: trial initiation involves an approach to an illuminated center port. Data panels: upper and middle data rows: previously reported (Mohebi et al., 2019) spiking of identified lateral VTA DA cells (n = 29) and dLight DA signals (n = 10). Lower row shows CIN GCaMP signals (n = 8). Each panel shows a representative single example on top and the population average on the bottom. Shading indicates ± SEM. (b) Same as (a), but for the approach to the food port following the food delivery Click! sound, on rewarded trials. (c) Quantification of slopes during approach. Data points indicate individual DA neurons (top) or fiber placements (middle, bottom). Filled gray rectangles show chance levels (95% confidence ranges, from 1000 shuffles).
To assess whether ramps in CIN activity might provide the ‘missing’ control of DA release without changes in DA cell firing, we recorded CIN GCaMP6f signals. We compared these to previously obtained data of VTA DA cell firing and NAc DA release (Mohebi et al., 2019). To help disentangle signals related to sensory cue onset versus approach behavior, we examined trials in which light-on and center-in are more than 1 s apart (i.e., ‘latency’ > 1 s). We measured ramping as the slope of the signal in the last 0.5 s before approach completion. We compared these slopes to a 95% confidence interval generated by measuring slopes at random times during the task (1000 shuffles). None of the optogenetically identified lateral VTA DA cells (0/29) showed significant ramps preceding center-in, but ramps were reliably observed in both DA release (10/10 fiber placements in seven rats) and CIN GCaMP (7/8 fiber placements, five rats). Repeating the same analysis for the food-port-in event produced significant ramping up for none of the 29 DA cells (one ramped down instead), but virtually all recordings of DA release (9/10) and CIN GCaMP (8/8) recordings. These observations are consistent with the hypothesis that ramps in NAc DA release are sculpted via CIN activity rather than DA cell firing.
Motivated approach relies on NAc β2-containing nicotinic receptors
If NAc CINs directly act upon nearby axons to boost DA release and thereby enhance approach behaviors, such behavior should be sensitive to the blockade of the relevant nAChRs. We tested this in the trial-and-error task, using local drug infusions into the NAc Core (bilaterally, volume 0.5 µl/side). On consecutive days, rats received either aCSF (vehicle), DHβE (selective antagonist of β2* nAChRs [Changeux, 2018; Picciotto et al., 2012]; 15 or 30 µg/side), or flupenthixol, a non-selective D1 and D2 DA receptor antagonist (FLU; 10 µg/side), 10 min before beginning the task. The drug treatment order was randomly assigned and counterbalanced across rats.
Blockade of β2* nAChRs reduced the number of completed trials in a dose-dependent manner, similarly to (though not as strongly as) FLU (Figure 4b). Both FLU and the higher dose of DHβE increased the latency to initiate a trial (Figure 4c). Specifically, both the higher dose of DHβE and FLU decreased the instantaneous likelihood (hazard rate) of decisions to approach the center port, shortly after the center port became illuminated (Figure 4d). These observations are consistent with our prior finding that bidirectional optogenetic manipulations of dopamine affect approach hazard rates during the same period (Hamid et al., 2016) and support the hypothesis that nAChR-mediated DA release in NAc is involved in the motivation to work.
Figure 4. Blocking nucleus accumbens (NAc) dopamine or β2* nicotinic receptors diminishes motivation to work in the operant task.
(a) Placement of infusion cannula tips (circles) in NAc Core, based on postmortem histology. (b). The number of trials completed during a 2 hr Bandit session compared to the veh session. F(3,36) = 24.64, p<7.6 × 10–9. Rats treated with DHβE-30 µg and FLU completed fewer trials compared to the vehicle session (p<0.013, p<1 × 10–9, respectively). DHβE-15µg treatment caused a trend toward fewer completed trials (p=0.074) (c). Cumulative distribution of long latencies (latency >1 s) for different treatment conditions, binned at 250 ms. Filled circles denote statistical differences from the Vehicle condition (p<0.01). (d) The hazard rate of long latencies for different condition treatments demonstrates that blocking nicotinic transmission decreases the likelihood of a self-initiated approach (between 1 and 2 s from light-on) in a dose-dependent manner. Filled circles denote statistical differences from the veh condition (p<0.01).
Discussion
Local regulation of striatal DA by ACh has long been established in brain slices (Giorguieff et al., 1976). However, how this influence shapes DA signals in vivo has remained obscure. As a result, cholinergic modulation of DA release has not typically been incorporated into functional accounts of DA dynamics (Berke, 2018), which have instead emphasized the faithful transmission of RPEs encoded in DA cell spiking. An accurate characterization of local modulation of NAc DA in behaving animals is essential not simply for understanding the neural control of motivation, but also altered physiological states evoked by disorders or abused drugs (notably, nicotine).
Seminal slice studies reported that while CINs can profoundly influence DA release via β2* nicotinic receptors, this effect shows strong short-term depression that can take minutes to recover (Cachope et al., 2012; Threlfell et al., 2012). If these desensitizing mechanisms apply in the awake behaving case, we might expect little functional contribution of CINs to DA signaling, and that stimulating CINs would not evoke appreciable extra DA release. Our results clearly demonstrate otherwise: stimulating CINs evoked strong DA release in a frequency-dependent manner, with no evidence of depression. This result both confirms the presence of powerful ACh modulation of DA release under physiological conditions and demonstrates that this modulation has the dynamic range to be a major, continuing influence over behaviorally relevant DA signals.
What can explain the discrepancy between ex vivo and in vivo experiments? One possibility involves the very different conditions for acetylcholinesterase (AChE), an enzyme that provides critical constraints over ACh signaling dynamics. AChE functions very rapidly, almost approaching the rate of ACh diffusion (Dvir et al., 2010; Quinn, 1987), but this rate will be slower at the lower temperature of slice experiments compared to whole animals. Furthermore, AChE is soluble in the extracellular matrix (Sirviö et al., 1989), and so can be partly washed away in the slice preparation. Taken together, released ACh in the slice may escape degradation in the synaptic space for longer than normal, and thereby provoke desensitization of a larger proportion of nAChRs.
One of the most prominent reported features of striatal CINs is a reliable pause in response to reward-predicting cues, in contrast to DA release (Morris et al., 2004). However, at least in NAc we found that both DA release and CIN activity increase rapidly in response to such cues (see also Atallah et al., 2014; Howe et al., 2019). Of course, bulk CIN GCaMP signals are at best an incomplete readout of either CIN firing or the spatiotemporal dynamics of ACh release. In particular, imaging of CINs GCaMP in the dorsal striatum found a mismatch between signals at cell bodies and the rest of the field of view (considered to be neuropil; Rehani et al., 2019). Understanding whether control of DA release via nAChRs directly reflects CIN firing will require more experiments adding either optogenetic tagging of CINs (Duhne, 2022) or high-resolution voltage imaging (Piatkevich et al., 2019). One related important direction for future studies is to understand why some transient fluctuations in CIN activity evoke DA release (Liu et al., 2022) but others do not (e.g., Figure 2b).
In animals performing an operant task, we demonstrated a correspondence between increasing ramps in NAc DA release during motivated approach and increasing NAc CIN activity (measured with GCaMP), at times when VTA DA cell firing is not increasing. This observation supports the idea that CINs can drive behaviorally relevant DA release even in the absence of DA firing changes. We further showed that, in the same task, interfering with NAc β2* nAChRs reduces the likelihood that rats perform the motivated approach behavior. However, one limitation of this study is that we did not causally establish that CINs are directly driving DA release, via β2* nAChRs, at the specific moments of DA ramping during approach. In subsequent studies, we hope to do this through combined local pharmacology, optogenetics, and photometry in behaving animals, as technical advances permit. Designing a conclusive manipulation experiment is not trivial; for example, if CINs tonically promote DA release, simple suppression of CINs could interfere with DA ramps during approach, even if CINs do not normally drive ramping.
Given that ACh can promote NAc DA release and thereby motivation, a continuing conundrum is to explain long-standing evidence for opposing roles for striatal DA and ACh in behavioral control (Mcgeer et al., 1961; Hikida et al., 2001; Collins et al., 2019). One potentially relevant behavioral dimension is whether actions are prompted by external events versus being ‘self-initiated.’ Increases in both (presumed) CIN activity and striatal DA release have been reported in conjunction with self-timed actions (e.g., Lee et al., 2006; Hamilos et al., 2021). This seems consistent with our observation of prominent joint DA and CIN activity ramps in longer-latency trials in our operant task, where rats are not simply reacting to the trial start light, but rather approaching at a variable time after its onset. However, if CIN control of NAc DA release is always important for self-initiated, motivated behavior, DHβE should suppress the hazard rate of approach across a wide range of delays after the light onset. In fact, both DHβE and FLU particularly depressed approach behavior in the 1–3 s range after light onset, with the hazard rate returning to control levels by ~4 s (Figure 4d). This suggests that the NAc joint ACh-DA mechanisms investigated here may be particularly involved in deciding whether it is worthwhile reorganizing ongoing behavior to respond to an external cue (Blazquez et al., 2002).
Finally, if CINs do indeed help locally sculpt motivational aspects of DA release, a natural question becomes how relevant CIN signals are themselves generated. CINs receive inputs from a wide range of areas that can supply motivational information and influence DA release, including the basolateral amygdala (Floresco et al., 1998), parafascicular thalamus (Bradfield et al., 2013), frontal cortex (Kosillo et al., 2016), and long-range GABAergic subpopulations in the VTA (Al-Hasani et al., 2021; Brown et al., 2012). They also sample the state of surrounding networks of striatal projection cells, allowing them to potentially extract useful decision variables (Franklin and Frank, 2015). Resolving how motivational signals are computed remains an ongoing challenge, but monitoring and manipulating each of these various circuit components within the same behavioral context is a promising approach.
Methods
Key resources table.
| Reagent type (species) or resource | Designation | Source or reference | Identifiers | Additional information |
|---|---|---|---|---|
| Strain, strain background (LE rats, both male and female) | ChAT-Cre, Long-Evans (male and female rats) | RRRC | Long-Evans-Tg(ChAT-Cre)5.1Deis | |
| Recombinant DNA reagent | AAV5-EF1a-DIO- ChR2-eYFP | Addgene | Cat# 20298-AAV5 | |
| Recombinant DNA reagent | pAAV.Syn.Flex.GCaMP6f.WPRE.SV40 | Addgene | Cat# 100833-AAV5 | |
| Recombinant DNA reagent | AAV-CAG-RdLight1 | Patriarchi et al., 2020 | ||
| Chemical compound, drug | DHβE | Tocris Bioscience | Cat# 2349 | |
| Chemical compound, drug | Flupenthixol | Sigma-Aldrich | CAS# 51529-01-2 | |
| Software, algorithm | MATLAB | MathWorks, Inc. | ||
| Software, algorithm | LabView | National Instruments |
Animals
In the conduct of this study, the animals involved were accommodated at the University of California San Francisco (UCSF) Animal Research Facility, which is accredited by AAALAC (#001084). The facility strictly adheres to institutional, federal, and AAALAC guidelines to ensure the highest standards of animal care. Procedures such as euthanasia for perfusion fixation were performed under profound anesthesia to minimize discomfort. The use of animals in this study was in strict compliance with the Public Health Service Policy on Humane Care and Use of Laboratory Animals. The UCSF Institutional Animal Care and Use Committee granted approval for this study (protocol # AN196232-01B). Furthermore, UCSF holds a PHS-approved Animal Welfare Assurance D16-00253/A3400-01, further affirming our commitment to ethical animal use.
Behavioral task
Rats were trained in the operant ‘bandit’ task described in detail previously (Hamid et al., 2016; Mohebi et al., 2019). Reward probabilities for left and right choices were pseudorandomly chosen from 10, 50, or 90% for blocks of 35–45 trials, over an ~2 hr session. Procedural errors (e.g., failure to hold until the Go cue) resulted in illumination of the house light and a timeout period of 1.5 s.
Photometry and optogenetic stimulation
We used a viral approach to express the genetically encoded optical DA sensor RdLight1 and the Ca2+ indicator GCaMP6f. Under isoflurane anesthesia, a 1 μl cocktail of AAV-DJ-CAG-RdLight1 and AAV5-Syn-Flex-GCaMP6f was slowly (100 nl/min) injected (Nanoject III, Drummond) through a glass micropipette targeting nucleus accumbens: (AP: 1.7, ML: 1.7, DV: 7.0 mm relative to bregma). During the same surgery, optical fibers (400 μm core, 430 μm total diameter) attached to a metal ferrule (Doric) were inserted (target depth 200 μm higher than AAV) and cemented in place. Data were collected >3 wk later, to allow for transgene expression. We used time-division multiplexing (Akam and Walton, 2019): green (565 nm), blue (470 nm), and violet (405 nm; isosbestic control) LEDs were alternately switched on and off in 10 ms frames (4 ms on, 6 ms off). Excitation power at the fiber tip was set to 30 μW for each wavelength. Both excitation and emission signals passed through minicube filters (Doric), and bulk fluorescence was measured with a femtowatt detector (Newport, Model 2151) sampling at 10 kHz. The separate signals were then rescaled to each other via a least-square fit before analysis.
To combine fiber photometry with optogenetics, we infused a cocktail of AAV-DJ-CAG-RdLight1 and AAV5-EF1a-DIO-ChR2-eYFP into the nucleus accumbens and implanted 400 µm fibers above the infusion site during the same surgery. We used time division multiplexing with interleaved LED illumination (565 nm, 405 nm), as above. We used brief laser pulses (470 nm, 20 mW) to activate ChR2.
Drugs and infusion procedures
Rats were bilaterally infused with either the selective α4β2 nicotinic antagonist DHβE (low dose: 15 µg/0.5 µl/side, high dose 30 µg/0.5 µl/side; Tocris Bioscience, Bristol, UK) the non-selective dopamine receptor antagonist flupenthixol (15 µg/0.5 µl/side; Tocris) or sterile saline (0.5 µl/side), which served as the vehicle control. All rats received all drug infusions, counterbalanced for order. Drugs were infused as described previously (Collins et al., 2016). Briefly, dummies were removed, and injectors were inserted into the guide cannulae protruding 3 mm past the guide tip targeted to the NAc. Using a micro infusion pump (Harvard Apparatus), drugs were infused at a rate of 0.5 µl/min for 1 min. Following a 1 min post-infusion wait time, injectors were removed and dummies inserted. Rats were given 10 min post-infusion before being placed in operant chambers for the bandit task.
Funding Statement
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Contributor Information
Joshua D Berke, Email: joshua.berke@ucsf.edu.
Joseph F Cheer, University of Maryland School of Medicine, United States.
Michael A Taffe, University of California, San Diego, United States.
Funding Information
This paper was supported by the following grants:
National Institute on Drug Abuse R01DA045783 to Joshua D Berke.
National Institute of Neurological Disorders and Stroke R01NS123516 to Joshua D Berke.
National Institute of Neurological Disorders and Stroke R01NS116626 to Joshua D Berke.
National Institute on Alcohol Abuse and Alcoholism R21AA027157 to Joshua D Berke.
National Institute of Mental Health K01MH126223 to Ali Mohebi.
Brain and Behavior Research Foundation NARSAD YIA 29361 to Ali Mohebi.
Additional information
Competing interests
No competing interests declared.
Author contributions
Conceptualization, Data curation, Software, Formal analysis, Funding acquisition, Investigation, Visualization, Methodology, Writing - original draft, Writing - review and editing.
Investigation, Methodology.
Conceptualization, Resources, Data curation, Supervision, Funding acquisition, Investigation, Visualization, Project administration, Writing - review and editing.
Ethics
In the conduct of this study, the animals involved were accommodated at the University of California San Francisco (UCSF) Animal Research Facility, which is accredited by AAALAC (#001084). The facility strictly adheres to institutional, federal, and AAALAC guidelines to ensure the highest standards of animal care. Procedures such as euthanasia for perfusion fixation were performed under profound anesthesia to minimize discomfort. The use of animals in this study was in strict compliance with the Public Health Service Policy on Humane Care and Use of Laboratory Animals. The UCSF Institutional Animal Care and Use Committee granted approval for this study (protocol # AN196232-01B). Furthermore, UCSF holds a PHS-approved Animal Welfare Assurance D16-00253/A3400-01, further affirming our commitment to ethical animal use.
Additional files
Data availability
All data generated or analyzed during this study will be made publicly available on Dryad (http://doi.org/10.7272/dryad.Q68P5XST).
The following dataset was generated:
Mohebi A, Collins VL, Berke JD. 2022. Cholinergic Interneurons and Dopamine in the Nucleus Accumbens. Dryad Digital Repository.
References
- Akam T, Walton ME. pyPhotometry: open source python based hardware and software for fiber photometry data acquisition. Scientific Reports. 2019;9:3521. doi: 10.1038/s41598-019-39724-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Al-Hasani R, Gowrishankar R, Schmitz GP, Pedersen CE, Marcus DJ, Shirley SE, Hobbs TE, Elerding AJ, Renaud SJ, Jing M, Li Y, Alvarez VA, Lemos JC, Bruchas MR. Ventral Tegmental area GABAergic inhibition of cholinergic interneurons in the ventral nucleus accumbens shell promotes reward reinforcement. Nature Neuroscience. 2021;24:1414–1428. doi: 10.1038/s41593-021-00898-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Atallah HE, McCool AD, Howe MW, Graybiel AM. Neurons in the ventral striatum exhibit cell-type-specific representations of outcome during learning. Neuron. 2014;82:1145–1156. doi: 10.1016/j.neuron.2014.04.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berke JD. What does dopamine mean? Nature Neuroscience. 2018;21:787–793. doi: 10.1038/s41593-018-0152-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blazquez PM, Fujii N, Kojima J, Graybiel AM. A network representation of response probability in the striatum. Neuron. 2002;33:973–982. doi: 10.1016/s0896-6273(02)00627-x. [DOI] [PubMed] [Google Scholar]
- Bradfield LA, Bertran-Gonzalez J, Chieng B, Balleine BW. The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. Neuron. 2013;79:153–166. doi: 10.1016/j.neuron.2013.04.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Breton JM, Charbit AR, Snyder BJ, Fong PTK, Dias EV, Himmels P, Lock H, Margolis EB. Relative contributions and mapping of ventral tegmental area dopamine and GABA neurons by projection target in the rat. The Journal of Comparative Neurology. 2019;527:916–941. doi: 10.1002/cne.24572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown MTC, Tan KR, O’Connor EC, Nikonenko I, Muller D, Lüscher C. Ventral Tegmental area GABA projections pause Accumbal cholinergic interneurons to enhance associative learning. Nature. 2012;492:452–456. doi: 10.1038/nature11657. [DOI] [PubMed] [Google Scholar]
- Cachope R, Mateo Y, Mathur BN, Irving J, Wang HL, Morales M, Lovinger DM, Cheer JF. Selective activation of cholinergic interneurons enhances accumbal phasic dopamine release: setting the tone for reward processing. Cell Reports. 2012;2:33–41. doi: 10.1016/j.celrep.2012.05.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cachope R, Cheer JF. Local control of striatal dopamine release. Frontiers in Behavioral Neuroscience. 2014;8:188. doi: 10.3389/fnbeh.2014.00188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Changeux JP. Structural identification of the nicotinic receptor ion channel. Trends in Neurosciences. 2018;41:67–70. doi: 10.1016/j.tins.2017.11.003. [DOI] [PubMed] [Google Scholar]
- Cohen JY, Haesler S, Vong L, Lowell BB, Uchida N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature. 2012;482:85–88. doi: 10.1038/nature10754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins AL, Aitken TJ, Greenfield VY, Ostlund SB, Wassum KM. Nucleus accumbens acetylcholine receptors modulate dopamine and motivation. Neuropsychopharmacology. 2016;41:2830–2838. doi: 10.1038/npp.2016.81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins AL, Aitken TJ, Huang IW, Shieh C, Greenfield VY, Monbouquette HG, Ostlund SB, Wassum KM. Nucleus accumbens cholinergic interneurons oppose cue-motivated behavior. Biological Psychiatry. 2019;86:388–396. doi: 10.1016/j.biopsych.2019.02.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Descarries L, Watkins KC, Garcia S, Bosler O, Doucet G. Dual character, asynaptic and synaptic, of the dopamine Innervation in adult rat neostriatum: a quantitative autoradiographic and immunocytochemical analysis. The Journal of Comparative Neurology. 1996;375:167–186. doi: 10.1002/(SICI)1096-9861(19961111)375:2<167::AID-CNE1>3.0.CO;2-0. [DOI] [PubMed] [Google Scholar]
- Duhne M. Relationships between cholinergic Interneuron spiking and dopamine release in freely behaving rats. Society for Neuroscience Abstracts. 2022;557:24 [Google Scholar]
- Dvir H, Silman I, Harel M, Rosenberry TL, Sussman JL. Acetylcholinesterase: from 3D structure to function. Chemico-Biological Interactions. 2010;187:10–22. doi: 10.1016/j.cbi.2010.01.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Floresco SB, Yang CR, Phillips AG, Blaha CD. Basolateral amygdala stimulation evokes glutamate receptor-dependent dopamine efflux in the nucleus accumbens of the anaesthetized rat. The European Journal of Neuroscience. 1998;10:1241–1251. doi: 10.1046/j.1460-9568.1998.00133.x. [DOI] [PubMed] [Google Scholar]
- Franklin NT, Frank MJ. A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning. eLife. 2015;4:e12029. doi: 10.7554/eLife.12029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Giniatullin R, Nistri A, Yakel JL. Desensitization of nicotinic ACh receptors: shaping cholinergic signaling. Trends in Neurosciences. 2005;28:371–378. doi: 10.1016/j.tins.2005.04.009. [DOI] [PubMed] [Google Scholar]
- Giorguieff MF, Le Floc’h ML, Westfall TC, Glowinski J, Besson MJ. Nicotinic effect of acetylcholine on the release of newly synthesized (3H)dopamine in rat striatal slices and cat caudate nucleus. Brain Research. 1976;106:117–131. doi: 10.1016/0006-8993(76)90077-9. [DOI] [PubMed] [Google Scholar]
- Hamid AA, Pettibone JR, Mabrouk OS, Hetrick VL, Schmidt R, Vander Weele CM, Kennedy RT, Aragona BJ, Berke JD. Mesolimbic dopamine signals the value of work. Nature Neuroscience. 2016;19:117–126. doi: 10.1038/nn.4173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hamilos AE, Spedicato G, Hong Y, Sun F, Li Y, Assad JA. Slowly evolving dopaminergic activity modulates the moment-to-moment probability of reward-related self-timed movements. eLife. 2021;10:e62583. doi: 10.7554/eLife.62583. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hikida T, Kaneko S, Isobe T, Kitabatake Y, Watanabe D, Pastan I, Nakanishi S. Increased sensitivity to cocaine by cholinergic cell ablation in nucleus accumbens. PNAS. 2001;98:13351–13354. doi: 10.1073/pnas.231488998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Howe MW, Tierney PL, Sandberg SG, Phillips PEM, Graybiel AM. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature. 2013;500:575–579. doi: 10.1038/nature12475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Howe M, Ridouh I, Allegra Mascaro AL, Larios A, Azcorra M, Dombeck DA. Coordination of rapid cholinergic and dopaminergic signaling in striatum during spontaneous movement. eLife. 2019;8:e44903. doi: 10.7554/eLife.44903. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ikemoto S, Panksepp J. The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Research. Brain Research Reviews. 1999;31:6–41. doi: 10.1016/s0165-0173(99)00023-5. [DOI] [PubMed] [Google Scholar]
- Jones IW, Bolam JP, Wonnacott S. In: The Basal Ganglia VII. Nicholson LFB, Faull RLM, editors. Boston, MA: Springer US; 2002. Localisation of Neuronal Nicotinic Acetylcholine Receptor Subunits in Rat Substantia Nigra and Dorsal Striatum In; pp. 127–136. [Google Scholar]
- Kimura M, Rajkowski J, Evarts E. Tonically discharging putamen neurons exhibit set-dependent responses. PNAS. 1984;81:4998–5001. doi: 10.1073/pnas.81.15.4998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koester HJ, Sakmann B. Calcium dynamics associated with action potentials in single nerve terminals of pyramidal cells in layer 2/3 of the young rat neocortex. The Journal of Physiology. 2000;529 Pt 3:625–646. doi: 10.1111/j.1469-7793.2000.00625.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kosillo P, Zhang YF, Threlfell S, Cragg SJ. Cortical control of striatal dopamine transmission via striatal cholinergic interneurons. Cerebral Cortex. 2016;26:4160–4169. doi: 10.1093/cercor/bhw252. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee IH, Seitz AR, Assad JA. Activity of Tonically active neurons in the monkey putamen during initiation and withholding of movement. Journal of Neurophysiology. 2006;95:2391–2403. doi: 10.1152/jn.01053.2005. [DOI] [PubMed] [Google Scholar]
- Liu C, Cai X, Ritzau-Jost A, Kramer PF, Li Y, Khaliq ZM, Hallermann S, Kaeser PS. An action potential initiation mechanism in distal axons for the control of dopamine release. Science. 2022;375:1378–1385. doi: 10.1126/science.abn0532. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCullough LD, Salamone JD. Involvement of nucleus accumbens dopamine in the motor activity induced by periodic food presentation: a microdialysis and behavioral study. Brain Research. 1992;592:29–36. doi: 10.1016/0006-8993(92)91654-w. [DOI] [PubMed] [Google Scholar]
- Mcgeer PL, Boulding JE, Gibson WC, Foulkes RG. Drug-induced extrapyramidal reactions. Treatment with diphenhydramine hydrochloride and dihydroxyphenylalanine. JAMA. 1961;177:665–670. doi: 10.1001/jama.1961.03040360001001. [DOI] [PubMed] [Google Scholar]
- Mohebi A, Pettibone JR, Hamid AA, Wong J-MT, Vinson LT, Patriarchi T, Tian L, Kennedy RT, Berke JD. Dissociable dopamine dynamics for learning and motivation. Nature. 2019;570:65–70. doi: 10.1038/s41586-019-1235-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris G, Arkadir D, Nevet A, Vaadia E, Bergman H. Coincident but distinct messages of Midbrain dopamine and striatal tonically active neurons. Neuron. 2004;43:133–143. doi: 10.1016/j.neuron.2004.06.012. [DOI] [PubMed] [Google Scholar]
- Nicola SM. The flexible approach hypothesis: unification of effort and cue-responding hypotheses for the role of nucleus accumbens dopamine in the activation of reward-seeking behavior. The Journal of Neuroscience. 2010;30:16585–16600. doi: 10.1523/JNEUROSCI.3958-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patriarchi T, Mohebi A, Sun J, Marley A, Liang R, Dong C, Puhger K, Mizuno GO, Davis CM, Wiltgen B, von Zastrow M, Berke JD, Tian L. An expanded palette of dopamine sensors for multiplex imaging in vivo. Nature Methods. 2020;17:1147–1155. doi: 10.1038/s41592-020-0936-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paxinos G, Watson C. The Rat Brain in Stereotaxic Coordinates. 6th Edition. Elsevier; 2006. [DOI] [PubMed] [Google Scholar]
- Phillips PEM, Stuber GD, Heien M, Wightman RM, Carelli RM. Subsecond dopamine release promotes cocaine seeking. Nature. 2003;422:614–618. doi: 10.1038/nature01476. [DOI] [PubMed] [Google Scholar]
- Piatkevich KD, Bensussen S, Tseng H-A, Shroff SN, Lopez-Huerta VG, Park D, Jung EE, Shemesh OA, Straub C, Gritton HJ, Romano MF, Costa E, Sabatini BL, Fu Z, Boyden ES, Han X. Population imaging of neural activity in awake behaving mice. Nature. 2019;574:413–417. doi: 10.1038/s41586-019-1641-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Picciotto MR, Higley MJ, Mineur YS. Acetylcholine as a neuromodulator: cholinergic signaling shapes nervous system function and behavior. Neuron. 2012;76:116–129. doi: 10.1016/j.neuron.2012.08.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quick MW, Lester RAJ. Desensitization of neuronal nicotinic receptors. Journal of Neurobiology. 2002;53:457–478. doi: 10.1002/neu.10109. [DOI] [PubMed] [Google Scholar]
- Quinn DM. Acetylcholinesterase: enzyme structure, reaction dynamics, and virtual transition states. Chemical Reviews. 1987;87:955–979. doi: 10.1021/cr00081a005. [DOI] [Google Scholar]
- Rehani R, Atamna Y, Tiroshi L, Chiu W-H, de Jesús Aceves Buendía J, Martins GJ, Jacobson GA, Goldberg JA. Activity patterns in the neuropil of striatal cholinergic interneurons in freely moving mice represent their collective spiking dynamics. ENeuro. 2019;6:ENEURO.0351-18.2018. doi: 10.1523/ENEURO.0351-18.2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roitman MF, Stuber GD, Phillips PEM, Wightman RM, Carelli RM. Dopamine operates as a subsecond modulator of food seeking. The Journal of Neuroscience. 2004;24:1265–1271. doi: 10.1523/JNEUROSCI.3823-03.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salamone JD, Correa M. The mysterious motivational functions of mesolimbic dopamine. Neuron. 2012;76:470–485. doi: 10.1016/j.neuron.2012.10.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science. 1997;275:1593–1599. doi: 10.1126/science.275.5306.1593. [DOI] [PubMed] [Google Scholar]
- Shin JH, Adrover MF, Alvarez VA. Distinctive modulation of dopamine release in the nucleus accumbens Shell mediated by dopamine and acetylcholine receptors. The Journal of Neuroscience. 2017;37:11166–11180. doi: 10.1523/JNEUROSCI.0596-17.2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sirviö J, Rinne JO, Valjakka A, Rinne UK, Riekkinen PJ, Paljärvi L. Different forms of brain acetylcholinesterase and muscarinic binding in Parkinson’s disease. Journal of the Neurological Sciences. 1989;90:23–32. doi: 10.1016/0022-510x(89)90042-7. [DOI] [PubMed] [Google Scholar]
- Suaud-Chagny MF, Chergui K, Chouvet G, Gonon F. Relationship between dopamine release in the rat nucleus accumbens and the discharge activity of dopaminergic neurons during local in vivo application of amino acids in the ventral tegmental area. Neuroscience. 1992;49:63–72. doi: 10.1016/0306-4522(92)90076-e. [DOI] [PubMed] [Google Scholar]
- Sulzer D, Cragg SJ, Rice ME. Striatal dopamine neurotransmission: regulation of release and uptake. Basal Ganglia. 2016;6:123–148. doi: 10.1016/j.baga.2016.02.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Threlfell S, Lalic T, Platt NJ, Jennings KA, Deisseroth K, Cragg SJ. Striatal dopamine release is triggered by synchronized activity in cholinergic interneurons. Neuron. 2012;75:58–64. doi: 10.1016/j.neuron.2012.04.038. [DOI] [PubMed] [Google Scholar]
- Wang L, Zhang X, Xu H, Zhou L, Jiao R, Liu W, Zhu F, Kang X, Liu B, Teng S, Wu Q, Li M, Dou H, Zuo P, Wang C, Wang S, Zhou Z. Temporal components of cholinergic terminal to dopaminergic terminal transmission in dorsal striatum slices of mice. The Journal of Physiology. 2014;592:3559–3576. doi: 10.1113/jphysiol.2014.271825. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Warner-Schmidt JL, Schmidt EF, Marshall JJ, Rubin AJ, Arango-Lievano M, Kaplitt MG, Ibañez-Tallon I, Heintz N, Greengard P. Cholinergic interneurons in the nucleus accumbens regulate depression-like behavior. PNAS. 2012;109:11360–11365. doi: 10.1073/pnas.1209293109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wassum KM, Ostlund SB, Maidment NT. Phasic Mesolimbic dopamine signaling precedes and predicts performance of a self-initiated action sequence task. Biological Psychiatry. 2012;71:846–854. doi: 10.1016/j.biopsych.2011.12.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Witten IB, Steinberg EE, Lee SY, Davidson TJ, Zalocusky KA, Brodsky M, Yizhar O, Cho SL, Gong S, Ramakrishnan C, Stuber GD, Tye KM, Janak PH, Deisseroth K. Recombinase-driver rat lines: tools, techniques, and optogenetic application to dopamine-mediated reinforcement. Neuron. 2011;72:721–733. doi: 10.1016/j.neuron.2011.10.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhou FM, Liang Y, Dani JA. Endogenous nicotinic cholinergic activity regulates dopamine release in the striatum. Nature Neuroscience. 2001;4:1224–1229. doi: 10.1038/nn769. [DOI] [PubMed] [Google Scholar]





