Skip to main content

This is a preprint.

It has not yet been peer reviewed by a journal.

The National Library of Medicine is running a pilot to include preprints that result from research funded by NIH in PMC and PubMed.

bioRxiv logoLink to bioRxiv
[Preprint]. 2024 Jul 13:2024.05.09.593320. Originally published 2024 May 9. [Version 2] doi: 10.1101/2024.05.09.593320

Natural phasic inhibition of dopamine neurons signals cognitive rigidity

Sasha CV Burwell 1,3, Haidun Yan 2,3, Shaun SX Lim 2,3, Brenda C Shields 2,3, Michael R Tadross 1,2,3,*
PMCID: PMC11100816  PMID: 38766037

Abstract

When animals unexpectedly fail, their dopamine neurons undergo phasic inhibition that canonically drives extinction learning—a cognitive-flexibility mechanism for discarding outdated strategies. However, the existing evidence equates natural and artificial phasic inhibition, despite their spatiotemporal differences. Addressing this gap, we targeted a GABAA-receptor antagonist precisely to dopamine neurons, yielding three unexpected findings. First, this intervention blocked natural phasic inhibition selectively, leaving tonic activity unaffected. Second, blocking natural phasic inhibition accelerated extinction learning—opposite to canonical mechanisms. Third, our approach selectively benefitted perseverative mice, restoring rapid extinction without affecting new reward learning. Our findings reveal that extinction learning is rapid by default and slowed by natural phasic inhibition—challenging foundational learning theories, while delineating a synaptic mechanism and therapeutic target for cognitive rigidity.


To thrive, animals must predict and secure essential rewards, such as food and water. When predictions fail, persistence is crucial to overcoming temporary obstacles. However, excess persistence, known as perseveration, is generally maladaptive (1-3).

These processes are often studied using Pavlovian assays in which neutral cues are paired with appetitive rewards. Seminal work using this paradigm established that ventral tegmental area dopamine (VTADA) neurons encode reward prediction error (RPE)—the difference between predicted and actual rewards (4-9). Investigating RPE’s synaptic origins (10-12) revealed that phasic excitation dominates when rewards exceed predictions, producing a burst in VTADA activity (positive RPE). As animals learn to predict rewards, phasic inhibition counteracts reward-evoked excitation (approaching zero RPE). Finally, when a prediction of reward fails, phasic inhibition becomes unopposed, yielding a pause in VTADA activity (negative RPE).

Regarding behavioral roles, the RPE framework has inspired many causal experiments delineating VTADA bursts and pauses as opposing forces. Artificial phasic excitation of VTADA neurons induces bursts that promote Pavlovian conditioning, reinforcing new cue-reward associations (13-21). Conversely, artificial phasic inhibition induces VTADA pauses that drive Pavlovian extinction, suppressing preexisting cue-reward associations (22-24).

However, widefield optogenetic perturbations tend to produce synchronous events that closely resemble natural bursts, where nearly all VTADA cells are recruited simultaneously by an unexpected external event (25-27). By contrast, natural VTADA pauses, signaling the failure of an internally generated prediction, exhibit irregular patterns across cells and time (28). In principle, these spatiotemporally distinct patterns could serve an essential role. For instance, synchronous events might broadcast globally to promote the formation of new synaptic engrams (29), whereas irregular patterns might act locally to update preexisting ones.

Nevertheless, the complexity of natural pauses also complicates their elimination. Widefield optical excitation cannot counteract natural phasic inhibition without producing bursts in cells that would have paused weakly or not at all (28). This concern is compounded by tonic-firing variability, ranging from 0.5 to 10 Hz (5-7), and the sensitivity of extinction learning to the intervention strength, being slowed by 20-Hz (15, 30, 31) but unaffected by 5-Hz (31) optogenetic excitation. While single-cell optogenetics presents a potential solution (32, 33), such precision has yet to be applied to VTADA cells.

In this study, we address the complexity of natural phasic inhibition by shifting the focus from VTADA pauses to their receptor-mediated origin. Specifically, we test the hypothesis that precisely blocking GABAA receptors on VTADA cells would intercept natural phasic inhibitory inputs, slowing the rate of behavioral extinction. While broadly believed to be true, experimental support for this hypothesis has been indirect. Traditional GABAA pharmacology (34) and optogenetic manipulations of GABA release in the VTA (10, 35, 36) support the canonical model, but with the caveat of affecting non-dopaminergic cells that directly impact reward learning (37-40). Knockout mice lacking the GABAA β3 subunit in DA neurons exhibit normal extinction, but chronic compensatory changes were seen even in non-dopaminergic cells (41). To circumvent these issues, we used DART (drug acutely restricted by tethering), a technology enabling cell-specific, receptor-specific manipulations within minutes (42, 43).

GabazineDART is a cell-specific, GABAA receptor-specific antagonist

Our approach capitalizes on DART’s ability to precisely block native GABAA receptors on VTADA neurons. To achieve cellular specificity, we use an AAV (adeno-associated viral vector) to express HTP (HaloTag Protein) exclusively on VTADA cells of DAT::Cre mice. HTP expression is stable and does not alter the physiology of VTADA cells (43). At a later time of interest, we apply gabazineDART, a two-headed ligand whose HTL (HaloTag Ligand) is efficiently captured by HTP, positioning the gabazine moiety to antagonize native GABAA receptors only on VTADA cells (Fig. 1A). We co-deliver gabazineDART with a small amount of Alexa647DART to serve as a fluorescent proxy of drug delivery (Fig. 1A). Control mice are treated identically, except for use of a double-dead HTP (ddHTP), which cannot bind the HTL (Fig. 1B).

Fig. 1: GABAA receptors mediate VTADA pauses in vivo.

Fig. 1:

A: DART technology. AAV expression of the +HTP protein (pink) enables cell-specific covalent capture of gabazineDART (black) and Alexa647DART (cyan) ligands. Once tethered, gabazineDART blocks native GABAA receptors, while Alexa647DART enables fluorescent visualization of target engagement.

B: Example histology. AAV expression of the active +HTP or control ddHTP in VTADA neurons is indicated by dTomato (red). All mice receive an intracranial ligand infusion of 10 μM gabazineDART + 1 μM Alexa647DART, and are perfused 36 hr later for histology. Alexa647DART (cyan) quantifies ligand target engagement.

C: Electrophysiology. Top: an electrode bundle targeting the medial VTA enables in vivo extracellular recordings. A nearby cannula permits ligand infusion. Bottom: sample putative dopamine-neuron spikes, recorded in head-fixed animals, shown for +HTP and ddHTP mice.

D: Pauses in firing: Top: time course of recording, baseline 15-min (pre-gabazineDART) followed by infusion and post-gabazineDART recording. Bottom: pause metric, %PSI (percent of interspike intervals longer than twice the median interspike interval). Changes in %PSI compare a 15-min baseline (%PSIpre) to a 15-min sliding window (%PSIpost) according to Δ%PSInorm=(%PSIpost%PSIpre)/(%PSIpost+%PSIpre). Left: Δ%PSInorm time course, mean ± SEM over cells (n = 18 ddHTP cells, 3 mice; n = 39 +HTP cells, 5 mice). Right: steady-state Δ%PSInorm (1-hr post-gabazineDART) with individual cells (circles), group means (thin horizontal lines), mean-difference bootstrap (pink distribution), and 95% CI of the two-sided permutation test (vertical black bar); +HTP and ddHTP cells differ significantly (P=0.009).

E-F: Burst/tonic firing: Analysis of %SFB (percent of spikes fired in bursts) and FR (firing rate) from the same cells; format as above.

In acute brain slices, dopamine neurons expressing ddHTP were unaffected by gabazineDART, whereas neurons expressing the active +HTP exhibited a rapid and nearly complete block of GABAA-mediated synaptic transmission (Fig. S1A) (43). Regarding receptor specificity, a saturating dose of tethered gabazineDART did not alter excitatory glutamate receptors, nor did it impact the intrinsic pacemaker properties or action-potential waveforms of VTADA cells (Fig. S1B-C). Furthermore, Alexa647DART did not influence VTADA physiology (Fig. S1D). Prior in-vivo tests found no behavioral effects of ambient gabazineDART when infused into the VTA of awake ddHTP mice (43). In +HTP mice, gabazineDART was tethered to VTADA neurons within minutes, with a single dose sufficing for two days of behavior (43). Together, these data validate tethered gabazineDART as a precise, cell-specific antagonist of native GABAA receptors.

GABAA receptors mediate natural phasic inhibition of VTADA neurons in vivo

In principle, GABAA receptors could regulate various aspects of VTADA firing (44). We thus recorded VTADA action potentials in awake, head-fixed mice before and after delivery of gabazineDART (Fig. 1C). We examined a panel of tonic, burst, and pause metrics using a sliding-window analysis spanning pre-gabazineDART (15 min), drug infusion/equilibration (75 min), and post-gabazineDART (15 min) periods. In ddHTP mice, all metrics remained stable throughout the recording, indicating negligible effects of ambient gabazineDART (Fig. S2A).

In comparing +HTP mice to ddHTP controls, we found that gabazineDART substantially reduced the occurrence of spontaneous pauses. The effect is seen most readily in the main pause metric, %PSI, the percent of interspike intervals longer than twice the median interval. This metric was reduced by gabazineDART in +HTP mice relative to ddHTP controls (two-sided permutation test, P=0.009, Fig. 1D). The effect was robust to adjustments in the definition of a pause, and could not be explained by a symmetrical change in interspike-interval variance (Fig. S2B). All other metrics exhibited no significant difference in +HTP vs ddHTP mice (Fig. 1E-F, Fig. S2C-E). Thus, the main effect of gabazineDART is to prevent natural GABAA-mediated VTADA pauses from occurring.

Histology confirmed ligand capture and specificity of viral expression: nearly all HTP expressing cells (99.7%) were dopaminergic and most dopaminergic cells in the VTA (~64%) expressed HTP (Fig. S2F-H). We did not opto-tag cells given concerns that overexpression of a second membrane protein could hinder surface trafficking of HTP. Instead, we identified putative dopamine neurons, as others have (45-47), by their unique electrophysiological features (48, 49), criteria known to yield ~12% false-positives (49).

To further scrutinize the data, we used our manipulation’s impact on pauses as a proxy for HTP expression and gabazineDART capture on individual cells. Reductions in the number of pauses corresponded with a decrease in pause length (Pearson’s r2=0.28, P=0.0006, Fig. S2I), congruent with a pause-reduction effect. By contrast, no correlations were found with respect to burst parameters (Fig. S2J). Similarly, the median interspike interval showed no correlation to pause reduction (Pearson’s r2=0, P=0.95) while total spikes trended very weakly (Pearson’s r2=0.04, P=0.2, Fig. S2K). Thus, the underlying tonic rhythm was unaffected, while subtle total-spike increments are an expected proxy of pause reduction itself.

The absence of even transient changes in tonic firing suggests homeostatic processes operating faster than DART’s 15-min onset, consistent with dynamic setpoint regulation by A-type potassium channels (50). By contrast, millisecond phasic GABA signaling requires postsynaptic GABAA receptors. Thus, gabazineDART selectively blocks phasic inhibition of VTADA neurons while preserving tonic- and burst-firing characteristics.

Blocking GABAA receptors on VTADA cells accelerates Pavlovian extinction

Given that gabazineDART prevents natural VTADA pauses, we expected it to slow extinction learning. We tested this in water-deprived mice, trained for 10 days to associate cue A (2.5 kHz tone, 1.5 sec) with sucrose-water reward in a head-fixed configuration (Fig. 2A-B). Anticipatory licking during the cue (prior to reward delivery) served as the primary learning metric (Fig. 2C-D; Fig. S3A). On day 11, mice received gabazineDART and a 2 hr rest before resuming rewarded cue A trials for 15 min. Thereafter, Pavlovian extinction (unrewarded cue A trials) commenced, continuing into the final day (Fig. 2E-F, top). Contrary to expectations, we saw significantly accelerated extinction in +HTP mice compared to ddHTP controls (P=0.0043, two-sided permutation test, Fig. 2G)—opposite the hypothesized direction of influence.

Fig. 2: Blocking GABAA receptors on VTADA cells accelerates Pavlovian extinction.

Fig. 2:

A: Pavlovian behavior paradigm. DAT::Cre mice with bilateral VTA cannula and +HTP or ddHTP expression in VTADA cells. Mice are head-fixed and presented with auditory cues and sucrose-water rewards. Licks detected with infrared beam; locomotion monitored via circular treadmill.

B: Training regimen. Over 9 days, mice undergo sessions where cue A (2.5 kHz tone, 1.5 sec) reliably signals reward, interspersed with silent trials (no cue, no reward) to monitor nonspecific licking. Licking during the random (3-13 sec) inter-trial interval is discouraged with a timeout, training mice to ignore environmental sounds other than cue A. Each session lasts 1 hour and comprises 100-150 cue A trials.

C: Anticipatory licking. Black line segments show beam breaks (licking) from a sample mouse on days 1 (early), 2 (middle), and 9 (late) of training.

D: Stable baseline. To account for individual-mouse differences, day 10 anticipatory licking to cue A is calculated for each mouse and used as a constant of normalization for that animal. The same normalization constant is applied to cue A trials (top) and silent / cue B trials (bottom). Lines and shading are the normalized anticipatory licking mean ± SEM over mice (n = 12 ddHTP mice; n = 12 +HTP mice).

E-F: Pavlovian learning. On day 11, mice receive gabazineDART and a 2 hr rest. The first ~15 min of the assay continue the prior day’s rules. Following the rule change, unrewarded cue A trials (extinction) are randomly interleaved with rewarded cue B trials (conditioning), contingencies which continue into day 12. Lines and shading are licknorm mean ± SEM over mice (n = 12 ddHTP mice; n = 12 +HTP mice).

G: Extinction AUC (area under the curve; licksnorm × hr), integrating licknorm over 1.75 hr (post rule-change). AUC = 1.75 indicates no extinction (cue A anticipatory licking equal to that on day 10), while smaller values indicate greater extinction. AUC of individual mice (circles), group means (thin horizontal lines), mean-difference bootstrap (pink distribution), and 95% CI of the two-sided permutation test (vertical black bar) indicate a significant difference between +HTP and ddHTP mice (P=0.0043).

H: Conditioning AUC. Format as above, showing cue B conditioning trials from the same mice (P=0.53).

Mice were assayed during their dark (active) circadian phase, each being initially naïve to the task. To avoid frustration from complete reward denial, extinction trials of cue A were randomly interleaved with trials pairing a distinct cue B (11 kHz tone, 1.5 sec) with sucrose-water reward (Fig. 2E-F, bottom), thereby maintaining overall reward availability (51). This design also provided a within-mouse measure of Pavlovian conditioning, canonically driven by VTADA bursts, which we hypothesized would not be impacted by gabazineDART. Confirming this hypothesis, Pavlovian conditioning was unaffected by gabazineDART (P=0.53, +HTP vs ddHTP, two-sided permutation test, Fig. 2H).

During training (days 1-10), we encouraged mice to ignore environmental sounds other than cue A by imposing a timeout for licking during the random (3-13 sec) inter-trial interval (Fig. 2B). This allowed cue B to remain novel (52), while achieving cue discrimination in the majority of mice: 89% (24 of 27) were unresponsive to rare probes of cue B presented on day 10, despite robust anticipatory licking to cue A, thereby satisfying our behavioral inclusion criteria (Fig. S3B).

Finally, after the session on day 12, we performed brain histology on every mouse to quantify target engagement. Locomotor enhancements, known to occur with VTADA disinhibition (43, 53-56), showed no correlation with gabazineDART target engagement, nor with either form of Pavlovian learning (Fig. S3C-E). By contrast, a significant correlation between Pavlovian extinction and gabazineDART target engagement was seen (Pearson’s r2=0.36, P=0.04, Fig. S3F), underscoring its dose-dependency.

VTADA neural activity dynamics during Pavlovian behavior

Given these surprising behavioral findings, we further scrutinized the impact of gabazineDART on VTADA neural dynamics during the Pavlovian assay. Photometry recordings were obtained from medial VTADA neurons that co-expressed HTP and jGCaMP8f (57), a cytosolic protein optimized to detect rapid calcium decrements (Fig. 3A). Histology confirmed fiber placement, AAV co-expression, and ligand capture (Fig. 3B, Fig. S4A). Of 18 mice that met behavioral criteria, 12 mice (6 experimental, 6 control) met a minimum signal-fidelity criterion (Fig. S4B).

Fig. 3: VTADA dynamics during Pavlovian behavior.

Fig. 3:

A: Experimental setup. DAT::cre mice injected with AAV-DIO-GCaMP8f and either AAV-DIO-+HTPGPI or AAV-DIO-ddHTPGPI in the VTA. Cannula and optical fiber implants permit intracranial DART infusions and calcium recording from VTADA neurons throughout the 12-day Pavlovian assay.

B: Example histology. AAV expression of GCaMP8f (green) and the active +HTP or control ddHTP indicated by dTomato (red). All mice receive an intracranial ligand infusion of 10 μM gabazineDART + 1 μM Alexa647DART, and are perfused 36 hr later for histology. Alexa647DART (cyan) quantifies ligand target engagement.

C: Early extinction. GCaMP8f responses in ddHTP (black) vs +HTP (pink) mice during the first four extinction trials. Right: time course of ΔF/F0 mean ± SEM over mice (n = 6 ddHTP mice; n = 6 +HTP mice). Analysis of ΔF/F0 during cue-burst (0 - 1 sec) and omission-pause (1.5 - 3 sec) is plotted in the left panel of corresponding color. Left: individual mice (circles), group means (thin horizontal lines), mean-difference bootstrap (pink distribution), and 95% CI of the two-sided permutation test (vertical black bar). +HTP and ddHTP mice were not statistically different during cue Burst (P=0.115), yet differed significantly during omission-pause (P=0.001).

D: Middle extinction. Format as above, during extinction trials 37 – 40.

Control mice exhibited a canonical VTADA pause to reward omission (Fig. 3C, black data within yellow boxes). These pauses were prominent during early extinction trials and diminished quickly thereafter, aligning with prior studies (31). We thus focused on the first 4 extinction trials and observed the elimination of pauses in +HTP/gabazineDART mice (Fig. 3C, pink data within yellow boxes), with a significant difference from controls (two-sided permutation test, P=0.001, Fig. 3C). In subsequent trials, VTADA pauses diminished in control mice, becoming statistically indistinguishable from manipulated animals (P=0.658, Fig. 3D).

We saw no group differences before ligand infusion, nor post-gabazineDART effects on baseline GCaMP signals (Fig. S4C-E), consistent with the stable tonic firing seen in our electrical recordings (Fig. 1F). Bursts to cue A were not significantly altered (Fig. 3C-D, Fig. S4F-G, gray boxes), also consistent with electrical recordings (Fig. 1E). As reported for unrewarded cues (25), a biphasic burst-pause to cue B appeared during probe (Fig. S4E) and early conditioning (S4H, top); this was unaffected by gabazineDART suggesting no GABAA involvement. During later conditioning, bursts to cue B trended larger but did not reach statistical significance (Fig. S4H, white boxes), consistent with unaltered behavioral conditioning (Fig. 2H).

Our data adhere to the canonical subtractive mechanism of RPE calculation (10), where phasic inhibitory predictions diminish bursts if the predicted reward is received (P=0.034, Fig. S4F, right inset) or produce a pause if the predicted reward is withheld (P=0.001, Fig. 3C). However, this correlative adherence to RPE belies a starkly different causal picture—one in which natural phasic inhibition of VTADA neurons favors persistence over adaptation (Fig. 2).

GabazineDART impacts perseverative, but not flexible, mice

Mice exhibited variable rates of conditioning, which was anti-correlated with extinction in ddHTP controls (Pearson’s r2=0.73, P=0.0004, Fig. 4A, black). We used conditioning, given its insensitivity to gabazineDART, to sort mice into upper and lower halves of this phenotypic spectrum. Slow-conditioning mice exhibited rapid cue A extinction (Fig. 4B, black), whereas fast-conditioning mice perseverated, responding to cue A despite repeated failure (Fig. 4C, black).

Fig. 4: GabazineDART impacts perseverative, but not flexible, mice.

Fig. 4:

A: Phenotypic spectrum. Extinction-AUC vs conditioning-AUC measured within-mouse. Individual mice (squares = males, circles = females), regression fit (line), and regression 95% and 68% CI (light and dark shading) are shown for ddHTP (black, n = 12) and +HTP (pink, n = 12) mice. In ddHTP mice, we observe an anti-correlation wherein fast-conditioning and slow-extinction (upper-right) tend to co-occur (Pearson’s r2 = 0.73, P = 0.0004). In +HTP mice, the full spectrum of conditioning is seen, however extinction is uniformly rapid, independent of conditioning (Pearson’s r2 = 0.07, P = 0.4). Vertical dashed line illustrates the conditioning boundary (AUC = 0.75) chosen to divide mice into the approximate lower and upper halves of the phenotypic spectrum.

B: Slow-conditioning mice. Analysis of mice exhibiting slow conditioning (AUC < 0.75), with conditioning (top) and extinction (bottom). Lines and shading are normalized anticipatory licking, mean ± SEM over mice (n = 7 ddHTP mice; n = 6 +HTP mice);

C: Fast-conditioning mice. Analysis of mice exhibiting fast conditioning (AUC > 0.75), with conditioning (top) and extinction (bottom). Lines and shading are normalized anticipatory licking and mean ± SEM over mice (n = 5 ddHTP mice; n = 6 +HTP mice).

D: Fast-conditioning AUC. Summary data with the slow-conditioning subset of mice removed (faded circles), allowing a focused analysis of the fast-conditioning subset (AUC > 0.75). AUC of individual mice (circles), group means (thin horizontal lines), mean-difference bootstrap (pink distribution), and 95% CI of the two-sided permutation test (vertical black bar) indicate that +HTP and ddHTP differ significantly with regard to extinction learning (P=0.001).

GabazineDART eliminated perseveration in the fast-conditioning subset of mice, selectively accelerating extinction (P=0.001, two-sided permutation test, Fig. 4D, bottom) without altering their naturally fast conditioning (P=0.8, Fig. 4D, top). When administered to the other phenotypic category of mice, gabazineDART had little impact on either form of Pavlovian learning (Fig. 4B). Overall, gabazineDART caused extinction to become uniformly rapid across the phenotypic spectrum, eliminating its anti-correlation with conditioning (Pearson’s r2=0.07, P=0.4, Fig. 4A, pink). Consequently, a unique phenotype not seen in the control population emerged—mice adept at both rapid conditioning and rapid extinction (Fig. 4C, pink).

We did not observe trending sex differences (Fig. 4A), nor patterns in randomly interleaved trials that could explain phenotypic differences (Fig. S5A), consistent with previously reported intrinsic trait variability (58, 59). Initial training rates, which can be obscured by variability in task familiarization, did not predict later phenotypes (Fig. S5B). By contrast, we consistently observed the same phenotypic anti-correlation across a larger set of 25 mice pooled from the control arms of ongoing studies (Fig. S5C). This underscores the unique rapid-conditioning / rapid-extinction phenotype produced by VTADA-specific GABAA antagonism (Fig. 4C, pink).

Discussion

The notion that learning is amplified by surprise is a central tenet in behavioral neuroscience. Canonically, surprise produces phasic dopamine signals that enhance cognitive flexibility, driving rapid learning, while tonic dopamine serves primarily as a baseline. Here, we reveal a fundamental inversion of these roles. Our finding that tonic dopamine allows rapid extinction learning aligns with a recent study suggesting that animals exhibit a default learning rate in the absence of phasic dopamine fluctuations (21). However, their focus on phasic excitation only allowed for transient increases above this default learning rate. Our study extends these findings by revealing that natural phasic inhibition can transiently slow the learning rate well below its default. Rather than conveying surprise, which enhances cognitive flexibility, we propose that natural phasic inhibition acts as a cognitive-rigidity signal, triggering skepticism toward new evidence that conflicts with prior expectations.

Two technical considerations arise from our findings. First, while our approach is specific to GABAergic over glutamatergic inputs, it remains unclear which subset of GABAergic inputs encodes the cognitive-rigidity signal. Given the importance of postsynaptic VTADA specificity to our findings, new tools must be developed to maintain this feature while refining input specificity—a constraint beyond the capability of existing tools (43). Second, since gabazineDART and excitatory optogenetics both counteract phasic inhibition of VTADA neurons, their opposite behavioral effects merit discussion. Early studies using 20-Hz optogenetic excitation to overpower natural phasic inhibition induced artificial bursts, driving conditioning that could be mistaken for slowed extinction. Efforts to mitigate this confound by using 5-Hz excitation still induce artificial bursts that could obscure measures of extinction, consistent with the reported lack of behavioral effects (31). Thus, despite similar population-average effects, adding an artificial signal is not the same as blocking a natural one.

The sensitivity of behavior to VTADA activity patterns suggests that the brain could employ a vocabulary of patterns for different forms of learning. For instance, optogenetic inhibition of VTADA cells (22-24) resembles mildly aversive air puffs (10-12): both are unexpected external events that induce synchronous phasic inhibition of VTADA neurons, without the need for prior training. By contrast, our study examines phasic inhibition tied to appetitive reward omission, which exhibits complex spatial and temporal patterns (28), stems from distinct presynaptic origins (11, 12, 60), and requires prior training (31, 61). These two patterns of phasic inhibition may engage different dopamine-dependent plasticity rules (31, 62-64) with distinct objectives. Synchronous pauses may signal aversive surprise (10-12, 65), enhancing cognitive flexibility to predict and avoid future air puffs. Irregular pauses may signal cognitive rigidity—driving persistence despite failure.

A persistence mechanism can be adaptive in moderation (31, 61), but may become maladaptive, leading to perseveration as seen in schizophrenia (66), obsessive-compulsive disorder (67), addiction (68), and Parkinson’s disease (PD) (69). While many of these disorders have been characterized as hyper- or hypo-dopaminergic, our study shows that subtle changes in dopamine-neuron activity can have an outsized effect on behavior. This raises the question of whether modulating specific phasic components of dopamine signaling could offer a better therapeutic profile than current treatments that modulate dopamine signaling globally and continuously. While much remains to be done, the precision of gabazineDART, both in its specificity for extinction over conditioning behaviors and for perseverative over non-perseverative individuals, underscores the potential of targeted synaptic interventions for treating neurological disorders within a diverse population (70).

METHODS

Mice —

DAT-IRES-Cre (Jackson Labs 006660) mice were group housed by age and sex (max 5 per cage) in a standard temperature and humidity environment. For breeding, mice were housed under a normal 12-hr light/dark cycle and with food and water provided ad libitum. Experimental mice were transitioned to reverse-light-cycle and water-restriction conditions, as detailed below. All experiments involving animals were approved by the Duke Institutional Animal Care and Use Committee (IACUC), an AALAC accredited program registered with both the USDA Public Health Service and the NIH Office of Animal Welfare Assurance, and conform to all relevant regulatory standards (Tadross protocols A160-17-06, A113-20-05, A091-23-04).

Recombinant Adeno-associated Viral (rAAV) Vectors —

All custom viral vectors were produced by the Duke Viral Vector Core or VectorBuilder, kept frozen at −80°C until use, then diluted to the desired titers using sterile hyperosmotic PBS and kept at 4°C for up to 4 weeks.

Acute Brain Slice Electrophysiology —

DAT-IRES-Cre mice (5 females, 3 males, 8-10 weeks) were anesthetized and stereotaxically injected with 400 nL of either AAVrh10-CAG-DIO-+HTPGPI-2A-dTomato-WPRE or AAVrh10-CAG-DIO-ddHTPGPI-2A-dTomato-WPRE (2 × 1012 VG/mL, 100 nL per site, two tracks with two depths per track: −3.2 mm AP, ±0.5 mm ML, −5.0/−4.5 mm DV) using a custom Narishige injector. After 3-5 weeks for expression, mice were deeply anesthetized with isoflurane and euthanized by decapitation. Coronal brain slices (300 μm) containing VTA were prepared by standard methods using a Vibratome (Leica, VT1200S), in ice-cold high sucrose cutting solution containing (in mM): 220 sucrose, 3 KCl, 1.25 NaH2PO4, 25 NaHCO3, 12 MgSO4, 10 glucose, and 0.2 CaCl2 bubbled with 95% O2 and 5% CO2. Slices were then placed into artificial cerebrospinal fluid (aCSF) containing (in mM): 120 NaCl, 3.3 KCl, 1.23 NaH2PO4, 1 MgSO4, 2 CaCl2, 25 NaHCO3, and 10 glucose at pH 7.3, previously saturated with 95% O2 and 5% CO2. Slices were incubated at 33°C for 40-60 min in bubbled aCSF and allowed to cool to room temperature (22-24°C) until recordings were initiated.

Recordings were performed on an Olympus BX51WI microscope, where slices were perfused with bubbled aCSF at 29-30°C with a 2 ml/min flow rate. To isolate GABAA IPSCs, the external solution was supplemented with DNQX (20 μM, AMPA antagonist) and AP-V (50 μM, NMDA antagonist). Alternately, to isolate AMPA-mediated EPSCs, aCSF was supplemented with picrotoxin (50 μM, GABAAR antagonist) and AP-V (50 μM). Finally, NMDA-mediated EPSCs were isolated with picrotoxin (50 μM) and DNQX (20 μM).

For voltage-clamp, the internal solution contained (in mM): 135 CsCl, 2 MgCl2, 0.5 EGTA, 10 HEPES, 4 MgATP, 0.5 NaGTP, 10 Na2-phosphocreatine, and 4 QX314 (lidocaine N-ethyl bromide), pH 7.3 with CsOH (290 mOsm). For current-clamp, we used (in mM) 130 K-gluconate, 5 KCl, 2 MgCl2, 0.2 EGTA, 10 HEPES, 4 MgATP, 0.5 NaGTP, and 10 phosphocreatine, pH adjusted to 7.3 with KOH (290 mOsm). Internal solutions were used to fill glass recording pipettes (4-6 MΩ). The liquid junction potential, estimated to be 15.9 mV, was not corrected.

Whole-cell recordings were obtained with Multiclamp 700B and Digidata 1440A, which were controlled by pClamp 10.7 acquisition software (Molecular Devices). Signals were filtered at 10 kHz. A stimulating electrode was placed 60-100 μm from the recorded neuron. Evoked IPSC or EPSC signals were elicited by electrical stimuli of 0.3 ms duration and 150-300 μA (60-70% maximum responses), with a repetition interval of 15 sec. Our inclusion criteria required that cells maintain stable access and holding currents for at least 5 min. In particular, series resistance is monitored using 5–10 mV hyperpolarizing steps interleaved with our stimuli, and cells are discarded if series resistance changed more than ~15% during the experiment. The stored data signals were processed using Clampfit 10.7 (Axon Instruments).

In Vivo Electrophysiology Experiments —

Adult DAT-IRES-Cre mice (2 females, 6 males; 12-16 weeks old) were anesthetized and stereotaxically injected with 400 nL of either AAVrh10-CAG-DIO-+HTPGPI-2A-dTomato-WPRE, AAVrh10-CAG-DIO-ddHTPGPI-2A-dTomato-WPRE (2 × 1012 VG/mL), AAVrh10-CAG-CreON-W3SL-+HTPGPI-IRES-dTomato-Farnesylated, or AAVrh10-CAG-CreON-W3SL-ddHTPGPI-IRES-dTomato-Farnesylated (1 × 1012 VG/mL) (100nL per site, two tracks with two depths per track: −3.2 mm AP, ±0.5 mm ML, −5.0/−4.5 mm DV) with a custom Narishige injector. Mice were implanted with a single-drive movable micro-bundle electrode array (Innovative Neurophysiology, Inc.; 23 μm Tungsten Electrodes, 16 / bundle; 0.008” silver ground wire) above the left VTA (−3.2 mm AP, −0.5 mm ML, −4.0 mm DV). The silver ground wire was wrapped securely around two ground screws, one placed in the skull above the cerebellum and one above the right olfactory bulb. A unilateral metal cannula (P1Tech; C315GMN; cut to 13.5 mm) was implanted laterally adjacent to the electrode bundle (−3.2 mm AP, −1.3 mm ML, −4.0 mm DV). Mice were fitted with a plastic head bar adhered to the skull with OptiBond and dental cement. Mice were singly or pair housed post-surgery, in a 12-hr light/dark cycle, with food and water provided ad libitum. Pair-housed mice were outfitted with head hats that clip to specially designed head bars to prevent cannula or electrode damage from chewing by cage mates (71).

Electrophysiology recordings and DART infusions were performed at least 3 weeks after surgery to allow for recombinant protein expression. The electrode bundle was manually advanced three times: (1) 208 μm at least one week after surgery, (2) another 208 μm one week later, and (3) 104 μm one week later. This placed the electrodes at −4.5 mm DV, at the top of the VTA. After a few days for recovery, electrophysiological recordings were made with an Intan RHD 16-channel headstage with accelerometer (C3335) attached to an Open Ephys Acquisition Board via an Intan RHD 1-ft ultra-thin SPI interface cable (C3211). Data was collected using the Open Ephys GUI (72). Putative dopamine neurons were identified via their canonical features: tonic firing between 0 and 10 Hz, with bursting; wide biphasic or triphasic waveform; and large amplitude (48, 49). If no putative dopamine neurons were observed online, electrodes were advanced an additional 26-52 μm; this cycle was repeated until multiple channels with putative dopamine neurons were observed, at which point a recording was obtained.

DART ligands, stored as pure-compound aliquots, were freshly thawed on the day of use and dissolved in sterile artificial cerebrospinal fluid (aCSF) containing (in mM): 148 NaCl, 3 KCl, 1.4 CaCl2, 0.8 MgSO4, 0.8 Na2HPO4, 0.2 NaH2PO4. The final reagent solution contained 10 μM gabazine.7DART.2 + 1 μM Alexa647.1DART.2. This solution was loaded into an internal cannula designed to project 0.5 - 1.5 mm from the guide cannula, with progressively longer internals used on successive infusions. Mice were head-fixed, the internal cannula inserted, and the Innovative Neurophysiology electrode bundle was connected to the Intan headstage. After obtaining a 15 min baseline recording, we infused 1.5 μL of DART reagent over 15 min (0.1 μL/min; Harvard Apparatus PhD Ultra pump; 5 μL Hamilton syringe), and continued the recording (120 min total). After completion of the recording, electrodes were advanced 26-52 μm (73). Mice were given at least two weeks for recovery between recordings, which we have shown is sufficient to allow for complete HTP protein turnover (43).

Spike sorting of the raw data was performed using SpyKING CIRCUS, an open-access software package allowing for semi-manual spike sorting on multichannel extra-cellular recordings (74). Detection parameters included: spike threshold = 4; N_t (width of templates) = 2 or 3; peaks = positive. Filtering parameters used 250 Hz as the cutoff frequency for the Butterworth filter. All other parameters in the configuration file were standard as recommended by the SpyKING CIRCUS documentation. Only templates that matched all features of putative dopamine neurons and exhibited consistent spiking across the whole two-hour recording window were kept for analysis. All semi-manual spike sorting and template extraction were performed by SCVB for consistency.

Custom MATLAB code was used to extract the following metrics:

Tonic: FR firing rate (spikes per second)
mISI median interspike interval (ms)
Pause: %PSI % pause-spike intervals (percent of all ISI > 2 × mISI)
PL pause length, normalized (mean PSI duration divided by mISI, unitless)
Burst: %SFB % spikes fired in bursts (percent of all spikes fired during bursts)
SPB mean spikes per burst (unitless)

For burst metrics, a burst is defined as a sequence of 3-10 spikes in which the first ISI < 80 ms and subsequent ISI < 160 ms (48, 49).

Changes in a given metric, m, were analyzed by comparing the 15-min baseline (mpre) to a 15-min sliding window (mpost) according to: Δmnorm = (mpostmpre) / (mpost + mpre). We then plotted the time course of Δmnorm (as a function of the sliding-window time), and analyzed the steady-state Δmnorm (1-hr post-gabazineDART) using a two-sided permutation test (75). Correlations between metrics were analyzed with a Pearson’s test.

Behavior Experiments —

Adult DAT-IRES-cre mice (17 females, 20 males; 12 - 16 weeks old) were anesthetized and stereotaxically injected with 400 nL of either AAVrh10-CAG-DIO-+HTPGPI-2A-dTomato-WPRE or AAVrh10-CAG-DIO-ddHTPGPI-2A-dTomato-WPRE (2 × 1012 VG/mL, 100 nL per site, two tracks with two depths per track: −3.2 mm AP, ±0.5 mm ML, −5.0/−4.5 mm DV) with a custom Narishige injector. Mice were implanted with a bilateral metal cannula above the VTA (P1Tech; C235G-1.0; cut to 4 mm with a 1.0 mm spacing), which was lowered slowly to −3.75 mm. Mice were fitted with a plastic head bar adhered to the skull with OptiBond and dental cement, enabling head fixation. Mice were singly or pair housed post-surgery, in a 12-hr reverse light/dark cycle, with food and water provided ad libitum. Pair-housed mice were outfitted with head hats that clip to specially designed head bars (71) to prevent cannula damage from chewing by cage mates.

Mice were given a minimum of 9 days post-surgery for recovery and acclimation to the reverse light cycle. For the subsequent 3 days, mice were habituated to head-fixation and water restriction. Water was limited to 50-60 μL per gram of the mouse’s baseline weight per day, while dry food was provided ad libitum. The water restriction goal was 85% starting body weight; additional supplementary water was provided if mice dropped below 77% original body weight or did not pass a daily qualitative health assessment. Only 1 mouse was excluded for issues with water restriction health.

During behavioral sessions, mice were head-fixed (custom 3D printed clamps that fit custom head bars (71)) on a round plastic treadmill (Delvie’s Plastics, 8” plexiglass disk covered with silicone rubber) attached to a rotary encoder to collect rotation data (U.S. Digital H5-100-NE-S). Cue tones were played through a Z50 speaker, lick detection was collected with an infrared beam, and sucrose rewards were delivered via a Lee Company solenoid (LHDA1233315H HDI-PTD-Saline-12V-30PSI). A custom MATLAB script controlled the behavioral sessions and data collection via a National Instruments card (NI USB-6351 X Series DAQ). Behavior sessions lasted 1 hr per day for 12 consecutive days and were performed during the dark portion of the mouse’s circadian cycle. The order in which each mouse performed the task was pseudo-randomly counterbalanced.

During training sessions (days 1-10), mice were conditioned to associate cue A (2.5 kHz tone, 1.5 sec) with a 5 μL 10% sucrose-water reward. Conditioning trials were randomly interleaved with silent trials (with neither cue nor reward), enabling consistency in the trial-structure and reward-delivery quantities throughout training and testing sessions. On the final day of training (day 10) we replaced 5-6 of the silent trials with probe trials in which an unfamiliar cue B (11 kHz tone, 1.5 sec) was presented but unrewarded. Thereafter, on day 11, we infused 10 μM gabazine.7DART.2 + 1 μM Alexa647.1DART.2 dissolved in sterile aCSF; 0.6 - 0.8 μL was infused per hemisphere at a rate of 0.1 μL/min (Harvard Apparatus PhD Ultra pump using 5 μL Hamilton syringes). Following a 2 hr rest, mice resumed the original training rules for 15 min. Thereafter the rules changed: cue A was now unrewarded (extinction trials) interleaved with cue B rewarded (conditioning trials). These rules continued on day 12. Throughout the assay, mice completed 200–300 total trials daily (half cue A; half cue B or silent). Licks were allowed during the 1.5 sec tone (anticipatory licks) and the subsequent 2 sec period (retrieval licks). The inter-trial interval (ITI) was random 3 - 13 sec (from the end of the retrieval period to the start of the next cue). Licks occurring during the ITI resulted in a timeout penalty and resetting of the ITI to discourage nonspecific licking. Timeouts were never imposed for licking during a cue or retrieval period (regardless of whether the cue was rewarded or unrewarded).

Anticipatory licking (during the 1.5 sec cue) was our primary learning measure, which we quantify as the fraction of time that the infrared beam was broken during the cue. Our behavioral inclusion criteria required that mice exhibit mean cue A anticipatory licking greater than 0.2 on the 10th training session (this was satisfied by 27/36 mice), and cue B probe-trial anticipatory licking less than 30% of responses to cue A (satisfied by 24/27 mice). The main-text figures include the 24 mice that met our behavioral inclusion criteria (12 ddHTP, 12 +HTP). The behavioral experimenter was blinded to virus condition in half of the experimental cohorts. Fig. S4c contains a total of 25 ddHTP mice (13 females, 12 males) which include the same 12 ddHTP mice (receiving gabazine.7DART.2) plus an additional 13 ddHTP mice that also met behavioral inclusion criteria and had received a different infusion (blank.1DART.2, diazepam.1DART.2, or YM90K.1DART.2) at doses shown to have no behavioral ambient drug effects (43). Following the session on day 12, all mice were perfused for histological visualization of tracerDART capture. No mice were excluded based on histology. All statistical comparisons were between ddHTP vs +HTP mice were determined using two-sided permutation tests (75).

Fiber Photometry —

Adult DAT-IRES-cre mice (12 females, 12 males; 12 - 16 weeks old) were anesthetized and stereotaxically injected with a mixture containing pGP-AAV9-CAG-FLEX-jGCaMP8f-WPRE (5 x 1011 VG/mL) and either AAVrh10-CAG-DIO-+HTPGPI-2A-dTomato-WPRE or AAVrh10-CAG-DIO-ddHTPGPI-2A-dTomato-WPRE (2 × 1012 VG/mL) (400 nL total; 100nL per site, two tracks with two depths per track: −3.2 mm AP, ±0.5 mm ML, −5.0/−4.5 mm DV) with a custom Narishige injector. Mice were implanted with a unilateral mini metal cannula in one hemisphere above the VTA (P1Tech; C315GMN/SPC; cut to 7 mm), at a 5-10 degree angle towards the midline and lowered slowly to −3.75 mm DV. They were also implanted with an optic fiber (Doric Lenses, MFC_400/430-0.66_5mm_MF1.25_FLT) in the opposite hemisphere, at a 5-6 degree angle towards the midline and lowered slowly to −4.25 mm DV, just dorsal to the VTA. Mice were fitted with a plastic head bar adhered to the skull with OptiBond and dental cement, enabling head fixation. Mice were singly housed post-surgery, in a 12-hr reverse light/dark cycle, with food and water provided ad libitum.

After three weeks, mice performed the Pavlovian assay with fiber photometry recordings on every behavioral session (Tucker-Davis Technologies RZ10X; TDT Synapse software; 465 nm excitation). Mice that did not meet behavioral inclusion criteria were excluded (4 for insufficient anticipatory licking to cue A; 2 for insufficient discrimination of cue B). Prior to the first testing session on day 11, ligands were freshly dissolved in sterile aCSF to 10 μM gabazine.7DART.2 + 1 μM Alexa647.1DART.2 or 10 μM blank.1DART.2 + 1μM Alexa647.1DART.2. Given the need to achieve bilateral ligand delivery through a unilateral cannula, 0.8 nL was infused 2 or 3 times at a rate of 0.1 μL/min with 1 hour between each infusion (1.6-2.4 μL total; Harvard Apparatus PhD Ultra pump using 5 μL Hamilton syringes). Behavior proceeded 2 hr after the last infusion. Following the last session on day 12, histology was obtained to confirm jGCaMP8f expression, Alexa647DART capture, and fiber placement. No mice were excluded based on histology. The behavioral experimenter was blinded to virus condition in all of the experimental cohorts.

To assess the effects of our manipulation on phasic activity, we computed:

ΔF/F0 = (FF0 ) / F0 where

  • F is the instantaneous fluorescence GCaMP intensity.

  • F0 is the baseline fluorescence signal (1 sec interval before each cue). Consistent with photobleaching of GCaMP, a plot of the raw F0 vs trial number adhered to a double-exponential fit. We used this fit to estimate F0, thereby accounting for photobleaching while minimizing trial-to-trial noise.

We then defined time intervals as follows: (where t = 0 at the start of the 1.5 sec cue).

  • Cue-evoked responses were time-averaged from t = 0.0 to 1.0 sec.

  • Reward responses (full width) were averaged from t = 1.5 to 3.0 sec.

  • Reward responses (narrow) were averaged from t = 1.75 to 2.25 sec.

To assess the effects of our manipulation on tonic activity, we computed:

Δ(F0)norm = ( F0,postF0,pre ) / ( F0,post + F0,pre ) where:

  • F0,pre is averaged over days 8-10.

  • F0,post is averaged over days 11-12.

Given that all mice had met our behavioral inclusion criteria, having learned the cue A reward association, cue-evoked bursts provide a quality-control metric for GCaMP expression and fiber placement. Thus, our photometry inclusion criteria required that cue-evoked ΔF/F0 > 1, averaged over days 6-10. To confirm the appropriateness of this threshold, we performed a regression analysis against our primary metric, the early-pause ΔF/F0 (first 4 reward omissions). This regression analysis, which included all mice, confirmed a statistically significant difference between ddHTP and +HTP mice (P = 0.008, two-sided permutation slope test, Fig. S4B), while demonstrating the appropriateness of our inclusion threshold, below which pauses could not be reliably detected in control mice. All statistical comparisons were between ddHTP vs +HTP mice were determined using two-sided permutation tests (75).

Histology —

Mice were deeply anesthetized with isoflurane. Electrodes were briefly connected to a 9V battery (1 sec) to mark electrode positions. Thereafter, mice were fixed by transcardial perfusion of 15 mL PBS followed by 50 mL ice-cold 4% paraformaldehyde (PFA) in 0.1M PB, pH 7.4. Brains were excised from the skull, post-fixed in 50 mL of 4% PFA at 4°C overnight, then washed three times with PBS. Brains were embedded in 5% agarose and sliced along the coronal axis at 50 μm (Leica, VT1200S).

For tyrosine hydroxylase immunostaining, sections were washed in PBS before a 2 hr incubation in a blocking solution consisting of 5% goat serum, 3% bovine serum albumin, and 0.3% trition-x. Sections were then transferred to a half block solution containing 1:1000 rabbit anti-TH (PelFreez, P40101) overnight at 4˚C with agitation, and then washed in 0.1M PBS containing 0.1% tween before a 4 hr incubation in a half block solution containing 1:1000 goat anti-rabbit 488 (Invitrogen, A11008). Finally, sections were washed in PBS containing tween, then PBS alone prior to mounting on glass slides.

Sections were mounted onto glass slides (VWR 48311-703) and coverslipped with Vectashield mounting medium (Vector Labs, H-1400 or H-1800). Fluorescent images (DAPI, FITC, TRITC, Cy5) were collected at 10X magnification with an Olympus VS200 slide scanner.

Cell counts were obtained using ilastik (76). Pixel Classification was used to predict cell versus not-cell (background tissue), then Object Classification was used on these pixel predictions to label cells as red (dTomato), green (TH+ or GCaMP), or red+green (both). Object identities were exported and used to calculate the number of cells identified in each label class across all sections from one brain. Pixel intensity analysis was performed with custom MATLAB code. For each coronal section, the VTA was manually segmented in both hemispheres. Background fluorescence was subtracted. Dye capture levels were calculated via a pixel-wise summation over 15 coronal sections. Correlations between pixel intensity and behavior were analyzed with a Pearson’s permutation test; trend lines are simple linear regressions, and shading is 95% confidence interval.

Supplementary Material

Supplement 1

Acknowledgements

We would like to thank Isaac Weaver and Janani Sundararajan for help designing and building the behavioral assay; Ankit Choudhury for performing tyrosine hydroxylase immunostaining; Konstantin Bakhurin for providing training on implanting electrodes into the VTA; and Robin Blazing for providing training on spike sorting. We also thank Rene Carter, Rich Mooney, Nicole Calakos, Mark Harnett, Elias Issa, Steve Lisberger, Erin Calipari, Vijay Namboodiri, and Josh Dudman for insightful feedback on the manuscript. This work was supported by Duke University Startup Funds (MRT), NIH grants RF1-MH117055 and DP2-MH1194025 (MRT), and by the joint efforts of The Michael J. Fox Foundation for Parkinson’s Research (MJFF) and the Aligning Science Across Parkinson’s (ASAP) initiative. MJFF administers grant ASAP-020607 on behalf of ASAP and itself.

Footnotes

Competing Interests

MRT and BCS are on patent applications describing DART. Other authors declare no competing interests.

Contact for Reagent and Resource Sharing

Further information and requests for resources and reagents should be directed to and will be fulfilled by the corresponding author Michael R. Tadross, MD, PhD (michael.tadross@duke.edu).

References

  • 1.Sandson J., Albert M. L., Varieties of perseveration. Neuropsychologia 22, 715–732 (1984). [DOI] [PubMed] [Google Scholar]
  • 2.Goodman J., Packard M. G., There is more than one kind of extinction learning. Frontiers in Systems Neuroscience 13, 16 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Bouton M. E., Maren S., McNally G. P., Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning. Physiological reviews 101, 611–681 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Schultz W., Dayan P., Montague P. R., A neural substrate of prediction and reward. Science 275, 1593–1599 (1997). [DOI] [PubMed] [Google Scholar]
  • 5.Watabe-Uchida M., Eshel N., Uchida N., Neural circuitry of reward prediction error. Annual review of neuroscience 40, 373–394 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Berke J. D., What does dopamine mean? Nature neuroscience 21, 787–793 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Cox J., Witten I. B., Striatal circuits for reward learning and decision-making. Nature Reviews Neuroscience 20, 482–494 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Dabney W. et al. , A distributional code for value in dopamine-based reinforcement learning. Nature 577, 671–675 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hamid A. A. et al. , Mesolimbic dopamine signals the value of work. Nature neuroscience 19, 117–126 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Eshel N. et al. , Arithmetic and local circuitry underlying dopamine prediction errors. Nature 525, 243–246 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Tian J., Uchida N., Habenula lesions reveal that multiple mechanisms underlie dopamine prediction errors. Neuron 87, 1304–1316 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Tian J. et al. , Distributed and mixed information in monosynaptic inputs to dopamine neurons. Neuron 91, 1374–1389 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Tsai H. C. et al. , Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080–1084 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Witten I. B. et al. , Recombinase-driver rat lines: tools, techniques, and optogenetic application to dopamine-mediated reinforcement. Neuron 72, 721–733 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Steinberg E. E. et al. , A causal link between prediction errors, dopamine neurons and learning. Nature neuroscience 16, 966–973 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Chang C. Y., Gardner M., Di Tillio M. G., Schoenbaum G., Optogenetic blockade of dopamine transients prevents learning induced by changes in reward features. Current Biology 27, 3480–3486. e3483 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Sharpe M. J. et al. , Dopamine transients are sufficient and necessary for acquisition of model-based associations. Nature Neuroscience 20, 735–742 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Saunders B. T., Richard J. M., Margolis E. B., Janak P. H., Dopamine neurons create Pavlovian conditioned stimuli with circuit-defined motivational properties. Nature neuroscience 21, 1072–1083 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kutlu M. G. et al. , Dopamine release in the nucleus accumbens core signals perceived saliency. Current Biology 31, 4748–4761. e4748 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Jeong H. et al. , Mesolimbic dopamine release conveys causal associations. Science 378, eabq6740 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Coddington L. T., Lindo S. E., Dudman J. T., Mesolimbic dopamine adapts the rate of learning from action. Nature 614, 294–302 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Danjo T., Yoshimi K., Funabiki K., Yawata S., Nakanishi S., Aversive behavior induced by optogenetic inactivation of ventral tegmental area dopamine neurons is mediated by dopamine D2 receptors in the nucleus accumbens. Proceedings of the National Academy of Sciences 111, 6455–6460 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Chang C. Y. et al. , Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors. Nature neuroscience 19, 111–116 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.van Zessen R. et al. , Cue and reward evoked dopamine activity is necessary for maintaining learned Pavlovian associations. Journal of Neuroscience 41, 5004–5014 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Schultz W., Predictive reward signal of dopamine neurons. Journal of neurophysiology, (1998). [DOI] [PubMed] [Google Scholar]
  • 26.Cohen J. Y., Haesler S., Vong L., Lowell B. B., Uchida N., Neuron-type specific signals for reward and punishment in the ventral tegmental area. nature 482, 85 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Engelhard B. et al. , Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons. Nature 570, 509–513 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Fleming W., Jewell S., Engelhard B., Witten D. M., Witten I. B., Inferring spikes from calcium imaging in dopamine neurons. PloS one 16, e0252345 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Okray Z. et al. , Multisensory learning binds neurons into a cross-modal memory engram. Nature 617, 777–784 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lee K. et al. , Temporally restricted dopaminergic control of reward-conditioned movements. Nature neuroscience 23, 209–216 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Iino Y. et al. , Dopamine D2 receptors in discrimination learning and spine enlargement. Nature 579, 555–560 (2020). [DOI] [PubMed] [Google Scholar]
  • 32.Marshel J. H. et al. , Cortical layer–specific critical dynamics triggering perception. Science 365, eaaw5202 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Fan L. Z. et al. , All-optical physiology resolves a synaptic basis for behavioral timescale plasticity. Cell 186, 543–559. e519 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Pan W.-X., Schmidt R., Wickens J. R., Hyland B. I., Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. Journal of Neuroscience 28, 9619–9631 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Tan K. R. et al. , GABA neurons of the VTA drive conditioned place aversion. Neuron 73, 1173–1183 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Van Zessen R., Phillips J. L., Budygin E. A., Stuber G. D., Activation of VTA GABA neurons disrupts reward consumption. Neuron 73, 1184–1194 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Brown M. T. et al. , Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature 492, 452–456 (2012). [DOI] [PubMed] [Google Scholar]
  • 38.Yoo J. H. et al. , Ventral tegmental area glutamate neurons co-release GABA and promote positive reinforcement. Nature communications 7, 13697 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Root D. H. et al. , Distinct signaling by ventral tegmental area glutamate, GABA, and combinatorial glutamate-GABA neurons in motivated behavior. Cell Reports 32, (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Zhou W.-L. et al. , Activity of a direct VTA to ventral pallidum GABA pathway encodes unconditioned reward value and sustains motivation for reward. Science Advances 8, eabm5217 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Parker J. G. et al. , Attenuating GABAA receptor signaling in dopamine neurons selectively enhances reward learning and alters risk preference in mice. Journal of Neuroscience 31, 17103–17112 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Shields B. C. et al. , Deconstructing behavioral neuropharmacology with cellular specificity. Science 356, eaaj2161 (2017). [DOI] [PubMed] [Google Scholar]
  • 43.Shields B. C. et al. , DART. 2: bidirectional synaptic pharmacology with thousandfold cellular specificity. Nature Methods, 1–10 (2024). [DOI] [PubMed] [Google Scholar]
  • 44.Lobb C. J., Wilson C. J., Paladini C. A., A dynamic role for GABA receptors on the firing pattern of midbrain dopaminergic neurons. Journal of neurophysiology 104, 403–413 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Salinas-Hernández X. I. et al. , Dopamine neurons drive fear extinction learning by signaling the omission of expected aversive outcomes. Elife 7, e38818 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Pan W.-X., Coddington L. T., Dudman J. T., Dissociable contributions of phasic dopamine activity to reward and prediction. Cell Reports 36, (2021). [DOI] [PubMed] [Google Scholar]
  • 47.Ishino S. et al. , Dopamine error signal to actively cope with lack of expected reward. Science Advances 9, eade5420 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Grace A. A., Bunney B. S., The control of firing pattern in nigral dopamine neurons: burst firing. Journal of neuroscience 4, 2877–2890 (1984). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Ungless M. A., Grace A. A., Are you or aren’t you? Challenges associated with physiologically identifying dopamine neurons. Trends in neurosciences 35, 422–430 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Khaliq Z. M., Bean B. P., Dynamic, nonlinear feedback regulation of slow pacemaking by A-type potassium current in ventral tegmental area neurons. Journal of Neuroscience 28, 10905–10917 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Bouton M. E., Context and behavioral processes in extinction. Learning & memory 11, 485–494 (2004). [DOI] [PubMed] [Google Scholar]
  • 52.Lubow R. E., Latent inhibition. Psychological bulletin 79, 398 (1973). [DOI] [PubMed] [Google Scholar]
  • 53.Mogenson G. J., Wu M., Machanda S., Locomotor activity initiated by microinfusions of picrotoxin into the ventral tegmental area. Brain research 161, 311–319 (1979). [DOI] [PubMed] [Google Scholar]
  • 54.Arnt J., Scheel-Kruger J., GABA in the ventral tegmental area: differential regional effects on locomotion, aggression and food intake after microinjection of GABA agonists and antagonists. Life Sci 25, 1351–1360 (1979). [DOI] [PubMed] [Google Scholar]
  • 55.Tanner T., GABA-induced locomotor activity in the rat, after bilateral injection into the ventral tegmental area. Neuropharmacology 18, 441–446 (1979). [DOI] [PubMed] [Google Scholar]
  • 56.Barrot M. et al. , Braking dopamine systems: a new GABA master structure for mesolimbic and nigrostriatal functions. Journal of Neuroscience 32, 14094–14101 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Zhang Y. et al. , Fast and sensitive GCaMP calcium indicators for imaging neural populations. Nature 615, 884–891 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Zalocusky K. A. et al. , Nucleus accumbens D2R cells signal prior outcomes and control risky decision-making. Nature 531, 642–646 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Sasaki R. et al. , Balancing risk-return decisions by manipulating the mesofrontal circuits in primates. Science 383, 55–61 (2024). [DOI] [PubMed] [Google Scholar]
  • 60.Takahashi Y. K., Langdon A. J., Niv Y., Schoenbaum G., Temporal specificity of reward prediction errors signaled by putative dopamine neurons in rat VTA depends on ventral striatum. Neuron 91, 182–193 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Coddington L. T., Dudman J. T., The timing of action determines reward prediction signals in identified midbrain dopamine neurons. Nat Neurosci 21, 1563–1573 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Shen W., Flajolet M., Greengard P., Surmeier D. J., Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848–851 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Yagishita S. et al. , A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science 345, 1616–1620 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Lee S. J. et al. , Cell-type-specific asynchronous modulation of PKA by dopamine in learning. Nature 590, 451–456 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Matsumoto H., Tian J., Uchida N., Watabe-Uchida M., Midbrain dopamine neurons signal aversion in a reward-context-dependent manner. Elife 5, e17328 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Morice R., Cognitive inflexibility and pre-frontal dysfunction in schizophrenia and mania. The British Journal of Psychiatry 157, 50–54 (1990). [DOI] [PubMed] [Google Scholar]
  • 67.Steuber E. R., McGuire J. F., A systematic review of fear learning, extinction learning, and reversal learning in obsessive-compulsive disorder: implications for treatment. The Journal of Clinical Psychiatry 83, 43190 (2022). [DOI] [PubMed] [Google Scholar]
  • 68.Pascoli V. et al. , Stochastic synaptic plasticity underlying compulsion in a model of addiction. Nature 564, 366–371 (2018). [DOI] [PubMed] [Google Scholar]
  • 69.Rutledge R. B. et al. , Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. Journal of Neuroscience 29, 15104–15114 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Bargmann C. I., How the New Neuroscience Will Advance Medicine. JAMA 314, 221–222 (2015). [DOI] [PubMed] [Google Scholar]
  • 71.Weaver I. A., Yousefzadeh S. A., Tadross M. R., An open-source head-fixation and implant-protection system for mice. HardwareX 13, e00391 (2023). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Siegle J. H. et al. , Open Ephys: an open-source, plugin-based platform for multichannel electrophysiology. Journal of neural engineering 14, 045003 (2017). [DOI] [PubMed] [Google Scholar]
  • 73.Dzirasa K., Fuentes R., Kumar S., Potes J. M., Nicolelis M. A., Chronic in vivo multi-circuit neurophysiological recordings in mice. Journal of neuroscience methods 195, 36–46 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Yger P. et al. , A spike sorting toolbox for up to thousands of electrodes validated with ground truth recordings in vitro and in vivo. Elife 7, e34518 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Ho J., Tumkaya T., Aryal S., Choi H., Claridge-Chang A., Moving beyond P values: data analysis with estimation graphics. Nature methods 16, 565–566 (2019). [DOI] [PubMed] [Google Scholar]
  • 76.Berg S. et al. , Ilastik: interactive machine learning for (bio) image analysis. Nature methods 16, 1226–1232 (2019). [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1

Articles from bioRxiv are provided here courtesy of Cold Spring Harbor Laboratory Preprints

RESOURCES