Abstract
Reward predictions not only promote reward pursuit, they also shape how reward is pursed. Such predictions are supported by environmental cues that signal reward availability and probability. Such cues trigger dopamine release in the nucleus accumbens core (NAc). Thus, here we used dopamine sensor fiber photometry, cell-type and pathway-specific optogenetic inhibition, pavlovian cue–reward conditioning, and test of cue-induced reward–pursuit strategy in male and female rats to ask whether cue-evoked phasic dopamine release is shaped by reward prediction to support reward pursuit. We found that cue-evoked NAc core dopamine is positively shaped by reward prediction and inversely relates to and predicts instrumental reward seeking. Cues that predicted imminent reward with high probability triggered a large NAc dopamine response, and this was associated checking for the expected reward in the delivery location rather than instrumental reward seeking. Cues that predicted reward with low probability elicited less dopamine, and this was associated with a bias toward seeking rather than checking for reward. Correspondingly, inhibition of cue-evoked NAc dopamine increased instrumental reward seeking and decreased reward-checking behavior. Thus, transient, cue-evoked NAc core dopamine release supports reward prediction to shape reward-pursuit strategy.
Keywords: fiber photometry, nucleus accumbens, optogenetics, pavlovian conditioning, pavlovian-to-instrumental transfer, ventral tegmental area
Significance Statement
Cues that signal reward availability promote reward pursuit. To ensure this is adaptive, we use the predictions these cues enable to select how to pursue reward. When reward prediction is low, we will seek out new reward opportunities. When it is high, we will check for the reward it in its usual location. We discovered that cue-evoked nucleus accumbens dopamine supports reward predictions to shape how reward is pursued. Dopamine can actually constrain reward seeking and promote reward checking when reward is predicted strongly and imminently. These results provide new information on how dopamine shapes behavior in the moment and help understand the link between motivational and dopamine disruptions in psychiatric conditions such as addictions and depression.
Introduction
Reward cues can heavily influence our behavior. By signaling reward availability and probability, they support reward predictions that not only promote reward pursuit (Corbit and Balleine, 2016; Robinson and Berridge, 2025) but also influence how we pursue reward (Ostlund and Marshall, 2021). When a cue only sporadically signals a desired resource, it is adaptive to engage in instrumental “reward-seeking” actions. However, if reward is more reliably predicted, it is better to pursue it by “checking” its usual delivery location (Azrin and Hake, 1969; Lovibond, 1981; Stephens and Krebs, 1986; Timberlake, 1994; Anselme and Güntürkün, 2018; Marshall and Ostlund, 2018). This is particularly true for cues that signal imminent reward. When time is of the essence, seeking reward can prevent retrieval of an expected reward and vice versa. So, we tend to seek reward when its presence is unlikely but check for it when it is probable. For example, with only a few minutes before a meeting, if snacks are offered only sporadically, you might seek one out at the vending machine, but, if they are more reliably predicted, you will head straight to the conference room to look for a treat. Thus, reward prediction is critical for adaptive behavior. Inability to adaptively regulate reward pursuit can lead to unnecessary opportunity costs, loss of control, or maladaptive behaviors. This can underlie symptoms of psychiatric conditions such as addictions and depression (Levy and Dubois, 2006; Jentsch and Pennington, 2014; Le Heron et al., 2018; Robinson and Berridge, 2025). Yet, little is known of how the brain supports reward prediction to shape reward-pursuit strategy.
Dopamine may contribute. Reward-predictive cues trigger dopamine release in the nucleus accumbens core (NAc; Roitman et al., 2004; Day et al., 2007, 2010; Wassum et al., 2013; Saddoris et al., 2015; Aitken et al., 2016; Collins et al., 2016; Sun et al., 2018; Kutlu et al., 2021; Garr et al., 2024; Bornhoft et al., 2025). In motivational accounts, this phasic signal is a critical substrate through which cues promote reward-pursuit behaviors (Beeler et al., 2012; Saunders and Robinson, 2012; Wassum et al., 2013; Syed et al., 2016; Berke, 2018; Robinson and Berridge, 2025). Such cue-evoked dopamine can be shaped by elements of reward prediction (Gan et al., 2009; Day et al., 2010; Hamid et al., 2015; Hart et al., 2015; Saddoris et al., 2015; Aitken et al., 2016; Garr et al., 2024). This raises the possibility that cue-evoked NAc dopamine may support reward prediction to shape how reward is pursued. Thus, here we investigated the relationship between cue-evoked NAc dopamine and reward-pursuit behaviors and asked whether dopamine supports reward prediction to shape the strategy with which reward is pursued. To achieve this, we combined NAc dopamine measurement and manipulation with pavlovian cue–reward conditioning and a pavlovian-to-instrumental transfer (PIT) test of the influence of cues signaling different reward probabilities on reward-pursuit strategy.
Materials and Methods
Subjects
Subjects were male and female wild-type Long–Evans rats and transgenic Long–Evans rats expressing Cre recombinase under control of the tyrosine hydroxylase promoter (Th-cre+) aged 10–12 weeks at the time of surgery. Rats were housed in a temperature (68–79°F) and humidity (30–70%) regulated vivarium. They were initially housed in same-sex pairs and then, following surgery, housed individually to preserve implants. Rats were provided with water ad libitum in the home cage and, during experimental training and testing, were maintained on a food-restricted 12–18 g daily diet (LabDiet) to maintain ∼85–90% free-feeding body weight. Rats were habituated to handling for 3–5 d prior to the onset of each experiment. Separate groups of naive rats were used for each experiment. Experiments were performed during the dark phase of a 12:12 h reverse dark/light cycle (lights off at 7 A.M.). All procedures were conducted in accordance with the NIH Guide for the Care and Use of Laboratory Animals and were approved by the UCLA Institutional Animal Care and Use Committee.
Surgery
Rats were anesthetized with isoflurane (4–5% induction, 1–2% maintenance) and positioned in a digital stereotaxic frame (David Kopf Instruments). Subcutaneous Rimadyl (carprofen; 5 mg/kg; Zoetis) was given preoperatively for analgesia and anti-inflammatory purposes. An incision was made along the midline to expose the skull. After performing a small craniotomy, virus was injected using a 28-g infusion needle (Plastics One) connected to a 1-ml syringe (Hamilton Company) by intramedic polyethylene tubing (Becton Dickinson) and controlled by a syringe pump (Harvard Apparatus). Virus was injected at a rate of 0.1 µl/min, and the needle was left in place for 10 min postinjection to allow diffusion. Further experiment-specific surgical details are provided below. After surgery, rats were kept on a heating pad maintained at 35°C for 1 h and then single housed in a clean homecage for recovery and monitoring. Rats received chow containing the antibiotic trimethoprim/sulfamethoxazole (TMS; Inotiv) for 7 d following surgery to prevent infection, after which they were returned to standard rodent chow.
Behavioral procedures
Apparatus
Training took place in Med Associates conditioning chambers housed within sound- and light-attenuating boxes, described previously (Malvaez et al., 2015; Collins et al., 2019). Each chamber had grid floors and contained a retractable lever that could be inserted to the left of a recessed food-delivery port (magazine) on the front wall. A photobeam entry detector was positioned at the entry to the food port. Each chamber was equipped with a pellet dispenser to deliver 45-mg food pellets (Bio-Serv) into a well of the food port. A tone generator and clicker were attached to a speaker on the wall opposite the lever and food-delivery port. A fan mounted to the outer chamber provided ventilation and external noise reduction. A 3-W, 24-V house light mounted on the top of the back wall opposite the food port provided illumination. For optogenetic manipulations, chambers were outfitted with an Intensity Division Fiberoptic Rotary Joint (Doric Lenses) connecting the output fiber-optic patch cords to a laser (Changchun New Industries Optoelectronics Technology) positioned outside of the chamber.
Magazine conditioning
Rats first received two sessions (one session/day) of training to learn where to receive the food-pellet reward (45-mg grain pellet; Bio-Serv). Each session included 30 noncontingent pellet deliveries (60-s intertrial interval, ITI).
Short-delay pavlovian conditioning
All rats received eight sessions of short-delay pavlovian conditioning (one session/day) to learn to associate each of two, 10-s auditory (75–78 db) cues (aka conditioned stimuli, CS), click (10 Hz), and tone (1.5 kHz), with the delivery of grain pellets. For 10 subjects in the fiber photometry experiment, the tone was continuous for 10 s; for all other subjects, the tone was pulsed in 0.25 s on/off intervals (4 Hz). Each 10-s cue coterminated with the delivery of a single pellet. The high-probability cue (CS90) coterminated with reward delivery on 90% of the trials. The low-probability cue (CS30) coterminated with reward delivery on only 30% of the trials. For half the subjects, click served as the CS90, and tone served as the CS30, with the other half receiving the opposite arrangement. Each session consisted of 20 click and 20 tone presentations. Cues were delivered pseudorandomly with a variable 60–160-s ITI (mean = 110 s).
Instrumental conditioning
Rats next received eight sessions, minimum, of instrumental conditioning (one session/day), in which lever-press actions were reinforced with delivery of a single grain pellet. Each session terminated after 30 outcomes had been earned or 40 min had elapsed. Lever presses were continuously reinforced during the first session and then the reinforcement schedule was shifted to random interval (RI) on which a variable interval must elapse following a reinforcer for another press to be reinforced. The variable interval started at an average of 15 s (RI-15 s) for one session, then escalated to 30 s (RI-30 s) for one session, and finally averaged 60 s (RI-60 s) for the remaining sessions.
Pavlovian retraining
Following instrumental training, rats received four additional sessions of pavlovian conditioning, as described above.
PIT test
Rats next received a PIT test. During the PIT test, the lever was continuously present, but pressing was not reinforced. After 10 min of lever-pressing extinction, each 10 s cue was presented separately 10 times, separated by a fixed 110-s ITI. Cues were presented in a pseudorandom order with no >2 of the same cue type occurring in succession. The cue type that started the session was counterbalanced across subjects. No rewards were delivered following cue presentation.
Behavioral data collection and analysis
Entries into the food-delivery port and/or lever presses were recorded continuously for each session and processed with Microsoft Excel (Microsoft). For pavlovian conditioning, conditional food-port approach responses were assessed by comparing entries into the food-delivery port during the 10-s cue to the 10-s baseline periods immediately prior to cue onset (precue). Data were averaged across trials and then averaged across the last two conditioning sessions. For instrumental conditioning, press rates (presses/min) were averaged across the last two training sessions. For PIT tests, we evaluated entries into the food-delivery port and lever presses for a 15-s cue window combining the 10-s cue and 5-s postcue period. This allowed us to capture behavior during the cue itself and the postcue period, when reward was delivered during training and, thereby, capture the delayed excitatory effect of short-delay cues and distinguish the effect of strongly versus weakly predictive cues (Marshall et al., 2020). See Supplemental Figures 1, a and b, and 2, c and d, for a breakdown of food-port entries and lever presses in 2-s bins before, during, and after cue presentation during PIT. Lever presses served as the measure of instrumental reward seeking. Presses during the 15-s cue periods were compared with that during the 15-s precue baseline. As shown previously (Halbout et al., 2019, 2022), we found that many food-port entries occurred immediately (within 2 s) following a lever press (Supplemental Fig. 1d). Therefore, to isolate pavlovian conditional food-port checks from these entries that occurred as part of an instrumental press-check sequence, we excluded food-port entries that directly followed a lever press within 2 s. The remaining food-port entries were our measure of reward-checking behavior. All food-port entries and press-linked food–port entries are shown in Supplemental Figures 1, c and e, and 2, e and f. Food-port entries during the 15-s cue periods were compared with that during the 15-s precue baseline. To account for baseline behavior rates and evaluate the cue-induced change in behavior, we also computed the change (Δ) in lever presses and unlinked food-port entries by subtracting those during the 15-s cue period from baseline. Data were averaged across trials for each cue type. Trial × trial results are presented in Supplemental Figure 1, k and l.
Fiber photometry recordings of NAc dopamine release during PIT
Subjects
Subjects were naive, male and female Long–Evans rats (final N = 14, 7 males). Two subjects were removed from the experiment: one due to illness and one because it did not acquire pavlovian conditional behavior. Three subjects with tissue damage that prevented placement validation were excluded from the analysis.
Behavioral training
Rats were food restricted and received magazine conditioning, followed by pavlovian and instrumental training as above. Following surgery (see below) and recovery, rats were again food restricted and received four additional pavlovian and four additional instrumental training sessions. Rats were tethered for the retraining sessions, but no light was delivered.
Surgery
Rats were infused unilaterally (right hemisphere N = 13; left, N = 1) with AAV encoding the GPCR activation-based dopamine sensor GRABDA2m (pAAV9-hsyn-GRAB_DA4.4, Addgene). Virus (0.5 µl) was infused at 0.1 µl/min into the NAc (AP, +1.3; ML, ±1.3; DV, −7.2, from the bregma). Five minutes later, viral injectors were dorsally repositioned in the NAc for a second viral infusion (0.5 µl; DV, −6.4). Optical fibers (200 µm diameter, 0.37 NA, Neurophotometrics) were implanted (DV, −6.8). Rats were allowed to recover for at least 5 d before retraining commenced.
Fiber photometry recordings during PIT
Fiber photometry was used to image GRABDA2m fluorescent changes in NAc neurons during PIT using a commercial fiber photometry system (Neurophotometrics). A 470-nm excitation light was adjusted to ∼80–100 µW at the tip of the patch cord (fiber core diameter, 400 µm; Doric Lenses). Fluorescence emission was passed through a 535-nm bandpass filter and focused onto the complementary metal-oxide semiconductor camera sensor through a tube lens. Samples were collected at 20 Hz using a custom Bonsai (Lopes et al., 2015) workflow. Time stamps of task events were collected simultaneously through an additional synchronized camera aimed at the Med Associates interface, which sent light pulses coincident with task events. Signals were saved using the Bonsai software and exported to MATLAB (MathWorks) for analysis.
Fiber photometry analysis
Data were preprocessed using a custom-written pipeline in MATLAB (MathWorks; Sias et al., 2021, 2024). The 415 and 470 nm signals were fit using an exponential curve. Change in fluorescence (ΔF/F) at each time point was calculated by subtracting the fitted 415-nm signal from the 470-nm signal and normalizing to the fitted 415-nm data [(470 − fitted 415) / fitted 415]. Non-normalized 470-nm signal is provided in Supplemental Figure 1v. The ΔF/F data were Z-scored to the average of the whole session [(ΔF/F − mean ΔF/F) / std(ΔF/F)]. Z-scored traces were then aligned to behavioral event timestamps. Individual trial data were excluded if the patch cord became detached or if artifactual signal due to excessive motion or patch cord twisting was detected (n = 6 CS30 trials from four subjects; n = 7 CS90 trials from six subjects).
Using a waveform analysis (Jean-Richard-Dit-Bressel et al., 2020), event-related activity was analyzed 5 s before to 20 s after cue onset. To ensure independence of observations, the analysis was performed at the subject-level average waveform. For each subject, the CS30 and CS90 trials were independently averaged to generate a mean time series for each CS type for each subject. The observed difference waveform (mean CS30 − mean CS90) was analyzed for statistical significance at every time point using two nonparametric approaches: a two-sample permutation test and a bootstrap confidence interval. For the permutation test, with 1,000 iterations, a null distribution of condition differences was generated by randomly assigning the CS condition labels and calculating the difference of the resampled means across the entire time window. The p value at each time point was the proportion of permutations whose mean difference values were more extreme than the observed difference between the actual samples. A time point was flagged as significant if p < 0.05. To provide a robust estimate of the true population mean difference, a matrix of 1,000 bootstrapped means were generated by resampling with replacement the subject-level average waveform for both CS30 and CS90. The difference between CSs was calculated for each of the 1,000 iterations. CI for each timepoint were percentiles at that timepoint of the bootstrap matrix (95%, 2.5; 97.5 percentiles), which were then expanded by a factor of √n/(n − 1) to counter small sample narrowness bias. A significant difference was flagged whenever the CI did not contain the null of 0. For both approaches, a threshold of 10 consecutive time points was applied to the initial set of significant indices to correct for isolated, random fluctuations. Using this approach, we found that the cue-evoked dopamine differed between cue type immediately after CS onset. Thus, to further quantify dopamine fluctuations, we calculated the peak value in the 2-s period immediately following cue onset and compared with the 2-s precue baseline periods. To quantify dips in dopamine detected following cue offset, when the predicted reward was omitted at test, we calculated the minimum GRABDA Z-score in the 5-s postcue period compared with 5-s period before cue offset. To quantify dopamine related to entry and lever-press behaviors during the cue, we used the 4-s period prior to entries or lever presses compared with the baseline 4-s precue periods. Quantifications and signal aligned to events were averaged across trials within a session and compared between groups.
Because lever pressing and entries into the food-delivery port can freely occur during cue presentation, we used a linear regression model to parse the extent to which dopamine fluctuations were explained by these discrete but overlapping events (Parker et al., 2016; Greenstreet et al., 2025). To calculate kernels that correspond to the isolated response to each behavioral event for each CS type, CS onset, CS offset, lever presses, and food-port entries, the Z-scored GRABDA signal 5 s prior to and 20 s after cue onset was modeled as the sum of the response to each event. Discrete events cue onset, offset, lever press, and food-port entry were convolved into a time series representing the time of the event in a series of values between 0 and 1 using a 4-s Gaussian distribution. For CS onset and offset, we used a half-Gaussian convolution (0–4 s). Because behavioral events include both movements to make the action and a following outcome (e.g., nonreinforcement), the press and food-port entry convolution was centered on the event (−2 to 2 s). For each CS type for each subject, the coefficients of the kernels were solved using the method of least-squares with the MATLAB function regress. The kernel output for the 5 s prior to and 20 s after cue onset was averaged across trials for each CS type for each subject. To calculate the percentage of variance explained by each regressor class, the predicted dopamine signal was recalculated removing one regressor class (e.g., CS, both CS30 and CS90) at a time. The percent variance explained by the removed regressor was calculated by subtracting the variance explained by the model with the regressor removed from the explained variance of the full model and expressing this as a percentage of the variance explained by the full model [(vfull − vpartial / vfull) * 100].
Optogenetic inhibition of VTADA→NAc terminals at cue onset during PIT
Subjects
Subjects were naive, male and female Th-cre + (hemizygous) Long–Evans rats and wild-type (Th-cre−) littermates [control, final N = 12, six males, nine Th-cre+/cre-dependent tdTomato, three Th-cre−/cre-dependent archaerhodopsin T (ArchT); ArchT, N = 14 Th-cre+, nine males]. Subjects with misplaced optic fibers (ArchT, N = 1), lack of terminal expression (N = 1), or broken optic fibers (ArchT, N = 4; control, N = 1) were excluded from the dataset.
Surgery
Th-cre+ rats were randomly assigned to a viral group and received bilateral infusions (0.2 µl) of AAV encoding a cre-inducible inhibitory opsin ArchT (AAV5-CAG-FLEX-ArchT-tdTomato, Addgene) or a tdTomato fluorescent protein control (tdTomato; AAV5-CAG-FLEX-tdTomato, University of North Carolina Vector Core) into the VTA (AP, −5.3; ML, ±0.7; DV, −8.3 mm from the bregma). Th-cre− rats all received bilateral infusions (0.2 µl) of AAV encoding an mCherry fluorescent protein control (AAV8-hSyn-mCherry). Optical fibers (200 µm core, 0.39 NA, Thorlabs) held in ceramic ferrules (Kientec Systems) were implanted bilaterally in the NAc (AP, +1.3; ML, ±1.4; DV, −6.8, from the bregma). Rats were allowed to recover for 3–4 weeks prior to the start of food restriction and training.
Behavioral training
Rats received magazine, pavlovian, and instrumental conditioning as above. They were attached to the optical tether (200 µm, 0.22 NA, Doric Lenses) throughout pavlovian and instrumental conditioning, but no light was delivered. One cohort (N = 6, three control, three ArchT) received 12 rather than 8 pavlovian conditioning sessions.
Optogenetic inhibition of VTADA→NAc projections during the PIT test
The PIT test occurred 7–9 weeks postsurgery to allow sufficient ArchT expression in VTADA→NAc terminals at the time of manipulation. Optogenetic inhibition was used to attenuate the activity of ArchT-expressing VTADA axons and terminals in the NAc at cue onset. Green light (532 nm; 10 mW) was delivered to the NAc via a laser (Changchun New Industries Optoelectronics Technology) connected through a ceramic mating sleeve (Thorlabs) to the ferrule implanted on the rat. During the PIT test, 2.5 s of continuous light was delivered beginning 0.5 s before each cue onset. Light effects were estimated to be restricted to the NAc core based on predicted irradiance values (https://web.stanford.edu/group/dlab/cgi-bin/graph/chart.php). Individual trials in which the patch cord became detached and, therefore, light was not delivered were removed from the analysis (controls, n = 1 CS90 trial in one subject; ArchT, n = 3 CS30 trials across three subjects; n = 5 CS90 trials across four subjects). Because behavioral data did not differ between the Th-cre+ and TH-cre− control types [PIT lever presses: three-way repeated-measure analysis of variance (RM-ANOVA), control type, F(1,20) = 1.52; p = 0.23; control type × CS presence, F(1,20) = 2.11; p = 0.16; control type × CS type, F(1,20) = 0.13; p = 0.72; control type × CS presence × CS type, F(1,20) = 0.67; p = 0.42; PIT food-port entries, three-way RM-ANOVA; control type, F(1,20) = 0.01; p = 0.94; control type × CS presence, F(1,20) = 0.02; p = 0.89; control type × CS type, F(1,20) = 0.22; p = 0.64; control type × CS presence × CS type, F(1,20) = 1.80; p = 0.19], the controls were collapsed into a single group.
Histology
Following behavioral experiments, rats were deeply anesthetized with pentobarbital (Vortech Pharmaceuticals) and transcardially perfused with phosphate-buffered saline (PBS) followed by 4% paraformaldehyde (PFA). Brains were removed and postfixed in 4% PFA overnight, placed into 30% sucrose solution, then sectioned into 30 μm slices using a cryostat (CM1950, Leica Biosystems) and stored in cryoprotectant. Slices were rinsed in a DAPI (Thermo Fisher Scientific) solution for 4 min (5 mg/ml stock, 1:10,000), washed three times in PBS for 15 min, mounted on slides, and coverslipped with ProLong Gold mounting medium (Thermo Fisher Scientific). All images were acquired using a fluorescence microscope (BZ-X710; Keyence) with 4×, 10×, and 20× objectives (CFI Plan Apo), CCD camera, and BZ-X Analyze software (Keyence), to confirm viral expressions and optic fiber placement.
Immunofluorescence was used to confirm expression of GRABDA in the NAc. Floating coronal sections were washed three times in 1× PBS for 30 min and then blocked for 1–1.5 h at room temperature in a solution of 3% normal goat serum (Thermo Fisher Scientific) and 0.3% Triton X-100 (Thermo Fisher Scientific) dissolved in PBS. Sections were then washed three times in PBS for 15 min and incubated in blocking solution containing chicken anti-GFP polyclonal antibody (1:1,000; Abcam) with gentle agitation at 4°C for 18–22 h. Sections were next rinsed three times in PBS for 30 min and incubated with goat anti-chicken IgY, Alexa Fluor 488 conjugate (1:500; Abcam), in blocking solution at room temperature for 2 h. Sections were washed a final two times in PBS for 10 min.
tdTomato fluorescence with a Th costain was used to confirm expression of ArchT-tdTomato in VTADA neurons. Floating coronal sections were washed three times in 1× PBS for 30 min and then blocked for 2 h at room temperature in a solution of 3% normal donkey serum (Thermo Fisher Scientific) and 0.2% Triton X-100 dissolved in PBS. Sections were then washed three times in PBS for 15 min and incubated in blocking solution containing rabbit anti-TH antibody (1:1,000; EMD Millipore) with gentle agitation at 4°C for 44–48 h. Sections were next rinsed three times in PBS for 30 min and incubated with goat anti-rabbit IgG, Alexa Fluor 488 conjugate (1:500; Thermo Fisher Scientific), in blocking solution at room temperature for 2 h. Sections were washed a final two times in PBS for 10 min. Immunofluorescence was also used to confirm expression of ArchT-tdTomato in axons and terminals in the NAc. Floating coronal sections were washed two times in 1× PBS for 10 min and then blocked for 2 h at room temperature in a solution of 10% normal goat serum and 0.5% Triton X-100 dissolved in PBS. Sections were then washed three times in PBS for 15 min and incubated in blocking solution containing rabbit anti DsRed polyclonal antibody (1:1,000; EMD Millipore) with gentle agitation at 4°C for 18–22 h. Sections were next rinsed three times in blocking solution for 30 min and incubated with goat anti-rabbit IgG, Alexa Fluor 594 conjugate (1:500; Thermo Fisher Scientific), in blocking solution at room temperature for 2 h. Sections were washed a final two times in PBS for 10 min.
Statistical analysis
Datasets were checked for normality using the Kolmogorov–Smirnov test and then analyzed by two-tailed, paired and unpaired Student's t tests, one-, two-, or three-way RM-ANOVA (GraphPad Prism, GraphPad; SPSS, IBM). Post hoc tests were corrected for multiple comparisons using Bonferroni’s method and used to clarify main and interaction effects. To assess the relationship between cue-evoked dopamine and event variables, we used multivariate general linear model (covariance predictor, peak cue-evoked dopamine at CS onset; dependent variables, test trial, cue-evoked change in lever presses, and cue-evoked change in food-port entries), Pearson's and partial correlation (controlling for subject), and linear mixed-model analysis (repeated factors, CS, trial; covariance predictor, peak cue-evoked dopamine at CS onset; random factor, subject; dependent variable, cue-evoked change in lever presses or food-port entries; GraphPad Prism, GraphPad; SPSS, IBM). To evaluate whether cue-evoked dopamine (peak dopamine after CS onset) mediates the influence of the CS type on instrumental reward-seeking and reward-checking behavior, we used mediation analysis with the PROCESS package for SPSS, Model 4 with 2,000 bootstrap samples. We also used this approach to ask whether either reward checking mediates the influence of CS type on reward seeking and vice versa and to ask whether cue-induced reward checking mediates the influence of virus on reward seeking and vice versa. Alpha levels were set at p < 0.05.
Sex as a biological variable
Male and female rats were used in approximately equal numbers for each cohort of each experiment. Individual data points are visually disaggregated by sex. We did not detect any significant effect of sex or interaction between sex and the variables of interest (lowest p = 0.09).
Rigor and reproducibility
Group sizes were estimated a priori based on prior work using male Long–Evans rats in this behavioral task (Malvaez et al., 2015; Lichtenberg and Wassum, 2016; Lichtenberg et al., 2017; Sias et al., 2021, 2024) and to ensure counterbalancing of cue–reward probability pairings. Investigators were not blinded to viral group because they were required to administer virus. All behaviors were scored using automated software (MedPC). Each experiment included at least two replication cohorts, and cohorts were balanced by viral group, cue–reward probability pairings, sex, etc. prior to the start of the experiment.
Data and code availability
All data that support the findings of this study are available in Data S1 and from the corresponding author upon request. Custom-written MATLAB code is accessible via Dryad repository (https://zenodo.org/records/4926719) (Sias et al., 2021) and available from the corresponding author upon request.
Results
Reward prediction shapes reward-pursuit strategy
We first monitored NAc dopamine release as cues influenced reward-pursuit behaviors (Fig. 1a–c). Male and female rats were food restricted and received pavlovian conditioning. We used short-delay conditioning to encourage imminent reward prediction and conflicting instrumental reward-seeking and reward-checking strategies at test (Ostlund and Marshall, 2021). To evaluate the influence of reward prediction on both behavior and dopamine, we used two distinct, 10-s auditory cues (conditioned stimuli, CS) each of which predicted food-pellet reward with a different probability. The high-probability cue (CS90) coterminated with reward delivery on 90% of the trials. The low-probability cue (CS30) coterminated with reward on only 30% of the trials. Rats learned these differential reward probability predictions. By the end of training, they showed more conditional checks of (i.e., entries into) the food-delivery port during the high-probability cue than the low-probability cue (Fig. 1d). To provide rats an instrumental reward-seeking action, they were next trained to lever press to earn food-pellet rewards. All rats acquired the instrumental behavior (final average press rate = 17.27; SEM = 2.39). To ask how the cues affected instrumental seeking versus checking reward-pursuit strategies, we gave rats a PIT test. At test, each cue was presented in a pseudorandom order to assess its influence over lever pressing and checks of the food-delivery port. No rewards were delivered, such that cued reward predictions decreased across the test. We operationalized cue-induced instrumental reward seeking as lever presses during the cue. We defined reward checking as pavlovian conditional entries into the food-delivery port that occurred independent of an instrumental press-enter sequence, thereby excluding food-port entries directly linked to lever presses (Supplemental Fig. 1c–e; Marshall et al., 2023).
Figure 1.
Cue-evoked NAc dopamine is positively modulated by reward prediction and inversely relates to instrumental reward seeking. a, Left, fiber photometry approach for imaging GRABDA fluorescence changes in NAc core neurons. Right, Representative immunofluorescence image of NAc GRABDA2m expression and fiber placement. b, Fiber placement map. c, Pavlovian and instrumental conditioning schematic. CS, 10-s conditioned stimulus (Click or Tone) coterminating with food-pellet (Pel) reward on 30% (CS30) or 90% (CS90) of the trials. Press, lever press earns food pellet (Pel) on a random-interval reinforcement schedule. d, Food-port entries per 10-s baseline (BL) and CS period averaged across the last 2 d of pavlovian conditioning. One-way RM-ANOVA, F(2,26) = 24.18; p < 0.0001. e, PIT test schematic. Ø, no rewards were delivered at test. f, Lever presses for the 15-s CS (10 s CS+ 5 s postCS) and preceding 15-s baseline periods. Two-way RM-ANOVA, CS presence × CS type, F(1,13) = 4.83; p = 0.047; CS presence, F(1,13) = 21.48; p = 0.0005; CS type, F(1,13) = 2.50; p = 0.14. g, Cue-evoked change (Δ) in lever presses from baseline. Two-tailed t test, t(13) = 2.20; p = 0.047; 95% confidence interval (CI) −1.56 to −0.01. h, Food-port entries, excluding those directly linked to lever presses, for the 15-s CS and baseline periods. Two-way RM-ANOVA, CS presence × CS type, F(1,13) = 7.69; p = 0.02; CS presence, F(1,13) = 16.40; p = 0.001; CS type, F(1,13) = 2.56; p = 0.13. i, Cue-evoked change in food-port entries. Two-tailed t test, t(13) = 2.77; p = 0.02; 95% CI 0.11–0.88. j, Cue-evoked GRABDA fluorescence changes (Z-score). Waveform analysis, bCI, time points where the adjusted 95% bootstrap confidence interval for the difference between CS30 and CS90 excludes zero (10-sample cluster minimum); Perm, time points for which CS30 is significantly (p < 0.05) different from CS90 from permutation test. k, Peak CS onset-evoked GRABDA (DA) Z-score compared with preCS baseline. Two-way RM-ANOVA, CS onset × CS type:, F(1,13) = 13.88; p = 0.003; CS onset, F(1,13) = 49.91; p < 0.0001; CS type, F(1,13) = 23.25; p = 0.0003. l, Minimum (min) CS offset GRABDA Z-score relative to baseline before CS offset. Two-way RM-ANOVA, CS offset, F(1,13) = 20.20; p = 0.0006; CS type, F(1,13) = 1.08; p = 0.32; CS offset × CS type, F(1,13) = 0.56; p = 0.47. m–o, Linear regression model using convolved CS onset, offset, lever presses, and food-port entries to predict GRABDA signal at each time point 5 s prior to and 20 s after each cue onset from the event kernels. Average regression coefficient of each kernel around cue presentation (m), β coefficients from model (n; 2-way RM-ANOVA, CS type × event type, F(3,39) = 5.57; p = 0.003; event type, F(3,39) = 49.25; p < 0.0001; CS type, F(1,13) = 3.32; p = 0.09), and percentage of variance explained by each event kernel (o; 1-way RM-ANOVA, F(3, 39) = 62.06; p < 0.0001). p, β coefficients from multivariate general linear model with covariance predictor, peak cue onset-evoked dopamine; dependent variables, test trial, cue-evoked change in lever presses, and cue-evoked change in food-port entries (excluding those directly linked to presses). Overall model, F(3,254) = 15.79; p < 0.001; η2 = 0.16; extinction test trial, F(3,129) = 40.05; p < 0.001; η2 = 0.14; β = −0.67; SE = 0.11; t(256) = −6.33; p < 0.001; 95% CI −0.88 to −0.46; presses, F(1,129) = 10.88; p = 0.001; η2 = 0.04; β = −0.37; SE = 0.08; t(256) = −3.30; p = 0.001; 95% CI −0.44 to −0.11; food-port entries, F(1,129) = 2.54; p = 0.11; η2 = 0.01; β = 0.14; SE = 0.09; t(256) = 1.59; p = 0.11; 95% CI −0.03 to 0.32. q–s, Relationship between peak cue-evoked GRABDA Z-score and test trial (q; 2-tailed partial correlation, controlling for subject, r(261) = −0.37; p < 0.001.), cue-evoked change in lever presses (r; 2-tailed partial correlation, r(255) = −0.20; p < 0.001), or food-port entries (s; 2-tailed partial correlation, r(255) = −0.12; p = 0.06). t, Mediation analysis. CS (CS30→CS90) effect on cue onset-evoked dopamine, β = 0.98; SE = 0.19; t(256) = 5.15; p < 0.001; 95% CI 0.61–1.36; effect of cue-evoked dopamine on cue-evoked presses, β = −0.22; SE = 0.09; t(256) = −2.49; p = 0.01; 95% CI −0.38 to −0.05; direct effect of CS on presses, β = −0.60; SE = 0.28; t(256) = −2.18; p = 0.03; 95% CI −1.15 to −0.06; indirect effect of CS on presses mediated by dopamine, β = −0.21; BootSE = 0.13, BootCI −0.51 to −0.06. u, Mediation analysis. CS (CS30→CS90) effect on cue-evoked dopamine: β = 0.98, SE = 0.19, t256 = 5.15, P < 0.001, 95% CI 0.61–1.36; effect of cue-evoked dopamine on Cue-evoked food-port entries (excluding those directly linked to lever pressing): β = 0.11, SE = 0.09, t256 = 1.27, P = 0.20, 95% CI −0.06 - 0.30; Direct effect of CS on entries: β = 0.23, SE = 0.29, t256 = 0.80, P = 0.43, 95% CI - 0.35 - 0.83; Indirect effect of CS on entries mediated by dopamine: β = 0.12, BootSE = 0.09, BootCI −0.04 - 0.32. v, β coefficients from linear mixed models with covariance predictor, peak cue-evoked dopamine; dependent variable, cue-evoked change in lever presses; repeated factors, CS, trial, and random factor; subject [β = −0.21; standard error (SE) = 0.07; t(136.60) = −3.06; p = 0.003; 95% CI −0.35 to −0.08] and covariance predictor, peak cue-evoked dopamine; dependent variable, cue-evoked change in food-port entries; repeated factors, CS, trial, and random factor, subject (β = 0.15; SE = 0.08; t(139.73) = 1.89; p = 0.06; 95% CI −0.007 to 0.30). w, x, Correlation between actual cue-evoked change in presses (v; Pearson's r(258) = 0.20; p = 0.001) or food-port entries (w; Pearson's r(258) = 0.59; p < 0.0001) and that predicted by cue-evoked dopamine using the linear mixed model. Data presented as mean ± SEM. Males, solid lines, Females, dashed lines. *p < 0.05; **p < 0.01; ***p < 0.001, Bonferroni’s corrected.
Whereas cues that predict reward with low probability bias toward instrumental reward seeking, highly predictive cues bias toward checking for the expected reward (Marshall et al., 2020). Indeed, at the test, the low-probability cue increased lever pressing (Fig. 1f,g). Such instrumental reward seeking was not triggered in response to the high-probability cue. Instead, this cue preferentially elicited a reward-checking strategy. The high-probability cue caused more conditional entries into the food-delivery port than the low-probability cue (Fig. 1h,i). Because rats cannot readily physically lever press and check the food port at the same time, we conducted four analyses to assess whether overt response competition explains the differential performance of instrumental reward seeking versus reward checking during the low- versus high-probability cue. First, if response competition explains differential instrumental reward-seeking versus reward-checking behavior, then the cue-induced changes in lever presses and food-port entries should be significantly inversely correlated. They were not (partial correlation, controlling for subject, r(255) = −0.08; p = 0.19; within subject across trials Pearson's correlation, r(20) = −0.39; p = 0.09; between subjects Pearson's correlation, r(28) = −0.10; p = 0.60; partial correlation, controlling for subject using only the 10 s CS periods, r(255) = −0.04; p = 0.55). Second, if response competition explains the results, performance of one behavior should decrease the probability of another. It did not. During the cues, a food-port entry did not decrease the probability of a lever press, nor did a lever press decrease food-port entry probability (Supplemental Fig. 1f,g). Third, if response competition explains the differential instrumental reward seeking versus reward checking during the low- versus high-probability cue, then a high reward-checking response should preclude the low-probability cue from also promoting instrumental reward seeking. It did not. The low-probability cue caused greater instrumental reward seeking than the high-probability cue even on trials for which the cues triggered high (≥1 standard deviation above the mean) reward-checking behavior (Supplemental Fig. 1h). Lastly, neither did the cue-induced change in reward checking significantly mediate the influence of the CS type on instrumental reward seeking, nor did the cue-induced change in reward seeking significantly mediate the influence of the CS type on reward checking (Supplemental Fig. 1i,j). Thus, similar to prior reports (Marshall et al., 2023), although instrumental reward seeking and reward checking are competing responses, their differential performance during the low- versus high-probability cues was not due to overt response competition. There were modest changes in elicited behavioral strategy across test trials (Supplemental Fig. 1k,l). Most notably, initially, the high-probability cue suppressed instrumental reward seeking, but this seeking response increased as reward prediction weakened across trials. Thus, reward prediction shapes reward-pursuit strategy. Cues that signal imminent reward with high probability preferentially elicit a strategy of checking for the expected reward. Conversely, cues that signal reward with low probability bias toward instrumental reward seeking.
Cue-evoked NAc dopamine is positively modulated by reward prediction and inversely relates to instrumental reward seeking
We exploited this task to ask the extent to which cue-evoked NAc dopamine release is shaped by reward prediction and relates to reward-pursuit behaviors. We used fiber photometry to record fluorescent activity of the G-protein–coupled receptor activation-based dopamine sensor (GRABDA) in the NAc core during the PIT test (Fig. 1a–c,e). The onset of both cues triggered robust, transient dopamine release (Fig. 1j,k; see Supplemental Fig. 1v for nonsubtracted GRABDA fluorescence response). We also detected a dopamine dip at cue offset, when the predicted reward would have been delivered but was omitted (Fig. 1j,l), and transient dopamine elevations prior to instrumental reward-seeking and reward-checking behaviors during the cues (Supplemental Fig. 1p–u). If dopamine is shaped by reward prediction, the high-probability cue should trigger more dopamine release than the low-probability cue. Indeed, the cue-evoked dopamine response was larger for the high- than low-probability cue (Fig. 1j,k). If cue-evoked dopamine is shaped by reward prediction, then it should also have declined as the reward prediction weakened across trials of the unrewarded test. This was the case (Fig. 1n; Supplemental Fig. 1m). Because lever pressing and food-port entries can freely occur during cue presentation, we used a linear regression model to parse the extent to which dopamine fluctuations are explained by the cues themselves versus concomitant behavioral responses (Parker et al., 2016; Greenstreet et al., 2025). The model included cue onset and offset, lever presses, and food-port entries. Dopamine release during the cues was best explained by the CS onset kernel, indicating that the differential dopamine response to the high- versus low-probability cue was due to the cues themselves rather than the differential behavioral responses they triggered (Fig. 1m,n). The influence of CS on dopamine was stronger for the high-probability cue than the low-probability cue. Thus, cue-evoked NAc dopamine is shaped by reward prediction occurring at cue onset. Stronger reward predictions cause greater cue-evoked NAc dopamine release.
We next further probed the relationship between cue-evoked NAc dopamine and reward prediction and asked how this signal relates to the influence of cues on reward-pursuit strategy. We first used a multivariate general linear model including data from each trial for each subject to ask the extent to which cue-evoked dopamine, measured by the peak dopamine response to cue onset, relates to the declining reward prediction resulting from extinction across the test (defined as test trial) and cue-induced changes in instrumental reward-seeking and reward-checking behavior (Fig. 1p). Cue-evoked dopamine significantly related to this multivariate combination. If dopamine generally promotes reward pursuit, it should positively relate to both instrumental reward-seeking and reward-checking behaviors or perhaps just instrumental reward seeking (du Hoffmann and Nicola, 2014; Hamid et al., 2015; Syed et al., 2016). If, however, dopamine supports reward prediction to shape reward-pursuit strategy, it should inversely relate to test trial and differentially relate to instrumental reward-seeking versus reward-checking behavior. The data support the latter. Cue-evoked dopamine significantly inversely related to test trial (Fig. 1p,q), indicating that as reward prediction weakened, so too did the cue-evoked dopamine. Thus, cue-evoked dopamine tracks trial-dependent changes in reward prediction. Cue-evoked dopamine also significantly inversely related to cue-induced instrumental reward seeking (Fig. 1p,r) but did not significantly relate to reward-checking behavior (Fig. 1p,s). The negative relationship between cue-evoked dopamine and cue-evoked instrumental reward seeking held true both between and within subjects (Supplemental Fig. 1w,x). Subjects for which the cues elicited a larger dopamine response showed less cue-evoked instrumental reward seeking. On trials in which the cue elicited a larger dopamine response it also tended to trigger less instrumental reward seeking. Thus, larger cue-evoked dopamine is associated with stronger reward predictions and less instrumental reward seeking. We next used mediation analyses to ask whether cue-evoked dopamine mediates the influence of the cued reward prediction on reward-pursuit strategy. We found that the magnitude of the peak cue-evoked dopamine response explains a meaningful portion of the influence of the cued reward prediction (CS30 vs CS90) on instrumental reward seeking (Fig. 1t). Dopamine did not significantly mediate the influence of the CS type on reward checking (Fig. 1u). Lastly, we asked whether the peak cue-evoked dopamine response could predict cue-induced behavior. Using a linear mixed-model analysis, we were able to reliably inversely predict instrumental reward seeking from cue-evoked dopamine (Fig. 1w,v; Supplemental Fig. 1n), indicating larger cue-evoked NAc dopamine predicts less instrumental reward seeking. Cue-evoked reward checking was positively, though not statistically significantly, predicted from cue-evoked dopamine (Fig. 1v,x; Supplemental Fig. 1o). Together, these results indicate that cue-evoked NAc dopamine is positively modulated by reward prediction and inversely relates to instrumental reward seeking. Stronger cue-evoked reward predictions elicit more NAc dopamine release, and this is associated with less instrumental reward seeking.
Cue-evoked NAc core dopamine mediates the influence of cued reward prediction on reward pursuit
We next asked whether cue-evoked NAc dopamine release mediates the influence of cued reward prediction on reward-pursuit behaviors. Because we found cue-evoked dopamine is positively modulated by reward prediction and inversely relates to instrumental reward seeking, we reasoned that cue-evoked NAc core dopamine may support reward prediction to shape reward-pursuit strategy. Large cue-evoked NAc core dopamine may support high imminent reward prediction to constrain instrumental reward seeking in favor of checking for the strongly predicted reward. This leads to the intriguing, perhaps surprising, prediction that inhibition of cue-evoked NAc dopamine release should increase instrumental reward seeking and decrease reward checking.
We tested this using optogenetic inhibition of cue-evoked NAc dopamine release during a PIT test (Fig. 2a–c). We cre-dependently expressed the inhibitory opsin ArchT bilaterally in ventral tegmental area dopamine (VTADA) neurons of male and female Th-cre rats (Fig. 2a,b) and implanted optical fibers bilaterally over the NAc core (Fig. 2b). For controls, we either cre-dependently expressed tdTomato bilaterally in VTADA neurons of Th-cre rats or infused a control mCherry AAV in wild-type (Th-cre−) rats and, in both cases, implanted optical fibers bilaterally over the NAc core. Rats were food restricted and received pavlovian short-delay conditioning, as above, during which two distinct, 10-s auditory cues each predicted a food-pellet reward with either high (90%) or low (30%) probability. Rats learned these differential reward probability predictions (Supplemental Fig. 2a). Rats then received instrumental conditioning to lever press to earn food-pellet rewards (Supplemental Fig. 2b). They were then given a PIT test during which the lever was available, and each cue was presented in a pseudorandom order to assess its influence over instrumental reward-seeking lever presses and checks of the food-delivery port. No rewards were delivered at test. We optically inhibited (532 nm, 10 mW, 2.5 s) VTADA axons and terminals in the NAc coincident with each cue during this test. We restricted optical inhibition to cue onset to inhibit only the phasic cue-induced dopamine elevation. Reward prediction influenced reward-pursuit strategy in controls. Only the low-probability cue increased instrumental reward seeking (Fig. 2d,e). The high-probability cue increased reward checking more than the low-probability cue (Fig. 2f,g). Optical inhibition of cue-evoked VTADA→NAc activity elevated the instrumental reward-seeking response to both cues (Fig. 2d,e) and decreased cue-evoked reward checking during the high-probability cue (Fig. 2f,g; see Supplemental Fig. 2e,f for data on all entries and press-linked entries). These effects were not correlated (two-tailed, between-subject Pearson's r, control, CS30, r(12) = 0.27; p = 0.39; CS90, r(12) = −0.10; p = 0.76; both CSs, CS30, r(24) = −0.01; p = 0.95; ArchT, CS30, r(14) = 0.22; p = 0.44; CS90, r(14) = −0.18; p = 0.55; both CSs, CS30, r(28) = −0.03; p = 0.88). Moreover, the cue-induced change in reward checking did not significantly mediate the influence of Group (control→ArchT) on cue-induced instrumental reward seeking (indirect effect of group on cue-induced food-port entries mediated by cue-induced presses, β = 0.01; BootSE = 0.09; BootCI −0.15 to 0.22) and neither did cue-induced reward seeking significantly mediate the influence of the group on reward checking (indirect effect of group on cue-induced food-port entries mediated by cue-induced presses: β = −0.009; BootSE = 0.06; BootCI −0.17 to 0.11). Thus, the VTADA→NAc inhibition-induced increase in instrumental reward seeking was not a secondary consequence of the decrease in reward checking or vice versa. Despite inhibition occurring only at cue onset, these effects persisted throughout the duration of the cue period (Supplemental Fig. 2c,d). Thus, cue-evoked, transient, NAc core dopamine release mediates the influence of reward prediction on reward-pursuit strategy, which, in this case of imminent reward prediction, opposes instrumental reward seeking and promotes checking for a highly predicted reward.
Figure 2.
Cue-evoked NAc core dopamine constrains instrumental reward seeking and promotes reward checking. a, Left, Optogenetic approach for bilateral inhibition of VTADA→NAc projections. Right top, Representative image of fiber placement in the vicinity of immunofluorescent ArchT-tdTomato-expressing VTADA axons and terminals in NAc. Right bottom, Representative immunofluorescent image of ArchT-tdTomato expression in VTADA (Th+) neurons. b, VTA ArchT expression and NAc fiber placement maps. c, Task training and test schematic. CS, 10-s conditioned stimulus (Click or Tone) coterminating with food-pellet (Pel) reward on 30% (CS30) or 90% (CS90) of the trials. Press, lever press earns food-pellet (Pel) reward on a random-interval reinforcement schedule. Ø, no rewards were delivered. d, Lever presses for the 15-s CS (10-s CS + 5-s postCS) and preceding baseline periods. Three-way RM-ANOVA, virus × CS presence, F(1,24) = 4.48; p = 0.04; virus, F(1,24) = 6.75; p = 0.02; CS presence, F(1,24) = 36.92; p < 0.0001; CS presence × CS type, F(1,24) = 3.44; p = 0.07; CS type, F(1,24) = 1.07; p = 0.31; virus × CS type, F(1,24) = 0.06; p = 0.81; virus × CS presence × CS type, F(1,24) = 0.57; p = 0.46. e, Cue-evoked change (Δ) in lever presses from baseline. Two-way RM-ANOVA, CS type, F(1,24) = 6.33; p = 0.02; virus, F(1,24) = 2.58; p = 0.12; virus × CS type, F(1,24) = 1.97; p = 0.17. f, Food-port entries, excluding those directly linked to lever presses, for the 15-s CS and preceding baseline periods. Three-way RM-ANOVA, virus × CS presence, F(1,24) = 5.68; p = 0.03; CS presence × CS type, F(1,24) = 9.90; p = 0.004; virus × CS presence × CS type, F(1,24) = 3.72; p = 0.07; CS presence, F(1,24) = 137.90; p < 0.0001; CS type, F(1,24) = 5.86; p = 0.02; virus, F(1,24) = 3.82; p = 0.06; virus × CS type, F(1,24) = 1.22; p = 0.28. g, Cue-evoked change in food-port entries. Two-way RM-ANOVA, virus, F(1,24) = 5.66; p = 0.03; CS type, F(1,24) = 10.18; p = 0.004; virus × CS type, F(1,24) = 3.65; p = 0.07. Control, N = 12 rats (6 male; 9 Th-cre+, 3 TH-cre−) ArchT; N = 14 Th-cre + rats (8 male). Data presented as mean ± SEM. Males, solid lines; females, dashed lines. *p < 0.05; **p < 0.01; ***p < 0.001; Bonferroni’s corrected.
Discussion
Here we investigated whether cue-evoked dopamine supports reward prediction to shape reward-pursuit strategy. We found that cue-evoked NAc core dopamine is positively related to reward prediction and inversely related to instrumental reward seeking. Cues that predict imminent reward with high probability trigger a large dopamine response and checking for the expected reward in the delivery location rather than instrumental reward seeking. Cues that predict reward with low probability elicit less dopamine and bias toward instrumental reward seeking rather than checking. Correspondingly, NAc dopamine mediates the influence of reward prediction on reward-pursuit strategy. Cue-evoked NAc dopamine release to short-delay cues opposes instrumental reward seeking and promotes checking for a highly predicted reward. Thus, cue-evoked NAc dopamine supports high imminent reward prediction to constrain instrumental reward seeking in favor of a pavlovian reward-checking strategy.
Reward prediction shapes how reward is pursued. Consistent with prior reports (Marshall et al., 2020), we found that cues that signal imminent reward with high probability tend to elicit a strategy of checking for the expected reward in its delivery location. Conversely, low-probability cues preferentially trigger instrumental reward seeking. This was not simply due to overt response competition (Marshall et al., 2023). Rather it reflects distinct, yet conflicting, global versus focal reward-pursuit strategies (Timberlake, 1994; Marshall et al., 2023). Reward-pursuit strategies were selected on the fly in a novel situation, without any prior reinforcement, indicating they were shaped by reward predictions. Cue-evoked reward predictions may therefore help to flexibly resolve conflict between competing response tendencies (Marshall et al., 2023). Our results are consistent with evidence that cue-evoked predictions of the probability (Marshall et al., 2020), timing (Lovibond, 1981; Crombag et al., 2008; Marshall and Ostlund, 2018), and value (Marshall et al., 2023) of reward regulate reward-pursuit strategy.
That strong reward prediction constrains instrumental reward seeking in favor of checking for the expected reward is particularly the case for cues that signal imminent, noncontingent reward (Konorski, 1967; Ostlund and Marshall, 2021), as we used here. Indeed, long-duration cues that set the occasion for sporadic, infrequent reward tend to promote instrumental reward seeking (Crombag et al., 2008; Wassum et al., 2013; Collins et al., 2016; Halbout et al., 2019). Our one-outcome/one-lever design limits understanding of whether reward pursuit was driven by the predicted reward identity (i.e., specific PIT), more general motivational properties (i.e., general PIT), or, perhaps, a process unique to cues that signal imminent reward (Ostlund and Marshall, 2021; Marshall et al., 2023). Toward the latter, whereas both specific and general PIT to loosely predictive cues are insensitive to devaluation of the predicted reward (Colwill and Rescorla, 1990; Rescorla, 1994; Holland, 2004), reward devaluation reverses the typically suppressive effect of high-probability, imminent reward-predicting cues to promote instrumental reward seeking (Marshall et al., 2023). Thus, the psychological processes through which short-delay cues influence reward pursuit and the extent to which they differ from long-delay and/or loosely predictive cues are important questions for future investigation. Such studies would also benefit from asking whether cue-evoked seeking versus checking behavior is also shaped by the strength and nature of the instrumental association.
NAc core dopamine is positively modulated by cue-evoked reward prediction. Consistent with prior reports (Roitman et al., 2004; Day et al., 2007, 2010; Flagel et al., 2011; Wassum et al., 2013; Saddoris et al., 2015; Aitken et al., 2016; Collins et al., 2016; Sun et al., 2018; Kutlu et al., 2021; Garr et al., 2024; Bornhoft et al., 2025), we found that reward-predictive cues trigger phasic dopamine release in the NAc core. We discovered that this signal is positively shaped by reward prediction. Cues that signal reward with high probability elicit more NAc dopamine than low-probability cues, and cue-evoked dopamine tracks trial-dependent changes in reward prediction. This accords with prior evidence of reward probability and value encoding in NAc dopamine release (Gan et al., 2009; Day et al., 2010; Hart et al., 2015; Aitken et al., 2016; Syed et al., 2016; Garr et al., 2024). An important future question is the extent to which dopamine is modulated by other features of the predicted reward. Whereas probability and general value shape NAc cue-evoked dopamine, specific features may not (Halbout et al., 2019; Taira et al., 2024). Whether dopamine's modulation by reward prediction is associated with its signaling of prediction error (Schultz et al., 1997; Steinberg et al., 2013; Hart et al., 2014) and/or salience (Kutlu et al., 2021, 2022) is also ripe for investigation.
Cue-evoked NAc dopamine mediates the influence of reward prediction on reward-pursuit strategy. Cue-evoked NAc core dopamine was not only shaped by reward prediction but also inversely related to and predicted cue-evoked instrumental reward seeking. Larger cue-evoked dopamine is associated with stronger reward predictions and less instrumental reward seeking. Correspondingly, we found that inhibition of cue-evoked NAc dopamine increased instrumental reward seeking. It also decreased reward checking, though it did not fully suppress this behavior, consistent with prior evidence (Lex and Hauber, 2008; Flagel et al., 2011; Saunders and Robinson, 2012; Halbout et al., 2019). Therefore, short-delay cue–evoked NAc core dopamine release constrains instrumental reward seeking and promotes the reward-checking strategy. Despite only brief inhibition at cue onset, the behavioral effects persisted during and immediately after the cue. Thus, the cue-evoked dopamine transients can support a transition in the reward prediction state (Kalmbach et al., 2022) that controls subsequent reward-pursuit strategy. Because NAc dopamine is shaped by reward prediction, its inhibition may disrupt reward prediction, thereby causing selection of the reward-pursuit strategy more consistent with a low probability of noncontingent reward: instrumental reward seeking. It is also plausible that this manipulation removed the general motivational value of the reward prediction leaving other reward features, like identity, intact to drive PIT through an associative priming or outcome-response process (Rescorla, 1992; Balleine and Ostlund, 2007; Watson et al., 2018). Indeed, NAc core dopamine is unlikely to be necessary for such identity information (Corbit and Balleine, 2011; Taira et al., 2024). Further arbitration of these possibilities will help refine understanding of NAc core cue-evoked dopamine function. In either case, these results indicate that cue-evoked NAc dopamine mediates the influence of reward prediction on reward-pursuit strategy to flexibly constrain instrumental reward seeking and promote a more focal reward-checking strategy.
Differences between our findings and prior work reveal important possibilities of how NAc dopamine function may differ based on reinforcement history and the duration, strength, and nature of reward prediction. Our evidence that cue-evoked NAc dopamine inversely relates to instrumental reward seeking contrasts with findings that cues elicit more NAc dopamine when they promote incentive motivation (Flagel et al., 2011) or the need to instrumentally seek reward (Syed et al., 2016) than when they encourage waiting at the reward delivery location. Unlike the present design, in these studies, reward-pursuit strategy was reinforced. Reinforcement may cache the value of the action to the predictive cue, such that the cue-evoked dopamine not only supports reward prediction but also the reinforced motivational value of instrumental reward seeking (Hamid et al., 2015; Syed et al., 2016). Thus, the information dopamine conveys and how it influences reward pursuit may differ if reward-pursuit strategies have been reinforced versus are being determined on the fly. Our results also contrast with those indicating that tonic inactivation of NAc dopamine input (Halbout et al., 2019) or receptors (Lex and Hauber, 2008) attenuates instrumental reward seeking in response to long-duration, loosely predictive reward. This could reflect differences in tonic versus phasic dopamine function (Niv et al., 2007; Schultz, 2007). However, it could also indicate that dopamine function depends on the duration, strength, and nature of reward prediction. These variables may shape the downstream circuitry engaged by the cue. Whereas strong, imminent reward prediction may engage circuitry to constrain global, instrumental reward seeking and promote focal reward checking, cues that signal less, delayed, uncertain, and/or infrequent reward may engage distinct circuitry to promote instrumental reward seeking. Cue-evoked dopamine may accentuate whichever reward-pursuit circuit is engaged. Another critical question is whether dopamine in regions outside the NAc, like the basolateral amygdala (Sias et al., 2024), dorsal striatum (Ostlund et al., 2011; Bernklau et al., 2024), and medial prefrontal cortex (Floresco et al., 2006), also contributes to reward predictions and shaping reward-pursuit behavior. Dopamine is likely to have unique function based on function of the region in which it is released.
Dopamine, including that elicited by cues (Maes et al., 2020), has a well-established function as a teaching signal to support learning (Waelti et al., 2001; Schultz, 2002; Lerner et al., 2021). Our results add to a growing body of evidence that dopamine does not simply function retrospectively in learning but also prospectively to regulate behavior (Howe and Dombeck, 2016; Schultz, 2016; Berke, 2018; Kaźmierczak and Nicola, 2022). They add that NAc core dopamine can support reward prediction to flexibly constrain versus promote conflicting reward-pursuit strategies. Inability to adaptively regulate reward-pursuit behaviors is a symptom of psychiatric conditions, including depression and addictions, conditions that are also marked by dopamine disruption. Thus, these data also aid our understanding and treatment of motivational symptoms of psychiatric disease.
References
- Aitken TJ, Greenfield VY, Wassum KM (2016) Nucleus accumbens core dopamine signaling tracks the need-based motivational value of food-paired cues. J Neurochem 136:1026–1036. 10.1111/jnc.13494 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Anselme P, Güntürkün O (2018) How foraging works: uncertainty magnifies food-seeking motivation. Behav Brain Sci 42:e35. 10.1017/S0140525X18000948 [DOI] [PubMed] [Google Scholar]
- Azrin NH, Hake DF (1969) Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli. J Exp Anal Behav 12:167–173. 10.1901/jeab.1969.12-167 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW, Ostlund SB (2007) Still at the choice-point: action selection and initiation in instrumental conditioning. Ann N Y Acad Sci 1104:147–171. 10.1196/annals.1390.006 [DOI] [PubMed] [Google Scholar]
- Beeler JA, Frazier CR, Zhuang X (2012) Putting desire on a budget: dopamine and energy expenditure, reconciling reward and resources. Front Integr Neurosci 6:49. 10.3389/fnint.2012.00049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berke JD (2018) What does dopamine mean? Nat Neurosci 21:787–793. 10.1038/s41593-018-0152-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bernklau TW, Righetti B, Mehrke LS, Jacob SN (2024) Striatal dopamine signals reflect perceived cue-action-outcome associations in mice. Nat Neurosci 27:747–757. 10.1038/s41593-023-01567-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bornhoft KN, Prohofsky J, O'Neal TJ, Wolff AR, Saunders BT (2025) Striatal dopamine represents valence on dynamic regional scales. J Neurosci 45:e1551242025. 10.1523/JNEUROSCI.1551-24.2025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins AL, Aitken TJ, Greenfield VY, Ostlund SB, Wassum KM (2016) Nucleus accumbens acetylcholine receptors modulate dopamine and motivation. Neuropsychopharmacology 41:2830–2838. 10.1038/npp.2016.81 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins AL, Aitken TJ, Huang IW, Shieh C, Greenfield VY, Monbouquette HG, Ostlund SB, Wassum KM (2019) Nucleus accumbens cholinergic interneurons oppose cue-motivated behavior. Biol Psychiatry 86:388–396. 10.1016/j.biopsych.2019.02.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Colwill RM, Rescorla RA (1990) Effect of reinforcer devaluation on discriminative control of instrumental behavior. J Exp Psychol Anim Behav Process 16:40–47. 10.1037/0097-7403.16.1.40 [DOI] [PubMed] [Google Scholar]
- Corbit LH, Balleine BW (2011) The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J Neurosci 31:11786–11794. 10.1523/JNEUROSCI.2711-11.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbit LH, Balleine BW (2016) Learning and motivational processes contributing to Pavlovian-instrumental transfer and their neural bases: dopamine and beyond. Curr Top Behav Neurosci 27:259–289. 10.1007/7854_2015_388 [DOI] [PubMed] [Google Scholar]
- Crombag HS, Galarce EM, Holland PC (2008) Pavlovian influences on goal-directed behavior in mice: the role of cue-reinforcer relations. Learn Mem 15:299–303. 10.1101/lm.762508 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Day JJ, Roitman MF, Wightman RM, Carelli RM (2007) Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10:1020–1028. 10.1038/nn1923 [DOI] [PubMed] [Google Scholar]
- Day JJ, Jones JL, Wightman RM, Carelli RM (2010) Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol Psychiatry 68:306–309. 10.1016/j.biopsych.2010.03.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
- du Hoffmann J, Nicola SM (2014) Dopamine invigorates reward seeking by promoting cue-evoked excitation in the nucleus accumbens. J Neurosci 34:14349–14364. 10.1523/JNEUROSCI.3492-14.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flagel SB, Clark JJ, Robinson TE, Mayo L, Czuh A, Willuhn I, Akers CA, Clinton SM, Phillips PEM, Akil H (2011) A selective role for dopamine in stimulus-reward learning. Nature 469:53–57. 10.1038/nature09588 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Floresco SB, Magyar O, Ghods-Sharifi S, Vexelman C, Tse MT (2006) Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting. Neuropsychopharmacology 31:297–309. 10.1038/sj.npp.1300825 [DOI] [PubMed] [Google Scholar]
- Gan JO, Walton ME, Phillips PE (2009) Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nat Neurosci 13:25–27. 10.1038/nn.2460 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garr E, Cheng Y, Jeong H, Brooke S, Castell L, Bal A, Magnard R, Namboodiri VMK, Janak PH (2024) Mesostriatal dopamine is sensitive to changes in specific cue-reward contingencies. Sci Adv 10:eadn4203. 10.1126/sciadv.adn4203 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greenstreet F, et al. (2025) Dopaminergic action prediction errors serve as a value-free teaching signal. Nature 643:1333–1342. 10.1038/s41586-025-09008-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Halbout B, Marshall AT, Azimi A, Liljeholm M, Mahler SV, Wassum KM, Ostlund SB (2019) Mesolimbic dopamine projections mediate cue-motivated reward seeking but not reward retrieval in rats. Elife 8:e43551. 10.7554/eLife.43551 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Halbout B, Hutson C, Wassum KM, Ostlund SB (2022) Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation. Front Behav Neurosci 16:999320. 10.3389/fnbeh.2022.999320 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hamid AA, Pettibone JR, Mabrouk OS, Hetrick VL, Schmidt R, Vander Weele CM, Kennedy RT, Aragona BJ, Berke JD (2015) Mesolimbic dopamine signals the value of work. Nat Neurosci 19:117–126. 10.1038/nn.4173 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hart AS, Rutledge RB, Glimcher PW, Phillips PE (2014) Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci 34:698–704. 10.1523/JNEUROSCI.2489-13.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hart AS, Clark JJ, Phillips PE (2015) Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning. Neurobiol Learn Mem 117:84–92. 10.1016/j.nlm.2014.07.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holland PC (2004) Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J Exp Psychol Anim Behav Process 30:104–117. 10.1037/0097-7403.30.2.104 [DOI] [PubMed] [Google Scholar]
- Howe MW, Dombeck DA (2016) Rapid signalling in distinct dopaminergic axons during locomotion and reward. Nature 535:505–510. 10.1038/nature18942 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jean-Richard-Dit-Bressel P, Clifford CWG, McNally GP (2020) Analyzing event-related transients: confidence intervals, permutation tests, and consecutive thresholds. Front Mol Neurosci 13:14. 10.3389/fnmol.2020.00014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jentsch JD, Pennington ZT (2014) Reward, interrupted: inhibitory control and its relevance to addictions. Neuropharmacology 76:479–486. 10.1016/j.neuropharm.2013.05.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kalmbach A, Winiger V, Jeong N, Asok A, Gallistel CR, Balsam PD, Simpson EH (2022) Dopamine encodes real-time reward availability and transitions between reward availability states on different timescales. Nat Commun 13:3805. 10.1038/s41467-022-31377-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaźmierczak M, Nicola SM (2022) The arousal-motor hypothesis of dopamine function: evidence that dopamine facilitates reward seeking in part by maintaining arousal. Neuroscience 499:64–103. 10.1016/j.neuroscience.2022.07.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Konorski J (1967) Integrative activity of the brain: an interdisciplinary approach. Chicago: University of Chicago Press. [Google Scholar]
- Kutlu MG, Zachry JE, Melugin PR, Cajigas SA, Chevee MF, Kelly SJ, Kutlu B, Tian L, Siciliano CA, Calipari ES (2021) Dopamine release in the nucleus accumbens core signals perceived saliency. Curr Biol 31:4748–4761.e8. 10.1016/j.cub.2021.08.052 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kutlu MG, et al. (2022) Dopamine signaling in the nucleus accumbens core mediates latent inhibition. Nat Neurosci 25:1071–1081. 10.1038/s41593-022-01126-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Le Heron C, Apps MAJ, Husain M (2018) The anatomy of apathy: a neurocognitive framework for amotivated behaviour. Neuropsychologia 118:54–67. 10.1016/j.neuropsychologia.2017.07.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lerner TN, Holloway AL, Seiler JL (2021) Dopamine, updated: reward prediction error and beyond. Curr Opin Neurobiol 67:123–130. 10.1016/j.conb.2020.10.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levy R, Dubois B (2006) Apathy and the functional anatomy of the prefrontal cortex-basal ganglia circuits. Cereb Cortex 16:916–928. 10.1093/cercor/bhj043 [DOI] [PubMed] [Google Scholar]
- Lex A, Hauber W (2008) Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer. Learn Mem 15:483–491. 10.1101/lm.978708 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lichtenberg NT, Wassum KM (2016) Amygdala mu-opioid receptors mediate the motivating influence of cue-triggered reward expectations. Eur J Neurosci 45:381–387. 10.1111/ejn.13477 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lichtenberg NT, Pennington ZT, Holley SM, Greenfield VY, Cepeda C, Levine MS, Wassum KM (2017) Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations. J Neurosci 37:8374–8384. 10.1523/JNEUROSCI.0486-17.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lopes G, et al. (2015) Bonsai: an event-based framework for processing and controlling data streams. Front Neuroinform 9:7. 10.3389/fninf.2015.00007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lovibond PF (1981) Appetitive Pavlovian-instrumental interactions: effects of inter-stimulus interval and baseline reinforcement conditions. Q J Exp Psychol B 33:257–269. 10.1080/14640748108400811 [DOI] [PubMed] [Google Scholar]
- Maes EJP, Sharpe MJ, Usypchuk AA, Lozzi M, Chang CY, Gardner MPH, Schoenbaum G, Iordanova MD (2020) Causal evidence supporting the proposal that dopamine transients function as temporal difference prediction errors. Nat Neurosci 23:176–178. 10.1038/s41593-019-0574-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Malvaez M, Greenfield VY, Wang AS, Yorita AM, Feng L, Linker KE, Monbouquette HG, Wassum KM (2015) Basolateral amygdala rapid glutamate release encodes an outcome-specific representation vital for reward-predictive cues to selectively invigorate reward-seeking actions. Sci Rep 5:12511. 10.1038/srep12511 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marshall AT, Ostlund SB (2018) Repeated cocaine exposure dysregulates cognitive control over cue-evoked reward-seeking behavior during Pavlovian-to-instrumental transfer. Learn Mem 25:399–409. 10.1101/lm.047621.118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marshall AT, Munson CN, Maidment NT, Ostlund SB (2020) Reward-predictive cues elicit excessive reward seeking in adolescent rats. Dev Cogn Neurosci 45:100838. 10.1016/j.dcn.2020.100838 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marshall AT, Halbout B, Munson CN, Hutson C, Ostlund SB (2023) Flexible control of Pavlovian-instrumental transfer based on expected reward value. J Exp Psychol Anim Learn Cogn 49:14–30. 10.1037/xan0000348 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191:507–520. 10.1007/s00213-006-0502-4 [DOI] [PubMed] [Google Scholar]
- Ostlund S, Marshall A (2021) Probing the role of reward expectancy in Pavlovian-instrumental transfer. Curr Opin Behav Sci 41:106–113. 10.1016/j.cobeha.2021.04.021 [DOI] [Google Scholar]
- Ostlund SB, Wassum KM, Murphy NP, Balleine BW, Maidment NT (2011) Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J Neurosci 31:200–207. 10.1523/JNEUROSCI.4759-10.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parker NF, Cameron CM, Taliaferro JP, Lee J, Choi JY, Davidson TJ, Daw ND, Witten IB (2016) Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target. Nat Neurosci 19:845–854. 10.1038/nn.4287 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rescorla RA (1994) Transfer of instrumental control mediated by a devalued outcome. Anim Learn Behav 22:27–33. 10.3758/BF03199953 [DOI] [Google Scholar]
- Rescorla R (1992) Response-outcome versus outcome-response associations in instrumental learning. Anim Learn Behav 20:223–232. 10.3758/BF03213376 [DOI] [Google Scholar]
- Robinson TE, Berridge KC (2025) The incentive-sensitization theory of addiction 30 years on. Annu Rev Psychol 76:29–58. 10.1146/annurev-psych-011624-024031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM (2004) Dopamine operates as a subsecond modulator of food seeking. J Neurosci 24:1265–1271. 10.1523/JNEUROSCI.3823-03.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saddoris MP, Sugam JA, Stuber GD, Witten IB, Deisseroth K, Carelli RM (2015) Mesolimbic dopamine dynamically tracks, and is causally linked to, discrete aspects of value-based decision making. Biol Psychiatry 77:903–911. 10.1016/j.biopsych.2014.10.024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saunders BT, Robinson TE (2012) The role of dopamine in the accumbens core in the expression of Pavlovian-conditioned responses. Eur J Neurosci 36:2521–2532. 10.1111/j.1460-9568.2012.08217.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593–1599. 10.1126/science.275.5306.1593 [DOI] [PubMed] [Google Scholar]
- Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241–263. 10.1016/S0896-6273(02)00967-4 [DOI] [PubMed] [Google Scholar]
- Schultz W (2007) Multiple dopamine functions at different time courses. Annu Rev Neurosci 30:259–288. 10.1146/annurev.neuro.28.061604.135722 [DOI] [PubMed] [Google Scholar]
- Schultz W (2016) Dopamine reward prediction-error signalling: a two-component response. Nat Rev Neurosci 17:183–195. 10.1038/nrn.2015.26 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sias AC, et al. (2021) A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories. Elife 10:e68617. 10.7554/eLife.68617 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sias AC, Jafar Y, Goodpaster CM, Ramírez-Armenta K, Wrenn TM, Griffin NK, Patel K, Lamparelli AC, Sharpe MJ, Wassum KM (2024) Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories. Nat Neurosci 27:728–736. 10.1038/s41593-024-01586-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steinberg EE, Keiflin R, Boivin JR, Witten IB, Deisseroth K, Janak PH (2013) A causal link between prediction errors, dopamine neurons and learning. Nat Neurosci 16:966–973. 10.1038/nn.3413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stephens DW, Krebs JR (1986) Foraging theory. Princeton, NJ: Princeton University Press. [Google Scholar]
- Sun F, et al. (2018) A genetically encoded fluorescent sensor enables rapid and specific detection of dopamine in flies, fish, and mice. Cell 174:481–496.e19. 10.1016/j.cell.2018.06.042 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Syed EC, Grima LL, Magill PJ, Bogacz R, Brown P, Walton ME (2016) Action initiation shapes mesolimbic dopamine encoding of future rewards. Nat Neurosci 19:34–36. 10.1038/nn.4187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taira M, Millard SJ, Verghese A, DiFazio LE, Hoang IB, Jia R, Sias A, Wikenheiser A, Sharpe MJ (2024) Dopamine release in the nucleus accumbens core encodes the general excitatory components of learning. J Neurosci 44:e0120242024. 10.1523/JNEUROSCI.0120-24.2024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Timberlake W (1994) Behavior systems, associationism, and Pavlovian conditioning. Psychon Bull Rev 1:405–420. 10.3758/BF03210945 [DOI] [PubMed] [Google Scholar]
- Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43–48. 10.1038/35083500 [DOI] [PubMed] [Google Scholar]
- Wassum KM, Ostlund SB, Loewinger GC, Maidment NT (2013) Phasic mesolimbic dopamine release tracks reward seeking during expression of Pavlovian-to-instrumental transfer. Biol Psychiatry 73:747–755. 10.1016/j.biopsych.2012.12.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watson P, Wiers RW, Hommel B, de Wit S (2018) Motivational sensitivity of outcome-response priming: experimental research and theoretical models. Psychon Bull Rev 25:2069–2082. 10.3758/s13423-018-1449-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data that support the findings of this study are available in Data S1 and from the corresponding author upon request. Custom-written MATLAB code is accessible via Dryad repository (https://zenodo.org/records/4926719) (Sias et al., 2021) and available from the corresponding author upon request.


