Abstract
Humans can seamlessly combine value signals from diverse motivational incentives, yet it is not well understood how these signals are “bundled” in the brain to modulate cognitive control. The dorsal ACC (dACC) is theorized to integrate motivational value dimensions in the service of goal-directed action, although this hypothesis has yet to receive rigorous confirmation. In the present study, we examined the role of human dACC in motivational incentive integration. Healthy young adult men and women were scanned with fMRI while engaged in an experimental paradigm that quantifies the combined effects of liquid (e.g., juice, neutral, saltwater) and monetary incentives on cognitive task performance. Monetary incentives modulated trial-by-trial dACC activation, whereas block-related effects of liquid incentives on dACC activity were observed. When bundled together, incentive-related dACC modulation predicted fluctuations in both cognitive performance and self-report motivation ratings. Statistical mediation analyses suggest that dACC encoded the incentives in terms of their integrated subjective motivational value, and that this value signal was most proximally associated with task performance. Finally, we confirmed that these incentive integration effects were selectively present in dACC. Together, the results support an account in which dACC integrates motivational signals to compute the expected value of goal-directed cognitive control.
SIGNIFICANCE STATEMENT How are primary and secondary incentives integrated in the brain to influence goal-directed behavior? Using an innovative experimental fMRI paradigm that combines motivational incentives that have historically been studied independently between species (e.g., monetary rewards for humans, food rewards for animals), we examine the relationship between incentive motivational value and cognitive control allocation. We find evidence that the integrated incentive motivational value of combined incentives is encoded in human dorsal ACC. Further, self-reported motivational shifts mediated the effects of incentive-modulated dorsal ACC activity on task performance, revealing convergence in how self-reported and experimentally induced motivation are encoded in the human brain. Our findings may inform future translational studies examining affective/motivational and cognitive impairments in psychopathology (e.g., anxiety, depression, addiction).
Keywords: cognitive control, dACC, incentive integration, motivation, reward, value
Introduction
A remarkable aspect of the interaction between motivation and cognition is the seamless ability that humans have in integrating diverse motivational incentives when allocating cognitive resources toward pursuit of mentally demanding goals (Botvinick and Braver, 2015). For example, when working toward a challenging project, a worker might be motivated by a potential raise, the praise received from their supervisor, the tasty snack they promised themselves on completion, or most likely, a combination of all three. Although individuals likely “bundle” values from multiple incentives to influence goal pursuit (FitzGerald et al., 2009), prior studies of human motivation have primarily examined monetary rewards (Kouneiher et al., 2009; Padmala and Pessoa, 2011; Bahlmann et al., 2015). Few studies have explored how biological incentives (e.g., food/drink) influence cognitive task performance (Krug and Braver, 2014). Yet, consideration of primary and “bundled” incentives is theoretically important for clarifying how incentive motivational value is encoded in the brain and how it can modulate goal pursuit. In this human fMRI study, we investigate the neural mechanisms underlying effects of integrated motivational incentives on cognitive control.
Several theoretical frameworks provide relevant predictions for neural mechanisms underpinning incentive integration. In neuroeconomics, the “common currency” account suggests that diverse incentives are represented in a common neural representation that enables incentives to be compared, combined, and selected under decision-making contexts (Padoa-Schioppa and Cai, 2011; Levy and Glimcher, 2012). The explicit encoding of incentives may reflect a valuation process that enables rank ordering based on subjective utility. One natural form for this utility encoding might be subjective motivational value, which is putatively represented in ventromedial PFC (vmPFC) and striatum (Chib et al., 2009; Sescousse et al., 2015). The encoding of incentives as subjective motivational value is relevant for theories of motivation-cognition interaction, which suggests that cognitive control is tightly coupled with motivational signals (Parro et al., 2018; Yee and Braver, 2018). Conversely, the expected value of control (EVC) theory postulates that dorsal ACC (dACC) plays a key role in integrating positive and negative outcomes to modulate cognitive control signals (Shenhav et al., 2013, 2017). Previous studies have demonstrated that dACC is engaged during incentivized cognitive tasks (Parro et al., 2018) and motivated action selection (Rushworth et al., 2004; Holroyd and Yeung, 2012). Further, dACC is sensitive to reward and punishment (Fujiwara et al., 2009; Lake et al., 2019), and to benefits and costs associated with cognitive control (Sayalı and Badre, 2019; Westbrook et al., 2019). Nevertheless, to robustly test whether dACC is an integrative motivation-cognition hub, it is necessary to demonstrate that dACC integrates the value of diverse incentives with both positive and negative motivational value, and that dACC signals are associated with fluctuations in self-reported motivation and cognitive task performance. A rigorous formal investigation of incentive integration requires an experimental paradigm that parametrically bundles incentives to measure their modulation of cognitive task performance.
We recently developed a novel incentive integration paradigm which has these critical components, enabling a rigorous test of whether dACC serves as a motivation-cognitive control hub. In this paradigm, liquid and monetary incentives are “bundled” together, but independently manipulated in a trial-by-trial and block-wise manner, enabling estimation of incentive-modulated effects on both self-reported motivation and cognitive task performance. The incorporation of liquids enables straightforward examination of motivational valence effects through utilization of positive/appetitive (juice), neutral (tasteless liquid), and negative/aversive (saltwater) incentives. Since participants directly consume the liquids, their subjective ratings of these liquids may indicate their motivational influence on task performance. Prior work has demonstrated that both incentives are additively combined to influence self-reported motivation and task performance (Yee et al., 2016, 2019). We leverage this paradigm in a human fMRI study with healthy young participants to test the compatibility of dACC activity patterns a key claim of the EVC account: that dACC integrates potential positive and negative values across diverse incentives to adjust the control signal; that is, as integrated subjective motivational value increases, so should dACC activity and the subsequent allocation of control. To preview, our results are consistent with this prediction, suggesting that dACC modulates motivation-cognition interactions via internal representation of bundled motivational value signals, and this representation is what enables motivation-linked modulation of task performance under high cognitive control demands.
Materials and Methods
Experimental design
Participants
A total of 51 right-handed participants (25 female; 18-38 years, mean ± SD, 25.1 ± 4.8 years) with normal or corrected-to-normal vision participated in the experiment. All participants provided written consent approved by the Washington University Institutional Review Board, and received payment for their participation ($25 per hour), plus additional earnings of up to $15 based on task performance. Five participants were excluded from analyses because of technical error, participant inability to complete the task, or participant noncompliance with task instructions. The final sample consisted of 46 participants (22 females; 18-38 years, mean ± SD, 25.4 ± 4.9 years). All demographic and self-report data were collected and managed using a secure web-based application, Research Electronic Data Capture, hosted at Washington University (Harris et al., 2009).
Incentive integration task
To examine the dissociable and bundled effects of primary and secondary incentives on cognitive control, we adapted the consonant-vowel odd-even cued task-switching paradigm developed by Yee et al. (2016, 2019). On each trial, a letter-number pair was visually presented (e.g., one letter and one number on the screen), and participants were tasked with categorizing the target symbol based on the task instruction briefly presented at the beginning of each trial (e.g., classify the letter was a vowel or consonant, the number as odd or even). The task for a given trial was indicated by a cue display, which was randomized across trials and preceded the number-letter pair, indicating either Attend Letter or Attend Number. Participants maintained the current task and associated response rules in working memory during a subsequent blank cue-target interval. A monetary reward cue was also presented each trial, placed above and below the task cue, which indicated whether the trial was associated with a low, medium, or high reward value (displayed as $, $$, or $$$$, respectively). The values of the monetary reward cues were randomized across trials. Although reward cues were always presented with task cues, participants could only earn monetary reward during incentive blocks (i.e., not during practice and baseline blocks).
During the incentive blocks, participants could earn monetary rewards for fast and accurate task performance (see Procedure). One key aspect of the experimental design was the utilization of monetary reward cues that varied on a trial-by-trial basis. A second key aspect was that successful attainment of the monetary reward was indicated by oral liquid delivery to the participant's mouth as post-trial performance feedback. At the end of trials in which participants were accurate and faster than the criterion response time (RT), they received a 1 ml drop of liquid directly to their mouths. Participants only received liquid feedback for successfully earning monetary reward in a given trial, and did not receive liquid if they were incorrect, too slow, or did not respond. Importantly, although the type of liquid received was blocked, such that the liquid feedback could be positive/appetitive (apple juice), neutral (isotonic tasteless solution), or negative/aversive (saltwater), the symbolic meaning of the liquid was kept constant. Thus, any behavioral differences observed between liquid types can be attributed to differential subjective valuation of liquid feedback, and simultaneous consideration of both monetary rewards and liquid incentives during task performance. Thus, because receipt of both monetary reward and liquid feedback was performance-contingent, participants integrated the value of both incentives (i.e., motivational incentive integration) when performing the task. Thus, the task enables straightforward comparison of the parametric effects of value on task performance for each motivational incentive (e.g., low vs medium vs high monetary rewards), as well as for “bundled” incentives (e.g., juice + high monetary reward vs neutral + high monetary reward) that reflect the effect of integrated motivational value on cognitive task performance.
The task was programmed with Psychtoolbox 3 (version 3.0.12) in MATLAB (version 2016b) and displayed on the projector connected to a laptop computer. Each trial consisted of a fixation cross displayed for 300 ms, a cue display with the task instruction and monetary reward value for 500 ms, a blank display for 4000 ms (cue-target interval), a target display of the number-letter pair for 2000 ms, a second fixation display for 1000 ms, and a feedback display for 2000 ms (Fig. 1A). Finally, an intertrial interval of randomized duration (3000, 5000, or 7000 ms) displayed the fixation cross before the start of the next trial. Response mappings were counterbalanced between participants. A more detailed schematic of the task trial with all of the timing variables is included in Extended Data Figure 1-1.
Procedure
Participants were asked to abstain from eating or drinking anything besides water for 2 h before the start of the session. Upon arrival, participants completed a contact information questionnaire with demographic information, along with the Behavioral Inhibition & Avoidance Scales, a self-report survey often used to measure individual differences in motivation to avoid aversive outcomes and approach goal-oriented outcomes (Carver and White, 1994).
Next, participants practiced the task for 30 min in a testing room. They first practiced single tasks (letter categorization or number categorization only; order counterbalanced across participants), followed by practice of a mixed task block (task-switching between letter and number task rules). During the three practice blocks (one letter, one number, one mixed), participants received visual performance feedback to indicate accurate performance after each trial. During the three baseline blocks (one letter, one number, one mixed), participants no longer received performance feedback. Additionally, participants practiced swallowing the liquids while lying down on a bed in the testing room, and several drops of the neutral solution liquid were delivered via a pacifier and plastic tubing from the computer-triggered liquid delivery setup.
During scanning, a mixed block/event-related task design was used to optimize characterization of nonlinear and time-sensitive neuronal responses, and to enable simultaneous extraction of trial-related transient activity and block-related sustained activity related to task-level processing (Petersen and Dubis, 2012). Each run consisted of 48 trials divided between three blocks (16 trials per block), alternating with 30 s of “rest” in which participants were instructed to attend a fixation cross display (see Fig. 3B). Participants performed one or two baseline runs, in which they performed the task without earning incentives. Each participant's reward criterion (40%) was calculated based on their response times in the baseline runs. Following the baseline runs, participants completed six incentive blocks with liquid delivered as performance feedback for the successful attainment of monetary reward (two juice, two neutral, two saltwater). Liquid order was counterbalanced. Participants received 1 ml of liquid delivered directly to their mouths (see Liquid setup and delivery procedure) if they were accurate and faster than their calculated reward criterion (40% faster than baseline performance). If participants were incorrect, too slow, or did not respond, they did not earn monetary reward and did not receive any liquid during that trial.
After completion of the scanning session, participants completed a post-task questionnaire and reported Likert ratings (1-7) of motivation of the liquids for each of the nine task conditions (Fig. 1C). Specifically, participants were asked how motivated they were on each of the nine motivational incentive conditions (e.g., “How motivated were you on the Juice $ trials?”). Participants additionally reported Likert ratings of liking and intensity for each liquid (Extended Data Table 1-1). Specifically, participants were asked “Please indicate on a scale of 1-7 how much you like or dislike this liquid” and “Please indicate on a scale of 1-7 how intense you find the taste of this liquid.” All self-report questions posed to participants are listed in Table 1. Reward earnings were calculated and added to their base rate earnings for experimental participation.
Table 1.
Questions | |
---|---|
Motivation | How motivated were you on Juice $ trials? How motivated were you on Juice $$ trials? How motivated were you on Juice $$$$ trials? How motivated were you on Neutral $ trials? How motivated were you on Neutral $$ trials? How motivated were you on Neutral $$$$ trials? How motivated were you on Saltwater $ trials? How motivated were you on Saltwater $$ trials? How motivated were you on Saltwater $$$$ trials? |
Liking | Please indicate on a scale of 1-7 how much you like or dislike this liquid. |
Intensity | Please indicate on a scale of 1-7 how intense you find the taste of this liquid. |
aFor all the questions, participants completed Likert ratings on a scale from 1 (lowest) to 7 (highest). For the motivation questions, there were nine questions: one for each of the motivational incentive conditions. For the liking and intensity questions, there were three questions: one for each liquid type. For each liquid, participants were asked to rate how much they liked the liquid from 1 (least liked) to 7 (most liked), as well as how intense they found the taste of each liquid from 1 (least intense) to 7 (most intense). For Likert ratings of liking and intensity for the liquid incentives, see Extended Data Table 1-1.
Liquid setup and delivery procedure
Before the scan, the neutral and saltwater liquid solutions were prepared in a testing room in the Cognitive Control and Psychopathology (CCP) laboratory. The isotonic neutral solution consisted of 1 L of distilled water, 0.0495 g of NaHCO3 (sodium bicarbonate), and 0.4668 g of KCl (potassium chloride). The saltwater solution consisted of 500 ml of distilled water and 8.8 g of noniodized salt. The juice used was 100% apple juice (Mott's) and purchased from the store.
During both the behavioral practice and scanning session, the liquids were dispensed using a digital infusion pump (model SP210iw, World Precision Instruments) triggered by an output signal from the MATLAB script and delivered via Tygon tubing and a pacifier directly to the participant's mouth. The infusion pump was located in the control room, and lengthy tubing was used to ensure that the dispensed liquid was delivered to the participants. The type of liquid delivered was manipulated in a blocked fashion, counterbalanced across participants, such that on a given block participants would receive positive/appetitive (apple juice), neutral (isotonic tasteless solution), or negative/aversive (saltwater) performance feedback.
Statistical analysis
Behavioral data analysis
Behavioral data were analyzed in RStudio using the R statistical language (RStudioTeam, 2016; RCoreTeam, 2017). All of the data were visualized using the ggplot2 package (Wickham, 2016). All of the linear mixed-effects models were conducted using the lmerTest (Kuznetsova et al., 2015) and LME4 (Bates et al., 2015) packages. We used linear mixed models for our behavioral and ROI-based analyses to facilitate more straightforward comparisons with analyses conducted in our prior work with this task (Yee et al., 2016, 2019). When applicable, 95% CIs for the effects were calculated using the “confint” function in the lme4 package. The knitr and Rmarkdown packages were used to create dynamic reports of the results (Xie, 2021). The behavioral data and analysis scripts are available on OSF: https://osf.io/upka4/.
Bayesian multilevel mediation analysis
We conducted a Bayesian multilevel mediation analysis to test the within-subjects mediated effects between dACC, self-reported motivation ratings, and motivated task performance. We adopted a Bayesian approach for the multilevel mediation analysis as it allows for more precise estimates of indirect effects, as the indirect effects typically do not follow a normal sampling distribution. Moreover, Bayesian multilevel mediation analyses are more conceptually straightforward and allow for simulation of sampling distributions to estimate parameters and credible intervals that characterize the mediated effects between our variable of interest (Yuan and MacKinnon, 2009). All variables were within-person centered to extract within-subject deviations across the nine motivational conditions, which captured fluctuations relative to each participant's subject means. The Bayesian multilevel mediation analyses were conducted in R using the bmlm package in (Vuorre and Bolger, 2017), which depends on the powerful Stan Bayesian inference engine. We used the default priors from the bmlm package (i.e., default priors for regression coefficients were normally distributed (Normal(0,1000)) and group-level SDs were Cauchy distributed (Cauchy(0,50)). The models were implemented with 10,000 samples drawn from the posterior distribution for each of the four MCMC chains. Half of the samples (5000) were used for sampling (which is the default). All Rhat values were equal to 1.00, indicating accurate estimates of the posterior distribution and model convergence. We report the medians and the 90% credible intervals from our Bayesian analyses. The median provides a more stable estimate of the parameter estimates and is maximally robust against outliers. Additionally, we chose to adopt 90% credible intervals because of suggested convention of Bayesian posterior distributions, as some have speculated that 95% credible intervals can lack stability if insufficient posterior samples are drawn (Kruschke, 2015; McElreath, 2020). It is worth noting that the credible interval reflects the probability that this interval contains the true parameter estimates given our data, or to be more precise, the uncertainty associated with these mediated effects.
fMRI data acquisition and preprocessing
The MRI data were acquired on a 3 Tesla Siemens Trio scanner equipped with a 32-channel head coil. A T1-weighed MPRAGE scan was acquired for each participant (TR = 2400 ms, TE =3.16 ms, flip angle = 8 degrees, 64 slices, slice thickness = 1.0 mm, FOV = 256 × 256 mm). For each EPI bold run (1 or 2 baseline, 6 incentive), 360 volumes were acquired with 4 mm isotropic voxels (TR = 2000 ms, TE = 30.0 ms, flip angle = 77 degrees, 32 slices, interleaved order, slice thickness = 4 mm, FOV = 384 × 384 mm, acquisition matrix 64 × 64 yielding an in-plane resolution of 4 × 4 mm).
Preprocessing for both anatomic and functional data were performed using fMRIPrep version 1.1.7 (Esteban et al., 2019), which is based on Nipype version 1.1.3 (Gorgolewski et al., 2011). The T1-weighted (T1w) image was corrected for intensity nonuniformity using N4BiasFieldCorrection (antsApplyTransforms [ANTs] 2.2.0) (Tustison et al., 2010) and used as T1w reference throughout the workflow. The T1w reference was then skull-stripped using antsBrainExtraction.sh (ANTs 2.2.0), using OASIS as target template. Brain surfaces were reconstructed using recon-all (FreeSurfer 6.0.1) (Dale et al., 1999), and the brain mask estimated previously was refined with a custom variation of the method to reconcile ANTs-derived and FreeSurfer-derived segmentations of the cortical gray matter of Mindboggle (Klein et al., 2017). Spatial normalization to the ICBM 152 Nonlinear Asymmetrical template version 2009c (Fonov et al., 2011) was performed through nonlinear registration with antsRegistration (ANTs 2.2.0) (Avants et al., 2008), using brain-extracted versions of both T1w volume and template. Brain tissue segmentation of CSF, white matter, and gray matter was performed on the brain-extracted T1w using fast (FSL 5.0.9) (Y. Zhang et al., 2001).
For each of the 8 BOLD EPI runs per participant (across all tasks and sessions), the following preprocessing steps were performed. First, a reference volume and its skull-stripped version were generated using the custom methodology of fMRIPrep. The BOLD reference was then coregistered to the T1w reference using bbregister (FreeSurfer), which implements boundary-based registration (Greve and Fischl, 2009). Coregistration was configured with 9 df to account for distortions remaining in the BOLD reference. Head-motion parameters with respect to the BOLD reference (transformation matrices, and six corresponding rotation and translation parameters) were estimated before any spatiotemporal filtering using mcflirt (FSL 5.0.9) (Jenkinson et al., 2002). BOLD runs were slice-time corrected using 3dTshift from AFNI (Cox, 1996, 2012; Cox and Hyde, 1997). The BOLD time-series (including slice-timing correction when applied) were resampled onto their original, native space by applying a single, composite transform to correct for head-motion and susceptibility distortions. These resampled BOLD time-series will be referred to as preprocessed BOLD in original space, or just preprocessed BOLD. The BOLD time-series were resampled to MNI152NLin2009cAsym standard space, generating a preprocessed BOLD run in MNI152NLin2009cAsym space. Several confounding time-series were calculated based on the preprocessed BOLD: framewise displacement, DVARS, and three region-wise global signals. Framewise displacement and DVARS are calculated for each functional run, both using their implementations in Nipype (following the definitions by Power et al., 2014). The head-motion estimates calculated in the correction step were also placed within the corresponding confounds file. The BOLD time-series were resampled to surfaces on the following spaces: fsaverage. All resamplings were performed with a single interpolation step by composing all the pertinent transformations (i.e., head-motion transform matrices, susceptibility distortion correction when available, and coregistrations to anatomic and template spaces). Gridded (volumetric) resamplings were performed using ANTs, configured with Lanczos interpolation to minimize the smoothing effects of other kernels (Lanczos, 1964). Nongridded (surface) resamplings were performed using mri_vol2surf (FreeSurfer).
The preprocessed BOLD runs were smoothed with a 4 mm FWHM kernel using 3dBlurtoFWHM from AFNI, as well as scaling (voxels were demeaned) using 3dTstat and 3dcalc from AFNI. Finally, the images were reoriented to LPI orientation using AFNI's 3dresample function.
fMRI data analysis
To optimize analyses for the mixed block/event-related task design (Visscher et al., 2003; Petersen and Dubis, 2012), a GLM was applied to extract β estimates and t statistics for both the sustained liquid block conditions and the transient event-related motivational conditions for each participant. Specifically, AFNI's 3dDeconvolve function was used to set up the GLM and build an input matrix with the hemodynamic regression model, which contains the duration modulated block effects (dmblock) for baseline, juice, neutral, and saltwater runs, as well as a parameter tent function expansion for every 2 s between 0 and 24 s after the onset of the cue stimulus (TENTzero) for each of the nine motivation conditions (three levels of money, three levels of liquid, rewarded trials only), and unrewarded trials. The TENTzero function eliminates the first and last basis functions from the set, forcing the deconvolved HRF to be zero at the start and end of the response window. Importantly, this function enables modeling the HRF without assuming a specific shape for the hemodynamic response (e.g., gamma). Such an estimation approach is advantageous for the complex multievent (i.e., cue, delay, target, feedback) trials used here.
The GLM was run with 3dREMLfit from AFNI, which performs a generalized least squares time-series regression (also known as “prewhitened” least squares) combined with a restricted maximum likelihood (REML) estimation of an Autoregressive Moving Average Model (ARMA(1,1)) temporal correlation structure, which has been argued to substantially improve reliability in task fMRI studies (Olszowy et al., 2019). For each participant, we computed whole-brain β estimates for the four block types (baseline, juice, neutral, saltwater), nine tent functions for each of the motivation conditions (3 monetary reward levels × 3 liquid types) (see Eq. 1). A tent function regressor for incorrect trials and the six motion parameters generated from fMRIPrep realignment were included in the GLM as nuisance regressors. Additionally, TRs were censored (current and previous) if the derivative values were estimated (in fMRIPrep) to have a Euclidean norm >0.9 mm as follows:
(1) |
Next, these mixed block/event-related β estimates were extracted for each of the 400 parcels from the Schaefer cortical atlas, divided into seven functional networks (Schaefer et al., 2018). The Schaefer atlas was selected because its approach of using a gradient-weighted Markov random field to integrate local gradient and global similarity metrics across resting-state fMRI, and task-based fMRI acquisition protocols yielded the most homogeneous parcellations and thus correspond with higher precision to cortical areas compared with prior parcellation schemes (Yeo et al., 2011; Gordon et al., 2016). Additionally, given our a priori hypotheses in subcortical regions, β estimates were calculated for 19 subcortical ROIs that were anatomically defined from Freesurfer. β estimates were averaged for all voxels within each parcel/region using 3dROIstats from AFNI.
For the dACC ROI analyses, five parcels from the Schaefer cortical parcellation scheme (400 parcels, 7 networks, 2 mm voxels) were identified and averaged, using criteria that were conservative and anatomically focused in corresponding to bilateral dACC based on a prior meta-analysis on motivated cognitive control (Parro et al., 2018). Specifically, the following parcels were included in bilateral dACC: 107 (LH_SalVentAttn_Med_1), 108 (LH_SalVentAttn_Med_2), 110 (LH_SalVentAttn_Med_4), 311 (RH_SalVentAttn_Med_1), and 312 (RH_ SalVentAttn_Med_2). MNI coordinates of these five parcels corresponding to dACC are listed in Table 2.
Table 2.
Parcel ID | ParcelnNumber | MNI coordinates (RAS) |
||
---|---|---|---|---|
x | y | z | ||
107 | LH_SalVentAttn_Med_1 | −6 | 22 | 32 |
108 | LH_SalVentAttn_Med_2 | −6 | 0 | 40 |
110 | LH_SalVentAttn_Med_4 | −6 | 10 | 48 |
311 | RH_SalVentAttn_Med_1 | 8 | 18 | 26 |
312 | RH_SalVentAttn_Med_2 | 8 | 2 | 42 |
Results
Motivational incentive integration effects: reward rate and self-reported motivation ratings
In the task, participants have the opportunity to earn monetary and liquid incentives on every trial if their performance is accurate and faster than a criterion RT cutoff (defined individually for each participant from their performance in a baseline condition). Consequently, we used the reward rate, defined as the percentage of trials in which the participant earned the available reward, as the primary dependent behavioral measure of motivated cognitive task performance. All participants (n = 46) performed above the expected rate of 40%, indicating that they significantly improved their performance relative to baseline levels (45 of 46 participants showed statistically significant improvements in performance according to a binomial test; successes = 117 trials = 288, p = 0.05). Additionally, participants were significantly faster (t(45) = 16.298, p < 0.001) and less accurate (t(45) = 7.582, p < 0.001) during the incentive blocks compared with the baseline block; this shift along the speed-accuracy curve suggests that participants strategically increased their effort in when bundled incentives were added to the task, to optimize reward rates (Fig. 2). Finally, RT switch costs (a critical measure of cognitive control) were significantly reduced between baseline and incentive blocks (t(45) = 2.956, p = 0.005), demonstrating overall increased recruitment of cognitive control during incentive blocks relative to baseline blocks. Nevertheless, we focused on reward rate as our primary index of motivated task performance because it is the most proximal measure indexing the extent to which the expected value of a given trial (i.e., the integrated value of the incentives) could modulate the degree of control specified (as opposed to RT switch costs that typically reflect the preparation of target-related processes and would be most strongly modulated by manipulating the task preparation time) (Wylie and Allport, 2000).
We found that different types of motivational incentives are integrated to modulate cognitive task performance. Specifically, we estimated a general linear mixed model with contrast-coded monetary reward (low = −1, medium = 0, high = 1) and liquid valence (saltwater = −1, neutral = 0, juice = 1) as fixed effects with participant as a random effect [reward rate ∼ money × liquid + (1 | subject)]. The model revealed significant effects of both monetary (b = 0.03, t = 4.41, p < 0.001) and liquid incentives (b = 0.01, t = 2.30, p = 0.022), but no significant interaction (b = 0.00, t = −0.21, p = 0.830). The liquid incentive effects were motivationally valenced, as expected by our prior work, in that performance was better when positive (juice) relative to negative (saltwater) liquids were offered as incentives. Post hoc analyses further revealed a significant difference between neutral and saltwater (b = 0.03, t = 2.12, p = 0.034), but no significant effects between juice and neutral (b = 0.00, t = 0.08, p = 0.936). Thus, the liquid effects on reward rates were primarily driven by impaired performance when saltwater was offered as incentive feedback (Fig. 1B), although, in our prior behavioral studies, we observed both performance facilitation effects because of juice, as well as performance impairments because of saltwater (Yee et al., 2016, 2019; Crawford et al., 2020). It is noteworthy that we did not detect an interaction between monetary rewards and liquid incentives, suggesting the presence of pure additive effects. Additional analyses of RT and accuracy (using the same linear mixed models as before, except now with RT and accuracy as dependent variables) revealed that reward rate improvements were primarily driven by a faster RT for higher monetary reward (b = −16.25, t = −4.93, p < 0.001), with no speed-accuracy trade-off (Extended Data Figs. 1-2, 1-3). However, analyses of switch costs indicated no further effects of monetary rewards and liquid incentives (all p values > 0.05; Extended Data Fig. 2-1) beyond the general switch-cost reduction observed in the incentive blocks relative to baseline [RT ∼ switch × liquid × money + (1 | subject)]. Switch trials were dummy coded (switch = 1, repeat = 0), money and liquid were contrast-coded same as in previous models. This lack of effect is not particularly surprising, given that switch costs were overall quite small under incentive conditions (∼20 ms), and so likely did not have sufficient dynamic range to exhibit sensitivity to the more subtle parametric incentive manipulations. More generally, because of the long cue-target intervals used in the current design, switch costs may not be the most sensitive index of cognitive control for this study, which supports our use of reward rate as the primary indicator of motivated cognitive task performance.
We next examined the relationship between self-report motivation ratings and cognitive task performance. Interestingly, these ratings predicted unique variance in reward rate beyond the experimental manipulation itself. Self-reported measures of motivation were collected for each of the nine trial types (e.g., How motivated were you on Juice $trials?) after task completion. A linear mixed-effects model [motivation ratings ∼ money × liquid + (1 | subject)] revealed that these motivation ratings were significantly predicted by both monetary (b = 0.69, t = 9.31, p < 0.001) and liquid incentives (b = 0.75, t = 10.04, p < 0.001), such that participants reported more motivation for higher monetary reward and more appetitive liquid incentives (Fig. 1C). We conducted a hierarchical regression to examine whether self-reported motivation predicted unique variance in reward rate over and above the experimentally manipulated motivational variables [Model 1: reward rate ∼ money × liquid + (1 | subject); Model 2: reward rate ∼ money × liquid + motivation ratings + (1 | subject)]. The hierarchical regression revealed that, when self-reported motivation ratings were added to the model with experimental fixed effects (e.g., monetary reward, liquid valence), their inclusion increased predicted reward rate variance over and above the experimentally manipulated motivational variables (χ2(3) = 20.311, p < 0.001) (Extended Data Fig. 1-4). These results indicate that self-reported fluctuations in motivation are an important contributor to cognitive task performance in that they predict unique variance beyond the effects of monetary and liquid incentives.
Critically, the self-report findings suggest two key interpretations. First, participants could access their subjective motivational states. Second, although these subjective states were modulated by monetary and liquid incentives, the induced motivation from the incentives may have been a more proximal influence on task performance. That is, although both reward rate and self-report motivation ratings are sensitive to the incentive manipulations, the weak association between these metrics (r = 0.22, t(44) = 1.541, p = 0.13) (Fig. 1D) suggests that they might reflect overlapping yet dissociable motivational components of the incentivized cognitive task.
dACC encodes both monetary and liquid incentives in bundled β estimates
We next focused on fMRI data to test whether dACC activity was predicted by monetary and liquid incentives. The dACC ROI encompasses the peak voxels of dACC based on a prior meta-analysis on motivated cognitive control (Fig. 3A), indicating that this ROI is consistently recruited during cognitive control tasks during which a reward incentive can be earned based on task performance (Parro et al., 2018). For each participant, a GLM was applied to extract β estimates for sustained activation for each liquid block condition and event-related activation to the monetary incentive cues for each trial type (estimating activity 4-6 s after cue onset), using a deconvolution approach to estimate the time course of activation. Specifically, we averaged the two estimates after the cue onset (t = 4 s and t = 6 s) to compute an averaged β value of the event-related activation associated with each of the monetary incentive cues (Fig. 3C), accommodating the hemodynamic delay in peak amplitude (Buckner, 1998; Taylor et al., 2018).
As predicted, the results of this analysis revealed that dACC is sensitive to liquid valence via sustained responses and monetary reward via cue-related transient activation during each trial, which is consistent with the incentive delivery structure of the task paradigm and the duration of hemodynamic response lag. To first validate that dACC was independently sensitive to each incentive type, we conducted two linear mixed models with contrast-coded monetary reward and liquid valence predicting the block and event-related cue β estimates, respectively [βblock ∼ money × liquid + (1 | subject); βevent ∼ money × liquid + (1 | subject)]. The models revealed that the block β estimates were predicted by liquid incentives (b = 0.02, t = 4.58, p < 0.001) but not monetary reward (b = 0, t = 0, p = 1.000), whereas the cue β estimates were predicted by monetary reward (b = 0.04, t = 5.55, p < 0.001), but not liquid valence (b = 0, t = –0.31, p = 0.759). Next, we “bundled” the β estimates corresponding to the liquid incentive effects (blocked) and monetary reward effects (event-related, 4-6 s after cue onset), which enabled us to calculate nine dACC bundled β estimates for each participant corresponding to the nine motivational conditions from the incentive integration task (e.g., $$-Juice, $$$$-Neutral; Fig. 3D). A critical assumption made was that summing the block and event-related β estimate values would reflect the additive effects of both liquid and monetary incentives in the BOLD signal (i.e., the integrated value). This seems a plausible assumption since the liquid effects were sustained throughout the task block, and thus by definition, available on every trial (i.e., to be added to the cue-triggered event-related activity). Importantly, the mixed model revealed that higher values of dACC bundled β estimates were associated with higher monetary reward (b = 0.04, t = 4.66, p < 0.001) and more appetitive liquid incentives (b = 0.02, t = 2.98, p = 0.003), confirming that neural signals associated with primary and secondary incentives can be combined additively to represent the aggregate motivational value from both incentive types. Paralleling the behavioral results, there was no significant interaction between these two factors (b = 0, t = 0.26, p = 0.794), suggesting simple additive effects. All model results are shown in Extended Data Fig. 3-1.
Reward rate predicted by dACC bundled betas (β)
Given the hypothesized role of dACC as a region that integrates various sources of motivational value into a modulatory signal that adaptively allocates cognitive control (Shenhav et al., 2013, 2017), we aimed to test whether experimentally manipulated within-subjects variability in dACC was significantly associated with similar within-subject variability in reward rate, our metric of motivated cognitive task performance. Such an association would provide compelling evidence demonstrating that dACC computes the aggregate value of both motivational incentives and predicts motivated task performance. We conducted a linear mixed-effects model with reward rate predicted by dACC bundled β estimates and “incentive conditions” (contrast-coded as the sum of liquid and monetary reward contrast codes). Our analyses revealed that reward rate was significantly predicted by both incentive conditions (as expected from prior analyses) (b = 0.02, t = 2.91, p < 0.001), but also the dACC bundled β (b = 0.09, t = 2.41, p = 0.016). A critical and important observation is that the inclusion of dACC bundled β explained significant additional variation in reward rate beyond the experimentally manipulated incentive effects, suggesting a role of dACC in encoding subjective motivational value. Moreover, these data are consistent with the EVC account of dACC as a hub for integrating value and cost information to derive an optimal control signal that balances task demands against potential rewards.
Self-report motivation ratings predicted by dACC bundled betas (β)
A secondary aim was to understand the putative relationship between the extent to which motivated cognitive task performance (i.e., reward rate) and self-reported motivation measures may be encoded in dACC activation. As self-report measures of motivation have been historically viewed as the “gold standard” for assessing human motivational states (Hermans, 1970), we investigated the extent to which human dACC neural signals may encode self-reported motivation to exert cognitive control to maximize earnings of the bundled incentives. Here, we conducted a similar mixed model as above, except now with self-report motivation ratings (rather than reward rate) as the dependent measure. Our analyses revealed that self-reported motivation ratings were predicted by both incentive condition (b = 0.67, t = 9.78, p < 0.001) and dACC bundled β (b = 1.64, t = 3.96, p < 0.001). These results are particularly intriguing because this association reveals that dACC neural signals also reflect a subjective (and accurate) measure of the valuation of the bundled motivational incentives in the current task context. Moreover, such ratings may tap into a complementary motivation-related construct distinct from motivation associated with the exerted effort on a cognitively demanding task.
dACC effects on reward rate mediated by self-report motivation ratings
Given the observed strong associations between dACC and reward rate, as well as between dACC and self-reported motivation ratings, we next examined the putative relationship between within-subjects variability across different incentive conditions in dACC, reward rate, and motivation ratings. In particular, given the utility of self-report ratings as a powerful metric for measuring subjective motivational states, we hypothesized that such ratings might partially explain the proximal motivational impact of the incentives on the associative modulatory relationship between dACC activity and reward rate. Such a within-subjects mediation would be compelling, as it would reveal the extent to which dACC may encode these two behavioral metrics as similar or distinct indices of an individual's current motivational state.
First, we conducted three linear mixed models and confirmed that experimentally manipulated incentives demonstrated quantifiable effects on within-subjects variability in dACC, reward rate, and self-report ratings. As indicated previously, incentive conditions significantly predicted dACC bundled β (b = 0.03, t = 4.04, p < 0.001), reward rate (b = 0.02, t = 3.36, p < 0.001), and motivation ratings (b = 0.72, t = 10.35, p < 0.001) (Fig. 4A, red dashed lines). Thus, these data demonstrate that the incentive manipulations influence all three variables, while also suggesting that these motivational variables may be mediated or moderated by each other.
Next, we conducted a Bayesian multilevel mediation analysis and observed that incentive-modulated effects on the relationship between dACC and reward rate were mediated by such variability in motivation ratings, as prior linear mixed models confirmed incentive effects across all three variables. The within-subjects mediation analysis used averaged values across each of the nine possible motivational incentive conditions for each participant. This enabled us to compare within-subjects variability across incentive conditions between these variables (dACC, reward rate, motivation ratings). Notably, this approach eliminated the need for including contrast-coded incentive effects in linear mixed models that were used to validate assumptions about associations between these variables before conducting the mediation analysis. Linear mixed models (without contrast-coded incentive effects) confirmed that dACC activity significantly predicted both reward rate (b = 0.14, t = 3.77, p < 0.001) and motivation ratings (b = 2.77, t = 5.98, p < 0.001). Moreover, in a linear mixed model of reward rate with motivation ratings as the mediator, controlling for the predictor revealed that motivation ratings significantly predicted reward rate (b = 0.02, t = 5.53, p < 0.001), and more importantly, the inclusion of these ratings weakened the effect of dACC, although it still remained statistically significant (b = 0.08, t = 2.15, p = 0.032).
These variables were submitted to a Bayesian multilevel mediation (using the bmlm package in R) to estimate the medians and 90% credible intervals for the posterior distributions for each path parameter (Fig. 3, blue lines). The mediation analysis revealed that motivation ratings partially mediated the relationship between dACC and reward rate [mediated effect = 0.05, CI90 = (0.01, 0.10); proportion mediated effect = 0.42, CI90 = (0.06, 1.10)], significantly reducing the direct effect [c = 0.13, CI90 = (0.04, 0.21); c′ = 0.07, CI90 = (–0.01, 0.15)]. We also conducted an alternative model, which revealed a weaker partially mediated effect of reward rate on the relationship between dACC and motivation ratings [mediated effect = 0.44, CI90 = (0.06, 0.90); proportion mediated effect = 0.13, CI90 = (0.02, 0.31)], which, critically, did not significantly reduce the direct effect [c = 3.30, CI90 = (1.73, 4.85); c′ = 2.84, CI90 = (1.32, 4.34)]. Thus, although dACC is significantly associated with incentive motivational task performance, this relationship is partially mediated by the variance explained by the self-report motivation ratings. Notably, these mediation models reveal that the subjective motivational incentive value is the more proximal factor that modulates task performance, rather than the incentive-driven performance modulation driving the motivation ratings. As such, these results provide compelling evidence that dACC encodes the integrated incentives primarily in terms of their subjective motivational value, which in turn modulates task performance. Parameter estimates are listed in Extended Data Figures 4-1 and 4-2.
In addition to examining within-subjects variability, we also tested whether between-subjects' differences in dACC activation were associated with reward rate and motivation ratings. That is, if baseline differences in overall dACC activation across individuals correlated with reward rate and motivation ratings, it would suggest that dACC also reflects more stable levels of task engagement (between-subjects variability), beyond integrating task-related changes in incentive values toward motivated task performance (within-subjects variability). We averaged and normalized subject-level values for dACC activation, reward rate, and motivation ratings (i.e., rather than across the nine incentive conditions). Our results revealed a moderate association between dACC and reward rate (r = 0.28, t(44) = 1.902, p = 0.064), as well as between dACC and motivation ratings (r = 0.33, t(44) = 2.32, p = 0.025) (Fig. 4B). Individuals with higher average dACC activity showed a trend toward reporting overall higher motivation ratings (and to a lesser extent, achieved higher reward rates).
These between-subjects dACC effects were not as reliable as the within-subjects dACC effects previously demonstrated. In particular, when both subject-level dACC activity and motivation ratings were included in a model predicting subject-level individual differences in average reward rate, neither variable was statistically reliable (dACC: b = 0.23, t = 1.47, p = 0.149; motivation ratings: b = 0.15, t = 0.99, p = 0.328). Thus, our data suggest that the dACC accurately encodes context-specific motivational states that are primarily modulated in a dynamic fashion (i.e., by incentive cues) rather than by more stable or global trait-like differences in motivation. Notably, although the utilization of an a priori ROI as well as hypothesized motivational processes reduced potential false-positive concerns regarding the between-subjects effects, these results should still be interpreted with caution. The modest sample size of the current study (N = 46) suggests that it is potentially underpowered to detect individual differences effects in dACC, or alternatively, could produce a biased inflation of the estimated effects (Dubois and Adolphs, 2016; Cremers et al., 2017). Validation of the individual differences' relationships between dACC and motivated processes would require collecting a sufficiently powered sample (Barch et al., 2013; Turner et al., 2018) and/or conducting a priori power analyses with given effect sizes to determine the estimated reliability of the findings expected in a novel sample (Mumford, 2012).
dACC selectively encodes subjective motivational value and modulates motivated task performance
Finally, we complemented our analyses of dACC activity patterns by examining other relevant brain ROIs. In particular, a number of well-established brain regions have been implicated in value-based decision-making (e.g., striatum, vmPFC) and other reward-related processes, such as taste processing (e.g., anterior insula). Consequently, we tested whether the subjective motivational value signal associated with task performance was also encoded in these other value-related brain regions. We conducted the same linear mixed models with reward rate and motivation ratings predicted by the motivational incentive conditions and bundled β, except now using bundled β from other ROIs associated with value-based decision-making (Bartra et al., 2013; Sescousse et al., 2013, 2015) as well as taste processing (Small, 2010). Of these selected ROIs, it is noteworthy that only dACC significantly predicted reward rate. In contrast, motivation ratings were additionally significantly predicted by caudate (b = 0.74, t = 2.29, p = 0.022), putamen (b = 1.29, t = 3.22, p = 0.001), and anterior insula (b = 1.36, t = 2.87, p = 0.003) (Fig. 5). These data reveal that, although several regions appear to predict motivation ratings (suggesting that multiple brains regions may track the subjective motivation of the incentives), the specificity of the association between dACC and reward rate robustly supports the EVC theory, that is, that dACC may play a significant and selective role in modulating how motivational values are translated in effortful action during the performance of a cognitively demanding task.
Discussion
We found novel evidence that dACC represents the integrated subjective motivational value of bundled primary and secondary incentives and, moreover, that this bundled neural signal is associated with changes in motivated cognitive task performance. We leveraged key features of our incentive integration paradigm, which enables estimation of the combined effect of both monetary and liquid incentives on brain activity and task performance while also allowing for examination of motivational valence effects through the use of both appetitive and aversive liquid feedback. Our findings support predictions of the EVC framework (Shenhav et al., 2017), which postulates that dACC integrates the motivational value of potential outcomes (e.g., the appetitive value of earning monetary reward subtracting the aversive value of the saltwater) to determine the optimal allocation of cognitive control. We find clear evidence that dACC acts as an integrative motivation-cognition hub, thus facilitating the pursuit of cognitively effortful goals (Holroyd and Yeung, 2012). Although prior work has demonstrated the role of dACC in using reward information to optimally allocate effort in rodents (Hosking et al., 2014; Holroyd and McClure, 2015), ours is the first study to demonstrate the role of human dACC in encoding subjective motivational value across integrated incentives to modulate behavioral performance in a task with high cognitive demands. In particular, consistent with EVC predictions, we found that reward rate tracked the subjective motivational value of cognitive control over task performance (i.e., in terms of both the integrated incentives available and self-reported motivation), and that this relationship was mediated by fluctuations in dACC activity.
A notable observation was the discovery that activity in the dACC was associated with not only task performance, but also with self-reported motivation, which is intriguing since these motivation ratings explained unique variance in reward rate beyond the incentive manipulations. Additionally, these motivation ratings partially mediated the relationship between dACC and reward rate, providing suggestive evidence that such ratings may reflect the more proximal impact of the incentive conditions encoded in dACC activity. Moreover, the self-reported motivational effects of the incentive manipulations may be somewhat distinct, although functionally related to the motivational effects inferred from behavioral enhancements observed during incentivized task performance (Bonner and Sprinkle, 2002). Alternatively, these motivation ratings may simply reflect a more accurate subject-specific indication of incentive salience based on the ordinal levels from the manipulation.
It is important to acknowledge a limitation regarding the inclusion of self-report motivation ratings. Although the use of these ratings was prompted by our group's prior work demonstrating that they predict unique variance beyond experimentally manipulated incentive effects (Yee et al., 2016, 2019), they do not capture the dynamic variability likely present in subjective motivation, as it gets modulated by performance, feedback, or physiological states (e.g., satiety). Although some have examined the dynamic variability in self-reported mood and behavior over the span of days/weeks (Moskowitz and Young, 2006; Rutledge et al., 2014), how subjective motivation varies dynamically throughout the course of a behavioral task context remains to be explored. Future work should aim to investigate the extent to which both measures (i.e., motivated task performance, self-report) reflect convergent versus divergent neural signals underpinning motivation, and explore the temporal dynamics of motivation within a task. It is important to note that including both measures simultaneously incurs its own set of limitations, and would require consideration of how self-report probes potentially alter the demand characteristics of motivated task performance (Velten, 1968; Polivy and Doyle, 1980). Nevertheless, such investigations have the potential to reconcile the frequently observed discrepancies between how both measures (self-report, behavioral performance) reflect motivated cognition (Dang et al., 2020). As such, this work could advance current understanding of how distinct sources of motivational information are represented in the brain.
Interestingly, we found evidence of an incentive integration neural mechanism present in the dACC, but not in other brain regions classically associated with representing the neural common currency of subjective value (Peters and Buchel, 2010; Levy and Glimcher, 2012). It is possible that these other regions may also be involved in integrating incentive value, but that the effects were not detected in the ROI-based analysis used here, and could require methods with greater granularity to detect putative heterogeneous processes within these ROIs. Nevertheless, our results are consistent with prior work showing a distinction between the subjective value signals associated with explicit economic choices (i.e., choosing one good over another) versus when such values are relevant for behavioral actions (Camille et al., 2011; Cai and Padoa-Schioppa, 2012; Kolling et al., 2016). The former process (value-based decision-making) involves explicit valuation and comparison of incentives, whereas the latter process (motivated cognitive control) involves implicit processing and utilization of incentive value for adaptive mobilization of cognitive control. Although a key feature of this study is the utilization of both monetary and liquid incentives, our task significantly deviates from prior studies evaluating the expectation of primary and secondary incentives (Chib et al., 2009; Kim et al., 2011; S. Q. Park et al., 2012; Z. Zhang et al., 2017).
Most prior evidence supporting the neural common currency account arises from human and animal studies, which include an explicit valuation phrase or when an economic choice is required between available goods (Padoa-Schioppa and Conen, 2017; Fromer et al., 2019). Because our task paradigm is optimized for motivated cognitive control, it is unsurprising that only dACC appeared to encode the incentive condition effects on reward rate. These results are consistent with prior work demonstrating that cost-benefit valuation in physical effort tasks elicits activation in dACC, but not vmPFC (Croxson et al., 2009; Klein-Flugge et al., 2016). Furthermore, this distinction is supported by our observation that motivation ratings were associated with bundled β in dorsal striatum (e.g., caudate, putamen), a region well known to be associated with motivated action selection (Balleine et al., 2007; Balleine and O'Doherty, 2010; Miller et al., 2014). Future work could bridge this gap via including an additional valuation phase for bundled incentives (e.g., $$$$reward + saltwater) or a choice component, in which preferences can be expressed (e.g., $$$$reward + saltwater vs $$reward + juice). Such a paradigm might more clearly reveal regions involved in value-based decision-making (e.g., vmPFC, ventral striatum) and/or motivated cognitive control (e.g., dACC, dorsal striatum).
A broader question relates to developing a mechanistic understanding of how dACC integrates incentives during motivated cognitive control. The dACC contains a heterogeneous population of neurons and underpins a diverse array of cognitive, motor, and affective functions (Bush et al., 2002; Heilbronner and Hayden, 2016; Vega et al., 2016). However, in light of our key findings supporting the role of dACC as a hub for motivation-cognition interactions by integrating the combined appetitive and aversive values of diverse incentives (Parro et al., 2018), the precise calculations by which different neurons, voxels, or subregions within the dACC perform incentive value integration remain to be elucidated. One possibility is that distinct neural patterns or voxel clusters within dACC may distinctly encode positive outcomes (e.g., monetary rewards, juice) and negative outcomes (e.g., punishments, saltwater). Such patterns seem plausible, given recent work demonstrating that dACC neurons respond to rewards and punishments in nonhuman primates (Monosov, 2017; Monosov et al., 2020) and rodents (Schneider et al., 2020). Alternatively, dACC voxels may be multiplexed to encode both positive and negative outcomes, or even context-specific incentives and actions (Hayden and Platt, 2010). An important future direction would be investigation with higher spatial resolution of when and how dACC integrates diverse incentives to represent the subjective motivational value in cognitive control contexts.
Finally, developing greater insight into how incentive motivation is integrated and represented provides a crucial foundation from which to elucidate the neural mechanisms underpinning how subjective value signals modulate cognitive task representations in PFC. Whereas prior work has shown that lateral PFC signals are enhanced when higher monetary rewards are present (Kouneiher et al., 2009; Dixon and Christoff, 2012; Bahlmann et al., 2015; Duverne and Koechlin, 2017), how such cognitive task PFC representations interface with the subjective motivational value computation in dACC remains an open question. Multivariate analyses (e.g., decoding or representational similarity analysis) could be exploited to probe how value signals are integrated (in dACC) to modulate neural representations of cognitive task rules (in lateral PFC) and ultimately translated to measurable changes in behavior (Wisniewski et al., 2015; Etzel et al., 2016). Such findings could inform systems-level neural representations of how diverse motivational incentives combine into subjective motivational value to support cognitive task goals.
Broadly, given the diversity of incentives that people regularly encounter (e.g., social rewards), an open question relates to understanding how people evaluate and integrate multiple diverse incentives in the real world (Lehner et al., 2017). Our innovative approach provides an initial step toward more careful study of real-world effort allocation, through which incentives can vary along both categories (e.g., monetary, liquid, social) and dimensions (e.g., appetitive, aversive), and are seamlessly integrated (e.g., consideration of both monetary rewards and social praise) (H. R. Park et al., 2018; Crawford et al., 2020). Importantly, such insight into the neural mechanisms underpinning how motivational incentives are integrated to modulate effortful tasks can provide a mechanistic framework to advance understanding of how motivational or cognitive deficits arise in clinical disorders, such as anxiety, depression (Clery-Melin et al., 2011; Huang et al., 2015; Grahek et al., 2019), or addiction (Koob and Moal, 2008; Volkow et al., 2017).
Footnotes
This work was supported by National Institutes of Health Grants R21-AG058206 and R21-AG067295 to T.S.B., and Subaward R24-AG054355 to D.M.Y.; and McDonnell Center for Systems Neuroscience to T.S.B. and D.M.Y. D.M.Y. and J.L.C. were supported by National Institutes of Health Grant T32-AG000030. D.M.Y. was additionally supported by National Institutes of Health Grants F31-DA042574 and T32-NS073547. We thank Carolyn Dean Wolf and Katherine Shapiro for assistance with data collection and technical support; and Amitai Shenhav, Katherine Conen, as well as the Cognitive Control and Psychopathology (CCP) and Shenhav laboratories for helpful input and discussions during manuscript preparation.
The authors declare no competing financial interests.
References
- Avants BB, Epstein CL, Grossman M, Gee JC (2008) Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med Image Anal 12:26–41. 10.1016/j.media.2007.06.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bahlmann J, Aarts E, D'Esposito M (2015) Influence of motivation on control hierarchy in the human frontal cortex. J Neurosci 35:3207–3217. 10.1523/JNEUROSCI.2389-14.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48–69. 10.1038/npp.2009.131 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW, Delgado MR, Hikosaka O (2007) The role of the dorsal striatum in reward and decision-making. J Neurosci 27:8161–8165. 10.1523/JNEUROSCI.1554-07.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barch DM, Burgess GC, Harms MP, Petersen SE, Schlaggar BL, Corbetta M, Glasser MF, Curtiss S, Dixit S, Feldt C, Nolan D, Bryant E, Hartley T, Footer O, Bjork JM, Poldrack R, Smith S, Johansen-Berg H, Snyder AZ, Essen DC, et al. (2013) Function in the human connectome: task-fMRI and individual differences in behavior. Neuroimage 80:169–189. 10.1016/j.neuroimage.2013.05.033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bartra O, McGuire JT, Kable JW (2013) The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76:412–427. 10.1016/j.neuroimage.2013.02.063 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bates D, Mächler M, Bolker B, Walker S (2015). Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software 67:1–48. [Google Scholar]
- Bonner SE, Sprinkle GB (2002) The Effects of Monetary Incentives on Effort and Task Performance: Theories, Evidence, and a Framework for Research. Accounting, Organizations and Society 27:303–345. [Google Scholar]
- Botvinick M, Braver T (2015) Motivation and cognitive control: from behavior to neural mechanism. Annu Rev Psychol 66:83–113. 10.1146/annurev-psych-010814-015044 [DOI] [PubMed] [Google Scholar]
- Buckner RL (1998) Event-related fMRI and the hemodynamic response. Hum Brain Mapp 66:373–377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bush G, Vogt BA, Holmes J, Dale AM, Greve D, Jenike MA, Rosen BR (2002) Dorsal anterior cingulate cortex: a role in reward-based decision making. Proc Natl Acad Sci USA 99:523–528. 10.1073/pnas.012470999 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cai X, Padoa-Schioppa C (2012) Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex. J Neurosci 32:3791–3808. 10.1523/JNEUROSCI.3864-11.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Camille N, Tsuchida A, Fellows LK (2011) Double dissociation of stimulus-value and action-value learning in humans with orbitofrontal or anterior cingulate cortex damage. J Neurosci 31:15048–15052. 10.1523/JNEUROSCI.3164-11.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carver CS, White TL (1994) Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS Scales. J Pers Soc Psychol 67:319–333. 10.1037//0022-3514.67.2.319 [DOI] [Google Scholar]
- Chib VS, Rangel A, Shimojo S, O'Doherty JP (2009) Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci 29:12315–12320. 10.1523/JNEUROSCI.2575-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clery-Melin ML, Schmidt L, Lafargue G, Baup N, Fossati P, Pessiglione M (2011) Why don't you try harder? An investigation of effort production in major depression. PLoS One 6:e23178. 10.1371/journal.pone.0023178 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cox RW (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162–173. 10.1006/cbmr.1996.0014 [DOI] [PubMed] [Google Scholar]
- Cox RW (2012) AFNI: what a long strange trip it's been. Neuroimage 62:743–747. 10.1016/j.neuroimage.2011.08.056 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cox RW, Hyde JS (1997) Software tools for analysis and visualization of fMRI data. NMR Biomed 10:171–178. [DOI] [PubMed] [Google Scholar]
- Crawford JL, Yee DM, Hallenbeck HW, Naumann A, Shapiro K, Thompson RJ, Braver TS (2020) Dissociable effects of monetary, liquid, and social incentives on motivation and cognitive control. Front Psychol 11:2212. 10.3389/fpsyg.2020.02212 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cremers HR, Wager TD, Yarkoni T (2017) The relation between statistical power and inference in fMRI. PLoS One 12:e0184923. 10.1371/journal.pone.0184923 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Croxson PL, Walton ME, O'Reilly JX, Behrens TE, Rushworth MF (2009) Effort-based cost-benefit valuation and the human brain. J Neurosci 29:4531–4541. 10.1523/JNEUROSCI.4515-08.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dale AM, Fischl B, Sereno MI (1999) Cortical surface-based analysis. Neuroimage 9:179–194. 10.1006/nimg.1998.0395 [DOI] [PubMed] [Google Scholar]
- Dang J, King KM, Inzlicht M (2020) Why Are Self-Report and Behavioral Measures Weakly Correlated? Trends Cogn Sci 24:267–269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dixon ML, Christoff K (2012) The decision to engage cognitive control is driven by expected reward-value: neural and behavioral evidence. PLoS One 7:e51637. 10.1371/journal.pone.0051637 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dubois J, Adolphs R (2016) Building a science of individual differences from fMRI. Trends Cogn Sci 20:425–419. 10.1016/j.tics.2016.03.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duverne S, Koechlin E (2017) Rewards and cognitive control in the human prefrontal cortex. Cereb Cortex 27:5024–5016. 10.1093/cercor/bhx210 [DOI] [PubMed] [Google Scholar]
- Esteban O, Markiewicz CJ, Blair RW, Moodie CA, Isik AI, Erramuzpe A, Kent JD, Goncalves M, DuPre E, Snyder M, Oya H, Ghosh SS, Wright J, Durnez J, Poldrack RA, Gorgolewski KJ (2019) fMRIPrep: a robust preprocessing pipeline for functional MRI. Nat Methods 16:111–116. 10.1038/s41592-018-0235-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Etzel J, Cole MW, Zacks JM, Kay KN, Braver TS (2016) Reward motivation enhances task representation coding in frontoparietal cortex. Cereb Cortex 26:1647–1659. 10.1093/cercor/bhu327 [DOI] [PMC free article] [PubMed] [Google Scholar]
- FitzGerald TH, Seymour B, Dolan RJ (2009) The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci 29:8388–8395. 10.1523/JNEUROSCI.0717-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fonov V, Evans AC, Botteron K, Almli CR, McKinstry RC, Collins DL, Brain Development Cooperative Group (2011) Unbiased average age-appropriate atlases for pediatric studies. Neuroimage 54:313–327. 10.1016/j.neuroimage.2010.07.033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fromer R, Wolf CK, Shenhav A (2019) Goal congruency dominates reward value in accounting for behavioral and neural correlates of value-based decision-making. Nat Commun 10:4926. 10.1038/s41467-019-12931-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fujiwara J, Tobler PN, Taira M, Iijima T, Tsutsui KI (2009) Segregated and integrated coding of reward and punishment in the cingulate cortex. J Neurophysiol 101:3284–3293. 10.1152/jn.90909.2008 [DOI] [PubMed] [Google Scholar]
- Gordon EM, Laumann TO, Adeyemo B, Huckins JF, Kelley WM, Petersen SE (2016) Generation and evaluation of a cortical area parcellation from resting-state correlations. Cereb Cortex 26:288–303. 10.1093/cercor/bhu239 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gorgolewski K, Burns CD, Madison C, Clark D, Halchenko YO, Waskom ML, Ghosh SS (2011) Nipype: a flexible, lightweight and extensible neuroimaging data processing framework in Python. Front Neuroinform 5:13–15. 10.3389/fninf.2011.00013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grahek I, Shenhav A, Musslick S, Krebs RM, Koster EH (2019) Motivation and cognitive control in depression. Neurosci Biobehav Rev 102:371–381. 10.1016/j.neubiorev.2019.04.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greve DN, Fischl B (2009) Accurate and robust brain image alignment using boundary-based registration. Neuroimage 48:63–72. 10.1016/j.neuroimage.2009.06.060 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG (2009) Research electronic data capture (REDCap): a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 42:377–381. 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayden BY, Platt ML (2010) Neurons in anterior cingulate cortex multiplex information about reward and action. J Neurosci 30:3339–3346. 10.1523/JNEUROSCI.4874-09.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heilbronner SR, Hayden BY (2016) Dorsal anterior cingulate cortex: a bottom-up view. Annu Rev Neurosci 39:149–170. 10.1146/annurev-neuro-070815-013952 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hermans HJ (1970) A questionnaire measure of achievement motivation. J Appl Psychol 54:353–363. 10.1037/h0029675 [DOI] [PubMed] [Google Scholar]
- Holroyd CB, McClure SM (2015) Hierarchical control over effortful behavior by rodent medial frontal cortex: a computational model. Psychol Rev 122:54–83. 10.1037/a0038339 [DOI] [PubMed] [Google Scholar]
- Holroyd CB, Yeung N (2012) Motivation of extended behaviors by anterior cingulate cortex. Trends Cogn Sci 16:122–128. 10.1016/j.tics.2011.12.008 [DOI] [PubMed] [Google Scholar]
- Hosking JG, Cocker PJ, Winstanley CA (2014) Dissociable contributions of anterior cingulate cortex and basolateral amygdala on a rodent cost/benefit decision-making task of cognitive effort. Neuropsychopharmacology 39:1558–1567. 10.1038/npp.2014.27 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huang H, Movellan J, Paulus MP, Harle KM (2015) The influence of depression on cognitive control: disambiguating approach and avoidance tendencies. PLoS One 10:e0143714. 10.1371/journal.pone.0143714 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jenkinson M, Bannister P, Brady M, Smith S (2002) Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17:825–841. 10.1006/nimg.2002.1132 [DOI] [PubMed] [Google Scholar]
- Kim H, Shimojo S, O'Doherty JP (2011) Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb Cortex 21:769–776. 10.1093/cercor/bhq145 [DOI] [PubMed] [Google Scholar]
- Klein A, Ghosh SS, Bao FS, Giard J, Häme Y, Stavsky E, Lee N, Rossa B, Reuter M, Neto EC, Keshavan A (2017) Mindboggling morphometry of human brains. PLoS Comput Biol 13:e1005350. 10.1371/journal.pcbi.1005350 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klein-Flugge MC, Kennerley SW, Friston K, Bestmann S (2016) Neural signatures of value comparison in human cingulate cortex during decisions requiring an effort-reward trade-off. J Neurosci 36:10002–10015. 10.1523/JNEUROSCI.0292-16.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolling N, Wittmann MK, Behrens TE, Boorman ED, Mars RB, Rushworth MF (2016) Value, search, persistence and model updating in anterior cingulate cortex. Nat Neurosci 19:1280–1285. 10.1038/nn.4382 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koob GF, Moal ML (2008) Neurobiological mechanisms for opponent motivational processes in addiction. Philos Trans R Soc Lond B Biol Sci 363:3113–3123. 10.1098/rstb.2008.0094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kouneiher F, Charron S, Koechlin E (2009) Motivation and cognitive control in the human prefrontal cortex. Nat Neurosci 12:939–945. 10.1038/nn.2321 [DOI] [PubMed] [Google Scholar]
- Krug M, Braver TS (2014) Motivation and cognitive control: going beyond monetary incentives. In: The psychological science of money, pp 137–162. Springer Science + Business Media. [Google Scholar]
- Kruschke JK (2015) Doing Bayesian data analysis: a tutorial with R and STAN, Ed 2. San Diego: Academic. [Google Scholar]
- Kuznetsova A, Brockhoff PB, Christensen RHB (2017) lmerTest Package: Tests in Linear Mixed Effects Models. J Stat Softw 82:1–26. [Google Scholar]
- Lake JI, Spielberg JM, Infantolino ZP, Crocker LD, Yee CM, Heller W, Miller GA (2019) Reward anticipation and punishment anticipation are instantiated in the brain via opponent mechanisms. Psychophysiology 56:e13381. 10.1111/psyp.13381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lanczos C (1964) Evaluation of noisy data. J Soc Industrial Appl Math B 1:76–85. 10.1137/0701007 [DOI] [Google Scholar]
- Lehner R, Balsters JH, Herger A, Hare TA, Wenderoth N (2017) Monetary, food, and social rewards induce similar Pavlovian-to-instrumental transfer effects. Front Behav Neurosci 10:247–212. 10.3389/fnbeh.2016.00247 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levy DJ, Glimcher PW (2012) The root of all value: a neural common currency for choice. Curr Opin Neurobiol 22:1027–1038. 10.1016/j.conb.2012.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McElreath R (2020) Statistical rethinking: a Bayesian course with examples in R and STAN, Ed 2. Boca Raton, FL: Chapman Hall/CRC. [Google Scholar]
- Miller EM, Shankar MU, Knutson B, McClure SM (2014) Dissociating motivation from reward in human striatal activity. J Cogn Neurosci 26:1075–1084. 10.1162/jocn_a_00535 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Monosov IE (2017) Anterior cingulate is a source of valence-specific information about value and uncertainty. Nat Commun 8:134. 10.1038/s41467-017-00072-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Monosov IE, Haber SN, Leuthardt EC, Jezzini A (2020) Anterior cingulate cortex and the control of dynamic behavior in primates. Curr Biol 30:R1442–R1454. 10.1016/j.cub.2020.10.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moskowitz DS, Young SN (2006) Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. J Psychiatry Neurosci 21:13–20. [PMC free article] [PubMed] [Google Scholar]
- Mumford JA (2012) A power calculation guide for fMRI studies. Soc Cogn Affect Neurosci 7:738–742. 10.1093/scan/nss059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olszowy W, Aston J, Rua C (2019) Accurate autocorrelation modeling substantially improves fMRI reliability. Nat Commun 10:1220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Padmala S, Pessoa L (2011) Reward reduces conflict by enhancing attentional control and biasing visual cortical processing. J Cogn Neurosci 23:3419–3432. 10.1162/jocn_a_00011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Padoa-Schioppa C, Cai X (2011) The orbitofrontal cortex and the computation of subjective value: consolidated concepts and new perspectives. Ann NY Acad Sci 1239:130–137. 10.1111/j.1749-6632.2011.06262.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Padoa-Schioppa C, Conen KE (2017) Orbitofrontal cortex: a neural circuit for economic decisions. Neuron 96:736–754. 10.1016/j.neuron.2017.09.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Park HR, Kostandyan M, Boehler CN, Krebs RM (2018) Smiling faces and cash bonuses: exploring common affective coding across positive and negative emotional and motivational stimuli using fMRI. Cogn Affect Behav Neurosci 18:550–563. 10.3758/s13415-018-0587-3 [DOI] [PubMed] [Google Scholar]
- Park SQ, Kahnt T, Talmi D, Rieskamp J, Dolan RJ, Heekeren HR (2012) Adaptive coding of reward prediction errors is gated by striatal coupling. Proc Natl Acad Sci USA 109:4285–4289. 10.1073/pnas.1119969109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parro C, Dixon ML, Christoff K (2018) The neural basis of motivational influences on cognitive control. Hum Brain Mapp 39:5097–5111. 10.1002/hbm.24348 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peters J, Buchel C (2010) Neural representations of subjective reward value. Behav Brain Res 213:135–141. 10.1016/j.bbr.2010.04.031 [DOI] [PubMed] [Google Scholar]
- Petersen SE, Dubis JW (2012) The mixed block/event-related design. Neuroimage 62:1177–1184. 10.1016/j.neuroimage.2011.09.084 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Polivy J, Doyle C (1980) Laboratory induction of mood states through the reading of self-referent mood statements: affective changes or demand characteristics? J Abnorm Psychol 89:286–290. 10.1037/0021-843X.89.2.286 [DOI] [PubMed] [Google Scholar]
- Power JD, Mitra A, Laumann TO, Snyder AZ, Schlaggar BL, Petersen SE (2014) Methods to detect, characterize, and remove motion artifact in resting state fMRI. Neuroimage 84:320–341. 10.1016/j.neuroimage.2013.08.048 [DOI] [PMC free article] [PubMed] [Google Scholar]
- RCoreTeam (2017) R: A language for statistical computing. RCoreTeam. Vienna, Austria. [Google Scholar]
- RStudioTeam (2016) RStudio: Integrated Development for R. RStudioTeam. Boston, MA. [Google Scholar]
- Rushworth MF, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8:410–417. 10.1016/j.tics.2004.07.009 [DOI] [PubMed] [Google Scholar]
- Rutledge RB, Skandali N, Dayan P, Dolan RJ (2014) A computational and neural model of momentary subjective well-being. Proc Natl Acad Sci USA 111:12252–12257. 10.1073/pnas.1407535111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sayalı C, Badre D (2019) Neural systems of cognitive demand avoidance. Neuropsychologia 123:41–54. 10.1016/j.neuropsychologia.2018.06.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schaefer A, Kong R, Gordon EM, Laumann TO, Zuo XN, Holmes AJ, Eickhoff SB, Yeo BT (2018) Local-global parcellation of the human cerebral cortex from intrinsic functional connectivity MRI. Cereb Cortex 28:3095–3114. 10.1093/cercor/bhx179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schneider KN, Sciarillo XA, Nudelman JL, Cheer JF, Roesch MR (2020) Anterior cingulate cortex signals attention in a social paradigm that manipulates reward and shock. Curr Biol 30:3724–3735.e2. 10.1016/j.cub.2020.07.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sescousse G, Caldu X, Segura B, Dreher JC (2013) Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neurosci Biobehav Rev 37:681–696. 10.1016/j.neubiorev.2013.02.002 [DOI] [PubMed] [Google Scholar]
- Sescousse G, Li Y, Dreher JC (2015) A common currency for the computation of motivational values in the human striatum. Soc Cogn Affect Neurosci 10:467–473. 10.1093/scan/nsu074 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shenhav A, Botvinick MM, Cohen JD (2013) The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 79:217–240. 10.1016/j.neuron.2013.07.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shenhav A, Musslick S, Lieder F, Kool W, Griffiths TL, Cohen JD, Botvinick MM (2017) Toward a rational and mechanistic account of mental effort. Annu Rev Neurosci 40:99–124. 10.1146/annurev-neuro-072116-031526 [DOI] [PubMed] [Google Scholar]
- Small DM (2010) Taste representation in the human insula. Brain Struct Funct 214:551–561. 10.1007/s00429-010-0266-9 [DOI] [PubMed] [Google Scholar]
- Taylor AJ, Kim JH, Ress D (2018) Characterization of the hemodynamic response function across the majority of human cerebral cortex. Neuroimage 173:322–331. 10.1016/j.neuroimage.2018.02.061 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turner BO, Paul EJ, Miller MB, Barbey AK (2018) Small sample sizes reduce the replicability of task-based fMRI studies. Commun Biol 1:62. 10.1038/s42003-018-0073-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tustison NJ, Avants BB, Cook PA, Zheng Y, Egan A, Yushkevich PA, Gee JC (2010) N4ITK: improved N3 bias correction. IEEE Trans Med Imaging 29:1310–1320. 10.1109/TMI.2010.2046908 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vega AD, Chang XL, Banich MT, Wager XT, Yarkoni XT (2016) Large-scale meta-analysis of human medial frontal cortex reveals tripartite functional organization. J Neurosci 36:6553–6562. 10.1523/JNEUROSCI.4402-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Velten E (1968) A laboratory task for induction of mood states. Behav Res Ther 6:473–482. 10.1016/0005-7967(68)90028-4 [DOI] [PubMed] [Google Scholar]
- Visscher KM, Miezin FM, Kelly JE, Buckner RL, Donaldson DI, McAvoy MP, Bhalodia VM, Petersen SE (2003) Mixed blocked/event-related designs separate transient and sustained activity in fMRI. Neuroimage 19:1694–1708. 10.1016/S1053-8119(03)00178-2 [DOI] [PubMed] [Google Scholar]
- Volkow ND, Wise RA, Baler R (2017) The dopamine motive system: implications for drug and food addiction. Nat Rev Neurosci 18:741–752. 10.1038/nrn.2017.130 [DOI] [PubMed] [Google Scholar]
- Vuorre M, Bolger N (2017) bmlm: Bayesian multilevel mediation (R package version 1.3.4). Available at https://cran.r-project.org/package=bmlm.
- Westbrook A, Lamichhane B, Braver T (2019) The subjective value of cognitive effort is encoded by a domain-general valuation network. J Neurosci 39:3934–3947. 10.1523/JNEUROSCI.3071-18.2019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wickham H (2016) ggplot2: elegant graphics for data analysis. New York: Springer. [Google Scholar]
- Wisniewski D, Reverberi C, Momennejad I, Kahnt T, Haynes JD (2015) The role of the parietal cortex in the representation of task-reward associations. J Neurosci 35:12355–12365. 10.1523/JNEUROSCI.4882-14.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wylie G, Allport A (2000) Task switching and the measurement of switch costs. Psychol Res 63:212–233. 10.1007/s004269900003 [DOI] [PubMed] [Google Scholar]
- Xie Y (2021) knitr: A General-Purpose Package for Dynamic Report Generation in R. R package version 1.31, Available at https://yihui.org/knitr/.
- Yee DM, Braver TS (2018) Interactions of motivation and cognitive control. Curr Opin Behav Sci 19:83–90. 10.1016/j.cobeha.2017.11.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yee DM, Krug MK, Allen A, Braver TS (2016) Humans integrate monetary and liquid incentives to motivate cognitive task performance. Front Psychol 6:2037–2017. 10.3389/fpsyg.2015.02037 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yee DM, Adams S, Beck A, Braver TS (2019) Age-related differences in motivational integration and cognitive control. Cogn Affect Behav Neurosci 19:692–714. 10.3758/s13415-019-00713-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yeo BT, Krienen FM, Sepulcre J, Sabuncu MR, Lashkari D, Hollinshead M, Roffman JL, Smoller JW, Zöllei L, Polimeni JR, Fischl B, Liu H, Buckner RL (2011) The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J Neurophysiol 106:1125–1165. 10.1152/jn.00338.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yuan Y, MacKinnon DP (2009) Bayesian mediation analysis. Psychol Methods 14:301–322. 10.1037/a0016972 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang Y, Brady M, Smith S (2001) Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging 20:45–57. 10.1109/42.906424 [DOI] [PubMed] [Google Scholar]
- Zhang Z, Fanning J, Ehrlich DB, Chen W, Lee D, Levy I (2017) Distributed neural representation of saliency controlled value and category during anticipation of rewards and punishments. Nat Commun 8:1907. 10.1038/s41467-017-02080-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.