Skip to main content
Cambridge Open Access logoLink to Cambridge Open Access
. 2022 Jul 7;52(10):1801–1816. doi: 10.1017/S0033291722001611

On what motivates us: a detailed review of intrinsic v. extrinsic motivation

Laurel S Morris 1,, Mora M Grehl 2, Sarah B Rutter 1, Marishka Mehta 1, Margaret L Westwater 3
PMCID: PMC9340849  PMID: 35796023

Abstract

Motivational processes underlie behaviors that enrich the human experience, and impairments in motivation are commonly observed in psychiatric illness. While motivated behavior is often examined with respect to extrinsic reinforcers, not all actions are driven by reactions to external stimuli; some are driven by ‘intrinsic’ motivation. Intrinsically motivated behaviors are computationally similar to extrinsically motivated behaviors, in that they strive to maximize reward value and minimize punishment. However, our understanding of the neurocognitive mechanisms that underlie intrinsically motivated behavior remains limited. Dysfunction in intrinsic motivation represents an important trans-diagnostic facet of psychiatric symptomology, but due to a lack of clear consensus, the contribution of intrinsic motivation to psychopathology remains poorly understood. This review aims to provide an overview of the conceptualization, measurement, and neurobiology of intrinsic motivation, providing a framework for understanding its potential contributions to psychopathology and its treatment. Distinctions between intrinsic and extrinsic motivation are discussed, including divergence in the types of associated rewards or outcomes that drive behavioral action and choice. A useful framework for understanding intrinsic motivation, and thus separating it from extrinsic motivation, is developed and suggestions for optimization of paradigms to measure intrinsic motivation are proposed.

Key words: Cognitive models, Depression, Extrinsic motivation, Intrinsic motivation

Introduction

Motivation is an integral component of human experience. Children spontaneously explore novel items, and adults autonomously engage in new hobbies, even in the absence of clear extrinsic reinforcers. Thus, not all actions are driven by tangible external stimuli or outcomes, known as ‘extrinsic’ motivation, but are driven by more internal drivers, known as ‘intrinsic’ motivation, where the activity is perceived as its own outcome.

Intrinsically motivated behaviors are computationally similar to extrinsically motivated behaviors, in that they strive to maximize goal attainment and minimize punishment, represented mathematically as value and effort cost functions, respectively (Gottlieb, Lopes, & Oudeyer, 2016). However, subjective internal value functions are difficult to characterize, and our understanding of how they are computed and integrated is limited (Gottlieb et al., 2016).

Dysfunction in intrinsic motivation represents an important transdiagnostic facet of psychiatric symptomology, which is often classified as distinct psychological constructs, such as apathy in neurological disorders, anhedonia in depression, and negative symptoms in schizophrenia. Each of these symptom domains may be underpinned by a shared dysfunction of intrinsic motivation, and interventions targeting intrinsic motivation have the potential to improve treatment outcomes for affected individuals.

However, due to a lack of clear consensus, the contribution of intrinsic motivation to psychiatric disorders remains poorly understood. This review aims to provide an overview of the conceptualization, measurement, and neurobiology of intrinsic motivation, providing a framework for understanding the potential contributions to psychopathology and its treatment.

Historical conceptualizations of intrinsic motivation

During the early 20th century, prominent descriptions of motivation were at odds with each other. Woodworth (1918) suggested that intrinsic motivation governed activities perpetuated by their own ‘native drive’, whereas Thorndike (1911) and Watson (1913) argued that external stimuli governed behavior. Also centered on internal drives, Hull's (1943) ‘drive theory’ posited that all behaviors were performed to seek or avoid primary biological states, including hunger or pain. However, the drive theory could not explain many behavioral anomalies, such as hungry rats withstanding painful electric shocks to explore a novel environment (Nissen, 1930), or rhesus monkeys performing a puzzle task for no biological reason or external reinforcer (Harlow, 1950). By narrowly presuming that biological states drive all behavior, drive theory failed to account for instances in which an organism prioritizes higher-order cognitive drives over physiological ones.

The shortcomings of drive theory led to the emergence of alternate theories of intrinsic motivation. Some argued that homeostatic maintenance of optimal biological or cognitive states (Hebb, 1955; McClelland & Clark, 1953; McClelland, Atkinson, Clark, & Lowell, 1967), or mitigation of incongruency or uncertainty (Festinger, 1957; Kagan, 1972), drove behavior. However, these theories emphasized external stimuli or cognitive representations of external goal states as key drivers of behavior. In the mid-to-late 20th century, several models underscored the importance of novelty-seeking, interest, and autonomy in driving intrinsic motivation. Novelty-seeking was suggested to energize approach behavior via curiosity and exploration that leads to skill mastery, information attainment, or learning (Kaplan & Oudeyer, 2007). Interest and enjoyment in an activity might boost intrinsic motivation by engendering ‘flow’, a prolonged state of focus and enjoyment during task engagement that stretches one's skillset (Csikszentmihalyi, 1975; Nakamura & Csikszentmihalyi, 2009). Finally, self-determination theory (Deci & Ryan, 1980) proposed that human needs for competence, achievement, and autonomy drive intrinsic motivation, aligning with observations that intrinsic motivation stems from an internal perceived autonomy during task engagement (DeCharms, 1968; Lamal, 2003). These models highlight the role of achievement and perceived autonomy (DeCharms, 1968) in driving intrinsic motivation, coinciding with current computational frameworks of intrinsic reward (Chew, Blain, Dolan, & Rutledge, 2021; Murayama, Matsumoto, Izuma, & Matsumoto, 2010).

The introduction of external goals: a shift to extrinsic motivation

While intrinsic motivation has been proposed to be divorced from external reinforcers, our understanding of motivation has been led largely by using external reinforcers as conceptual and experimental tools. Here, we briefly review historical perspectives on external drivers of motivated behavior, outlining prominent goal- and action-focused models of extrinsic motivation.

Early psychological models of extrinsic motivation suggested that ‘will’ and ‘intention’ fostered goal achievement, emphasizing the influence of goal expectation on action and control (Lewin, 1951; Tolman, 1932). Within this framework, environmental features, as well as an individual's internal state or memory, determine their actions when pursuing a goal, or, more specifically, the cognitive representation of a goal (Kagan, 1972). This requires multiple cognitive representations to be developed, maintained, and updated, with a particular reliance on external stimuli and learning (Deci, Koestner, & Ryan, 1999; Kagan, 1972; Kagan & Moss, 1983).

Alongside psychological model development, economic models of motivation emerged. These models propose that extrinsic goals, or incentives, elicit motivated behavior via a cost-benefit analysis, where motivated choice occurs when benefits outweigh costs. More recently, behavioral economics has considered how individual personality traits, biases, and irrationalities influence motivated behavior (Strombach, Strang, Park, & Kenning, 2016). A recent model (Strombach et al., 2016) incorporates various factors into the classical cost-benefit analysis, including traditional intrinsic (e.g. satisfaction) and extrinsic drivers (e.g. money), with negative influences from costs (e.g. effort, pain), which are merged into a single dynamic, subjective and state-dependent factor that drives motivated behavior. Though this approach is powerful, the explicit focus on incentives provides limited explanatory power for various paradoxical behaviors, including rodents overcoming the high cost to self-stimulate certain brain regions (e.g. nucleus accumbens; Nac) or extrinsic reinforcers' dampening effect on intrinsic motivation.

In reinforcement learning models of decision-making, an organism, or agent, learns which actions maximize total reward. This process has been formalized within computational sciences and modern artificial intelligence systems (Sutton & Barto, 1981; Witten, 1977), where learning and decision-making depend on an extrinsic outcome. One theory suggests that motivated action is driven solely by a need to reduce reward prediction errors (RPEs; Kaplan and Oudeyer, 2007), or the mismatch between expectation and outcome (Montague, Dayan, & Sejnowski, 1996; Schultz et al., 1997). RPEs can also be conceptualized as valuation signals for novel outcomes or unexpected stimuli. RPE-based learning then drives motivated behavior, or action choice, but even if the agent displays intact encoding of action or outcome value, motivated behavior can be dampened by reduced novelty. This highlights the role of novelty, expectation and prediction in learning per se, rather than choice valuation.

In action-focused models of motivation, incentives can trigger approach or avoidance behavior by signaling a potential goal state (Berridge, Robinson, & Aldridge, 2009). Incentive motivation thus relies on expectancy, probability, and value of outcomes, which are thought to dictate behavioral choice and decision-making. While greater reliance on stimulus-outcome rather than stimulus-response contingencies has led some to describe incentive motivation as proactive (Beckmann & Heckhausen, 2018), others have characterized it as reactive due to the central role of learning from past experience (Bolles, 1972). Reliance on an expected outcome was central to behaviorism (Watson, 1913, 1930) and operant conditioning (Skinner, 1938), which assume that actions are driven by a reinforcer, and instrumental value is assigned to the behavior itself. Stimulus-response pairs dominate behaviorism and modern theories of habitual behavior (Gläscher, Daw, Dayan, & O'Doherty, 2010), where the dependency on previously reinforced actions ultimately governs motivated choice (de Wit et al., 2011; Gillan, Robbins, Sahakian, van den Heuvel, & van Wingen, 2016; Voon et al., 2014). However, this renders behaviors as repetitive, insensitive to punishment and divorced from goals (Robbins, Gillan, Smith, de Wit, & Ersche, 2012). Therefore, these action-focused models of motivated behavior almost entirely discount intrinsic motivation since extrinsic motivators usurp control of behavior.

Several limitations of extrinsic motivation models must be considered when attempting to characterize intrinsic motivation. First, for cost-benefit analysis and reinforcement learning, an internal representation of the outcome must first be learned, which requires previous experience of the goal. However, intrinsic motivation can occur for novel outcomes, or behaviors that are uncertain or ambiguous. Second, motivation can occur for activities that may already be fully predictable, marking a significant limitation for reinforcement-learning models of motivation, which assume that reward prediction errors drive learning for motivated action. Third, these frameworks cannot fully explain spontaneous novelty seeking or exploratory behavior, in which no external reward is expected and no cost is overcome (Deci et al., 1999; Marsden, Ma, Deci, Ryan, & Chiu, 2014).

Separating and integrating intrinsic and extrinsic motivation

A key question is whether intrinsic and extrinsic motivation can, or should, be experimentally or theoretically separated. There is some evidence that they are dissociable constructs at the neural level. The most compelling support comes from case reports of patients with basal ganglia lesions who developed ‘psychic akinesia’, a syndrome characterized by difficulty with self-generated action initiation but no difficulty in performing complex cognitive or motor tasks when prompted (Laplane, Baulac, Widlocher, & Dubois, 1984; Lugaresi, Montagna, Morreale, & Gallassi, 1990). In patients with alien hand syndrome, medial prefrontal and anterior cingulate cortex (ACC) lesions lead to a loss of intentional motor control, whereas (pre)-supplementary motor area lesions lead to impairments in implementing motor intentions (Brugger, Galovic, Weder, & Kägi, 2015; Nachev, Kennard, & Husain, 2008). Preclinical findings further show that photostimulation of GABAergic amygdala projections modulates extrinsic motivation without affecting intrinsically motivated behavior (Seo et al., 2016). Together, these findings suggest that intrinsic and extrinsic motivation reflect different cortico-striatal-limbic circuits.

Behavioral research primarily supports the view that intrinsic and extrinsic motivation are partially distinct, interacting processes. For example, if the motivation for intrinsic and extrinsic goals were independent constructs, they might demonstrate an additive or subtractive effect on each other (Woodworth, 1921). Indeed, the expectation (Liu & Hou, 2017) and experience (Badami, VaezMousavi, Wulf, & Namazizadeh, 2011) of an extrinsic reinforcer can increase intrinsic motivation. However, reports of the ‘undermining effect’, in which an external reinforcer reduces intrinsic motivation (Cerasoli, Nicklin, & Ford, 2014; Deci, 1971; Deci, Benware, & Landy, 1974; Lepper & Greene, 1978; Lepper, Greene, & Nisbett, 1973) have sparked debate over how extrinsic reinforcers affect internally-motived behaviors (Cameron & Pierce, 2002; Lamal, 2003; Lepper, Keavney, & Drake, 1996). One explanation for the undermining effect suggests that the presence of an external reinforcer shifts one's perception of the locus of control over the behavior from internal to external (Deci & Ryan, 1980). This implicates a key role of agency, or the belief of action ownership, in intrinsic motivation. While controversial, mounting evidence supports this account of the undermining effect, where various extrinsic motivators (e.g. food, social observation; Ryan, 1982) decrease intrinsic motivation when their delivery is contingent on task-performance.

A useful framework for parsing motivated action into intrinsic and extrinsic is the Rubicon model of action phases (Heckhausen & Heckhausen, 2018; Heckhausen, 1989). Within this framework, pre-decisional option deliberation occurs, which is followed by choice intention formation and planning, volitional action, outcome achievement, and evaluation (Fig. 1). Husain and Roiser (2018) recently proposed a complementary model to deconstruct apathy and anhedonia into underlying cognitive processes, including option generation, anticipation, action initiation, prediction, consumption and learning. This parcellation broadly reflects the five main stages of the Rubicon model: (1) pre-decisional deliberation (option generation); (2) intention formation, planning, initiation (anticipation); (3) volitional action (action initiation, prediction), (4) outcome achievement (consumption); and (5) evaluation (learning; Figure 1). Within these overlapping frameworks, the initial pre-decisional deliberation/option generation phase represents the point at which intrinsic and extrinsic facets of motivation diverge, as early drivers of behavior can be intrinsic (e.g. enjoyment, interest, exploration) or extrinsic (e.g. social reward). The differences between these early drivers highlight a key distinction between intrinsic and extrinsic motivation, in which the former is a fundamentally proactive process and the latter reactive.

Fig. 1.

Fig. 1.

Schematic framework for parsing motivated action. Motivated decision-making and action is parsed into separate phases of choice, action and outcome valuation, combining and building upon separate frameworks including the Rubicon model of action phases, well-established computational mechanisms and a recent cognitive framework describing anhedonia and apathy. During choice valuation, pre-decisional deliberation includes option generation, a cost-benefit analysis and option selection. Intrinsic and extrinsic motivation diverges during this early choice valuation phase. Once choice valuation has been computed and an option selected, planning and anticipation occurs. During action valuation, volitional action is initiated and action sustainment or acceleration is maintained. During outcome valuation, outcome achievement and consumption ensue, followed by evaluation based on learning via prediction error (PE) updating. Created with BioRender.com.

If a behavior were intrinsically motivated, the pre-decisional deliberation phase might be determined by biological drives, the need to restore homeostasis (Hebb, 1949; Hull, 1943), or a state of incongruency resolution (Festinger, 1957; Kagan, 1972) as described by early theories of intrinsic motivation. In contemporary frameworks, novelty-seeking, exploration, or interest in learning or achievement would render subsequent actions as intrinsically motivated. If a behavior were extrinsically motivated, this pre-decisional deliberation phase would represent the cost-benefit analysis in economic models, prediction-error minimization in reinforcement learning, or effort-reward trade-off computation. Under incentive motivation and behaviorist theories, the pre-decisional deliberation phase would be triggered by conditioned stimuli making conscious deliberation unnecessary and inefficient.

A combination of intrinsic and extrinsic factors likely enters into the pre-decisional deliberation phase to guide motivated behavior (Fig. 1). Although intrinsic and extrinsic motivation are conceptually distinct processes, attempts to formally define them have identified several mechanisms by which they interact, leading to questions about their dissociability. Since they can interact in an additive or subtractive fashion, they may indeed be separate, independent drivers of behavior that are amalgamated during a pre-decisional deliberation phase of behavioral choice.

Measuring intrinsic motivation

Human behavior

Early attempts to quantify intrinsic motivation were largely based on behavioral observation, wherein intrinsic motivation was measured as free choice of an activity in the absence of an external stimulus or performance rating (Butler & Nisan, 1986; Daniel & Esser, 1980; Liu & Hou, 2017). These studies also implemented self-report measures of participants' interest or enjoyment in an activity. While such measures do capture intrinsic motivation as inherent task enjoyment, they are limited by their qualitative and indirect nature, as well as by variability in participant insight. However, more objective measures are difficult to develop due to the inherently unobservable nature of intrinsic motivation.

Since spontaneous novelty-seeking and exploratory behavior reflect intrinsic motivation, one candidate objective measure may be the explore-exploit paradigm (Gittins & Jones, 1979; Robbins, 1952). In explore-exploit foraging tasks, participants must choose among various options and either exploit a previously reinforced choice or explore a novel alternative option. An individual's tendency to either explore an environment or exploit their pre-existing knowledge is influenced by perseverance (Von Culin et al., 2014), which acts as an indicator of confidence in the absence of immediate reward. Healthy adults flexibly employ a mix of exploitative and exploratory choices, where striatal and prefrontal dopamine signaling is proposed to drive exploration and exploitation, respectively (Badre, Doll, Long,, & Frank,, 2012; Daw, O'Doherty, Dayan, Seymour, & Dolan, 2006; Mansouri, Koechlin, Rosa, & Buckley, 2017). While these tasks capture one's willingness to trade-off exploratory v. exploitative behaviors, they do not measure free-choice exploratory behavior in the absence of explicit reinforcers, which would be most consistent with intrinsic motivation.

Paradigms that allow an individual to choose to explore an environment without extrinsic reinforcers, or to engage in a previously enjoyable or interesting activity, would more closely index intrinsic motivation. Additionally, outcomes that relate to achievement or autonomy, without socially rewarding feedback or monetary outcomes, would also putatively engage intrinsic motivation. Task parameters related to exploration, enjoyment, achievement, and autonomy can each be modulated and computationally modeled to determine their effects on free choice or behavioral activation vigor.

Current computational approaches depend on modeling decision-making, outcome learning, or action-outcome associations to drive our understanding of motivation. Traditional decision-making models often rely on softmax functions to compute values of available actions (Wilson & Collins, 2019), where action selection is based on the ‘policy’ of the best outcome. Computationally, an action selection process computes the probability of an action occurring in any state and the expected reward. A policy is developed based on the assumption that motivated actions are performed to increase the probability of rewards and decrease the probability of punishment. Yet, in everyday life, our actions can be motivated by an arbitrary cue that may signal an internal rewarding state. For example, a standard algorithm solving for motivated action assumes that all actions have equal probability, yet this discounts the unknown drivers and evaluators of internal rewards. Hence, they act as limiting factors to the applicability of decision-making models in studies of intrinsic motivation.

Neuroimaging

Functional neuroimaging [e.g., functional magnetic resonance imaging (fMRI), electroencephalography (EEG)] offers a measurement modality that may be particularly apt for the study of internally driven processes like intrinsic motivation. Research using fMRI has characterized the neural correlates of various internal processes that lack clear behavioral indicators (e.g. rumination, emotion regulation, pain perception; Zhou et al., 2020; Wagner, N'Diaye, Ethofer, and Vuilleumier, 2011), yet few studies have assessed the neural correlates of intrinsic motivation in humans, which likely reflects the limitations in its behavioral measurement. Studies have largely assessed intrinsic motivation via comparisons with neural responses to extrinsic reinforcers during fMRI, which can be correlated with self-reported intrinsic motivation (Bengtsson, Lau, & Passingham, 2009; Chew et al., 2021; Linke et al., 2010). Despite the relative paucity of neuroimaging studies that clearly separate intrinsic v. extrinsic motivation, existing work provides preliminary insight into the neural circuitry of intrinsic motivation.

First, extrinsic reinforcers have elicited amygdala, ACC, ventromedial prefrontal cortex (vmPFC), orbitofrontal cortex (OFC), and ventral striatal (VS) or Nac activity in healthy subjects that was associated with higher self-reported extrinsic motivation but lower self-reported intrinsic motivation (Linke et al., 2010). This could suggest that intrinsic motivation relates to a lower sensitivity of these regions to extrinsic reinforcers, general deactivation of these regions, or that the dampening impact of extrinsic reinforcers on intrinsic motivation is subserved by these regions. Others report that intrinsic motivation (operationalized as the amount of free-time spent on a puzzle-task, which did not relate to task enjoyment, interest, or accuracy), was associated with deactivation in the amygdala, dorsal ACC, dorsomedial striatum, and insula during puzzle-task onset (Marsden et al., 2014). This is another piece of evidence linking neural deactivation to intrinsic motivation; however, since these tasks were not related to traditional ‘intrinsic motivators’ like task enjoyment, findings may relate to boredom-reduction behavior that might be more related to punishment avoidance rather than intrinsic motivation per se.

Bengtsson et al. (2009) operationalized intrinsic motivation as task-performance with and without explicit experimental observation during fMRI scanning, which boosted self-reported intrinsic motivation. The authors found greater neural activation of ACC, OFC, and lateral prefrontal cortex during task-performance errors when participants were observed (Bengtsson et al., 2009). While implicating a similar network of brain regions as prior studies, these findings cannot be divorced from error-related neural activation modulated by task salience (e.g. observed v. not).

In contrast, Murayama et al. (2010) provide a more optimal operationalization of intrinsic motivation, in which participants performed a task that was previously rated as inherently interesting, and successful task performance served as the intrinsic reward. During fMRI scanning, feedback for both extrinsic (monetary feedback) and intrinsic (accuracy feedback) rewards elicited VS activation. Participants then had the option to perform the same task without feedback, and intrinsic motivation was operationalized as time spent on the second version of the task. During the second session, VS activation was only diminished for extrinsic rewards, which could reflect reduced VS habituation to intrinsic rewards (Murayama et al., 2010, 2015). Additionally, greater reductions in neural responses to extrinsic reinforcers were related to lower intrinsic motivation (i.e. task engagement time outside of the scanner), suggesting that neural habituation to extrinsic reinforcers may relate to lower intrinsic motivation. A recent computational neuroimaging study modeled intrinsic rewards as successful spatial-motor task performance without experienced errors, which was divorced from learning (Chew et al., 2021). This modeling of intrinsic rewards was akin to the accuracy feedback operationalization of Murayama et al. (2010). Both extrinsic (monetary) reward and intrinsic performance-based rewards (successful task completion) recruited vmPFC activation, which related to subjective happiness (Chew et al., 2021). Although limited in their ability to dissociate activation from task performance per se and explicit feedback related to achievement, these studies are the closest examples of objective measures of intrinsic motivation, and they suggest that putative reward-processing regions (VS, vmPFC) encode intrinsic rewards.

Complementary studies have examined how curiosity, or the intrinsic motivation to learn, modulates neural responses and influences memory recall (Gruber, Gelman, & Ranganath, 2014; Kang et al., 2009). High-curiosity states augment midbrain and v. activity (Gruber et al., 2014), as well as bilateral caudate (Kang et al., 2009) and anterior insula (Lee & Reeve, 2017) responses, which may improve learning and memory. As these paradigms index intrinsic motivation independently from a rewarding outcome, they perhaps provide the strongest support for partially overlapping circuits of extrinsic and intrinsic motivation.

Dopamine

The brain's dopamine system supports a range of appetitive and aversive motivational processes, including behavioral activation, exertion of effort, and sustained task engagement (Diederen & Fletcher, 2020; Salamone, Yohn, López-Cruz, San Miguel, & Correa, 2016). The mesolimbic pathway, projecting from the ventral tegmental area (VTA) to limbic regions, including the Nac, amygdala, and hippocampus, facilitates reinforcement and associative learning by acting as a ‘Go’ signal for foraging or exploration (Huang, Lv, & Wu, 2016). Although it has long been known that dopamine transmission subserves motivational processes, some evidence suggests that it is particularly important for intrinsic motivation. For example, mesolimbic dopamine contributes to exploration for the sake of interest (DeYoung, 2013; Panksepp & Moskal, 2008), and novel and unexpected stimuli elicit phasic dopamine spikes in rodents (Fiorillo, 2003; Hooks & Kalivas, 1994; Schultz, 1998). In patients with depression, deep-brain stimulation of dopaminergic brain regions including the Nac (Schlaepfer et al., 2007) and the mesolimbic dopamine projections from the VTA (Fenoy et al., 2018) increased subjective interest in, and motivational energy for, previously enjoyable activities (Schlaepfer et al., 2007). Dopamine has also been associated with intrinsically motivated flow states (de Manzano et al., 2013; Gyurkovics et al., 2016).

However, since VTA dopamine spiking is reduced for expected events (Schultz, 1998), it may not be a strong candidate neural mechanism for intrinsic motivation, which can occur for predictable activities. Efforts to reconcile the role of dopamine in learning and motivation suggest that while phasic cell firing signals RPEs (Kim et al., 2020), phasic dopamine release and local modulation in key regions, such as the VS/NAc, relates to approach motivation (Berke, 2018; Mohebi et al., 2019). Indeed, while VTA dopamine cell firing occurs during reward prediction, only NAc dopamine release covaries with reward availability and ramps up during approach and consumption of reward (Mohebi et al., 2019). Moreover, increasing dopamine in rodents increases their willingness to exert effort, and this has since been replicated across species, including via pharmacological manipulation in humans (Salamone, Correa, Farrar, & Mingote, 2007; Treadway & Zald, 2011). This suggests that, while VTA dopamine spiking underpins reward prediction and learning, it is local NAc dopamine release that encodes motivational drive.

Opioids, norepinephrine, and related neurotransmitter systems

Though a comprehensive account of the neurotransmitter systems subserving motivated behavior is beyond the scope of this review, we note that endogenous opioid and cannabinoid systems may uniquely modulate intrinsically motivated behavior. For example, mu- and delta-opioid receptor activation underlies the pleasurable effects of opioid and non-opioid drugs of abuse (Berrendero, Robledo, Trigo, Martín-García, & Maldonado, 2010; Trigo, Martin-García, Berrendero, Robledo, & Maldonado, 2010), as well as primary reinforcers (Hsu et al., 2013; Kelley & Berridge, 2002). Activation of mu-opioid receptors has also been shown to mediate motivational states following delta-9-tetrahydrocannabinol (THC) administration in rodents (Ghozland et al., 2002), likely via interactions with the mesolimbic dopamine system. Further evidence implicates antidepressant effects of endogenous opioids in both animals and humans (Peciña et al., 2018), which many partly reflect improved intrinsic motivation (e.g. time mice spent swimming during the forced swim test; Kastin, Scollan, Ehrensing, Schally, and Coy, 1978). Additionally, the endocannabinoid system interacts with both endogenous opioid and dopaminergic systems to influence intrinsic motivation, such as social play (Trezza et al., 2012; Trezza & Vanderschuren, 2008), and voluntary exercise, in rodents (Dubreucq, Koehl, Abrous, Marsicano, & Chaouloff, 2010). Since these systems have been primarily examined in animal models, pharmacological manipulation in humans would be an important next step in delineating the contribution of opioid and endocannabinoid systems to intrinsic v. extrinsic motivation.

Intrinsic motivation and psychiatry: focus on anhedonia

Problems with motivation are observed across many neuropsychiatric disorders, and these often correspond to distinct symptoms (Table 1). This section focuses on anhedonia, a reduced ability to experience pleasure (Ribot, 1986), as a prevalent clinical manifestation of deficient intrinsic and extrinsic motivation.

Table 1.

Explicit studies of ‘intrinsic motivation’ in neuropsychiatric disorders

Disorder Related symptom Cohort Measure Evidence Reference
Depressive disorders Anhedonia N = 537 undergraduate students Motivated Strategies for Learning Questionnaire, 9-item intrinsic value subscale, Pintrich and De Groot (1990). Academic IM was negatively associated with depression and stress. Huang et al. (2016)
N = 95 MDD Autonomous and Controlled Motivations for Treatment Questionnaire. Autonomous motivation predicted a higher probability of remission and lower post-treatment depression severity among patients across three outpatient treatments: 16 sessions of manualized interpersonal therapy, cognitive–behavior therapy, or pharmacotherapy with clinical management. Zuroff et al. (2007)
N = 59 subthreshold MDD Performance of a stopwatch task based on intrinsic motivation during fMRI scanning Behavioral activation therapy (identify and complete enjoyable activities that provide a sense of achievement) increased activation and connectivity in frontostriatal regions, associated with improved sensitivity to rewards. Mori et al. (2018)
N = 106 healthy volunteers Intrinsic Motivation Inventory: two items from the interest/enjoyment subscale. Participants who were unable to differentiate between positive emotions had stronger links between positive emotions and intrinsic motivation, whereas subjects that were able to differentiate between negative emotions showed a weaker link between negative emotions and intrinsic motivation. Vandercammen, Hofmans, and Theuns (2014)
N = 33 treatment resistant MDD Intrinsic Motivation Inventory. Examined the effectiveness of cognitive remediation with supplemental Internet-based homework, Treatment consisted of 10 weeks of weekly group sessions and daily online cognitive exercises completed at home. Homework completion was associated with worse depressive symptoms and not intrinsic motivation. Bowie et al. (2013)
N = 300 working adults Rated 10 job aspects on 6-point scales related in intrinsic (e.g. self growth) and extrinsic (e.g. pay, social status) job features. Intrinsic work motivation was associated with higher job satisfaction. Higher extrinsic motivation was associated with higher depression scores. Lu (1999)
N = 215 elite team-sport athletes Sport Motivation Scale II, Perceived Motivational Climate in Sport Questionnaire II, Basic Need Satisfaction in Sport Scale. Intrinsic regulation of sport motivation was related to higher depressive symptoms. Sheehan, Herring, and Campbell (2018)
N = 236 healthy adolescents Perceived Teacher Autonomy Support Questionnaire, General Basic Needs Satisfaction Scale. Teacher autonomy support increased psychological needs satisfaction and intrinsic motivation for school engagement, which, in turn, was associated with decreased anxiety and depression scores. Yu, Li, Wang, and Zhang (2016)
N = 115 healthy children Perception of Success, Enjoyment of the Practice of Sports, Achievement Motivation in Physical Education. In 11-12-year-old children, skill mastery ‘intrinsic’ motivation training increased task enjoyment, perceived ability and effort, as well as baseline anxiety. Cecchini et al. (2001)
Schizophrenia spectrum disorders ‘Negative symptoms' in schizophrenia, schizoaffective disorder, and other psychotic illnesses span a range of behaviors again underscored by a lack of self-generated initiation, not limited to alogia, avolition, social withdrawal and affective blunting. n = 66 SCZ or SZA; n = 44 controls Motivational Trait Questionnaire: 3 components of intrinsic motivation (personal mastery, competitive excellence, motivation related to anxiety). In control subjects only, IM was related to cognitive performance. Both groups showed positive relationships between intrinsic motivation and approach and avoidance behaviors. Barch, Yodkovik, Sypher-Locke, and Hanewinkel (2008)
N = 120 SCZ Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity. In patients who were at the start of outpatient psychosocial rehabilitation programs, IM mediated the relationship between neurocognition and psychosocial functioning. Nakagami, Xie, Hoe, and Brekke (2008)
N = 57 SCZ or SZA Intrinsic Motivation Inventory. Intrinsically motivating instructional techniques during difficult task learning increased intrinsic motivation for the task, self-efficacy and achievement. Choi and Medalia (2010)
N = 130 SCZ or SZA Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity. In patients from 4 community-based, psychosocial rehabilitation programs in Los Angeles, USA, IM was dynamic over time. Baseline IM predicted improvements in neurocognition, and change in IM was associated with change in psychosocial functioning. Nakagami, Hoe, and Brekke (2010)
N = 18 SCZ; n = 17 healthy controls Enjoyable stop watch timing task where subjects stop a watch at an exact time. In this task, the watch starts automatically and must be stopped with a single button press within 50 ms of the 5s time point. The total number of successful trials is continuously displayed. A control task is passive watch viewing with a single button press when the watch stops. Participants with SCZ showed lower IM for the task. Lateral prefrontal cortex activity during the cue period was associated with higher IM. Takeda et al. (2017)
N = 75 SCZ Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity. High IM related to greater metacognitive mastery in a sample of patients with chronic illness. Vohs and Lysaker (2014)
N = 32 SCZ in functional remission Intrinsic Motivation Inventory for Schizophrenia Research. IM was associated with metacognition and subjects with greater intrinsic motivation and metacognition improved. Tas, Brown, Esen-Danaci, Lysaker, and Brüne (2012)
N = 58 SCZ spectrum disorders Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity. IM was linked to extraversion, neuroticism and negative symptoms in this all-male cohort. Vohs, Lysaker, and Nabors (2013)
N = 12 SCZ Intrinsic Motivation Inventory. Among patients in outpatient treatment, IM for a cognitive task was associated with performance. Fervaha, Agid, Foussias, and Remington (2014)
N = 166 SCZ spectrum disorders Quality of Life Scale. All participants attended psychosocial rehabilitation programs in a diverse urban community. IM fully mediated the relationship between functioning and negative, disorganized, and global symptoms, and partially mediated the relationship between positive symptoms and functioning. Yamada, Lee, Dinh, Barrio, and Brekke (2010)
N = 49 SCZ or SZA Intrinsic Motivation Inventory for Schizophrenia Research. Perceived program value was the only predictor of attendance and cognitive improvement increased with improvements in program interest. Motivational changes over time were variable between subjects. Bryce et al. (2018)
N = 125 psychotic disorder Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity. IM mediated the relationship between poor metacognition and impaired functioning. Luther et al. (2016)
N = 40 FEP; N = 66 prolonged psychosis Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity; PANSS. FEP patients had higher IM and lower amotivation levels than the prolonged psychosis group. IM was associated with lower amotivation in both groups. Luther, Lysaker, Firmin, Breier, and Vohs (2015)
N = 535 SCZ with comorbid SUDs Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity. The IM measure was reliable for this cohort. IM was negatively associated with alcohol and drug use severity, and changes in IM over time predicted alcohol/drug use severity. Bahorik, Eack, Cochran, Greeno, and Cornelius (2015)
N = 858 SCZ; N = 576 SCZ with comorbid SUDs Heinrichs-Carpenter Quality of Life Scale IM was negatively related to the likelihood of any alcohol or substance use at baseline. Reduced IM was associated with greater likelihood of alcohol or substance use at 6-month follow-up, whereas greater IM was protective against drug use. Bahorik, Greeno, Cochran, Cornelius, and Eack (2017)
N = 71 SCZ spectrum disorders Quality of Life Scale: Sum of 3 items, purpose, motivation, and curiosity; Intrinsic Motivation Inventory. The two IM measures were not significantly correlated among patients in an outpatient rehabilitation program. Only the QLS IM score was associated with rehabilitation outcomes. Choi, Choi, Felice Reddy, and Fiszdon (2014)
Parkinson's disease Apathy- In Parkinson's disease (PD), apathy describes reduced interest and execution of goal-directed activities, unrelated to depressive emotional states or cognitive impairment. There is an absence of spontaneous auto-activation, or self-generated behavior. three subtypes of disrupted processing: ‘cognitive’, ‘emotional-affective’, and ‘auto-activation’. N = 27 PD; N = 27 healthy controls Curiosity for resolving uncertainty, despite negative outcomes, via choice to view or skip negative images. The PD group viewed the images less frequently under the certain and uncertain conditions. The amount of pictures viewed was positively associated with the distribution of dopamine transporters in the striatum. Shigemune et al. (2021)
N = 28 PD Participants stood on a stabilometer and aimed to maintain a horizontal platform position during each 30s trial, with the self-control group having autonomy to choose to use a balance pole while the yoked group used the balance pole on a set schedule. The self-control group were more accurate and more motivated to learn the task compared to the yoked group. Chiviacowsky, Wulf, Lewthwaite, and Campos (2012)
N = 28 PD Intrinsic Motivation Inventory. In PD patients at general psychiatric outpatient clinics in Nanjing, those assigned to core stability training showed (1) higher IM compared to the home exercise group, and (2) increased interest and pleasure, perceived merit, effort and general motivation at the 8-week follow-up. Sun and Chen (2017)
N = 57 PD Regulatory Mode Questionnaire. Patients showed reduced assessment motivation only. Foerde, Braun, Higgins, and Shohamy (2014)
SUD, AUD, and gambling disorder One symptom of SUDs and AUD relates to individuals forgoing important work-related, social or recreational activities due to their substance use. Among others, this symptom relates to reduced goal-directed behaviors, which may indicate impaired IM. N = 454 SUD Circumstances, Motivation, Readiness, and Suitability instrument, Norwegian version. In patients from 5 inpatient SUD centers in Norway, higher IM for changing substance use was associated with lower dropout risk. Andersson, Steinsbekk, Walderhaug, Otterholt, and Nordfjærn (2018)
N = 15 SUD adolescents; N = 15 caretakers Interview about treatment experience coded for 4 dyadic categories: intrinsic motivation; extrinsic motivation; both or mixed/transitional; and disagreement/conflicting. Adolescent patients with higher IM were more engaged in treatment. Cornelius, Earnshaw, Menino, Bogart, and Levy (2017)
N = 611 SUD Reasons for Quitting Questionnaire adapted for use with substance users other than tobacco smokers. Intrinsic self-concept issues were related to abstinence. IM was higher than IM in this sample of treatment-seeking individuals with poly-substance use disorders Downey, Rosengren, and Donovan (2001)
N = 252 undergraduate students Gambling Motives Scale & General Causality Orientation Scale In an at-risk sample, greater autonomy was associated with lower problematic gambling, in part, due to a lower tendency of chasing losses. Rodriguez, Neighbors, Rinker, and Tackett (2014)
N = 887 regular gamblers Global Motivation Scale & Basic Psychological Need Satisfaction and Frustration Scale Greater IM was weakly associated with increased problematic gambling. Mills, Li Anthony, and Nower (2020)
N = 94 undergraduate students Intrinsic–Extrinsic Aspirations Scale. IM and sense of control were positively associated with adaptive motivation and negatively with alcohol intake. Shamloo and Cox (2010)
N = 1137 smokers Reasons for Quitting scale. In this population-based sample, higher IM relative to EM was associated with greater readiness to quit and successful smoking cessation at 1-year follow-up. Curry, Grothaus, and McBride (1997)
N = 1961 adolescents Ratings of emotional engagement. In a diverse adolescent sample, positive time attitudes were indirectly associated with less marijuana use via IM, engagement, and less alcohol use. The indirect effect of positive time attitudes on engagement via IM was significant and substantial. Negative time attitudes and IM were indirectly associated with less marijuana use via behavioral engagement. Froiland, Worrell, Olenchak, and Kowalski (2020)

Note: Cohort abbreviations: AUD, alcohol use disorder; FEP, first-episode psychosis; MDD, major depressive disorder; PD, Parkinson's disease; SCZ, schizophrenia; SUDs, substance use disorders; SZA, schizoaffective disorder. Evidence abbreviations: EM, extrinsic motivation; IM, intrinsic motivation.

In the Diagnostic and Statistical Model of Mental Disorders, 5th edition (DSM-5), anhedonia serves as one of two cardinal symptoms of depressive disorders, where it is defined as the ‘loss of interest or pleasure in all, or almost all, activities’, (American Psychiatric Association, 2013). The second cardinal symptom relates to persistent depressed mood. Approximately one-third of individuals with depression report clinically significant anhedonia (Pelizza & Ferrari, 2009), and these individuals are at-risk for poorer treatment outcomes, including nonresponse, relapse, and increased suicidality, relative to their non-anhedonic peers (Morris, Bylsma, & Rottenberg, 2009; Nierenberg et al., 1999).

Anhedonia remains an important clinical target that, by definition, implicates perturbations in intrinsically-motivated behavior, yet most empirical studies of anhedonia and motivation have investigated their relationship using extrinsic reinforcers. Findings broadly support theories of reward dysfunction in depression (reviewed by Sescousse, Caldú, Segura, and Dreher, 2013; Roiser & Husain, 2018; Borsini, Wallis, Zunszain, Pariante, and Kempton, 2020), where anhedonia has been associated with a reduced bias toward a monetary reward in individuals with depression (Liu et al., 2011) and their first-degree relatives (Liu et al., 2016). Children who are at-risk for depression show reduced VS and anterior insula responses to monetary gains, implicating blunted reward sensitivity as an antecedent to anhedonia (Luking, Pagliaccio, Luby, & Barch, 2016). Moreover, vmPFC responses during unexpected reward receipt may indirectly relate to anhedonia in depressed patients by modulating task motivation (Segarra et al., 2016). Interestingly, reward sensitivity disturbances in depression might not extend to aberrant reward learning (Huys, Pizzagalli, Bogdan, & Dayan, 2013) where adults with moderate depression show intact VS RPE-signaling during probabilistic learning (Rutledge et al., 2017). Nevertheless, there have been suggestions that perturbations in domains more related to intrinsic motivation, such as model-based future planning or effort initiation and invigoration, may be key in underlying anhedonia (Berwian et al., 2020; Cooper, Arulpragasam, & Treadway, 2018; Rutledge et al., 2017). Finally, affect can also alter both the valence and evaluation of an activity, which can, in turn, modulate the likelihood of selecting a more inherently interesting task (Isen & Reeve, 2006). Anhedonic individuals have more pessimistic likelihood estimates and reduced positive affective forecasts relative to controls while also demonstrating greater reliance on negative emotion during future-oriented cognition (Marroquín & Nolen-Hoeksema, 2015).

While few studies have implemented objective measures of intrinsic motivation in studying anhedonia, recent work links this symptom with difficulties with representations of future states during early stages of motivated behavior (Moutoussis et al., 2018). Since intrinsic motivation is driven more by proactive factors as opposed to the more reactive domain of extrinsic motivation, parsing future-oriented decision-making might provide novel insights not only into mechanisms of intrinsic motivation but also anhedonia. When considering the pre-decisional deliberation phase of motivated action (Fig. 1), the representation of a future state may be critical for distinguishing intrinsic v. extrinsic motivation. For example, disrupted representations of intrinsic reinforcers (e.g. autonomy, achievement, task enjoyment, novelty seeking), energy expenditure (Treadway, Cooper, & Miller, 2019; Winch, Moberly, & Dickson, 2014), or fatigue (Müller, Klein-Flügge, Manohar, Husain, & Apps, 2021) might disrupt choice deliberation and interrupt ensuing stages of motivation. This could critically determine the capacity for self-generated, intrinsically-motivated actions (Husain & Roiser, 2018). However, relatively few studies have examined this distinction. One study developed a cognitive task that aimed to capture separate measures of self-generated (intrinsic) v. externally generated (extrinsic) motivation during the option-generation phase (Morris et al., 2020). This distinction linked self-generated option generation (intrinsic motivation) to anhedonia symptoms in healthy adults (Morris et al., 2020). However, this task still relies on extrinsic rewards, and there is a need for improved tasks that index both behavioral and neural correlates of intrinsic drivers of motivated behavior.

Summary and future directions

In this review, we summarize how intrinsic motivation has been conceptualized, measured, and related to neural function to elucidate its role in psychopathology. In contrast to extrinsic motivation, which has been rapidly incorporated into prominent cognitive, computational, and neurobiological models of human behavior, knowledge of intrinsic motivation remains limited due to evolving conceptualizations, imprecise measurement, and incomplete characterization of its biological correlates. We identify three potential areas of interest for future research.

First, additional objective measures of intrinsically motivation should be developed. This remains challenging experimentally since even the closest approximations of intrinsic motivation (Murayama et al., 2010; Rutledge et al., 2017) define the construct relative to extrinsic motivation, and other paradigms (e.g. exploration/exploitation tasks) rely on the presence of extrinsic reinforcers. Rather than defining motivated behavior as intrinsic or extrinsic, a more tractable approach might be to consider separate drivers of behavior that can be intrinsic or extrinsic. Future paradigms could index intrinsic motivation by characterizing the effects of intrinsic v. extrinsic reinforcers on motivation for an activity that is enjoyable. Such a design would enable more complex modeling of the effects of distinct reinforcers, and interactions between them, on motivated behavior, which would resolve inconsistencies surrounding the impact of extrinsic reinforcers on intrinsic motivation. For example, monetary incentives might reduce motivation only when a perceived agency is low, or when task enjoyment is high. These interactions might explain paradoxical observations like the undermining effect.

Second, computational models are needed to characterize intrinsic motivation. Computational models of motivation have been successfully implemented in studies of extrinsic motivation, yet few are appropriate for intrinsic motivation due to a focus on action-outcome associations. However, if the intrinsic reward were operationalized as a measurable outcome (e.g. completion of an enjoyable task), reinforcement-learning models could estimate how intrinsic reward value is represented. Advancements in the computational area could significantly improve understanding of the latent processes underlying (ab)normal decision-making, thereby identifying novel therapeutic targets.

Third, although evidence supports the bifurcation of intrinsic and extrinsic motivation at the psychological level, findings at the neural level are more equivocal. Given the overarching role of the mesolimbic dopamine system in learning, reward value estimation, and exploratory behavior, it is perhaps unsurprising that current evidence supports largely overlapping neural circuits for intrinsically and extrinsically motivated behavior. One potential avenue involves targeted pharmacological manipulations or neuromodulation of cortico-limbic circuits to determine if intrinsically and extrinsically motivated behaviors can be systematically modulated in humans. By elucidating the neural circuits of distinct motivational processes and their associations with specific symptom profiles, this approach would improve targeted interventions for highly heterogenous and debilitating disorders like depression.

Financial support

All authors report no financial disclosures. This work was supported by the National Institute of Mental Health (LSM, grant number K01MH120433) and the National Institute on Drug Abuse (MLW, T32DA022975).

References

  1. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Association. [Google Scholar]
  2. Andersson, H. W., Steinsbekk, A., Walderhaug, E., Otterholt, E., & Nordfjærn, T. (2018). Predictors of dropout from inpatient substance use treatment: A prospective cohort study. Substance Abuse: Research and Treatment, 12, 1–10. 10.1177/1178221818760551. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Badami, R., VaezMousavi, M., Wulf, G., & Namazizadeh, M. (2011). Feedback after good versus poor trials affects intrinsic motivation. Research Quarterly for Exercise and Sport, 82(2), 360–364. 10.1080/02701367.2011.10599765. [DOI] [PubMed] [Google Scholar]
  4. Badre, D., Doll, B. B., Long, N. M., & Frank, M. J. (2012). Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron, 73(3), 595–607. 10.1016/j.neuron.2011.12.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bahorik, A., Eack, S. S., Cochran, G., Greeno, C., & Cornelius, C. (2015). The Longitudinal Impact of Intrinsic Motivation on Substance Use Severity in Schizophrenia and its Patterns in Men and Women. Retrieved March 2, 2022, from d-scholarship.pitt.edu website http://d-scholarship.pitt.edu/25060/.
  6. Bahorik, A. L., Greeno, C. G., Cochran, G., Cornelius, J. R., & Eack, S. M. (2017). Motivation deficits and use of alcohol and illicit drugs among individuals with schizophrenia. Psychiatry Research, 253, 391–397. 10.1016/j.psychres.2017.04.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Barch, D. M., Yodkovik, N., Sypher-Locke, H., & Hanewinkel, M. (2008). Intrinsic motivation in schizophrenia: Relationships to cognitive function, depression, anxiety, and personality. Journal of Abnormal Psychology, 117(4), 776–787. 10.1037/a0013944. [DOI] [PubMed] [Google Scholar]
  8. Beckmann, J., & Heckhausen, H.. (2018). Motivation as a function of expectancy and incentive. In Heckhausen J., & Heckhausen H. (Eds.), Motivation and Action (2nd edn, pp. 99–136). Cambridge: Cambridge University Press. 10.1017/cbo9780511499821.006 [DOI] [Google Scholar]
  9. Bengtsson, S. L., Lau, H. C., & Passingham, R. E. (2009). Motivation to do well enhances responses to errors and self-monitoring. Cerebral Cortex, 19(4), 797–804. 10.1093/cercor/bhn127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Berke, J.D. (2018). What does dopamine mean?. Nat Neurosci 21, 787–793 . 10.1038/s41593-018-0152-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Berrendero, F., Robledo, P., Trigo, J. M., Martín-García, E., & Maldonado, R. (2010). Neurobiological mechanisms involved in nicotine dependence and reward: Participation of the endogenous opioid system. Neuroscience & Biobehavioral Reviews, 35(2), 220–231. 10.1016/j.neubiorev.2010.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Berridge, K. C., Robinson, T. E., & Aldridge, J. W. (2009). Dissecting components of reward: ‘liking’, ‘wanting’, and learning. Current Opinion in Pharmacology, 9(1), 65–73. 10.1016/j.coph.2008.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Berwian, I. M., Wenzel, J. G., Collins, A. G. E., Seifritz, E., Stephan, K. E., Walter, H., & Huys, Q. J. M. (2020). Computational mechanisms of effort and reward decisions in patients with depression and their association with relapse after antidepressant discontinuation. JAMA Psychiatry, 77(5), 513. 10.1001/jamapsychiatry.2019.4971. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Bolles, R. C. (1972). Reinforcement, expectancy, and learning. Psychological Review, 79(5), 394–409. 10.1037/h0033120. [DOI] [Google Scholar]
  15. Borsini, A., Wallis, A. S. J., Zunszain, P., Pariante, C. M., & Kempton, M. J. (2020). Characterizing anhedonia: A systematic review of neuroimaging across the subtypes of reward processing deficits in depression. Cognitive, Affective, & Behavioral Neuroscience, 20(4), 816–841. 10.3758/s13415-020-00804-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Bowie, C. R., Gupta, M., Holshausen, K., Jokic, R., Best, M., & Milev, R. (2013). Cognitive remediation for treatment-resistant depression: Effects on cognition and functioning and the role of online homework. The Journal of Nervous and Mental Disease, 201(8), 680–685. 10.1097/NMD.0b013e31829c5030. [DOI] [PubMed] [Google Scholar]
  17. Brugger, F., Galovic, M., Weder, B. J., & Kägi, G. (2015). Supplementary motor complex and disturbed motor control – a retrospective clinical and lesion analysis of patients after anterior cerebral artery stroke. Frontiers in Neurology, 6, 209. 10.3389/fneur.2015.00209. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Bryce, S. D., Lee, S. J., Ponsford, J. L., Lawrence, R. J., Tan, E. J., & Rossell, S. L. (2018). The impact of intrinsic motivation on session attendance and reliable cognitive improvement in cognitive remediation in schizophrenia. Schizophrenia Research, 202, 354–360. 10.1016/j.schres.2018.06.028. [DOI] [PubMed] [Google Scholar]
  19. Butler, R., & Nisan, M. (1986). Effects of no feedback, task-related comments, and grades on intrinsic motivation and performance. Journal of Educational Psychology, 78(3), 210–216. 10.1037//0022-0663.78.3.210. [DOI] [Google Scholar]
  20. Cameron, J., & Pierce, D. W. (2002). Rewards and intrinsic motivation: Resolving the controversy. Westport, CT: Bergin & Garvey. [Google Scholar]
  21. Cecchini, J., González, C., Carmona, Á, Arruza, J., Escartí, A., & Balagué, G. (2001). The influence of the physical education teacher on intrinsic motivation, self-confidence, anxiety, and pre- and post-competition mood states. European Journal of Sport Science, 1(4), 1–11. 10.1080/17461390100071407. [DOI] [Google Scholar]
  22. Cerasoli, C. P., Nicklin, J. M., & Ford, M. T. (2014). Intrinsic motivation and extrinsic incentives jointly predict performance: A 40-year meta-analysis. Psychological Bulletin, 140(4), 980–1008. 10.1037/a0035661. [DOI] [PubMed] [Google Scholar]
  23. Chew, B., Blain, B., Dolan, R. J., & Rutledge, R. B. (2021). A neurocomputational model for intrinsic reward. The Journal of Neuroscience, 41(43), 8963–8971. 10.1523/jneurosci.0858-20.2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Chiviacowsky, S., Wulf, G., Lewthwaite, R., & Campos, T. (2012). Motor learning benefits of self-controlled practice in persons with Parkinson's disease. Gait & Posture, 35(4), 601–605. 10.1016/j.gaitpost.2011.12.003. [DOI] [PubMed] [Google Scholar]
  25. Choi, J., Choi, K.-H., Felice Reddy, L., & Fiszdon, J. M. (2014). Measuring motivation in schizophrenia: Is a general state of motivation necessary for task-specific motivation? Schizophrenia Research, 153(1–3), 209–213. 10.1016/j.schres.2014.01.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Choi, J., & Medalia, A. (2010). Intrinsic motivation and learning in a schizophrenia spectrum sample. Schizophrenia Research, 118(1–3), 12–19. 10.1016/j.schres.2009.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Cooper, J. A., Arulpragasam, A. R., & Treadway, M. T. (2018). Anhedonia in depression: Biological mechanisms and computational models. Current Opinion in Behavioral Sciences, 22, 128–135. 10.1016/j.cobeha.2018.01.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Cornelius, T., Earnshaw, V. A., Menino, D., Bogart, L. M., & Levy, S. (2017). Treatment motivation among caregivers and adolescents with substance use disorders. Journal of Substance Abuse Treatment, 75, 10–16. 10.1016/j.jsat.2017.01.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Csikszentmihalyi, M. (1975). Beyond boredom and anxiety. San Francisco: Jossey-Bass Publishers. [Google Scholar]
  30. Curry, S. J., Grothaus, L., & McBride, C. (1997). Reasons for quitting: Intrinsic and extrinsic motivation for smoking cessation in a population-based sample of smokers. Addictive Behaviors, 22(6), 727–739. 10.1016/s0306-4603(97)00059-2. [DOI] [PubMed] [Google Scholar]
  31. Daniel, T. L., & Esser, J. K. (1980). Intrinsic motivation as influenced by rewards, task interest, and task structure. Journal of Applied Psychology, 65(5), 566–573. 10.1037/0021-9010.65.5.566. [DOI] [Google Scholar]
  32. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441(7095), 876–879. 10.1038/nature04766. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. DeCharms, R. (1968). Personal causation: The internal affective determinants of behavior. New York: Academic Press. [Google Scholar]
  34. Deci, E. L. (1971). Effects of externally mediated rewards on intrinsic motivation. Journal of Personality and Social Psychology, 18(1), 105–115. 10.1037/h0030644. [DOI] [Google Scholar]
  35. Deci, E. L., Benware, C., & Landy, D. (1974). The attribution of motivation as a function of output and rewards. Journal of Personality, 42(4), 652–667. 10.1111/j.1467-6494.1974.tb00699.x. [DOI] [Google Scholar]
  36. Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 627–668. 10.1037//0033-2909.125.6.627. [DOI] [PubMed] [Google Scholar]
  37. Deci, E. L., & Ryan, R. M. (1980). The empirical exploration of intrinsic motivational processes. Advances in Experimental Social Psychology, 13, 39–80. 10.1016/s0065-2601(08)60130-6. [DOI] [Google Scholar]
  38. de Manzano, Ö, Cervenka, S., Jucaite, A., Hellenäs, O., Farde, L., & Ullén, F. (2013). Individual differences in the proneness to have flow experiences are linked to dopamine D2-receptor availability in the dorsal striatum. NeuroImage, 67, 1–6. 10.1016/j.neuroimage.2012.10.072. [DOI] [PubMed] [Google Scholar]
  39. de Wit, S., Standing, H. R., DeVito, E. E., Robinson, O. J., Ridderinkhof, K. R., Robbins, T. W., & Sahakian, B. J. (2011). Reliance on habits at the expense of goal-directed control following dopamine precursor depletion. Psychopharmacology, 219(2), 621–631. 10.1007/s00213-011-2563-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. DeYoung, C. G. (2013). The neuromodulator of exploration: A unifying theory of the role of dopamine in personality. Frontiers in Human Neuroscience, 7, 762. 10.3389/fnhum.2013.00762. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Diederen, K. M. J., & Fletcher, P. C. (2020). Dopamine, prediction error and beyond. The Neuroscientist, 27(1), 30–46. 10.1177/1073858420907591. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Downey, L., Rosengren, D. B., & Donovan, D. M. (2001). Sources of motivation for abstinence. Addictive Behaviors, 26(1), 79–89. 10.1016/s0306-4603(00)00090-3. [DOI] [PubMed] [Google Scholar]
  43. Dubreucq, S., Koehl, M., Abrous, D. N., Marsicano, G., & Chaouloff, F. (2010). CB1 receptor deficiency decreases wheel-running activity: Consequences on emotional behaviours and hippocampal neurogenesis. Experimental Neurology, 224(1), 106–113. 10.1016/j.expneurol.2010.01.017. [DOI] [PubMed] [Google Scholar]
  44. Fenoy, A. J., Schulz, P. E., Selvaraj, S., Burrows, C. L., Zunta-Soares, G., Durkin, K., … Soares, J. C. (2018) A longitudinal study on deep brain stimulation of the medial forebrain bundle for treatment-resistant depression. Translational Psychiatry, 8(111), 10.1038/s41398-018-0160-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Fervaha, G., Agid, O., Foussias, G., & Remington, G. (2014). Effect of intrinsic motivation on cognitive performance in schizophrenia: A pilot study. Schizophrenia Research, 152(1), 317–318. 10.1016/j.schres.2013.11.037. [DOI] [PubMed] [Google Scholar]
  46. Festinger, L. (1957). A theory of cognitive dissonance. The American Journal of Psychology, 72(1), 153. 10.2307/1420234. [DOI] [Google Scholar]
  47. Fiorillo, C. D. (2003). The uncertain nature of dopamine. Molecular Psychiatry, 9(2), 122–123. 10.1038/sj.mp.4001445. [DOI] [PubMed] [Google Scholar]
  48. Foerde, K., Braun, E. K., Higgins, E. T., & Shohamy, D. (2014). Motivational modes and learning in Parkinson's disease. Social Cognitive and Affective Neuroscience, 10(8), 1066–1073. 10.1093/scan/nsu152. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Froiland, J. M., Worrell, F. C., Olenchak, F. R., & Kowalski, M. J. (2020). Positive and negative time attitudes, intrinsic motivation, behavioral engagement and substance use among urban adolescents. Addiction Research & Theory, 29(4), 347–357. 10.1080/16066359.2020.1857740. [DOI] [Google Scholar]
  50. Ghozland, S., Matthes, H. W. D., Simonin, F., Filliol, D., Kieffer, B. L., & Maldonado, R. (2002). Motivational effects of cannabinoids Are mediated by μ-opioid and κ-opioid receptors. The Journal of Neuroscience, 22(3), 1146–1154. 10.1523/jneurosci.22-03-01146.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Gillan, C. M., Robbins, T. W., Sahakian, B. J., van den Heuvel, O. A., & van Wingen, G. (2016). The role of habit in compulsivity. European Neuropsychopharmacology, 26(5), 828–840. 10.1016/j.euroneuro.2015.12.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Gittins, J. C., & Jones, D. M. (1979). A dynamic allocation index for the discounted multiarmed bandit problem. Biometrika, 66(3), 561–565. 10.1093/biomet/66.3.561. [DOI] [Google Scholar]
  53. Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010). States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron, 66(4), 585–595. 10.1016/j.neuron.2010.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Gottlieb, J., Lopes, M., & Oudeyer, P.-Y. (2016). Motivated cognition: Neural and computational mechanisms of curiosity, attention, and intrinsic motivation. In Kim S., Reeve J. & Bong M. (Eds.), Recent developments in neuroscience research on human motivation (pp. 149–172). Bingley: Emerald Group Publishing Limited. [Google Scholar]
  55. Gruber, M. J., Gelman,, B. D., & Ranganath, C. (2014). States of curiosity modulate hippocampus-dependent learning via the dopaminergic circuit. Neuron, 84(2), 486–496. 10.1016/j.neuron.2014.08.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Gyurkovics, M., Kotyuk, E., Katonai, E. R., Horvath, E. Z., Vereczkei, A., & Szekely, A. (2016). Individual differences in flow proneness are linked to a dopamine D2 receptor gene variant. Consciousness and Cognition, 42, 1–8. 10.1016/j.concog.2016.02.014. [DOI] [PubMed] [Google Scholar]
  57. Harlow, H. F. (1950). Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys. Journal of Comparative and Physiological Psychology, 43(4), 289–294. 10.1037/h0058114. [DOI] [PubMed] [Google Scholar]
  58. Hebb, D. O. (1949). The organization of behavior: A neuropsychological theory. London: Wiley. [Google Scholar]
  59. Hebb, D. O. (1955). Drives and the C. N. S. (conceptual nervous system). Psychological Review, 62(4), 243–254. 10.1037/h0041823. [DOI] [PubMed] [Google Scholar]
  60. Heckhausen, H. (1989). Motivation und Handeln. Springer-Lehrbuch (2nd ed.) Berlin, Heidelberg: Springer. [Google Scholar]
  61. Heckhausen, H., & Heckhausen, J. (2018). Motivation and action. Cham: Springer. [Google Scholar]
  62. Hooks, M. S., & Kalivas, P. W. (1994). Involvement of dopamine and excitatory amino acid transmission in novelty-induced motor activity. The Journal of Pharmacology and Experimental Therapeutics, 269(3), 976–988. [PubMed] [Google Scholar]
  63. Hsu, D. T., Sanford, B. J., Meyers, K. K., Love, T. M., Hazlett, K. E., Wang, H., … Zubieta, J.-K. (2013). Response of the μ-opioid system to social rejection and acceptance. Molecular Psychiatry, 18(11), 1211–1217. 10.1038/mp.2013.96. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Huang, Y., Lv, W., & Wu, J. (2016). Relationship between intrinsic motivation and undergraduate students’ depression and stress. Psychological Reports, 119(2), 527–538. 10.1177/0033294116661512. [DOI] [PubMed] [Google Scholar]
  65. Hull, C. L. (1943). Principles of behavior: An introduction to behavior theory. New York, NY: Appleton Century Crofts. [Google Scholar]
  66. Husain, M., & Roiser, J. P. (2018). Neuroscience of apathy and anhedonia: A transdiagnostic approach. Nature Reviews Neuroscience, 19(8), 470–484. 10.1038/s41583-018-0029-9. [DOI] [PubMed] [Google Scholar]
  67. Huys, Q. J., Pizzagalli, D. A., Bogdan, R., & Dayan, P. (2013). Mapping anhedonia onto reinforcement learning: A behavioural meta-analysis. Biology of Mood & Anxiety Disorders, 3(1), 12. 10.1186/2045-5380-3-12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Isen, A. M., & Reeve, J. (2006). The influence of positive affect on intrinsic and extrinsic motivation: Facilitating enjoyment of play, responsible work behavior, and self-control. Motivation and Emotion, 29(4), 295–323. 10.1007/s11031-006-9019-8. [DOI] [Google Scholar]
  69. Kagan, J. (1972). Motives and development. Journal of Personality and Social Psychology, 22(1), 51–66. 10.1037/h0032356. [DOI] [PubMed] [Google Scholar]
  70. Kagan, J., & Moss, H. A. (1983). Birth to maturity: A study in psychological development. New Haven: Yale University Press. [Google Scholar]
  71. Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T., & Camerer, C. F. (2009). The wick in the candle of learning. Psychological Science, 20(8), 963–973. 10.1111/j.1467-9280.2009.02402.x. [DOI] [PubMed] [Google Scholar]
  72. Kaplan, F., & Oudeyer, P.-Y. (2007). In search of the neural circuits of intrinsic motivation. Frontiers in Neuroscience, 1(1), 225–236. 10.3389/neuro.01.1.1.017.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Kastin, A. J., Scollan, E. L., Ehrensing, R. H., Schally, A. V., & Coy, D. H. (1978). Enkephalin and other peptides reduce passiveness. Pharmacology Biochemistry and Behavior, 9(4), 515–519. 10.1016/0091-3057(78)90051-5. [DOI] [PubMed] [Google Scholar]
  74. Kelley, A. E., & Berridge, K. C. (2002). The neuroscience of natural rewards: Relevance to addictive drugs. Journal of Neuroscience, 22(9), 3306–3311. 10.1523/JNEUROSCI.22-09-03306.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Kim, H. R., Malik, A. N., Mikhael, J. G., Bech, P., Tsutsui-Kimura, I., Sun, F., … Uchida, N. (2020). A unified framework for dopamine signals across timescales. Cell, 183(6), 1600–1616.e25. 10.1016/j.cell.2020.11.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Lamal, P. (2003). Are rewards bad for us? The Educational Forum, 67(1), 92–93. 10.1080/00131720208984539. [DOI] [Google Scholar]
  77. Laplane, D., Baulac, M., Widlocher, D., & Dubois, B. (1984). Pure psychic akinesia with bilateral lesions of basal ganglia. Journal of Neurology, Neurosurgery & Psychiatry, 47(4), 377–385. 10.1136/jnnp.47.4.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Lee, W., & Reeve, J. (2017). Identifying the neural substrates of intrinsic motivation during task performance. Cognitive, Affective, & Behavioral Neuroscience, 17(5), 939–953. 10.3758/s13415-017-0524-x. [DOI] [PubMed] [Google Scholar]
  79. Lepper, M. R., & Greene, D. (1978). The hidden costs of reward: New perspectives on the psychology of human motivation. Lawrence Erlbaum. [Google Scholar]
  80. Lepper, M. R., Greene, D., & Nisbett, R. E. (1973). Undermining children's intrinsic interest with extrinsic reward: A test of the ‘overjustification’ hypothesis. Journal of Personality and Social Psychology, 28(1), 129–137. 10.1037/h0035519. [DOI] [Google Scholar]
  81. Lepper, M. R., Keavney, M., & Drake, M. (1996). Intrinsic motivation and extrinsic rewards: A commentary on cameron and pierce's meta-analysis. Review of Educational Research, 66(1), 5–32. 10.3102/00346543066001005. [DOI] [Google Scholar]
  82. Lewin, K. (1951). Intention, will and need. In Rapaport D. (Ed.), Organization and Pathology of Thought: Selected Sources (pp. 95–153). Columbia University Press. 10.1037/10584-005. [DOI] [Google Scholar]
  83. Linke, J., Kirsch, P., King, A. V., Gass, A., Hennerici, M. G., Bongers, A., & Wessa, M. (2010). Motivational orientation modulates the neural response to reward. NeuroImage, 49(3), 2618–2625. 10.1016/j.neuroimage.2009.09.013. [DOI] [PubMed] [Google Scholar]
  84. Liu, W., Chan, R. C. K., Wang, L., Huang, J., Cheung, E. F. C., Gong, Q., & Gollan, J. K. (2011). Deficits in sustaining reward responses in subsyndromal and syndromal major depression. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 35(4), 1045–1052. 10.1016/j.pnpbp.2011.02.018. [DOI] [PubMed] [Google Scholar]
  85. Liu, W., Roiser, J. P., Wang, L., Zhu, Y., Huang, J., Neumann, D. L., … Chan, R. C. K. (2016). Anhedonia is associated with blunted reward sensitivity in first-degree relatives of patients with major depression. Journal of Affective Disorders, 190, 640–648. 10.1016/j.jad.2015.10.050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Liu, Y., & Hou, S. (2017). Potential reciprocal relationship between motivation and achievement: A longitudinal study. School Psychology International, 39(1), 38–55. 10.1177/0143034317710574. [DOI] [Google Scholar]
  87. Lu, L. (1999). Work motivation, job stress and employees’ well-being. Journal of Applied Management Studies, 8(1), 61. [Google Scholar]
  88. Lugaresi, A., Montagna, P., Morreale, A., & Gallassi, R. (1990). ‘Psychic akinesia’ following carbon monoxide poisoning. European Neurology, 30(3), 167–169. 10.1159/000117337. [DOI] [PubMed] [Google Scholar]
  89. Luking, K. R., Pagliaccio, D., Luby, J. L., & Barch, D. M. (2016). Depression risk predicts blunted neural responses to gains and enhanced responses to losses in healthy children. Journal of the American Academy of Child & Adolescent Psychiatry, 55(4), 328–337. 10.1016/j.jaac.2016.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Luther, L., Firmin, R. L., Vohs, J. L., Buck, K. D., Rand, K. L., & Lysaker, P. H. (2016). Intrinsic motivation as a mediator between metacognition deficits and impaired functioning in psychosis. British Journal of Clinical Psychology, 55(3), 332–347. 10.1111/bjc.12104. [DOI] [PubMed] [Google Scholar]
  91. Luther, L., Lysaker, P. H., Firmin, R. L., Breier, A., & Vohs, J. L. (2015). Intrinsic motivation and amotivation in first episode and prolonged psychosis. Schizophrenia Research, 169(1–3), 418–422. 10.1016/j.schres.2015.08.040. [DOI] [PubMed] [Google Scholar]
  92. Mansouri, F. A., Koechlin, E., Rosa, M. G. P., & Buckley, M. J. (2017). Managing competing goals – a key role for the frontopolar cortex. Nature Reviews Neuroscience, 18(11), 645–657. 10.1038/nrn.2017.111. [DOI] [PubMed] [Google Scholar]
  93. Marroquín, B., & Nolen-Hoeksema, S. (2015). Emotion regulation and depressive symptoms: Close relationships as social context and influence. Journal of Personality and Social Psychology, 109(5), 836–855. 10.1037/pspi0000034. [DOI] [PMC free article] [PubMed] [Google Scholar]
  94. Marsden, K. E., Ma, W. J., Deci, E. L., Ryan, R. M., & Chiu, P. H. (2014). Diminished neural responses predict enhanced intrinsic motivation and sensitivity to external incentive. Cognitive, Affective, & Behavioral Neuroscience, 15(2), 276–286. 10.3758/s13415-014-0324-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  95. McClelland, D. C., Atkinson, J. W., Clark, R. A., & Lowell, E. L. (1967). The affective arousal model of motivation. In Haber R. N. (Ed.), Current research in motivation. New York: Holt, Rinehart And Winston Inc. [Google Scholar]
  96. McClelland, D. C., & Clark, R. A. (1953). Discrepancy hypothesis. In Mcclelland D. C., Atkinson J. W., Clark R. A. & Lowell E. L. (Eds.), The achievement motive. New York: Appleton-Century-Crofts. [Google Scholar]
  97. Mills, D. J., Li Anthony, W., & Nower, L. (2020). General motivations, basic psychological needs, and problem gambling: Applying the framework of self-determination theory. Addiction Research & Theory, 29(2), 175–182. 10.1080/16066359.2020.1787389. [DOI] [Google Scholar]
  98. Mohebi, A., Pettibone, J. R., Hamid, A. A., Wong, J.-M. T., Vinson, L. T., Patriarchi, T., … Berke, J. D. (2019). Dissociable dopamine dynamics for learning and motivation. Nature, 57, 65–70. 10.1038/s41586-019-1235-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  99. Montague, P., Dayan, P., & Sejnowski, T. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience, 16(5), 1936–1947. 10.1523/jneurosci.16-05-01936.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]
  100. Mori, A., Okamoto, Y., Okada, G., Takagaki, K., Takamura, M., Jinnin, R., … Yamawaki, S. (2018). Effects of behavioural activation on the neural circuit related to intrinsic motivation. BJPsych Open, 4(5), 317–323. 10.1192/bjo.2018.40. [DOI] [PMC free article] [PubMed] [Google Scholar]
  101. Morris, B. H., Bylsma, L. M., & Rottenberg, J. (2009). Does emotion predict the course of major depressive disorder? A review of prospective studies. British Journal of Clinical Psychology, 48(3), 255–273. 10.1348/014466508x396549. [DOI] [PubMed] [Google Scholar]
  102. Morris, L. S., Norbury, A., Smith, D. A., Harrison, N. A., Voon, V., & Murrough, J. W. (2020). Dissociating self-generated volition from externally-generated motivation. PLoS One, 15(5), e0232949. 10.1371/journal.pone.0232949. [DOI] [PMC free article] [PubMed] [Google Scholar]
  103. Moutoussis, M., Rutledge, R. B., Prabhu, G., Hrynkiewicz, L., Lam, J., Ousdal, O.-T., Guitart-Masip, M., Fonagy, P., & Dolan, R. J. (2018). Neural activity and fundamental learning, motivated by monetary loss and reward, are intact in mild to moderate major depressive disorder. PLoS ONE, 13(8), e0201451. 10.1371/journal.pone.0201451 [DOI] [PMC free article] [PubMed] [Google Scholar]
  104. Müller, T., Klein-Flügge, M. C., Manohar, S. G., Husain, M., & Apps, M. A. J. (2021). Neural and computational mechanisms of momentary fatigue and persistence in effort-based choice. Nature Communications, 12(1), 4593. 10.1038/s41467-021-24927-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  105. Murayama, K., Matsumoto, M., Izuma, K., & Matsumoto, K. (2010). Neural basis of the undermining effect of monetary reward on intrinsic motivation. Proceedings of the National Academy of Sciences, 107(49), 20911–20916. 10.1073/pnas.1013305107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  106. Murayama, K., Matsumoto, M., Izuma, K., Sugiura, A., Ryan, R. M., Deci, E. L., & Matsumoto, K. (2015). How self-determined choice facilitates performance: A key role of the ventromedial prefrontal cortex. Cerebral Cortex, 25(5), 1241–1251. 10.1093/cercor/bht317. [DOI] [PubMed] [Google Scholar]
  107. Nachev, P., Kennard, C., & Husain, M. (2008). Functional role of the supplementary and pre-supplementary motor areas. Nature Reviews Neuroscience, 9(11), 856–869. 10.1038/nrn2478. [DOI] [PubMed] [Google Scholar]
  108. Nakagami, E., Hoe, M., & Brekke, J. S. (2010). The prospective relationships among intrinsic motivation, neurocognition, and psychosocial functioning in schizophrenia. Schizophrenia Bulletin, 36(5), 935–948. 10.1093/schbul/sbq043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  109. Nakagami, E., Xie, B., Hoe, M., & Brekke, J. S. (2008). Intrinsic motivation, neurocognition and psychosocial functioning in schizophrenia: Testing mediator and moderator effects. Schizophrenia Research, 105(1–3), 95–104. 10.1016/j.schres.2008.06.015. [DOI] [PubMed] [Google Scholar]
  110. Nakamura, J., & Csikszentmihalyi, M. (2009). Flow theory and research. In Lopez S. J. & Snyder C. R. (Eds.), The Oxford handbook of positive psychology (pp. 195–206). Oxford University Press. [Google Scholar]
  111. Nierenberg, A. A., Keefe, B. R., Leslie, V. C., Alpert, J. E., Pava, J. A., Worthington, J. J., … Fava, M. (1999). Residual symptoms in depressed patients who respond acutely to fluoxetine. The Journal of Clinical Psychiatry, 60(4), 221–225. 10.4088/jcp.v60n0403. [DOI] [PubMed] [Google Scholar]
  112. Nissen, H. W. (1930). A study of exploratory behavior in the white rat by means of the obstruction method. The Pedagogical Seminary and Journal of Genetic Psychology, 37(3), 361–376. 10.1080/08856559.1930.9944162. [DOI] [Google Scholar]
  113. Panksepp, J., & Moskal, J. (2008). Dopamine and SEEKING: Subcortical ‘reward’ systems and appetitive urges. In Elliot A. J. (Ed.), Handbook of approach and avoidance motivation (pp. 67–87). New York: Psychology Press. [Google Scholar]
  114. Peciña, M., Karp, J. F., Mathew, S., Todtenkopf, M. S., Ehrich, E. W., & Zubieta, J.-K. (2018). Endogenous opioid system dysregulation in depression: Implications for new therapeutic approaches. Molecular Psychiatry, 24(4), 576–587. 10.1038/s41380-018-0117-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  115. Pelizza, L., & Ferrari, A. (2009). Anhedonia in schizophrenia and major depression: State or trait? Annals of General Psychiatry, 8, 22. 10.1186/1744-859x-8-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  116. Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33–40. 10.1037/0022-0663.82.1.33. [DOI] [Google Scholar]
  117. Ribot, T. (1986). La Psychologie des Sentiment [The psychology of feelings]. Paris: Felix Alcan. [Google Scholar]
  118. Robbins, H. (1952). Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 58(5), 527–536. 10.1090/s0002-9904-1952-09620-8. [DOI] [Google Scholar]
  119. Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., & Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: Towards dimensional psychiatry. Trends in Cognitive Sciences, 16(1), 81–91. 10.1016/j.tics.2011.11.009. [DOI] [PubMed] [Google Scholar]
  120. Rodriguez, L. M., Neighbors, C., Rinker, D. V., & Tackett, J. L. (2014). Motivational profiles of gambling behavior: Self-determination theory, gambling motives, and gambling behavior. Journal of Gambling Studies, 31(4), 1597–1615. 10.1007/s10899-014-9497-7. [DOI] [PubMed] [Google Scholar]
  121. Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., … Dolan, R. J. (2017). Association of neural and emotional impacts of reward prediction errors with major depression. JAMA Psychiatry, 74(8), 790–797. 10.1001/jamapsychiatry.2017.1713. [DOI] [PMC free article] [PubMed] [Google Scholar]
  122. Ryan, R. M. (1982). Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. Journal of Personality and Social Psychology, 43(3), 450–461. 10.1037/0022-3514.43.3.450. [DOI] [Google Scholar]
  123. Salamone, J. D., Correa, M., Farrar, A., & Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology, 191(3), 461–482. 10.1007/s00213-006-0668-9. [DOI] [PubMed] [Google Scholar]
  124. Salamone, J. D., Yohn, S. E., López-Cruz, L., San Miguel, N., & Correa, M. (2016). Activational and effort-related aspects of motivation: Neural mechanisms and implications for psychopathology. Brain, 139(5), 1325–1347. 10.1093/brain/aww050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  125. Scherer, K. R. (2009). Emotions are emergent processes: They require a dynamic computational architecture. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535), 3459–3474. 10.1098/rstb.2009.0141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  126. Schlaepfer, T. E., Cohen, M. X., Frick, C., Kosel, M., Brodesser, D., Axmacher, N., … Sturm, V. (2007). Deep brain stimulation to reward circuitry alleviates anhedonia in refractory major depression. Neuropsychopharmacology, 33(2), 368–377. 10.1038/sj.npp.1301408. [DOI] [PubMed] [Google Scholar]
  127. Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80(1), 1–27. 10.1152/jn.1998.80.1.1. [DOI] [PubMed] [Google Scholar]
  128. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.), 275(5306), 1593–1599. 10.1126/science.275.5306.1593. [DOI] [PubMed] [Google Scholar]
  129. Segarra, N., Metastasio, A., Ziauddeen, H., Spencer, J., Reinders, N. R., Dudas, R. B., … Murray, G. K. (2016). Abnormal frontostriatal activity during unexpected reward receipt in depression and schizophrenia: Relationship to anhedonia. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 41(8), 2001–2010. 10.1038/npp.2015.370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  130. Seo, D., Funderburk, S. C., Bhatti, D. L., Motard, L. E., Newbold, D., Girven, K. S., … Bruchas, M. R. (2016). A GABAergic projection from the centromedial nuclei of the amygdala to ventromedial prefrontal cortex modulates reward behavior. The Journal of Neuroscience, 36(42), 10831–10842. 10.1523/jneurosci.1164-16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  131. Sescousse, G., Caldú, X., Segura, B., & Dreher, J.-C. (2013). Processing of primary and secondary rewards: A quantitative meta-analysis and review of human functional neuroimaging studies. Neuroscience & Biobehavioral Reviews, 37(4), 681–696. 10.1016/j.neubiorev.2013.02.002. [DOI] [PubMed] [Google Scholar]
  132. Shamloo, Z. S., & Cox, W. M. (2010). The relationship between motivational structure, sense of control, intrinsic motivation and university students’ alcohol consumption. Addictive Behaviors, 35(2), 140–146. 10.1016/j.addbeh.2009.09.021. [DOI] [PubMed] [Google Scholar]
  133. Sheehan, R. B., Herring, M. P., & Campbell, M. J. (2018). Associations between motivation and mental health in sport: A test of the hierarchical model of intrinsic and extrinsic motivation. Frontiers in Psychology, 9, 707. 10.3389/fpsyg.2018.00707. [DOI] [PMC free article] [PubMed] [Google Scholar]
  134. Shigemune, Y., Kawasaki, I., Midorikawa, A., Baba, T., Takeda, A., & Abe, N. (2021). Intrinsic motivation in patients with Parkinson's disease: A neuropsychological investigation of curiosity using dopamine transporter imaging. Neurological Sciences, 42(8), 3349–3356. 10.1007/s10072-020-04968-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  135. Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. Acton, MA: Copley Publ. Group. [Google Scholar]
  136. Strombach, T., Strang, S., Park, S. Q., & Kenning, P. (2016). Common and distinctive approaches to motivation in different disciplines. Motivation – Theory, Neurobiology and Applications, 229, 3–23. 10.1016/bs.pbr.2016.06.007. [DOI] [PubMed] [Google Scholar]
  137. Sun, Y., & Chen, X. (2017). A randomized controlled clinical trial of a core stability exercise program for the intrinsic motivation of Parkinson's patients. NeuroQuantology, 15(4), 139–145. 10.14704/nq.2017.15.4.1144. [DOI] [Google Scholar]
  138. Sutton, R. S., & Barto, A. G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88(2), 135–170. 10.1037/0033-295x.88.2.135. [DOI] [PubMed] [Google Scholar]
  139. Takeda, K., Matsumoto, M., Ogata, Y., Maida, K., Murakami, H., Murayama, K., … Nakagome, K. (2017). Impaired prefrontal activity to regulate the intrinsic motivation-action link in schizophrenia. NeuroImage: Clinical, 16, 32–42. 10.1016/j.nicl.2017.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  140. Tas, C., Brown, E. C., Esen-Danaci, A., Lysaker, P. H., & Brüne, M. (2012). Intrinsic motivation and metacognition as predictors of learning potential in patients with remitted schizophrenia. Journal of Psychiatric Research, 46(8), 1086–1092. 10.1016/j.jpsychires.2012.04.027. [DOI] [PubMed] [Google Scholar]
  141. Thorndike, E. L. (1911). Animal intelligence: Experimental studies. New York: The Macmillan Company. 10.5962/bhl.title.55072. [DOI] [Google Scholar]
  142. Tolman, E. C. (1932). Purposive behavior in animals and men. New York, NY: Century/Random House UK. [Google Scholar]
  143. Treadway, M. T., Cooper, J. A., & Miller, A. H. (2019). Can't or won't? Immunometabolic constraints on dopaminergic drive. Trends in Cognitive Sciences, 23(5), 435–448. 10.1016/j.tics.2019.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  144. Treadway, M. T., & Zald, D. H. (2011). Reconsidering anhedonia in depression: Lessons from translational neuroscience. Neuroscience and Biobehavioral Reviews, 35(3), 537–555. 10.1016/j.neubiorev.2010.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  145. Trezza, V., Damsteegt, R., Manduca, A., Petrosino, S., Van Kerkhof, L. W. M., Pasterkamp, R. J., … Vanderschuren, L. J. M. J. (2012). Endocannabinoids in amygdala and nucleus accumbens mediate social play reward in adolescent rats. Journal of Neuroscience, 32(43), 14899–14908. 10.1523/jneurosci.0114-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  146. Trezza, V., & Vanderschuren, L. J. M. J. (2008). Cannabinoid and opioid modulation of social play behavior in adolescent rats: Differential behavioral mechanisms. European Neuropsychopharmacology, 18(7), 519–530. 10.1016/j.euroneuro.2008.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  147. Trigo, J. M., Martin-García, E., Berrendero, F., Robledo, P., & Maldonado, R. (2010). The endogenous opioid system: A common substrate in drug addiction. Drug and Alcohol Dependence, 108(3), 183–194. 10.1016/j.drugalcdep.2009.10.011. [DOI] [PubMed] [Google Scholar]
  148. Vandercammen, L., Hofmans, J., & Theuns, P. (2014). Relating specific emotions to intrinsic motivation: On the moderating role of positive and negative emotion differentiation. PLoS ONE, 9(12), e115396. 10.1371/journal.pone.0115396. [DOI] [PMC free article] [PubMed] [Google Scholar]
  149. Vohs, J. L., & Lysaker, P. H. (2014). Metacognitive mastery and intrinsic motivation in schizophrenia. The Journal of Nervous and Mental Disease, 202(1), 74–77. 10.1097/nmd.0000000000000063. [DOI] [PubMed] [Google Scholar]
  150. Vohs, J. L., Lysaker, P. H., & Nabors, L. (2013). Associations of personality with intrinsic motivation in schizophrenia. Psychiatry Research, 208(1), 78–80. 10.1016/j.psychres.2013.03.008. [DOI] [PubMed] [Google Scholar]
  151. Voon, V., Derbyshire, K., Rück, C., Irvine, M. A., Worbe, Y., Enander, J., … Bullmore, E. T. (2014). Disorders of compulsivity: A common bias towards learning habits. Molecular Psychiatry, 20(3), 345–352. 10.1038/mp.2014.44. [DOI] [PMC free article] [PubMed] [Google Scholar]
  152. Von Culin, K. R., Tsukayama, E., & Duckworth, A. L. (2014). Unpacking grit: Motivational correlates of perseverance and passion for long-term goals. The Journal of Positive Psychology, 9(4), 306–312. 10.1080/17439760.2014.898320. [DOI] [PMC free article] [PubMed] [Google Scholar]
  153. Wagner, U., N'Diaye, K., Ethofer, T., & Vuilleumier, P. (2011). Guilt-specific processing in the prefrontal cortex. Cerebral Cortex, 21(11), 2461–2470. 10.1093/cercor/bhr016. [DOI] [PubMed] [Google Scholar]
  154. Watson, J. B. (1913). Psychology as the behaviorist views it. Psychological Review, 20(2), 158–177. 10.1037/h0074428. [DOI] [Google Scholar]
  155. Watson, J. B. (1930). Behaviorism. New York: W.W. Norton & Company, Inc. [Google Scholar]
  156. Wilson RC, Collins AG. Ten simple rules for the computational modeling of behavioral data. Elife 26(8), e49547. doi: 10.7554/eLife.49547. [DOI] [PMC free article] [PubMed] [Google Scholar]
  157. Winch, A., Moberly, N. J., & Dickson, J. M. (2014). Unique associations between anxiety, depression and motives for approach and avoidance goal pursuit. Cognition and Emotion, 29(7), 1295–1305. 10.1080/02699931.2014.976544. [DOI] [PubMed] [Google Scholar]
  158. Witten, I. H. (1977). An adaptive optimal controller for discrete-time Markov environments. Information and Control, 34(4), 286–295. 10.1016/s0019-9958(77)90354-0. [DOI] [Google Scholar]
  159. Woodworth, R. S. (1918). Dynamic psychology. New York: Columbia University Press. [Google Scholar]
  160. Woodworth, R. S. (1921). Psychology: A study of mental life. Henry Holt And Co. [Google Scholar]
  161. Yamada, A.-M., Lee, K. K., Dinh, T. Q., Barrio, C., & Brekke, J. S. (2010). Intrinsic motivation as a mediator of relationships between symptoms and functioning among individuals with schizophrenia spectrum disorders in a diverse urban community. The Journal of Nervous and Mental Disease, 198(1), 28–34. 10.1097/nmd.0b013e3181c8aa71. [DOI] [PMC free article] [PubMed] [Google Scholar]
  162. Yu, C., Li, X., Wang, S., & Zhang, W. (2016). Teacher autonomy support reduces adolescent anxiety and depression: An 18-month longitudinal study. Journal of Adolescence, 49, 115–123. 10.1016/j.adolescence.2016.03.001. [DOI] [PubMed] [Google Scholar]
  163. Zhou, F., Li, J., Zhao, W., Xu, L., Zheng, X., Fu, M., … Becker, B. (2020). Empathic pain evoked by sensory and emotional-communicative cues share common and process-specific neural representations. Elife, 9, e56929. doi: 10.7554/eLife.56929. [DOI] [PMC free article] [PubMed] [Google Scholar]
  164. Zuroff, D. C., Koestner, R., Moskowitz, D. S., McBride, C., Marshall, M., & Bagby, M. R. (2007). Autonomous motivation for therapy: A new common factor in brief treatments for depression. Psychotherapy Research, 17(2), 137–147. 10.1080/10503300600919380. [DOI] [Google Scholar]

Articles from Psychological Medicine are provided here courtesy of Cambridge University Press

RESOURCES