Summary
When predicting financial profits [1], relationship outcomes [2], longevity [3], or professional success [4], people habitually underestimate the likelihood of future negative events (for review see [5]). This well-known bias, termed unrealistic optimism [6], is observed across age [7], culture [8], and species [9] and has a significant societal impact on domains ranging from financial markets to health and well being. However, it is unknown how neuromodulatory systems impact on the generation of optimistically biased beliefs. This question assumes great importance in light of evidence that common neuropsychiatric disorders, such as depression, are characterized by pessimism [10, 11]. Here, we show that administration of a drug that enhances dopaminergic function (dihydroxy-L-phenylalanine; L-DOPA) increases an optimism bias. This effect is due to L-DOPA impairing the ability to update belief in response to undesirable information about the future. These findings provide the first evidence that the neuromodulator dopamine impacts on belief formation by reducing negative expectations regarding the future.
Highlights
► L-DOPA impairs ability to update beliefs in response to undesirable information ► Enhancing dopamine function reduces negative expectations regarding the future
Results
Humans are optimistically biased when making predictions about the future, habitually underestimating the likelihood of negative events [1–8]. This bias is related to a striking asymmetry whereby people update their beliefs more in response to information that is better than expected compared to information that is worse than expected [12, 13]. Selective updating is mediated by regions of the frontal cortex that track errors in estimation when these call for positive update but show a relative failure to code for errors that might induce a negative update [12].
An unresolved question is whether neuromodulators associated with generating expectations of future outcomes influence this process. A prominent candidate is the monoamine dopamine, a neuromodulator suggested to provide a teaching signal that indexes when predictions fail to align with outcomes [14, 15]. In Parkinson's disease, drugs enhancing dopaminergic function (e.g., dihydroxy-L-phenylalanine; L-DOPA) influence learning of positive and negative outcomes in an asymmetric manner, enhancing the former and impairing the latter [16]. Dopamine effects on learning have been extensively studied in the context of model-free reinforcement learning [14–16]. However, it also impacts on domains as diverse as working memory, episodic memory, and reversal learning [17, 18]. Given these set of findings [12, 16], we hypothesize that enhancing dopamine function will influence how healthy individuals incorporate information about probabilities of future life events in an asymmetric manner, increasing an optimism bias.
To test whether an optimism bias is modulated by dopamine, participants completed a belief update task [12] on two separate days, one week apart (Figure 1), in a double-blind placebo-controlled pharmacological intervention study. On one of the days, participants received placebo and on the other they received L-DOPA (150 mg), in a counterbalanced order (n = 21). The task was identical on both days except for the fact that different stimuli were used on each day (lists were counterbalanced). At each session, participants provided estimates of their likelihood of experiencing 40 different types of adverse life events (e.g., Alzheimer's disease, robbery; see the List of Stimuli in the Supplemental Experimental Procedures available online) adapted from a previous study [12]. After each trial, they were presented with an actuarial average probability of that event occurring to a person from the same sociocultural environment. We then assessed whether participants used this information to update their predictions by subsequently asking them to again estimate their likelihoods for the same 40 events in a second session, taking place ∼15 min after the first session. They also completed a memory test for the information presented and rated all stimuli on different subjective scales (for a full description, see Supplemental Experimental Procedures).
To test whether effects might be observed when manipulating another neuromodulator implicated in learning about reward and punishment, we administered the serotonergic reuptake inhibitor citalopram (24 mg in oral drops, equivalent to 30 mg in tablets) to a second group of participants (n = 19). Serotonin neurotransmission is suggested to be involved in aversive processing and inhibition ([19, 20], but see [21]). However, the nature of its role in learning is less established than is the case for dopamine.
Optimism Bias Grows with Increased Dopamine Function
We found that enhancing participants' dopamine function increased their prediction bias in an optimistic direction. Specifically, for each participant on each trial, we subtracted the participant's estimation of how likely they were to encounter the negative event from the average probability of encountering that event (i.e., estimation error = estimation − probability presented). If the average estimation error was negative, then this indicated that participants tended to underestimate their likelihood of encountering aversive events relative to the average probability in the population (optimistically biased predictions). A positive number indicated a bias in a pessimistic direction, and a score of zero indicated that the extent of overestimation is equal to that of underestimation. Note that if the average estimation error is small in magnitude, this does not imply that the subject is accurate in their estimation; rather, it reflects that they are not biased in any particular direction.
For each subject, the change in average estimation errors (i.e., the change in bias = bias after presentation of information − bias before the presentation of information) was calculated and compared using a one-way analysis of covariance (ANCOVA) with condition (drug/placebo) as factor and differential scores on all subjective scales and memory controlled for by entering them as covariates (see Supplemental Experimental Procedures for details). The change in bias in the L-DOPA condition was greater than in the placebo condition [F(1,14) = 9.37, p < 0.01] (Figure 2A). As shown in Figure 2A, the change in bias in the L-DOPA condition was due to an effect in the optimistic direction and significantly different from zero [t(20) = 2.99, p < 0.01].
The change in bias in the citalopram condition was not different from in the placebo condition [F(1,12) = 0.01, p > 0.9]. We note that no assays of plasma drug levels or changes in endocrine measures were documented, which might have shown that the drug levels were not adequate to produce significant changes.
L-DOPA Impairs Updating in Response to Undesirable Information Regarding the Future
We next investigated whether L-DOPA increased the optimism bias by enhancing learning from desirable information regarding the future, decreasing learning from undesirable information, or both. To this end, as implemented previously [12], we divided trials into those for which the average probability of experiencing a negative life event was better than the participants' own probability estimate (i.e., trials for which a subject received desirable information) relative to a situation where the average probability was worse (i.e., subjects received undesirable information). The average degree of absolute belief update was then computed for each participant and condition (update = |participant's second estimate − participant's first estimate|). We found that L-DOPA selectively impaired belief update in response to undesirable information about the future (Figure 2B). Specifically, a 2 (condition: L-DOPA/placebo) by 2 (valence: desirable/undesirable) ANCOVA on update scores revealed a significant interaction [F(1,14) = 7.4, p < 0.02]. The interaction was characterized by a reduction in update magnitude in response to undesirable information under L-DOPA relative to placebo [t(20) = 3.03, p < 0.01, observed in 76% of the participants; Figure 2C], but there was no significant difference in response to desirable information under L-DOPA relative to placebo [t(20) = 0.34, p > 0.7]. Thus, selective updating, whereby participants update their beliefs when receiving desirable information relative to undesirable information, was enhanced by L-DOPA.
Our findings were not explained by valence-dependent effects of L-DOPA on memory (see Supplemental Experimental Procedures for a full description of how memory scores were calculated), emotional arousal, extent of negative valence, sense of familiarity, or sense of past experience with the adverse life events, because all these variables were added as covariates in all ANCOVAs (see Table S1 for scores on all variables and Supplemental Experimental Procedures for a description of all scales). Note that L-DOPA tended to increase memory for the information provided [F(1,20) = 3.67, p = 0.07], an effect that reached significance for desirable information only [desirable: t(20) = 2.12, p < 0.05; undesirable: t(20) = 1.2, p > 0.1], although there was no interaction [F(1,20) = 0.46, p > 0.5; Figure 3]. Furthermore, L-DOPA did not cause side effects, nor did it affect mood or reaction times (see Tables S1 and S2).
We observed no effect of citalopram on updating [main effect of condition: F(1,12) = 1.7, p > 0.6; interaction between condition and valence: F(1,12) = 0.8, p > 0.8]. Although citalopram did not impact on updating, this does not imply that citalopram, or serotonin function, does not influence optimism. An optimism bias can in principle be generated via a number of different mechanisms [5, 12, 23], and it is possible that serotonin could impact on expectations by altering other processes, such as mental simulation of future events [23] or increased memory for positive emotions [24].
Discussion
We show that a tendency to incorporate undesirable information into one's forecasts of the future is impaired when dopamine levels are enhanced. This leads to an underestimation of the likelihood of negative events, a fundamental characteristic of unrealistic optimism. Previously, we reported that increasing dopamine function while people imagined positive future events enhanced expectations of pleasure to be derived from those events [25]. Whereas dopamine in our previous study altered hedonic expectancies, in the current study we show that enhancing dopamine influences positive expectations by attenuating the impact of unexpected negative information. In this regard, our findings converge with observations from patients with Parkinson's disease where enhanced dopaminergic levels lead to impaired learning from unwanted outcomes [16]. Although the latter study differed significantly from ours, not only in terms of the target population (Parkinsonian patients rather than healthy individuals) but also in relation to a requirement to learn from actual outcomes (rather than information of possible future outcomes) in the context of a reinforcement learning task, we suggest that the underlying mechanisms may be shared. Specifically, L-DOPA administration may interfere with dopamine dips, the putative mechanism signaling a worse-than-expected outcome [26, 27] suggested to support learning from negative prediction errors [16, 28]. We speculate that dopamine modulation of frontal cortex function may explain the current results, given that dopamine plays a modulatory role in cognition through its extensive diffuse projections from midbrain dopamine nuclei to the basal ganglia and frontal cortical areas [29–31].
Note that we do not conclude that the effect of L-DOPA is specific to learning about possible future outcomes (differential effects of dopamine on the impact of positive and negative outcomes may be general). Instead, the relevance of our findings is in providing an explanation of how dopamine enhances unrealistic optimism. Interestingly, our results also hint at a possible mechanism by which antidepressant medication that targets dopamine function might reduce depressive symptoms and cognitions [32]. A core symptom profile in major depression disorder is pessimistic beliefs [10]. Individuals with mild depression exhibit less biased expectations than healthy individuals, whereas those with severe depression express a pessimistic bias [11]. By reducing the probability of updating expectations in response to negative information, medication that enhances dopamine levels might lead to a diminution of a pessimistic outlook in depressed patients.
Understanding how predictions of future life events are altered is critical for understanding human action and decision making, which is largely driven by predictions of likely negative and positive outcomes [33–35]. It is also key to understanding how expectations go awry in neuropsychiatric disorders where dopamine function is an implicated mechanism, including depression [32], addiction [36], and attention deficit hyperactivity disorder [37]. Our data provide novel evidence that pharmacological manipulation of the neurotransmitter dopamine alters the efficiency of human belief updating, reducing negative expectations in a manner that leads to a boosting of unrealistic optimism.
Experimental Procedures
Participants
Forty participants were recruited via the University College London psychology subject pool. Participants were randomly assigned to either the L-DOPA condition (n = 21, mean age 23.9 years, 11 females, 10 males) or the citalopram condition (n = 19, mean age 22.5 years, 10 females, 9 males). The study was double blind. All subjects gave informed consent and were paid for their participation. They completed a screening form for significant medical conditions, signed a form declaring that they were not receiving other medications or using illicit drugs, and were paid for their participation.
Stimuli
Eighty short descriptions of negative life events (e.g., car theft, Parkinson's disease; see the List of Stimuli in the Supplemental Experimental Procedures) were presented. Stimuli were split into two lists of 40 events each. One list was used on day 1 and the other on day 2, randomly assigned.
For each adverse event, the average probability of that event occurring at least once to a person living in the same sociocultural environment as the participants was determined based on online resources. Very rare or very common events were not included; all event probabilities lay between 10% and 70%. To ensure that the range of possible overestimation was equal to the range of possible underestimation, participants were told that the range of probabilities was between 3% and 77%.
Procedure
Participants completed the task on two days one week apart. On one day they received placebo, and on the other day either L-DOPA (150 mg) together with benserazide (37.5 mg, which promotes higher levels of dopamine in the brain while minimizing side effects from peripheral dopamine, such as nausea and vomiting) 2 hr before task completion, or citalopram (24 mg in drops, which is equivalent to 30 mg in tablet) 4 hr before task completion; order was randomly assigned and counterbalanced. L-DOPA's half-life is ∼1.5 hr (peaks at 1 hr) and citalopram's is ∼35 hr (peaks at 4 hr).
After completing the main task, subjects completed the memory test and additional ratings (see Supplemental Experimental Procedures) and a subjective state questionnaire [38] (see Table S1 for scores). Before completing the task, subjects participated in a separate fMRI study using a go/no-go task [39]. There is no a priori theoretical link between the two studies, and the reason for using the same subjects in both tasks was purely efficiency.
Task
On each trial, a stimulus was presented on screen for 2 s. During that time, participants were instructed to think of that event happening to them in the future. When the words “Estimation of happening?” appeared on screen they were to estimate how likely the event was to happen to them in the future. Participants had up to 6 s to respond using the keyboard. If the participant failed to respond, that trial was excluded from all consequent analyses. A fixation cross then appeared for 1–3 s (jittered). Next, the event description appeared again for 2 s together with the average probability of that event occurring. Finally, a fixation cross appeared for 1–3 s (jittered). Immediately after completing 40 trials, participants estimated all events again. The procedure was the same as above, except that the average probability of the event occurring was not presented again.
Acknowledgments
This study was supported by a Wellcome Trust Program Grant to R.J.D. and a Wellcome Trust Career Development Fellowship to T.S. The Wellcome Trust Centre for Neuroimaging is supported by core funding from the Wellcome Trust 091593/Z/10/Z.
Published online: July 12, 2012
Footnotes
Supplemental Information includes Supplemental Experimental Procedures and two tables and can be found with this article online at http://dx.doi.org/10.1016/j.cub.2012.05.053.
Supplemental Information
References
- 1.Calderon T.G. Predictive properties of analysts' forecasts of corporate earnings. Mid-Atlantic J. Bus. 1993;29:41–58. [Google Scholar]
- 2.Baker L.A., Emery R.E. When every relationship is above average: perceptions and expectations of divorce at the time of marriage. Law Hum. Behav. 1993;17:439–450. [Google Scholar]
- 3.Puri M., Robinson D.T. Optimism and economic choice. J. Financ. Econ. 2007;86:71–99. [Google Scholar]
- 4.Lovallo D., Kahneman D. Delusions of success. How optimism undermines executives' decisions. Harv. Bus. Rev. 2003;81:56–63. 117. [PubMed] [Google Scholar]
- 5.Sharot T. Pantheon Books; New York: 2011. The Optimism Bias. [Google Scholar]
- 6.Weinstein N.D. Unrealistic optimism about future life events. J. Pers. Soc. Psychol. 1980;39:806–820. [Google Scholar]
- 7.Isaacowitz D.M. Correlates of well-being in adulthood and old age: a tale of two optimisms. J. Res. Pers. 2005;39:224–244. [Google Scholar]
- 8.Chang E.C. First Edition. American Psychological Association; Washington, DC: 2000. Optimism and Pessimism: Implications for Theory, Research, and Practice. [Google Scholar]
- 9.Harding E.J., Paul E.S., Mendl M. Animal behaviour: cognitive bias and affective state. Nature. 2004;427:312. doi: 10.1038/427312a. [DOI] [PubMed] [Google Scholar]
- 10.American Psychiatric Association . Fourth Edition. American Psychiatric Association; Washington, DC: 1994. Diagnostic and Statistical Manual of Mental Health Disorders. [Google Scholar]
- 11.Strunk D.R., Lopez H., DeRubeis R.J. Depressive symptoms are associated with unrealistic negative predictions of future life events. Behav. Res. Ther. 2006;44:861–882. doi: 10.1016/j.brat.2005.07.001. [DOI] [PubMed] [Google Scholar]
- 12.Sharot T., Korn C.W., Dolan R.J. How unrealistic optimism is maintained in the face of reality. Nat. Neurosci. 2011;14:1475–1479. doi: 10.1038/nn.2949. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Eli D., Rao J.M. The good news-bad news effect: asymmetric processing of objective information about yourself. Am. Econ. J. Microeconomics. 2011;3:114–138. [Google Scholar]
- 14.Schultz W., Dayan P., Montague P.R. A neural substrate of prediction and reward. Science. 1997;275:1593–1599. doi: 10.1126/science.275.5306.1593. [DOI] [PubMed] [Google Scholar]
- 15.Schultz W. Predictive reward signal of dopamine neurons. J. Neurophysiol. 1998;80:1–27. doi: 10.1152/jn.1998.80.1.1. [DOI] [PubMed] [Google Scholar]
- 16.Frank M.J., Seeberger L.C., O'reilly R.C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science. 2004;306:1940–1943. doi: 10.1126/science.1102941. [DOI] [PubMed] [Google Scholar]
- 17.Cools R. Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neurosci. Biobehav. Rev. 2006;30:1–23. doi: 10.1016/j.neubiorev.2005.03.024. [DOI] [PubMed] [Google Scholar]
- 18.Shohamy D., Adcock R.A. Dopamine and adaptive memory. Trends Cogn. Sci. 2010;14:464–472. doi: 10.1016/j.tics.2010.08.002. [DOI] [PubMed] [Google Scholar]
- 19.Cools R., Roberts A.C., Robbins T.W. Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn. Sci. 2008;12:31–40. doi: 10.1016/j.tics.2007.10.011. [DOI] [PubMed] [Google Scholar]
- 20.Dayan P., Huys Q.J.M. Serotonin in affective control. Annu. Rev. Neurosci. 2009;32:95–126. doi: 10.1146/annurev.neuro.051508.135607. [DOI] [PubMed] [Google Scholar]
- 21.Seymour B., Daw N.D., Roiser J.P., Dayan P., Dolan R.J. Serotonin selectively modulates reward value in human decision-making. J. Neurosci. 2012;32:5833–5842. doi: 10.1523/JNEUROSCI.0053-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Cousineau D. Confidence intervals in within-subject designs: a simpler solution to Loftus and Masson's method. Tutorial. Quant. Meth. Psychol. 2005;1:42–45. [Google Scholar]
- 23.Sharot T., Riccardi A.M., Raio C.M., Phelps E.A. Neural mechanisms mediating optimism bias. Nature. 2007;450:102–105. doi: 10.1038/nature06280. [DOI] [PubMed] [Google Scholar]
- 24.Harmer C.J., Shelley N.C., Cowen P.J., Goodwin G.M. Increased positive versus negative affective perception and memory in healthy volunteers following selective serotonin and norepinephrine reuptake inhibition. Am. J. Psychiatry. 2004;161:1256–1263. doi: 10.1176/appi.ajp.161.7.1256. [DOI] [PubMed] [Google Scholar]
- 25.Sharot T., Shiner T., Brown A.C., Fan J., Dolan R.J. Dopamine enhances expectation of pleasure in humans. Curr. Biol. 2009;19:2077–2080. doi: 10.1016/j.cub.2009.10.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Ungless M.A., Magill P.J., Bolam J.P. Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science. 2004;303:2040–2042. doi: 10.1126/science.1093360. [DOI] [PubMed] [Google Scholar]
- 27.Satoh T., Nakai S., Sato T., Kimura M. Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci. 2003;23:9913–9923. doi: 10.1523/JNEUROSCI.23-30-09913.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wickens J.R., Horvitz J.C., Costa R.M., Killcross S. Dopaminergic mechanisms in actions and habits. J. Neurosci. 2007;27:8181–8183. doi: 10.1523/JNEUROSCI.1671-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Fallon J.H., Moore R.Y. Catecholamine innervation of the basal forebrain. IV. Topography of the dopamine projection to the basal forebrain and neostriatum. J. Comp. Neurol. 1978;180:545–580. doi: 10.1002/cne.901800310. [DOI] [PubMed] [Google Scholar]
- 30.Gerfen C.R. The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. Annu. Rev. Neurosci. 1992;15:285–320. doi: 10.1146/annurev.ne.15.030192.001441. [DOI] [PubMed] [Google Scholar]
- 31.Goldman-Rakic P. Localization of function all over again. Neuroimage. 2000;11:451–457. doi: 10.1006/nimg.2000.0575. [DOI] [PubMed] [Google Scholar]
- 32.Papakostas G.I. Dopaminergic-based pharmacotherapies for depression. Eur. Neuropsychopharmacol. 2006;16:391–402. doi: 10.1016/j.euroneuro.2005.12.002. [DOI] [PubMed] [Google Scholar]
- 33.Bentham J. Hafner Publishing Company; New York: 1948. An Introduction to the Principles of Morals and Legislation. Originally published 1789. [Google Scholar]
- 34.Sharot T., De Martino B., Dolan R.J. How choice reveals and shapes expected hedonic outcome. J. Neurosci. 2009;29:3760–3765. doi: 10.1523/JNEUROSCI.4972-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Sharot T., Shiner T., Dolan R.J. Experience and choice shape expected aversive outcomes. J. Neurosci. 2010;30:9209–9215. doi: 10.1523/JNEUROSCI.4770-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Berke J.D., Hyman S.E. Addiction, dopamine, and the molecular mechanisms of memory. Neuron. 2000;25:515–532. doi: 10.1016/s0896-6273(00)81056-9. [DOI] [PubMed] [Google Scholar]
- 37.Tripp G., Wickens J.R. Neurobiology of ADHD. Neuropharmacology. 2009;57:579–589. doi: 10.1016/j.neuropharm.2009.07.026. [DOI] [PubMed] [Google Scholar]
- 38.Joint Formulary Committee . First Edition. BMJ Group and Pharmaceutical Press; London: 2009. British National Formulary 57. [Google Scholar]
- 39.Guitart-Masip M., Chowdhury R., Sharot T., Dayan P., Duzel E., Dolan R.J. Action controls dopaminergic enhancement of reward representations. Proc. Natl. Acad. Sci. USA. 2012;109:7511–7516. doi: 10.1073/pnas.1202229109. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.