Abstract
Affective neuroscience has helped guide research and theory development in judgment and decision-making by revealing the role of emotional processes in choice behavior, especially when risk is involved. Evidence is emerging that qualitatively and quantitatively different processes may be involved in risky decision-making for gains and losses. We start by reviewing behavioral work by Kahneman and Tversky (1979) and others, which shows that risk-taking differs for potential gains and potential losses. We then turn to the literature in decision neuroscience to support the gain versus loss distinction. Relying in part on data from a new task that separates risky decision-making for gains and losses, we test a neural model that assigns unique mechanisms for risky decision-making involving potential losses. Included are studies using patients with lesions to brain areas specified as important in the model and studies with healthy individuals whose brains are scanned to reveal activation in these and other areas during risky decision-making. In some cases, there is evidence that gains and losses are processed in different regions of the brain, while in other cases the same region appears to process risk in a different manner for gains and losses. At a more general level, we provide strong support for the notion that decisions involving risk-taking for gains and decisions involving risk-taking for losses represent different psychological processes. At a deeper level, we present mounting evidence that different neural structures play different roles in guiding risky choices in these different domains. Some structures are differentially activated by risky gains and risky losses while others respond uniquely in one domain or the other. Taken together, these studies support a clear functional dissociation between risk-taking for gains and risk-taking for losses, and further dissociation at the neural level.
Keywords: decision neuroscience, risky decision-making, gain/loss domain differences
Introduction
The combination of methods from the behavioral decision-making literature such as risky decision-making tasks derived from the classic work of Kahneman and Tversky (1979), and methods of neuroscience such as functional magnetic resonance imaging (fMRI) and lesion studies has led to breakthroughs in both fields. Examples include how impairment in specific brain functions translate into disadvantageous decision-making inside and outside of the laboratory (Bechara et al., 1994, 1996, 1997, 1999) and how common decision-making biases and heuristics can be understood at the neural level (Sanfey et al., 2003; Hsu et al., 2005; Kuhnen and Knutson, 2005; De Martino et al., 2006; Huettel et al., 2006; Tom et al., 2007). New areas of study have emerged with titles such as neuroeconomics and decision neuroscience.
A major contribution of this work has been a better understanding of how emotion, in combination with cognition, guides our decisions, particularly in the realm of risky decision-making where conflicts often arise in balancing the lure of reward and the fear of loss. Evidence is accumulating that emotional reactivity differs in response to risky gains and risky losses. Logical questions are whether risk-taking for gains and risk-taking for losses can best be understood as separate psychological processes, and ultimately, whether they rely on different brain structures. In this paper, we integrate findings from our own work and that of others to come to conclusions that have some generality but also allow for differences between studies based on methodology.
In order to frame this investigation, we start with a model put forth to support the findings from two studies we conducted with patients with lesions to areas of the brain known to be critical to risky decision-making, namely the ventromedial prefrontal cortex (VMPFC), the amygdala, and the insula (Bechara et al., 1999; Clark et al., 2008). As summarized in Figure 1 (from Weller et al., 2007), we propose that risky decision-making is influenced by the opposing forces of lure of gain and fear of risk1. We operationalize the “lure” of rewards as either the potential for a relatively large gain in the gain domain (in comparison to the small sure gain from a riskless choice) or the potential for avoiding a loss altogether in the loss domain, and the “fear” of risk as arising from risking a relatively large loss in the loss domain (in comparison to the small sure loss from a riskless choice) or not winning anything in the gain domain. These two forces act in opposite directions in exciting or inhibiting risk-taking. We suggest that the VMPFC subregions, the amygdala, and the insula each contribute in different ways to the processing and utilization of these two critical pieces of emotional information. The mere presence of uncertainty induces a primary “fear” response elicited by the amygdala, which has been associated specifically with fear processing and avoidance behavior (LeDoux, 2000; Trepel et al., 2005; Phelps, 2006). This fear response activates the VMPFC whose function it is to mediate decision-making and allows for more careful deliberative processes by linking together working memory and emotional systems (Damasio, 1994).
While the amygdala has been studied extensively and shown to be a key substrate for triggering emotional responses, especially in connection with fear (LeDoux, 2000), the fact remains that the triggering of emotional responses involves multiple neural regions, and not just the amygdala. Thus, structures such as the insula, which are independent of the amygdala, are also likely to impact decision-making under uncertainty (Kuhnen and Knutson, 2005; Clark et al., 2008; Weller et al., 2009). In particular, we propose that the insula and the amygdala provide complementary systems for dealing with potential losses, which we attribute to the evolutionary significance of dealing with potential losses. Our ancestors learned to avoid situations that risked the loss of things essential for survival and it is reasonable to assume that our brains have been primed for avoiding losses.
This account parallels the proposed dual systems approach of System 1 (experiential) and System 2 (deliberative) for decision-making (Kahneman, 2003). The neural underpinnings of these mechanisms have also been addressed in the “somatic marker” framework. According to the “somatic marker hypothesis” (Bechara and Damasio, 2005; Reimann and Bechara, 2010), after the amygdala triggers an automatic emotional response (or primary induction), the VMPFC subsequently prompts a more careful deliberative analysis that triggers secondary emotional responses (secondary induction) that help guide advantageous decision-making. Findings in support of the somatic marker hypothesis were key to new behavioral theories in which emotions play a pivotal role in decision-making (Mellers et al., 1999; Loewenstein et al., 2001; Slovic et al., 2002).
In the following sections of this paper, we review the evidence for our model based on studies involving the VMPFC, amygdala, and insula, but we also include studies involving other areas that have implications for addressing the basic question of whether there is evidence at the neural level of a distinction between risky decision-making in the gain and loss domains. We will provide evidence that separate psychological processes are involved in risk-taking for gains and losses in terms of both behavioral and neurological reactions that discriminate between risk-taking to achieve a gain and risk-taking to avoid a loss. We then address the more complex issue of whether distinct neural structures support these different reactions. In the case of fMRI studies, we will see that results depend on when during the decision-making process the recordings are made. We start, however, with some more straightforward and well-known behavioral phenomena that motivate the search for neurological dissociations between risk-taking for gains and losses.
It is typical to consider risk-taking as a unified behavioral concept when we talk about a person in terms such as “She is a risk-taker” or “He likes to play it safe.” However, it has been shown that risk-taking within the same individual varies across content domains such as monetary, health, and social risks (Weber et al., 2002). Within each of these domains, we may talk about an action as being “risky” because of the uncertainty of its outcome without differentiating between the potential for achieving benefits versus the potential for avoiding aversive consequences. Kahneman and Tversky (1979) demonstrated a fundamental principle that sparked decades of later research: individuals were more likely to take a risk to avoid a loss than to achieve a gain of the same magnitude2. Later work by the same authors revealed a fourfold pattern of risk-aversion for gains and risk-seeking for losses of high probability but risk-seeking for gains and risk-aversion for losses of low probability (Tversky and Kahneman, 1992). This was explained in terms of underweighting the likelihood of high probability but overweighting the likelihood of low probability events. The tasks described in this paper will primarily be of the former type. This paper describes a relatively new component of this research: neuroscientific studies that provide additional sources of data that separate risk-taking to achieve a gain and risk-taking to avoid a loss.
In presenting the most recent research in our laboratory, we focus on the “cups task” (Levin et al., 2007), which we developed specifically to separate risky decision-making for actual gains and losses, both in terms of overall riskiness and sensitivity to expected value (EV) differences between choice options. The cups task includes a gain domain and a loss domain. Gain trials involve some probability of an addition to the decision-maker’s account while loss trials involve a possible reduction. Decision makers choose between one array of cups in which the outcome is constant (the riskless choice) and one array of cups in which the outcomes vary (the risky choice). Outcomes are displayed immediately after choices are made. By varying the number of cups and the amount to be won or lost, we create gain and loss trials with contingencies that either do or do not favor a risky choice (see Figure 2). For example, a one-out-of-three chance of winning five coins is better in the long run than a sure gain of one coin but a one-out-of-three chance of losing five coins is worse in the long run than a sure loss of one coin. A key component of data analysis for the cups task is the extent to which an individual makes choices based on the consideration of relative EV between choice options, for both gain- and loss-related decisions. EV sensitivity represents an index of advantageous decision-making because consistently choosing the option with a more favorable EV will yield more positive outcomes in the long run. As will be described later, a somewhat simpler version of the task was adapted for use in scanner research. Across many data sets, we demonstrated that Kahneman and Tversky’s (1979) original finding of more risk-taking to avoid a loss than to achieve a gain of the same magnitude is reproduced in the cups task. Beyond the initial demonstration of greater risk-taking for losses than for gains, our recent research with the cups task showed age-related differences in risk-taking as a function of decision domain (risk-taking to achieve a gain versus to avoid a loss). Risk-taking in the domain of gains decreased monotonically from early childhood to older adulthood whereas overall risk-taking to avoid losses was remarkably constant across age groups (Weller et al., 2011). Within both domains, EV sensitivity increased from early childhood through adulthood with a slight decline for older adults.
Evidence from Decision Neuroscience
We turn to neuroscience for an exploration of brain functions that may help explain these gain/loss behavioral differences. Our approach in this paper is to provide a body of evidence that is consistent with the proposition that risky decision-making is separable in the gain and loss domains rather than providing a single “critical” test.
Historically, the most fundamental functional division of the brain was thought to be the one that distinguished between approach and avoidance behaviors. However, many years of animal research failed to identify anatomically separate neural substrates–neural systems underlying pain and pleasure seem to overlap considerably (e.g., Craig, 2009). Later human behavioral studies found equivocal support for a separation of neural systems whereby the left hemisphere is predominantly concerned with approach behaviors and the lure of reward, whereas the right hemisphere is critical for avoidance behaviors and the fear of uncertainty (Davidson et al., 1990). More recently, neuropsychological research on the approach–avoidance conflict evolved into studies of risky decision-making where the shift was to a more microscopic analysis of neural systems.
Neuroimaging data have been used to gain new insights concerning risky decision-making. In particular, fMRI studies use changes in blood flow that accompany neural activity in different parts of the brain to associate these areas to particular behaviors. For instance, in a recent meta-analysis of fMRI studies of risky decision-making using young, healthy adults, Mohr et al. (2010) found evidence common to all studies that risk processing is associated with activation of specific emotional systems in the brain such as the anterior insula, especially when potential losses are involved. The dorsolateral prefrontal cortex and parietal cortex are also activated when making decisions involving risk. Using fMRI in conjunction with a paradigm in which individuals decided whether to accept or reject gambles offering a 50/50 chance of gaining or losing varying amounts of money, Tom et al. (2007) found that activity in the ventral striatum and the VMPFC increased as potential gains increased but decreased as potential losses increased. Also, in the anterior insula, activity was found more strongly associated with the anticipation of losses than with anticipation of gains (Knutson et al., 2007). Earlier research showed increased arousal following losses than following gains (Bechara et al., 1999). Such results motivated us to classify study results based on whether activation was measured before, during, or after a decision was made.
In order to get a more complete picture, we conducted a focused literature search. Using the keywords “fMRI,” “gains,” “losses,” “risk,” and “uncertainty,” Table 1 summarizes the results of a number of fMRI studies in terms of which areas of the brain were studied and at what point in time, and whether the study provided support for distinct mechanisms involved in risky decision-making for gains and losses. While the results are “mixed,” a pattern emerges when the studies are separated based on whether brain activation was measured before, during, or after a risky choice was made. Most noteworthy, while different regions were the focus of different studies, in 14 studies in which activation was assessed prior to a choice (i.e., anticipation), support for separate mechanisms was found in eight studies, four studies did not support separate structures, and two studies did not make claims about separate structures because they focused on a specific region only. For example, studies by Kuhnen and Knutson (2005) and Knutson et al. (2008b) each found that the nucleus accumbens was activated in anticipation of a risky gain, whereas the insula was activated in anticipation of a risky loss. We think these results are particularly compelling because they suggest that different parts of the brain drive risky decision-making in anticipation of uncertain gains versus uncertain losses. Whereas activation during or after a risky choice can influence subsequent risky choices, activation prior to a choice is unique in its potential to influence the current choice.
Table 1.
Authors and year | Focal topic | Time of measurement | Conditions | Active regions identified | Sample size | Result |
---|---|---|---|---|---|---|
TIME OF MEASUREMENT BEFORE DECISION-MAKING | ||||||
Knutson et al. (2001) | Anticipation of monetary reward | Before decision-making (anticipation of choice phase) | Gains (reward anticipation versus neutral) | Nucleus accumbens Caudate Putamen Anterior thalamus Amygdala Anterior cingulate cortex Medial prefrontal cortex Supplementary motor area Posterior cingulate cortex Cerebellar vermis |
8 | Study supports separate structures because additional other regions were activated for gains compared to losses |
Losses (punishment anticipation versus neutral) | Caudate Anterior thalamus |
|||||
Matthews et al. (2004) | Risky decision-making | Before decision-making (prior to selection phase) | Gains (risky response minus safe responses) | Medial frontal gyrus Nucleus accumbens Caudate tail Middle occipital gyrus |
12 | Study supports separate structures because different regions were activated for gains versus losses |
Losses (safe minus risky responses) | Superior temporal gyrus Middle temporal gyrus Inferior frontal gyrus |
|||||
Kuhnen and Knutson (2005) | Risky decision-making in a financial context | Before decision-making (anticipation of choice phase) | Gains (risky choices and risk-seeking mistakes) | Nucleus accumbens | 19 | Study supports separate structures because different regions were activated for gains versus losses |
Losses (riskless choices and risk-aversion mistakes) | Insula | |||||
Gains versus losses | Medial prefrontal cortex Orbitofrontal cortex Nucleus accumbens Anterior cingulate cortex Precuneus Posterior cingulate |
|||||
Yacubian et al. (2006) | Decision-making under uncertainty | Before decision-making (anticipation of choice phase) | Gains (computation of expected value for gains) | Ventral striatum | 66 | Study supports separate structures because different regions were activated for gains versus losses |
Losses (computation of expected value for losses) | Amygdala | |||||
Knutson et al. (2007) | Decision-making in purchasing context | Before decision-making (anticipation of choice phase) | Gains (purchasing a preferred product) | Anterior cingulate cortex Dorsolateral prefrontal cortex Medial frontal gyrus Superior frontal gyrus Anterior insula Nucleus accumbens Caudate Globus pallidus Posterior cingulate |
26 | Study supports separate structures because different regions were activated for gains versus losses |
Losses (spending money) | Frontopolar cortex Medial prefrontal corte Anterior cingulate cortex Parahippocampal gyrus |
|||||
Seymour et al. (2007) | Risky decision-making in a financial context | Before decision-making (prediction error phase) | Gains (rewards) | Anterior striatum | 20 | Study supports separate structures because different regions were activated for gains versus losses |
Losses | Posterior striatum | |||||
Knutson et al. (2008a) | Decision-making in a buying and selling context | Before decision-making (anticipation of choice phase) | Gains (buying versus selling at low prices) | Medial prefrontal cortex | 24 | Study supports separate structures because different regions were activated for gains versus losses |
Buying and selling of preferred products | Nucleus accumbens | |||||
Losses (selling product) | Insula | |||||
Knutson et al. (2008b) | Risky decision-making in a financial context | Before decision-making (anticipation of choice phase) | Gains (high-risk shift versus low-risk shift) | Anterior insula Caudate Nucleus accumbens |
15 | Study supports separate structures because different regions were activated for gains versus losses |
Gains versus losses | Medial prefrontal cortex Caudate Putamen Inferior frontal gyrus Precentral gyrus Posterior cingulate Lingual gyrus |
|||||
Breiter et al. (2001) | Expectancy and experience of monetary gains and losses | Before decision-making (expectancy phase) | Gains (good spinner) | Frontal lobe Amygdala Nucleus accumbens Sublenticular extended amygdala Hypothalamus |
12 | Study does not support separate structures because same key regions were activated for both gains and losses |
Losses (bad spinner) | Frontal lobe Amygdala Nucleus accumbens Sublenticular extended amygdala |
|||||
Fukui et al. (2005) | Risk anticipation during Iowa Gambling Task | Before decision-making (anticipation of choice phase) | Gains (risky response minus safe responses) | Medial frontal gyrus | 14 | Study does not make claims about separate structures because the medial frontal cortex was the region of focus |
Paulus and Frank (2006) | Comparison of high versus low probability prospects | Before decision-making (from onset of the presentation of the options until the subject had made a response) | Losses (high probability prospects) versus gains (low probability prospects) | Precuneus Cingulate gyrus Insula Middle frontal gyrus Middle occipital gyrus Precuneus Superior parietal lobule Insula Thalamus Postcentral gyrus Inferior parietal lobule Middle frontal gyrus Superior temporal gyrus Precentral gyrus Caudate |
16 | Study does not support separate structures because same regions were activated for both gains and losses |
Tom et al. (2007) | Risky decision-making and loss aversion | Before decision-making (anticipation of potential gains or losses phase) | Gains (potential gain effects) | Nucleus accumbens Caudate Thalamus Ventromedial prefrontal cortex Orbitofrontal cortex Frontal pole Middle frontal gyrus Middle/superior frontal gyrus Posterior cingulate Midbrain |
16 | Study does not support separate structures because same regions were activated for both gains and losses |
Losses (potential loss effects) | Nucleus accumbens Caudate Thalamus Ventromedial prefrontal cortex Orbitofrontal cortex Frontal pole Middle frontal gyrus Middle/superior frontal gyrus Posterior cingulate Midbrain |
|||||
Preuschoff et al. (2008) | Risk prediction error and risk in decision-making | Before decision-making (prediction phase) | Risk prediction error | Insula | 19 | Study does not make claims about separate structures because the insula was the region of focus |
Tobler et al. (2009) | Risk and expected value in decision-making | Before decision-making (prediction phase) | Gains (increased risk-seeking) | Lateral prefrontal cortex | 15 | Study does not support separate structures because same regions were activated for both gains and losses |
Losses (increase risk-aversion) | Lateral prefrontal cortex | |||||
TIME OF MEASUREMENT DURING DECISION-MAKING | ||||||
O’Doherty et al. (2001) | Reversal learning task of monetary reward and punishment | During decision-making (acquisition/reversal phase) | Gains | Orbitofrontal cortex Medial prefrontal cortex Posterior inferior prefrontal sulcus |
9 | Study does not clearly support separate structures because same key region (here: orbitofrontal cortex) was activated for both gains and losses |
Losses | Orbitofrontal cortex Posterior inferior prefrontal sulcus Dorsal anterior cingulate cortex |
|||||
Gottfried et al. (2002) | Appetitive and aversive olfactory learning | During learning phase | Gains (appetitive olfactory learning) | Medial orbitofrontal cortex Anterior orbitofrontal cortex Ventral striatum Nucleus accumbens Pallidum/dorsomedial amygdala Uncus/ventromedial amygdala Dorsomedial amygdala Ventromedial prefrontal cortex Cerebellar hemisphere Anterior hippocampus |
15 | Study does not support separate structures because same key regions were activated for both gains and losses |
Losses (aversive olfactory learning) | Lateral orbitofrontal cortex Medial orbitofrontal cortex Nucleus accumbens Temporal pole/piriform cortex |
|||||
Paulus et al. (2003) | Risky decision-making | During decision-making | Gains (risky response versus safe response) | Insula Cuneus Precuneus Middle frontal gyrus |
17 | Study does not clearly support separate structures because same key region (here: insula) was activated for both gains and losses but to a greater extent for risky versus safe responses |
Losses (risky response versus punishment response) | Inferior frontal gyrus Insula Superior parietal lobule |
|||||
Huettel et al. (2005) | Uncertain decision-making | During decision-making | Gains/losses (increasing uncertainty) | Insula Inferior frontal gyrus Middle frontal gyrus Thalamus Inferior parietal lobule Intraparietal sulcus |
12 | Study does not clearly support separate structures because same regions were activated for both gains and losses |
Plassmann et al. (2010) | Processing of appetitive versus aversive goal values | During decision-making (decision-making phase) | Gains (appetitive goal values) | Medial orbitofrontal cortex Dorsolateral prefrontal cortex |
19 | Study does not support separate structures because same key regions were activated for both gains and losses |
Losses (aversive goal values) | Medial orbitofrontal cortex Dorsolateral prefrontal cortex |
|||||
TIME OF MEASUREMENT AFTER DECISION-MAKING (OUTCOME PROCESSING) | ||||||
Hsu et al. (2005) | Ambiguous decision-making | After decision-making (response to risk) | Gains (gamble versus certainty) | Occipital cortex Medial frontal gyrus Brodmann area 6 Precentral gyrus Insula Caudate head Brodmann area 18 Insula Middle temporal gyrus |
16 | Study supports separate structures because additional other regions were activated for gains compared to losses |
Losses (certainty versus gamble) | Precentral gyrus Occipital cortex |
|||||
Fujiwara et al. (2009) | Monetary reward and punishment | After decision-making (presentation of chosen outcome) | Gain-specific regions | Anterior cingulate cortex Posterior cingulate cortex Superior frontal gyrus Inferior operculum Insula Midbrain Inferior temporal gyrus Inferior parietal lobule Cerebellum |
17 | Study does not support separate structures because same key regions were activated for both gains and losses |
Loss-specific regions | Anterior cingulate cortex Inferior operculum Insula |
|||||
Common gain and loss regions | Anterior cingulate cortex Posterior cingulate cortex Postcentral gyrus Inferior operculum Insula Midbrain Middle temporal gyrus |
This table is sorted by time of measurement (before, during, or after decision-making) and by result (supportive of separate structures or not). In each category, the table is sorted first in chronological order, then in alphabetical order.
Beside the dissociation at the pre-decision stage, recent evidence suggests that experienced gains and losses might also activate different regions, which then affect subsequent decisions making. In a recent study using the cups task, we found that at the feedback stage, experienced reward was associated with strong activation in the VMPFC and the ventral striatum, and the stronger reward-related responses in the VMPFC were positively associated with risk-taking (Xue et al., 2009). In a follow up study, we explicitly examined how neural and behavioral responses to gains and losses were associated with subsequent decisions. We developed a modified version of the cups task in which a single array of cups was presented on a given trial where one coin would be lost for all but one randomly selected cup, but multiple coins would be won if the other cup was drawn (Xue et al., 2011). The decision-maker indicated whether to take or not take the gamble. In one analysis, we focused on how an experienced gain versus an experienced loss could modulate subsequent risky decision-making, both behaviorally and neurally. We found that subjects took more risk after losing a gamble than after winning a gamble. At the neural level, we again found that at the feedback stage, win was associated with stronger activation than loss in the anterior cingulate cortex, the posterior cingulate cortex, the ventral striatum, and the insula. More importantly, decisions after loss were associated with stronger activation in the frontoparietal network, which was positively correlated with individuals’ increased tendency to take more risk. These results thus suggest that experienced gains and losses not only involve different brain regions, but also trigger differential neural responses and behaviors in subsequent decisions.
Despite this suggested anatomical separation, the fact remains that the same structure, for example, the insula, has sometimes been implicated in the processing of both painful and pleasurable stimuli (e.g., Craig, 2009). Indeed, when compared to a baseline of activation following trials on which the decision-maker decided not to take the gamble, both experienced gains and losses elicited strong insular activation, which then modulated subsequent decision-making (Xue et al., 2010). This calls for caution when making absolute determination about the anatomical separation of these pleasure (gain)–loss (pain) systems. In particular, a proper baseline should be included in this analysis since the same regions might show opposite modulation by gains and losses (Tom et al., 2007). Thus, the stronger activation for gains or losses in some regions might not necessarily reflect distinct neural structures for gains and losses. Another reason for these difficulties in establishing absolute anatomical separations is that cellular physiological evidence of neurons responding to positive versus negative valence stimuli, at least within the amygdala, indicates separation, while anatomical evidence is highly inter-mixed (e.g., Paton et al., 2006). This explains why the neural systems for risky gains versus losses can be functionally separate, but finding clear-cut separation viewed at the global anatomical level is more difficult, given the proximity and overlap of these two systems.
Next, we turn to lesion studies which are smaller in number in terms of addressing this issue but which should align with the “anticipatory” fMRI studies because, of course, pre-existing brain damage would likewise serve to influence revealed choices. While neuroimaging studies argue whether a particular brain region is involved in a particular function, lesion studies test whether that brain region is necessary for that function, and thus form more direct tests of the model in Figure 1 and our earlier reference to anatomically separate neural substrates. The logic here is that if a particular function is impaired in individuals with a localized lesion, then the affected neural region must play a crucial role in executing that function. Lesion studies seem to reveal little dissociation between the domains of gains and losses within the prefrontal cortex region, but such dissociations are more likely to be revealed when one considers two other neural systems, the insula and amygdala, which feed information into the prefrontal cortex. Indeed, within the prefrontal cortex, patients with damage to the VMPFC show deficits for both risky gains and risky losses (Weller et al., 2007). Compared to healthy controls, VMPFC patients showed increased levels of risk-taking and decreased sensitivity to EV differences in both gain and loss domains. In contrast, amygdala patients showed impaired decision-making and exaggerated levels of risk-taking to achieve gains. However, in the loss domain amygdala damage was not associated with significantly increased risk-taking or decreased EV sensitivity. Given the abundance of literature suggesting that the amygdala is involved with avoidance of punishment, this finding suggests that other structures may act in concert with the amygdala to produce a signal that engages the VMPFC. When patients with insula damage were compared to controls, a different pattern emerged (Weller et al., 2009). Consistent with research suggesting that the insula is important for risk processing (Preuschoff et al., 2008), insula lesion patients like VMPFC and amygdala patients showed decreased sensitivity to EV differences between choice options for both risky gains and risky losses. However, these individuals showed lower levels of risk-taking compared to healthy controls, especially on gain trials. Thus the insula, with connections to the amygdala, ventral striatum, and the VMPFC, may serve the purpose of providing a “gate” to determine the effectiveness of excitatory and inhibitory motivational circuits, signaling approach or danger. Subsequently, insula damage may result in a blunted response toward risk, and would lead to insensitivity to changes in environmental contingencies signaling the approach or avoidance of a risk, regardless of domain.
Because the amygdala and insula have long been implicated in the processing of negative emotions, evoked from stimuli that are particularly aversive and perhaps even a threat to survival (e.g., LeDoux, 2000; Paulus and Stein, 2006; Phelps, 2006), we argue that these emotional reactions may be processed by multiple neural structures and are thus more difficult to disrupt as a result of a focal lesion to the amygdala or the insula alone3. Specifically, a person with a damaged amygdala but an intact insula can still make reasoned decisions in the domain of losses even when they cannot in the domain of gains. While a separation in processing gains and losses is achieved at the level of the amygdala versus insular cortex, the two neural systems may come closely together (and become more difficult to dissociate) by the time information reaches the prefrontal cortex, which responds similarly to risky gains and risky losses. Nevertheless, when considering the evidence from both insula and amygdala lesions, support for separate processes for risky decision-making in the gain and loss domains seems to emerge. Consistent with our model, the insula, in addition to its general role in processing risk, serves to especially aid in recruitment of the VMPFC to guide risky decisions in the more emotion-laden loss domain.
Summary and Conclusion
Taken individually, each of the neuroimaging and lesion studies reviewed here has its limitations. Lesion studies are limited to the small sample of available participants who meet the criteria of damage to a targeted area. Furthermore, some of those included may have collateral damage to other adjacent areas. fMRI studies also typically have small sample size due to financial and time constraints. Furthermore, the complexity and length of tasks that can be conducted in a scanner are limited. Also, because different studies focus on different areas (see Table 1), comparisons, and integration of findings can be difficult. Finally, for present purposes, the tasks used in the different studies differed in their ability to separate the gain and loss domains.
Nevertheless, we believe that we can provide a meaningful summary of the findings reviewed here. Behavioral studies suggest differences in decision-making for risky gains and risky losses. A study comparing different age groups suggests different developmental trajectories for risk-taking in the gain and loss domains. Neuroimaging studies are sometimes inconclusive in mapping brain systems to differential reactions to risky gains and losses. For example, while there is evidence that a system such as the VMPFC or the striatum is involved in both risky gains and losses, different parts of the system may be differentially sensitive to gains and losses (Xue et al., 2009). In such cases, the more general hypothesis of separate processes underlying risk-taking for gains and losses is still supported. With regard to the stricter hypothesis of separate structures, a breakdown of fMRI studies in Table 1 shows the strongest evidence for this hypothesis when recordings capture pre-decisional or anticipatory processes. We believe that the lesion studies provide the most direct evidence implicating separate structures.
Although a more detailed meta-analysis is clearly warranted, Table 1 shows that a wide variety of structures are involved in risky decision-making beyond those depicted in Figure 1. Nevertheless, we feel that the relatively simple depiction of the model represents a good start in capturing the different neurological underpinnings of risk-taking for gains and losses. The complementary roles of the VMPFC, amygdala, and insula depicted in the model are consistent with both the general hypothesis that separate processes underlie risk-taking for gains and losses, and the stricter hypothesis of separate neural structures coming together in different ways to guide risky decision-making in the gain and loss domains. In conclusion, we find that evidence of different neural responses underlying risk-taking for gains and losses favors the hypothesis that decision makers react differently to risky gains and losses, both in terms of overt risk-taking and neural activation.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
1Some definitions of risk include loss as a component. However, in order to incorporate risk-taking for gains and losses, we use a more general definition of risky choice as involving choice options of differing outcome variability. In the typical task described here, the choice is between a “sure thing” or “riskless” option with fixed outcome and a “risky” option with variable possible outcomes.
2Following Kahneman and Tversky (see Kahneman, 2003), most framing studies have employed between-subjects designs. However, it is important to note that reliable risky choice framing effects have been reported in within-subject designs where procedural precautions have been taken to avoid recognition of repeated problems by using multiple problems and presenting gain and loss versions of the same problem in separate sessions spaced widely apart (Levin et al., 2002). Emphasis in this paper will be on tasks involving actual gains and losses where separate gain and loss trials can be administered to the same decision makers without concern for consistency demands.
3It should be noted that redundancy has also been found in learning and memory systems, which allow learning to occur in multiple parallel memory systems; see Pinker and Ullman (2002) for an example of how multiple memory systems support the generation of verb past-tense.
References
- Bechara A., Damasio A. R. (2005). The somatic marker hypothesis: a neural theory of economic decision. Games Econ. Behav. 52, 336–372 10.1016/j.geb.2004.06.010 [DOI] [Google Scholar]
- Bechara A., Damasio A. R., Damasio H., Anderson S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7–15 10.1016/0010-0277(94)90018-3 [DOI] [PubMed] [Google Scholar]
- Bechara A., Damasio H., Damasio A. R., Lee G. P. (1999). Different contributions of the amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 19, 5473–5481 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bechara A., Damasio H., Tranel D., Damasio A. R. (1997). Deciding advantageously before knowing the advantageous strategy. Science 275, 1293–1295 10.1126/science.275.5304.1293 [DOI] [PubMed] [Google Scholar]
- Bechara A., Tranel D., Damasio H., Damasio A. R. (1996). Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. Cereb. Cortex 6, 215–225 10.1093/cercor/6.2.215 [DOI] [PubMed] [Google Scholar]
- Breiter H. C., Aharon I., Kahneman D., Dale A., Shizgal P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30, 619–639 10.1016/S0896-6273(01)00303-8 [DOI] [PubMed] [Google Scholar]
- Clark L., Bechara A., Damasio H., Aitken M. R. F., Sahakian B. J., Robbins T. W. (2008). Distinct patterns of risky decision-making in patients with lesions to ventromedial prefrontal cortex and insular cortex. Brain 131, 1311–1322 10.1093/brain/awn066 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Craig A. D. (2009). How do you feel – now? The anterior insula and human awareness. Nat. Rev. Neurosci. 10, 59–70 10.1038/nrn2606-c1 [DOI] [PubMed] [Google Scholar]
- Damasio A. R. (1994). Descartes’ Error: Emotion, Reason, and the Human Brain. New York, NY: Putnam [Google Scholar]
- Davidson R., Ekman P., Saron C., Senulis J., Friesen W. (1990). Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology I. J. Pers. Soc. Psychol. 58, 330–341 10.1037/0022-3514.58.2.330 [DOI] [PubMed] [Google Scholar]
- De Martino B., Kumaran D., Seymour B., Dolan R. J. (2006). Frames, biases, and rational decision-making in the human brain. Science 313, 684–687 10.1126/science.1128356 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fujiwara J., Tobler P. N., Taira M., Iijima T., Tsutsui K. I. (2009). Segregated and integrated coding of reward and punishment in the cingulate cortex. J. Neurophysiol. 101, 3284. 10.1152/jn.90909.2008 [DOI] [PubMed] [Google Scholar]
- Fukui H., Murai T., Fukuyama H., Hayashi T., Hanakawa T. (2005). Functional activity related to risk anticipation during performance of the Iowa gambling task. Neuroimage 24, 253–259 10.1016/j.neuroimage.2004.08.028 [DOI] [PubMed] [Google Scholar]
- Gottfried J. A., O’Doherty J., Dolan R. J. (2002). Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J. Neurosci. 22, 10829–10837 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hsu M., Bhatt M., Adolphs R., Tranel D., Camerer C. F. (2005). Neural systems responding to degrees of uncertainty in human decision-making. Science 310, 1680. 10.1126/science.1115327 [DOI] [PubMed] [Google Scholar]
- Huettel S. A., Song A. W., McCarthy G. (2005). Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J. Neurosci. 25, 3304–3311 10.1523/JNEUROSCI.5070-04.2005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huettel S. A., Stowe C. J., Gordon E. M., Warner B. T., Platt M. L. (2006). Neural signatures of economic preferences for risk and ambiguity. Neuron 49, 776–775 10.1016/j.neuron.2006.01.024 [DOI] [PubMed] [Google Scholar]
- Kahneman D. (2003). Perspective on judgment and choice: mapping bounded rationality. Am. Psychol. 58, 697–720 10.1037/0003-066X.58.9.697 [DOI] [PubMed] [Google Scholar]
- Kahneman D., Tversky A. (1979). Prospect theory – analysis of decision under risk. Econometrica 47, 263–291 10.2307/1914185 [DOI] [Google Scholar]
- Knutson B., Adams C. M., Fong G. W., Hommer D. (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 21, 159–164 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knutson B., Rick S., Wimmer G. E., Prelec D., Loewenstein G. (2007). Neural predictors of purchases. Neuron 53, 147–156 10.1016/j.neuron.2006.11.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knutson B., Wimmer G. E., Kuhnen C. M., Winkielman P. (2008a). Nucleus accumbens activation mediates the influence of reward cues on financial risk taking. Neuroreport 19, 509–513 10.1097/WNR.0b013e3282f85c01 [DOI] [PubMed] [Google Scholar]
- Knutson B., Wimmer G. E., Rick S., Hollon N. G., Prelec D., Loewenstein G. (2008b). Neural antecedents of the endowment effect. Neuron 58, 814–822 10.1016/j.neuron.2008.05.018 [DOI] [PubMed] [Google Scholar]
- Kuhnen C. M., Knutson B. (2005). The neural basis of financial risk taking. Neuron 47, 763–770 10.1016/j.neuron.2005.08.008 [DOI] [PubMed] [Google Scholar]
- LeDoux J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 2, 155–184 10.1146/annurev.neuro.23.1.155 [DOI] [PubMed] [Google Scholar]
- Levin I. P., Gaeth G. J., Schreiber J., Lauriola M. (2002). A new look at framing effects: Distribution of effect sizes, individual differences, and independence of types of effects. Organ. Behav. Hum. Decis. Process. 88, 411–429 10.1006/obhd.2001.2983 [DOI] [Google Scholar]
- Levin I. P., Weller J. A., Pederson A., Harshman L. A. (2007). Agerelated differences in adaptive decision making: sensitivity to expected value in risky choice. Judgm. Decis. Mak. 2, 225–233 [Google Scholar]
- Loewenstein G. F., Weber E. U., Hsee C. K., Welch N. (2001). Risk as feelings. Psychol. Bull. 127, 267–286 10.1037/0033-2909.127.2.267 [DOI] [PubMed] [Google Scholar]
- Matthews S. C., Simmons A. N., Lane S. D., Paulus M. P. (2004). Selective activation of the nucleus accumbens during risk-taking decision making. Neuroreport 15, 2123–2127 10.1097/00001756-200409150-00025 [DOI] [PubMed] [Google Scholar]
- Mellers B. A., Schwartz A., Ritov I. (1999). Emotion-based choice. J. Exp. Psychol. 128, 1–14 [Google Scholar]
- Mohr P. N. C., Biele G., Heekeren H. R. (2010). Neural processing of risk. J. Neurosci. 30, 6613–6619 10.1523/JNEUROSCI.0003-10.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Doherty J. P., Kringelbach M. L., Rolls E. T., Hornak J., Andrews C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95–102 10.1038/82959 [DOI] [PubMed] [Google Scholar]
- Paton J. J., Belova M. A., Morrison S. E., Salzman C. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865–870 10.1038/nature04490 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paulus M. P., Frank L. R. (2006). Anterior cingulate activity modulates nonlinear decision weight function of uncertain prospects. Neuroimage 30, 668–677 10.1016/j.neuroimage.2005.09.061 [DOI] [PubMed] [Google Scholar]
- Paulus M. P., Rogalsky C., Simmons A., Feinstein J. S., Stein M. B. (2003). Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage 19, 1439–1448 10.1016/S1053-8119(03)00251-9 [DOI] [PubMed] [Google Scholar]
- Paulus M. P., Stein M. B. (2006). An insular view of anxiety. Biol. Psychiatry 60, 383–387 10.1016/j.biopsych.2006.03.042 [DOI] [PubMed] [Google Scholar]
- Phelps E. A. (2006). Emotion and cognition: insights from studies of the human amygdala. Annu. Rev. Psychol. 57, 27–53 10.1146/annurev.psych.56.091103.070234 [DOI] [PubMed] [Google Scholar]
- Pinker S., Ullman M. T. (2002). The past and future of past tense. Trends Cogn. Sci. (Regul. Ed.) 6, 456–463 10.1016/S1364-6613(02)02013-2 [DOI] [PubMed] [Google Scholar]
- Plassmann H., O’Doherty J. P., Rangel A. (2010). Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J. Neurosci. 30, 10799. 10.1523/JNEUROSCI.0788-10.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preuschoff K., Quartz S. R., Bossaerts P. (2008). Human insula activation reflects risk prediction errors as well as risk. J. Neurosci. 28, 2745–2752 10.1523/JNEUROSCI.4286-07.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reimann M., Bechara A. (2010). The somatic marker framework as a neurological theory of decision-making: review, conceptual comparisons, and future neuroeconomic research. J. Econ. Psychol. 31, 767–776 10.1016/j.joep.2010.03.002 [DOI] [Google Scholar]
- Sanfey A. G., Rilling J. K., Aronson J. A., Nystrom L. E., Cohen J. D. (2003). The neural basis of economic decision-making in the ultimatum game. Science 300, 1755–1758 10.1126/science.1082976 [DOI] [PubMed] [Google Scholar]
- Seymour B., Daw N., Dayan P., Singer T., Dolan R. (2007). Differential encoding of losses and gains in the human striatum. J. Neurosci. 27, 4826–4831 10.1523/JNEUROSCI.0400-07.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Slovic P., Finucane M., Peters E., MacGregor D. (2002). “The affect heuristic,” in Heuristic and Biases: The Psychology of Intuitive Judgment, eds Gilovich T., Griffin D., Kahneman D. (New York, NY: Cambridge University Press; ), 397–420 [Google Scholar]
- Tobler P. N., Christopoulos G. I., O’Doherty J. P., Dolan R. J., Schultz W. (2009). Risk-dependent reward value signal in human prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 106, 7185. 10.1073/pnas.0809599106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tom S. M., Fox C. R., Trepel C., Poldrack R. A. (2007). The neural basis of loss aversion in decision-making under risk. Science 315, 515–518 10.1126/science.1134239 [DOI] [PubMed] [Google Scholar]
- Trepel C., Fox C. R., Poldrak R. A. (2005). Prospect theory on the brain? Toward a cognitive neuroscience of decisions under risk. Brain Res. Cogn. Brain Res. 23, 34–50 10.1016/j.cogbrainres.2005.01.016 [DOI] [PubMed] [Google Scholar]
- Tversky A., Kahneman D. (1992). Advances in prospect theory: cumulative representation of uncertainty. J. Risk Uncertain 5, 297–323 10.1007/BF00122574 [DOI] [Google Scholar]
- Weber E., Blais A., Betz N. (2002). A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J. Behav. Decis. Mak. 15, 263–290 10.1002/bdm.414 [DOI] [Google Scholar]
- Weller J. A., Levin I. P., Denburg N. (2011). Trajectory of risky decision making for potential gains and losses from age 5 to 85. J. Behav. Decis. Mak. 24, 331–344 10.1002/bdm.690 [DOI] [Google Scholar]
- Weller J. A., Levin I. P., Shiv B., Bechara A. (2007). Neural correlates of adaptive decision making for risky gains and losses. Psychol. Sci. 18, 958–964 10.1111/j.1467-9280.2007.02009.x [DOI] [PubMed] [Google Scholar]
- Weller J. A., Levin I. P., Shiv B., Bechara A. (2009). The effects of insula damage on decision-making for risky gains and losses. Soc. Neurosci. 4, 347–358 10.1080/17470910902934400 [DOI] [PubMed] [Google Scholar]
- Xue G., Lu Z., Levin I. P., Bechara A. (2010). The impact of prior risk experiences on subsequent risky decision-making: the role of the insula. Neuroimage 50, 709–716 10.1016/j.neuroimage.2009.12.097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xue G., Lu Z., Levin I. P., Bechara A. (2011). An fMRI study of risk-taking following wins and losses: implications for the gambler’s fallacy. Hum. Brain Mapp. 32, 271–281 10.1002/hbm.21015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xue G., Lu Z., Levin I. P., Weller J. A., Li X., Bechara A. (2009). Functional dissociations of risk and reward processing in the medial prefrontal cortex. Cereb. Cortex 19, 1019–1027 10.1093/cercor/bhn147 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yacubian J., Gläscher J., Schroeder K., Sommer T., Braus D. F., Büchel C. (2006). Dissociable systems for gain-and loss-related value predictions and errors of prediction in the human brain. J. Neurosci. 26, 9530–9537 10.1523/JNEUROSCI.2915-06.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]