Abstract
Even a single night of total sleep deprivation (SD) can have dramatic effects on economic decision making. Here we tested the novel hypothesis that SD influences economic decisions by altering the valuation process. Using functional magnetic resonance imaging we identified value signals related to the anticipation and the experience of monetary and social rewards (attractive female faces). We then derived decision value signals that were predictive of each participant’s willingness to exchange money for brief views of attractive faces in an independent market task. Strikingly, SD altered decision value signals in ventromedial prefrontal cortex (VMPFC) in proportion to the corresponding change in economic preferences. These changes in preference were independent of the effects of SD on attention and vigilance. Our results provide novel evidence that signals in VMPFC track the current state of the individual, and thus reflect not static but constructed preferences.
Keywords: sleep deprivation, decision making, reward, valuation, VMPFC
Introduction
A single night of total sleep deprivation (SD) can result in a host of neurocognitive consequences (Goel et al., 2009). Most comprehensively studied have been impairments in vigilance and attention (Lim and Dinges, 2010). Considerably less is known about how SD influences affective processes (Walker, 2009), for example, those engaged during decision making (Harrison and Horne, 1999; Killgore et al., 2006; McKenna et al., 2007; Venkatraman et al., 2007). Studies to date have evaluated risky decisions using the Iowa Gambling Task (Killgore et al., 2006), risky and ambiguous decision making tasks (McKenna et al., 2007; Venkatraman et al., 2007, 2011), and the Balloon Analog Risk Task (Killgore et al., 2011). Increased propensity to take risks has been observed in some of these studies and an intriguing possibility is that SD affects decision making by influencing the very values that underlie our decisions. Investigating this potential mechanism would benefit from measuring the neural correlates of reward valuation without involving decision making.
Recent studies suggest that decision preferences reflect the subjective valuation of different goods that have been converted into a standard signal, or “common neural currency” (Montague and Berns, 2002; Izuma et al., 2008; Kim et al., 2010; Rademacher et al., 2010; Smith et al., 2010). This common neural currency enables individuals to make decisions about nominally incommensurable rewards, as when sacrificing a physical or monetary good to obtain a desirable social interaction (Smith et al., 2010; Lin et al., 2011). Such common valuation signals have been demonstrated in ventromedial prefrontal cortex (VMPFC), through correlative techniques such as functional magnetic resonance imaging (fMRI) and single-unit recording (Padoa-Schioppa and Assad, 2006, 2008; Chib et al., 2009; Padoa-Schioppa, 2009; Kim et al., 2010; Smith et al., 2010). One limitation of the extant research is that nearly all studies manipulate value by changing the stimuli about which individuals make decisions (e.g., comparing high- and low-valued items). Yet, in the real-world, our valuation of an outcome depends both on its intrinsic features and on our current state. SD provides an ideal milieu for testing state-dependent changes in valuation: it allows for fully within-participant testing, it has no effects on the actual value of economic goods (unlike presenting food items under states of satiation and hunger), and it represents a common and ecologically relevant state that nearly all individuals experience at some time in their lives.
We hypothesized that SD can alter valuation and perturb the neural common currency for value as reflected by VMPFC activation. This hypothesis stems from the observation that VMPFC activation was altered during risky decision making when sleep deprived (Venkatraman et al., 2011). In turn, these changes in decision value signals would be expected to be commensurate with shifts in valuation of different reward types – demonstrating that VMPFC plays an important role in coding a common currency signal. This second prediction stems from observing that SD also affects activation of regions involved in emotional processing (Yoo et al., 2007; Gujar et al., 2011). We used an incentive delay task in which participants anticipated and then received rewards that had either monetary value or social value [e.g., pictures of faces of varying attractiveness (Aharon et al., 2001; Figure 1A)]. Following the scanner session, we measured each subject’s willingness to sacrifice money to view attractive faces (Smith et al., 2010; Figure 1B). This procedure was motivated by evidence that signals reflecting subjective value can be elicited by incentive-compatible stimuli even in the absence of overt decision making (Lebreton et al., 2009; Smith et al., 2010; Tusche et al., 2010). The measurement of these brain signals provides a neural marker for subjective value independent of the effects of SD on decision making (Venkatraman et al., 2007). We anticipated that changes in an individual’s relative willingness to trade social and monetary rewards following SD would be correlated with a corresponding alteration of neural signals corresponding with their valuation. Such a result would provide evidence that SD affects more than attentional and cognitive inputs to a decision – it shapes the very mechanisms of valuation that underlie economic preferences.
Another issue we examine here is whether SD-related changes in valuation correlate with alterations in vigilance (Venkatraman et al., 2011). If SD can result in decoupling of some cognitive and affective processes, it would caution us against expecting that countermeasures effective for one behavioral domain would also benefit other domains (Killgore et al., 2009).
Materials and Methods
Participants
Twenty-two healthy adult males (mean age = 22.7 years, SD = 3.2 years), self-reported as heterosexual, participated in the study. All participants provided informed consent, in compliance with the requirements of the National University of Singapore Institutional Review Board. Participants were selected from a pool of university students who responded to a web-based questionnaire. They had to be right-handed, be between 18 and 30 years of age, not be on any long-term medication, and have no history of any psychiatric or neurologic disorders. They also had to have habitually good sleeping habits (sleeping no less than 6.5 h each night for the past 1 month) and have no symptoms associated with sleep disorders. Participants’ sleep habits were monitored throughout the 2-week duration of the study with an Actiwatch (Philips Respironics, USA). Only participants who maintained a regular sleep schedule (>6.5 h of sleep/night; sleep time no later than 1:00 AM; wake time no later than 9:00 AM) for the week prior to each fMRI scanning session were included in the study. Four participants were removed from the analysis: one for excessive motion during the scan, and three for failure to perform the task appropriately during the SD session. All participants indicated that they did not smoke, consume any medications, stimulants, caffeine, or alcohol for at least 24 h prior to scanning.
Study procedures
Participants visited the laboratory three times. During the first visit, they were briefed on the study protocol. At the end of this session, they were each given a wrist actigraph, which they were instructed to wear at all times until the conclusion of the experiment. They were also issued sleep diaries on which they recorded the onset and offset of all sleep bouts. The second and third visits (one rested wakefulness, RW session and one SD session) involved the actual in-scanner fMRI experiments. The order of the two sessions was counterbalanced across all the participants and the sessions were separated by 1 week to minimize residual effects of sleep loss in participants whose SD session preceded the RW session.
The first scanning session took place approximately 1 week after the initial visit. For the RW session, scanning commenced at about 8:00 AM. For the SD session, scanning took place at about 6:00 AM, but participants were monitored in the lab from 7:00 PM onward the night before. They remained awake overnight under the constant supervision of a research assistant and were allowed to engage in non-strenuous activities such as reading and watching videos. Participants completed the psychomotor vigilance task (Dinges et al., 1997) and rated their subjective sleepiness using the Karolinska Sleepiness Scale (Akerstedt and Gillberg, 1990) during the first 10 min of every hour from 7:00 PM until 6:00 AM.
Behavioral tasks
Monetary and social incentive delay task
Participants were scanned while performing an adaptation of the monetary incentive delay task (Knutson et al., 2001; Clithero et al., 2011; Figure 1A). Participants responded as fast as possible to a white square (target). Each target was preceded (between 2 and 2.7 s) by a visual cue (0.5 s) that signaled either a monetary or social reward (presented for 1.5 s) that could be obtained if the response to the upcoming target was fast enough (hit trials). Reaction time threshold was dynamically titrated using information about response times on previous similar trials to adjust the threshold such that on average 60% of the responses resulted in receipt of the reward (Knutson et al., 2001). Eight different visual cues predicted the eight possible rewards: three monetary rewards ($1, $5, and $10), three social rewards (1-star, 3-star, 5-star), and two control cues, one monetary ($0) and one social (0-star, where a scrambled picture of a face was presented). These cues were semi-randomly intermixed in the course of a run. A higher number of stars signaled that a picture of a more attractive female face would be seen.
To establish the attractiveness categories, an independent group of 30 male heterosexual volunteers viewed 5000 pictures of female faces and rated them on a five-point scale. All images were obtained from publicly accessible local dating websites, and the ethnicity proportions matched those of Singapore’s population. We used headshots and did not remove the hair. The average rating of each face was then used to re-bin the face ratings into six categories. The least attractive faces were then discarded as they might elicit aversive responses. Faces belonging to the other five categories were classified from 1-star to 5-star. Faces belonging to the 1, 3, and 5-star categories were used as social rewards. The control cue was constructed by scrambling the pixels of a random picture.
Each scanning session consisted of one in-scanner practice run followed by six runs. Each run consisted of 56 trials: seven semi-randomly intermixed repetitions of each of the eight possible rewards. Intertrial intervals had a uniform distribution between 1.8 and 4.5 s. At the end of the last session subjects received the amount of money earned in two randomly selected runs of the 12 they performed.
Participants viewed stimuli through a set of MR-compatible LCD goggles (Resonance Technology, Los Angeles, USA). Further, they responded to the task using their right hand via a MR-compatible button box. A research assistant monitored participants’ performance throughout the session and noted all lapses and eye closures through use of an eye tracking device. Participants were prompted to attend to the task through an intercom system when they failed to respond to a trial or when epochs of eye closure exceeded 3 s.
Exchange task
After each scanning session participants performed a two-alternative force choice task, in which they had to spend money to view a social reward (female face). On each trial, participants were presented with two options – two different star ratings (1- to 5-stars) each paired with a monetary amount (price tag: 1–12 cents). After making a choice between the two offers participants would view a picture of a female face of the star category they chose (2 s) and pay the monetary amount equal to the number of cents in the price tag. More stars were always paired with a more expensive price tag. Money spent in the exchange task was deducted from each participant’s total compensation.
Face-rating task
Following the exchange task, participants rated the attractiveness of female faces from one to five (one being least attractive and five being most attractive). The faces that were rated all appeared previously in the incentive delay task.
Imaging Procedures
Images were acquired on a 3-T Siemens Tim Trio scanner (Siemens, Erlangen, Germany) fitted with a 12-channel head coil. A high-resolution 3D-MEMPRAGE (Multi-Echo Magnetization-Prepared Rapid-Acquisition Gradient Echo) sequence was obtained so that anatomical images could be normalized into common stereotactic space. Functional images were collected using a gradient echo-planar imaging sequence (TR: 1500 ms; TE: 20 ms; flip angle: 90°; field-of-view: 192 mm × 192 mm; matrix size: 64 × 64). We acquired 34 oblique axial slices (4 mm thick with no inter-slice gap) parallel to the line connecting the anterior and posterior commissures, resulting in whole-brain coverage.
Behavioral data analysis
Exchange task
A trial was considered an exchange if the subject chose the more expensive (and more attractive face) out of the two options. In other words, an exchange meant that the subject was willing to spend money to view a more attractive face. For each subject (and each state: RW and SD) we calculated the proportion of exchange trials. We then calculated for each subject the difference between the proportions of exchanges between both states (RW minus SD; Figure 2B).
Face-rating task
Ratings were first converted to z-score, and then we calculated for each subject (and each state: RW and SD) the average difference between their ratings and the ratings of independent group of participants. For each subject, we calculated the difference between the ratings in both states (RW minus SD).
Imaging data analysis
The MRI data were analyzed using BrainVoyager QX 1.10.1 (Brain Innovation, Maastricht, The Netherlands) and MATLAB (MathWorks, Natick, USA). Inter-slice timing differences within each functional acquisition were corrected using cubic spline interpolation. Intra-session image alignment to correct for motion was performed using the first image of the first functional run as the reference image. Spatial filtering employed a Gaussian filtering kernel with a 6-mm FWHM for group level activation maps. Linear trend removal and a high-pass filter of 160s were applied to compensate for scanner drifts. Functional volumes were registered to the high-resolution 3D anatomical image. Finally, all images were normalized to Talairach space.
Functional analysis at a voxel-by-voxel-level was performed using a general linear model (GLM) with a total of 24 predictor variables (regressors) in each state (RW, SD). Eight regressors were created for the different cues ($0, $1, $5, $10, 0-star, 1-star, 3-star, 5-stars) of unit amplitude response with 0.5 s duration following the onset of the cue and 16 regressors for the different outcomes (hit or miss) of unit amplitude response with 1.5 s duration following the onset of the outcome. Two additional models were created that included parametric regressors for either anticipation or outcome of rewards, with all other events modeled as nuisance regressors. Parametric regressors included $1, $5, and $10 for monetary rewards and 1-star, 3-star, and 5-star for social rewards. Control rewards – $0 and 0-star, were added as nuisance regressors. Each regressor was convolved with a hemodynamic response function. A voxel-level threshold of at least p < 0.001 (uncorrected) for t-maps was applied. To control for Type I error, remaining voxels were then processed using an iterative cluster size thresholding procedure (Goebel et al., 2006) that considered the spatial smoothness of functional imaging data when generating activation maps based on a corrected cluster threshold (p < 0.05).
To identify brain regions with decision value signals, we performed a whole-brain correlation analysis between exchange rate and the difference in parameter estimates of parametric regressors of social and monetary rewards. This “decision value” signal was computed separately for the cue and outcome-hit periods and also separately for each state. Correlation maps were thresholded (p < 0.05) and cluster corrected (p < 0.05). The conjunction of regions identified in RW and SD were used as ROIs for further analysis. For further details on the rationale for using subjects’ preferences in the exchange task to look at neural measures of decision value (in the absence of choice) see Smith et al. (2010).
We performed a whole-brain correlation analysis between the difference in decision value signal in VMPFC (RW minus SD) and the difference in parameter estimates of parametric regressors during cue or outcome-hit periods for both monetary and social rewards. Correlation maps were masked using the union of parametric response in RW and SD for the specified period (anticipation or receipt phases) and reward type. Correlation maps were thresholded (p < 0.05) and cluster corrected (p < 0.05).
Results
Behavioral results
The reward value of an item influences the effort expended in acquiring it (Bickel et al., 1992; Aharon et al., 2001). In the Incentive Delay Task (see Materials and Methods), increasing effort is reflected in shorter response times. Three factors were expected to influence response times: behavioral state (SD or RW), reward modality (social or money), and reward magnitude (high, medium, low).
Consistent with prior work, a three-way ANOVA showed a significant interaction between reward type and reward magnitude [F(3,54) = 35.18, p < 0.001; Figure 2A]. A two-way ANOVA of reaction time for monetary rewards showed significant main effects of reward magnitude [F(2,17) = 23.07, p < 0.001] and state [F(1,17) = 6.61), p < 0.05] on response time but no interaction between these factors [F(2,17) = 2, n.s.]. Similarly, for social rewards there were significant main effects of reward magnitude [F(2,17) = 10.89, p < 0.001] and state [F(1,17) = 8.65, p < 0.01] on response times without significant interaction between reward and state [F(2,17) = 0.27, n.s.]. These findings formed the behavioral basis for the identification of brain regions involved in the valuation of monetary and social rewards.
The relative valuation of social and monetary rewards was ascertained by analyzing decisions in the Exchange Task. Following a normal night of sleep (RW), participants ranged from being unwilling to exchange money to view an attractive face, to exchanging in over 90% of the trials (Figure 2B). Although the average exchange rate did not differ across the two sessions – the mean exchange rate being 24.9% in RW and 24.0% in SD [t(17) = 0.62, n.s.] – individual participants showed a range of alterations in willingness to exchange money to view attractive faces, with some participants exchanging more and some exchanging less following SD (Figure 2B).
The heterogeneous alteration in exchange behavior following SD may be the result of random fluctuation in choices rather than a systematic alteration of preferences. To rule out this possibility, we examined the consistency of exchange rates across runs within the same session. Within-session exchange rates were similarly consistent across both states (ICC of 0.939 for RW and 0.936 for SD), arguing against increased randomness in choices following SD. As a control experiment, we recruited an additional independent group of participants to perform the exchange task twice in RW. Consistent with the expectation that SD was the source of altered exchange behavior, we found the variance associated with RW–SD exchanges to be larger than the variance associated with RW–RW exchanges (Levene test, F = 4.58, p < 0.05, Figure 2C). Finally, order of sessions could not explain the shifts in exchange rate [t(17) = −1.56, n.s.].
To ascertain whether SD prompted alteration in exchange behavior by shifting the perceived (social) value of attractive faces, we had subjects rate faces for attractiveness in both states. We found strong correlation between the state-driven alteration in exchange rates between RW and SD and the corresponding difference in attractiveness ratings (r = 0.84, p < 0.001; Figure 2D).
Finally, if participants altered their valuation of social, but not monetary, rewards in a consistent manner during SD, we would expect this to be reflected in the reaction times during the Incentive Delay Task. Indeed, the SD-induced change in exchange rate was significantly correlated with a corresponding change in reaction time for the higher levels of social reward – 5-star and 3-star faces (r = 0.48; p < 0.05) – but not for control cues, 1-star faces, or monetary rewards (r < 0.26; n.s., Figure 2E). Taken together, these behavioral findings suggest that the shift in exchange rates elicited by SD were a consequence of altered valuation of social as opposed to monetary rewards.
Additionally, altered psychomotor vigilance (Dinges et al., 1997), as evidenced by increased RT during SD [RW: 242 ms, SD: 291 ms; t(17) = 6.5, p < 0.001], did not correlate with alteration of exchange behavior (r = −0.04; n.s.). This result concurs with a prior finding that vigilance and the propensity to make gain-maximizing decisions are uncorrelated (Venkatraman et al., 2011).
Imaging results
Effects of SD on processing of monetary and social rewards
Brain regions carrying decision value signals related to the exchange of monetary for social rewards were identified as those where an individual’s willingness to exchange money to view attractive faces correlated with the corresponding difference in MR signal associated with the receipt of social and monetary rewards. A region in the VMPFC (Figure 3A) was found to carry such decision value signals in both RW and SD (Figure 3B). Of specific interest, SD-driven alteration in exchange rates correlated with SD-driven alteration of decision value signal in the VMPFC (r = 0.58, p < 0.01, Figure 3C).
To evaluate signals associated with the processing of the monetary and social reward value, we first identified voxels that showed parametric increase in activation with reward size (Tables 1 and 2). We then determined whether SD-related alteration of decision value signals in VMPFC correlated with signal change associated with the processing of monetary or social rewards. We found significant correlation between SD-related signal shifts (comparison of RW and SD) associated with the receipt of social rewards and the corresponding alteration in decision value signals in VMPFC. Regions showing such correlation were: left amygdala (r = 0.53, p < 0.05; Figure 4A), frontal pole (r = 0.54, p < 0.05; Figure 4B), left putamen (r = 0.49, p < 0.05; Figure 4C), and left anterior insula (r = 0.52, p < 0.05; Figure 4D; Table 3).
Table 1.
Region | BA | Talairach | t-Value | Cluster size | ||
---|---|---|---|---|---|---|
x | y | z | ||||
MONETARY REWARD ANTICIPATION | ||||||
R. frontal BA10 | 10 | 33 | 51 | 28 | 5.8 | 3958 |
L. frontal BA10 | 10 | −35 | 47 | 25 | 6.8 | 3895 |
R. ACC BA32 | 32 | 6 | 27 | 32 | 8.1 | 4733 |
L. ACC BA32 | 32 | −8 | 21 | 30 | 8 | 2795 |
R. SMA BA6 | 6 | 4 | 4 | 49 | 7.1 | 8259 |
L. SMA BA6 | 6 | −7 | 1 | 48 | 7.5 | 6490 |
R. FEF BA9 | 9 | 41 | 1 | 35 | 5.4 | 828 |
L. FEF BA9 | 9 | −47 | −9 | 46 | 4.6 | 206 |
R. insula BA13 | 13 | 34 | 17 | 6 | 6.9 | 5904 |
L. insula BA13 | 13 | −32 | 17 | 2 | 7.7 | 8388 |
R. NAcc | 11 | 4 | −2 | 5.3 | 242 | |
L. NAcc | −12 | 2 | −5 | 5.5 | 494 | |
R. dorsal striatum | −17 | 6 | 4 | 7.5 | 6070 | |
L. dorsal striatum | 17 | 4 | 8 | 6.1 | 5526 | |
VTA | 0 | −20 | −8 | 4.8 | 334 | |
R. thalamus | 9 | −14 | 4 | 7.2 | 4661 | |
L. thalamus | −9 | −16 | 2 | 5.7 | 3039 | |
R. parietal | 40 | 51 | −41 | 33 | 7.2 | 6373 |
L. parietal | 40 | −54 | −39 | 32 | 6 | 1758 |
L. parietal | 3 | −19 | −25 | 58 | 5.2 | 1358 |
R. parietal | 3 | 14 | −30 | 57 | 4.6 | 283 |
R. precuneus | 7 | 13 | −62 | 27 | 6.7 | 3801 |
L. precuneus | 7 | −11 | −66 | 29 | 5 | 1394 |
R. middle temporal gyrus | 22 | 52 | −33 | 2 | 5.1 | 515 |
R. visual cortex BA18 | 18 | 16 | −70 | −4 | 5.8 | 5510 |
L. visual cortex BA18 | 18 | −19 | −72 | −8 | 8 | 7518 |
Cerebellar vermis | −1 | −54 | −12 | 5.4 | 530 | |
MONETARY REWARD RECEIPT | ||||||
R. SFG | 9 | 18 | 56 | 25 | 5.2 | 35 |
R. ACC | 24 | 1 | 34 | 15 | 4.3 | 15 |
Table 2.
Region | BA | Talairach | t-Value | Cluster size | ||
---|---|---|---|---|---|---|
x | y | z | ||||
SOCIAL REWARD ANTICIPATION | ||||||
L. OFC BA11 | 11 | −22 | 44 | −7 | 4.91 | 23 |
L. ACC BA32 | 32 | −2 | 31 | 30 | 4.6 | 43 |
R. insula BA13 | 13 | 36 | 11 | 9 | 6.62 | 173 |
R. dSTR | 16 | 4 | 10 | 5.11 | 73 | |
R. SMA | 6 | 4 | 5 | 55 | 5.1 | 161 |
L. thalamus | −3 | −5 | 4 | 4.6 | 56 | |
L. thalamus | −9 | −8 | 0 | 5.98 | 143 | |
R. thalamus | 13 | −12 | −2 | 5.5 | 135 | |
VTA | 1 | −20 | −4 | 5.73 | 292 | |
R. thalamus posterior | 21 | −25 | 0 | 4.45 | 8 | |
L. thalamus posterior | −22 | −30 | −2 | 4.5 | 51 | |
R. visual cortex | 18 | 14 | −78 | 9 | 8.24 | 13328 |
L. visual cortex | 18 | −17 | −80 | 4 | 9.31 | 11070 |
SOCIAL REWARD RECEIPT | ||||||
L. MFG | 10 | −5 | 56 | 3 | 4.91 | 780 |
L. SFG | 9 | −5 | 45 | 33 | 4.68 | 113 |
VMPFC | ? | −1 | 41 | −5 | 4.76 | 451 |
ACC | 32 | −6 | 39 | 19 | 5 | 24 |
L. IFG | 13 | −34 | 13 | −13 | 4.96 | 63 |
L. putamen | −23 | 12 | −4 | 5.26 | 135 | |
L. DCC | 24 | −2 | 8 | 27 | 4.49 | 67 |
L. amygdala | −23 | 5 | −13 | 5.94 | 205 | |
R. amygdala | 18 | 3 | −12 | 4.22 | 8 | |
R. visual | 17 | 18 | −94 | 2 | 4.42 | 18 |
Table 3.
Region | BA | Talairach | Max r-value | Cluster size (1 mm3 voxel) |
||
---|---|---|---|---|---|---|
x | y | z | ||||
Frontal pole | 10 | −7 | 52 | 10 | 0.634 | 435 |
L. amygdala | −23 | 0 | −13 | 0.747 | 210 | |
L. anterior insula | 13 | −30 | 13 | −8 | 0.599 | 36 |
L. putamen | −23 | 12 | −3 | 0.578 | 103 |
These areas were a subset of regions showing a parametric response to social rewards.
In contrast, we found no significant correlation between SD-related change in monetary reward signals and the corresponding alteration of decision value signals in VMPFC. There were also no significant associations in the corresponding analyses related to the anticipation of social or monetary rewards.
Discussion
We found that SD alters decision value signals in VMPFC in a manner consistent with state-dependent changes in economic preference. This alteration in decision value signals appears to be driven by neural changes in processes underlying the valuation of the social rewards in this task. Finally, we found that these effects of SD on economic preferences were uncorrelated with its effects on vigilance.
SD affects decision value and social reward signals
Previous studies have suggested that, during decision making, the values of different actions under consideration are converted into signals that can be compared within the VMPFC to select the action with the highest overall benefit (Rangel and Hare, 2010; Smith and Huettel, 2010). The critical evidence in support of this conjecture – previously absent from the literature – would be the manipulation of a participant’s state in a manner that causes idiosyncratic changes in valuation, then leads to concomitant changes in VMPFC activation. Such a result would be consistent with the idea that VMPFC signals are associated with constructed preferences. We found such evidence in the current study: a significant correlation between SD-related shift in behavioral measures of decision value and their corresponding BOLD signals in the VMPFC (Figures 3A,C).
We next tested the hypothesis that the observed change in decision value signals during SD originates from altered valuation of different goods. Previous studies have shown that monetary and social rewards are processed in separate, but overlapping brain regions (Spreckelmeyer et al., 2009; Rademacher et al., 2010; Smith et al., 2010). Changes in decision value signals in VMPFC could thus originate in brain regions involved in assigning value to the different rewards under consideration. Altered inputs from these regions would then be integrated in the VMPFC, resulting in shifts in signals that reflect the observed shifts in neural valuation signals. In support of this line of reasoning, we found that changes in decision value signals in VMPFC correlated with changes in signals elicited by social rewards during the incentive delay task in the amygdala, frontal pole, left putamen, and anterior insula. These structures have been proposed to belong to a network supporting motivation and reward processing (Craig, 2009; Gujar et al., 2011). Of particular interest is the result observed in the amygdala, given its known role in social reward processing as well as its interactions with VMPFC (Price, 2003; Yoo et al., 2007).
One limitation of this study concerns the generalizability of the results. It is possible that other types of reward, such as food or sex, could be differently affected by SD. Furthermore, the observed lack of effect of SD on monetary rewards could be dependent on context as well as reward attributes, such as the magnitude, uncertainty, or delay of the offers.
The neural correlates of monetary and social reward valuation
While we observed activation associated with valuation of monetary and social rewards consistent with prior studies (Aharon et al., 2001; Knutson et al., 2001; O’Doherty et al., 2003; Winston et al., 2007; Rademacher et al., 2010; Smith et al., 2010), we observed ventral striatal activation only during anticipation of monetary rewards, not during anticipation of social rewards. This dissociation might be the product of differences in the rewarding value of the social stimuli used in this study compared to those used in previous studies. Although viewing attractive faces of the opposite sex serves as a social reward (Aharon et al., 2001; O’Doherty et al., 2003; Hayden et al., 2007; Winston et al., 2007; Smith et al., 2010), other types of social interactions may be even more potent. As examples, both receiving social approval signals (Spreckelmeyer et al., 2009; Davey et al., 2010; Rademacher et al., 2010) and donating money to charities (Harbaugh et al., 2007; Carter et al., 2009) have been shown to activate the ventral striatum.
An alternative explanation is that mixing social and monetary rewards within the same run affects the signals associated with social rewards. Social rewards used in this experiment were lower-valued than monetary reward as evidenced by the relatively slower RTs elicited by social rewards. As social and monetary rewards were intermixed in the same runs, the certain anticipation of receiving a (relatively lower-valued) social reward as opposed to monetary reward might have in turn attenuated the value of social cues (Nieuwenhuis et al., 2005; Seymour and McClure, 2008), leading to a different result from that reported when social and monetary rewards appeared in separate runs (Rademacher et al., 2010).
Inter-individual differences in the effects of SD on different facets of behavior
Previous studies have shown the utility of fMRI in augmenting such behavioral assessments of inter-individual variation in vulnerability to SD (Venkatraman et al., 2007). Correlations between behavioral and neural changes under SD have been found in studies involving working memory (Bell-McGinty et al., 2004; Habeck et al., 2004; Lim et al., 2007), visual short-term memory (Chee and Chuah, 2007), episodic memory (Chuah et al., 2009), and selective attention (Chee et al., 2010).
Here, the correlation between state-related alterations in exchange rate and fMRI signal in the amygdala, frontal pole, dorsal striatum, and anterior insula is in agreement with prior work concerning the generation of reward value signals (Baxter and Murray, 2002; O’Doherty et al., 2003; Winston et al., 2007) adding to the neuroanatomical markers that can be used to augment behavioral assessment of state-induced alteration of behavior.
Following SD participants showed individual differences in their willingness to exchange money to view attractive faces. Across-individuals variation in the manner in which SD alters behavior would be of considerable practical relevance (e.g., to determine relative suitability for tasks requiring extreme durations of sustained wakefulness). Previous work has shown that the inter-individual differences in the effects of SD on attention, executive function, and speed of processing are not random, but rather trait-like (Leproult et al., 2003; Van Dongen et al., 2004). Whether the effects of SD on social reward valuation are trait-like remains to be determined, but we did replicate the observation that decision making signals and behavior are altered by SD in a manner that is not correlated with changes in vigilance (Venkatraman et al., 2011). These two independently obtained results warn that a single test in sleep deprived persons is unlikely to predict how SD alters behavior in all domains. As a real-world example, a person who appears to be an ideal operative for all-night missions cannot be assumed to make the same kind of value judgments while sleep deprived as when fully rested.
Conclusion
We have shown that the VMPFC, a region that integrates valuation signals for different rewards into a common scale, demonstrates a shift in activation commensurate with shift in behavior across states. This strengthens the notion that VMPFC is involved in value comparisons during economic decision making independent of state. Additionally, regions involved in social reward valuation, such as the amygdala, alter their responses to social rewards during SD in a manner that is correlated with the shift in decision value signals in VMPFC. This suggests that the changes in VMPFC activation could be the result of state-related alteration of inputs from the amygdala and other regions mediating affective processes.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Annette Chen, Shuwei Koh, and Jack De Havas for collecting data. This work was supported by the Defense Science and Technology Agency, Singapore (POD 00713897), by National Research Foundation STaR Award (0004/2008), by an Incubator Award from the Duke Institute for Brain Sciences (Scott A. Huettel), by NIMH RC1-088680 (Scott A. Huettel), and by NIMH National Research Service Award F31-086248 (David V. Smith).
References
- Aharon I., Etcoff N., Ariely D., Chabris C. F., O’Connor E., Breiter H. C. (2001). Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron 32, 537–551 10.1016/S0896-6273(01)00491-3 [DOI] [PubMed] [Google Scholar]
- Akerstedt T., Gillberg M. (1990). Subjective and objective sleepiness in the active individual. Int. J. Neurosci. 52, 29–37 10.3109/00207459008994241 [DOI] [PubMed] [Google Scholar]
- Baxter M. G., Murray E. A. (2002). The amygdala and reward. Nat. Rev. Neurosci. 3, 563–573 10.1038/nrn875 [DOI] [PubMed] [Google Scholar]
- Bell-McGinty S., Habeck C., Hilton H. J., Rakitin B., Scarmeas N., Zarahn E., Flynn J., DeLaPaz R., Basner R., Stern Y. (2004). Identification and differential vulnerability of a neural network in sleep deprivation. Cereb. Cortex 14, 496–502 10.1093/cercor/bhh011 [DOI] [PubMed] [Google Scholar]
- Bickel W. K., Hughes J. R., DeGrandpre R. J., Higgins S. T., Rizzuto P. (1992). Behavioral economics of drug self-administration. IV. The effects of response requirement on the consumption of and interaction between concurrently available coffee and cigarettes. Psychopharmacology (Berl.) 107, 211–216 10.1007/BF02245139 [DOI] [PubMed] [Google Scholar]
- Carter R. M., Macinnes J. J., Huettel S. A., Adcock R. A. (2009). Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses. Front. Behav. Neurosci. 3:21. 10.3389/neuro.08.021.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chee M. W. L., Chuah Y. M. L. (2007). Functional neuroimaging and behavioral correlates of capacity decline in visual short-term memory after sleep deprivation. Proc. Natl. Acad. Sci. U.S.A. 104, 9487–9492 10.1073/pnas.0610712104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chee M. W. L., Tan J. C., Parimal S., Zagorodnov V. (2010). Sleep deprivation and its effects on object-selective attention. Neuroimage 49, 1903–1910 10.1016/j.neuroimage.2009.08.067 [DOI] [PubMed] [Google Scholar]
- Chib V. S., Rangel A., Shimojo S., O’Doherty J. P. (2009). Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J. Neurosci. 29, 12315–12320 10.1523/JNEUROSCI.2575-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chuah L. Y. M., Chong D. L., Chen A. K., Rekshan W. R., III, Tan J. C., Zheng H., Chee M. W. (2009). Donepezil improves episodic memory in young individuals vulnerable to the effects of sleep deprivation. Sleep 32, 999–1010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clithero J. A., Reeck C., Carter R. M., Smith D. V., Huettel S. A. (2011). Nucleus accumbens mediates relative motivation for rewards in the absence of choice. Front. Hum. Neurosci. 5:87. 10.3389/fnhum.2011.00087 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Craig A. D. (2009). How do you feel – now? The anterior insula and human awareness. Nat. Rev. Neurosci. 10, 59–70 10.1038/nrn2606-c1 [DOI] [PubMed] [Google Scholar]
- Davey C. G., Allen N. B., Harrison B. J., Dwyer D. B., Yücel M. (2010). Being liked activates primary reward and midline self-related brain regions. Hum. Brain Mapp. 31, 660–668 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dinges D. F., Pack F., Williams K., Gillen K. A., Powell J. W., Ott G. E., Aptowicz C., Pack A. I. (1997). Cumulative sleepiness, mood disturbance, and psychomotor vigilance performance decrements during a week of sleep restricted to 4-5 hours per night. Sleep 20, 267–277 [PubMed] [Google Scholar]
- Goebel R., Esposito F., Formisano E. (2006). Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum. Brain Mapp. 27, 392–401 10.1002/hbm.20249 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goel N., Rao H., Durmer J. S., Dinges D. F. (2009). Neurocognitive consequences of sleep deprivation. Semin. Neurol. 29, 320–339 10.1055/s-0029-1237117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gujar N., Yoo S. S., Hu P., Walker M. P. (2011). Sleep deprivation amplifies reactivity of brain reward networks, biasing the appraisal of positive emotional experiences. J. Neurosci. 31, 4466–4474 10.1523/JNEUROSCI.3220-10.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Habeck C., Rakitin B. C., Moeller J., Scarmeas N., Zarahn E., Brown T., Stern Y. (2004). An event-related fMRI study of the neurobehavioral impact of sleep deprivation on performance of a delayed-match-to-sample task. Brain Res. Cogn. Brain Res. 18, 306–321 10.1016/j.cogbrainres.2003.10.019 [DOI] [PubMed] [Google Scholar]
- Harbaugh W. T., Mayr U., Burghart D. R. (2007). Neural responses to taxation and voluntary giving reveal motives for charitable donations. Science 316, 1622–1625 10.1126/science.1140738 [DOI] [PubMed] [Google Scholar]
- Harrison Y., Horne J. A. (1999). One night of sleep loss impairs innovative thinking and flexible decision making. Organ. Behav. Hum. Decis. Process. 78, 128–145 10.1006/obhd.1999.2827 [DOI] [PubMed] [Google Scholar]
- Hayden B. Y., Parikh P. C., Deaner R. O., Platt M. L. (2007). Economic principles motivating social attention in humans. Proc. Biol. Sci. 274, 1751–1756 10.1098/rspb.2007.0368 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Izuma K., Saito D. N., Sadato N. (2008). Processing of social and monetary rewards in the human striatum. Neuron 58, 284–294 10.1016/j.neuron.2008.03.020 [DOI] [PubMed] [Google Scholar]
- Killgore W. D., Grugle N. L., Reichardt R. M., Killgore D. B., Balkin T. J. (2009). Executive functions and the ability to sustain vigilance during sleep loss. Aviat. Space Environ. Med. 80, 81–87 10.3357/ASEM.2396.2009 [DOI] [PubMed] [Google Scholar]
- Killgore W. D., Kamimori G. H., Balkin T. J. (2011). Caffeine protects against increased risk-taking propensity during severe sleep deprivation. J. Sleep Res. 20, 395–403 10.1111/j.1365-2869.2010.00893.x [DOI] [PubMed] [Google Scholar]
- Killgore W. D. S., Balkin T. J., Wesensten N. J. (2006). Impaired decision making following 49 h of sleep deprivation. J. Sleep Res. 15, 7–13 10.1111/j.1365-2869.2006.00540_4.x [DOI] [PubMed] [Google Scholar]
- Kim H., Shimojo S., O’Doherty J. P. (2010). Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb. Cortex 21, 769–776 10.1093/cercor/bhq145 [DOI] [PubMed] [Google Scholar]
- Knutson B., Fong G. W., Adams C. M., Varner J. L., Hommer D. (2001). Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12, 3683–3687 10.1097/00001756-200112040-00016 [DOI] [PubMed] [Google Scholar]
- Lebreton M., Jorge S., Michel V., Thirion B., Pessiglione M. (2009). An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 64, 431–439 10.1016/j.neuron.2009.09.040 [DOI] [PubMed] [Google Scholar]
- Leproult R., Colecchia E. F., Berardi A. M., Stickgold R., Kosslyn S. M., Van Cauter E. (2003). Individual differences in subjective and objective alertness during sleep deprivation are stable and unrelated. Am. J. Physiol. Regul. Integr. Comp. Physiol. 284, R280–R290 [DOI] [PubMed] [Google Scholar]
- Lim J., Choo W. C., Chee M. W. (2007). Reproducibility of changes in behaviour and fMRI activation associated with sleep deprivation in a working memory task. Sleep 30, 61–70 [DOI] [PubMed] [Google Scholar]
- Lim J., Dinges D. F. (2010). A meta-analysis of the impact of short-term sleep deprivation on cognitive variables. Psychol. Bull. 136, 375–389 10.1037/a0018883 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lin A., Adolphs R., Rangel A. (2011). Social and monetary reward learning engage overlapping neural substrates. Soc. Cogn. Affect. Neurosci. [Epub ahead of print]. 10.1093/scan/nsr006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McKenna B. S., Dickinson D. L., Orff H. J., Drummond S. P. (2007). The effects of one night of sleep deprivation on known-risk and ambiguous-risk decisions. J. Sleep Res. 16, 245–252 10.1111/j.1365-2869.2007.00591.x [DOI] [PubMed] [Google Scholar]
- Montague P. R., Berns G. S. (2002). Neural economics and the biological substrates of valuation. Neuron 36, 265–284 10.1016/S0896-6273(02)00974-1 [DOI] [PubMed] [Google Scholar]
- Nieuwenhuis S., Heslenfeld D. J., von Geusau N. J., Mars R. B., Holroyd C. B., Yeung N. (2005). Activity in human reward-sensitive brain areas is strongly context dependent. Neuroimage 25, 1302–1309 10.1016/j.neuroimage.2004.12.043 [DOI] [PubMed] [Google Scholar]
- O’Doherty J., Winston J., Critchley H., Perrett D., Burt D. M., Dolan R. J. (2003). Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia 41, 147–155 10.1016/S0028-3932(02)00145-8 [DOI] [PubMed] [Google Scholar]
- Padoa-Schioppa C. (2009). Range-adapting representation of economic value in the orbitofrontal cortex. J. Neurosci. 29, 14004–14014 10.1523/JNEUROSCI.3751-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Padoa-Schioppa C., Assad J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223–226 10.1038/nature04676 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Padoa-Schioppa C., Assad J. A. (2008). The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat. Neurosci. 11, 95–102 10.1038/nn2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Price J. L. (2003). Comparative aspects of amygdala connectivity. Ann. N. Y. Acad. Sci. 985, 50–58 10.1111/j.1749-6632.2003.tb07070.x [DOI] [PubMed] [Google Scholar]
- Rademacher L., Krach S., Kohls G., Irmak A., Gründer G., Spreckelmeyer K. N. (2010). Dissociation of neural networks for anticipation and consumption of monetary and social rewards. Neuroimage 49, 3276–3285 10.1016/j.neuroimage.2009.10.089 [DOI] [PubMed] [Google Scholar]
- Rangel A., Hare T. (2010). Neural computations associated with goal-directed choice. Curr. Opin. Neurobiol. 20, 262–270 10.1016/j.conb.2010.03.001 [DOI] [PubMed] [Google Scholar]
- Seymour B., McClure S. M. (2008). Anchors, scales and the relative coding of value in the brain. Curr. Opin. Neurobiol. 18, 173–178 10.1016/j.conb.2008.07.010 [DOI] [PubMed] [Google Scholar]
- Smith D. V., Hayden B. Y., Truong T. K., Song A. W., Platt M. L., Huettel S. A. (2010). Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J. Neurosci. 30, 2490–2495 10.1523/JNEUROSCI.4438-10.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith D. V., Huettel S. A. (2010). Decision neuroscience: neuroeconomics. Wiley Interdiscip. Rev. Cogn. Sci. 1, 854–871 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spreckelmeyer K. N., Krach S., Kohls G., Rademacher L., Irmak A., Konrad K., Kircher T., Gründer G. (2009). Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women. Soc. Cogn. Affect. Neurosci. 4, 158–165 10.1093/scan/nsn051 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tusche A., Bode S., Haynes J. D. (2010). Neural responses to unattended products predict later consumer choices. J. Neurosci. 30, 8024–8031 10.1523/JNEUROSCI.0064-10.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Dongen H. P. A., Baynard M. D., Maislin G., Dinges D. F. (2004). Systematic interindividual differences in neurobehavioral impairment from sleep loss: evidence of trait-like differential vulnerability. Sleep 27, 423–433 [PubMed] [Google Scholar]
- Venkatraman V., Chuah Y. M. L., Huettel S. A., Chee M. W. (2007). Sleep deprivation elevates expectation of gains and attenuates response to losses following risky decisions. Sleep 30, 603–609 [DOI] [PubMed] [Google Scholar]
- Venkatraman V., Huettel S. A., Chuah L. Y., Payne J. W., Chee M. W. (2011). Sleep deprivation biases the neural mechanisms underlying economic preferences. J. Neurosci. 31, 3712–3718 10.1523/JNEUROSCI.4407-10.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walker M. P. (2009). The role of sleep in cognition and emotion. Ann. N. Y. Acad. Sci. 1156, 168–197 10.1111/j.1749-6632.2009.04416.x [DOI] [PubMed] [Google Scholar]
- Winston J. S., O’Doherty J., Kilner J. M., Perrett D. I., Dolan R. J. (2007). Brain systems for assessing facial attractiveness. Neuropsychologia 45, 195–206 10.1016/j.neuropsychologia.2006.05.009 [DOI] [PubMed] [Google Scholar]
- Yoo S. S., Gujar N., Hu P., Jolesz F. A., Walker M. P. (2007). The human emotional brain without sleep – a prefrontal amygdala disconnect. Curr. Biol. 17, R877–R878 10.1016/j.cub.2007.08.007 [DOI] [PubMed] [Google Scholar]