Abstract
Theoretical models and empirical work indicate a critical role of the NAcc in salience processing. For instance, the NAcc not only responds to appetitive and aversive information, but it also signals novelty, contextual deviance, and action monitoring. However, because most studies have investigated only one specific type of salience independently, it remains unclear how the NAcc concurrently differentiates between different forms of salience. To investigate this issue, we used intracranial electroencephalography in human epilepsy patients together with a previously established visual oddball paradigm. Here, three different oddball categories (novel, neutral, and target images) were infrequently presented among a standard scene image, and subjects responded to the target via button press. This task allowed us to differentiate “item novelty” (new vs neutral oddballs) from “contextual deviance” (neutral oddballs vs standard images) and “targetness” (target vs neutral oddballs). Time-frequency analysis revealed a dissociation between item novelty and contextual deviance on the basis of decreases in either θ (4–8 Hz) or β power (20–30 Hz). Targetness, on the other hand, was signaled by positive deflections in the stimulus-locked local field potentials, which, importantly, correlated with subjects' reaction times. These findings indicate that, in an ongoing stream of information, the NAcc differentiates between types of salience by distinct neural mechanisms to guide goal-directed behavior.
Introduction
The NAcc is a core region of the ventral striatum, which has direct and indirect connections to a wide range of brain structures, including the prefrontal cortex, medial temporal lobe, and dopaminergic midbrain (Haber and Knutson, 2009). It has traditionally been associated with reward learning (e.g., O'Doherty, 2004), but recent evidence suggests that it has a much broader function. In particular, the NAcc is involved in goal-directed behavior (Goto and Grace, 2005), and it responds to novelty (Wood and Rebec, 2004), contextual deviance (Axmacher et al., 2010), and aversive stimuli (Becerra et al., 2001; Baliki et al., 2010), which points toward a prominent role in salience processing (Horvitz, 2000; Zink et al., 2003, 2006; Cooper and Knutson, 2008). However, the precise neural mechanisms in support of distinct forms of salience within the NAcc remain unclear.
A distinction between different types of salience can be made on the rationale that stimuli are salient because of (1) their first encounter (i.e., “item novelty”), (2) their contextual rareness (i.e., “contextual deviance”; here items are familiar to the subject but contextually deviant), or (3) their behavioral significance in a given context (i.e., “targetness”; here rare items require a motor response). Although previous studies could show NAcc activity to contextual deviance, for instance by using intracranial recordings (Axmacher et al., 2010), there is only indirect evidence for the involvement of the NAcc in processing item novelty (e.g., Guitart-Masip et al., 2010; Daniel and Pollmann, 2012). This is surprising given that a prominent theoretical model of novelty processing suggests that the NAcc plays an important role in transferring novelty signals from the medial temporal lobe to the dopaminergic midbrain (Lisman and Grace, 2005; Lisman et al., 2011). This so-called hippocampal-substantia nigra/ventral tegmental area loop is supposed to underlie encoding of novel information into long-term memory possibly via neural θ oscillations (Duzel et al., 2010).
Here, we used intracranial recordings in seven epilepsy patients together with a modified version of a previously established oddball paradigm (Bunzeck and Duzel, 2006; Bunzeck et al., 2007) that allowed us to differentiate item novelty from contextual deviance and targetness. We predicted that neural responses to contextual deviance emerge in the local field potentials (LFPs) at ∼400 ms (Axmacher et al., 2010), and we assessed whether this response is generic for item novelty and targetness. Furthermore, on the basis of previous scalp recordings investigating novelty and/or saliency (e.g., Brenner et al., 2009; Bunzeck et al., 2011; HajiHosseini et al., 2012), we tested whether neural oscillations in the θ (4–8 Hz) and β (20–30 Hz) frequency range are modulated as a function of item novelty and whether they provide a mechanism to differentiate between all three types of salience (i.e., item novelty, contextual deviance, and targetness). Finally, we tested the prediction (again derived from scalp recordings) that enhanced NAcc θ power during encoding drives subsequent recognition memory (e.g., Klimesch et al., 1996; Osipova et al., 2006).
Materials and Methods
Task.
All subjects were instructed to complete five blocks of a modified visual oddball paradigm (Bunzeck and Duzel, 2006; Bunzeck et al., 2007) using photographs of outdoor scenes. In each block, there were 50 standard images (i.e., one frequently repeated scene), 10 target oddballs (i.e., one infrequently presented scene requiring a button press), 10 neutral oddballs (i.e., one infrequently presented scene), and 10 novel oddballs (i.e., 10 different unfamiliar scene images), yielding a total of 50 stimuli per oddball class (Fig. 1). Before the experiment, the target stimulus was introduced and subjects were required to make a simple button press to each of its subsequent appearance in the experiment using their right index finger. No motor responses were associated with any of the other stimulus classes.
During the experiment, pictures were presented for 1500 ms followed by a white fixation cross (presented for 1500 ms) on gray background (gray-value = 127). The intertrial interval was jittered between −50 ms and +50 ms (uniformly distributed). The order of stimuli was fully randomized. All subjects performed a short practice run before the actual experiment started.
Approximately 15 min after the oddball paradigm, subjects completed a recognition memory test. Here, all 50 studied novel oddballs (now old items) were presented intermixed with 50 unstudied distractor images (new items), and participants discriminated the old/new status by button presses. Each picture was presented until a button was pressed (old vs new), and this was followed by a fixation cross for 1500 ms. Similar to the oddball task, all subjects performed a short practice run before the actual experiment started.
Participants, surgery, and electrode implantation.
Bilateral stereotactically guided implantation of quadripolar brain electrodes (model 3387, Medtronic) in the NAcc (Fig. 2) was performed in seven patients (mean ± SD age: 40 ± 9.02 years; 3 male/4 female, all right handed) with a history of severe, drug-resistant epilepsy. The study was approved by the local ethics committee (University of Magdeburg), and all patients gave written informed consent.
Table 1 summarizes individual clinical background and neuropsychological test results. Neuropsychological assessment was performed before the surgical intervention and included tests regarding verbal memory (VLMT) (Helmstaedter et al., 2001), figural memory (DCS) (Weidlich et al., 2001), and sustained attention (d2) (Brickenkamp, 2000). The VLMT measures verbal list learning and memory by assessing recall and recognition of unstructured word lists over immediate and delayed trials. Analogously, the DCS measures learning ability and performance of visual memory by assessing the recall and reproduction of symmetrical geometric drawings. In the “d2” test of attention, subjects are presented with lines of d's and p's, which can have up to two marks on top and below (i.e., a maximum of four marks per letter). The task is to strike out those d's that have exactly two marks on top or two marks below and ignore all other letters; it is timed and has to be performed as fast and accurately as possible.
Table 1.
Patient no. | Sex, age, duration of epilepsy (years) | Epilepsy |
IQ (HAWIE-R) | Verbal memory |
Figural memory (z-score) | Sustained attention (z-score) | ||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Syndrome | Lateralization | Seizure onset | Etiology | AEDs | Immediate free recall (z-score) | Delayed free recall (z-score) | Recognition (z-score) | |||||
A01 | F, 36, 15 | Multifocal | Bilateral | Frontotemporal | Cryptogenic | ZNS 400 mg | 68 | 38 (−1.6) | 8 (−1.3) | 11 (−0.75) | 25 (−1.4) | 350 (−0.5) |
LCM 400 mg | ||||||||||||
OXC 1200 mg | ||||||||||||
A02 | F, 52, 19 | Multifocal | Bilateral | Mesiotemporal | Cryptogenic | LCM 400 mg | 74.2 | 40 (−0.65) | 5 (−1.6) | 9 (−1) | 8 (−1.6) | 199 (−2.2) |
LTG 200 mg | ||||||||||||
A03 | M, 35, 9 | Focal | Right | Temporal | Right temporal encephalocele | LEV 2000 mg | 124.9 | 57 (−0.65) | 12 (0.2) | 15 (1.1) | 39 (−1) | 486 (0) |
ESL 1200 mg | ||||||||||||
A04 | F, 28, 12 | Multifocal | Bilateral | Temporal | Cryptogenic | LTG 200 mg | 94 | 53 (−0.4) | 13 (0.2) | 15 (1.1) | 23 (−1) | 424 (−0.8) |
LCM 200 mg | ||||||||||||
A05 | M, 40, 31 | Focal | Left | Temporal | Left hippocampal sclerosisa | LTG 400 mg | 90.2 | 36 (−1.6) | 9 (−0.9) | 9 (−1.3) | 16 (−1.6) | 275 (−2.2) |
LCM 400 mg | ||||||||||||
A06 | M, 41, 12 | Multifocal | Bilateral | Frontotemporal | Cryptogenic | 103 | 51 (−0.1) | 9 (−0.9) | 12 (−0.5) | 37 (0.8) | 507 (0.7) | |
A07 | F, 52, 17 | Focal | Left | Temporal | Cryptogenic | LTG 250 mg | 78.6 | 62 (1.6) | 12 (0.2) | 11 (−0.7) | 40 (0.9) | 318 (−1.5) |
LCM 400 mg |
AEDs, Antiepileptic drugs; F, female; M, male; HAWIE-R, Hamburg-Wechsler Intelligence Test for Adults; ZNS, zonisamide; LCM, lacosamide; OXC, oxcarbazepine; LTG, lamotrigine; LEV, levetiracetam; ESL, eslicarbazepine acetate.
aThe patient underwent a left cortico-amygdalohippocampectomy 9 years before deep brain stimulation intervention.
Treatment planning standards and surgical procedures were performed as described previously (Voges et al., 2002). Briefly, the target for the deep brain stimulation electrode was defined as the point 2 mm rostral to the anterior border of the anterior commissure at the level of the mid-sagittal plane, 3–4 mm ventral and 6–8 mm lateral of the midline. These are standard coordinates, which have to be modified according to the individual planning MRI. An important landmark is the vertical limb of Broca's diagonal band, which can be clearly visualized in coronal MRI scans. The target was placed 2–2.5 mm lateral of this structure. The contacts within the NAcc were placed in the caudomedial part, which, according to histochemical criteria, represents the remnant of the shell area in the primate. Different from rodents, the shell area has regressed in the primate and is no longer clearly distinguishable, except for the fact that it carries the typical receptors.
To further indicate the coordinates of the most caudal NAcc electrode, we transformed all patients' MRI images to MNI space. The resulting MNI coordinates were (x, y, z) as follows: 7, 6, −10 (right hemisphere) and −8, 6, −10 (left hemisphere). Figure 2 depicts one patient's non-normalized MRI image and the planned trajectories of the leads/electrodes.
Apart from the NAcc, all patients received implantations of electrodes in the bilateral anterior nuclei of thalamus (Samadani and Baltuch, 2007). Data from these electrodes will not be reported in this manuscript. Also, the rationale behind deep brain stimulation in epilepsy patients will be explained in detail elsewhere.
Intraoperatively, the localization of the leads was documented by stereotactic x-ray imaging using x-ray tubes installed in the operating room. Additionally, postoperative CT examination (2 mm slice thickness) was performed. After transformation of postoperative CT- and x-ray images with the stereotactic treatment planning MRI, the stereotactic coordinates were defined for each electrode contact of the leads and visualized on frontal sections of the stereotactic brain atlas of Morel. Postoperatively, electrode leads were externalized allowing electrical test stimulation with different parameters and the recording from the depth contacts in different psychological tasks. Subsequently, electrode cables were connected to an impulse generator located beneath the left pectoral muscle (Kinetra, Medtronic) similar to a cardiac pacemaker.
Data recording and analysis.
All recordings were conducted using a Walter Graphtek system (Walter Graphtek). Intracranial EEG (iEEG) signals were digitized continuously at a sampling rate of 512 Hz, and behavioral responses were made via an EEG-compatible response pad. Because of technical issues, behavioral responses could not be recorded during the oddball paradigm for one subject. As described above, there were four intracranial electrode contacts (platinum-iridium contacts, 1.5 mm wide with 1.5 mm edge-to-edge distance) both in the left and right NAcc. Following previous studies (Staudigl et al., 2012; e.g., Litvak et al., 2012), each electrode contact was referenced to its neighboring electrode (three bipolar channels per hemisphere: 1–2, 2–3, 3–4) to limit the effects of volume conduction from distant sources and to maximize spatial selectivity. Data were analyzed with MATLAB version 7.8 (MathWorks) and EEGlab toolbox (Delorme and Makeig, 2004).
Analysis of local field potentials.
The continuous iEEG data were off-line filtered between 0.5 and 20 Hz and epoched from 100 ms before to 1000 ms after item onset. To remove possible artifacts, trials were automatically rejected when they contained iEEG activity that exceeded 3 SDs from the mean at a specific bipolar channel. Subsequently, all trials were visually inspected and manually rejected if they still contained any artifacts. None of the analyzed trials contained epileptic spike activity. This step resulted in the following number of trials per condition: standard, 233 (range 196–250); target, 47 (43–50); neutral, 47 (41–50); and novel, 46 (39–50). Subsequently, LFP waveforms were computed for each subject and bipolar channel separately by averaging all trials per condition.
To statistically test whether LFPs were modulated by item novelty (novel vs neutral), contextual deviance (neutral vs standard), or targetness (targets vs neutral) repeated-measures ANOVAs were conducted on the mean amplitude for the time window 100–500 ms (see below). These analyses included the within-subject factors hemisphere (left/right), site (3 bipolar channels), and item type: deviance (standard/neutral), novelty (novel/neutral), or targetness (target/neutral), respectively. Significant main effects and interactions were followed by additional analyses to understand the nature of the effect. Greenhouse-Geisser-corrected degrees of freedom (df) and p values are reported where necessary to account for possible violations of the sphericity assumption (Keselman and Rogan, 1980).
Time-frequency analysis.
iEEG data were high-pass filtered with a cutoff point of 0.5 Hz to remove slow drifts, and segmented into epochs that extended from −800 ms to 2100 ms. This epoch length ensured that time-frequency information could be extracted from −200 ms before until 1000 ms after stimulus onset without any edge effects. Artifact detection included an automatic and manual step (as described above). None of the analyzed trials contained epileptic spike activity.
Spectral decomposition was applied to the preprocessed data at a trial-by-trial level using Morlet wavelets (Percival and Walden, 1993) in 1 Hz steps in the frequency range of 4 to 30 Hz (Niedermeyer and da Silva, 2004). The analysis was conducted with 4 cycles in the lower frequency range and 6 cycles for the higher frequencies with a sliding time window of 20 ms between −200 ms and 1 s. The frequency power was baseline corrected to the average frequency power in the time window from −200 ms to −100 ms before item onset via a subtraction approach for each frequency (4–30 Hz) across each data point of the epoch (see e.g., Hanslmayr et al., 2009). Finally, the time-frequency power across all trials was averaged for each condition (i.e., standard, target, novel, and neutral events). The mean number of trials (range) for those four conditions were 231 (196–250), 47 (44–50), 47 (39–50), and 47 (39–50), respectively.
As for the LFPs, statistical analysis for θ power (4–8 Hz) and β power (20–30 Hz) was based on ANOVAs with the within-subject factors hemisphere (left/right), electrode site (3 bipolar channels), and item type (item novelty: novel/neutral, contextual deviance: neutral/standard, and targetness: target/neutral).
The nature of our paradigm and concept of what defines novelty, contextual salience, and targetness require a direct comparison between novel versus neutral (item novelty), neutral versus standards (contextual deviance), and targets versus neutral (targetness). All other direct comparisons (e.g., targets vs novel) would be difficult to interpret because these conditions differ in more than one dimension (e.g., targets are familiar and require a motor response vs novel items that do not require a motor response). Therefore, entering all conditions into one statistical model (e.g., one ANOVA) would be unjustified.
All reported p values are based on two-tailed tests.
Results
Behavior: oddball task
All subjects performed the task according to the instructions. They responded with high accuracy to the target stimulus (hit-rate, 0.97 ± 0.03; false-alarm rate, 0.01 ± 0.01; average reaction time, 588.83 ± 106.43; mean ± SEM).
Behavior: recognition memory
One patient had to be excluded from the analyses because he did not perform the task according to the instruction (i.e., he constantly pressed only one button to all images). For the remaining six subjects, the hit-rate was 0.45 ± 0.31, false-alarm rate was 0.29 ± 0.26, and resulting D-prime (Stanislaw and Todorov, 1999) was 0.58 ± 0.32. Although this relatively low D-prime indicates poor recognition memory performance, it was positive for each patient and above chance level across the entire group (p < 0.05).
LFPs
The grand averaged LFP signals from the nucleus accumbens for standard, neutral, novel, and target events are displayed in Figure 3.
Repeated-measures ANOVAs on the mean amplitudes were conducted for the time window 100–500 ms and the conditions “novel versus neutral” (item novelty), “neutral versus standard” (contextual deviance), and “target versus neutral” (targetness) (see Materials and Methods). This particular time window was chosen because contextual deviance effects in the NAcc were reported to peak at ∼400 ms (Axmacher et al., 2010) and because neural novelty responses can emerge at the scalp surface already at ∼100 ms (Tsivilis et al., 2001; Bunzeck et al., 2009).
The ANOVA on targetness revealed a significant main effect (F(1,6) = 10.33; p < 0.05), which was most pronounced at L2 (p < 0.05; see Fig. 3). There were no significant main effects or interactions for contextual deviance (p > 0.123) or item novelty (p > 0.113).
The direct comparison between the LFPs for targetness (targets-neutral) versus novelty (novel-neutral), and targetness (targets-neutral) versus contextual deviance (neutral-standards), respectively, revealed a significant (p < 0.05) and a marginal significant difference (p = 0.089) at channel L2.
To further link the LFP effects with behavior, a correlation analysis was performed between subjects' reaction times and signal changes to target items (100–500 ms). Here, we first rectified individual LFPs by computing their absolute value (Sauleau et al., 2009) and used the nonparametric measure Spearman's ρ (ρ), which seems particularly useful for small sample sizes, and it offers the advantage of being less sensitive to possible outliers. This analysis revealed a statistically significant correlation for R2 (ρ = 0.87, p = 0.019) but no other contact (p > 0.05) (Fig. 4A).
Time-frequency analysis
Data were analyzed with respect to their oscillatory power in the θ (4–8 Hz) and β range (20–30 Hz). Consistent with the LFP data, the time window of interest for statistical analyses was 100–500 ms.
ANOVA on mean oscillatory θ power (4–8 Hz) revealed no significant item novelty effect (neutral-novel, p = 0.244). However, planned paired sample t tests (see Introduction; Bunzeck et al., 2011) showed a significant θ power decrease for novel compared with neutral items for the right bipolar channel R2 (p < 0.05; Fig. 5C). The ANOVAs for contextual deviance (neutral vs standard) and targetness (targets vs neutral) revealed no significant effects (p > 0.335).
The direct comparison of θ power at R2 for item novelty (novel-neutral) versus contextual deviance (neutral-standards) and contextual deviance (neutral-standards) versus targetness (target-neutral), respectively, resulted in a significant (p < 0.05) and marginal significant difference (p = 0.060).
In a next step, ANOVAs were conducted for the β frequency range (20–30 Hz; 100–500 ms). For contextual deviance (standard vs neutral), there was a significant interaction between contextual deviance and hemisphere (F(1,6) = 10.07; p < 0.05). Further analyses, separate for the left and right hemisphere (averaged across all bipolar channels of the corresponding site), showed significant effects for left (F(1,6) = 12.71; p < 0.05) but not right NAcc (p = 0.544). Further post hoc t tests revealed that this effect was mainly driven by β power decreases for neutral items in contrast to standard items at L2 (p < 0.05; see Fig. 5A). The ANOVAs for item novelty (novel vs neutral items) and targetness (target vs neutral items) did not reveal any significant effects (p > 0.151).
The direct comparisons of β power at L2 for contextual deviance (neutral-standards) versus item novelty (novel-neutral) and contextual deviance (neutral-standards) versus targetness (targets-neutral), respectively, revealed a significant (p < 0.05) and marginal significant difference (p = 0.078).
Relationship between NAcc θ and recognition memory
We further investigated the relationship between the novelty-related θ effect at bipolar channel R2 and subsequent recognition memory performance. We found a positive correlation between the mean θ power to novel oddballs (time window 100–500 ms) and D-prime (ρ = 0.87; p = 0.019; Fig. 4B).
We computed the correlation between D-prime and θ power instead of the DM effect (difference resulting from later memory) because most participants had an insufficient number of trials for remember and/or forgotten items (Paller et al., 1987).
Discussion
We used intracranial recordings to investigate the neural mechanisms of salience processing in the NAcc. Our results demonstrate that oscillatory θ power decreases closely relate to item novelty, whereas contextual deviance is signaled by changes in β oscillations. Moreover, LFPs signaled targetness and predicted subjects' reaction times. These findings suggest that the NAcc concurrently differentiates between different types of salience by distinct neural mechanisms to guide goal-directed behavior.
Theoretical models suggest that the NAcc is an important relay station for the transfer of neural novelty signals from the medial temporal lobe (including hippocampus and surrounding cortex) to dopaminergic midbrain regions (Lisman and Grace, 2005; Lisman et al., 2011). Evidence comes primarily from animal studies showing, for instance, that stimulation of the ventral subiculm (a primary output structure of the hippocampus) leads to increased firing of the NAcc, which, by inhibiting the ventral pallidum, increases the number of tonically activated dopamine neurons in the substantia nigra/ventral tegmental area (Floresco et al., 2001, 2003). Furthermore, in rats the exploration of novel, but not familiar, environments increases neural firing in the NAcc (Wood and Rebec, 2004). Our findings conform to this work, and they suggest that θ seem to be the primary frequency band by which stimulus novelty is signaled in the human NAcc.
In physiological terms, θ oscillations may allow for binding the distributed neural assemblies that jointly signal novelty/familiarity processing (Buzsaki and Draguhn, 2004). In rats hippocampal θ has been related to the exploration of novelty by showing a reduction of θ frequency in novel compared with familiar environments (Jeewajee et al., 2008). In humans, θ power over frontal and temporal MEG sensors was attenuated for novel items, and it increased with stimulus repetition (Bunzeck et al., 2011). Our results extend these findings to the NAcc by showing decreased θ power to novel in contrast to neutral oddballs (i.e., repeated scene images).
Along the same lines, within the network of novelty sensitive brain regions, θ oscillations have been suggested to provide a mechanism for mnemonic functions (Cashdollar et al., 2009; Nyhus and Curran, 2010; Fell and Axmacher, 2011). This notion is based on animal studies showing consistent θ activity patterns during spatial memory tasks in the hippocampus, prefrontal cortex, and ventral striatum (for review, see Duzel et al., 2010). In humans, M/EEG studies (e.g., Klimesch et al., 1996; Mölle et al., 2002; Osipova et al., 2006; Hanslmayr et al., 2011) demonstrated that θ power during encoding is enhanced for items that are later remembered versus items that are later forgotten (so-called “DM effect”) (Paller et al., 1987). Although our positive correlation between D-prime (i.e., recognition memory accuracy) and θ power for novel items (Fig. 4B) is consistent with these scalp recordings, and therefore provides further evidence for a specific role of the NAcc not only in novelty processing but also in declarative memory encoding, there are other studies revealing the opposite pattern (i.e., decreased θ for later remembered items) (e.g., Sederberg et al., 2007; Guderian et al., 2009; Burke et al., 2013). It has been argued before that differences in stimulus material, testing procedures (Duzel et al., 2010), or postprocessing steps (Burke et al., 2013) might help to explain these diverging findings. Clearly, future work is needed to explore how θ novelty effects relate to subsequent memory performance.
In our paradigm, contextual deviance, which was induced by the rare occurrence of repeated items, was associated with decreased β power. This finding partly conforms to previous human M/EEG studies suggesting that neural oscillations in the β frequency range signal deviance. For instance, scalp recorded β power increases in response to rare auditory sounds (in contrast to frequent sounds) in healthy controls, and this effect was diminished in schizophrenia patients (Brenner et al., 2009). Similarly, increases in β power (again as measured by scalp M/EEG) were linked with salience in sensory gating paradigms (Kisley and Cornwell, 2006), processing of unexpected rewards (HajiHosseini et al., 2012), and reward anticipation (Bunzeck et al., 2011). Although these scalp recordings and our intracranial data point toward a role of β in deviance processing, it should be noted that the effects in our iEEG study and the outlined scalp recordings have opposing directions (increases vs decreases in β). Because scalp recorded M/EEG signals are unlikely to reflect direct NAcc activity, it remains unclear whether and how both effects (NAcc and scalp surface) are related.
As evident in the LFPs, the NAcc also signaled targetness (target vs neutral oddballs) and activity changes correlated with reaction times. Because target stimuli were not only contextually deviant (as neutral oddballs) but also required a motor response, this condition was behaviorally most relevant and could be described as “task-driven salient” (Kisley and Cornwell, 2006). Indeed, the NAcc has been proposed to play a prominent role in goal-directed behavior by integrating inputs from other limbic structures and the prefrontal cortex (Goto and Grace, 2005). More precisely, Goto and Grace (2005) pointed out that the NAcc is, in anatomical terms, ideally located to integrate affective information from the amygdala, contextual information from the medial temporal lobe, and executive/motor plans from prefrontal regions to guide goal-directed behavior. Our findings support this notion, and they are in line with previous intracranial recordings in humans, showing that the NAcc is involved in action monitoring (Münte et al., 2007, 2008) possibly by integrating signals from dopaminergic midbrain regions (Boehler et al., 2011). It should be noted that changes in LFPs do not allow direct conclusions regarding increases or decreases in underlying neural activity. Therefore, the observed positive correlation (Fig. 4A) can be taken as evidence for a relationship between changes in neural activity and reaction times rather than evidence for increased neural activity as a function of reaction times.
In contrast to our expectation, we did not find significant contextual deviance effects in the LFPs. This is inconsistent with a previous iEEG study (Axmacher et al., 2010) and might be the result of at least two factors. First, the study designs differ in several ways: most importantly, Axmacher et al. (2010) induced contextual deviance by changes in stimulus category (faces vs houses) and background color (red vs green); in contrast, we only used one stimulus category (scenes) and contextual deviance was induced by the infrequent occurrence of one (repeated) oddball. Furthermore, in our study, subjects used button presses only to report the presentation of a target image; in Axmacher et al. (2010), subjects had to rate the pleasantness of each item (also by button presses). Apart from the study design, the second main difference lies in the clinical population: while we investigated patients suffering from drug-resistant epilepsy, Axmacher et al. (2010) recruited patients with major depression. Although both conditions are not primarily associated with the NAcc, there is some evidence indicating differential pathological changes of the NAcc in depression (Warner-Schmidt et al., 2012) and epilepsy (Deransart et al., 2001).
Several other human recording studies of the NAcc have focused on the neural mechanisms of reward processing (e.g., Cohen et al., 2009, 2012). One of the interesting findings with regard to our results is that anticipation of monetary wins, in contrast to losses, enhances θ power (Cohen et al., 2012). Together with our observation of changes in θ to novel items, this suggests that NAcc θ oscillations may underlie both reward and novelty processing. Indeed, θ power at the scalp surface (using MEG) changes in response to novelty and reward (Bunzeck et al., 2011), and there are a number of studies pointing toward a functional and anatomical overlap of reward and novelty processing (Guitart-Masip et al., 2010; e.g., Bunzeck et al., 2010). It remains unclear, however, why novelty and reward processing lead to opposite changes in NAcc θ power while they both increase hemodynamic activity in other parts of the mesolimbic system, such as the substantia nigra/ventral tegmental area (Wittmann et al., 2005; Adcock et al., 2006; Bunzeck and Duzel, 2006; Bunzeck et al., 2007).
On a final note, we would like to acknowledge that a larger sample size could increase the power of our statistical results. However, because access to suitable patients is limited and requires a careful selection based on clinical grounds, our sample size is (as in comparable studies, e.g., Cohen et al., 2009, 2012; Axmacher et al., 2010) smaller than 10. To keep the number of statistical comparisons to a minimum, we limited our analyses to one predefined time window of interest, the LFPs, and two frequency bands for which we had a priori defined hypotheses. Therefore, at this stage, we refrain from further exploratory analyses of other time points and frequency bands.
Together, our findings demonstrate that, within an ongoing stream of information, the NAcc codes different forms of salience by distinct neural mechanisms: decreases in θ power signaled item novelty, decreases in β power signaled contextual deviance, and positive deflections in the stimulus-locked LFP signaled targetness. These findings further indicate the importance of the NAcc in integrating information from interconnected brain regions, and they suggest that the NAcc differentiates concurrently behaviorally relevant from irrelevant forms of salience to guide decision-making. Furthermore, the positive relationship between θ power during encoding and subsequent recognition memory provides evidence for a role of NAcc θ oscillation in mnemonic functions possibly by binding neural activity that is shared between different mesolimbic brain regions (i.e., medial temporal lobe and dopaminergic midbrain).
Footnotes
This work was supported by grants from the German Research Foundation (Deutsche Forschungsgemeinschaft) to T.Z., J.V., and H.-J.H. (SFB 779), and N.B. (BU 2670/1-1), and Hamburg state cluster of excellence (neurodapt!) to N.B. We thank all patients for their willingness to participate in this study.
The authors declare no competing financial interests.
References
- Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron. 2006;50:507–517. doi: 10.1016/j.neuron.2006.03.036. [DOI] [PubMed] [Google Scholar]
- Axmacher N, Cohen MX, Fell J, Haupt S, Dümpelmann M, Elger CE, Schlaepfer TE, Lenartz D, Sturm V, Ranganath C. Intracranial EEG correlates of expectancy and memory formation in the human hippocampus and nucleus accumbens. Neuron. 2010;65:541–549. doi: 10.1016/j.neuron.2010.02.006. [DOI] [PubMed] [Google Scholar]
- Baliki MN, Geha PY, Fields HL, Apkarian AV. Predicting value of pain and analgesia: nucleus accumbens response to noxious stimuli changes in the presence of chronic pain. Neuron. 2010;66:149–160. doi: 10.1016/j.neuron.2010.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Becerra L, Breiter HC, Wise R, Gonzalez RG, Borsook D. Reward circuitry activation by noxious thermal stimuli. Neuron. 2001;32:927–946. doi: 10.1016/S0896-6273(01)00533-5. [DOI] [PubMed] [Google Scholar]
- Boehler CN, Bunzeck N, Krebs RM, Noesselt T, Schoenfeld MA, Heinze HJ, Münte TF, Woldorff MG, Hopf JM. Substantia nigra activity level predicts trial-to-trial adjustments in cognitive control. J Cogn Neurosci. 2011;23:362–373. doi: 10.1162/jocn.2010.21473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brenner CA, Kieffaber PD, Clementz BA, Johannesen JK, Shekhar A, O'Donnell BF, Hetrick WP. Event-related potential abnormalities in schizophrenia: a failure to “gate in” salient information? Schizophr Res. 2009;113:332–338. doi: 10.1016/j.schres.2009.06.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brickenkamp R. Test d2: Aufmerksamkeits-Belastungs-Test. Ed 9. Göttingen: Hogrefe; 2000. [Google Scholar]
- Bunzeck N, Düzel E. Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron. 2006;51:369–379. doi: 10.1016/j.neuron.2006.06.021. [DOI] [PubMed] [Google Scholar]
- Bunzeck N, Schütze H, Stallforth S, Kaufmann J, Düzel S, Heinze HJ, Düzel E. Mesolimbic novelty processing in older adults. Cereb Cortex. 2007;17:2940–2948. doi: 10.1093/cercor/bhm020. [DOI] [PubMed] [Google Scholar]
- Bunzeck N, Doeller CF, Fuentemilla L, Dolan RJ, Duzel E. Reward motivation accelerates the onset of neural novelty signals in humans to 85 milliseconds. Curr Biol. 2009;19:1294–1300. doi: 10.1016/j.cub.2009.06.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bunzeck N, Dayan P, Dolan RJ, Duzel E. A common mechanism for adaptive scaling of reward and novelty. Hum Brain Mapp. 2010;31:1380–1394. doi: 10.1002/hbm.20939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bunzeck N, Guitart-Masip M, Dolan RJ, Düzel E. Contextual novelty modulates the neural dynamics of reward anticipation. J Neurosci. 2011;31:12816–12822. doi: 10.1523/JNEUROSCI.0461-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke JF, Zaghloul KA, Jacobs J, Williams RB, Sperling MR, Sharan AD, Kahana MJ. Synchronous and asynchronous θ and γ activity during episodic memory formation. J Neurosci. 2013;33:292–304. doi: 10.1523/JNEUROSCI.2057-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buzsáki G, Draguhn A. Neuronal oscillations in cortical networks. Science. 2004;304:1926–1929. doi: 10.1126/science.1099745. [DOI] [PubMed] [Google Scholar]
- Cashdollar N, Malecki U, Rugg-Gunn FJ, Duncan JS, Lavie N, Duzel E. Hippocampus-dependent and -independent theta-networks of active maintenance. Proc Natl Acad Sci U S A. 2009;106:20493–20498. doi: 10.1073/pnas.0904823106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen MX, Axmacher N, Lenartz D, Elger CE, Sturm V, Schlaepfer TE. Good vibrations: cross-frequency coupling in the human nucleus accumbens during reward processing. J Cogn Neurosci. 2009;21:875–889. doi: 10.1162/jocn.2009.21062. [DOI] [PubMed] [Google Scholar]
- Cohen MX, Bour L, Mantione M, Figee M, Vink M, Tijssen MA, van Rootselaar AF, van den Munckhof P, Schuurman PR, Denys D. Top–down-directed synchrony from medial frontal cortex to nucleus accumbens during reward anticipation. Hum Brain Mapp. 2012;33:246–252. doi: 10.1002/hbm.21195. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cooper JC, Knutson B. Valence and salience contribute to nucleus accumbens activation. Neuroimage. 2008;39:538–547. doi: 10.1016/j.neuroimage.2007.08.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daniel R, Pollmann S. Striatal activations signal prediction errors on confidence in the absence of external feedback. Neuroimage. 2012;59:3457–3467. doi: 10.1016/j.neuroimage.2011.11.058. [DOI] [PubMed] [Google Scholar]
- Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134:9–21. doi: 10.1016/j.jneumeth.2003.10.009. [DOI] [PubMed] [Google Scholar]
- Deransart C, Landwehrmeyer GB, Feuerstein TJ, Lücking CH. Up-regulation of D3 dopaminergic receptor mRNA in the core of the nucleus accumbens accompanies the development of seizures in a genetic model of absence-epilepsy in the rat. Mol Brain Res. 2001;94:166–177. doi: 10.1016/S0169-328X(01)00240-6. [DOI] [PubMed] [Google Scholar]
- Düzel E, Penny WD, Burgess N. Brain oscillations and memory. Curr Opin Neurobiol. 2010;20:143–149. doi: 10.1016/j.conb.2010.01.004. [DOI] [PubMed] [Google Scholar]
- Fell J, Axmacher N. The role of phase synchronization in memory processes. Nat Rev Neurosci. 2011;12:105–118. doi: 10.1038/nrn2979. [DOI] [PubMed] [Google Scholar]
- Floresco SB, Todd CL, Grace AA. Glutamatergic afferents from the hippocampus to the nucleus accumbens regulate activity of ventral tegmental area dopamine neurons. J Neurosci. 2001;21:4915–4922. doi: 10.1523/JNEUROSCI.21-13-04915.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Floresco SB, West AR, Ash B, Moore H, Grace AA. Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat Neurosci. 2003;6:968–973. doi: 10.1038/nn1103. [DOI] [PubMed] [Google Scholar]
- Goto Y, Grace AA. Dopaminergic modulation of limbic and cortical drive of nucleus accumbens in goal-directed behavior. Nat Neurosci. 2005;8:805–812. doi: 10.1038/nn1471. [DOI] [PubMed] [Google Scholar]
- Guderian S, Schott BH, Richardson-Klavehn A, Düzel E. Medial temporal θ state before an event predicts episodic encoding success in humans. Proc Natl Acad Sci U S A. 2009;106:5365–5370. doi: 10.1073/pnas.0900289106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guitart-Masip M, Bunzeck N, Stephan KE, Dolan RJ, Düzel E. Contextual novelty changes reward representations in the striatum. J Neurosci. 2010;30:1721–1726. doi: 10.1523/JNEUROSCI.5331-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haber SN, Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology. 2010;35:4–26. doi: 10.1038/npp.2009.129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- HajiHosseini A, Rodríguez-Fornells A, Marco-Pallarés J. The role of β-γ oscillations in unexpected rewards processing. Neuroimage. 2012;60:1678–1685. doi: 10.1016/j.neuroimage.2012.01.125. [DOI] [PubMed] [Google Scholar]
- Hanslmayr S, Leipold P, Pastötter B, Bäuml KH. Anticipatory signatures of voluntary memory suppression. J Neurosci. 2009;29:2742–2747. doi: 10.1523/JNEUROSCI.4703-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanslmayr S, Volberg G, Wimber M, Raabe M, Greenlee MW, Bäuml KH. The relationship between brain oscillations and BOLD signal during memory formation: a combined EEG–fMRI study. J Neurosci. 2011;31:15674–15680. doi: 10.1523/JNEUROSCI.3140-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Helmstaedter C, Lendt M, Lux S. Verbaler Lern- und Merkfähigkeitstest-Manual. Göttingen: Hogrefe; 2001. [Google Scholar]
- Horvitz JC. Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience. 2000;96:651–656. doi: 10.1016/S0306-4522(00)00019-1. [DOI] [PubMed] [Google Scholar]
- Jeewajee A, Lever C, Burton S, O'Keefe J, Burgess N. Environmental novelty is signaled by reduction of the hippocampal θ frequency. Hippocampus. 2008;18:340–348. doi: 10.1002/hipo.20394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Keselman HJ, Rogan JC. Repeated measures F tests and psychophysiological research: controlling the number of false positives. Psychophysiology. 1980;17:499–503. doi: 10.1111/j.1469-8986.1980.tb00190.x. [DOI] [PubMed] [Google Scholar]
- Kisley MA, Cornwell ZM. γ and β neural activity evoked during a sensory gating paradigm: effects of auditory, somatosensory and cross-modal stimulation. Clin Neurophysiol. 2006;117:2549–2563. doi: 10.1016/j.clinph.2006.08.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klimesch W, Doppelmayr M, Russegger H, Pachinger T. θ band power in the human scalp EEG and the encoding of new information. Neuroreport. 1996;7:1235–1240. doi: 10.1097/00001756-199605170-00002. [DOI] [PubMed] [Google Scholar]
- Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 2005;46:703–713. doi: 10.1016/j.neuron.2005.05.002. [DOI] [PubMed] [Google Scholar]
- Lisman J, Grace AA, Duzel E. A neoHebbian framework for episodic memory: role of dopamine-dependent late LTP. Trends Neurosci. 2011;34:536–547. doi: 10.1016/j.tins.2011.07.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Litvak V, Eusebio A, Jha A, Oostenveld R, Barnes G, Foltynie T, Limousin P, Zrinzo L, Hariz MI, Friston K, Brown P. Movement-related changes in local and long-range synchronization in Parkinson's disease revealed by simultaneous magnetoencephalography and intracranial recordings. J Neurosci. 2012;32:10541–10553. doi: 10.1523/JNEUROSCI.0767-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mölle M, Marshall L, Fehm HL, Born J. EEG θ synchronization conjoined with α desynchronization indicate intentional encoding. Eur J Neurosci. 2002;15:923–928. doi: 10.1046/j.1460-9568.2002.01921.x. [DOI] [PubMed] [Google Scholar]
- Münte TF, Heldmann M, Hinrichs H, Marco-Pallares J, Krämer UM, Sturm V, Heinze HJ. Nucleus accumbens is involved in human action monitoring: evidence from invasive electrophysiological recordings. Front Hum Neurosci. 2007;1:11. doi: 10.3389/neuro.09.011.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Münte TF, Heldmann M, Hinrichs H, Marco-Pallares J, Krämer UM, Sturm V, Heinze HJ. Contribution of subcortical structures to cognition assessed with invasive electrophysiology in humans. Front Neurosci. 2008;2:72–78. doi: 10.3389/neuro.01.006.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Niedermeyer E, da Silva FL. Electroencephalography: basic principles, clinical applications, and related fields. New York: Lippincott Williams and Wilkins; 2004. [Google Scholar]
- Nyhus E, Curran T. Functional role of γ and θ oscillations in episodic memory. Neurosci Biobehav Rev. 2010;34:1023–1035. doi: 10.1016/j.neubiorev.2009.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- O'Doherty JP. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr Opin Neurobiol. 2004;14:769–776. doi: 10.1016/j.conb.2004.10.016. [DOI] [PubMed] [Google Scholar]
- Osipova D, Takashima A, Oostenveld R, Fernández G, Maris E, Jensen O. θ and γ oscillations predict encoding and retrieval of declarative memory. J Neurosci. 2006;26:7523–7531. doi: 10.1523/JNEUROSCI.1948-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paller KA, Kutas M, Mayes AR. Neural correlates of encoding in an incidental learning paradigm. Electroencephalogr Clin Neurophysiol. 1987;67:360–371. doi: 10.1016/0013-4694(87)90124-6. [DOI] [PubMed] [Google Scholar]
- Percival DB, Walden AT. Spectral analysis for physical applications. Cambridge: Cambridge UP; 1993. [Google Scholar]
- Samadani U, Baltuch GH. Stereotactic atlas of the human thalamus and basal ganglia. Boca Raton, FL: CRC Press; 2007. First indirect localization according to the Morel atlas. [Google Scholar]
- Sauleau P, Eusebio A, Thevathasan W, Yarrow K, Pogosyan A, Zrinzo L, Ashkan K, Aziz T, Vandenberghe W, Nuttin B, Brown P. Involvement of the subthalamic nucleus in engagement with behaviourally relevant stimuli. Eur J Neurosci. 2009;29:931–942. doi: 10.1111/j.1460-9568.2009.06635.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sederberg PB, Schulze-Bonhage A, Madsen JR, Bromfield EB, McCarthy DC, Brandt A, Tully MS, Kahana MJ. Hippocampal and neocortical γ oscillations predict memory formation in humans. Cereb Cortex. 2007;17:1190–1196. doi: 10.1093/cercor/bhl030. [DOI] [PubMed] [Google Scholar]
- Stanislaw H, Todorov N. Calculation of signal detection theory measures. Behav Res Methods Instrum Comput. 1999;31:137–149. doi: 10.3758/BF03207704. [DOI] [PubMed] [Google Scholar]
- Staudigl T, Zaehle T, Voges J, Hanslmayr S, Esslinger C, Hinrichs H, Schmitt FC, Heinze HJ, Richardson-Klavehn A. Memory signals from the thalamus: early thalamocortical phase synchronization entrains γ oscillations during long-term memory retrieval. Neuropsychologia. 2012;50:3519–3527. doi: 10.1016/j.neuropsychologia.2012.08.023. [DOI] [PubMed] [Google Scholar]
- Tsivilis D, Otten LJ, Rugg MD. Context effects on the neural correlates of recognition memory: an electrophysiological study. Neuron. 2001;31:497–505. doi: 10.1016/S0896-6273(01)00376-2. [DOI] [PubMed] [Google Scholar]
- Voges J, Volkmann J, Allert N, Lehrke R, Koulousakis A, Freund HJ, Sturm V. Bilateral high-frequency stimulation in the subthalamic nucleus for the treatment of Parkinson disease: correlation of therapeutic effect with anatomical electrode position. J Neurosurg. 2002;96:269–279. doi: 10.3171/jns.2002.96.2.0269. [DOI] [PubMed] [Google Scholar]
- Warner-Schmidt JL, Schmidt EF, Marshall JJ, Rubin AJ, Arango-Lievano M, Kaplitt MG, Ibañez-Tallon I, Heintz N, Greengard P. Cholinergic interneurons in the nucleus accumbens regulate depression-like behavior. Proc Natl Acad Sci U S A. 2012;109:11360–11365. doi: 10.1073/pnas.1209293109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weidlich S, Lamberti G, Hartje W. Diagnosticum für Cerebralschädigung. Ed 4. Bern: Huber; 2001. [Google Scholar]
- Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Düzel E. Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron. 2005;45:459–467. doi: 10.1016/j.neuron.2005.01.010. [DOI] [PubMed] [Google Scholar]
- Wood DA, Rebec GV. Dissociation of core and shell single-unit activity in the nucleus accumbens in free-choice novelty. Behav Brain Res. 2004;152:59–66. doi: 10.1016/j.bbr.2003.09.038. [DOI] [PubMed] [Google Scholar]
- Zink CF, Pagnoni G, Martin ME, Dhamala M, Berns GS. Human striatal response to salient nonrewarding stimuli. J Neurosci. 2003;23:8092–8097. doi: 10.1523/JNEUROSCI.23-22-08092.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zink CF, Pagnoni G, Chappelow J, Martin-Skurski M, Berns GS. Human striatal activation reflects degree of stimulus saliency. Neuroimage. 2006;29:977–983. doi: 10.1016/j.neuroimage.2005.08.006. [DOI] [PMC free article] [PubMed] [Google Scholar]