Abstract
Motivationally/emotionally engaging stimuli are strong competitors for the limited capacity of sensory and cognitive systems. Thus, they often act as distractors, interfering with performance in concurrent primary tasks. Keeping task-relevant information in focus while suppressing the impact of distracting stimuli is one of the functions of working memory (WM). Macroscopic brain oscillations in the alpha band (8–13 Hz) have recently been identified as a neural correlate of WM processing. Using electroencephalography, we examined the extent to which changes in alpha power and inter-site connectivity during a typical WM task are sensitive to load and emotional distraction. Participants performed a lateralized change detection task with two levels of load (4 vs 2 items), which was preceded by naturalistic scenes rated either as unpleasant or neutral, acting as distractors. The results showed the expected parieto-occipital alpha reduction in the hemisphere contralateral to the WM task array, compared to the ipsilateral hemisphere, during the retention interval. Selectively heightened oscillatory coupling between frontal and occipital sensors was observed (1) during the retention interval as a function of load, and (2) upon the onset of the memory array, after viewing neutral, compared to unpleasant distractors. At the end of the retention interval, we observed greater coupling during the unpleasant, compared to the neutral condition. These findings are consistent with the notions (1) that representing more items in WM requires greater interconnectivity across cortical areas and (2) that unpleasant emotional distractors interfere with subsequent WM processing by disrupting processing during the encoding stage.
Keywords: Working memory, EEG, Alpha oscillations, Inter-site synchrony, Emotion
1-. INTRODUCTION
Working memory (WM) can be described as a set of cognitive processes that allow us to maintain a limited amount of goal-relevant information, even when this information is no longer present in the sensory environment (Baddeley, 2012; Cowan, 2001). In order to successfully access and manipulate WM content, these processes rely not only on maintaining and selecting information, but also on suppressing irrelevant and distracting items (Luria et al., 2016). A substantial body of studies have used lateralized change detection tasks to characterize the neural mechanisms underlying WM processing (e.g., Vogel & Machizawa, 2004; Vogel et al., 2005; Stout et al., 2013). In a typical version of this task, two sequential bilateral arrays are shown and participants are asked to remember the first array (the memory set) in the pre-cued hemifield (see e.g., Qi et al., 2014), then after a retention interval, participants are asked to compare the array held in WM (the memory set) with the second array (the test set) while maintaining fixation.
Previously, we used a lateralized WM change detection task to investigate the extent to which a sustained unpleasant emotional state affects WM capacity, as indexed by the event-related potential (ERP) referred to as Contralateral Delay Activity (CDA; Figueira et al., 2017). To examine the effect of emotional/motivational states on WM processing, participants viewed neutral or unpleasant pictures before each trial within a blocked design. Participants showed the typical CDA enhancement when remembering four items, compared to two items, only during blocks in which all-neutral pictures were presented. By contrast, the CDA amplitude did not vary with set size during the unpleasant emotional state, which was induced by viewing all-unpleasant pictures. These results dovetail with previous studies that suggest that the processing of task-relevant stimuli is impaired when emotional distractors are presented before high demanding cognitive tasks (Pereira et al., 2006; Ihssen, Heim, & Keil, 2007).
Despite the fact that ERP studies have been critical in highlighting the temporal structure of WM processing (see e.g. Perez & Vogel, 2012), the ERP technique has limitations, for example, in defining inter-site interactions as well as characterizing neural processes which are not time-locked to the event of interest. Particularly these latter processes may provide links to neural recordings obtained in the animal model, such as recordings of local field potentials during WM tasks in monkeys (Lee et al., 2005; Bastos et al., 2018). One way to address these limitations is to consider large-scale oscillatory activity contained in the human electroencephalogram (EEG) signal. A substantial body of research has identified specific time-frequency properties of oscillatory phenomena in the human EEG, which are sensitive to experimental manipulations in cognitive tasks, including WM tasks (Freunberger et al., 2011; Roux & Uhlhaas, 2014).
The present study examines neural mass oscillatory activity recorded from the scalp using EEG, with a focus on oscillations in the alpha frequency band (8–12 Hz). Changes in alpha power, phase, and inter-site phase locking have been related to a range of neurophysiological and cognitive processes. For example, heightened alpha power has been linked to the selective inhibition of local cortical processing (Palva & Palva, 2011), potentially in the service of distractor suppression, ultimately contributing to attentive selection (Foxe & Snyder, 2011). Other work has prompted the hypothesis that alpha oscillations temporally scaffold cortical processing in a pulsed fashion where one phase of the alpha cycle is associated with inhibition and another with the excitation of neuronal activity (Mathewson et al., 2009). Overall, it is now widely accepted that the active sensory processing of external stimuli prompts alpha power reduction, whereas tasks that require suppression of sensory input or focusing on internal representations prompt alpha power enhancement. Thus, time-varying alpha power and alpha-band connectivity (see below) are promising indices for characterizing WM dynamics, especially in the context of distraction and interference exerted by salient emotional stimuli.
Several previous EEG studies have observed modulations in the alpha band during WM tasks (Jensen et al., 2002; Klimesch et al., 2007). Based on a review of the literature, Klimesch et al. (2007) suggested that oscillatory activity in the alpha range is selectively altered during different stages of WM processing. In line with this notion, many studies have shown, during the retention interval, decreased alpha-band power contralateral to an attended location and increased alpha-band power ipsilateral to an attended location during the retention interval (see e.g. Sauseng et al., 2009). This pattern of findings is in line with the notion that heightened alpha activity reflects suppression of processing task-irrelevant or distracting information (Foxe & Snyder, 2011). Thus, this asymmetry has been hypothesized to reflect differential excitability of cortical areas representing attended versus non-attended locations or features (Klimesch, 2012). Moreover, findings from trans-cranial magnetic stimulation (TMS) studies corroborate this hypothesis by demonstrating that TMS-evoked alpha oscillatory activity in task-relevant sensory areas is associated with decline in perceptual performance (Herring et al., 2015). Conversely, evoking alpha activity in regions ipsilateral to task-relevant items prompts improved distractor suppression (Sauseng et al., 2009).
Differential alpha power during anticipatory processing in lateralized WM tasks is thought to facilitate subsequent visual processing at the attended position while potentially reflecting “inhibitory” processes against the task-irrelevant positions’ visual input. Such an inhibitory function of relatively heightened alpha-band oscillations may represent a neural correlate of shifting attention away from task-irrelevant stimuli (Schneider et al., 2019). Changes in the topography of alpha-band power may also be related to the encoding of specific spatial locations stored in WM (Foster et al., 2016), which points to an overlap between spatial WM and spatial attention.
In addition to power changes in the alpha-band of the EEG, analyses of oscillatory activity provide an avenue to quantifying the temporal coupling between recordings from different locations. Oscillatory coupling has been defined as a mechanism for regulating and coordinating intra-areal processing and inter-areal interactions (Singer, 2009, Buzsaki et al., 2013). Given their high amplitude, and their sensitivity to sensory, memory, and motor processes alpha-band oscillations in particular have been linked to long-range communication among cortical networks (Klimesch, 2006). For example, intracranial EEG recordings have shown frequency-specific coordination of distal cortical events at consistent time lags, and with stable center frequencies, at the alpha frequency (Chapeton et al., 2019). Together, this data support the hypothesis that changes in alpha power and in inter-site phase connectivity across the scalp may systematically reflect changes in WM dynamics.
Inter-site phase-locking analyses quantify the consistency of the oscillatory phase across trials and recording sites and have been used to test hypotheses regarding large-scale interactions between cortical areas (Lachaux, Rodriguez, & Martinerie, 1999). Here, we use this metric to examine the extent to which visual WM processing is associated with fronto-occipital interactions in the alpha range, reflected in oscillatory phase coherence between frontal and occipital recording sites.
Although substantial evidence suggests that the frontal cortex is not a substrate of item storage in WM (e.g., Adam & Postle, 2013), there is empirical support for its role in actively focusing attention on the relevant sensory item’s representation and in suppressing the sensory processing of potentially distracting items (Postle, 2006). For example, functional MRI (fMRI) evidence has converged to show that visual WM is supported by a network of frontal, temporal, parietal and occipital cortices (Pessoa et al. 2002; Linden et al. 2003; Todd & Marois, 2004). Specifically, there is evidence to support that frontoparietal areas mediate attentional shifts towards relevant WM items whereas occipital areas are responsible for keeping these relevant stimuli in an active state (Konen & Kastner, 2008). Consistent with this notion, Sreenivasan et al. (2014) suggested that frontal activity may reflect top-down influences on sensory regions (such as visual cortex) during WM tasks. Additionally, increased phase synchronization in the alpha-band has been suggested to reflect the activity within cell assemblies involved in maintaining items in visual WM (Jensen et al., 2002; Bonnefond & Jensen, 2012). More recently, Lobier et al. (2018) measured long-range phase synchronization in the alpha range between the frontal and visual cortex. They demonstrated that this phase alignment may underlie visuospatial attention, which is known to be a key factor to WM processing (Gazzaley & Nobre, 2012).
Here we re-analyzed data from Figueira et al. (2018), who used a change detection task with two levels of load (4 vs 2 items), preceded by an unpleasant or by a neutral stimulus. The present analysis focused on oscillatory EEG activity in the alpha range, which was examined both in terms of power and inter-site connectivity. Previous studies have characterized several robust alpha power effects during lateralized change detection tasks, which we expected to replicate and extend. Notably, greater alpha reduction in the contralateral hemisphere compared to the ipsilateral hemisphere was observed previously (see e.g. Sauseng et al., 2009). Additionaly, Sauseng et al. (2009) demonstrated that parieto-occipital alpha activity varies with the set size in a similar bilateral change detection task. Extending previous research, we aimed to (1) characterize the effect of a leading emotional (vs. neutral) distractor on alpha power changes during lateralized WM processing, and to (2) define changes in fronto-occipital oscillatory coupling during the same task.
Emotional stimuli are processed in a prioritized fashion because of their relevance to survival (e.g. Öhman et al., 2001). Specifically, emotional stimuli show greater recruitment of visual brain areas when compared to neutral stimuli (Satpute et al, 2015). Such prioritization is believed to underlie interference effects due to the occupation of limited-capacity systems by emotionally engaging stimuli or due to an increased difficulty in disengaging attentional resources from emotional cues/information (Erthal et al., 2005; Fernandes et al., 2013). Moreover, emotional states influence cognition (Oliveira et al., 2013), storage of unpleasant distractor, and interfere with the representation of task-relevant information (Stout et al., 2013; Figueira et al., 2017). The interference effect caused by task-irrelevant emotional stimuli depend on the interaction between neural systems that allow the ability to stay focused on task-relevant information and systems involved in the processing of emotional information that may occupy WM (Iordan et al., 2013). The frontalparietal network is part of WM’s neural models and it is implicated in the maintenance of task-relevant information in mind. If WM is being occupied by emotionally irrelevant stimuli, frontoparietal resources important to execute top-down/cognitive control may be impaired (Botvinick & Braver, 2015).
Thus, we expected that the induction of an unpleasant emotional state (induced by viewing unpleasant, vs. neutral, pictures) interferes with the processing of the relevant items in the change detection task, prompting perturbation in stimulus-evoked alpha asymmetry across set-size conditions. As an alternative hypothesis, the leading emotional distractor may differentially affect the set-size dependent contralateral alpha reduction, resulting in an interaction effect.
Additionally, to explore the role of top-down control feedback in mediating changes within the alpha-band activity throughout the experimental manipulations, we calculated the inter-site phase-locking index (ISPL) as a measure of functional connectivity between cortical areas (Lachaux, Rodriguez, & Martinerie, 1999). As our main goal, we determined the extent to which ISPL in the alpha-band between frontal and occipital electrode sensors would increase as a function of WM load (4 vs 2 items) and if this measure would be differently influenced by the participants’ emotional state. Specifically, we expected greater fronto-occipital ISPL in the four-item condition, which would be consistent with the notion that top-down control between frontal and occipital visual areas is needed to cope with increasing difficulty. In terms of emotional effects, emotionally engaging stimuli can interfere not only with goal-directed behavior but specifically with WM capacity (Stout et al., 2013; Figueira et al., 2017). Thus, we expected that emotional engagement elicited by the unpleasant emotional state would disrupt the functional connectivity between frontal areas and the occipital visual areas.
2-. MATERIALS AND METHODS
2.1-. Participants
The final sample consisted of twenty-eight participants (eighteen women; age: 21.89 years, SD = 5.18). Data sets of eight additional participants had to be excluded due to excessive extensive eye movements (3), excessive (more than 35%) behavioral errors (2) and excessive loss of electrophysiological data due to noise (more than 50% of bad trials) (3). The study sample size was modeled after a body of studies using similar measures and manipulations, with Ns typically between 25 and 35, but no power analysis was conducted. Collection was stopped once this goal was reached. Future work will determine sample size based on simulations with extant data, across a range of effect sizes. The study procedure was approved by the local ethics committee and participants gave informed consent before the experimental session. All participants reported no history of neurological or psychiatric problems. They were all right-handed (according to Oldfield, 1971), reported normal color vision and normal or corrected-to-normal visual acuity.
2.2-. Stimuli and experimental procedure
To manipulate emotional engagement, we presented one hundred-twenty pictures evenly distributed in two distinct emotional categories: unpleasant (mutilated bodies) and neutral (people in daily situations) presented in a blocked fashion. Pictures (20°x16°) were presented centrally on the screen before each trial. The pictures were taken from the International Affective Picture System (IAPS) (Lang, Bradley, & Cuthbert, 2008) and from the worldwide web. The neutral and unpleasant pictures differed significantly in both valence (M=5.06, SD=.42 and M=2.08, SD=.52, respectively, t (59)=35.06; P<0.01) and arousal (M=3.29, SD=0.48 and M=6.89, SD=0.49, respectively, t (59)=–41.41; P < 0.01).
The experiment consisted of four blocks, with sixty trials each. Two blocks comprised only neutral pictures, and two blocks comprised only unpleasant pictures. The block order was counter-balanced between participants with respect to emotional state. Participants were instructed that their task would begin after the picture disappeared in a given trial, but they were not instructed to ignore or to attend to the pictures. During the experimental session, participants were positioned 47cm away from the screen on a head-and-chin rest.
Each trial began with a fixation cross that stayed on the screen throughout the block. After 2000 to 2100ms from fixation cross onset (variable interval, rectangular distribution), a picture (neutral or unpleasant) was presented for 1000ms. After another variable interval (600 to 700ms) after the picture offset, the WM change detection task (Vogel & Machizawa, 2004) began (Figure 1). Participants were instructed to respond as quickly as possible, to avoid committing errors, and to maintain fixation. See Figueira et al. (2017) for detailed information regarding the experimental paradigm.
Figure 1.
Example of the sequential order of events in a trial inside a neutral block. From 2000 to 2100ms of the fixation cross onset, a neutral or an unpleasant picture would appear centrally and stay on the screen for 1000ms. In this example, because this would be a trial inside a neutral block, a neutral picture would appear. The WM change detection task (Vogel & Machizawa, 2004) started from 600 to 700ms following the offset of the picture. This task began with the onset of an arrow cue for 200ms. The arrow pointed to the left on half of the trials. The arrow cue would then be replaced with a memory array, that would stay onscreen for 100ms. After a 900ms retention interval (RI), a test array would follow, staying on screen until the participant’s response, at a maximum of 2000ms. Participants should compare the test array to the previously shown memory array and respond if a square on the previously cued hemifield changed color or not. Participants were instructed to respond as quickly as possible and try not to commit errors.
2.3-. EEG recording and pre-processing
EEG data were recorded continuously from 64 active electrodes placed according to the international 10–20 system in an elastic electrode cap (BrainProducts, Munich, Germany). Data were sampled at 500Hz using Cz as the online reference and FPz as the ground electrode.
Pre-processing steps were as follows. Continuous data were re-referenced to the average of TP9 and TP10 electrodes and digitally filtered using a second order Butterworth high-pass filter 3dB at 0.01Hz (12db/octave). Then, we removed eye-blink artifacts using the semi-automatic Independent Component Analysis tool in BrainVision Analyzer 2.1 software. Components (maximum of two) were removed from the data only after inspection of topographical maps demonstrating their proximity to the ocular area and their resemblance to established waveform characteristics (Jung et al., 2000). Epochs of 1800ms length were extracted from the continuous signal (600ms pre- and 1200ms post-arrow cue onset). Epochs containing voltage deviations of ± 100μV were rejected as well as epochs containing horizontal eye-movements. An average of 89.92% of the total trials were retained for further analyses (88.39% and 89.48% for the neutral emotional state, 2 and 4 squares respectively, 91.06% and 90.96% for the unpleasant emotional state, 2 and 4 squares respectively).
2.4-. Time-frequency analyses
The present study focused on alpha oscillations, specifically the alpha-band in the 8–12Hz frequency range. Only artifact-free single trials with correct responses were used to investigate the temporal dynamics of alpha oscillatory activity. We used a family of complex Morlet wavelets with a Morlet parameter m=f0/sigmaf=7, which resulted in a frequency resolution of 1.43 Hz and a time resolution of 111ms (full width at a half maximum) at a center frequency of 10 Hz. Complex wavelets were calculated for frequencies between 3.88–41.67Hz in steps of 0.55Hz. The resulting time-by-frequency data for each time point were kept for further analyses. Time-varying amplitudes were divided from the mean of a baseline segment between 600 and 400ms prior to arrow-cue onset.
2.5-. Inter-site phase-locking analyses
To quantify systematic relations of oscillatory phase across the sensor array, at a given frequency and time, we calculated inter-site phase-locking (ISPL) values. To this end, the complex phase values obtained after wavelet transform for each trial, electrode, time point, and frequency were first normalized by dividing by the corresponding absolute value. Then, differences between a reference electrode pair (O1/O2) and the remaining electrodes were calculated, and the result normalized again, to minimize the impact of overall signal energy and of volume conduction (see Nolte et al., 2004; McTeague et al., 2015). These complex values were then trial-averaged, and the absolute value (modulus) of the average taken. The resulting inter-site phase locking values indicate to what degree the phase differences across sensors are constant across trials (Lachaux, Rodriguez, & Martinerie, 1999). Considering our focus on parieto-occipital alpha activity, the ISPL values were then averaged within the alpha-band, including wavelets with center frequencies between 9.44 and 10.55 Hz. This resulted in electrode-by time matrices for each participant and condition, submitted to statistical analysis as described below.
2.6-. Behavioral analysis
Error:
2.6-. Statistical Analyses
2.6.1-. EGG
To fully use the temporal and spatial information of the data, the alpha power time courses for each sensor were submitted to general linear model approach and F-contrast weights computed for each time point and sensor, using permutation control for alpha error accumulation. First, we modeled three main effects: Hemisphere (Contralateral vs. Ipsilateral), Load (4 vs. 2 items) and Emotional State (Unpleasant vs. Neutral).
To control for multiple comparisons, we used an F-max reference distribution (Blair & Karniski, 1993), based on 8000 random permutations of the data: Data were shuffled across conditions within each participant, and F-value matrices (sensor by time points) were re-calculated 8000 times. The maxima of these F-value matrices was used to create a distribution of F-max values for each time and frequency points. The 0.95 % tail of this distribution served as the cutoff for statistical significance, and was determined separately for each comparison.
To account for possible interactions between Hemisphere, Load and Emotional State we also included the data for all time points and scalp locations in a 2×2×2 ANOVA. All F-values obtained for 2-way interactions, and the 3-way interactions were below 8.00 and thus did not reach the threshold determined by permutation testing (see above). Therefore, we discarded the interactions between the factors.
Power values and statistical parameters were analyzed in terms of contra- and ipsilateral conditions, rather than left/right hemifield conditions, as is customary in lateralized change detection tasks. In other words, we used the difference between hemifield conditions with same load as the dependent variable. Such a procedure is aimed at eliminating perceptual confounds produced by physical differences in the memory array. It should be noted, however, that this subtraction approach may not eliminate non-linear effects of load.
A note should be made regarding topographical maps shown in the results section: due to the subtraction procedure, we mirrored the F-values against the other hemisphere. As a consequence, all topographical plots are symmetrical.
2.6.2-. Behavioral Analysis
Reaction Time
Mean response times of correct responses were submitted to a repeated-measures analysis of variance (ANOVA) that included the factors Emotional State (Unpleasant vs. Neutral) and Load (2 vs 4 Items).
Error
Incorrect responses included anticipation (reaction time (RT)<150 ms), slow responses (RT>2000 ms), and incorrect key-press responses. The total number of incorrect responses was submitted to a repeated-measures analysis of variance (ANOVA) that included the factors Emotional State (Unpleasant vs. Neutral) and Load (2 vs 4 Items).
3-. RESULTS
3.1-. Permutation-controlled analyses: Time-varying power
F-values exceeded the critical value only for the main effect of Hemisphere in the alpha-band, showing greater alpha reduction effect for the contralateral hemisphere in comparison to the ipsilateral hemisphere. As shown in figure 2, the parietal-occipital sensors P3/P4, P5/P6, P7/P8 and O1/O2 showed sustained differences (above the permutation-controlled threshold) for more than 50% of the 800–1200ms time-window that comprises the second half of the Retention Interval (RI). This result served as manipulation check, replicating previous findings using lateralized cognitive tasks. The remaining main effects (Load and Emotional State) did not reach the permutation-controlled significance threshold (14.60).
Figure 2.
Power changes for the Hemisphere main effect. Left: On the top (contralateral) and bottom(ipsilateral), grand means (N = 28) time-frequency planes showing power changes at parietal-occipital sensors P3/P4, P5/P6, P7/P8 and O1/O2, where time zero is the onset of the arrow cue. Right: On the top, grand mean subtraction between contra and ipsilateral hemispheres. On the bottom, topographical map of the permutation-controlled F values comparing power changes for the main effect of hemisphere at 900ms. The highlighted black electrode represents the Cz and the highlighted white electrodes on the topographical map crossed the significance threshold for more than 50% of the 800–1200ms time-window. Note: the data were mirrored against the opposite hemisphere.
3.2-. Permutation-controlled analyses: Inter-site phase-locking analyses
3.2.1-. Hemisphere effects
The F-value for the inter-site phase-locking (ISPL) data exceeded the F-value threshold (9.55) for all main effects in the alpha-band. The Hemisphere main effect comprised only three pair of sensors (CP5/CP6, P3/P4 and P7/P8) for more than half of brief time-window of 100–180 (figure 3), indicating higher coupling between those sensors and the O1/O2 seed in the contralateral hemisphere.
Figure 3.
Inter-site phase-locking (ISPL) for the Hemisphere main effect. Left: On the top (contralateral) and bottom (ipsilateral), grand means (N = 28) time-frequency planes showing ISPL changes at CP5/CP6, P3/P4 and P7/P8 sensors. Right: On the top, grand mean subtraction between contra and ipsilateral hemispheres. On the bottom: topographical map of the permutation-controlled showing the F values for the main effect of hemisphere at 150ms. The highlighted black electrode represents the Cz and the highlighted white electrodes on the topographical map crossed the significance threshold (9.55) for more than 50% of the 100–180ms time-window. Note: the data were mirrored against the opposite hemisphere.
3.2.2-. Load and Emotional State Effects
Both the Load and the Emotional State main effects comprised a broad fronto-central area. The Load main effect was found in two different time-windows representing the beginning (400–550ms) and the end (800–1000ms) of the retention interval. That is, we found greater inter-site phase-locking between fronto-central areas and the occipital pole (O1/O2 seed) for the four-item compared to the two-item condition during the retention interval. Figure 4 illustrates the finding of greater phase synchrony between the occipital pole (O1/O2 seed) and fronto-central areas for the four items condition in comparison with the two items condition.
Figure 4.
Inter-site phase-locking (ISPL) for the Load main effect. Left: On the top (4 items) and bottom (2 items), grand means (N = 28) time-frequency planes showing ISPL changes at F1/F2, F3/F4, F5/F6, F7/F8 and AF3/AF4 sensors. Right: On the top, grand mean subtraction between the four-items and the two-items conditions. On the bottom: topographical maps of the permutation-controlled showing the F values for the main effect of Load at 500ms and 900ms. The highlighted black electrode represents the Cz and the highlighted white electrodes on the topographical map crossed the significance threshold (9.55) for more than 50% of the 400–550ms (left) and 800–1000ms (right) time-window. Note: the data were mirrored against the opposite hemisphere.
An Emotional State main effect (Figure 5) was also found in two different time windows, the first one (200–250 ms) representing the onset of the to-be-memorized array and the second one (850–950 ms) representing part of the retention interval. For the first one, we found greater coupling for the neutral emotional condition, suggesting that when a trial is preceded by an unpleasant picture, the top-down control exerted by frontal areas is disrupted. Surprisingly, by the end of the retention interval, we observed the opposite pattern: the unpleasant emotional state elicited greater coupling between frontal areas and the seed.
Figure 5.
Inter-site phase-locking (ISPL) for the main effect of emotional state. Left panel, top (unpleasant) and bottom (neutral), grand means (N = 28) time-frequency planes showing ISPL changes between occipital seed sensors and F3/F4, F7/F8, AF3/AF4, FC3/FC4 sensors. Right panel, top: grand mean difference between the unpleasant and neutral conditions. On the bottom, topographical maps of the permutation-controlled F tests for the main effect of Emotional State at 250ms and 900ms. The highlighted black electrode represents the Cz and the highlighted white electrodes on the topographical map crossed the significance threshold (9.55) for more than 50% of the 200–250ms (left) and 850–950ms (right) time-window. Note: the data were mirrored against the opposite hemisphere.
3.3-. Behavioral Results
The main effect of Load approached significance for both the Reaction Time (F(1,27)=77.96, p<0.01) and Incorrect Response (F(1,27)=170.52, p<0.01). Participants committed more errors and were slower when the load was higher (For descriptive analysis, see Table 1). The main effect of Emotional State did not approach significance for either Reaction Time (F(1,27)=2.15, p<0.15) nor Incorrect Response (F(1,27)= 0.63, p<0.44). Furthermore, the interactions between Load and Emotional State did not approach significance for Reaction Time (F(1,27)=0.002, p<0.96) nor Incorrect Response (F(1,27)= 0.02, p<0.90)
Table 1.
Behavioral descriptive analysis
| 2-Items | 4-Items | |||
|---|---|---|---|---|
| Unpleasant | Neutral | Unpleasant | Neutral | |
| Mean RT ± SD | 693.3 ± 188.8 | 722.1 ± 216.7 | 784.1 ± 200.5 | 809.8 ± 207.8 |
| Mean Error ± SD | 5.3 ± 7.8 | 4.5 ± 7.8 | 16.6 ± 6.2 | 15.6 ± 6.2 |
4-. DISCUSSION
The current study investigated large-scale brain oscillatory activity in the alpha range in a lateralized change detection task, manipulating WM load and emotional state. Specifically, we quantified parieto-occipital alpha power asymmetry and large-scale oscillatory coupling of alpha phase across recording sites (ISPL). The results showed greater coupling between fronto-central areas and the occipital pole (O1/O2 seed) for the four-item compared to the two-item condition, and for the neutral emotional state condition compared to the unpleasant emotional state. Thus, the present findings are consistent with the hypothesis that maintaining four items (vs. two items) requires greater top-down control over the visual cortex. In addition, we also found that the interconnectivity between frontal regions and the occipital pole was modulated by the emotional state, that is: for the neutral emotional state that was a greater coupling when the first array had to be encoded in WM, however when the unpleasant emotional state was elicited, this pattern was disturbed. On the other hand, by the end of the retention interval, the unpleasant emotional state elicited greater interconnectivity between frontal areas and the occipital pole.
As a manipulation check, the results showed greater parieto-occipital alpha reduction in the contralateral hemisphere compared to the ipsilateral hemisphere during the retention interval, replicating previous work (e.g. Sauseng et al., 2009). In addition to the time-varying power, we found greater coupling between centro-parietal sensors and the O1/O2 seed in the contralateral compared to the ipsilateral hemisphere, during the retention interval.
Our present findings suggest that the experimental emotional modulation disrupted the typical interconnectivity between frontal and occipital areas, especially when the memory set was encoded. A rich body of studies has demonstrated that the processing of emotionally engaging stimuli is prioritized due to their evolutionary relevance (Oliveira et al., 2013; Wieser, Miskovic, & Keil, 2016). When it comes to emotion-WM interactions, it is known that storing task-irrelevant emotional stimuli can diminish the active maintenance of task-relevant information which may indicate a competition for limited WM capacity (Dolcos & McCarthy, 2006; Stout et al., 2013). Therefore, it is conceivable that the competition between colored squares and highly motivational unpleasant pictures disrupted the top-down control exerted by the frontal cortex (c.f., Dolcos & McCarthy, 2006). Unexpectedly, at the end of the retention interval, we observed greater fronto-occitial phase-locking during the unpleasant, compared to the neutral condition. This unpredicted finding is consistent with earlier reports showing that interference versus facilitation effects exerted by emotional stimuli change over the course of a trial (Müller, Andersen, Keil, 2008). Importantly, the direct effect of unpleasant picture viewing on WM capacity previously observed using the ERP methodology (Figueira et al., 2017), was not born out when considering oscillatory power activity in the alpha-band. Thus, these two EEG measures yield complementary, unique information.
Sauseng et al. (2009) reported that the amplitude of alpha-band power increases with load during the retention interval in a change detection task. Here, we did not replicate this Load effect for the time-varying power data, but results showed a main effect of Load on inter-site phase locking in the alpha band. The present findings thus suggest greater interconnectivity in the alpha frequency band, between frontal regions and the occipital pole, during the retention interval in the four-item vs. the two-item condition. This finding is in line with results described by Palva et al. (2010) that showed strengthened synchrony among the frontoparietal regions by increasing memory load. Sadaghiani et al. (2012) demonstrated a link between global phase synchrony and frontoparietal network, using EEG-fMRI recordings. Importantly, their findings are was specific for alpha activity which highlights the importance of alpha-band coupling in a well-defined top-control network. In other words, there are strong evidences that alpha-band phase locking is be involved in the regulation of attentional top-down modulation, predominantly within those specific frontoparietal and visual cortices that is known to be active during VWM processing with fMRI.
Thus, even though the alpha-band power was not influenced by the number of items to be held in WM (see also Jensen et al., 2002), the degree of alpha synchronization across brain regions was. This may be taken to suggest that maintaining more items in WM requires greater top-down control in comparison to fewer items. Future work may aim to clarify this relationship and to further examine the relation between number of items and the degree of synchronization.
The current finding of alpha reduction in the contralateral compared to the ipsilateral occipital cortex is in line with notions that consider hemispheric alpha power asymmetries as a consequence of inhibition in visual input. For example, Schneider et al. (2019) proposed that this asymmetry plays a role in the orienting of attention within WM. It has been suggested that alpha lateralization arises from an alpha increase in the ipsilateral cortex to mediate the inhibition of the ipsilateral task-irrelevant cortical regions (Jensen & Mazaheri, 2010). Consequently, our result points to a functional role of ipsilateral alpha enhancement in suppressing irrelevant WM representations and favoring the processing of the to-be-memorized hemifield. We also found greater interconnectivity between centro-parietal regions and the occipital pole in the contralateral hemisphere during the presentation of the arrow cue, that is, before the onset of the memory array. It is consistent with current conceptual models of alpha oscillations that this phase adjustment in the contralateral hemisphere serves to protect WM against the items presented in the non-cued hemifield (Bonnefond & Jensen, 2012).
One limitation that might arise with the inter-site phase-locking technique is due to volume conduction, which in turn may lead to spurious connectivity estimates. To overcome this limitation, we normalized the complex phase and the complex inter-site phase differences to unit length prior to phase-averaging (Wieser et al., 2016). Future neuroimaging studies are needed to shed light on the interaction between frontal cortex and visual sensory areas during WM processing, and to trace the flow of information between those areas during cognitive tasks that engage WM resources. Furthermore, we delivered the same visual information to both hemispheres and used the difference between the electric activity on ipsilateral and contralateral hemispheres as the dependent variable, with the intention to remove linear effects due to the physical appearance of the stimuli. Studies that examine nonlinear effects of set size on selective visual processing, accounting for both hemispheres, are still needed. Equally important, however, is to further clarify the neural circuits implicated in the interaction between emotion and WM.
6-. CONCLUSION
Taken together, our results provide evidences for the role of alpha-band activity in the service of executive control. In this regard, frontal-occipital interconnectivity in the alpha-band could be interpreted as mechanism that influences the way in which a stimulus is to be processed. The current findings, specially the inter-site phase-locking results, can be added to the WM and attention literature (see e.g. Jensen & Mazaheri, 2010) that postulate alpha-band activity as being part of a control mechanism that promotes inhibitory gating of information processing. Furthermore, we provided evidence that neutral and unpleasant emotional states differentially modulate the neural correlates of relevant information encoding, contributing to a better understanding of how emotional states influence WM processing.
Acknowledgments
7- FUNDING
This work was supported by funds from the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES), the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPQ), the Fundação de Amparo à Pesquisa do Estado do Rio de Janeiro (FAPERJ), the US AIR FORCE RESEARCH LABORATORY (FA9453-18-1-0039) and the Office of Naval Research (N00014-18-1-2306).
Footnotes
10-OPEN PRACTICES STATEMENT
None of the data or materials for the experiments reported here is available, and none of the experiments was preregistered.
Publisher's Disclaimer: This Author Accepted Manuscript is a PDF file of a an unedited peer-reviewed manuscript that has been accepted for publication but has not been copyedited or corrected. The official version of record that is published in the journal is kept up to date and so may therefore differ from this version.
11- REFERENCES
- Adam CR,R, Postle B (2013). The relation between working memory storage and elevated activity, as measured with fmri. J Neuroscience, 32, 12990–98 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baddeley A (2012). Working Memory: Theories, Models, and Controversies. Annual Review of Psychology, 63, 1–29 [DOI] [PubMed] [Google Scholar]
- Bastos AM, Loonis R, Kornblith S, et al. (2018). Laminar recordings in frontal cortex suggest distinct layers for maintenance and control of working memory. Proceedings of the National Academy of Sciences, 115, 1117–22 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blair RC, Karniski W (1993). An alternative method for significance testing of waveform difference potentials. Psychophysiology, 30, 518–24 [DOI] [PubMed] [Google Scholar]
- Bonnefond M, Jensen O (2012). Alpha oscillations serve to protect working memory maintenance against anticipated distracters. Current Biology, 22, 1969–74 [DOI] [PubMed] [Google Scholar]
- Buzsáki G, Logothetis N, & Singer W (2013). Scaling Brain Size, Keeping Timing: Evolutionary Preservation of Brain Rhythms. Neuron, 80, 751–764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chapeton JI, Haque R, Wittig JH, Inati SK, & Zaghloul KA (2019). Large-Scale Communication in the Human Brain Is Rhythmically Modulated through Alpha Coherence. Current Biology, 29, 2801–2811.e5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cowan N (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87–114 [DOI] [PubMed] [Google Scholar]
- Dolcos F, McCarthy G (2006). Brain Systems Mediating Cognitive Interference by Emotional Distraction. Journal of Neuroscience, 26, 2072–79 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Erthal FS, de Oliveira L, Mocaiber I, et al. (2005). Load-dependent modulation of affective picture processing. Cognitive, affective & behavioral neuroscience, 5, 388–95 [DOI] [PubMed] [Google Scholar]
- Fernandes O, Portugal LCL, Alves RCS, et al. (2013). How you perceive threat determines your behavior. Frontiers in Human Neuroscience, 7, 632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Figueira JSB, Oliveira L, Pereira MG, et al. (2017). An unpleasant emotional state reduces working memory capacity : electrophysiological evidence. 984–92 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Figueira JSB, Pacheco LB, Lobo I, et al. (2018). “ Keep That in Mind !” The Role of Positive Affect in Working Memory for Maintaining Goal-Relevant Information. 9, 1–6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foster JJ, Sutterer DW, Serences JT, et al. (2016). The topography of alpha-band activity tracks the content of spatial working memory. Journal of Neurophysiology, 115, 168–77 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Foxe JJ, Snyder AC (2011). The role of alpha-band brain oscillations as a sensory suppression mechanism during selective attention. Frontiers in Psychology, 2, 1–13 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freunberger R, Werkle-Bergner M, Griesmayr B, et al. (2011). Brain oscillatory correlates of working memory constraints. Brain Research, 1375, 93–102 [DOI] [PubMed] [Google Scholar]
- Ihssen N, Heim S, Keil A (2007). The costs of emotional attention: Affective processing inhibits subsequent lexico-semantic analysis. Journal of Cognitive Neuroscience, 19, 1932–49 [DOI] [PubMed] [Google Scholar]
- Lachaux J, Rodriguez E, Martinerie J, and F.J.V. (1999). Measuring Phase Synchrony in Brain Signals. Human Brain Mapping 8:194–208(1999), 194–208 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jensen O, Gelfand J, Kounios J, et al. (2002). Oscillations in the alpha band (9–12 Hz) increase with memory load during retention in a short-term memory task. Cerebral cortex (New York, N.Y. : 1991), 12, 877–82 [DOI] [PubMed] [Google Scholar]
- Jensen O, Mazaheri A (2010). Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition . Frontiers in Human Neuroscience, 4, 1–8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jung T-P, Makeig S, Humphries C, et al. (2000). Removing electroencephalographic artifacts by blind source separation. Psychophysiology, 37, 163–78 [PubMed] [Google Scholar]
- Klimesch W (2012). Alpha-band oscillations, attention, and controlled access to stored information. Trends in Cognitive Sciences, 16, 606–17 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klimesch W, Sauseng P, Hanslmayr S (2007). EEG alpha oscillations: The inhibition-timing hypothesis. Brain Research Reviews, 53, 63–88 [DOI] [PubMed] [Google Scholar]
- Lang PJ, Bradley MM, Cuthbert B. (2008). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Gainesville, FL. [Google Scholar]
- Lee H, Simpson GV, Logothetis NK, et al. (2005). Phase Locking of Single Neuron Activity to Theta Oscillations during Working Memory in Monkey Extrastriate Visual Cortex activity" has been considered to play a major role in the short-term maintenance of memories. Many studies since then have provided support for this view and greatly advanced our knowledge of the effects of stimulus type and modality on delay activity and its temporal . Neuron, 45, 147–56 [DOI] [PubMed] [Google Scholar]
- Luria R, Balaban H, Awh E, et al. (2016). The contralateral delay activity as a neural measure of visual working memory. Neuroscience & Biobehavioral Reviews, 62, 100–108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McTeague LM, Gruss LF, Keil A (2015). Aversive learning shapes neuronal orientation tuning in human visual cortex. Nature Communications, 6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Müller MM, Andersen S, Keil A (2008). Time course of competition for visual processing resources between emotional pictures and a foreground task. Cerebral Cortex, 18, 1892–1899 [DOI] [PubMed] [Google Scholar]
- Nolte G, Bai O, Wheaton L, et al. (2004). Identifying true brain interaction from EEG data using the imaginary part of coherency. Clinical Neurophysiology, 115, 2292–2307 [DOI] [PubMed] [Google Scholar]
- Öhman A, Flykt A, Esteves F (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130, 466–78 [DOI] [PubMed] [Google Scholar]
- Oldfield RC (1971). The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia, 9, 97–113 [DOI] [PubMed] [Google Scholar]
- Oliveira L, Mocaiber I, David IA, et al. (2013). Emotion and attention interaction: a trade-off between stimuli relevance, motivation and individual differences. Frontiers in Human Neuroscience, 7, 364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pereira MG, Volchan E, de Souza GGL, et al. (2006). Sustained and transient modulation of performance induced by emotional picture viewing. Emotion, 6, 622–34 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perez V, Vogel EK (2012). What ERPs can tell us about working memory Oxford Handbook of Event-related Potential Components, 361–72 [Google Scholar]
- Postle BR (2006). Working memory as an emergent property of the mind and brain. Neuroscience, 139, 23–38 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Qi S, Chen J, Hitchman G, et al. (2014). Reduced representations capacity in visual working memory in trait anxiety. Biological Psychology, 103, 92–99 [DOI] [PubMed] [Google Scholar]
- Roux F, Uhlhaas PJ (2014). Working memory and neural oscillations: Alpha-gamma versus theta-gamma codes for distinct WM information? Trends in Cognitive Sciences, 18, 16–25 [DOI] [PubMed] [Google Scholar]
- Sauseng P, Klimesch W, Heise KF, et al. (2009). Brain Oscillatory Substrates of Visual Short-Term Memory Capacity. Current Biology, 19, 1846–52 [DOI] [PubMed] [Google Scholar]
- Schneider D, Barth A, Haase H, et al. (2019). Hemispheric asymmetries in EEG alpha oscillations indicate active inhibition during attentional orienting within working memory Keywords. Behavioural Brain Research, 359, 38–46 [DOI] [PubMed] [Google Scholar]
- Sreenivasan KK, Curtis CE, D’Esposito M (2014). Revisiting the role of persistent neural activity during working memory. Trends in Cognitive Sciences, 18, 82–89 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stout DM, Shackman AJ, Larson CL (2013). Failure to filter: anxious individuals show inefficient gating of threat from working memory. Frontiers in human neuroscience, 7, 58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vogel EK, Mccollough AW, Machizawa MG (2005). Neural measures reveal individual differences in controlling access to working memory. Nature, 438, 500–503 [DOI] [PubMed] [Google Scholar]
- Vogel EK, Vogel EK, Machizawa MG, et al. (2004). Neural activity predicts individual differences in visual working memory capacity. Nature, 428, 748–51 [DOI] [PubMed] [Google Scholar]
- Wieser MJ, Miskovic V, Keil A (2016). Steady-state visual evoked potentials as a research tool in social affective neuroscience. Psychophysiology, 53, 1763–75 [DOI] [PMC free article] [PubMed] [Google Scholar]





