Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Jun 1.
Published in final edited form as: Psychophysiology. 2019 Jan 21;56(6):e13332. doi: 10.1111/psyp.13332

Attention to a Threat-Related Feature Does Not Interfere with Concurrent Attentive Feature Selection

Maeve R Boylan 1, Mia N Kelly 1, Nina N Thigpen 1, Andreas Keil 1
PMCID: PMC6508976  NIHMSID: NIHMS1002979  PMID: 30663061

Abstract

Visual features associated with a task and those that predict noxious events both prompt selectively heightened visuocortical responses. Conflicting views exist regarding how the competition between a task-related and a threat-related feature is resolved when they co-occur in time and space. Utilizing aversive differential Pavlovian conditioning, we investigated the visuocortical representation of two simultaneously presented, fully overlapping visual stimuli. Isoluminant red and green random dot kinematogram (RDK) stimuli were flickered at distinct tagging frequencies (8.57 Hz, 12 Hz) to elicit distinguishable steady-state visual evoked potentials (ssVEPs). Occasional coherent motion events prompted a motor response (task) or predicted a noxious noise (threat). These events occurred either in the green (task cue), the red (threat cue), or in both RDKs simultaneously. In the initial habituation phase, participants responded to coherent motion of the green RDK with a key press, but no loud noise was presented at any time. Here, selective amplification was seen for the task-relevant (green) RDK, and interference was observed when both RDKs simultaneously showed coherent motion. Upon pairing the threat cue with the noxious noise in the subsequent acquisition phase, the threat cue-evoked ssVEP (red RDK) was also amplified, but this amplification did not interact with amplification of the task cue or alter the behavioral or visuocortical interference effect observed during simultaneous coherent motion. Although competing feature conjunctions resulted in interference in the visual cortex, the acquisition of a bias towards an individual threat-related feature did not result in additional cost effects.

Keywords: electroencephalography, ssVEP, competition, threat cues, human visual cortex

1. Introduction

The visual system receives dense sensory information, continually exceeding the limited capacity of visual cognition. In response to this challenge, the human brain has evolved mechanisms to select and prioritize behaviorally relevant stimuli in the environment. Prioritization of task-relevant stimulus representations in the visual cortex has been documented extensively in research on selective attention (Hillyard, Hink, Schwent, & Picton, 1973; Reynolds & Heeger, 2009). Stimuli associated with threat or danger can preferentially prompt selective visuocortical amplification. For example, contingent pairing of visual cues with noxious outcomes in aversive conditioning paradigms elicit heightened visuocortical responses (Miskovic & Keil, 2012). Outside the laboratory however, observers confront dynamic visual environments in which task-relevant and threatening stimuli compete for limited capacity, prompting studies of emotional distraction and task interference (Iordan & Dolcos, 2015; Mather & Sutherland, 2011). This body of work has converged to show that naturalistic task-irrelevant distractors high in emotional intensity, such as mutilation scenes, interfere with performance at a concurrent task (Bradley, Keil, & Lang, 2012) and diminish the visuocortical response elicited by the concurrent task stimuli (Müller, Andersen, & Keil, 2008). By contrast, studies in which individual threat-conditioned features such as orientation, color, or visual motion direction co-occur with spatially separated task cues have reported lack of interference effects (Miskovic & Keil, 2013, 2014). This is consistent with observations during feature-based selective attention, in which interference between competing features is restricted to the locus of spatial attention (Forschack, Andersen, & Müller, 2016).

The question arises regarding how threat-related features compete with task-relevant features for limited capacity. Specifically, do interference effects occur because of spatial competition alone, or is interference contingent on threat cues and task cues sharing non-spatial features, such as color, orientation, or motion direction? Addressing these questions has clinical implications, given increasing efforts to use measures of selective attention to threat for diagnostic assessment and intervention in a range of psychiatric disorders (Amir, Bomyea, & Beard, 2010). Attention dysfunction (either hypervigilance or perceptual avoidance of threat cues) is often described as a characteristic seen in those with anxiety, stress-related, or depressive disorders. However, accurate and reliable measurement of dysfunctional threat biases is challenging. Previous work using the so called dot-probe task has recently been criticized for the task’s lack of reliability, poor external validity, and lack of correlation with pathology (Kappenman, Farrens, Luck, & Proudfit, 2014; Thigpen, Gruss, Garcia, Herring, & Keil, 2018). In addition, methodological barriers have hampered addressing the problem of selective processing of threat cues: Most neurophysiological measurements cannot separately quantify the neural response to two simultaneously presented, overlapping stimuli. Recent developments in selective attention research have emphasized the importance of quantifying the “selection” and “prioritization” of a stimulus relative to concurrent sensory inputs, such as competing stimuli, or stimulus features (e.g., Reynolds & Heeger, 2009). Steady-state visual evoked potential (ssVEP) frequency-tagging is a technique which yields direct, separate measurements of the visuocortical response evoked by individual items embedded in a complex array. The ssVEP is evoked when a visual stimulus is periodically modulated in terms of luminance or contrast (Norcia, Appelbaum, Ales, Cottereau, & Rossion, 2015; Wieser, Miskovic, & Keil, 2016). ssVEPs are extracted from scalp EEG, using spectral analysis, at the same fundamental frequency as the driving stimulus, often including higher harmonics. Critical for the present study, this technique separately quantifies the visuocortical response to concurrently presented and spatially fully overlapping stimuli.

Using this technique, we combined a feature-based attention task with an aversive conditioning protocol, using two fully overlapping random dot kinematograms (RDKs; arrays of randomly moving dots that may occasionally exhibit coherent motion in one direction) differing in color, one being task-relevant, one threat-relevant: Occasional feature conjunctions of color and coherent motion in a given kinematogram represented a task cue or a threat cue, prompting a key press or predicting the onset of an aversive loud noise, respectively. Trials could contain task cues, threat cues, or both simultaneously. We quantified the frequency-tagged ssVEP evoked by each RDK during random and coherent motion, before and after conditioning, enabling us to test alternative hypotheses regarding the nature of threat-based selective attention. Hypotheses emphasizing spatial competition effects of threat (Bishop, 2008; Holmes, Vuilleumier, & Eimer, 2003) predict that selection of a threat cue should be at the cost of concurrent stimuli at the same location, resulting in a competitive trade-off between threat-evoked and task-evoked visual responses, during random as well as during coherent motion. Alternative perspectives have emphasized feature-specific rather than space-based amplification of threat representations (McTeague, Gruss, & Keil, 2015; Pessoa & Adolphs, 2010). These notions predict that competitive interactions should be restricted to situations where threat and task features are similar (McTeague et al., 2015) or when conjunctions of more than one feature are present (Notebaert, Crombez, Van Damme, De Houwer, & Theeuwes, 2011).

2. Method

2.1. Participants

Sixteen undergraduate students (11 female, 2 left-handed; mean age = 18.7; SD = 1.3) with normal or corrected-to-normal vision and no personal or family history of photic epilepsy participated in this study. Participants received credits in a general psychology course for their participation. One additional participant (female, 19 years old, left-handed) was excluded from data analysis due to excessive EEG artifacts (more than 50% of trials were rejected). Experimental procedures were approved by the institutional review board at the University of Florida and were in accordance with the Declaration of Helsinki.

2.2. Experimental Design and Stimuli

Visual stimuli consisted of one red and one green, isoluminant (see procedure), random dot kinematogram (RDK) presented simultaneously against a black background. A centrally located white fixation point was present throughout all trials and during the intertrial interval. Both RDKs spanned the same visual angle of 6.9° and consisted of 120 continuously moving dots (0.5° each), generated and presented using MATLAB code and PsychToolbox functions (Brainard, 1997). Each dot within the RDK was displaced 0.2° in a random direction every 116 ms. During each trial, all dots of the RDK could systematically move in a coherent motion in one of eight cardinal directions (0˚, 45˚, 90˚, 135˚, 180˚, 225˚, 270˚, 315˚). Stimuli were presented centrally on a 23-inch Samsung SyncMaster SA950 LED monitor with a refresh rate of 120 frames per second, placed at a viewing distance of 150 cm.

An aversive classical Pavlovian conditioning paradigm with three phases (habituation, acquisition, extinction) and a total of 180 trials (60 trials per phase) was implemented. Each trial began with the simultaneous presentation of the overlapping red and green RDKs against a black background, and both RDKs remained on the screen for 8.17 seconds. Each trial represented one of three experimental conditions, which were determined by occasional coherent motion events (one event per trial) among otherwise randomly moving dots. Coherent motion events occurred randomly (drawn from a rectangular distribution) between 1750 ms and 6413 ms after RDK onset and lasted for 1749 ms. Thus, the first 1749 ms of each trial never contained coherent motion events. The three conditions were defined by which RDK displayed a coherent motion event in a given trial: Coherent motion of the green RDK represented the task condition, during which participants were instructed to respond with a button press. Coherent motion of the red RDK represented a conditioned threat cue, and was paired with a loud noise during the acquisition phase (see below). Concurrent coherent motion of both RDKs represented the third condition. The three conditions and the sequence of events for any given trial are depicted in Figure 1. Each condition was presented randomly 20 times during each phase of the experiment. Participants were instructed to detect the coherent motion event in the green RDK in the task and concurrent conditions, and to respond as quickly and accurately as possible by button press while ignoring coherent motion in the red RDK.

Figure 1. Trial sequence.

Figure 1.

For any given trial, during the first 1749 ms all dots presented on the screen moved in a random motion. Here, the only relevant feature was color, as participants were told to attend the task-relevant green dots. Following this guaranteed segment of random motion, all of the dots in one or both RDKs could move coherently in one direction. The onset of coherent motion could occur between 1750 ms and 6413 ms post-stimuli onset. Similar to the random motion segment, the coherent motion segment had a duration of 1749 ms. Regardless of experimental phase, when the task-relevant green dots exhibited coherent motion (task and concurrent conditions), participants responded via button press. During acquisition, the coherent motion of the red dots (threat and concurrent conditions) was paired with an aversive loud noise (the unconditioned stimulus). In total, the visual stimuli were presented for 8170 ms. The intertrial interval was 2.5–3.5 seconds, during which the participants viewed a black screen and a centrally located, white fixation point.

During the acquisition phase, coherent motion of the red RDK served as the conditioned stimulus (CS) and predicted the occurrence of the unconditioned stimulus (US), which was 500 ms of a 92 dB (SPL) white noise burst, generated in MATLAB, played over speakers placed directly behind the participant. Specifically, coherent motion events in the red RDK, which occurred in the threat and concurrent conditions, were paired with the US for the final 500 ms of coherent motion, upon which the coherent motion event and the loud noise co-terminated. Conditions were randomized and fully balanced throughout all trials. Intertrial intervals randomly varied between 2.5 and 3.5 seconds (drawn from a rectangular distribution).

In addition to continuous motion, each dot of the RDKs flickered throughout the trial to evoke ssVEPs. For the first half of participants, the task-relevant green RDK flickered at 8.57 Hz while the red RDK flickered at 12 Hz. The tagging condition was counterbalanced for the second half of participants in order to control for confounds of flicker frequency (i.e. green flickered at 12 Hz and red flickered at 8.57 Hz). This resulted in two distinguishable ssVEP responses, one for the task stimulus and one for the threat stimulus.

2.3. Procedure

After providing written consent, the isoluminance level of the red dots relative to the green dots was determined using flicker photometry. Using monochromatic circles (1° of visual angle) embedded in a gray (first step) or monochromatic (second step) field, each observer first adjusted the intensity of the red channel of the LED until no flicker was perceived between alternating red and gray backgrounds, and then adjusted the red against a monochromatic green background. Each observer’s final red value was used for the remainder of the experiment. Thus, although color was not counterbalanced in the present experiment, direct effects of luminance were minimized. In addition, the key comparisons of interest were conducted after standardizing differences within color (see statistical analyses, below).

Participants were given instructions to focus on the green dots, while ignoring the red dots, and to click the mouse when the green dots moved together in a coherent motion. Participants were made aware that occasionally loud noises would occur in the experiment, but no additional information was given regarding contingencies. Participants were then fitted with the appropriate EEG sensor net and seated in a dimly lit and sound attenuated Faraday chamber. A chin rest was used to ensure the participant remained 150 cm away from the monitor for the duration of the study. In addition to oral instructions, participants viewed on-screen instructions before each experimental phase. Prior to and following the acquisition phase, each participant gave affective ratings on a scale of 1 to 9, of the red and green dots using the Self-Assessment Manikin (SAM; Lang, 1980). At the end of the experimental session, all participants were debriefed.

2.4. Data Acquisition and Reduction

EEG was continuously recorded with a 257-channel sensor net at a sampling rate of 500 Hz, using an Electrical Geodesic amplifier with an input impedance of 200 MΩ. Impedances were kept below 60 kΩ. Given the amplifier’s high input impedance, satisfactory EEG data quality can be readily achieved with electrode impedances in the range of 60–80 kΩ (Ferree, Luu, Russell, & Tucker, 2001). During recording, online filtering occurred by means of a 0.1 Hz high-pass and 80 Hz (3-dB points, respectively) low-pass elliptical filters. After recording, all data were converted to an average reference and further filtering occurred offline.

The use of steady-state visual evoked potentials allows for a priori knowledge of the precise (tagging) frequencies of interest, enabling narrower band-pass filtering than used in event-related potential (ERP) studies. Thus, all channels were preprocessed by means of a 3 Hz high-pass filter (defined as the 1-dB point, Butterworth, 2nd order filter) and a 30 Hz (3-dB point) low-pass filter (Butterworth, 14th order filter). Epochs were segmented 1 second pre- and 8 seconds post- stimuli (RDKs) onset. Artifacts were rejected based on statistical parameters of these epochs (absolute value, standard deviation, maximum of differences) across time points and for each channel, as proposed by Junghöfer et al (2000). Across subjects for the threat condition, an average of 16.06 (SD = 3.49), 14.31 (SD = 3.75), and 14.13 (SD = 3.67) trials were kept after artifact rejection for the habituation, acquisition, and extinction phases, respectively. For the task condition, an average of 15.00 (SD = 4.56), 15.31 (SD = 2.70), and 12.81 (SD = 2.99), and for the concurrent condition, an average of 16.63 (SD = 2.78), 14.81 (SD = 3.87), and 12.56 (SD = 3.29) trials were kept after artifact rejection for the habituation, acquisition, and extinction phases, respectively.

2.4.1. Steady state visual evoked potentials (ssVEPs).

Artifact-free epochs were averaged for each of the three conditions in the three phases. For each trial, two segments were analyzed: (1) Random Motion and (2) Coherent Motion. During each trial, following stimuli onset, there were 1750 ms of random dot motion prior to any possible onset of coherent motion. These data segments were averaged to result in the “Random Motion” ssVEP, which is sensitive to attentive bias towards one of the RDKs that does not depend on the occurrence of task cues. In a subsequent step, the coherent motion segments (also of 1750 ms length) occurring at different latencies in each trial were aligned relative to the beginning of the coherent motion and averaged, yielding the “Coherent Motion” ssVEP. Using in-house MATLAB code, these ssVEP signals were subjected to a Fourier transform to quantify the power at the driving frequencies (8.57 Hz and 12 Hz) of each of the two RDKs. This analytic step involved tapering the data with a 40-ms cosine-square window, followed by discrete Fourier transform across all 1750 ms, and normalizing the resulting complex spectrum by the number of points. The resulting power spectrum had a resolution of 0.57 Hz. To enable comparison between tagging frequencies and to eliminate the effect of nonspecific level differences between participants and conditions, we computed the signal-to-noise ratio (SNR) for each tagging frequency: We divided the power at each tagging frequency by the mean of the spectral power at 6 adjacent frequency bins in each spectrum, leaving out the two immediate neighbors. Previously, we and others have quantified the visuocortical ssVEP response to a stimulus by calculating the SNR, if the nature of the spectrum allowed for it (e.g. Barry-Anwar, Hadley, Conte, Keil, & Scott, 2018; Rossion & Boremanse, 2011): If there are multiple driving frequencies and they are far enough apart to sufficiently capture the noise of the surrounding frequency bins, the SNR is an intuitive, unitless measure that reflects both the evoked signal as well as the random noise in the data.

2.5. Statistical Analysis

2.5.1. Behavioral Data.

Hit rate, false alarm rate, and response time were considered. The hit rate was the percentage of correct responses, defined as responses following detection of the coherent motion of the task RDK in the task and concurrent conditions between 150 and 2000 ms post-onset. The false alarm rate was the percentage of incorrect button presses when the task RDK did not exhibit coherent motion and responses outside the “correct” window, defined above. Response time was the amount of time that elapsed between the onset of the coherent motion of the task RDK in the task and concurrent conditions and the button press for a correct response. The Self-Assessment Manikin (SAM) was used to collect affective ratings (hedonic valence) for the red and green dots, before and after the acquisition phase for each participant.

A repeated-measures ANOVA was conducted for the hit rate with phase (habituation, acquisition, extinction) and condition (task, concurrent) as factors. Likewise, a repeated-measures ANOVA was conducted for the response time with phase (habituation, acquisition, extinction) and condition (task, concurrent) as factors. Significant main effects or interactions were followed by post-hoc ANOVA and paired t-tests, as appropriate.

A repeated-measures ANOVA was conducted for the SAM ratings with conditioning (pre, post) and stimulus color (red, green) as factors. Significant main effects or interactions were followed by post-hoc ANOVA and paired t-tests, as appropriate.

Throughout this report, frequentist statistics were supplemented by Bayesian repeated-measures ANOVAs, where appropriate, to quantify the evidence for the different hypotheses as well as for null-findings. In each Bayesian analysis, the prior model probabilities were uniformly distributed such that each model was given equal weight (i.e. in a Bayesian repeated-measures ANOVA with five candidate models, each held a prior probability of 0.2). Bayesian repeated-measures ANOVAs were conducted by utilizing JASP software (v 0.8.6; JASP Team, 2018). Interpretation of Bayes Factors follows language guidelines developed by Jeffreys (1961).

2.5.2. ssVEPs.

Replicating a large body of research (reviewed in Wieser et al., 2016), maximum amplitudes were observed at occipital electrodes. Figure 2 shows the grand mean ssVEP time series obtained at a sensor corresponding to location Oz of the international 10–20 system, and the grand mean topographical distribution of the power at the driving frequency. For statistical analysis, SNR values were averaged over a cluster of occipital electrodes, including Oz and 21 of its nearest neighbors (EGI sensors: 116–119, 124–128, 136–140, 147–150, and 156–159, see Figure 2). To investigate the ssVEP amplitude changes when only color information was present (Random Motion) as opposed to when a feature conjunction of color and motion was present (Coherent Motion segment) the SNR values from the two segments entered the statistical analysis (below) separately. Visuocortical response as well as amplitude changes from the habituation phase to the acquisition or extinction phases were examined within color, and thus within the respective ssVEP response, for the threat and task stimuli.

Figure 2. Time course and frequency spectrum.

Figure 2.

(A) Averaged time course for all trials and all participants extracted from sensor Oz. The vertical dashed line indicates stimuli onset. (B) Resulting frequency spectrum for the grand mean of the coherent motion segment following a Fourier transform. Here, there are distinct peaks at the driving frequencies, 8.57 Hz and 12 Hz. Similar to previous ssVEP research, maximal amplitude power is found at occipital sensors (inset).

2.5.2.1. Manipulation Checks.

Before conducting targeted analyses of interaction between tagging frequencies, we conducted several manipulation checks to quantify the extent to which expected and established effects were present in this dataset. A repeated-measures ANOVA was conducted for only the task condition (coherent motion in the green RDK), with segment (random motion, coherent motion) and phase (habituation, acquisition, extinction) as factors, for the tagging frequency of the task stimulus. In this analysis, task-related enhancement of ssVEP amplitude would be reflected in a main effect of segment, indicating heightened ssVEP during task cue processing across all phases. To ensure that any such amplitude enhancement was specific to the task tagging frequency, the same repeated-measures ANOVA was conducted for the tagging frequency of the threat stimulus, where no amplitude enhancement during the task cue segment was expected. This comparison addresses potential concerns regarding the effects of transient brain events on ssVEP amplitude. If such transient events would contaminate the present ssVEP measures, then they are expected to affect both tagging frequencies, rather than one tagging frequency selectively.

In the same vein, we conducted a manipulation check on the red RDK, examining the extent to which the present data replicated the known selective amplification of the ssVEP evoked by conditioned threat cues. To investigate this effect, a repeated-measures ANOVA was conducted only for the threat condition (coherent motion in the red RDK) with segment (random motion, coherent motion) and phase (habituation, acquisition, extinction) as factors. Here, the expected amplification of the threat cue during acquisition would result in a selective amplification of the ssVEP evoked by the red RDK during acquisition. The specificity of any such effect to the threat cue would be demonstrated by the absence of this phase effect in the green RDK.

2.5.2.2. Hypothesis Testing.

To examine the central hypotheses of this study regarding the nature of trade-off and interference effects between the two RDKs, repeated-measures ANOVAs were conducted for random motion and for coherent motion segments separately:

For the random motion segment, a repeated-measures ANOVA was conducted with tagging frequency (threat stimulus, task stimulus) and phase (habituation, acquisition, extinction) as factors. Here, the experimental conditions in each phase were averaged together, because during random dot motion the trial condition (the type of coherent motion occurring afterwards) was irrelevant. A post-hoc ANOVA and paired t-tests were used to follow up significant interaction, where appropriate.

For the coherent motion segment, a repeated-measures ANOVA was conducted for the task stimulus tagging frequency with phase (habituation, acquisition, extinction) and condition (threat, task, concurrent) as factors. Here, an interaction between phase and condition would indicate an effect of fear acquisition on task stimulus processing, which would be consistent with competitive cost effects. Paired samples t-tests were used to follow up significant results, as appropriate. Additionally, Bayesian repeated-measures ANOVAs were conducted where appropriate. As an added control, the same ANOVA design was evaluated for the threat cue tagging frequency.

2.5.2.2.1. Competition Index.

Presently, visuocortical competition is defined as a trade-off effect in which the visuocortical response of one stimulus is amplified at the expense of the other stimulus, which sees a corresponding decrease in amplitude. This was directly quantified via a competition index which represented the product of the amplitude changes from habituation to acquisition and extinction within each tagging frequency:

  1. (Threat ssVEPAcquisition – Threat ssVEPHabituation) * (Task ssVEPAcquisition – Task ssVEPHabituation)

  2. (Threat ssVEPExtinction – Threat ssVEPHabituation) * (Task ssVEPExtinction – Task ssVEPHabituation)

This index is negative if amplitude enhancement in the threat RDK is accompanied by amplitude reduction in the task RDK, or vice-versa (trade-off), but will be positive if both RDKs display amplitude reduction or amplitude enhancement from habituation to the subsequent acquisition or extinction phases. For statistical analysis, a repeated-measures ANOVA was conducted on the competition index with phase (difference between habituation and acquisition, difference between habituation and extinction) and condition (threat, task, concurrent) as factors for both the random motion segment and the coherent motion segment.

In addition, a Bayesian linear model was used to test two opposing models: (1) No Competition: No direct trade-off effects between the threat and task stimuli following fear conditioning and (2) Competition: Direct trade-off effects between the two stimuli. For this analysis, the change in visuocortical activity between habituation and acquisition was computed for each condition in both ssVEP responses. Model predictors are reported such that the first three values represent the threat ssVEP and the last three values represent the task ssVEP for the task condition, the threat condition, and the concurrent condition, respectively. Model predictors for the “No Competition” model were 0, 1, 1, 0, 0, and 0, indicating that for the threat ssVEP, the conditions in which the threat cue occurred will show increased amplitude from habituation to acquisition, while the task ssVEP will show no changes in visuocortical activity between the phases for any condition, because the two stimuli do not compete. Model predictors for the “Competition” model were 0, 1, 1, −0.5, −2, and −1, such that the task-evoked ssVEP will show additive cost effects (i.e. decreased visuocortical activity as a consequence of the increased visuocortical activity for the threat stimulus) in all conditions, and especially those in which the threat cue occurs, following fear acquisition.

While the current study was not formally preregistered, processed data and analysis scripts are available via the Open Science Framework (https://osf.io/7sm5p/).

3. Results

3.1. Behavioral Data

Across participants, the overall average hit rate was 89.43% (SD = 19.22) and the average response time was 1662 ms (SD = 336) after coherent motion onset. The average false alarm rates were 9%, 6%, and 3% for the habituation, acquisition, and extinction phases, respectively. Hit rate and response time, averaged across participants by condition are reported in Table 1.

Table 1.

Means (SD) of hit rate and response time (in milliseconds) averaged across participants by condition and phase

Habituation Acquisition Extinction
Hit Rate
 Task 0.91 (0.14) 0.95 (0.11) 0.91 (0.19)
 Concurrent 0.82 (0.22) 0.92 (0.19) 0.87 (0.27)
Response Time
 Task 1665 (288) 1567 (279) 1624 (312)
 Concurrent 1851 (463) 1600 (254) 1665 (355)

The hit rate was not sensitive to any experimental manipulations, resulting in no significant main effects nor a significant interaction between phase and condition. By contrast, a significant interaction between phase and condition emerged for the response time (F(2,30) = 4.660, p = 0.021; η2 = 0.237). This interaction was driven by the significantly longer response time for the concurrent condition in the habituation phase compared to the other conditions, across phases (t15 > 2.962, p < 0.018, see Figure 3). The Bayesian repeated-measures ANOVA on response time resulted in a BF10 > 2.8 for the main effect of condition model with all remaining models returning a BF10 > 104.6, providing anecdotal to decisive evidence, respectively, for the alternate hypothesis. The model which received the most support was the two main effects (phase + condition) model with a BF10 of 485.2.

Figure 3. Response Time.

Figure 3.

Participants were slower in responding to the task cue during the concurrent condition in which both RDKs exhibited coherent motion. While this interference effect was pronounced during habituation it was not sustained throughout the acquisition or extinction phases of this experiment.

* signifies p < 0.05

The SAM hedonic valence ratings were sensitive to experimental manipulation, resulting in a significant interaction which was driven by the red dots’ affective rating significantly increasing from pre-conditioning to post-conditioning (t15 = 6.603, p < 0.001) and a significantly higher SAM rating for the red dots than the green dots after conditioning (t15 = 5.883, p < 0.001). The average SAM rating before conditioning was 4.4 (SD = 0.66). Following conditioning the SAM ratings for the green dots did not significantly change (M = 4.3, SD = 0.54), while the SAM rating for the fear-conditioned red dots significantly increased (M = 6.0, SD = 0.78). The Bayesian ANOVA model which received the most support was the interaction model with main effects (Conditioning + Color + Conditioning*Color) with a BF10 > 1,000,000.

3.2. Steady state visual evoked potentials (ssVEPs)

3.2.1. Manipulation Checks.

Visuocortical responses to the task stimulus during the coherent motion of the task relevant green RDK (Figure 4A) increased from the random motion to the coherent motion segment across all phases of the experiment (F(1,15) = 5.759, p = 0.030; η2 = 0.277). The Bayesian repeated-measures ANOVA resulted in a BF10 = 10.4 for the segment main effect model, providing strong evidence for the hypothesis that task cues increase the ssVEP amplitude evoked by the task stimulus. The visuocortical response to the threat stimulus during the same coherent motion was not affected by the task cue, i.e., it did not show an increase between segments or across phases. Thus, the task cue prompted a selective increase in ssVEP amplitude that was specific to the time period of the task cue, and to the task stimulus.

Figure 4. Manipulation Checks.

Figure 4.

(A) Visuocortical response for the task stimulus (i.e. the ssVEP for the task-relevant green dots) was amplified during the coherent motion segment, regardless of block, relative to the random motion segment. (B) Visuocortical response for the threat stimulus showed amplification following aversive conditioning. These findings replicate previous work in regards to selective amplification of both a task-relevant stimulus and a motivationally relevant, fear-conditioned stimulus in the visual brain.

The visuocortical response to the threat stimulus during the coherent motion of the threat cue (Figure 4B) demonstrated a main effect of phase (F(2,30) = 4.955, p = 0.032; η2 = 0.248) which was driven by the significant increase in ssVEP amplitude from the habituation phase to the acquisition phase (t15 = 2.692, p = 0.017) whereas the increase from habituation to extinction was not significant (t15 = 1.943, p = 0.071). The Bayesian repeated-measures ANOVA resulted in a BF10 = 2.8 for the phase main effect model as well as a BF10 = 4.0 for the two main effects (segment + phase) model, providing substantial evidence for the hypothesis that conditioned threat cues result in selective visuocortical amplification. In a control analysis, the visuocortical response to the task stimulus during the coherent motion of the threat RDK did not show an increase either between segments or across phases.

3.2.2. Random Motion Segment.

When the conditions within each phase were averaged for the segment of random motion, the ssVEP amplitudes during the first 1750 ms of each trial showed a significant interaction between tagging frequency and phase (F(2,30) = 4.587, p = 0.039; η2 = 0.234). A post-hoc ANOVA was conducted for both tagging frequencies and showed a main effect of phase for the threat tagging frequency (F(2,30) = 4.770, p = 0.028; η2 = 0.241). The interaction and main effect were driven by the significant increase in the threat stimulus ssVEP amplitude from habituation to acquisition (t15 = 2.498, p = 0.025, see Figure 5, top panel) and from habituation to extinction (t15 = 2.258, p = 0.039). The Bayesian repeated-measures ANOVA resulted in a BF10 = 3.5 for the tagging frequency main effect model, providing substantial evidence for the alternate hypothesis.

Figure 5. Random Motion Segment.

Figure 5.

During the random motion segment, the ssVEP for the threat stimulus showed significant amplification during acquisition, when coherent motion of the red RDK was paired with the unconditioned stimulus. The task stimulus did not prompt a similar amplification during acquisition but had relatively higher visuocortical activity throughout the experiment.

3.2.3. Coherent Motion Segment.

The visuocortical response to the task stimulus was sensitive to the experimental conditions, (F(2,30) = 6.290, p = 0.008; η2 = 0.295, see Figure 6). Throughout the experiment, ssVEP amplitude was heightened during the coherent motion event during the task condition, compared to both the threat condition (t15 = 4.463, p < 0.001) and the concurrent coherent motion condition (t15 = 2.616, p = 0.019). The Bayesian repeated-measures ANOVA resulted in a BF10 = 2.7 for the main effect of condition model, providing anecdotal evidence for the hypothesis that coherent motion prompts selective amplification of the task response. Results of the ANOVA evaluating the threat stimulus tagging frequency converged with those of the manipulation checks, demonstrating heightened visuocortical activity for the conditioned threat stimulus during the acquisition phase.

Figure 6. Coherent Motion Segment.

Figure 6.

The ssVEP for the task stimulus demonstrated a main effect of condition, in which the task condition had relatively higher amplitude for every phase of the experiment. Here, an interaction effect would indicate cost effects as the threat stimulus becomes relevant to the participant through fear conditioning. No interaction was found, suggesting that the amplification of the threat stimulus is not at the cost of the simultaneously presented task stimulus.

* signifies p < 0.05

3.2.4. Competition Analysis.

The repeated-measures ANOVA on the competition index data for the random motion segment and the coherent motion segment each resulted in no significant interaction between phase and condition, nor any main effects, suggesting that there is no visuocortical competition (as defined previously) between the two RDKs throughout all phases of the experiment. The Bayesian repeated-measures ANOVAs for the competition index during coherent motion and random motion resulted in a BF01 > 3.0 and a BF01 > 4.6, respectively, for all models, providing substantial to very strong evidence for the null hypothesis. The two main effects with the interaction model (Phase + Condition + Phase*Condition) for both the coherent motion and random motion segments received the most support for the null hypothesis with BF01 of 31.8 and 77.2, respectively.

The Bayesian linear model analysis returned Bayes Factors of 193.8 and 91.0 for the “No Competition” and “Competition” models, respectively, demonstrating that the present data are 2.1 times more likely to arise given the “No Competition” model.

4. Discussion

The present study investigated whether acquired biases towards a threat-related feature come at the cost of concurrent task-based feature selection at the same location in the visual field. We tested the alternative hypotheses that (1) threat cues interfere with concurrent stimuli at the same location irrespective of their feature composition and (2) individual threat features are amplified without imparting cost effects on concurrent task-based feature selection, even when competing for representation at the same spatial locations. We addressed these hypotheses using the unique capability of ssVEP frequency tagging to quantify distinct neural signals from fully overlapping stimuli.

Combining a feature-based attention task with an aversive conditioning protocol, we replicated previous findings that a task-relevant feature prompts selectively heightened visuocortical responses (Muller et al., 2006). We also replicated previous work showing visuocortical response amplification following aversive conditioning (Moratti & Keil, 2009). This selective amplification effect was not accompanied by attenuation of the task-evoked ssVEP, in either a pre-cue random motion segment, or during the time segment in which coherent motion occurred. Targeted analyses using a sensitive competition index supported the conclusion that the visuocortical amplification of an individual threat feature is not at the cost of concurrent feature selection at the same location. By contrast, co-occurring feature conjunction events (color and coherent motion in both RDKs simultaneously) prompted interference, and this interference occurred independently of aversive conditioning, present already in the initial habituation stage. Visuocortical interference effect during simultaneous feature conjunction events was consistent with response time data, which also indicated interference when coherent motion events co-occurred in both RDKs during the habituation phase. Notably, this behavioral interference effect diminished across phases and was absent during acquisition and extinction, providing further evidence against the notion that fear conditioning of an individual salient feature heightens competition. Learning effects with respect to the task and the acquisition of conditioned fear are both confounded with the passage of time in this paradigm, so we cannot be certain whether the overall reduced response times in acquisition and extinction were prompted by an acquired saliency of the CS+ or represent a practice effect. However, the lack of an interference effect (i.e. the longer response times for the concurrent condition) in acquisition and extinction is inconsistent with the notion of competition between the threat and task stimuli, converging with the ssVEP findings. To the extent that the present sample was sized to detect large effects, the question may arise as to the robustness of the present findings to changes in the analysis pipeline and quantification of the dependent variable. In this report, we used the SNR as the main outcome measure. When repeating the statistical analyses with raw spectral power and log spectral power, the main conclusions were also supported, pointing towards large effects, robustly occurring across the participants in this sample of health young observers.

Future work may further investigate the neurophysiological mechanisms that underlie the translation of broad defensive engagement of the organism into feature-specific gain modulation at the level of visual neurons. Previous research has emphasized the role of re-entrant feedback signals from limbic structures such as the amygdaloid body to visual cortical areas in amplifying visual threat cues (Amaral, Behniea, & Kelly, 2003; Anderson & Phelps, 2001). Although these connections are well established in primate models, including their directional properties, evidence of their involvement in the selective visual processing of threat has been scarce. Emphasizing norepinephrinergic modulation of perception and attention, the arousal-biased competition model (Mather & Sutherland, 2011) states that motivational states, such as avoidance of threat, bias neural competition and that autonomic/emotional arousal will increase the competitive advantage for motivationally relevant stimuli while simultaneously decreasing the priority of motivationally irrelevant stimuli. The present study suggests that such competitive interactions are most pronounced in situations in which threat cues are defined by multiple features, again paralleling canonical findings in selective attention and visual search (Treisman & Kanwisher, 1998). In line with this notion, recent evidence from concurrent EEG-fMRI recordings during aversive Pavlovian conditioning suggests that the same cortical regions associated with spatial and feature-based attention may also be involved in the selection of threat cue representations (Petro et al., 2017). Thus, multimodal neuroimaging with the present experimental design may allow refining and testing of the hypothesis that fronto-parietal attention networks under the control of limbic circuits mediate the selective visuocortical facilitation of threat (Yin, Liu, Petro, Keil, & Ding, 2018).

A longstanding debate in the field of emotion/attention interactions has discussed the extent to which threat cues are processed in an automatic, or parallel fashion, with no or little cost to concurrent neurocognitive processes (Ohman & Mineka, 2001; Pessoa & Adolphs, 2010; Pourtois, Schettino, & Vuilleumier, 2013). The present study suggests that for conditioned stimuli, such parallel processing is seen when a threat cue is completely distinct from the features that characterize the concurrent stimuli, i.e., when the threat cue is defined by a unique, salient feature. No prioritization however was observed when two concurrent feature conjunctions were present. This is consistent with the notion that the effect of color as a feature known to readily guide visual search (Wolfe & Horowitz, 2017) may be amplified by stimulus value, further facilitating attentive selection.

In conclusion, the present study used a novel experimental design, which allows for control over the physical stimulus properties of two fully overlapping visual stimuli, permitting distinct quantification of task-related and threat-related cues. Results strongly support the hypothesis that selective attention to an individual, salient feature associated with threat is not at the cost of concurrent attentive processing in healthy adult observers. The practical implications of this finding are manifold: For diagnostic assessment of psychopathologies in the fear, anxiety, and depression spectrum, the presence of interference effects in some patients may represent a marker of dysfunctional attention biases (Bar-Haim, Lamy, Pergamin, Bakermans-Kranenburg, & van, 2007). For intervention, the online feedback of ssVEP amplitudes is routinely accomplished in brain-computer-interfaces (Muller-Putz & Pfurtscheller, 2008), and may thus be used to alter maladaptive attentive selection of threat.

Acknowledgments

This work was supported by the National Institutes of Health, Grant R01 MH097320 to Andreas Keil.

References

  1. Amaral DG, Behniea H, & Kelly JL (2003). Topographic organization of projections from the amygdala to the visual cortex in the macaque monkey. Neuroscience, 118(4), 1099–1120. 10.1016/S0306-4522(02)01001-1 [DOI] [PubMed] [Google Scholar]
  2. Amir N, Bomyea J, & Beard C (2010). The effect of single-session interpretation modification on attention bias in socially anxious individuals. Journal of Anxiety Disorders, 24(2), 178–182. 10.1016/j.janxdis.2009.10.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Anderson AK, & Phelps EA (2001). Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature, 411(6835), 305–309. 10.1038/35077083 [DOI] [PubMed] [Google Scholar]
  4. Bar-Haim Y, Lamy D, Pergamin L, Bakermans-Kranenburg MJ, & van, Ij MH (2007). Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychological Bulletin, 133(1), 1–24. 10.1037/0033-2909.133.1.1 [DOI] [PubMed] [Google Scholar]
  5. Barry-Anwar R, Hadley H, Conte S, Keil A, & Scott LS (2018). The developmental time course and topographic distribution of individual-level monkey face discrimination in the infant brain. Neuropsychologia, 108, 25–31. 10.1016/j.neuropsychologia.2017.11.019 [DOI] [PubMed] [Google Scholar]
  6. Bishop Sonia J. (2008). Neural Mechanisms Underlying Selective Attention to Threat. Annals of the New York Academy of Sciences, 1129(1), 141–152. 10.1196/annals.1417.016 [DOI] [PubMed] [Google Scholar]
  7. Bradley MM, Keil A, & Lang PJ (2012). Orienting and emotional perception: Facilitation, attenuation, and interference. Frontiers in Psychology, 3, 493 10.3389/fpsyg.2012.00493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Brainard DH (1997). The Psychophysics Toolbox. Spat Vis, 10(4), 433–436. [PubMed] [Google Scholar]
  9. Ferree TC, Luu P, Russell GS, & Tucker DM (2001). Scalp electrode impedance, infection risk, and EEG data quality. Clinical Neurophysiology, 112(3), 536–544. 10.1016/S1388-2457(00)00533-2 [DOI] [PubMed] [Google Scholar]
  10. Forschack N, Andersen SK, & Müller MM (2016). Global Enhancement but Local Suppression in Feature-based Attention. Journal of Cognitive Neuroscience, 29(4), 619–627. 10.1162/jocn_a_01075 [DOI] [PubMed] [Google Scholar]
  11. Hillyard SA, Hink RF, Schwent VL, & Picton TW (1973). Electrical signs of selective attention in the human brain. Science, 182(4108), 177–180. 10.1126/science.182.4108.177 [DOI] [PubMed] [Google Scholar]
  12. Holmes A, Vuilleumier P, & Eimer M (2003). The processing of emotional facial expression is gated by spatial attention: Evidence from event-related brain potentials. Cognitive Brain Research, 16(2), 174–184. 10.1016/S0926-6410(02)00268-9 [DOI] [PubMed] [Google Scholar]
  13. Iordan AD, & Dolcos F (2015). Brain Activity and Network Interactions Linked to Valence-Related Differences in the Impact of Emotional Distraction. Cerebral Cortex, bhv242. 10.1093/cercor/bhv242 [DOI] [PubMed] [Google Scholar]
  14. JASP Team. (2018).
  15. Jeffreys H (1961). Theory of probability (3rd ed.). Oxford, UK: Oxford University Press. [Google Scholar]
  16. Junghofer M, Elbert T, Tucker DM, & Rockstroh B (2000). Statistical control of artifacts in dense array EEG/MEG studies. Psychophysiology, 37(4), 523–532. 10.1111/1469-8986.3740523 [DOI] [PubMed] [Google Scholar]
  17. Kappenman ES, Farrens JL, Luck SJ, & Proudfit GH (2014). Behavioral and ERP measures of attentional bias to threat in the dot-probe task: Poor reliability and lack of correlation with anxiety. Frontiers in Psychology, 5 10.3389/fpsyg.2014.01368 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Lang P (1980). Behavioral treatment and bio-behavioral assessment: Computer applications In Sidowski JB, Johnson JH, & William TA (Eds.), Technology in mental health care delivery systems (pp. 119–137). Norwood, NJ: Ablex. [Google Scholar]
  19. Mather M, & Sutherland MR (2011). Arousal-Biased Competition in Perception and Memory. Perspectives on Psychological Science, 6(2), 114–133. 10.1177/1745691611400234 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. McTeague LM, Gruss LF, & Keil A (2015). Aversive learning shapes neuronal orientation tuning in human visual cortex. Nature Communications, 6, 7823 10.1038/ncomms8823 [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Miskovic V, & Keil A (2012). Acquired fears reflected in cortical sensory processing: A review of electrophysiological studies of human classical conditioning. Psychophysiology, 49(9), 1230–1241. 10.1111/j.1469-8986.2012.01398.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Miskovic V, & Keil A (2013). Perceiving Threat In the Face of Safety: Excitation and Inhibition of Conditioned Fear in Human Visual Cortex. Journal of Neuroscience, 33(1), 72–78. 10.1523/JNEUROSCI.3692-12.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Miskovic V, & Keil A (2014). Escape from harm: Linking affective vision and motor responses during active avoidance. Social Cognitive and Affective Neuroscience, 9(12), 1993–2000. 10.1093/scan/nsu013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Moratti S, & Keil A (2009). Not what you expect: Experience but not expectancy predicts conditioned responses in human visual and supplementary cortex. Cerebral Cortex, 19(12), 2803–2809. 10.1093/cercor/bhp052 [DOI] [PubMed] [Google Scholar]
  25. Müller MM, Andersen S, & Keil A (2008). Time course of competition for visual processing resources between emotional pictures and a foreground task. Cerebral Cortex, 18, 1892–1899. 10.1093/cercor/bhm215 [DOI] [PubMed] [Google Scholar]
  26. Muller MM, Andersen S, Trujillo NJ, Valdes-Sosa P, Malinowski P, & Hillyard SA (2006). Feature-selective attention enhances color signals in early visual areas of the human brain. Proceedings of the National Academy of Sciences, 103(38), 14250–14254. 10.1073/pnas.0606668103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Muller-Putz GR, & Pfurtscheller G (2008). Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Transactions on Biomedical Engineering, 55(1), 361–364. 10.1109/TBME.2007.897815 [DOI] [PubMed] [Google Scholar]
  28. Norcia AM, Appelbaum LG, Ales JM, Cottereau BR, & Rossion B (2015). The steady-state visual evoked potential in vision research: A review. Journal of Vision, 15(6), 4–4. 10.1167/15.6.4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Notebaert L, Crombez G, Van Damme S, De Houwer J, & Theeuwes J (2011). Signals of threat do not capture, but prioritize, attention: A conditioning approach. Emotion, 11(1), 81–89. 10.1037/a0021286 [DOI] [PubMed] [Google Scholar]
  30. Ohman A, & Mineka S (2001). Fears, phobias, and preparedness: Toward an evolved module of fear and fear learning. Psychological Review, 108(3), 483–522. [DOI] [PubMed] [Google Scholar]
  31. Pessoa L, & Adolphs R (2010). Emotion processing and the amygdala: From a “low road” to “many roads” of evaluating biological significance. Nature Reviews Neuroscience, 11(11), 773–783. 10.1038/nrn2920 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Petro NM, Gruss LF, Yin S, Huang H, Miskovic V, Ding M, & Keil A (2017). Multimodal Imaging Evidence for a Frontoparietal Modulation of Visual Cortex during the Selective Processing of Conditioned Threat. Journal of Cognitive Neuroscience, 29(6), 953–967. 10.1162/jocn_a_01114 [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Pourtois G, Schettino A, & Vuilleumier P (2013). Brain mechanisms for emotional influences on perception and attention: What is magic and what is not. Biological Psychology, 92(3), 492–512. 10.1016/j.biopsycho.2012.02.007 [DOI] [PubMed] [Google Scholar]
  34. Reynolds JH, & Heeger DJ (2009). The Normalization Model of Attention. Neuron, 61(2), 168–185. 10.1016/J.Neuron.2009.01.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Rossion B, & Boremanse A (2011). Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials. Journal of Vision, 11(2). 10.1167/11.2.16 [DOI] [PubMed] [Google Scholar]
  36. Thigpen NN, Gruss LF, Garcia S, Herring DR, & Keil A (2018). What does the dot-probe task measure? A reverse correlation analysis of electrocortical activity. Psychophysiology, 55(6), e13058 10.1111/psyp.13058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Treisman AM, & Kanwisher NG (1998). Perceiving visually presented objects: Recognition, awareness, and modularity. Current Opinion in Neurobiology, 8, 218–226. [DOI] [PubMed] [Google Scholar]
  38. Wieser MJ, Miskovic V, & Keil A (2016). Steady-state visual evoked potentials as a research tool in social affective neuroscience. Psychophysiology, 53(12), 1763–1775. 10.1111/psyp.12768 [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Wolfe JM, & Horowitz TS (2017). Five factors that guide attention in visual search. Nature Human Behaviour, 1(3), 0058 10.1038/s41562-017-0058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Yin S, Liu Y, Petro NM, Keil A, & Ding M (2018). Amygdala Adaptation and Temporal Dynamics of the Salience Network in Conditioned Fear: A Single-Trial fMRI Study. eNeuro, 5(1), ENEURO.0445–17.2018. 10.1523/ENEURO.0445-17.2018 [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES