Abstract
After attention has been involuntarily captured by a distractor, how is it reoriented toward a target? One possibility is that attention to the distractor passively fades over time, allowing the target to become attended. Another possibility is that the captured location is actively suppressed so that attention can be directed toward the target location. The present study investigated this issue with event-related potentials (ERPs), focusing on the N2pc component (a neural measure of attentional deployment) and the Pd component (a neural measure of attentional suppression). Observers identified a color-defined target in a search array, which was preceded by a task-irrelevant cue array. When the cue array contained an item that matched the target color, this item captured attention (as measured both behaviorally and with the N2pc component). This capture of attention was followed by active suppression (indexed by the Pd component), and this was then followed by a reorienting of attention toward the target in the search array (indexed by the N2pc component). These findings indicate that the involuntary capture of attention by a distractor is followed by an active suppression process that presumably facilitates the subsequent voluntary orienting of attention to the target.
INTRODUCTION
Attention can be voluntarily deployed toward relevant information or involuntarily captured by an irrelevant item. Much is known about the mechanisms by which attention is voluntarily or involuntarily allocated, but little is known about how the brain recovers after being involuntarily captured by an irrelevant item so that attention can be reoriented to relevant information. One possibility is that attention passively fades after being involuntarily captured by a distractor. Another possibility is that an active suppression process is applied to disengage attention from the distractor, especially if attention is needed for a concurrent or upcoming target.
The present study assesses the processes that occur during the transition from attentional capture by a distractor to attentional reorienting toward a target. This issue is difficult to study behaviorally, because it involves the processes that intervene between the orienting of attention to one stimulus and the reorienting of attention to another stimulus, and we therefore recorded event-related potentials (ERPs) to provide a continuous measure of attention over this time period. We focused on the N2pc and Pd components. The N2pc component is a well-characterized index of the covert deployment of visual attention (Luck & Hillyard, 1994a,b; see review by Luck, 2012). This component is observed at lateral occipital-temporal scalp sites as a more negative voltage at scalp sites contralateral to an attended item relative to ipsilateral scalp sites, and it typically begins 150–225 ms after stimulus onset. In contrast, the Pd component appears to reflect active attentional suppression (Hickey, Di Lollo, & McDonald, 2009; Kiss, Grubert, Petersen, & Eimer, 2012; Sawaki, Geng, & Luck, 2012; Sawaki & Luck, 2010, 2011). This component is observed at lateral occipital-temporal scalp sites as a more positive voltage at contralateral scalp sites relative to ipsilateral scalp sites, relative to the position of a to-be-suppressed item in a display. It begins 100–400 ms after stimulus onset, depending on the stimuli and task. Using these components, previous studies have investigated the mechanisms by which attention is captured by distractors (indexed by N2pc) and the mechanisms by which the actual capture of attention is prevented by active suppression control in some situations (indexed by Pd). The present study ask a previously unexplored question: how does the brain recover from the involuntarily capture of attention once it has occurred?
The present study used a cuing capture paradigm in which a cue array containing task-irrelevant circles was presented prior to a search array containing a search target (see Figure 1). One of the circles in the cue array could have the same color as the search target, leading to attention capture by this target-color cue. If attention simply fades away passively after being captured by the target-color cue, followed by orienting of attention to the target, an N2pc component should be observed for the target-color cue and then another N2pc component should be observed for the search target. If, however, an active suppression process is applied after attention is captured by the target-color cue, a Pd component should be observed after the N2pc to the target-color cue and before the N2pc to the search target.
METHODS
Participants
The participants were 12 neurologically normal volunteers (8 female, 4 male) between 18 and 30 years old who were paid for their participation. All participants had normal or corrected-to-normal vision and provided informed consent.
Stimuli and Procedure
The stimuli were presented on a video monitor with a black background (luminance: 0.39 cd/m2) and a continuously visible grey fixation cross (0.3° × 0.3°) at a distance of 70 cm (see Figure 1). At the beginning of each block of trials, one member of a set of four colors (red: u' = .46, v' = .50; green: u' = .14, v' = .55; blue: u' = .19, v' = .23; yellow: u' = .26, v' = .53) was designated as the target color. The red-target, green-target, blue-target, and yellow-target blocks occurred in random order.
Each trial began with a blank inter-trial interval (1500–1700 ms, rectangular distribution), followed by a 100-ms cue array. Each cue array consisted of four filled circles (1.6° × 1.6°, centered 2.5° above or below the horizontal meridian and 2.5° to the left or right of the vertical meridian). On 80% of trials, the color of each circle was selected randomly without replacement from the set of four colors (a color never repeated within a given display). On the remaining 20% of trials, all four circles were gray. The colored-circle and gray-circle trials occurred in random order. All stimuli were matched for luminance (18 cd/m2).
After a blank delay period (200 ms), a search array was presented for 100 ms (SOA = 300 ms). It should be noted that prior experiments using this general approach have found capture effects with this 300-ms SOA (Lamy & Egeth, 2003), and no inhibition of return (IOR) would be expected at this SOA because the cues were not purely exogenous (Henderickx, Maetens, & Soetens, 2012). Each search array consisted of four outlined squares (1.9° × 1.9°, centered 2.5° above or below the horizontal meridian and 2.5° to the left or right of the vertical meridian). Two squares had a gap (missing side) on the top and the other two squares had a gap on the bottom; except for this constraint, the location of each gap was selected at random on every trial. The color of each square was selected randomly without replacement from the set of four colors. Participants were instructed to report the location of the target square's gap (top or bottom) by pressing one of two spatially corresponding buttons on a game pad with the right index and middle fingers as quickly and accurately as possible.
The combination of cues and targets led to five types of trials, each with equal probability (320 trials each): same-quadrant trials (target-color cue and target in the same quadrant); vertical-quadrant trials (target-color cue and target directly across the horizontal meridian); horizontal-quadrant trials (target-color cue and target directly across the vertical meridian); diagonal-quadrant trials (target-color cue and target in diagonally opposed positions); and neutral trials (cue circles were gray).
Each participant performed 80 practice trials, followed by 20 blocks of 80 trials during which ERPs were recorded. Participants were explicitly instructed that circles in the cue array were task-irrelevant and did not predict a location of target on the search array. They were required to maintain central fixation throughout each trial, verified with electrooculogram (EOG) recordings (see details below and online supplementary materials).
Recording and Analysis
The electroencephalogram (EEG) and electrooculogram (EOG) were recorded at 1024 Hz with an antialiasing filter at 208 Hz (half-power cutoff) using our standard methods (Sawaki & Luck, 2010). The EEG signals were referenced offline to the average of the left and right mastoids, and bipolar vertical and horizontal EOG derivations were computed for the EOG signals. All signals were bandpass-filtered offline (Butterworth filter, half-power bandwidth of 0.1–30 Hz, roll-off of 12 dB/octave) and then down-sampled to 256 Hz. Averaged ERP waveforms were computed with an 800-ms epoch, beginning 100 ms before cue array onset. The waveforms were collapsed across stimulus colors and locations to eliminate sensory confounds related to these factors. Trials were automatically excluded if they contained an incorrect response or if the RT was shorter than 100 ms or longer than 1100 ms (< 0.9% of trials). A combination of artifact rejection and artifact correction (via independent component analysis) was used to eliminate eye blinks. Trials were also excluded if the post-correction EEG exceeded ±100 μV in any channel, if the vertical or horizontal EOG exceeded ±80 μV, or if a step function applied to the horizontal EOG exceeded 15 μV (see Luck, 2005, p. 161). One participant was replaced because of excessive artifacts. For more details, see online supplementary materials.
N2pc and Pd amplitudes were measured as the difference between electrode sites contralateral and ipsilateral to either the target-color cue or the search target. Both components were measured at the PO7 and PO8 electrode sites, where they were largest in previous studies as well as in the present study. Analyses of variance (ANOVAs) and t-tests were used for statistical tests, and p-values were adjusted when appropriate with the Greenhouse-Geisser corrections to the degrees of freedom.
RESULTS
Behavioral Results
Mean reaction time (RT) and mean hit rate are shown for each trial type in Figure 2. RT was fastest on same-quadrant trials, intermediate on neutral trials, and slowest on the vertical-, horizontal-, and diagonal-quadrant trials. The effect of trial type was significant in a one-way ANOVA [F(4,44) = 36.3, p < .001], and follow-up t tests indicated that RT was significantly faster for same-quadrant trials than for each of the other trial types (p <= .001 for all cases).
A complementary but somewhat weaker pattern was observed for hit rate. The main effect of trial type was again significant [F(4,44) = 4.7, p = .007], and follow-up t tests indicated that hit rate was significantly higher for same-quadrant trials than for vertical-quadrant trials (p = .047) and horizontal-quadrant trials (p = .019). These RT and accuracy effects indicate that the target-color cue captured attention.
ERP Results
Figure 3 shows the ERP waveforms from the same-quadrant, vertical-quadrant, and neutral trials. Separate waveforms are shown for contralateral and ipsilateral sites, relative to the visual hemifield of the target-color cue (and also relative to the target, which was in the same hemifield as the target-color cue on these trials). Contralateral-minus-ipsilateral difference waves are shown in Figure 3D, making it easier to see the N2pc and Pd components.
In both the same-quadrant and vertical-quadrant trials, the N2pc component can be seen as a negative deflection in the contralateral-minus-ipsilateral difference waves, beginning approximately 150 ms after the onset of cue array. A Pd component can also be seen as a positive deflection, beginning approximately 400 ms after the onset of cue array (i.e., 100 ms after the onset of search array). Following the Pd, another N2pc component was observed, beginning approximately 480 ms from the onset of cue array (i.e., .180 ms from the onset of search array).
For the neutral trials, only the target-elicited N2pc component was present, beginning at approximately 450 ms from the onset of cue array (i.e., 150 ms after the onset of search array). On horizontal-quadrant and diagonal-quadrant trials, the cue-elicited Pd and target-elicited N2pc were the same polarity and therefore could not be isolated from each other. Consequently, these data were ambiguous and are not presented here (but are presented in Figure S1 in the online supplementary materials).
To assess the statistical significance of these effects, the voltage was measured from the contralateral-minus-ipsilateral difference waves for the cue N2pc (175–225 ms post cue), the cue Pd (400–450 ms post cue), and the target N2pc (200–300 ms post target) and analyzed with one-sample t-tests and one-way ANOVAs. All statistical results were confirmed with nonparametric permutation tests that do not depend on precisely defined measurement windows (see online supplementary materials).
One-sample t-tests indicated that the N2pc following the cue array was significantly greater than zero for both same-quadrant trials [t (11) = −3.2, p = .009] and vertical-quadrant trials [t (11) = −3.6, p = .004]. The permutation test was also significant for both same-quadrant trials (p = .043) and vertical-quadrant trials (p = .004; Figure S2-A). A one-way ANOVA indicated that the N2pc was not significantly different between these trial types [F (1, 11) = 0.2]. Thus, the target-color cue elicited an N2pc, reflecting the allocation of attention to its location. Because there was no unique lateralized item on neutral trials, there was no way to assess the N2pc component on those trials.
The Pd component (400–450 ms postcue) was also significantly greater than zero for both same-quadrant trials [t (11) = 3.6, p = .004] and vertical-quadrant trials [t (11) = 4.4, p = .001], with no difference between them [F (1, 11) = 0.4]. These effects were confirmed by the permutation tests [same-quadrant trials: p = .038, vertical-quadrant trials: p = .005; Figure S2-B]. Because the Pd effect began approximately 90 ms after search array onset, it is very unlikely that it could have been a response to the target within the search array. Consistent with this, no significant Pd was observed contralateral to the target when it was preceded by a neutral cue [t (11) = −0.2]. Moreover, the difference in Pd amplitude between neutral trials, same-quadrant trials, and vertical-quadrant trials was significant in a one-way ANOVA [F (2, 22) = 7.7, p = .006]. In addition, a Pd was also observed contralateral to the target-color cue when the search target was in the opposite field (see Figure S1 in the online supplementary materials). Thus, the Pd reflected suppression of the target-color cue location and was not a response to the target itself.
The N2pc following the search array was significantly greater than zero for same-quadrant trials [t (11) = −5.6, p < .001], vertical-quadrant trials [t (11) = −4.7, p = .001], and neutral trials [t (11) = −4.0, p = .002]. Permutation tests were also significant [p < .001 for all cases, Figure S2-C]. Thus, attention was shifted back to the target location once the search display appeared. The N2pc was numerically larger on same- and vertical-quadrant trials than on neutral trials, but this effect did not reach significance in a one-way ANOVA [F (2, 22) = 3.3, p = .0558].
To assess the onset and peak latencies of the target N2pc for same- and vertical-quadrant trials, we used a jackknife-based procedure (Miller, Patterson, & Ulrich, 1998). N2pc onset was defined as the latency at which the N2pc (measured from the contralateral-minus-ipsilateral difference wave) reached 50% of the peak amplitude of the waveform (Kiesel, Miller, Jolicoeur, & Brisson, 2008). N2pc onset latency was 493 ms for same-quadrant trials and 499 ms for vertical-quadrant trials. N2pc peak latency was 554 ms for same-quadrant trials and 591 ms for vertical-quadrant trials. The latency values were entered into in a t-test, with the t score corrected according to the formula provided by Ulrich and Miller (2001). This analysis indicated that latency difference between these conditions was marginally significant [onset latency: corrected t (11) = −1.4, p = 0.096; peak latency: corrected t (11) = −1.0, p = 0.176]. This trend of faster N2pc latency in the same-quadrant trials is consistent with behavioral finding (i.e., faster RT in the same-quadrant trials). Note that N2pc latency for neutral trials cannot be directly compared to that for same- and vertical-quadrant trials because the overlapping Pd for the same-quadrant and vertical-quadrant trials likely distorted the apparent N2pc onset and peak latencies (Luck, 2005).
DISCUSSION
Previous studies have shown that, when attention is captured by an item that is task-irrelevant but shares a target feature, attention can reorient fairly rapidly when a target is subsequently presented (Folk, Remington, & Johnston, 1992; Folk, Remington, & Wright, 1994; Lamy & Egeth, 2003; Lamy, Leber, & Egeth, 2004). The present behavioral findings are consistent with this. Specifically, the target in the search array was detected more rapidly when it was preceded by a target-color cue in the same quadrant (compared to the neutral trials), indicating that the cue captured attention. However, target detection was slowed by only about 15 ms when the cue and target appeared in different quadrants (compared to the neutral trials), indicating that attention could be reoriented rapidly after being captured by the target-color cue. The ERPs provide a continuous measure of processing in the period between the onset of the cue and the response to the target, making it possible to understand how this rapid reorienting occurred.
Specifically, the target-color cue led to an N2pc, reflecting the capture of attention by this item (Eimer & Kiss, 2008), but this N2pc was followed by a Pd, which appears to reflect a squashing of attentional priority (see especially Sawaki et al., 2012). Thus, the attentional priority at the location of the target-color cue had been reduced via the Pd mechanism by the time the search array was presented, making it possible to rapidly generate an N2pc to the target whether it appeared in the same quadrant as the preceding target-color cue (i.e., on a same-quadrant trial) or in a different quadrant (i.e., on a vertical-quadrant trial). The priority must not have completely returned to a neutral state, however, because a faster RT and N2pc were observed when the target appeared in the same quadrant as the target-color cue than in a different quadrant. This may reflect an incomplete termination of attention or some parallel mechanism of attention that is not terminated in this manner.
These results do not appear to reflect a passive decay of attention after capture by the target-color distractor. If attention had passively decayed, then the ERPs on trials with a target-color distractor should have been just like the ERPs on neutral trials once the N2pc ended. However, a large Pd was present beginning 400 ms after the onset of the cue array when this array contained a target-color distractor. Several previous studies have now established that this Pd effect reflects an active suppression mechanism that is under top-down control (Hickey et al., 2009; Kiss et al., 2012; Sawaki et al., 2012; Sawaki & Luck, 2010, 2011). The present study adds to this growing literature by showing that this active suppression mechanism is also involved in the transition from attentional capture by a distractor to attentional reorienting toward a target.
Although the Pd occurred slightly after the onset of the search array, the initial portion of the Pd was the same irrespective of the location of the search target (see Figure 2 and Supplementary Figure 1). Thus, the process reflected by the Pd was presumably applied to the location of the target-color cue, not to the target. The onset latency of the Pd component varies over a broad range (ca. 100–400 ms) depending on the stimuli and task, and the observed Pd in the present study was relatively late within the range. Given that the Pd occurred very close to the onset time of the target array, which was the same on each trial, it is possible that the Pd was entrained to the anticipated onset time of the target array. Additional research is necessary to determine the factors that control the timing of this process.
It should be emphasized that target N2pc for neutral trials cannot be directly compared to that for same- and vertical-quadrant trials. Any differences in target N2pc could be a result of the overlapping Pd (Luck, 2005). For this reason, the pattern of target N2pc between neutral trials and same-/vertical-quadrant trials also cannot be directly compared to the pattern of RTs between these trials.
It should be noted that several studies have examined ERPs in similar contingent capture paradigms (Eimer & Kiss, 2008, 2010; Eimer, Kiss, Press, & Sauter, 2009; Leblanc, Prime, & Jolicoeur, 2008; Lien, Ruthruff, Goodin, & Remington, 2008), and some evidence of a Pd was observed in the post-cue portion of the waveforms in all of them. However, the Pd was not fully investigated in these studies because they were conducted before the Pd had been identified as a distinct ERP component and/or because an active suppression process was not the main interest in these studies. Consequently, the paradigms and analyses were not optimal for testing the Pd in these studies. Thus, the present finding appears to be quite general, and the present study provides new insights into the mechanisms by which the brain recovers from involuntary capture of attention.
ACKNOWLEDGEMENTS
This study was made possible by grant R01MH076226 to S.J.L. from the National Institute of Mental Health and by a postdoctoral fellowship to R.S. from the Japan Society for the Promotion of Science.
References
- American Electroencephalographic Society Guidelines for standard electrode position nomenclature. Journal of Clinical Neurophysiology. 1994;11:111–113. [PubMed] [Google Scholar]
- Eimer M, Kiss M. Involuntary attentional capture is determined by task set: Evidence from event-related brain potentials. Journal of Cognitive Neuroscience. 2008;20:1423–1433. doi: 10.1162/jocn.2008.20099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eimer M, Kiss M. Top-down search strategies determine attentional capture in visual search: Behavioral and electrophysiological evidence. Attention Perception & Psychophysics. 2010;72:951–962. doi: 10.3758/APP.72.4.951. [DOI] [PubMed] [Google Scholar]
- Eimer M, Kiss M, Press C, Sauter D. The roles of feature-specific task set and bottom-up salience in attentional capture: An ERP study. Journal of Experimental Psychology: Human Perception and Performance. 2009;35:1316–1328. doi: 10.1037/a0015872. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Folk CL, Remington RW, Johnston JC. Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance. 1992;18:1030–1044. [PubMed] [Google Scholar]
- Folk CL, Remington RW, Wright JH. The structure of attentional control: Contingent attentional capture by apparent motion, abrupt onset, and color. Journal of Experimental Psychology: Human Perception and Performance. 1994;20:317–329. doi: 10.1037//0096-1523.20.2.317. [DOI] [PubMed] [Google Scholar]
- Henderickx D, Maetens K, Soetens E. The involvement of bottom-up saliency processing in endogenous inhibition of return. Attention Perception & Psychophysics. 2012;74:285–299. doi: 10.3758/s13414-011-0234-3. [DOI] [PubMed] [Google Scholar]
- Hickey C, Di Lollo V, McDonald JJ. Electrophysiological Indices of Target and Distractor Processing in Visual Search. Journal of Cognitive Neuroscience. 2009;21:760–775. doi: 10.1162/jocn.2009.21039. [DOI] [PubMed] [Google Scholar]
- Kiesel A, Miller J, Jolicoeur P, Brisson B. Measurement of ERP latency differences: A comparison of single-participant and jackknife-based scoring methods. Psychophysiology. 2008;45:250–274. doi: 10.1111/j.1469-8986.2007.00618.x. [DOI] [PubMed] [Google Scholar]
- Kiss M, Grubert A, Petersen A, Eimer M. Attentional capture by salient distractors during visual search is determined by temporal task demands. Journal of Cognitive Neuroscience. 2012;24:749–759. doi: 10.1162/jocn_a_00127. [DOI] [PubMed] [Google Scholar]
- Lamy D, Egeth HE. Attentional capture in singleton-detection and feature-search modes. Journal of Experimental Psychology: Human Perception and Performance. 2003;29:1003–1020. doi: 10.1037/0096-1523.29.5.1003. [DOI] [PubMed] [Google Scholar]
- Lamy D, Leber A, Egeth HE. Effects of task relevance and stimulus-driven salience in feature-search mode. Journal of Experimental Psychology: Human Perception and Performance. 2004;30:1019–1031. doi: 10.1037/0096-1523.30.6.1019. [DOI] [PubMed] [Google Scholar]
- Leblanc E, Prime DJ, Jolicoeur P. Tracking the location of visuospatial attention in a contingent capture paradigm. Journal of Cognitive Neuroscience. 2008;20:657–671. doi: 10.1162/jocn.2008.20051. [DOI] [PubMed] [Google Scholar]
- Lien M, Ruthruff E, Goodin Z, Remington RW. Contingent attentional capture by top-down control settings: Converging evidence from event-related potentials. Journal of Experimental Psychology. Human Perception and Performance. 2008;34:509–530. doi: 10.1037/0096-1523.34.3.509. [DOI] [PubMed] [Google Scholar]
- Loftus GR, Masson MEJ. Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review. 1994;1:476–490. doi: 10.3758/BF03210951. [DOI] [PubMed] [Google Scholar]
- Luck SJ. An Introduction to the Event-Related Potential Technique. MIT Press; Cambridge, MA: 2005. [Google Scholar]
- Luck SJ. Electrophysiological correlates of the focusing of attention within complex visual scenes: N2pc and related ERP components. In: Luck SJ, Kappenman ES, editors. Oxford Handbook of ERP Components. Oxford University Press; New York: 2012. [Google Scholar]
- Luck SJ, Hillyard SA. Electrophysiological correlates of feature analysis during visual search. Psychophysiology. 1994a;31:291–308. doi: 10.1111/j.1469-8986.1994.tb02218.x. [DOI] [PubMed] [Google Scholar]
- Luck SJ, Hillyard SA. Spatial filtering during visual search: Evidence from human electrophysiology. Journal of Experimental Psychology: Human Perception and Performance. 1994b;20:1000–1014. doi: 10.1037//0096-1523.20.5.1000. [DOI] [PubMed] [Google Scholar]
- Miller J, Patterson T, Ulrich R. Jackknife-based method for measuring LRP onset latency differences. Psychophysiology. 1998;35:99–115. [PubMed] [Google Scholar]
- Posner MI. Orienting of attention. Quarterly Journal of Experimental Psychology. 1980;32:3–25. doi: 10.1080/00335558008248231. [DOI] [PubMed] [Google Scholar]
- Sawaki R, Geng JJ, Luck SJ. A common neural mechanism for preventing and terminating the allocation of attention. Journal of Neuroscience. 2012;32:10725–10736. doi: 10.1523/JNEUROSCI.1864-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sawaki R, Luck SJ. Capture versus suppression of attention by salient singletons: Electrophysiological evidence for an automatic attend-to-me signal. Attention Perception & Psychophysics. 2010;72:1455–1470. doi: 10.3758/APP.72.6.1455. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sawaki R, Luck SJ. Active suppression of distractors that match the contents of visual working memory. Visual Cognition. 2011;19:956–972. doi: 10.1080/13506285.2011.603709. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ulrich R, Miller J. Using the jackknife-based scoring method for measuring LRP onset effects in factorial designs. Psychophysiology. 2001;38:816–827. [PubMed] [Google Scholar]
- Woodman GF, Luck SJ. Serial deployment of attention during visual search. Journal of Experimental Psychology: Human Perception and Performance. 2003;29:121–138. doi: 10.1037//0096-1523.29.1.121. [DOI] [PubMed] [Google Scholar]