Abstract
Interacting with the environment requires the ability to flexibly direct attention to relevant features. We examined the degree to which individuals attend to visual features within and across Detection, Fine Discrimination, and Coarse Discrimination tasks. Electroencephalographic (EEG) responses were measured to an unattended peripheral flickering (4 or 6 Hz) grating while individuals (n = 33) attended to orientations that were offset by 0°, 10°, 20°, 30°, 40°, and 90° from the orientation of the unattended flicker. These unattended responses may be sensitive to attentional gain at the attended spatial location, since attention to features enhances early visual responses throughout the visual field. We found no significant differences in tuning curves across the three tasks in part due to individual differences in strategies. We sought to characterize individual attention strategies using hierarchical Bayesian modeling, which grouped individuals into families of curves that reflect attention to the physical target orientation (“on-channel”) or away from the target orientation (“off-channel”) or a uniform distribution of attention. The different curves were related to behavioral performance; individuals with “on-channel” curves had lower thresholds than individuals with uniform curves. Individuals with “off-channel” curves during Fine Discrimination additionally had lower thresholds than those assigned to uniform curves, highlighting the perceptual benefits of attending away from the physical target orientation during fine discriminations. Finally, we showed that a subset of individuals with optimal curves (“on-channel”) during Detection also demonstrated optimal curves (“off-channel”) during Fine Discrimination, indicating that a subset of individuals can modulate tuning optimally for detection and discrimination.
Keywords: attentional gain, attentional flexibility, perception, EEG, steady-state visual evoked potential
attention biases early visual processing so that relevant information is enhanced and irrelevant information is suppressed or ignored. The neural representations of these attentional biases are routinely demonstrated in early visual areas (e.g., V1) because of their high selectivity to basic visual features (such as orientation). For example, detecting a target of known orientation results in an increased response in neurons selective to the target orientation and a reduced response in neurons sensitive to orientations away from the target (Cohen and Maunsell 2011; Haenny and Schiller 1988; Martinez-Trujillo and Treue 2004; Maunsell et al. 1991; Motter 1993, 1994). Thus attention often enhances the neural representation of the physical features of visual targets. A growing body of evidence demonstrates that attention may also enhance the representation of features away (or “off-channel”) from the physical features of potential targets, in cases where those neurons provide the most relevant information. For example, when discriminating between two gratings nearby in orientation (fine discrimination) it is theoretically more advantageous to enhance the representation of orientations away from the physical orientations of the two gratings, since they demonstrate the largest difference in response (i.e., firing rate) between the two potential targets (Jazayeri and Movshon 2006; Regan and Beverley 1985).
Psychophysical results are consistent with the theoretical account that “off-channel” orientations are most informative for fine discriminations of orientation (Regan and Beverley 1985), directions of motion (Hol and Treue 2001), and spatial frequency (Wilson and Regan 1984). The neural benefits of “off-channel” responses have been demonstrated by the ability of “off-channel” single-unit activity to predict motion direction discrimination (Purushothaman and Bradley 2005) and improved orientation coding in “off-channel” neurons during the perceptual learning of fine discriminations (Raiguel et al. 2006; Schoups et al. 2001). The psychophysical benefits may be related to enhanced “off-channel” responses with attention as demonstrated in BOLD fMRI V1 tuning profiles when individuals were cued to the direction of the nearby change in orientation (Scolari et al. 2012) and as suggested by an increased response to gratings oriented 20° away from fine discrimination orientations (Verghese et al. 2012). These findings suggest that attention shapes early visual processing in a relatively flexible manner, which helps ensure that individuals can deal with the complex discriminations and detections that can usefully be applied to a visual scene.
The present study used the frequency tagging technique to isolate the response of large-scale brain networks to a grating outside the spatial focus of attention while attention was parametrically varied over orientations. The flicker contains a fixed orientation; thus the flickering input in principle originates from early visual neurons sensitive to the flicker features and propagates within the large-scale brain networks sensitive to the flicker frequency (Nunez and Srinivasan 2006; Srinivasan et al. 2006). Attending to a particular orientation at the center of the screen enhances the neural response to that orientation throughout the visual field, including neurons that respond to the spatial location of the unattended flicker (Bichot 2005; Martinez-Trujillo and Treue 2004; Saenz et al. 2002; Serences and Boynton 2007; Treue and Martinez-Trujillo 1999). This widespread influence of attention to one feature has also been demonstrated in steady-state visual evoked potential (SSVEP) responses to a flicker presented at an unattended location (Bridwell and Srinivasan 2012). In this study, the SSVEP response to an unattended flickering grating may provide a measure of the attentional tuning profile, or “attentional tuning curve” over orientations. We measured these tuning profiles while individuals performed Detection, Coarse Discrimination, and Fine Discrimination tasks, which theoretically differ in the degree of complexity of the attentional tuning (e.g., applying a single peak during Detection or 2 peaks during the Discrimination tasks) or the orientation where gain should optimally be applied (e.g., “on-channel” for Detection and Coarse Discrimination but “off-channel” during Fine Discrimination) (Fig. 1 and Fig. 2).
Comparing the shape of the SSVEP estimate of attention tuning curves for Detection, Fine Discrimination, and Coarse Discrimination allowed us to estimate the strategies that individuals employ during different tasks, to determine whether those strategies are related to individual differences in behavioral performance, and to examine whether individuals can flexibly distribute attention in an optimal manner across the different tasks.
METHODS
Participants.
Thirty-four individuals (20 men, 14 women; 1 left handed) between the ages of 18 and 35 yr (mean age: 24 yr, median age: 22 yr) were recruited to participate in four sessions, comprising one psychophysical (threshold) and three SSVEP sessions. Two individual sessions were excluded because of experimental error, reducing the number of participants to 33 for Detection and Fine Discrimination. Each individual reported normal or corrected to normal vision and had no family history of epilepsy. This study was conducted in accordance with an experimental protocol approved by the Institutional Review Board of the University of California, Irvine. All participants gave informed written consent at the start of the first session. The individuals' ability to maintain fixation was monitored within each session with an SMI eye-tracker (iView Red) camera. Each individual participated in one of four conditions: a left visual field f1 = 4 Hz (contrast reversal; square wave) flicker with a 0° unattended grating (n = 19) or a 45° unattended grating (n = 4) or a left visual field f1 = 6 Hz flicker with a 0° unattended grating (n = 7) or a 45° unattended grating (n = 4).
Stimuli.
Stimuli were produced by a Power Mac G4 using MATLAB (version 5.2.1.1421; The MathWorks, Natick, MA) and Psychophysics Toolbox (Brainard 1997; Pelli 1997) and displayed on a 19-in. monitor (Viewsonic PF790) with a vertical refresh of 60 Hz. Subjects viewed the monitor from a distance of 57 cm.
Three black concentric circles were displayed centered on fixation (Fig. 1). The inner circle [radius = 3.5° of visual angle (dva)] enclosed the location where Gabor targets would appear, and the two outer circles (radius = 5.3 and 12.5 dva) enclosed the location of the unattended flickering half-annulus. A static checkerboard was displayed within the center circle. The checkerboard was introduced after initial pilot studies showed that individuals had a more difficult time detecting targets when they appeared within a high-contrast texture. Thus the checkerboard helped increase task difficulty and helped ensure that individuals' detection thresholds are above the lowest contrast value that can be presented. The checkerboard was 80% of the maximum achievable contrast. The minimum and maximum luminance were 0.3 and 83 cd/m2, respectively, with a gray background of 39 cd/m2. The individual squares that comprised the checkerboard were 1.4 dva (40 × 40 pixels).
An unattended flickering grating (f1 = 4 Hz or f1 = 6 Hz) was presented in the left visual field during each trial. The spatial frequency of the grating was 0.35 cycles/°, which matched the center frequency of the Gabor targets that appeared within the inner circle, centered on fixation. The Gabor targets contained a falloff away from center specified by a Gaussian with a standard deviation of 1.7 dva. The Gabor target was displayed averaged against the background texture, and the background texture was averaged against the gray background when the Gabor was not present.
Task.
Individuals performed either a Detection or a Coarse or Fine Discrimination task. During Detection individuals detected a single Gabor target presented within the static background checkerboard. During Coarse Discrimination individuals discriminated between two potential Gabor targets that were oriented either 45° clockwise (cw) or counterclockwise (ccw) from a reference orientation. During Fine Discrimination individuals discriminated between two potential Gabor targets that were oriented either 4° cw or ccw from a reference orientation (see Fig. 1). The Gabor target orientation (for Detection) or the reference orientation (for Coarse and Fine Discrimination) deviated from the orientation of the unattended flickering grating by 0°, 10°, 20°, 30°, 40°, or 90°. Thus with increasing orientation offset either the single physical target moves away from the unattended flicker orientation (during Detection), one of two potential targets moves away from the unattended flicker orientation (during Coarse Discrimination), or each of the two potential targets moves away from the unattended flicker orientation (during Fine Discrimination). For example, in the 10° offset Detection condition the single physical target was directly offset from the unattended flicker orientation by 10°. During Coarse Discrimination one of the two potential targets was directly offset by 10° and the other target was offset by 100°. During Fine Discrimination the reference orientation was offset by 10° and the two potential targets were offset 6° and 14° from the reference. The unattended flickering grating was displayed at a fixed orientation and contrast (80%) for each subject during all EEG recording sessions (either 0° or 45° from vertical).
Threshold procedure.
An initial psychophysics session was conducted to determine the target level (i.e., the Gabor contrast) corresponding to the individual's 85% Detection and Coarse and Fine Discrimination thresholds. Individuals viewed instructions indicating which of the three tasks would be performed at the start of each block, followed by an example of the Gabor target orientation (for Detection) or the reference orientation (for Coarse and Fine Discrimination). During each trial (of a random duration uniformly distributed between 1,517 and 3,267 ms) individuals were instructed to use their right hand to press “l,” “k,” or “j” to indicate if the target was present or shifted clockwise with “high,” “medium,” or “low” confidence, respectively. Individuals used their left hand to press “s,” “d,” or “f” to indicate if the target was absent or counterclockwise with “high,” “medium,” or “low” confidence, respectively. Targets appeared on 80% of the Detection trials, and the two potential targets were equally likely to appear during the Discrimination tasks. The target level presented on each trial was determined with maximum likelihood estimation (MLE) [adapted from the MLP toolbox (Grassi and Soranzo 2009)].
The unattended flickering grating was presented in the left visual field at a fixed orientation and contrast (80%) for each subject during all sessions (either 0° or 45° from vertical). The unattended flicker location, orientation, and frequency were fixed throughout each session and served as the location, orientation, and frequency in the subsequent SSVEP sessions. Subjects participated in two blocks of each task. The initial 15 trials of each block consisted of training with the target contrast fixed and sound feedback provided, followed by 40 threshold trials without feedback.
Separate thresholds were used for Fine Discrimination since initial piloting indicated that individuals were better at fine discriminations along the meridian. Fine Discrimination threshold estimates were obtained in one block for discriminations along the vertical meridian and in the second block for the orientations away from the vertical meridian. The threshold obtained at the meridian was used as the target contrast for subsequent SSVEP trials in which the reference appeared within 10° from the meridians (e.g., for the 0°, 10°, and 90° offsets with the 0° unattended grating and for the 40° offset with the 45° unattended grating). The threshold away from the meridian was used for SSVEP trials at the remaining reference orientations (e.g., for 20°, 30°, and 40° offsets with the 0° unattended grating and for the 0°, 10°, 20°, 30°, and 90° offsets for the 45° unattended grating).
Individuals participated in two Detection and Coarse Discrimination blocks. The target orientation (for Detection) or reference orientation (for Coarse Discrimination) was fixed within a block at 0°, 10°, 30°, or 40°. The particular orientation offset was assigned randomly to each block. The two threshold estimates obtained for each task were averaged together, generating a single threshold estimate for Detection and a single threshold estimate for Coarse Discrimination. These thresholds were used to equate performance in the corresponding SSVEP sessions.
SSVEP procedure.
As in the threshold procedure, each SSVEP trial began with instructions to either detect a single Gabor or discriminate between two potential Gabors oriented 45° or 4° cw or ccw from reference. Individuals were shown an example of the Gabor target (for Detection) or the reference orientation (for Coarse and Fine Discrimination) at high contrast, and again at their threshold contrast level. The 40-s SSVEP trial was then initiated with the onset of the flicker, and individuals detected target Gabors at center and pressed a button if the target was either present (for Detection) or clockwise or counterclockwise (for Coarse and Fine Discrimination). Targets were presented randomly but on average every 5 s (duration = 333 ms) within the 40-s trial. Individuals performed the same task within a single session, and each orientation was repeated six times per session (counterbalanced over 6 blocks in a Latin square). The unattended flickering grating was presented in the left visual field throughout each trial.
EEG recording.
EEG was recorded with a 128-channel Geodesic Sensor Net (Tucker 1993). To synchronize stimulus information with EEG recording, eight electrodes on the outer ring were disabled to record the activity of photocells placed on the monitor. An additional 10 channels on the outer ring were discarded because of a high susceptibility to muscle artifacts. The EEG signals were sampled at 1,000 Hz with a 50-Hz analog low-pass filter. EEG signals were initially recorded with a vertex reference and were mathematically referenced to the average of the 110 channels for analysis. The subject's response to targets was recorded by a switch connected to the EEG system. The subject's ability to maintain fixation was monitored with an SMI eye-tracker (iView Red) camera.
SSVEP analysis.
Steady-state responses to a contrast reversal flicker primarily occur at the second harmonic of the flicker frequency (Regan 1989). Steady-state responses were estimated by decomposing each ∼40-s trial of EEG recording with the discrete Fourier transform (DFT) (Δf ∼ 0.025 Hz) implemented with the fast Fourier transform (FFT) function in MATLAB (version 7.11; The MathWorks). The exact duration was an integer number of periods of the flicker. We examined the magnitude of SSVEP responses at each channel within the narrow window corresponding to the stimulus frequency by calculating the signal-to-noise ratio (SNR): the ratio of the power in the second harmonic and the average power in the 100 surrounding frequency bins (see Sutoyo and Srinivasan 2009). SNRs were averaged over a set of eight left parietal and eight right parietal-temporal electrodes that captured the prominent peak SNR response within each task (see Fig. 3). The overall average SNR overlaps well with the 16 electrodes that cover the peak response in individual subjects and sessions (i.e., at least 1 electrode overlaps within 98 of 100 subjects/sessions).
The SNR value of the 16 electrodes was averaged to construct the individual subject SNR curves. Differences in SNR with increasing orientation offset were examined by normalizing each individual subject's SNR profile by his/her mean response and conducting a one-way ANOVA with the orientation offset as the within-subject variable (α = 0.05). Statistical tests were conducted with MATLAB subroutines (version 7.11; The MathWorks). For clarity, tuning profiles are plotted after normalizing the average SNR by the SNR at 0° offset (indicating the percent modulation from zero) (Fig. 3).
Individual curves and Bayesian graphical modeling.
Individual differences in attentional strategies were examined in order to determine whether different tuning profiles were related to differences in behavior and whether individuals were able to use the optimal tuning profile across tasks. Individual differences were characterized with a hierarchical Bayesian model. The model formally “decomposes” each individual tuning curve into one of three families of circular normal (von Mises) curves constrained by a small slope (i.e., uniform gain), a large slope and a preferred orientation around 0° offset (i.e., attend “on-channel”), or a large slope with a preferred orientation away from 0° (i.e., attend “off-channel”) (see Fig. 4).
The observed SSVEP tuning profile R will approximate a flat line over orientations if individuals apply uniform gain. Alternatively, the response may peak at the physical target orientation if individuals enhance the gain of the physical target orientation and/or suppress the gain of orientations away from the physical targets (i.e., attention is “on-channel”). The response may peak away from the physical target orientation if individuals enhance the gain of neurons that code orientations away from the physical targets (i.e., if they attend “off-channel”). Each of these three potential approaches may be captured by constraining the parameters of a von Mises (circular normal) distribution: R = exp[κ cos(μ)], where μ is the orientation offset between the target and the flicker orientation (here 0°, 10°, 20°, 30°, and 40°) and κ is a scale parameter. Constraining the function to small values of κ (e.g., −0.01 < κ < 0.2)1 generates a family of flat curves capturing a uniform distribution of attentional gain. Restricting κ to larger values (e.g., 0.2 < κ < 4) generates a family of curves with a peak response at either the physical target orientation (e.g., −15° < μ < 8°) or away from the physical target orientation (e.g., 8° < μ < 50°).
Bootstrap resampled SNR values were used as repeated observations in each run of the Bayesian graphical model, implemented in WinBUGS software (Lunn et al. 2000). SNR values were obtained for each orientation offset i, subject j, and bootstrapped permutation p (Fig. 4). Specifically, Fourier analysis was conducted on the individual trials and the power values (6 for each orientation offset) were resampled and averaged to generate a single bootstrapped resampled power value for a given offset. The power values within the 100 neighboring frequency bins were also resampled and averaged, generating a bootstrapped measure of noise. The bootstrapped power corresponding to the flicker frequency was divided by the power in the surrounding frequency bins generating the SNR. One thousand posterior samples were obtained for a single run of the model with the fixed set of bootstrapped resampled SNR values.
The model was implemented repeatedly with different upper or lower boundaries for κ and μ in order to ensure that the parameter inference (i.e., the assignment to a particular family of curves) generalized over a range of parameter boundaries. The lower boundaries of κ (for the curves representing a uniform distribution of attention) were [−0.04 −0.03 −0.02 −0.01]. The upper boundaries of κ values [representing the boundary between curves with a peak (i.e., “on-channel” or “off-channel”) and without a peak (i.e., “uniform”)] were [0.1 0.12 0.15 0.2]. The upper boundary for curves with a peak was fixed for all runs at 4. The lower μ boundaries (representing the boundary between the “on-channel” and “off-channel” curves) were [−25 −20 −15], while the upper boundary for μ was fixed at 50 across all runs of the model. For example, one run of the model sampled κ values continuously from the interval from [−0.04 to 0.2] and μ values continuously from the interval from [−25 to 50]. The model was run with the entire 48 combinations of parameter boundaries (e.g., 4 lower κ boundaries, 4 upper κ boundaries, and 3 lower μ boundaries generate 48 combinations).
The full graphical model is displayed in Fig. 4 with plate notation (for an introduction see Shiffrin et al. 2008). Each individual's group assignment is provided by the “switch” parameters Z1j and Z2j, which provide inference on the relative probability in which each of the three potential families may have generated the observed data. For example, on a single iteration the data may be generated by a family of uniform curves(Z1j = 1), a family with peak gain at the target orientation (Z1j = 2, Z2j = 1), or a family with peak gain away from the target orientation (Z1j = 2, Z2j = 2). The parameters are estimated on each iteration of the WinBUGS (Gibbs) sampler (1,000 iterations × 48 model implementations; 500 burn-in iterations per implementation). The average value over the (48,000) posterior observations captures the relative probability that the observed data belong to each of the three families of curves. This probability was rounded to a discrete value to assign each individual to one of three families for further analysis.
Strategies and behavioral results.
The average detection or discrimination thresholds (obtained at the start of the experiment) were calculated for the subset of individuals who applied each of the three different strategies for each of the three different tasks. This allowed us to examine the perceptual benefits of applying different strategies for each of the three tasks (e.g., whether individuals who apply the “optimal” strategy are better at performing the task). We identified differences in behavioral thresholds by conducting a nonparametric bootstrap analysis. [A nonparametric test was performed because of the nonnormality of the threshold data, e.g., 40% (n = 40 of 100) of threshold values were at the minimum achievable contrast level of 2%]. Differences in thresholds were reported if the observed difference in threshold was >95% of the differences in threshold obtained after sampling randomly within each group with replacement (10,000 samples) (Efron and Tibshirani 1993).
Strategies across tasks.
We examined whether individuals used a common pattern of strategies across Detection, Coarse Discrimination, and Fine Discrimination. Of particular interest was whether individuals were able to apply the optimal strategy over multiple tasks. For example, did the individuals who attended “on-channel” during Detection also attend “off-channel” during Fine Discrimination? To address this question we calculated the number of individuals who applied a particular pair of strategies over a pair of tasks. This count was compared with the number of individuals who demonstrated the same pattern after permuting the subject labels for each task (with replacement).
Statistical analysis.
The subsequent analysis on the individual groups comprised a total of nine statistical tests. Six statistical tests were conducted comparing differences in behavioral thresholds for individuals assigned to different families of curves. For example, we examined whether individuals assigned to the “on-channel” curves had lower detection thresholds than those assigned to “uniform” or “off-channel” during both Course Discrimination and Detection, and we examined whether individuals assigned to “off-channel” curves during Fine Discrimination had lower detection thresholds than those assigned to “uniform” or “on-channel.” An additional three statistical tests were performed in examining the flexibility with which individuals directed attention across the tasks. This consisted of a statistical interaction between task and orientation and two bootstrap tests examining whether a significant number of individuals were assigned to the “off-channel” curves for Fine Discrimination and “on-channel” curves for either Detection or Course Discrimination. Eight of nine a priori tests were significant at an uncorrected threshold of P < 0.05. Two of the nine tests were significant after Holm-Bonferroni correction for multiple comparisons (with P < 0.0021 and P < 0.0034).
RESULTS
Behavior.
The average 85% thresholds were 3.6 for Detection (D) (SE = 0.49; n = 33), 6.0 for Coarse Discrimination (CD) (SE = 1.39; n = 34), and 15.3 for Fine Discrimination (FD) (SE = 1.12; n = 33). The average hit rate in the subsequent SSVEP experiment was 80.2%, 82.7%, and 68.3% correct for Detection, Coarse Discrimination, and Fine Discrimination, respectively. The hit rate and false alarm rate in the SSVEP experiment were combined to generate A′, a nonparametric measure of perceptual sensitivity (See et al. 1997; Stanislaw and Todorov 1999) for each task and orientation offset. A two-way repeated-measures ANOVA was conducted for the 32 subjects who participated in all conditions, with the factors “task” (D, CD, or FD) and “orientation offset” (0°, 10°, 20°, 30°, or 40°). We found no significant differences in log(A′) with increasing orientation offset [F(4,124) = 1.11, P = 0.35] or across tasks [F(2,62) = 1.41, P = 0.25] and an interaction between “task” and “orientation offset” [F(8,248) = 2.22, P = 0.03].
Attentional tuning curves (SSVEP responses over orientation).
The SNR of the SSVEP response was measured while individuals detected targets that overlapped with the flicker orientation by 0°, 10°, 20°, 30°, 40°, and 90°. We anticipated that the maximum SNR will be observed when the flicker orientation aligns with the peak of the attentional tuning function. We found a monotonic decline in the SNR with increasing orientation offset during Detection and Fine Discrimination from 0° to 30° offsets (Fig. 3). The decline from 0° to 30° was more pronounced during Detection, with a maximum percent reduction in SNR (from 0°) of 6.0% when the target orientation was offset from the flicker orientation by 30° (compared with 2.9% for Fine Discrimination and 1.9% for Coarse Discrimination at 40°). Despite the trend in which responses to the unattended flicker are reduced with increasing offset (e.g., the majority of points falling below 0 in Fig. 3), a one-way ANOVA revealed no significant differences in SNR with orientation for each of the three tasks [F(5,192) = 1.49, P = 0.194; F(5,198) = 0.36, P = 0.874; and F(5,192) = 1.67; P = 0.144 for D, CD, and FD, respectively].
The absence of robust differences at the group level may be due to a number of factors that can contribute variance to the SSVEP curves. For example, attentional gain may be less spatially widespread in some subjects and may depend on task difficulty. In addition, the horizontal unattended flicker may have sampled a larger population of neurons than the oblique flicker, individuals may have utilized a mixture of strategies within a task, and there may be individual differences in attention strategies within detection and fine and coarse discriminations. The subsequent analysis focused on the contribution of individual differences by examining whether SSVEP curves are related to perceptual performance and whether individuals can flexibly apply different strategies over different tasks.
Evaluating attentional strategies and behavior.
Individual differences in attention strategies were characterized with a hierarchical Bayesian model. We found that 26%, 33%, and 41% of the sessions (e.g., tasks and individuals) were assigned to uniform, “on-channel,” and “off-channel,” respectively. The individual average mean (μ) and scale (κ) parameters are indicated in Fig. 5.
The individual assignments to uniform, “on-channel,” and “off-channel” were determined based on the entire data set, as described in methods. We verified that these assignments would generalize to data that were not included in the model by dividing the data in half into a training and a test data set. The Bayesian model estimation was conducted identically as before on the training set, and then the average SNR was obtained with the test data for each subject. Subject assignments were determined for the test data set by finding the family of curves (e.g., the uniform, “on-channel,” and “off-channel” curves) that best fit the average SNR of the test data. We found 78% agreement between the assignments from the training and the test data. In addition, the average curve within the test data demonstrated the pattern of modulation suggested by the training data. For example, the individuals assigned to “on-channel” with the training data demonstrated the largest average response at 0° orientation offset within the test data, while the individuals assigned to “off-channel” with the training data demonstrated the largest average response at the 20° orientation offset in the test data.
It is likely that different attentional strategies are associated with differences in perceptual performance. For example, individuals with enhanced responses to the target orientation (i.e., those with “on-channel” curves) may contain an enhanced perceptual representation of the target. This enhanced perceptual representation may manifest as a reduction in detection/discrimination thresholds within the individuals who attend “on-channel” during Detection and Coarse Discrimination (Regan and Beverley 1985). Alternatively, individuals with enhanced responses within “off-channel” neurons may be better at discriminating nearby orientations. This result would be consistent with the account that “off-channel” neurons provide the most relevant information for fine discrimination (Jazayeri and Movshon 2006; Navalpakkam and Itti 2007; Scolari et al. 2012; Scolari and Serences 2009).
We observed the lowest thresholds for individuals with “on-channel” curves during Detection and Coarse Discrimination (mean % contrast: 2.68 and 2.83, respectively). In each case, the threshold was lower than the threshold of the group that applied uniform gain (difference in % contrast: 1.15, CI: [−0.02 3.18], P = 0.0267 and difference in % contrast: 6.92, CI: [−2.80 10.24], P = 0.0362). During Fine Discrimination, the lowest thresholds were observed for the individuals with “off-channel” curves (mean % contrast: 12.51), followed by “on-channel” (mean % contrast: 15.45) and uniform (mean % contrast: 21.78). The groups with “off-channel” and “on-channel” curves had significantly lower thresholds than the group with uniform curves (difference in % contrast: 9.27, CI: [4.10 14.07], P = 0.0034; difference in % contrast: 6.32, CI: [2.49 11.69], P = 0.0442) (see Fig. 6). Thus the results suggest that during each of the three tasks the individuals who attended “on-channel” had significantly lower thresholds than the individuals who applied uniform gain. Individuals who attended “off-channel” additionally had significantly lower thresholds (compared with the individuals who applied uniform gain) during Fine Discrimination.
Evaluating the flexibility of attentional strategies.
We next examined whether individuals applied a common pattern of strategies across a pair of tasks. Specifically, we were interested in whether individuals who were assigned to the optimal family of curves during Detection or Coarse Discrimination (e.g., “on-channel”) were also assigned to the optimal family of curves during Fine Discrimination (e.g., “off-channel”). Nonparametric bootstrap tests (10,000 samples) revealed that a significant subset of individuals attended “on-channel” during Detection and “off-channel” during Fine Discrimination (n = 8; P = 0.0125). The number of individuals who apply a pattern of curves over tasks is demonstrated in Fig. 7. Figure 8 demonstrates the topographic distribution of SNR responses for an individual with an on-channel curve for Detection and an off-channel curve for Fine Discrimination.
To examine this pattern further, we took the subset of individuals assigned to a particular curve during one task and examined their average percent modulation in each of the other two tasks. Significant differences in strategies across tasks were investigated by examining the interaction between “task” and “orientation” in a two-way ANOVA with the percent modulation (from mean SNR) as the dependent variable. There was a significant interaction between “task” and “orientation” for the subset of individuals assigned to “off-channel” curves during Fine Discrimination (in Fig. 9) [F(10,216) = 2.88, P = 0.0021]. The interaction approached significance for the subset of individuals assigned to “on-channel” curves during Fine Discrimination (in Fig. 9) [F(10,180) = 1.84, P = 0.0571]. The individuals assigned to the “on-channel” curves during Fine Discrimination demonstrate a similar pattern of responses for Coarse Discrimination but a more uniform pattern of responses during Detection. The individuals assigned to the “off-channel” curves during Fine Discrimination show a reduced SNR from 0° to 30° offsets (Fig. 9) for Detection. This pattern likely contributed to the observed interaction and is consistent with the finding that a significant number of individuals attend “off-channel” during Fine Discrimination and “on-channel” during Detection.
DISCUSSION
Psychophysical studies suggest that neurons coding “off-channel” orientations are most informative during fine discriminations (Hol and Treue 2001; Regan and Beverley 1985; Scolari and Serences 2009; Wilson and Regan 1984). BOLD fMRI studies further demonstrate that “off-channel” activity within early sensory areas is predictive of subsequent fine discrimination performance (Scolari et al. 2012; Scolari and Serences 2010). The present study extends these results with a novel technique that aims to measure attentional tuning profiles within frequency-tagged cortical networks. We found considerable individual variability in the tuning curves during Detection and Coarse and Fine Discrimination tasks. Decomposing tuning profiles into “on-channel,” “off-channel,” and uniform strategies with Bayesian modeling allowed us to characterize these individual differences according to their relation with behavioral performance and their distribution across tasks.
We found that the individuals with “on-channel” curves had significantly lower detection and discrimination thresholds for each of the three tasks compared with the individuals with uniform curves. During Fine Discrimination we also found that the individuals with “off-channel” curves had significantly lower discrimination thresholds than the individuals with uniform curves. These results suggest that there are perceptual benefits to enhancing the gain of neurons coding the physical features of target stimuli during detection and fine and coarse discrimination tasks. The additional presence of significantly lower thresholds for individuals attending “off-channel” during Fine Discrimination is consistent with previous studies demonstrating that fine discrimination encourages enhancing the gain of neurons coding orientations slightly offset from the target orientation. Collectively, the results add to the growing body of literature indicating that individuals can apply gain in an optimal manner and demonstrate that differences in gain are functionally related to differences in behavioral performance.
Individuals are theoretically motivated to distribute attentional gain in different ways over each of the three tasks. The distribution of attentional gain differs in terms of the optimal place to apply peak gain (e.g., “on-channel” during Detection but “off-channel” during Fine Discrimination) and the complexity of attentional tuning (e.g., 1 peak for Detection compared with 2 peaks for Discrimination). Applying the optimal strategy across each of these tasks encourages individuals to shape their attentional tuning in a relatively flexible manner. We examined the number of individuals who applied a particular pattern of strategies across two tasks and found that a significant number of individuals demonstrated “on-channel” curves during Detection and “off-channel” curves during Fine Discrimination. These results suggest that there are only a subset of individuals who apply the optimal strategy in the context of detection and fine discriminations.
The present tuning profiles are reflected within cortical networks targeted with the SSVEP. In contrast, previous findings on the influence of attention on sensory gain have been largely restricted to early sensory areas that are robustly tuned to the stimulus feature. These constraints arise because of both the innate differences in the neural sensitivity to stimulus features as well as the particulars of the recording technique. For example, single-unit studies demonstrate that orientation tuning curves may be measured over a series of anatomically and functionally isolated visual areas (e.g., V1, V2, and V4), and the degree of attentional modulation is increased within areas with more complex stimulus-response properties (e.g., V4 vs. V1) (McAdams and Maunsell 1999). The single-unit dynamics captured by electrophysiological recordings are not captured by the comparatively lower spatial resolution of the BOLD fMRI voxel; however, recent techniques demonstrate that orientation information may be extracted at least in area V1, which contains a high density of orientation-selective cells (Haynes and Rees 2005; Kamitani and Tong 2005; Serences et al. 2009).
The frequency tagging technique provides the opportunity to isolate cortical activity that is time-locked to a periodic visual input with a fixed orientation. Thus, while EEG is incapable of measuring the orientation profile of individual neurons, it is a promising method to monitor the activity of cortical networks that entrain with neurons sensitive to the flicker orientation. Enhanced gain within early sensory areas is well posed to propagate to brain networks that synchronize with the periodic visual input. Thus a unique contribution of the frequency tagging technique is that it can potentially provide a measure of the response to basic visual features beyond the earliest stages of visual processing. However, further studies are required to determine precisely how the frequency-tagged network activity in the present study is related to activity within the early sensory areas traditionally examined with single-unit and BOLD fMRI measures.
It is important to note that the individual tuning profiles in the present study were measured by isolating the SSVEP response to an unattended flicker. Thus the experimental design leverages upon the phenomenon that attending to a feature at one location also results in an enhanced response to that feature within neurons or voxels sensitive to unattended spatial locations (Bichot 2005; Martinez-Trujillo and Treue 2004; Saenz et al. 2002; Serences and Boynton 2007; Treue and Martinez-Trujillo 1999). Within this context, the unattended flicker may serve as a “probe” to measure the attentional strategy applied at the attended spatial location. Previous studies examining the influence of “off-channel” attentional gain have focused on neurons that code the attended regions of the visual display. Thus, as far as we are aware, the present study is the first to explicitly examine whether “off-channel” gain also extends to neurons coding unattended regions of the visual field and the implication of their attentional profile on visual perception and attention strategies applied over different tasks.
Conclusion.
Individuals' tuning curves were examined by measuring the SSVEP response to a fixed orientation while individuals attended to a range of orientations during Detection, Coarse Discrimination, and Fine Discrimination tasks. There were no statistical differences in the overall tuning profile across the three tasks. The absence of robust effects may result in part from variability in individual attention strategies as suggested by the relationship between SSVEP curves and perceptual performance and the relationship of SSVEP curves across tasks. Individuals with tuning curves centered on the physical target orientation (i.e., “on-channel”) had significantly lower detection/discrimination thresholds than those with uniform curves. Individuals with curves that peaked away from the target orientation during Fine Discrimination additionally demonstrated significantly lower discrimination thresholds (compared with those who applied uniform gain). This emphasizes the perceptual benefits of attending “off-channel” during fine discriminations. Furthermore, a significant subset of individuals applied “on-channel” attentional tuning during Detection and “off-channel” tuning during Fine Discrimination tasks. This demonstrates that some individuals may flexibly and optimally apply attention during detection and fine discrimination.
GRANTS
This work was supported by National Institute of Mental Health Grant 2 R01 MH-68004.
DISCLOSURES
No conflicts of interest, financial or otherwise, are declared by the author(s).
AUTHOR CONTRIBUTIONS
Author contributions: D.A.B., J.T.S., and R.S. conception and design of research; D.A.B. and E.A.H. analyzed data; D.A.B., J.T.S., and R.S. interpreted results of experiments; D.A.B. prepared figures; D.A.B. drafted manuscript; D.A.B., J.T.S., and R.S. edited and revised manuscript; D.A.B., E.A.H., J.T.S., and R.S. approved final version of manuscript; E.A.H. performed experiments.
ACKNOWLEDGMENTS
We thank Barbara Dosher, George Sperling, and Michael Lee for helpful comments.
Footnotes
The curve is flipped along the horizontal axis when the sign of κ changes. Negative κ values help ensure that small fluctuations in a uniform response (e.g., due to noise) are not misattributed to the “on-channel” or “off-channel” family of curves.
REFERENCES
- Bichot NP. Parallel and serial neural mechanisms for visual search in macaque area V4. Science 308: 529–534, 2005 [DOI] [PubMed] [Google Scholar]
- Bisley JW. Neuronal activity in the lateral intraparietal area and spatial attention. Science 299: 81–86, 2003 [DOI] [PubMed] [Google Scholar]
- Brainard DH. The Psychophysics Toolbox. Spat Vis 10: 433–436, 1997 [PubMed] [Google Scholar]
- Bridwell DA, Srinivasan R. Distinct attention networks for feature enhancement and suppression in vision. Psychol Sci 23: 1151–1158, 2012 [DOI] [PubMed] [Google Scholar]
- Cohen MR, Maunsell JH. Using neuronal populations to study the mechanisms underlying spatial and feature attention. Neuron 70: 1192–1204, 2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbetta M, Patel G, Shulman GL. The reorienting system of the human brain: from environment to theory of mind. Neuron 58: 306–324, 2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbetta M, Shulman GL. Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci 3: 215–229, 2002 [DOI] [PubMed] [Google Scholar]
- Crapse TB, Sommer MA. Frontal eye field neurons with spatial representations predicted by their subcortical input. J Neurosci 29: 5308–5318, 2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Efron B, Tibshirani R. An Introduction to the Bootstrap. London: Chapman and Hall, 1993 [Google Scholar]
- Fanini A, Assad JA. Direction selectivity of neurons in the macaque lateral intraparietal area. J Neurophysiol 101: 289–305, 2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freedman DJ, Assad JA. Experience-dependent representation of visual categories in parietal cortex. Nature 443: 85–88, 2006 [DOI] [PubMed] [Google Scholar]
- Grassi M, Soranzo A. MLP: a MATLAB toolbox for rapid and reliable auditory threshold estimation. Behav Res Methods 41: 20–28, 2009 [DOI] [PubMed] [Google Scholar]
- Gregoriou GG, Gotts SJ, Zhou H, Desimone R. Long-range neural coupling through synchronization with attention. Prog Brain Res 176: 35–45, 2009 [DOI] [PubMed] [Google Scholar]
- Haenny P, Schiller P. State dependent activity in monkey visual cortex. Exp Brain Res 69: 225–244, 1988 [DOI] [PubMed] [Google Scholar]
- Haynes JD, Rees G. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat Neurosci 8: 686–691, 2005 [DOI] [PubMed] [Google Scholar]
- Hol K, Treue S. Different populations of neurons contribute to the detection and discrimination of visual motion. Vision Res 41: 685–689, 2001 [DOI] [PubMed] [Google Scholar]
- Jazayeri M, Movshon JA. Optimal representation of sensory information by neural populations. Nat Neurosci 9: 690–696, 2006 [DOI] [PubMed] [Google Scholar]
- Kamitani Y, Tong F. Decoding the visual and subjective contents of the human brain. Nat Neurosci 8: 679–685, 2005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu T, Hospadaruk L, Zhu DC, Gardner JL. Feature-specific attentional priority signals in human cortex. J Neurosci 31: 4484–4495, 2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS—a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput 10: 325–337, 2000 [Google Scholar]
- Martinez-Trujillo JC, Treue S. Feature-based attention increases the selectivity of population responses in primate visual cortex. Curr Biol 14: 744–751, 2004 [DOI] [PubMed] [Google Scholar]
- Maunsell JH, Sclar G, Nealey TA, DePriest DD. Extraretinal representations in area V4 in the macaque monkey. Vis Neurosci 7: 561–573, 2001 [DOI] [PubMed] [Google Scholar]
- McAdams CJ, Maunsell JH. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. J Neurosci 19: 431–441, 1999 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moore T, Fallah M. Control of eye movements and spatial attention. Proc Natl Acad Sci USA 98: 1273–1276, 2001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Motter BC. Focal attention produces spatially selective processing in visual cortical areas V1, V2, and V4 in the presence of competing stimuli. J Neurophysiol 70: 909–919, 1993 [DOI] [PubMed] [Google Scholar]
- Motter BC. Neural correlates of attentive selection for color or luminance in extrastriate area V4. J Neurosci 14: 2178–2189, 1994 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Navalpakkam V, Itti L. Search goal tunes visual features optimally. Neuron 53: 605–617, 2007 [DOI] [PubMed] [Google Scholar]
- Nunez P, Srinivasan R. Electric Fields of the Brain: the Neurophysics of EEG (2nd ed). New York: Oxford Univ. Press, 2006 [Google Scholar]
- Pelli DG. The VideoToolbox software for visual psychophysics: transforming numbers into movies. Spat Vis 10: 437–442, 1997 [PubMed] [Google Scholar]
- Purushothaman G, Bradley DC. Neural population code for fine perceptual decisions in area MT. Nat Neurosci 8: 99–106, 2005 [DOI] [PubMed] [Google Scholar]
- Raiguel S, Vogels R, Mysore SG, Orban GA. Learning to see the difference specifically alters the most informative V4 neurons. J Neurosci 26: 6589–6602, 2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Regan D. Human Brian Electrophysiology: Evoked Potentials and Evoked Magnetic Fields in Science and Medicine. New York: Elsevier, 1989 [Google Scholar]
- Regan D, Beverley KI. Postadaptation orientation discrimination. J Opt Soc Am A 2: 147–155, 1985 [DOI] [PubMed] [Google Scholar]
- Saenz M, Buracas GT, Boynton GM. Global effects of feature-based attention in human visual cortex. Nat Neurosci 5: 631–632, 2002 [DOI] [PubMed] [Google Scholar]
- Schoups A, Vogels R, Qian N, Orban G. Practicing orientation identification improves orientation coding in V1 neurons. Nature 412: 549–553, 2001 [DOI] [PubMed] [Google Scholar]
- Scolari M, Byers A, Serences JT. Optimal deployment of attention gain during fine discriminations. J Neurosci 32: 7723–7733, 2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scolari M, Serences JT. Adaptive allocation of attentional gain. J Neurosci 29: 11933–11942, 2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scolari M, Serences JT. Basing perceptual decisions on the most informative sensory neurons. J Neurophysiol 104: 2266–2273, 2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- See JE, Warm JS, Dember WN, Howe SR. Vigilance and signal detection theory: an empirical evaluation of five measures of response bias. Hum Factors 39: 14–29, 1997 [Google Scholar]
- Serences JT, Saproo S, Scolari M, Ho T, Muftuler LT. Estimating the influence of attention on population codes in human visual cortex using voxel-based tuning functions. Neuroimage 44: 223–231, 2009 [DOI] [PubMed] [Google Scholar]
- Serences JT, Yantis S. Selective visual attention and perceptual coherence. Trends Cogn Sci 10: 38–45, 2006 [DOI] [PubMed] [Google Scholar]
- Serences JT, Boynton GM. Feature-based attentional modulations in the absence of direct visual stimulation. Neuron 55: 301–312, 2007 [DOI] [PubMed] [Google Scholar]
- Shiffrin RM, Lee MD, Kim W, Wagenmakers EJ. A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cogn Sci 32: 1248–1284, 2008 [DOI] [PubMed] [Google Scholar]
- Srinivasan R, Bibi FA, Nunez PL. Steady-state visual evoked potentials: distributed local sources and wave-like dynamics are sensitive to flicker frequency. Brain Topogr 18: 167–187, 2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stanislaw H, Todorov N. Calculation of signal detection theory measures. Behav Res Methods Instrum Comput 31: 137–149, 1999 [DOI] [PubMed] [Google Scholar]
- Stokes M, Thompson R, Nobre AC, Duncan J. Shape-specific preparatory activity mediates attention to targets in human visual cortex. Proc Natl Acad Sci USA 106: 19569–19574, 2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sutoyo D, Srinivasan R. Nonlinear SSVEP responses are sensitive to the perceptual binding of visual hemifields during conventional “eye” rivalry and interocular “percept” rivalry. Brain Res 1251: 245–255, 2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Treue S, Martinez-Trujillo JC. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 399: 575–579, 1999 [DOI] [PubMed] [Google Scholar]
- Tucker DM. Spatial sampling of head electrical fields: the geodesic sensor net. Electroencephalogr Clin Neurophysiol 87: 154–163, 1993 [DOI] [PubMed] [Google Scholar]
- Verghese P, Kim JY, Wade AR. Attention selects informative neural populations in human V1. J Neurosci 32: 16379–16390, 2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilson HR, Regan D. Spatial-frequency adaptation and grating discrimination: predictions of a line-element model. J Opt Soc Am A 1: 1091–1096, 1984 [DOI] [PubMed] [Google Scholar]