Abstract
Before each saccade, neurons in frontal eye field anticipate the impending eye movement by showing sensitivity to stimuli appearing where the neuron's receptive field will be at the end of the saccade, referred to as the future field (FF) of the neuron. We explored the time course of this anticipatory activity in monkeys by briefly flashing stimuli in the FF at different times before saccades. Different neurons showed substantial variation in FF time course, but two salient observations emerged. First, when we compared the time span of stimulus probes before the saccade to the time span of FF activity, we found a striking temporal compression of FF activity, similar to compression seen for perisaccadic stimuli in human psychophysics. Second, neurons with distinct FF activity also showed suppression at the time of the saccade. The increase in FF activity and the decrease with suppression were temporally independent, making the patterns of activity difficult to separate. We resolved this by constructing a simple model with values for the start, peak, and duration of FF activity and suppression for each neuron. The model revealed the different time courses of FF sensitivity and suppression, suggesting that information about the impending saccade triggering suppression reaches the frontal eye field through a different pathway, or a different mechanism, than that triggering FF activity. Recognition of the variations in the time course of anticipatory FF activity provides critical information on its function and its relation to human visual perception at the time of the saccade.
Introduction
We make saccadic eye movements up to three times per second, and with each saccade the visual image is displaced on the retina. Yet we maintain our perception of a stable visual world. One proposal is that anticipatory shifts of visual sensitivity accompany each saccade, and that these shifts are critical for visual stability (for review, see Wurtz, 2008). Visual sensitivity shifts from the current receptive field (RF) of a neuron to the location the RF will occupy after the saccade–the future field (FF) of the neuron. Neurons with these shifting RFs were first found by Duhamel et al., (1992) in monkey parietal cortex, and have subsequently been found in monkey frontal eye field (FEF; Umeno and Goldberg, 1997; Sommer and Wurtz, 2006). Recent psychophysical evidence has also suggested that these shifting RFs contribute to a perceived compression of the temporal and spatial locations of visual stimuli at the time of the saccade, and that this compression could also contribute to our perceived visual stability (Burr and Morrone, 2012; Cicchini et al., 2013).
The anticipatory shifts of sensitivity are not instantaneous but appear and disappear over time at the FF location. By determining the rate of FF development, we should be able to better determine its role in perception and control of movement. Unfortunately, we have only minimal information on this time course. For FEF, we only know that different neurons have different FF latencies and waveforms (Sommer and Wurtz, 2008). For lateral intraparietal (LIP) area, we know the time course of FF activity averaged across a sample of neurons but not the individual variations (Kusunoki and Goldberg, 2003).
In our current experiments, we determined the time course of the FF activity for individual neurons in FEF. After identifying FEF neurons showing FF activity, we flashed stimuli lasting 50 ms in the FF of the neuron over a range of times right before the monkey made saccades. We found a remarkable variation in the latency and time course of FF activity among neurons. Also, FF activity was compressed in time compared with the spread of the stimulus flashes; the span of the flashes exceeded the span of the FF activity. We also found a striking saccadic suppression superimposed on the FF activity that has not been reported previously in FEF. To varying extents, the compression and suppression were overlapping in time. To determine the time courses of each, we constructed a model that was fitted to the data from each neuron. From this model we inferred the start, peak, and duration for both FF activity and suppression for each neuron. While both FF activity and suppression were synchronized to the saccade, their different time courses indicated the likelihood of separate mechanisms, or at least separate pathways.
Materials and Methods
Three adult male monkeys (Macaca mulatta) weighing from 7 to 9 kg, were implanted with scleral search coils for measuring eye position, recording cylinders for accessing neurons in FEF, and a receptacle for receiving a post immobilizing the head during experiments as described previously (Sommer and Wurtz, 2000). All procedures were approved by the Institute Animal Care and Use Committee and complied with Public Health Service Policy on the humane care and use of laboratory animals.
Recording procedures.
We implanted a recording cylinder over the FEF (the anterior bank of the arcuate sulcus) approximately normal to the cranial surface. Cylinder placement over the sulcus was guided by magnetic resonance images. We recorded single neuron responses and microstimulated in FEF with tungsten microelectrodes advanced by a stepper microdrive. FEF neurons were verified using two criteria: saccade-related activity and the ability to evoke saccades with stimulation currents of ≤50 μA (Bruce et al., 1985).
The monkey sat in a primate chair with its eyes 57 cm in front of a tangent screen. The chair was in the center of magnetic field coils in a dark room that was sound attenuated. Computers running REX (Hays, 1982) and associated programs controlled stimulus presentation, administration of reward, the recording of eye movements and single neuron activity, and the on-line display of results. We excluded neurons from analysis if we were unable to determine the parameters of the visual RF due to loss of neuronal isolation during the recording session.
Visual stimuli on the screen appeared on a gray background, back-projected by a DLP projector. In each experiment we first determined the center of the RF by creating a coarse spatial map. While the monkey fixated a central white cross, we sequentially presented spots of light of a fixed diameter (1 to 5°, depending on RF eccentricity) at nine locations on a 3 × 3 grid. The exact time of stimulus onset and offset was measured by a photocell on the projector side of the screen that registered the appearance of a white square in the corner of the screen (hidden from the monkey) for a single monitor cycle that was synchronized to both the appearance and disappearance of each stimulus. The stimulus grid center and spacing were adjusted to sample a large part of the RF and form an initial quantitative estimate of RF center and qualitative estimate of the extent. From the 3 × 3 grid, we determined the RF center as the average of the neuronal responses at nine locations weighted by the magnitude of the visual responses at each location.
We searched for neurons that had an identifiable visual RF, and then searched for that fraction that showed anticipatory visual activity as the monkey prepared to make a saccade. These neurons have shifting RFs: sensitivity to visual stimulation shifting from the spatial location of its current RF to the location that field will occupy after the saccade is completed. To determine whether a neuron possessed a shifting RF we systematically compared the neuronal responses to stimuli in its RF and the FF, that area that will be the RF after the saccade. We used a visually guided saccade task to study shifting RFs (see Fig. 1A,B). On each trial, after 500 ms of initial fixation, a 50 ms visual stimulus was flashed in the center of the RF to determine the RF response. Following a variable delay (500–700 ms), the fixation point was turned off as a saccade target (the future fixation point) came on. Before the monkey made a saccade to the new fixation point, the same stimulus used to probe the RF was flashed in the FF. This 50 ms FF flash was at the same location in the FF as the flash had been in the RF. For example, if the center of the RF was at x = −5°, y = 10°, and the monkey was required to make a saccade from the fixation point at 0°,0° to a target at 15°,0°, the FF center would be at 10°,10° (Fig. 1A). Importantly, the FF stimulus was extinguished before the saccade was made; trials with early saccades that started before or during the FF stimulus were discarded. The monkey received a liquid reward for maintaining fixation within a 1.5° window around the fixation point at the start of the trial and for reaching the new fixation point within a 2.5° window around the saccade target at the end of the trial.
Analysis of FF activity.
We recorded from 192 neurons and concentrated on 67 of these that had shifting RFs. We did complete experiments on 28 of these neurons (16 in monkey Art, 10 in monkey Fln, 2 in monkey Cap). The remaining neurons were rejected because of the following: (1) response isolation became uncertain, (2) there was not sufficient variability in the probe and saccade timing for analysis (31 neurons), or (3) the RF was so large that the FF and RF overlapped, even with large saccades. In this latter case the FF flash activated the RF as well, as indicated by a fixed latency response after the FF stimulus onset, rather than a fixed latency after the saccade onset. We used results from all FEF neurons that had both a clear visual response and a shifting RF, whether or not there was accompanying saccade-related activity, as the presence (or absence) of purely saccade-related activity had no bearing on the presence of FF activity. Note that we use the term FF activity rather than FF response to emphasize the difference between this shifting RF activity with its dependence on the saccade, and a straightforward visual response.
To determine the dependence of FF activity on the timing of stimuli in the FF, we systematically varied the time of the FF flash before the saccade. We flashed the FF probes at a series of 50 ms intervals, from 50 ms to ∼250 ms before saccade onset. Therefore, the offset of the 50 ms duration probes varied from approximately saccade onset (0 ms) to 200 ms before the eye movement. Probe timing was synchronized to the offset of the fixation point, adjusted to the usual latency of the saccade. Because of variability in saccade latency, there was a continuum of probe times relative to saccade onset. Trials in which the saccade began during the FF probe were discarded because any eye movement would displace the location of the probe on the retina. Saccade initiation was identified as the time that eye velocity and acceleration exceeded 50 and 2000°/s2, respectively.
We divided the continuum of probe times into three successive time bins in each experiment, with each bin containing the same number of probe offset times. We used the probe offset time (which occurred 50 ms after the probe appeared) to provide a continuum of times contiguous with saccade onset. For each experiment, our goal was to obtain bins of probe times with both a sufficient number of trials and a reasonable spread of mean probe times. Over our 28 experiments, the mean number of trials in each of the three bins was 133, ranging from 14 to 389 trials in each bin. The purpose in binning the probes was to convert the continuum of probe times into a smaller number of cases each with an adequate number of trials such that effects of timing could be sufficiently measured. We used the mean probe offset time within each bin rather than the bin edges or centers, because the means introduce no systematic inconsistencies between the probe times and the expected timing of the FF activity. That is, given a range of probe times and a constant response latency, the mean responses to binned probes will naturally align (at some fixed offset) with the mean times in each bin rather than the bin edges or centers.
Because FF activity is synchronized to saccade onset (Sommer and Wurtz, 2008), we analyzed perisaccadic neuronal activity, beginning 200 ms before saccade onset and ending 300 ms after onset, lasting a total of 500 ms. Neuronal activity was calculated using spike density histograms smoothed with a Gaussian with a 10 ms SD. We first determined the peak time of the FF activity within the specified 500 ms window around the saccade. We located the peak activity, and looked forward and backward in time to determine when the firing rate fell to 80% of this peak. The duration of the epoch when activity was at least 80% of maximum was taken to represent the width of the activity. We calculated the time of the activity peak by weighting the times within this epoch by the instantaneous firing rate at each time, in effect creating a weighted average of the center of the peak activity. For eight neurons with especially variable responses, we calculated the center and width using a 50% of peak activity epoch. This permitted us to calculate peak times for noisier and slow-rising activity that would otherwise produce spurious timing measures. We visually inspected each of the calculated peaks to confirm their validity.
We calculated the magnitude of each neuron's FF activity as the mean firing rate in a time window 100 ms wide centered on the weighted peak time. Using a fixed time window centered on the weighted peak provided a reasonable measure of the magnitude of activity that was not affected by its duration or decay. Visual responses to the RF probes were calculated in the same manner.
Significances and p values, unless otherwise specified, were determined by t tests.
Results
Confirmation of FF activity
To be sure that each of the 28 neurons we analyzed displayed FF activity, we identified the two primary salient characteristics of FF activity: it depends on both preparations to make a saccade and a stimulus in the FF. To evoke FF activity from each FEF neuron, we visually stimulated twice as the monkey fixated before the saccade (Fig. 1). The first stimulus was a 50 ms spot that came on in the RF. For the example neuron in Figure 2 the visual response (data not shown) had a mean latency of 61 ms from the stimulus onset. As the monkey prepared to make a saccade to the target, a second 50 ms stimulus flashed in the FF. This second probe also resulted in neuronal activity as indicated by the black trace for the example neuron in Figure 2A. However, the FF probe elicited no activity on trials when the monkey simply fixated and no saccade was being prepared (Fig. 2A, dashed trace), indicating that the FF activity depended on saccade initiation. The FF activity from Fig. 2A is shown again in Figure 2B, now synchronized to the saccade (Fig. 2B, thick trace). When there was no stimulus before the saccade, there was no activity in the FF (Fig. 2B, thin trace). To be classified as having FF activity, we required FEF neurons to exhibit both these characteristics.
For the 28 neurons with FF activity that fit these criteria, we confirmed the importance of the saccade by expanding upon the finding that FF activity is better aligned to saccade onset than to stimulus onset (Kusunoki and Goldberg, 2003; Sommer and Wurtz, 2008). Although this has often been shown for single neurons, we adopted a more quantitative approach. For each neuron, we examined the magnitude and the width of FF activity aligned to both the saccade and the probe (see Materials and Methods for determination of activity peak and width). To compare magnitude, we used a contrast measure using both the magnitude of the FF activity aligned to the saccade (MS) and the probe (MP). We calculated this relative activity MSP as (MS − MP)/(MS + MP). We similarly used width of the saccade-aligned activity (WS) and the probe-aligned activity (WP) to calculate the relative saccade-aligned activity width (WSP) as (WS − WP)/(WS + WP).
The abscissa of Figure 2C shows MSP: the relative magnitude of the FF activity aligned to the saccade. The distribution at the top of Figure 2C shows how responses tended to be greater when aligned to the saccade. The ordinate of Figure 2C shows WSP: the relative width of the FF activity aligned to the saccade. The histogram on the right of Figure 2C shows how saccade-aligned activity tended to be narrower than when aligned to the probe. Overall the preferred alignment of FF activity to the saccade is evident in the greater magnitude (+5.2% ± 1.5 SEM, p = 0.002) and narrower width (−11.2% ± 3.5 SEM, p = 0.005) when aligned to the saccade, quantifying this observation.
As a final point, the magnitude of the FF activity was on average only 56% (±5.5 SEM) of the magnitude of the RF response. Interestingly, the magnitude of the FF activity was not correlated with the magnitude of the RF response (r = 0.250, p = 0.20).
The above results are clear confirmation that the FF activity we study is a saccade-related phenomenon. FF activity does not exist without a saccade, and the saccade alone (in the absence of a probe) does not evoke FF activity. Finally, FF activity aligns better to the saccade than the stimulus that evokes it.
Temporal dependence of the magnitude of FF activity
A major goal of our experiments was to determine the effect of the time of FF stimulation on the magnitude and the timing of the resulting FF activity. To do this we varied the interval between a brief stimulus probe (50 ms) and saccade onset, and then determined the variation in the timing of the FF activity. We flashed the FF stimulus at up to four different times before the saccade (see Materials and Methods; Fig. 1B). Additional variation in the monkey's saccade latency produced a continuous distribution of probe times. For each neuron, we divided this time continuum into three successive bins, with each bin containing the same number of probe offset times. The colored regions on the left side of Figure 3, A and B, demonstrate this binning for two example neurons. Each color corresponds to one of the three bins, and the width of each color is the range of the probes within that bin. Note that the red colored bin extends all the way to saccade onset, as we are binning the probe offset times. The three vertical dashed lines are color coded to each bin and show the mean probe offset time for that bin.
In Figure 3, A and B, the spike density histograms of neuronal activity resulting from probes in each of the three bins are color coded to that bin. The peak activity times for each bin are indicated by the colored spots above the spike density functions. The left side of Figure 3A shows how the saccade-aligned activity evoked by probes in different bins varies both in magnitude and timing. The probes for the neuron shown in Figure 3A produce FF activity before and during the saccade whereas the probes in Figure 3B produce FF activity after the saccade. The right side shows the same FF activity as on the left, but aligned to the probe offset times. These two examples demonstrate the variability in FF activity that we exploit to study the relationship between FF activity and both of its essential components: the probe and the saccade.
Temporal compression of FF activity
If the activity in the FF was a simple visual response, we would expect FF activity to occur at a fixed latency after the probe. Such probe-determined activity, when viewed relative to the saccade, would span the same time period as the probes. We can therefore explore the relative dependence of FF activity timing on both the probe and on the saccade by examining the spread of the activity when aligned to the saccade or the probe.
Consider again the FF activity shown on the left side of Figure 3A where activity is aligned to the saccade. Although the mean times of the FF probes (shown by the dashed colored lines) occurred over a 77 ms range before the saccade, the range of the peak FF activity (marked by the colored spots above the spike density functions) spanned 30 ms, less than half the span of the probes. Interestingly, when the FF activity is aligned to the probe offset times (Fig. 3A, right), the resulting spike density histograms span 51 ms (again indicated by the three colored dots above the spike density functions on the right side of Fig. 3A).
The neuron shown in Figure 3A is representative of neurons that had FF activity before and during saccade onset. But it has previously been shown that different FEF neurons have different FF activity latencies (Sommer and Wurtz, 2008). Compare Figure 3A with the neuron in Figure 3B, which shows FF activity after the saccade. For this example, the mean probe times spanned 72 ms, but the resulting FF activity spanned only 3 ms when aligned to the saccade (left). Although the saccade-aligned activity in Figure 3B was compressed in time, the spread of FF activity when aligned to the probe was nearly as long as the spread of probe times (70 ms, right). In both example neurons in Figure 3, the spread of FF activity was compressed in time compared with the span of the FF probe stimuli.
Figure 3C shows this compression for the 28 neurons in our sample by comparing the time span of stimulus presentation to the time span of the FF activity. The abscissa shows the span of the mean probe times aligned on saccade onset (the span of the vertical dashed lines on the left side of Fig. 3A,B). The ordinate of Figure 3C shows the span of the FF activity peaks when aligned to the saccade onset (the span of the colored dots on the left). The example neurons presented in Figure 3, A and B, are distinguished by black outlines in Figure 3C. If the span of the FF activity peaks were as wide as the span of the probes before saccade onset (as would be expected without compression), the points would fall on the diagonal line indicating equal spans. However, as in the example neurons, nearly all of the points fall below the line. Across the sample, the mean span of the peak FF activity was 17 ± 3 ms (SE) and the mean span of the probes before saccade onset was 52 ± 4 ms. For the sample of neurons, the span of the FF activity peaks was significantly less than the span of the probes before saccade onset (two-tailed t test, p ≪ 0.001). This indicates a striking temporal compression of the FF activity across the sample of neurons.
We further quantified this reduction in the temporal spans by determining the temporal compression ratio: the proportional decrease of time span between the probes and the FF activity peaks (Fig. 3D). Here, a ratio near 0 represents no temporal compression, and a ratio close to 1 signifies almost total temporal compression when the peaks of the FF activities would span only a few milliseconds. For Figure 3A compression would be (77 − 30)/77 = 0.61 and for Figure 3B equaled (72 − 3)/72 = 0.96. As shown in the figure, all but four neurons had a temporal compression >40%, with a mean temporal compression of 64% (p ≪ 0.001). In contrast, the probe-aligned FF activity (as on the right side of Fig. 3A,B) did not demonstrate such pronounced temporal compression (mean = 11%, p = 0.27).
Our last question regarding temporal compression of FF activity was whether there was a relationship between the span of FF activity and the time of the saccade; did the peaks spread out more or less when the FF activity was closer to the saccade? We performed a correlation between the time of the peak FF activity (over all probes, aligned to saccade onset as in Fig. 2B), and the range of the peaks when the probe times were binned (as in Fig. 3) and found no significant relationship between the two (r = 0.25, p = 0.21) suggesting that the compression of FF activity is not dependent on whether the activity occurred before, during, or after the saccade. These results summarize the prevalence of temporal compression of FF activity in FEF, compression that is equally strong whether it occurs during or after the saccade.
Saccadic suppression of FF activity
While examining FF activity in frontal eye field, we often observed a distinctive suppression of neuronal activity that has not been previously reported. Figure 4A illustrates this suppressive influence for a sample neuron with striking suppression before the FF activity, while Figure 4B shows a neuron with little visible suppression. Suppression is also evident for the neurons illustrated in Figure 3 (left): unmistakable in Figure 3A (after the FF activity), and to a lesser extent in Figure 3B (the saccade-aligned dips during the activity). As suggested by our examples, the variability of suppression over our sample was substantial. In the 28 neurons, 12 showed suppression as clear as that in Figure 4A, while 6 showed a lesser amount of suppression as in Figure 3B. For 10 neurons, suppression was virtually imperceptible (Fig. 4B).
The increase of neuronal activity at the time of the saccade in neurons with FF activity provided a higher background against which the suppression could often be seen. But it also led to an intermixing of FF activity and suppression that made it difficult to discern one change in neuronal activity from the other. Consequently, the patterns of activity we observed defied classification into specific categories (e.g., activity before/after saccade, strong/weak suppression, suppression before/during activity). We therefore developed a simple model that incorporated the distinctive aspects of FF activity and suppression that we observed. Our hopes were that the model would be able to separate in time the strengths and time courses of the FF activity and the accompanying suppression, and succeed in differentiating these two influences where simple visual inspection failed.
Model of FF activity and suppression
We developed a model comprising simple components based on our observations. We assumed that the probes create an underlying pattern of activity with a fixed latency from each probe. These patterns of activity were transiently revealed by the appearance and disappearance of the FF near the time of the saccade. Finally, the revealed probe activity could be affected by a suppressive influence aligned to the saccade.
The formalization of the model was simple. First we assumed that the FF probes created a slowly decaying pattern of activation, because we often recorded FF activity 300–400 ms after the 50 ms probes disappeared. We modeled the probe activity as a function that peaks relatively quickly and then decays; we chose an α function. Each neuron had a single α function, so the three bins of probes produced three identical α functions separated in time. This α function was specified by:
where αp is the α function for probe bin p, τ is the time constant, and t is time. For each neuron, the α function incorporated a second parameter t0 representing the latency of the induced activity. The separation of the three α functions in time was set by the mean probe times in each bin, and was fixed for each cell. We normalized the α functions to a height of 1.
Second, we modeled the transitory presence of the FF as a time-varying envelope of sensitivity to the probe activity with a Gaussian temporal profile:
in which μff is the time at which the sensitivity peaks, and the standard deviation σff determines the duration of the FF.
Third, the suppressive influence was similarly modeled with a Gaussian temporal profile of a decrease in activity:
where we have added the scale term ks permitting various strengths of suppression.
The complete model of the activity evoked by probe p is now the following:
We multiply the probe α function by the FF Gaussian. We then scale this curve (multiply by kr) and add a baseline firing rate (r0). Finally we multiply by the suppressive Gaussian.
Figure 5 shows the results of fitting this model to the four example neurons shown so far. The three curves for each neuron representing FF activity were fit simultaneously so a single set of parameters generated all three fit curves for the three probe times. In other words, the only difference in the three different colored curves is the relative timing of the probes, which was extracted from the data and fixed during the fitting procedure for each neuron.
Figure 5A (left) shows how the model fit the responses to our first example neuron in which the FF activity occurred before and during the saccade, and in which suppression affected the end of the FF activity. The model accounts for not only the different response timing for the different probes, but also for the different response magnitudes. The suppression also is represented in the fits.
For each neuron, the R2 value is shown for the fit to the model. The right side of Figure 5A graphically depicts the components of the model that fit these responses. The probe times, which were fixed, are denoted by the dashed vertical lines (Figs. 3, 4), and are color coded to their corresponding curves. The α functions representing the activity induced by the probes are shown as the solid colored lines. The solid black curve denotes the temporal envelope of the FF, and the black dashed curve shows the location in time and relative magnitude of the suppressive influence. In the model, the peak magnitude of the probe responses was scaled to 1, as was the peak of the FF envelope. The height of the dashed curve represents the strength of the suppressive influence relative to the solid black FF envelope.
Figure 5A shows the model accounting for a neuron with FF activity of different magnitudes and latencies. The three other examples (Fig. 5 B–D) show the model's ability to capture various other patterns of FF activity. Figure 5B shows the model representing FF activity after the saccade with a small amount of suppression during the activity. Figure 5C shows strong suppression before the FF activity. Figure 5D shows the fit to a neuron with no visible suppression. Keep in mind that for each neuron the only difference among the three curves fit to the data was the time of the probe; the same equation generated each curve.
Overall the model did well accounting for the variability in the characteristics we observed in FF activity, including differences in activity onset, activity magnitude, and the presence of saccade-related suppression. The overall quality of the fits is quantified in Figure 6A, which shows the distribution of R2 values across our sample. The shaded bars represent R2 of at least 0.8, indicating the fits that provided the most confident predictions of FF activity (n = 21). The model was also able to represent temporal compression of FF activity. Figure 6B plots the temporal compression predicted by the model against that measured from the data. The points from the less confident fits (R2 < 0.8) are plotted as open symbols. The correlation between the data and the model was significant (r = 0.63, p < 0.001). The marginal histograms show the distributions of compression from the data (top, duplicated from Fig. 3D) and the fits (right). Note that the model estimated higher compression than that shown by the data. We believe the higher estimation of compression from the model is more accurate due to the lack of activity variations (noise) that occur in the data. If compression is as high as the fits suggest, the variations in the data naturally would spread out the activity, making measurements of spread from the data larger, and estimates of compression correspondingly smaller.
It occurred to us that in some cases, such as in Figure 5D, suppression might not be necessary to account for some patterns of activity. To test this possibility we fit the data from each neuron to a version of the model without suppression. We simply left out the final step of multiplying by the suppressive influence (we omitted s(t) in Eq. 4). We calculated an adjusted χ2 statistic (Hoel et al., 1971; Cavanaugh et al., 2002) for the fits with and without suppression to determine whether the improvement in fit quality warranted the addition of the extra parameters that represented the suppression. For all but two neurons (both with R2 < 0.6), the adjusted χ2 errors for the model without suppression were higher than when including suppression; the addition of suppression improved the fit (even taking into account the additional parameters). Figure 6C shows the ratio between the χ2 errors from both fits for each neuron (no suppression/suppression). The marginal histogram at the top shows the distribution of these ratios. Larger values indicate the importance of suppression as a factor in fitting the data. Values less than one would indicate that suppression was not required to model FF activity. The ordinate shows the strength of suppression determined by the model. There was, as would be expected, a significant correlation between the strength of suppression and its importance in fitting the data (r = 0.51, p = 0.006).
The variety of FF activities we observed was accounted for by a simple model in which the FF appears briefly near the time of the saccade. The probes create a predictable pattern of activity that is revealed when the FF appears. The addition of saccade-related suppression permitted the model to account for most of the variations in FF activity. If we regard our model as descriptive, we can consider the temporal envelope of increased sensitivity in the model to correspond to the appearance of the FF (as we intended), and we can use the model to infer certain aspects of the mechanisms underlying FF activity.
Model estimates of FF and suppressive influences
By examining the components of our model as applied across the sample of neurons, we derived an estimate of the two key underlying features we have been exploring: the time course of FF sensitivity and that of the saccadic suppression. The time course of FF sensitivity is given by the center and width of the FF Gaussian in the model. Similarly, the time course of saccadic suppression is taken from the center and width of the model's suppressive Gaussian. Figure 7 shows these estimates.
Figure 7A shows the distribution of times that FF sensitivity peaked. As in Figure 6, quantities from fits with R2 ≥ 0.8 are shaded gray, and are white otherwise. The mean peak was 129 ms after the saccade, ranging from shortly before the saccade to well after the saccade. The duration (width at half-height) of the FF sensitivity according to the model (Fig. 7B) was on average 173 ms (note that the width at half-height of the Gaussian components corresponds to ∼2.35 SD). Figure 7, D and E, show the center and width of the suppression, the means of the peaks and the widths being 93 and 123 ms, respectively.
To make informed speculations as to the origins of the FF activity we would want to know not just when the FF sensitivity peaks, but perhaps more importantly when it begins. Figure 7C shows the start of the FF sensitivity (when it reached half of its maximum sensitivity). Naturally, the distribution of starts is shifted to earlier times relative to the peaks, making it clear that the FF often appears well before the saccade starts (Sommer and Wurtz, 2008; Fig. 4). Figure 7F shows the beginning of the suppressive influence, which although distributed differently (note the peak) spans a similar range relative to the saccade as the FF sensitivity (Fig. 7C).
Although the time of the FF activity and the time of the suppression share similar distributions (Fig. 7A,D) there was little similarity on a cell-by-cell basis. Figure 7G demonstrates this by showing the time when the FF sensitivity peaked versus the time when the suppression peaked, demonstrating the lack of correlation. In Figure 7H, we examined the start of the sensitivity and the start of the suppression (rather than their peaks). There was a slightly stronger relationship (r = 0.42, p = 0.025) although the correlation remained less than compelling.
Part of the reason for the decoupling of the time course of the FF activity and the suppression is demonstrated in Figure 8. Recall from Figure 2 that FF activity requires both (1) a saccade and (2) a probe in the FF. In the absence of a probe, there is no FF activity, but some neurons still exhibited varying amounts of purely saccade-related activity during other experiments (Fig. 8A, solid trace; same neuron as in Fig. 2). We often observed similar suppression during saccadic activity as we did during FF activity (Figs. 3, 4). Suppression during purely saccadic responses often followed the same time course as the suppression seen during FF activity. This is demonstrated by the dashed line in Figure 8A, which is the estimate of the saccadic suppression determined by the model for this cell. The suppressive component determined by the model's fit to the FF activity aligns with the suppression seen in the saccade-only activity. We explored a subset of our neurons with saccade-only activity for the presence of suppression during the saccade. By using criteria extracted from the model's fit and its parameters, we chose neurons with an R2 of at least 0.8, a saccade strength of at least 0.4, and a χ2 ratio of at least 0.25. This selected neurons for which FF activity was reasonably well fit with substantial and necessary suppression. Of the 11 neurons fitting these criteria, there were 8 for which we had sufficient data showing activity during the saccade only. We aligned the saccade-only activity to the center of the suppression relative to saccade onset as determined by the model's fit to the data. We normalized each neuron's activity and averaged. We also averaged the suppression as determined by the model. Using these averages of activity and suppression, Figure 8B shows unmistakable suppression of activity when the model predicted it should occur. This suggests that the suppression is a saccadic phenomenon rather than a characteristic of the FF. But because FF activity depends on an impending saccade, this saccade-related suppression is often revealed in the FF activity as well.
The components of our model provided an insight into the mechanisms behind the predictive FF activity. We discovered that both the timing of the FF activity and the strength of the FF activity depended on the onset of the saccade. We recognized an increase in sensitivity expressing FF activity, as well as an independent suppressive influence that was also saccade related. Although these two competing influences generally occurred over the same time span, the correlation in their timing was weak, indicating ultimately a similar saccade-related source, but suggesting different mechanisms or pathways.
Discussion
Temporal characteristics of FF activity
We concentrated on the temporal characteristics of FF activity in monkey FEF neurons. This activity anticipates the impending saccade by showing sensitivity to stimuli falling in what will be the RF of the neuron after the saccade. This anticipatory activity could contribute to stability of perception across saccades.
We know that FF activity requires both an impending saccade and a stimulus in the FF (Fig. 2). We also confirmed the close relation of FF activity to saccade onset. Together these characteristics establish that FF activity is dependent on the saccade, or perhaps rather on the corollary discharge associated with the saccade (Sommer and Wurtz, 2006).
Two salient findings emerged. First, comparing the time span of the stimulus probes before the saccade to the time span of the FF activity, we found a striking temporal compression of FF activity (Fig. 3). Stimuli flashed over a 70 ms time span could be compressed into activity spanning only a few milliseconds. Second, many neurons also showed suppression of activity at the time of the saccade, even during FF activity (Fig. 4).
Both FF activity and suppression were intertwined, making it difficult to separate the effects of each. We therefore constructed a simple model that incorporated an α function for the FF probes, a Gaussian increase of sensitivity for the FF, and a Gaussian decrease of activity for suppression. The model determined the time courses of the increase in FF sensitivity and the suppression, and we could infer that FF activity and suppression had about the same average time course (Fig. 7). But considering each neuron (Fig. 7G,H), it became evident that the time courses of compression and suppression were different, as discussed further later.
Compression of FF activity
The span of time between the first and the last probe stimulus was frequently substantially longer than the spread of the FF activity–a pronounced temporal compression. FF activity was compressed an average of 64% relative to the probes. Compression was unmistakable in the majority of neurons that we tested, although the degree of compression varied (Fig. 3D).
When we recognized that FF activity is consistently better aligned to saccade onset than FF probe onset, the mechanism of this temporal compression became less of a mystery. If we assume that there is a limited time window of sensitivity for stimuli in the FF and that the window is aligned to the saccade, then only probe activity falling in this window will produce measurable FF activity. Since FF sensitivity for a neuron is fixed in time (relative to the saccade) all activity evoked by probes, regardless of their timing, will appear within this fixed window.
Consider the following analogy. Two neighbors who work together walk to the bus stop, but one leaves home 10 min after the other. Both, however, get on the same bus, and arrive at work at the same time. Thus the bus “compresses” their commute time by converting the 10 min between their departures to essentially no difference in their arrivals. But considered from the workers' point of view, the bus actually extends the commute for the early neighbor, in much the same way that an early probe must wait until the FF sensitivity develops for its activity to become visible. Thus compression of departure times can also be viewed as expansion of commute times. This demonstrates that the temporal compression we see in our data is actually a subjective measurement based on the frame of reference: compression of activity timing, or expansion of activity latency. Both result from the alignment, in time, of asynchronous events. But as our time frame is based on the saccade, we will continue to refer to the temporal alignment of probe activity as “compression.”
This compression at the neuronal level may be relevant to observations in humans that compression in both space and time occurs for stimuli presented just before saccades (Cicchini et al., 2013). For example, stimuli flashed just before saccades are perceived as falling spatially closer to the saccade target (Matin and Pearce, 1965; Honda, 1989; Dassonville et al., 1995), and interpreted as a compression of space (Ross et al., 1997; Kaiser and Lappe, 2004), Binda et al. (2009) have shown a similar compression in time (or, rather, an expansion of latency); bars flashed just before the saccade were perceived to occur 50–100 ms later. Note that while aspects of the human and monkey experiments differ, both are examining events aligned to the saccade (perceptual or neuronal). In light of this critical parallel between the monkey and human studies, we believe that the compression of FF activity we have shown provides a tantalizing neuronal correlate for temporal compression in human psychophysics (Burr and Morrone, 2012; Cicchini et al., 2013). This comparison suggests that experiments such as ours could be used to explore the neuronal bases of similar psychophysical phenomena.
Suppression of FF activity
With the aid of our model we identified suppression of activity in most of our 28 neurons, all of which were selected for showing FF activity. We were surprised to find such a prominent suppression, and are unaware of previous reports of suppression in FEF. However, in the plots of FEF FF activity from the review of Sommer and Wurtz (2008), there are notches that might well be suppression. Kusunoki and Goldberg (2003), in their study of the timing of FF activity in LIP, comment that some LIP neurons show saccadic suppression of varying strength, whereas others do not. Again it seems possible that the notch just before the saccade in their plots of averaged LIP activity (their Figures 7 and 8) results from suppression. We may have seen more suppression in our experiments in FEF as elevated FF activity allowed suppression to be seen against a higher firing rate. Thus, it is possible that the suppression we clearly see in frontal eye field has been seen in LIP as well.
FF activity has been shown to depend on the corollary discharge (CD) input to FEF from superior colliculus (Sommer and Wurtz, 2006) and it would seem reasonable that the timing of both FF sensitivity and the concurrent suppression are both determined by the same CD input. However, whereas peak time and duration are similar for the FF and suppression, individual neurons show substantial differences (Fig. 7), implying separate inputs. Both may be produced by a CD, but it might not be the same one, or it might be the same CD but through different pathways. In any case the effects in FEF are of different signs: excitatory for the FF and inhibitory for suppression, so both effects could not arise from identical CD signals in FEF. It should also be noted that FF activity and suppression often begin before the saccade (Fig. 7) so their early influences cannot result from proprioceptive feedback, which begins well after saccade onset. Suppression is also unlikely to result from visual masking, due to our controlled experimental setting (dark room and small, transient stimuli).
Suppression is clear in a number of visual areas (for a review, see Wurtz, 2008), particularly middle temporal (Thiele et al., 2002; Price et al., 2005; Zirnsak et al., 2011), and is considered a candidate neuronal mechanism for blocking the retinal blur during saccades to improve visual stability. Suppression might, however, reduce activity during saccades so that any rebound after the saccade would produce a period of hypersensitivity, making stimuli falling in the RF after the saccade more effective. In this case the suppression during saccades might not produce perceptual suppression during the saccade, but rather produce a period of heightened sensitivity after the saccade.
Another hypothesis related to perceptual stability across saccades is that stability is maintained at the neuronal level by matching the anticipatory FF activity to the activity in the RF after the saccade (Deubel et al., 2002). A match between FF and RF activities indicates stability; failure indicates changes in the real world. We would expect FF activity to occur first, suppression second, and finally the new RF activity. This, however, is not what happens. Suppression occurs independently of FF activity: before, during, or after. This argues against the function of such suppression being necessary for presaccadic and postsaccadic comparisons.
Our study shows that suppression and FF sensitivity are both temporally related to saccades. We submit that temporal compression is simply an alignment of asynchronous presaccadic events to a saccade-related envelope of FF sensitivity. We also show that the time course of suppression is independent of FF sensitivity. This indicates that FF sensitivity (which underlies temporal compression) is not necessarily precipitated by the same signal that triggers suppression during the saccade. Although corollary discharge in preparation of saccades may play a role in both suppression and compression, it is evident that it is not the same CD signal, or at least not the same pathway.
Footnotes
Supported by the National Eye Institute Intramural Research Program at the National Institutes of Health. We are grateful to Altah Nichols and Tom Ruffner for machine shop support.
References
- Binda P, Cicchini GM, Burr DC, Morrone MC. Spatiotemporal distortions of visual perception at the time of saccades. J Neurosci. 2009;29:13147–13157. doi: 10.1523/JNEUROSCI.3723-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruce CJ, Goldberg ME, Bushnell MC, Stanton GB. Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements. J Neurophysiol. 1985;54:714–734. doi: 10.1152/jn.1985.54.3.714. [DOI] [PubMed] [Google Scholar]
- Burr DC, Morrone MC. Constructing stable spatial maps of the world. Perception. 2012;41:1355–1372. doi: 10.1068/p7392. [DOI] [PubMed] [Google Scholar]
- Cavanaugh JR, Bair W, Movshon JA. Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. J Neurophysiol. 2002;88:2530–2546. doi: 10.1152/jn.00692.2001. [DOI] [PubMed] [Google Scholar]
- Cicchini GM, Binda P, Burr DC, Morrone MC. Transient spatiotopic integration across saccadic eye movements mediates visual stability. J Neurophysiol. 2013;109:1117–1125. doi: 10.1152/jn.00478.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dassonville P, Schlag J, Schlag-Rey M. The use of egocentric and exocentric location cues in saccadic programming. Vision Res. 1995;35:2191–2199. doi: 10.1016/0042-6989(94)00317-3. [DOI] [PubMed] [Google Scholar]
- Deubel H, Schneider WX, Bridgeman B. Transsaccadic memory of position and form. Prog Brain Res. 2002;140:165–180. doi: 10.1016/S0079-6123(02)40049-0. [DOI] [PubMed] [Google Scholar]
- Duhamel JR, Colby CL, Goldberg ME. The updating of the representation of visual space in parietal cortex by intended eye movements. Science. 1992;255:90–92. doi: 10.1126/science.1553535. [DOI] [PubMed] [Google Scholar]
- Hays AVR, Richmond BJ, Optican LM. A UNIX-based multiple process system for real-time data acquisition and control. WESCON Conf Proc. 1982;2:1–10. [Google Scholar]
- Hoel P, Port S, Stone C. Introduction to statistical theory. Boston: Houghton-Mifflin; 1971. [Google Scholar]
- Honda H. Perceptual localization of visual stimuli flashed during saccades. Percept Psychophys. 1989;45:162–174. doi: 10.3758/BF03208051. [DOI] [PubMed] [Google Scholar]
- Kaiser M, Lappe M. Perisaccadic mislocalization orthogonal to saccade direction. Neuron. 2004;41:293–300. doi: 10.1016/S0896-6273(03)00849-3. [DOI] [PubMed] [Google Scholar]
- Kusunoki M, Goldberg ME. The time course of perisaccadic receptive field shifts in the lateral intraparietal area of the monkey. J Neurophysiol. 2003;89:1519–1527. doi: 10.1152/jn.00519.2002. [DOI] [PubMed] [Google Scholar]
- Matin L, Pearce DG. Visual perception of direction for stimuli flashed during voluntary eye movements. Science. 1965;148:1485–1488. doi: 10.1126/science.148.3676.1485. [DOI] [PubMed] [Google Scholar]
- Price NS, Ibbotson MR, Ono S, Mustari MJ. Rapid processing of retinal slip during saccades in macaque area MT. J Neurophysiol. 2005;94:235–246. doi: 10.1152/jn.00041.2005. [DOI] [PubMed] [Google Scholar]
- Ross J, Morrone MC, Burr DC. Compression of visual space before saccades. Nature. 1997;386:598–601. doi: 10.1038/386598a0. [DOI] [PubMed] [Google Scholar]
- Sommer MA, Wurtz RH. Composition and topographic organization of signals sent from the frontal eye field to the superior colliculus. J Neurophysiol. 2000;83:1979–2001. doi: 10.1152/jn.2000.83.4.1979. [DOI] [PubMed] [Google Scholar]
- Sommer MA, Wurtz RH. Influence of the thalamus on spatial visual processing in frontal cortex. Nature. 2006;444:374–377. doi: 10.1038/nature05279. [DOI] [PubMed] [Google Scholar]
- Sommer MA, Wurtz RH. Brain circuits for the internal monitoring of movements. Annu Rev Neurosci. 2008;31:317–338. doi: 10.1146/annurev.neuro.31.060407.125627. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thiele A, Henning P, Kubischik M, Hoffmann KP. Neural mechanisms of saccadic suppression. Science. 2002;295:2460–2462. doi: 10.1126/science.1068788. [DOI] [PubMed] [Google Scholar]
- Umeno MM, Goldberg ME. Spatial processing in the monkey frontal eye field. I. Predictive visual responses. J Neurophysiol. 1997;78:1373–1383. doi: 10.1152/jn.1997.78.3.1373. [DOI] [PubMed] [Google Scholar]
- Wurtz RH. Neuronal mechanisms of visual stability. Vision Res. 2008;48:2070–2089. doi: 10.1016/j.visres.2008.03.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zirnsak M, Gerhards RG, Kiani R, Lappe M, Hamker FH. Anticipatory saccade target processing and the presaccadic transfer of visual features. J Neurosci. 2011;31:17887–17891. doi: 10.1523/JNEUROSCI.2465-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]