Abstract
In realistic environments, keeping track of multiple visual targets during eye movements likely involves an interaction between vision, top-down spatial attention, memory, and self-motion information. Recently we found that the superior colliculus (SC) visual memory response is attention-sensitive and continuously updated relative to gaze direction. In that study, animals were trained to remember the location of a saccade target across an intervening smooth pursuit (SP) eye movement (Dash et al., 2015). Here, we modified this paradigm to directly compare the properties of visual and memory updating responses to attended and unattended targets. Our analysis shows that during SP, active SC visual vs. memory updating responses share similar gaze-centered spatio-temporal profiles (suggesting a common mechanism), but updating was weaker by ~25%, delayed by ~55 ms, and far more dependent on attention. Further, during SP the sum of passive visual responses (to distracter stimuli) and memory updating responses (to saccade targets) closely resembled the responses for active attentional tracking of visible saccade targets. These results suggest that SP updating signals provide a damped, delayed estimate of attended location that contributes to the gaze-centered tracking of both remembered and visible saccade targets.
Keywords: spatial updating, smooth pursuit, superior colliculi, attention, saccades
Introduction
Spatial updating is the ability to localize and act upon previously perceived targets when self-motion changes their location relative to body-fixed sensory organs (Klier and Angelaki, 2008; Sommer and Wurtz, 2008; Crawford et al., 2011; Medendorp, 2011). In the visual system, the double-step paradigm (i.e., a saccade to a visual target followed by another eye movement to a remembered target) is often used to demonstrate accurate visuospatial updating of goal-directed motor plans across various types of eye motion (Hallett and Lightstone, 1976; Herter and Guitton, 1998; Sommer and Wurtz, 2002; Baker et al., 2003; Daye et al., 2010; Dash et al., 2015). These experiments are typically done in complete darkness, but in real-world conditions both updating signals and visual signals are typically present. Very little is known about the functional contributions of updating signals to normal vision, or the way these signals differ/combine at the neurophysiological level. For example, Vaziri et al. (2006) showed that trans-saccadic updating improves manual pointing to visible targets, but this has not been studied in the oculomotor system and the neural correlates are unknown.
Visual receptive fields (RF) in the cortex and superior colliculus (SC) often become distorted just before and during saccades, but are then re-organized in their normal location relative to the final eye position: a process called predictive remapping (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 1997; Nakamura and Colby, 2002; Churan et al., 2012; Zirnsak et al., 2014; Mirpour and Bisley, 2015; Neupane et al., 2016). Viewed from the perspective of visual memory, remapping often results in the gaze-centered updating of visual activity (at a reduced level) during or just before saccade onset (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 2001; Inaba and Kawano, 2014), particularly when saccades place a remembered target within the RF of the neuron. In other experiments, it has been shown that visual responses may be augmented after a saccade (Ibbotson et al., 2008). However, a detailed comparison of updating and visual responses during saccades has not been done, perhaps because saccades are very brief and cause widespread suppression of visual responses (Burr et al., 1994; Phongphanphanee et al., 2011).
Spatial updating behavior is also observed across slow, continuous forms of eye motion such as full body translation and smooth pursuit (SP) eye movements of a moving visual target (Schlag et al., 1990; Ohtsuka, 1994; Zivotofsky et al., 1996; Baker et al., 2003; Medendorp et al., 2003; Blohm et al., 2005; Daye et al., 2010). In contrast to saccades, visual responses are not suppressed during SP. We, recently demonstrated that nearly all visually responsive neurons in the SC also show a transient memory response that is continuously updated the saccade goal during a preceding SP eye movement, i.e., the spatial memory response is shifted across the SC retinotopic map in opposition to the change in eye position (Dash et al., 2015). This response (henceforth called “updating”) was selectively enhanced when the memorized target was actively attended compared to the response when a distracter passively passed through the neuron’s RF. Thus, this provides an ideal experimental model for comparing the properties and functional interactions of visual and updating signals, but our previous study did not measure visual responses to sustained stimuli during SP.
In the present study we compared several important aspects of SC updating responses vs. visual responses during SP, including their relative magnitudes, spatio-temporal profiles, latencies, and dependence on attention. To do this, we recorded activity of visually responsive SC neurons during double-step SP-saccade task where animals were trained to make a saccade towards a remembered location after an intervening SP (SP updating task) and compared it with activity during exactly same task except that the saccade goal was visible throughout (SP visual task). In particular, we focused on comparing the dependence on attention, the spatio-temporal profiles, the magnitudes, and the temporal synchrony of these responses. We then tested whether the updating response might also contribute to vision when the stimulus is still present. In particular, we tested the hypothesis that the neural signals for attention-driven updating also contribute to the tracking of visible stimuli. We did this by comparing the responses during active memory updating, passive visual stimulation during pursuit, and the active attentional tracking of non-foveated visual targets during SP.
Experimental Procedures
Surgical Preparation and Electrophysiological Procedures
Two female rhesus monkeys, Macaca mulatta, (W and S) were prepared for head immobilization, two dimensional eye movements recordings and chronic electrophysiological recordings from SC. All surgical and experimental procedures were approved by the York University Animal Care Committee and were in compliance with the Canadian Council of Animal Care policy on the use of Laboratory animals. Monkeys underwent aseptic surgery under general anesthesia (isoflurane 1.5% and Ketamine 10 mg/kg). During surgery the animal underwent implantation of a stainless steel cylindrical tube (head post) and a plastic recording chamber (centered at 5 mm anterior and 0 mm lateral in stereotaxic coordinates, vertical approach with no angle) allowing easy access to SC. A circular craniotomy beneath the base of the chamber allowed access to both sides of the SC. In order to accurately measure (2D) eye position, the animal was implanted with one teflon coated braided stainless steel wire search coil (18 mm in diameter) sub-conjunctivally around the right eye. The head post, recording chamber and the socket attached to the search coil were affixed to the skull with the aid of dental acrylic and held in place with 13–15 stainless steel cortical screws. Animals were allowed 2 weeks of recovery following the surgery.
We, recorded extracellular neural activity from the SC with commercially available tungsten microelectrodes (FHC). A hydraulic microdrive (MO-90S, Narishige International USA) was used to lower single electrode into the SC based on stereotaxic coordinates. Detailed procedures for identification of the SC were described in our previous article (Dash et al., 2015), and recording sites have been confirmed histologically in both animals. Individual neurons were separated online based on template matching as provided by the Alpha–Omega Engineering Multi Spike Detector (MSD). Based on our criteria, all of our recordings were done within top 1.5 mm of the left SC in both animals. In general, during any session we encountered visual neurons first and then motor activity emerged as we went deeper, as expected from the known functional anatomy of the SC.
Behavioral Procedures
Monkeys were trained to sit in a primate chair with their head immobilized and were fitted with a juice tube placed at their mouth for computer-controlled reward delivery (Crist Instruments). The monkeys were trained to generate the behavior of interest by rewarding them with units of fluid (juice or water), needed to satisfy their daily fluid requirements. Careful monitoring of fluid intake and body weight and supplementation of fluid outside the experiment if needed ensured that the animals were sufficiently hydrated at all the time. Monkeys were trained to keep their line of sight within an eye position window of 2–3° diameter centered on the fixation target (diameter 3 min of arc) presented on a computer monitor (Viewsonic P815, 20” screen diagonal, refresh rate 75 Hz, 1024 × 768 pixels) placed 40 cm in front of the monkeys in an otherwise completely dark room. We, used custom-designed software to present visual stimuli, control behavioral paradigms, and deliver juice rewards to the monkeys. As described in our previous article, we measured the rate of phosphor decay in our stimuli to confirm that this was complete approximately 1 s before the reported cell responses.
Memory Saccade Paradigm
During a typical trial the monkey fixated a small white dot (0.2°) in the center of the display (500–800 ms). While she fixated, a small (0.2°) white peripheral target was flashed for 200 ms. The monkey was required to maintain fixation throughout the target presentation period and also throughout the subsequent delay period (500–1000 ms; randomized variable delay between these two extremes). At the end of the delay interval the fixation target was extinguished and the monkey was required to make a saccade to the remembered location of the peripheral target. The monkey was rewarded if her eye position fixated within an 4° radius from the peripheral target location, within 500 ms of fixation target offset. Failure to perform this sequence of events resulted in the abortion of the trial (no reward) and the beginning of a new trial.
Using this paradigm, we screened the approximate location of visual and motor response fields (RF) for each recorded neuron in the right visual field, contralateral to our recording sites. Targets were presented in cardinal and oblique direction at 5°–20° eccentricities with 5° increments (20 different locations). We did not systematically map the complete RF of neurons as the purpose of using memory saccade paradigm was to get a quick, qualitative description of the neuron’s RF. Another block of memory saccade trials were carried out for a limited number of locations whose spatial coordinates were chosen based on the intended spatial configuration of the SP updating task. Memory saccade trials toward 7–9 different targets arranged in a linear array, which included the spatial boundary of the visual RF along the axis parallel to that of the subsequent SP ramp during SP updating task. Visual activity was sampled during a 100 ms interval that started 50 ms after visual target appearance (visual test) and it was compared to 100 ms period immediately preceding target presentation (control). The visual latency of neurons in our sample ranged between 50–70 ms. The motor activity was sampled in a 100 ms period starting 50 ms before saccade onset (motor test). To test if the neurons exhibited a memory response during the delay interval we defined a memory interval between 400–500 ms after visual target onset. This activity was compared to the same pre-stimulus control activity. All comparisons were made using Wilcoxon signed rank test and were deemed significant at p < 0.05. If only visual activity (for at least one stimulus location) was significantly different from its control, the neuron was deemed to be a visual neuron. Similarly, if only motor activity showed a significant difference, it was deemed to be a motor neuron. And if both visual and motor activity showed a significant difference, those neurons were deemed to be visuomotor neurons. The targets for which there was a significant visual response defined the entry point, exit point and center of visual RF (in one dimension) in the SP updating task. The approximate RF location of the neuron was used to ascertain the experimental configuration during the subsequent SP visual/updating task and was arranged in such a way that the saccade target (visual/memory target) corresponded approximately with the neuron’s RF somewhere along the SP ramp. The SP visual task and SP updating task were conducted in two separate blocks of trials whose order was randomized across the neural population.
SP Visual Task
Monkey subjects were trained to pursue a moving visual target (white dot; 0.2°) and make a saccade towards a stationary visual target (white dot; 0.2°) while ignoring another stationary distracter stimulus (a 0.2° orange dot appearing in the mirror location across the SP ramp; Figure 1A). A typical trial started with the monkey aligning its line of sight to a target placed 10° right, up or down of straight ahead position. While fixating, the visual target and distracter appeared simultaneously while the animal kept fixating for another 300–500 ms. Following this the home fixation target stepped “backwards” before reversing direction and moving at a constant velocity (10°/s; this “step-ramp” paradigm was used to avoid catch up saccades during pursuit initiation: both animals had a pursuit initiation latency of approximately 150 ms so, we stepped the target back by 1.5°). Animals then followed the target with SP. At an unpredictable time during the SP the target disappeared. At this point the animal was required to make a saccadic eye movement towards the peripheral visual target while ignoring the visual distracter. Both visual target as well as the distracter was visible during the entire duration of the trial. Animals were only rewarded if the saccade landed within 5° (radius) of the visual target.
The direction of the SP ramp and the location of the visual targets/distracters were chosen based on the location of visual RF of the neuron. Each neuron was tested with a single ramp direction orthogonal to the vector derived from the peak of the response field obtained on-line in the laboratory. The basic experimental configuration for each SC neuron was arranged in such a way that the saccade target (visual target) passed approximately through the center of the neuron’s RF during the SP ramp. Furthermore, we ensured that the animal could not predict the end of SP ramp (and plan the subsequent saccade vector in advance) based on the location of the memory target. We did this by having three fixed SP ramp lengths (20°, 24° and 28°) and 3–5 different visual target/distracter locations relative to the end of each SP ramp length (= 9–15 different conditions per session). With this configuration most of the visual target locations (in screen coordinates) were associated with more than one SP ramp length, thereby decreasing the chance of predicting SP ramp end. Visual targets were linearly arranged along an axis parallel to the SP ramp and they were equally spaced from each other (4° separation). Animals were trained on this task until they were able to fulfill all of the above requirements and obtain a reward on >90% of the trials.
SP Updating Task
This task was essentially the same as our previous experiment (Dash et al., 2015) and was identical to the SP visual task, except that instead of a persistent visual target and distracter for the entire trial duration, the memory target and distracter were flashed for 200 ms at the beginning of the trial and the animals were required to keep the location of these target in memory and make a saccade to the remembered location after an intervening SP (for more details see Dash et al., 2015).
Data Analysis
Trial history, eye position records (sampled at 1.5625 kHz) and the timing of identified spikes were stored for later offline analysis. In addition, high-resolution (25 kHz) records of the electrode signal were kept for offline verification of the spike identification obtained online. The analysis was carried out using customized MATLAB programs (MATLAB, The MathsWorks Inc., MA, USA). The horizontal and vertical eye position records were smoothed using a Savitzky-Golay filter (window = 20 samples; polynomial degree = 4), which replaces the data points in the specified window by a polynomial fit of chosen order. We estimated the instantaneous firing rate of the recorded neurons with a continuous spike density function (SDF), generated by convoluting the spike train with a Gaussian function of σ = 10 ms width. We converted the discharge into SDFs in order to obtain the continuous description of neuronal activity.
As explained earlier, the experimental configuration for the SP visual/updating task was arranged for each SC neuron based on the approximate location of its visual RF. To quantitatively study the visual/updating response, data were aligned on the time point when the visual angle subtended by the instantaneous eye position and the visual target location corresponded to the entry point of the RF. The entry point of the RF was derived from the visual response during memory saccade task.
Single Unit Analysis
The average neural activity during the 500 ms period around the peak visual or updating response (inRF) was compared with a 500 ms period the immediately preceding the entry into the RF (outsideRF). If the activity in the inRF was significantly different from outsideRF, the neuron was deemed to show a visual response (Wilcoxon signed rank test; p < 0.05). The same time windows and statistics were used during the SP updating task to test if the neuron exhibited a significant updating response during SP updating task. We compared the visual/updating responses between the conditions when the target vs. the distracter was in the RF (Wilcoxon rank sum test; p < 0.05). For comparison of the magnitude of visual vs. updating responses for visual/memory target at single neuron level we compared the inRF activity for both groups (Wilcoxon rank sum test; p < 0.05).
In order to quantitatively analyze the correlation (r-value) between the visual response and updating response we cross-correlated the instantaneous visual response with the updating response at different time lags. The search range for lag estimation for best r-value ranged from −200 to 200 ms, i.e., visual and updating responses were moved relative to each other to get the optimal lag/lead where they are best correlated. The entire time period from 1 s before entry in to RF (outsideRF) to 1 s after RF entry (inRF) was used for the estimation of the best correlation coefficients and time lags.
Group Analysis
Group level comparisons (whether between visual vs. updating responses or target vs. distracter responses) were done using the averaged activity in inRF period for all the neurons (Wilcoxon signed rank test; p < 0.05).
Results
We recorded 50 SC neurons in two rhesus monkeys (21 in Monkey S and 29 in Monkey W). Thirty nine out of 50 neurons were visually active and were considered for further analysis (Wilcoxon sign rank test; p < 0.05). Twenty one out of 39 visually active neurons also exhibited motor activity (visuomotor neurons), whereas 18 only showed visual responses (visual-only). Since the visual responses of visual-only and visuomotor neurons never showed any qualitative or quantitative differences in our subsequent analyses, we pooled their visual responses together for the analyses provided below and called these visually active neurons.
The bottom row of Figure 1 summarizes the continuous spatial updating responses for briefly presented memory targets that we reported previously and qualitatively compares these to the analogous visual responses to sustained stimuli. Figure 1C shows the task-relevant one-dimensional “slice” recorded of the RF of an example visual neuron. This figure shows the visual response for nine targets spanning horizontally from −16° to 16° (left to right separated by 4°) and with a constant vertical component of 5° relative to fovea (corresponding to the spatial range of visual or remembered targets that will pass through the neuron’s RF during our SP visual task or SP updating task, assuming for the moment that this RF is fixed relative to the eye). This neuron showed maximum response 5° vertically up relative to the fovea and also had significant response at 4° right/5° up relative to the fovea. Other locations did not evoke any significant visual response in this neuron.
Figures 1D,E plot neural activity for visual (dotted) and updating (solid) response as a function of horizontal eye position towards visual and memory targets and distracters, respectively. Figure 1D represents the visual and updating response towards three different targets spaced 4° apart from each other in the axis parallel to SP direction (circles with three different colors for three different set of trials presented randomly interleaved) during a 28° rightward SP starting from 10° left of center (arrow indicates the direction of SP). Figure 1E clearly shows the vigorous visual response (dotted traces) as soon as the location of the visual target started to overlap the RF of this neuron (4° right / 5° up). The peak visual response appears to be shifted slightly to the left (spatially) or before (temporally) the peak response that one would expect from the static RF. But the spatial resolution of our static RF maps was not high enough to analyze this quantitatively, and here we could not yet disambiguate spatial and temporal shifts. Therefore, we focused on comparison of visual vs. updating responses during SP.
Consistent with our previous study, a clear updating response (solid traces) also emerged roughly when the location of remembered target coincided with the RF of the neuron (Dash et al., 2015). However, Figure 1D reveals that the updating response is much weaker than the visual response, and the updating response is slightly shifted in space (or time) compared to corresponding visual response. Figure 1E shows the visual and updating response towards the distracters. Whereas the visual response for distracter is equally vigorous as for a visual target, the updating response is absent. We will quantify these observations in more detail in the following sections (Figures 2, 3, 4).
Strength of Visual and Updating Responses
Here we provide a more rigorous comparison of the magnitude of the four responses that we measured (visual vs. updating × active vs. passive). Figure 2A shows visual and updating responses in raster’s for the same visual neuron depicted in Figure 1 when instantaneous eye position corresponds to the entry point of the RF (4° right/ 5° up) during either SP visual task or SP updating task. This neuron shows a robust visual response towards both target (active visual response) as well as the distracter (passive visual response) when the eye brings the target into the neurons RF. At the group level, there was no difference between the visual response towards the target and the distracter (Figure 2B) but only 6/39 neurons showed a significantly different response in the active condition (Wilcoxon sign rank test; p > 0.05).
The example neuron in Figure 2A also exhibits a strong updating response towards target while no updating response towards the distracter. Consistent with our previous observation (Dash et al., 2015), almost all visually active neurons (38 out of 39) exhibited a significant updating response toward remembered location of target during SP updating task (Wilcoxon sign rank test; p < 0.05). Nineteen out of 39 visually active neurons exhibited significant updating response towards the distracter during SP updating task (Wilcoxon sign rank test; p < 0.05). At the single neuron level, 37 out of 38 updating neurons exhibited significantly higher updating response towards the target when compared with the distracter (Wilcoxon rank sum test; p < 0.05). The one remaining neuron did not show any significant difference but the average updating response for target was higher than that of the distracter. Figure 2C clearly shows that all the neurons are above the diagonal when mean updating response for target was plotted as a function of mean updating response for distracter. At the group level the updating response for target was significantly higher than that for distracter (Wilcoxon sign rank test; p < 0.000001). Thus, SC memory updating responses were much more sensitive to the influence of attention than SC visual signals during SP.
In the example neuron (Figure 2A), the updating response (red) is clearly weaker than the visual response (black). However, 20 out of 38 updating neurons showed a significantly higher visual response compared to updating response at single neuron level (Wilcoxon rank sum test; p < 0.05). Only one neuron showed a significantly higher updating response (Wilcoxon rank sum test; p < 0.05). However, overall the visual response was stronger across the population of 38 neurons (Wilcoxon sign rank test; p < 0.05; Figure 2D). The mean ratio of updating response and visual response across the population was 0.74, i.e., strength of updating response was approximately 74% of that of the visual response. Thus, at the overall population level, the active and passive visual responses were similar, both were significantly greater than the active updating response, and active updating (attended target) was significantly greater than passive updating (distracter).
Correlation and Timing of Visual and Updating Responses
Here we provide a more rigorous analysis of the relative timing of the responses that we measured. Figure 3A shows the continuous spike density profile representation of visual and updating responses for the target as well as the distracter for an example neuron (same neuron as shown in Figures 1, 2) when the eye position corresponded with the entry point of the neuron’s RF (4° right / 5° up). It is clear in the figure that updating response towards target (red profile) lags behind the visual response (black profile), i.e., when compared to the visual response it starts to develop after a time lag. In order to quantitatively determine the time lag between the visual and the updating response and to explore how well the firing profile of visual response correlates with the updating response we cross-correlated both the profiles at a continuous range of time lags ranging between −200 ms to 200 ms. The visual and updating response in this example neuron showed a correlation coefficient (r-value) of 0.9 when the visual response was moved by 137 ms towards right. In other words, visual response led the updating response by 137 ms (or updating response lagged the visual response). The inset in Figure 3A shows the r-value for the full range of time lags analyzed.
Across the population of neurons, visual and updating response profiles towards target exhibited a strong correlation between each other (median r-value = 0.8433) which was always better than the correlation between visual and updating response profiles towards the distracter (median r-value = 0.2102; Wilcoxon sign rank test; p < 0.05; Figure 3B). Across population, the updating response lagged behind the visual response (median lag = 55 ms; Figure 3C).
Active Visual Response as Combination of Passive Visual Response and Updating Response
In a natural environment, we often make movements towards target visible in peripheral vision after an intervening movement. Vaziri et al. (2006) have argued that the brain uses multiple sources of information for optimal response. In the SP active visual task (response to a continuous target), spatial attention, memory trace updating, and visual information were all available. If all of this information were used for tracking targets in the SC, this leads to the prediction that the SC response during this task should derive its features from both the updating response to an attended memory target and the passive sensory response to an unattended distractor. This can be observed in the example neuron shown in Figure 3A. The sharp initial response in the active visual task and the passive visual task were aligned, but the active response showed a more robust, longer lasting “tail” of activity. In contrast, the updating data lacked the sharp initial response, but had the longer lasting tail. Thus, in this neuron, the active visual response resembled the sum of the updating and passive responses.
To test this prediction quantitatively we combined the spike density profile of passive visual response and updating response and cross-correlated it with that of active visual response with zero time lag. If our hypothesis is correct then the combined response (passive visual response and updating response) should correlate better with active visual response at zero time lag compared with either of the individual responses. Figure 4A shows the continuous spike density profile representation of active visual (black) and combined responses (red) for an example neuron (same neuron as shown in Figures 1, 2, 3) when the eye position corresponded with the entry point of the neuron’s RF. It is clear that the tail end of the combined response coincide much better with active visual response when compared with passive visual response (Figure 3A). Upon cross-correlation of active visual response and combined response at zero lag we obtained a r-value (0.917) which was better than either cross-correlating active visual response with passive visual response (r-value = 0.900) or cross-correlating active visual response with updating response (r-value = 0.630). At the group level, correlation between active visual response and combined response was higher than either of the two contributing responses to combined response (Figures 4B,C; Wilcoxon signed rank test, p < 0.05). This supports our hypothesis that the active visual response to sustained stimuli is the sum of the passive visual response and the active updating response.
Discussion
Many previous studies reported the existence of memory trace response in cortex and SC during inter-saccade interval in a double step saccade task or, when a saccade brings a previously seen visual stimuli into the RF (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 2001; Inaba and Kawano, 2014; Dash et al., 2015); but none of these directly compared spatial updating (or remapping) signals with the visual response for more than one spatial location. To our knowledge, this is the first study to systematically compare spatio-temporal response profiles of memory trace updating and corresponding visual response (and the influence of attention on these) in any brain area during an ongoing eye movement.
The current results confirm our previous SP updating study (Dash et al., 2015), in particular, the existence of gaze-centered updating signals in SC neurons with visual responses. But the current study also adds several new and important observations that required a direct comparison of updating vs. visual responses during SP. First, we found a high spatio-temporal correlation between updating and visual responses during SP. However, attention had a much stronger influence on memory updating than visual responses, the magnitude of updating response was weaker than the active visual response, and the majority of visually active SC neurons exhibited a lag in memory trace updating response when compared with the visual response. Finally, we obtained the highest spatio-temporal correlations when the sum of the passive visual response and the updating response was compared to the active visual response. We shall consider the significance of each of these results in more detail in the following sections.
Similar Spatiotemporal Profiles in Updating and Visual Responses
The properties of visual RFs during saccades remain controversial (Zirnsak et al., 2014; Neupane et al., 2016), likely for the same reasons we outlined above (brief duration, widespread suppression). Here, we made a direct comparison of updating and visual response profiles when the animal was engaged in SP. Our paradigm allowed us to record visual and updating response through the entire span of neuron’s RF in one dimension; instead of just one spatial location typically used in previous studies (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 2001). In our previous comparison with static visual responses we found a high and significant correlation with updating responses in only 40% of visually responsive neurons. In the present study we find a high and significant correlation across the whole population of neurons. Thus, SC RF properties might be slightly modified by SP, but our data suggest that updating and visual responses share a very similar set of gaze-centered spatial inputs during SP. However, updating and visual responses also showed several differences, as follows.
Differences Between Visual and Updating Responses During SP
Relative Influence of Attention
In our previous study, we observed that the SP spatial updating response is highly dependent on attention, i.e., to a saccade target vs. a distracter stimulus (Dash et al., 2015). However, we were not able to compare this to the influence of attention on visual signals in the same behavioral setting. Here, we were able to show that attention has a much bigger influence on updating responses than it does on visual responses in the SC. This is consistent with the notion that updating is an internally driven, cognitive process (Klier and Angelaki, 2008; Sommer and Wurtz, 2008; Medendorp, 2011). More generally, this is consistent with the notion that attention and working memory are tightly linked processes (Curtis, 2006; Prime et al., 2007; Luck and Vogel, 2013). However, to our knowledge across eye movements this has only been demonstrated at the neuronal level in a few recent studies, such as our experiments (Dash et al., 2015) and a more recent experiment on trans-saccadic remapping of memory trace (Yao et al., 2016).
Visual and Updating Response Magnitude
Post-saccadic memory trace responses are weaker than visual responses in the same neurons (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 2001), but this is very difficult to quantify during rapid eye movements because of the brevity of the sample period and widespread response suppression during saccades (Sommer and Wurtz, 2006; Zirnsak et al., 2014). These, however, are not limitations during SP updating. In our previous study, which utilized an indirect comparison between visual responses during static eye position and memory updating responses during SP, we estimated that a response magnitude ratio of 50%. Here, in a more direct comparison of responses during SP, we found a ratio of 75% between responses to active attended visual targets vs. updated memory targets. This is consistent with the need to internally reconstruct updating signals (Droulez and Berthoz, 1991; Keith et al., 2010), but it may also be somehow complementary to visual responses in normal lighting conditions. We will return to the latter topic below.
Temporal Lag in Spatial Updating Signals
Saccade-related remapping is well known to be anticipatory, to the extent that it begins even before the saccade (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 1997; Nakamura and Colby, 2002; Zirnsak et al., 2014; Neupane et al., 2016). Here, we used the cross-correlation between memory trace updating and visual response to reveal that the updating response was not predictive, but rather lagged the visual response by a median value of 55 ms (52 ± 63 ms; mean ± std). This suggests that during SP, SC updating signals represent a slightly delayed estimate of current target location relative to gaze.
This is consistent with previous behavioral studies in both humans and monkeys which showed an inability to account for subsequent smooth eye displacement when a saccade target was flashed near the end of pursuit (McKenzie and Lisberger, 1986; Gellman and Fletcher, 1992). Recently, Blohm et al. (2005) re-examined this question and concluded that a post-stimulus latency of >175 ms to generate an accurate saccade. Shorter latency saccades were directed towards the instantaneous retinal error subtended during target flash, as expected if updating were incomplete. Based on these results, Blohm and collegues inferred that a time lag was present in the extra-retinal pursuit signal for updating, as we observed here.
It is easy to explain why pursuit updating is not predictive compared to saccades: saccade planning signals are predictive and therefore can be used to predict updating, whereas SP is stimulus-velocity driven and unpredictable. However, it is harder to explain a lag. From the viewpoint of building an internal model of the world during pursuit one would ideally want a zero lag. Pursuit speed was constant across all the experimental sessions (= 10°/s) and the direction of the SP was constant in a given session and could provide predictive information on the SP trajectory. We only varied the length of the SP (in order to maintain unpredictability of the go signal and promote continuous updating of the saccade target). It may be that there is a hardwired lag in the system. Assuming that SP updating is driven by efference copies of an SP velocity signal (Blohm et al., 2006), these should not lag behind the actual SP. However, our updating responses were clearly attention-dependent, and such signals could involve significant lags (Egeth and Yantis, 1997). Again, another possibility is that these updating lags might somehow augment normal vision, as considered in the next section.
Updating Signals During Normal Vision: Updating Spatial Attention?
Another possibility for the reduced gain and increased lag of updating responses relative to visual responses is that they serve some complementary function to vision in normal lighting conditions. For example, the presence of updating signals might augment and prolong visual signals, for improved attention and a better bridge it to action. It has previously been shown in the reach system that a combination of vision and updating provides more optimal behavior than either one alone (Vaziri et al., 2006), but to our knowledge, the current study is the first to show this occurring within actual neurons. In our final analysis, we tested such a prediction and found that active visual responses showed a high correlation with the sum of passive visual responses and updating responses. In our paradigm, this may have aided animals, even in the presence of a sustained visual target, to remain in a state of preparedness for a visuomotor transformation. In our paradigm, this only occurred at the “go signal”, at which time motor neurons began to show build up activity leading to a burst (see Dash et al., 2015, “Supplementary Figure 2”). Since the common element of our active visual and updating tasks was attention to a particular point in space, this suggests that pursuit updating signals are concerned with tracking (non-foveal) attended locations, whether these locations correspond to remembered stimuli or to stimuli that remain visible.
Neural Mechanisms: Possible Sources of Attention, Memory and Updating Signals
Humans and monkeys are able to accurately memorize a location in space and update the location after an intervening SP with the head mobile or immobilized (Schlag et al., 1990; Ohtsuka, 1994; Herter and Guitton, 1998; Baker et al., 2003; Blohm et al., 2005; Daye et al., 2010; Dash et al., 2015). Dash et al. (2015) identified a neural correlate of this memory trace response; continuous updating of a “hill” of activity in visually responsive neurons, corresponding to the gaze-centered location of a memorized target in the SC topographic map. Any brain area exhibiting above response should possess or receive several signals: first, visual inputs, to initiate the updating system and/or combine later with updating signals for active vision, second, attention-dependent mechanisms to hold the visual location in short-term memory (Goldman-Rakic, 1995; Baddeley, 2003, 2012), and third, access to an appropriate updating signal (Figure 5).
The visual inputs to the SC are well described and include both retino-tectal projections as well as projections from occipital and parietal cortex (May, 2006). Once such stimuli have activated the SC, many computational models have proposed that attended stimuli might be maintained by recurrent connections, both intrinsic to structures like the SC and between different regions, both during fixation and spatial updating task (Xing and Andersen, 2000; Keith et al., 2010). These signals could involve both intrinsic SC circuits as well as projections from cortical and sub-cortical regions including caudate nucleus, substantia nigra, dorso-lateral prefrontal cortex (DLPFC), frontal eye fields (FEF) as well as lateral intraparietal area (LIP; Hikosaka and Wurtz, 1983; Hikosaka and Sakamoto, 1986; Gnadt and Andersen, 1988; Funahashi et al., 1989; Goldman-Rakic, 1995; Constantinidis and Steinmetz, 1996; Compte et al., 2003; Armstrong et al., 2009).
What feedback information could be used as updating signal during SP updating? Based on behavioral observations, Blohm et al. (2006) proposed a model that used the delayed integration of eye velocity signal to obtain eye displacement signal prior to updating target location. Furthermore, consistent with our results, other computational modeling studies showed that when eye velocity was used as the updating signal, there was a continuous moving hill of activity across two dimensional topographic representation of visual space (Droulez and Berthoz, 1991; Keith et al., 2010). Various cortical and cerebellar regions, ventral intraparietal area (VIP), FEF, medial superior temporal area (MST), oculomotor vermis and ventral paraflocculus carry velocity signals which could be the source of updating signal and reach SC directly or indirectly (Fukushima et al., 1999; Ilg and Thier, 2003; Schlack et al., 2003; Medina and Lisberger, 2007; Dash et al., 2012). Finally, projections from visually responsive updating neurons in the SC to saccade motor neurons—both within the SC and other structures like FEF and LIP—would be required to initiate saccade activity in premotor burst neurons (Büttner-Ennever and Büttner, 1988; Crawford and Vilis, 1992; Moschovakis et al., 1996; Sparks, 2002).Together, our current results suggest that these circuits provide two interacting systems for optimal target tracking during pursuit: a completely internal attention-driven feedback loop for updating target memory (Dash et al., 2015) embedded within a vision-driven closed-loop feedback system.
Author Contributions
SD and JDC designed the experiment, SD and SAN conducted the experiments and analyzed the data, XY and HW provided technical and surgical help. SD and JDC wrote the manuscript.
Funding
This project was funded by the Canadian Institutes for Health Research. JDC was supported by a Canada Research Chair, and SD was supported by an Ontario Ministry of Research and Innovation Fellowship.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
- Armstrong K. M., Chang M. H., Moore T. (2009). Selection and maintenance of spatial information by frontal eye field neurons. J. Neurosci. 29, 15621–15629. 10.1523/JNEUROSCI.4465-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baddeley A. (2003). Working memory: looking back and looking forward. Nat. Rev. Neurosci. 4, 829–839. 10.1038/nrn1201 [DOI] [PubMed] [Google Scholar]
- Baddeley A. (2012). Working memory: theories, models and controversies. Annu. Rev. Psychol. 63, 1–29. 10.1146/annurev-psych-120710-100422 [DOI] [PubMed] [Google Scholar]
- Baker J. T., Harper T. M., Snyder L. H. (2003). Spatial memory following shifts of gaze. J. Neurophysiol. 89, 2564–2576. 10.1152/jn.00610.2002 [DOI] [PubMed] [Google Scholar]
- Blohm G., Missal M., Lefèvre P. (2005). Processing of retinal and extraretinal signals for memory-guided saccades during smooth pursuit. J. Neurophysiol. 93, 1510–1522. 10.1152/jn.00543.2004 [DOI] [PubMed] [Google Scholar]
- Blohm G., Optican L. M., Lefèvre P. (2006). A model that integrates eye velocity commands to keep track of smooth eye displacements. J. Comput. Neurosci. 21, 51–70. 10.1007/s10827-006-7199-6 [DOI] [PubMed] [Google Scholar]
- Burr D. C., Morrone M. C., Ross J. (1994). Selective suppression of the magnocellular visual pathway during saccadic eye movements. Nature 371, 511–513. 10.1038/371511a0 [DOI] [PubMed] [Google Scholar]
- Büttner-Ennever J. A., Büttner U. (1988). Neuroanatomy of the oculomotor system. Rev. Oculomot. Res. 2, 119–176. [PubMed] [Google Scholar]
- Churan J., Guitton D., Pack C. C. (2012). Perisaccadic remapping and rescaling of visual responses in macaque superior colliculus. PLoS One 7:e52195. 10.1371/journal.pone.0052195 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Compte A., Constantinidis C., Tegner J., Raghavachari S., Chafee M V., Goldman-Rakic P. S., et al. (2003). Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J. Neurophysiol. 90, 3441–3454. 10.1152/jn.00949.2002 [DOI] [PubMed] [Google Scholar]
- Constantinidis C., Steinmetz M. A. (1996). Neuronal activity in posterior parietal area 7a during the delay periods of a spatial memory task. J. Neurophysiol. 76, 1352–1355. [DOI] [PubMed] [Google Scholar]
- Crawford J. D., Henriques D. Y. P., Medendorp W. P. (2011). Three-dimensional transformations for goal-directed action. Annu. Rev. Neurosci. 34, 309–331. 10.1146/annurev-neuro-061010-113749 [DOI] [PubMed] [Google Scholar]
- Crawford J. D., Vilis T. (1992). Symmetry of oculomotor burst neuron coordinates about Listing’s plane. J. Neurophysiol. 68, 432–448. [DOI] [PubMed] [Google Scholar]
- Curtis C. E. (2006). Prefrontal and parietal contributions to spatial working memory. Neuroscience 139, 173–180. 10.1016/j.neuroscience.2005.04.070 [DOI] [PubMed] [Google Scholar]
- Dash S., Catz N., Dicke P. W., Thier P. (2012). Encoding of smooth-pursuit eye movement initiation by a population of vermal Purkinje cells. Cereb. Cortex 22, 877–891. 10.1093/cercor/bhr153 [DOI] [PubMed] [Google Scholar]
- Dash S., Yan X., Wang H., Crawford J. D. (2015). Continuous updating of visuospatial memory in superior colliculus during slow eye movements. Curr. Biol. 25, 267–274. 10.1016/j.cub.2014.11.064 [DOI] [PubMed] [Google Scholar]
- Daye P. M., Blohm G., Lefèvre P. (2010). Saccadic compensation for smooth eye and head movements during head-unrestrained two-dimensional tracking. J. Neurophysiol. 103, 543–556. 10.1152/jn.00656.2009 [DOI] [PubMed] [Google Scholar]
- Droulez J., Berthoz A. (1991). A neural network model of sensoritopic maps with predictive short-term memory properties. Proc. Natl. Acad. Sci. U S A 88, 9653–9657. 10.1073/pnas.88.21.9653 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duhamel J. R., Colby C. L., Goldberg M. E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255, 90–92. 10.1126/science.1553535 [DOI] [PubMed] [Google Scholar]
- Egeth H. E., Yantis S. (1997). Visual attention: control, representation and time course. Annu. Rev. Psychol. 48, 269–297. 10.1146/annurev.psych.48.1.269 [DOI] [PubMed] [Google Scholar]
- Fukushima K., Fukushima J., Sato T. (1999). Vestibular-pursuit interactions: gaze-velocity and target-velocity signals in the monkey frontal eye fields. Ann. N Y Acad. Sci. 871, 248–259. 10.1111/j.1749-6632.1999.tb09189.x [DOI] [PubMed] [Google Scholar]
- Funahashi S., Bruce C. J., Goldman-Rakic P. S. (1989). Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. J. Neurophysiol. 61, 331–349. [DOI] [PubMed] [Google Scholar]
- Gellman R. S., Fletcher W. A. (1992). Eye position signals in human saccadic processing. Exp. Brain Res. 89, 425–434. 10.1007/bf00228258 [DOI] [PubMed] [Google Scholar]
- Gnadt J. W., Andersen R. A. (1988). Memory related motor planning activity in posterior parietal cortex of macaque. Exp. Brain Res. 70, 216–220. [DOI] [PubMed] [Google Scholar]
- Goldman-Rakic P. S. (1995). Cellular basis of working memory. Neuron 14, 477–485. 10.1016/0896-6273(95)90304-6 [DOI] [PubMed] [Google Scholar]
- Hallett P. E., Lightstone A. D. (1976). Saccadic eye movements towards stimuli triggered by prior saccades. Vision Res. 16, 99–106. 10.1016/0042-6989(76)90083-3 [DOI] [PubMed] [Google Scholar]
- Herter T. M., Guitton D. (1998). Human head-free gaze saccades to targets flashed before gaze-pursuit are spatially accurate. J. Neurophysiol. 80, 2785–2789. [DOI] [PubMed] [Google Scholar]
- Hikosaka O., Sakamoto M. (1986). Neural activities in the monkey basal ganglia related to attention, memory and anticipation. Brain Dev. 8, 454–461. 10.1016/s0387-7604(86)80069-9 [DOI] [PubMed] [Google Scholar]
- Hikosaka O., Wurtz R. H. (1983). Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. J. Neurophysiol. 49, 1268–1284. [DOI] [PubMed] [Google Scholar]
- Ibbotson M. R., Crowder N. A., Cloherty S. L., Price N. S. C., Mustari M. J. (2008). Saccadic modulation of neural responses: possible roles in saccadic suppression, enhancement and time compression. J. Neurosci. 28, 10952–10960. 10.1523/JNEUROSCI.3950-08.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ilg U. J., Thier P. (2003). Visual tracking neurons in primate area MST are activated by smooth-pursuit eye movements of an “imaginary” target. J. Neurophysiol. 90, 1489–1502. 10.1152/jn.00272.2003 [DOI] [PubMed] [Google Scholar]
- Inaba N., Kawano K. (2014). Neurons in cortical area MST remap the memory trace of visual motion across saccadic eye movements. Proc. Natl. Acad. Sci. U S A 111, 7825–7830. 10.1073/pnas.1401370111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Keith G. P., Blohm G., Crawford J. D. (2010). Influence of saccade efference copy on the spatiotemporal properties of remapping: a neural network study. J. Neurophysiol. 103, 117–139. 10.1152/jn.91191.2008 [DOI] [PubMed] [Google Scholar]
- Klier E. M., Angelaki D. E. (2008). Spatial updating and the maintenance of visual constancy. Neuroscience 156, 801–818. 10.1016/j.neuroscience.2008.07.079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Luck S. J., Vogel E. K. (2013). Visual working memory capacity: from psychophysics and neurobiology to individual differences. Trends Cogn. Sci. 17, 391–400. 10.1016/j.tics.2013.06.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- May P. J. (2006). The mammalian superior colliculus: laminar structure and connections. Prog. Brain Res. 151, 321–378. 10.1016/s0079-6123(05)51011-2 [DOI] [PubMed] [Google Scholar]
- McKenzie A., Lisberger S. G. (1986). Properties of signals that determine the amplitude and direction of saccadic eye movements in monkeys. J. Neurophysiol. 56, 196–207. [DOI] [PubMed] [Google Scholar]
- Medendorp W. P. (2011). Spatial constancy mechanisms in motor control. Philos. Trans. R. Soc. Lond. B Biol. Sci. 366, 476–491. 10.1098/rstb.2010.0089 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Medendorp W. P., Tweed D. B., Crawford J. D. (2003). Motion parallax is computed in the updating of human spatial memory. J. Neurosci. 23, 8135–8142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Medina J. F., Lisberger S. G. (2007). Variation, signal and noise in cerebellar sensory-motor processing for smooth-pursuit eye movements. J. Neurosci. 27, 6832–6842. 10.1523/JNEUROSCI.1323-07.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mirpour K., Bisley J. W. (2015). Remapping, spatial stability and temporal continuity: from the pre-saccadic to postsaccadic representation of visual space in LIP. Cereb. Cortex [Epub ahead of print]. 10.1093/cercor/bhv153 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moschovakis A. K., Scudder C. A., Highstein S. M. (1996). The microscopic anatomy and physiology of the mammalian saccadic system. Prog. Neurobiol. 50, 133–254. 10.1016/s0301-0082(96)00034-2 [DOI] [PubMed] [Google Scholar]
- Nakamura K., Colby C. L. (2002). Updating of the visual representation in monkey striate and extrastriate cortex during saccades. Proc. Natl. Acad. Sci. U S A 99, 4026–4031. 10.1073/pnas.052379899 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Neupane S., Guitton D., Pack C. C. (2016). Two distinct types of remapping in primate cortical area V4. Nat. Commun. 7:10402. 10.1038/ncomms10402 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ohtsuka K. (1994). Properties of memory-guided saccades toward targets flashed during smooth pursuit in human subjects. Invest. Ophthalmol. Vis. Sci. 35, 509–514. [PubMed] [Google Scholar]
- Phongphanphanee P., Mizuno F., Lee P. H., Yanagawa Y., Isa T., Hall W. C. (2011). A circuit model for saccadic suppression in the superior colliculus. J. Neurosci. 31, 1949–1954. 10.1523/jneurosci.2305-10.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prime S. L., Tsotsos L., Keith G. P., Crawford J. D. (2007). Visual memory capacity in transsaccadic integration. Exp. Brain Res. 180, 609–628. 10.1007/s00221-007-0885-4 [DOI] [PubMed] [Google Scholar]
- Schlack A., Hoffmann K.-P., Bremmer F. (2003). Selectivity of macaque ventral intraparietal area (area VIP) for smooth pursuit eye movements. J. Physiol. 551, 551–561. 10.1113/jphysiol.2003.042994 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schlag J., Schlag-Rey M., Dassonville P. (1990). Saccades can be aimed at the spatial location of targets flashed during pursuit. J. Neurophysiol. 64, 575–581. [DOI] [PubMed] [Google Scholar]
- Sommer M. A., Wurtz R. H. (2002). A pathway in primate brain for internal monitoring of movements. Science 296, 1480–1482. 10.1126/science.1069590 [DOI] [PubMed] [Google Scholar]
- Sommer M. A., Wurtz R. H. (2006). Influence of the thalamus on spatial visual processing in frontal cortex. Nature 444, 374–377. 10.1038/nature05279 [DOI] [PubMed] [Google Scholar]
- Sommer M. A., Wurtz R. H. (2008). Brain circuits for the internal monitoring of movements. Annu. Rev. Neurosci. 31, 317–338. 10.1146/annurev.neuro.31.060407.125627 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sparks D. L. (2002). The brainstem control of saccadic eye movements. Nat. Rev. Neurosci. 3, 952–964. 10.1038/nrn986 [DOI] [PubMed] [Google Scholar]
- Umeno M. M., Goldberg M. E. (1997). Spatial processing in the monkey frontal eye field. I. Predictive visual responses. J. Neurophysiol. 78, 1373–1383. [DOI] [PubMed] [Google Scholar]
- Umeno M. M., Goldberg M. E. (2001). Spatial processing in the monkey frontal eye field. J. Neurophysiol. 86, 2344–2352. [DOI] [PubMed] [Google Scholar]
- Vaziri S., Diedrichsen J., Shadmehr R. (2006). Why does the brain predict sensory consequences of oculomotor commands? Optimal integration of the predicted and the actual sensory feedback. J. Neurosci. 26, 4188–4197. 10.1523/JNEUROSCI.4747-05.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walker M. F., Fitzgibbon E. J., Goldberg M. E. (1995). Neurons in the monkey superior colliculus predict the visual result of impending saccadic eye movements. J. Neurophysiol. 73, 1988–2003. [DOI] [PubMed] [Google Scholar]
- Xing J., Andersen R. A. (2000). Memory activity of LIP neurons for sequential eye movements simulated with neural networks. J. Neurophysiol. 84, 651–665. [DOI] [PubMed] [Google Scholar]
- Yao T., Treue S., Krishna B. S. (2016). An attention-sensitive memory trace in macaque MT following saccadic eye movements. PLoS Biol. 14:e1002390. 10.1371/journal.pbio.1002390 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zirnsak M., Steinmetz N. A., Noudoost B., Xu K. Z., Moore T. (2014). Visual space is compressed in prefrontal cortex before eye movements. Nature 507, 504–507. 10.1038/nature13149 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zivotofsky A. Z., Rottach K. G., Averbuch-Heller L., Kori A. A., Thomas C. W., Dell’Osso L. F., et al. (1996). Saccades to remembered targets: the effects of smooth pursuit and illusory stimulus motion. J. Neurophysiol. 76, 3617–3632. [DOI] [PubMed] [Google Scholar]