Abstract
A previous study showed that the initial ocular following responses elicited by sudden motion of a large random-dot pattern were only modestly attenuated when that whole pattern was shifted out of the plane of fixation by altering its horizontal binocular disparity, but the same disparity applied to a restricted region of the dots had a much more powerful effect [Masson, G.S., Busettini, C., Yang, D.-S., & Miles, F.A. (2001). Short-latency ocular following in humans: sensitivity to binocular disparity. Vision Research, 41, 3371–387]. Thus, if the dots were partitioned into horizontal bands, for example, and alternate bands were moved in opposite directions to the left or right then ocular following was very weak, but if the (conditioning) dots moving in one direction were all shifted out of the plane of fixation (by applying horizontal disparity to them) then strong ocular following was now seen in the direction of motion of the (test) dots in the plane of fixation, i.e., moving images became much less effective when they were given binocular disparity. We sought to determine if the greater impact of disparity with the partitioned images was because there were additional relative disparity cues. We used a similar partitioned display and found that the dependence of ocular following on the absolute disparity of the conditioning stimulus had a Gaussian form with an x-offset that was close to zero disparity and, importantly, this offset was almost unaffected by changing the absolute disparity of the test stimulus. We conclude from this that it is the absolute—rather than the relative—disparity that is important, and that ocular following has a strong preference for moving images whose absolute disparities are close to zero. This is consistent with the idea that ocular following selectively stabilizes the retinal images of objects in and around the plane of fixation and works in harmony with disparity vergence, which uses absolute disparity to bring objects of interest into the plane of fixation [Westheimer, G., & Mitchell, A.M. (1956). Eye movement responses to convergent stimuli. Archives of Ophthalmology, 55, 848–56].
Keywords: optokinetic eye movements, binocular disparity, visual motion, motion segmentation
1. Introduction
An observer who undergoes linear motion and looks off to one side experiences motion parallax as the images of objects at different distances move across his/her retina at different speeds. In order to stabilize the retinal images of objects in the passing scene the observer must track them with his/her eyes, but if the tracking mechanism is to respond selectively to the retinal motion of the object(s) of regard in the plane of fixation then it must ignore the retinal motion of other objects that are less or more distant. Mackensen (1953) showed that the optokinetic responses (OKN) elicited by wide-field motion were attenuated if the observer’s eyes were not correctly converged or focused on the moving display, and Howard and Gonzalez (1987) confirmed this observation, suggesting that at least some part of the effect was due to the disparity of the retinal images and that the motion detectors mediating OKN were disparity selective, preferring images with zero disparity, i.e., images in the plane of fixation. In support of this idea they showed that when the display was segregated into central and peripheral regions, in which the images moved in opposite directions and one or the other was given horizontal disparity, the associated optokinetic responses were always in the direction of the binocularly fused display, whether that was peripheral or central. In a subsequent study, Howard and Simpson (1989) provided subjects with a vertical line on which to converge their eyes and found that the optokinetic responses elicited by vertical motion of a display made up of oblique lines were roughly inversely proportional to the horizontal disparity of the display, at least over the range examined. Masson et al. (2001) reported that the initial open-loop ocular following responses (OFR) elicited by motion of a large random-dot pattern were only weakly sensitive to disparity that was applied uniformly to the whole pattern. These initial OFR are reflex-like, with ultra-short latencies of < 60 ms in monkeys (Miles, Kawano & Optican, 1986) and < 80 ms in humans (Gellman, Carl & Miles, 1990), and it has been suggested that they occur before the subject has had time to direct his/her attention to a particular part of the display and before the subject is even aware that there has been a visual disturbance (Miles, 1998). Masson et al. (2001) argued that applying the disparity uniformly to the whole moving image effectively simulated the visual experience of the rotating—rather than translating—observer who compensates only partially for the rotation and has a vergence error that renders the entire scene disparate (though normally not uniformly so): such visual disturbances lack the motion parallax associated with linear motion in a world with 3-D structure and hence lack the problem—conflicting motions in different depth planes—that binocular disparity had been hypothesized to resolve (in favor of the motion in the plane of fixation). To simulate the hypothesized motion parallax, these workers recorded the initial OFR elicited when the random-dot pattern was partitioned into two interleaved sets of horizontal bands that suddenly underwent opposite horizontal motion. This approach uncovered powerful effects of disparity on initial ocular following: when one set of (conditioning) dots was given disparity OFR now strongly favored the motion of the other set of (test) dots that lacked disparity. There were two important technical details in this study. First, the disparity was applied to the conditioning bands during a centering saccade because these workers had found that any sudden disturbances of the large-field pattern—regardless of whether they resulted in a change in disparity—produced a powerful transient suppression of OFR, an effect described previously by Kawano and Miles (1986) in monkeys. Second, the OFR stimuli—opposite motion of the test and conditioning bands—were applied soon after the saccade ended (in some cases, as early as 10 ms) to take advantage of post-saccadic enhancement, whereby motion in the immediate wake of a saccade across a textured background generates much stronger OFR than the same stimuli applied later (Gellman et al., 1990), and to preclude the possibility that there would be time for disparity-vergence eye movements to modify the applied disparity (Busettini, FitzGibbon & Miles, 2001), or for the subject to selectively redirect his/her attention to the (test) pattern in the plane of fixation.
Masson et al. (2001) suggested that the greater dependence of OFR on disparity when the visual stimulus was partitioned into regions with conflicting motion might indicate that the motion detectors driving OFR were more sensitive to relative motion and/or relative disparity than to en masse motion and/or absolute disparity. Absolute disparity refers to the slight differences in the positions of the two retinal images of a given object resulting from the differing viewpoints of the two eyes, and relative disparity refers to the differences in the absolute disparities of different objects within the visual scene resulting from differences in their distance to the observer. In the present study we used the partitioned display of Masson et al. (2001) and sought to determine whether the disparity involved was relative and/or absolute. To obtain definitive evidence for relative disparity it is necessary to show that the disparity tuning in one region is dependent on the disparity in another region. We now report that the absolute disparity at which the conditioning stimulus has its maximal impact on OFR is little affected by changing the absolute disparity of the test stimulus, i.e., the responses to the test and conditioning stimuli are separable, hence it is the absolute and not the relative disparity of the motion stimuli that determines their impact on OFR.
2. Methods
The visual display, eye-movement recording techniques, experimental procedures and data analyses were very similar to those used for Experiment 3 in the paper of Masson et al. (2001) and, therefore, will only be described in brief here.
2.1. Subjects
Four subjects (FM, DY, BS, NB) participated. All were experienced in eye movement recordings, with stereoacuities better than 40 seconds of arc (Titmus test) and no known oculomotor or visual problems other than refractive errors that were corrected with spectacles (FM). Subjects BS and NB were unaware of the purpose of the experiment.
2.2. Visual display
The subject faced a translucent tangent screen (80° wide, 50° high, at a viewing distance of 33.3 cm) onto which four photographic images, each filling the screen, were back-projected independently. Pairs of mirror galvanometers with an X/Y configuration were positioned in each of the four light paths to provide computer control of the horizontal and vertical positions of the images. The images were arranged in two matching dichoptic pairs, one pair forming a test pattern and the other pair a conditioning pattern. An orthogonal arrangement of polarizing filters in the projection paths and in front of the subject’s eyes ensured that each eye saw only one of the two test patterns and one of the two conditioning patterns: dichoptic stimulation. The test images consisted of white dots (diameters, 1.5°) arranged randomly within horizontal bands (each ~3.5° high) distributed at vertical intervals of ~7° on a black background (so that adjacent bands were separated by ~3.5°). At the start of the trial, the two test images overlapped exactly so as to create a single binocular image in the plane of the screen. The two conditioning images, which were identical to the test images except for being inverted vertically and horizontally, were also initially overlapping so as to create a single binocular image in the plane of the screen and were positioned so as to exactly fill the spaces between the bands of dots making up the test pattern. A cartoon showing the layout of the binocular images of the interleaved test and conditioning patterns can be seen in Fig. 5 of Masson et al. (2001). The bands were always vertically positioned so that a test band was at the center of the screen.
2.3. Eye-movement recording
The horizontal and vertical positions of both eyes were recorded with an electromagnetic induction technique (Robinson, 1963) using scleral search coils embedded in silastin rings (Collewijn, Van Der Mark & Jansen, 1975). The outputs from the coils were calibrated at the beginning of each recording session by having the subject fixate small target lights located at known eccentricities along the horizontal and vertical meridians.
2.4. Procedures
The presentation of stimuli, and the acquisition, display and storage of data were controlled by a PC (Pentium II) using a Real-time EXperimentation software package (REX) developed by Hays, Richmond and Optican (1982).
At the beginning of each trial, the test and conditioning patterns were imaged in the plane of the screen (each dichoptic pair overlapped exactly) and were stationary for a minimum period in excess of 1 s to allow adequate time for the subject to acquire a convergent state appropriate for the near viewing (33.3 cm). During a 10° leftward centering saccade—guided by target spots projected onto the display—horizontal step displacements (transition time, ~2 ms) were applied symmetrically to the image pairs to alter the horizontal disparity of the test and conditioning patterns independently. The magnitude and polarity (i.e., crossed or uncrossed) of these disparity steps were selected randomly from two lookup tables. The table entries for the conditioning pattern were 0°, 0.4°, 0.8°, 1.6°, 2.4°, 3.2°, and 6.4° and for the test pattern were 0° and 1.6°. Note that all disparities given in this paper are with respect to the center of the tangent screen unless specifically stated otherwise. Fifty milliseconds after the end of the centering saccade there was an equal probability that the test and conditioning bands would either remain stationary or undergo equal but opposite horizontal motion (40°/s) with the test bands moving leftward while the conditioning bands moved rightward, or vice versa, for 200 ms: OFR stimulus. After this, the images on the screen were blanked for 500 ms, marking the end of the trial. Each block of trials had 117 randomly interleaved stimulus combinations: 13 conditioning disparities, 3 test disparities, 3 velocities. The subject’s task was to make the leftward centering saccade and then refrain from making any further saccades until the end of the trial. Subjects were given no instructions in regard to the disparity or OFR stimuli. If there were no saccades (other than the centering saccade), then the data were stored on a hard disk; otherwise, the trial was aborted and subsequently repeated. Data were collected over several sessions until each condition had been repeated an adequate number of times to permit good resolution of the responses (through averaging) even when exploring the limit of the responsive range with stimuli of marginal efficacy (actual numbers will be given in the Results).
2.5. Data analysis
The horizontal and vertical eye position data obtained during the calibration procedure were each fitted with a third-order polynomial which was then used to linearize the horizontal and vertical eye position data recorded during the experiment proper. The latter were then smoothed with a cubic spline of weight 107, selected by means of a cross-validation procedure (Eubank, 1988), and all subsequent analyses utilized these splined data. Rightward eye movements were defined as positive. The horizontal version position was computed by averaging the horizontal positions of the two eyes, and the horizontal vergence position was computed from the difference in the horizontal positions of the two eyes, left eye minus right, so that increases in the vergence angle were positive. Version and vergence velocity were obtained by two-point backward differentiation of their respective position data. Trials with saccadic intrusions were deleted. Mean version and vergence temporal profiles (position and velocity) were computed for all the data obtained for each of the 117 stimulus conditions. The initial horizontal OFR were quantified by measuring the change in horizontal version position over the 83-ms time period commencing 85 ms after the onset of the stimulus ramps. We then computed the means of these change-in-version-position measures for each stimulus condition. The minimum latencies of onset were 85–90 ms so that these response measures were restricted to the period prior to the closure of the visual feedback loop (i.e., twice the reaction time): initial open-loop responses. To eliminate the (slight) effects due to post-saccadic drift, for each combination of test and conditioning disparities, the mean change-in-version-position measures recorded during the no-motion (saccade-only control) trials were subtracted from the same measures recorded during the motion stimulus (experimental) trials. As previously described by Masson et al. (2001), the disparity tuning curves describing the dependence of the initial OFR measures on the disparity of the conditioning stimulus were approximately bell shaped, and we fitted each with the following Gaussian function:
(1) |
where A is the y-offset, g is a scale factor, σ is the width, μ is the x-offset, and dc is the disparity applied to the conditioning bands. All units are degrees, except for g, which is dimensionless.
3. Results
3.1. Sample data from one subject
Disparity tuning curves describing the dependence of the initial OFR—given by the change-in-version-position measures (see Methods)—on the absolute disparity applied to the conditioning bands, dc, had the roughly bell-shaped form described by Masson et al (2001). Sample tuning curves from one subject (DY) are shown in Fig. 1. For the data in this figure, the test bands always moved leftwards while the conditioning bands always moved rightwards and, because we adopted the convention that rightward OFR are positive, OFR in the direction of the conditioning bands are plotted above zero and OFR in the direction of the test bands are plotted below zero. The data shown in filled squares were obtained while the test bands were imaged in the plane of the screen, i.e., no disparity was applied to the test bands (dt = 0), a situation that exactly simulated one of the stimulus configurations used by Masson et al. and essentially replicated their findings: when the conditioning bands were imaged in the plane of the screen, OFR were close to zero—actually favoring the motion in the test bands very slightly in this instance—and applying a few degrees of disparity to the conditioning bands, whether crossed or uncrossed, reduced the efficacy of the motion in those bands so that OFR now strongly favored the (leftward) motion in the test bands. The peak response is clearly offset slightly from zero, and the best-fit Gaussian function for these data (shown in continuous line) has an x-offset, μ, of 0.41° (crossed disparity): this is our best estimate of the absolute disparity at which the rightward motion of the conditioning bands had their greatest influence on OFR. The width of the best-fit Gaussian, σ, was 0.55°, but the data show a slight asymmetry in the decay from the peak to the asymptote—there is a small undershoot with uncrossed disparities that is not seen with crossed disparities—that is not captured by the (symmetrical) Gaussian function. Nonetheless, the Gaussian function still provides a reasonable representation of the data, accounting for 97% of the disparity-related changes in OFR (i.e., r2 = 0.97).
Figure 1 also shows the disparity tuning curves obtained when crossed (circles and dotted line) and uncrossed (diamonds and dashed line) disparities of 1.6° were applied to the test bands. It is immediately evident that the major effect of applying disparity to the test bands was to shift the tuning curves upwards. If the dependence on the disparity of the conditioning bands had emanated solely from their disparity relative to the disparity of the test bands then changes in the disparity of the test bands would have shifted the curves in Fig. 1 horizontally. More particularly, applying 1.6° of crossed disparity to the test bands would have shifted the curve 1.6° to the right and applying 1.6° of uncrossed disparity to the test bands would have shifted the curve 1.6° to the left. Based on the x-offset, μ, of the best-fit Gaussian functions, the actual horizontal shifts were quite small (0.09° and 0.23°, respectively) and rightward in both cases. The observed upward shift of the tuning curves indicates that OFR acquired a more rightward bias, consistent with the idea that applying disparity to the test bands reduces the impact of their (leftward) motion on OFR. The upward shift was much greater when the test bands had uncrossed disparity than when they had crossed disparity, the change in the y-offset, A, of the best-fit Gaussian functions being 0.066° and 0.026° in the two cases. To give these y-offsets some perspective, we expressed them as a percentage of the amplitude of the best-fit Gaussian (given by the difference between the peak and the asymptote) in the case in which the test disparity was zero. When so expressed, the changes in the y-offsets when the test bands were crossed and uncrossed amounted to 22% and 56%, respectively.
The data obtained with the opposite combination of motion stimuli—rightward test motion and leftward conditioning motion—showed very similar effects (though with the opposite sign, of course) and this is apparent from the parameters of the best-fit Gaussian functions listed for subject DY in Table 1.
Table 1.
Subj | Motion | Test Disparity dt | Y-offset A | Scale factor g | Widthσ | X-offset μ | Peak P | Amplit P-A | r2 | Range of N | Mean Difference in Vergence Angle | Slope:μ vs. dt |
---|---|---|---|---|---|---|---|---|---|---|---|---|
FM | Test leftward Cond rightward | Uncrossed | 0.023 | 0.337 | 0.86 | 0.07 | 0.179 | 0.156 | 0.98 | 166–174 | 0.015* | 0.18 (0.18) |
Zero | −0.085 | 0.198 | 0.55 | 0.11 | 0.058 | 0.142 | 0.92 | 172–176 | ||||
crossed | −0.023 | 0.192 | 0.88 | 0.65 | 0.064 | 0.087 | 0.94 | 164–175 | ||||
Test rightward
Cond leftward |
uncrossed | 0.188 | −0.533 | 1.02 | 0.55 | −0.020 | −0.208 | 0.96 | 166–175 | 0.017* | 0.06 (0.07) | |
zero | 0.311 | −0.344 | 0.98 | 0.80 | 0.171 | −0.140 | 0.92 | 167–177 | ||||
crossed | 0.162 | −0.235 | 0.77 | 0.76 | 0.041 | −0.121 | 0.91 | 163–177 | ||||
DY | Test leftward Cond rightward | uncrossed | −0.059 | 0.250 | 0.75 | 0.49 | 0.073 | 0.132 | 0.99 | 123–137 | 0.015* | 0.05 (0.04) |
zero | −0.125 | 0.184 | 0.63 | 0.41 | −0.008 | 0.117 | 0.97 | 126–138 | ||||
crossed | −0.099 | 0.237 | 0.72 | 0.64 | 0.033 | 0.132 | 0.98 | 126–135 | ||||
Test rightward
Cond leftward |
uncrossed | 0.057 | −0.225 | 0.71 | 0.63 | −0.069 | −0.126 | 0.99 | 127–136 | 0.005 | 0.06 (0.07) | |
zero | 0.136 | −0.152 | 0.67 | 0.56 | 0.045 | −0.091 | 0.95 | 129–138 | ||||
crossed | 0.098 | −0.233 | 0.70 | 0.82 | −0.035 | −0.133 | 0.99 | 127–134 | ||||
BS | Test leftward Cond rightward | uncrossed | −0.113 | 0.401 | 0.98 | −0.19 | 0.051 | 0.164 | 0.97 | 69–76 | 0.019* | 0.02 (0.01) |
zero | −0.181 | 0.342 | 0.92 | −0.41 | −0.033 | 0.148 | 0.99 | 69–79 | ||||
crossed | −0.110 | 0.439 | 0.90 | −0.13 | 0.086 | 0.196 | 0.99 | 70–76 | ||||
Test rightward
Cond leftward |
uncrossed | 0.106 | −0.434 | 1.08 | −0.04 | −0.054 | −0.160 | 0.95 | 69–81 | 0.024* | 0.02 (0.02) | |
zero | 0.162 | −0.308 | 0.77 | −0.28 | 0.002 | −0.160 | 0.96 | 69–80 | ||||
crossed | 0.071 | −0.368 | 0.83 | 0.04 | −0.105 | −0.176 | 0.98 | 69–79 | ||||
NB | Test leftward Cond rightward | uncrossed | 0.001 | 0.204 | 0.82 | 0.34 | 0.100 | 0.099 | 0.90 | 74–82 | 0.022* | 0.01(0.01) |
zero | −0.085 | 0.187 | 0.73 | 0.00 | 0.017 | 0.102 | 0.99 | 74–82 | ||||
crossed | −0.026 | 0.275 | 0.79 | 0.36 | 0.112 | 0.138 | 0.98 | 75–82 | ||||
Test rightward
Cond leftward |
uncrossed | 0.072 | −0.179 | 0.64 | 0.23 | −0.040 | −0.112 | 0.96 | 75–81 | 0.021* | 0.04 (0.03) | |
zero | 0.144 | −0.118 | 0.66 | −0.04 | 0.073 | −0.071 | 0.92 | 75–81 | ||||
crossed | 0.077 | −0.170 | 0.60 | 0.35 | −0.037 | −0.114 | 0.95 | 74–81 |
The Gaussian function in Expression 1 was fitted to plots like those in Fig. 1, each plot having 13 data points, which were the means of multiple samples (Range of N, range of samples used for each mean); the parameters of these fits are given by A, σ, μ, P, and P-A, which are in degrees, and g, which is dimensionless. Mean Difference in Vergence Angle, a mean pre-response vergence angle was first computed by averaging the vergence angles over the time period 0–83 ms (from onset of stimulus motion) for all 13 conditioning disparities for each value of dt, then the mean pre-response vergence angle when dt was uncrossed was subtracted from the mean pre-response vergence angle when dt was crossed. Slope: μ vs. dt, gives the slopes of the linear regression of x-offset (μ) on the disparity of the test bands (dt); values in parentheses were obtained after adjusting the disparities for any vergence error.
p < 0.05 (Student’s t-test).
3.2. Population data
Table 1 also lists the parameters of the best-fit Gaussian functions for three additional subjects who showed very similar trends. These Gaussian fits generally provided a very good representation of the disparity tuning curves, the r2 values ranging from 0.90 to 0.98 (mean ± SD, 0.96 ± 0.03), so that, on average, the fits accounted for 96% of the disparity-related variance.
That changing the absolute disparity of the test bands induced very little horizontal shift in the disparity tuning curves is evident from Fig. 2A, which shows the dependence of the x-offsets (μ) of the best-fit Gaussian functions on the absolute disparity applied to the test bands for all four subjects. If the x-offsets had been determined by the disparity of the conditioning bands relative to the disparity of the test bands then the curves in Fig. 2A would have had a slope of one (like the dashed line). Regression lines fitted to the data in Fig. 2A had positive slopes ranging from 0.01 to 0.18 (mean ± SD, 0.06 ± 0.05), indicating that, on average, the modulation of the x-offset with the disparity of the test bands was only ~6% of that expected of a relative-disparity mechanism: for a complete list of these slopes, see the column labeled, “Slope: μ vs. dt”, in Table 1. Although the mean x-offset when the test disparity was crossed was significantly greater (i.e., more crossed) than when the test disparity was uncrossed (p < 0.05, Student’s t-test), the difference was only 0.17°, which is ~5% of the difference in the test disparities.
Applying disparity to the test bands invariably shifted the OFR bias in favor of the motion in the conditioning bands, the y-offset of the best-fit Gaussians becoming more positive when the conditioning motion was rightward (as in Fig. 1) and more negative when the conditioning motion was leftward: see Table 1 and Fig. 3. The average y-offset, expressed with respect to the amplitude of the best-fit Gaussian when the test disparity was zero, was 65 ± 26% (SD). The effects on the width and amplitude of the best-fit Gaussians of applying disparity to the test bands were less consistent: four curves showed reduced width (mean reduction ± SD, 9 ± 9%) while the remainder (12) showed increased width (mean increase ± SD, 20 ± 20%), and four curves showed reduced amplitude (mean reduction ± SD, 14 ± 18%) while the remainder showed increased amplitude (mean increase ± SD, 31 ± 20%). See Table 1 for a complete listing of the widths (s) and amplitudes (P-A).
3.2. Vergence eye movements
A major concern was the possibility that changing the disparity of the test bands resulted in changes in the vergence angle that significantly altered the absolute disparities experienced by the observer (though, of course, not the relative disparities). To address this question, we measured the average vergence angle over the 83-ms periods immediately following the onsets of the OFR stimuli, which approximated the periods during which the visual system was sampling the stimulus motions giving rise to our measured OFR, and computed the mean of these measures for all of the trials for each stimulus condition. Vergence showed very little within-subject variation in the various conditions: for a given subject, the total range of mean vergence angles never exceeded 0.07°, which is only ~2% of the range of the applied test disparities (3.2°). This is evident from Fig. 4, which shows the dependence of the mean vergence angle on the disparity applied to the conditioning bands for each of the three test disparities used (for all four subjects). More particularly, the mean vergence angle when the test disparity was crossed exceeded that when the test disparity was uncrossed on average by only 0.017°, which is 0.5% of the difference in the applied test disparities: for a complete listing see the column in Table 1 labeled, “Mean Difference in Vergence Angle”. Thus, over the time period of interest, the vergence angle showed little dependence on the disparity applied to the test bands.
The estimated vergence errors—based on the difference between the mean vergence angles and the vergence angle required to align the two eyes on the center of the screen as indicated by our calibration procedure—varied substantially between subjects: FM and DY were generally overconverged (overall mean vergence error for all conditions ± SD: 0.02 ± 0.03° and 0.45 ± 0.09°, respectively), while NB and BS were generally underconverged (0.07 ± 0.05° and 0.69 ± 0.07°, respectively). The vergence errors provided estimates of the fixation disparities and so allowed us to also estimate the absolute disparities actually experienced by the subject at the screen center. Using these adjusted values we replotted the disparity tuning curves, fitted each with a Gaussian function and then plotted their x-offsets against the estimated mean absolute test disparity: see Fig. 2B. (Note that the estimated absolute disparities of the test bands in Fig. 2B were each based on the mean vergence error for all 13 conditioning disparities for each combination of stimulus motions). A comparison of Figs. 2A and B indicates that the major effect on the x-offsets of compensating for the vergence errors was to reduce the inter-subject vertical scatter (slightly) and to increase the inter-subject horizontal scatter. We saw in Fig. 4 that there was little within-subject variation in the vergence angle so it is perhaps not surprising that the slopes of the least-squares best fit linear regressions for the data in Fig. 2B never differed from those for the corresponding data in Fig. 2A by more than 1%. These slopes are listed in parentheses in the column labeled, “Slope: μ vs. dt”, in Table 1, and ranged from 0.01 to 0.18 (mean ± SD, 0.05 ± 0.06), indicating that, after compensating for vergence errors, on average the modulation of the x-offset with the disparity of the test bands was only ~5% of that expected of a relative-disparity mechanism. These values are almost identical to those obtained without compensation for vergence errors. Thus, the very small positive slopes in Fig. 2A were not secondary to changes in the vergence angle. Other parameters of the best-fit Gaussian functions (y-offset, peak, amplitude) never changed by more than 1% when vergence errors were compensated. In sum, changes in the vergence angle were minor and had negligible impact on the OFR data.
4. Discussion
A previous study on humans reported that binocular disparity applied uniformly to a large random-dot pattern had a relatively minor effect on the initial OFR elicited by motion of that pattern, but when the pattern was partitioned into regions with conflicting motion then altering the disparity of one of those regions could have a substantial impact on initial net tracking (Masson et al., 2001). In particular, when the pattern was subdivided into two interleaved sets of horizontal bands of test and conditioning dots that suddenly underwent horizontal motion in opposite directions, applying disparity to the conditioning dots substantially reduced their impact so that the initial OFR was now dominated by the motion of the test dots that remained in the plane of fixation. The suggestion was made that the initial OFR relied on motion detectors that were sensitive to relative motion and/or relative disparity. The present experiments have replicated these previous findings with partitioned dot patterns and shown that the disparity tuning curves describing the dependence on the disparity of the conditioning pattern are well fit by a Gaussian function whose x-offset is usually close to zero disparity. We reasoned that if a relative disparity mechanism were involved then a change in the disparity of the test dots should result in an equal change in this x-offset. However, we now report that the changes in x-offset were on average only 5–6% of the applied changes in the disparity of the test pattern (Fig. 2), indicating that the system was almost exclusively sensitive to the absolute disparity. There were consistent, often appreciable, changes in the y-offset—applying disparity to the test bands invariably shifted the OFR bias in favor of the motion in the conditioning bands—but this was to be expected, at least in part, from the reduced efficacy of the test bands when given disparity.
We conclude from these experiments that initial OFR is sensitive to absolute disparity and, as a consequence, is much more responsive to objects moving in the vicinity of the plane of fixation than to objects moving—often with competing motion—in other depth planes. The dependence on absolute disparity means that ocular following functions in harmony with disparity vergence, which is known to use absolute disparity to bring objects of interest into the plane of fixation (Busettini et al., 2001; Erkelens & Collewijn, 1985a; Westheimer & Mitchell, 1956).
The x-offset of the best-fit Gaussian functions, indicating the absolute disparity at which the conditioning stimulus had its greatest impact, was generally not located exactly at zero and even after compensating for the vergence errors in our experiment tended to be slightly shifted towards crossed disparities (Fig. 2B). We suggest that this was at least in part a consequence of our using a tangent screen and referring all absolute disparities to the screen center, which has crossed disparity relative to eccentric locations on the screen. If the ocular following mechanism integrates motion inputs over a wide area (extent presently unknown) and has indeed a preference for zero absolute disparity then, in our experimental situation, a certain amount of crossed disparity would be needed at the center to offset the uncrossed disparities at eccentric locations. Other studies that used a tangent screen to examine the tolerance of short-latency vertical disparity-vergence responses for horizontal disparity also found a slight crossed-disparity bias and attributed this to a similar cause (Yang, FitzGibbon & Miles, 2003).
It is well known that human stereopsis—depth perception based on binocular stereo cues—is much better for relative disparity than for absolute disparity (Erkelens & Collewijn, 1985a; 1985b; Kumar & Glaser, 1992; Regan, Erkelens & Collewijn, 1986; Westheimer, 1979) and the same is true of monkeys (Prince, Pointon, Cumming & Parker, 2000). Thus, our finding that the disparity mechanisms influencing the initial short-latency OFR depend on absolute rather than relative disparity is consistent with the idea that these ultra-rapid responses—like those responsible for the initial short-latency disparity vergence (Masson, Busettini & Miles, 1997)—operate independently of perception and perhaps occur before the observer is even aware that there has been a visual disturbance (Miles, 1998).
Monkeys provide a valuable animal model for studying the initial OFR, sharing many properties with humans (Gellman et al., 1990; Kawano & Miles, 1986; Miles et al., 1986), and also have excellent binocular vision. Disparity-sensitive neurons have been recorded in several regions of the monkey’s cortex, some of which are of particular interest to us here because they contain cells that are sensitive to both motion and binocular disparity. These include the medial temporal area (MT) (Bradley & Andersen, 1998; Bradley, Qian & Andersen, 1995; DeAngelis, Cumming & Newsome, 1998; DeAngelis & Newsome, 1999; Maunsell & Van Essen, 1983b) and the medial superior temporal area (MST) (Eifuku & Wurtz, 1998; Roy, Komatsu & Wurtz, 1992), which receives major inputs from MT (Maunsell & Van Essen, 1983a; Ungerleider & Desimone, 1986; Van Essen, Maunsell & Bixby, 1981) and has been strongly implicated in the generation of the initial OFR (Kawano, Shidara, Watanabe & Yamane, 1994; Takemura, Inoue & Kawano, 2002). Unfortunately, few studies have attempted to determine whether the cells in these regions are specialized for sensing absolute or relative disparity. Recent neurophysiological studies have concluded that most disparity-sensitive cells in cortical areas V1 (Cumming & Parker, 1999) and MT (Uka & DeAngelis, 2002) are responsive to absolute disparity because the preferred disparity in the receptive field centers is generally independent of the disparity in the surround regions. In fact, to date, only cortical region V2 has been shown to contain cells whose preferred disparities in the center of the receptive field are strongly dependent on the disparity in the surround, the hallmark of a mechanism sensing relative disparity (Thomas, Cumming & Parker, 2002). However, it is not clear that the sensing of relative disparity necessarily always involves center/surround comparisons and other spatial configurations need to be explored. Eifuku and Wurtz (1999) suggested that some motion-sensitive neurons in MST were selectively sensitive to relative disparity because the optimal disparities for the centers and surrounds of their receptive fields were different (Bradley & Andersen, 1998; Eifuku & Wurtz, 1999) but, as pointed out by Cumming and DeAngelis (2001) and Thomas et al. (2002), such neurons might merely be differentially sensitive to absolute disparity in their centers and surrounds.
The observation of Masson et al. (2001) that the effects of disparity on initial OFR were much greater when the disparity was applied selectively to regional elements with conflicting motion than when applied uniformly to the whole display led them to suggest that image segmentation mechanisms were operating. Motion signals are known to facilitate scene segmentation (Braddick, 1993; Nakayama, 1985; Stoner & Albright, 1993) and the opponent center-surround organization of the receptive fields of some cells in MT and MST—in which the center and surround prefer opposite directions of motion—has been invoked as the neural basis for this (Allman, Miezin & McGuinness, 1985a; Allman, Miezin & McGuinness, 1985b; Born, Groh, Zhao & Lukasewycz, 2000; Bradley & Andersen, 1998; Eifuku & Wurtz, 1998; Tanaka, Hikosaka, Saito, Yukie, Fukada & Iwai, 1986). Some of these cells are disparity sensitive and have a preference for zero disparity (Bradley & Andersen, 1998), exactly the sort of properties that might be expected of cells mediating the strongly disparity-dependent OFR when there is conflicting motion. However, such neurons are poorly responsive to coherent large-field motion, which is a powerful stimulus for OFR even when the images have disparity. Thus, the OFR elicited with large uniform patterns would seem to require neurons with much weaker inhibitory surrounds and a more modest preference for zero disparity. These seemingly different properties might define the two ends of a continuum of cells mediating OFR, cf., the population coding of disparity vergence in MST (Takemura, Inoue, Kawano, Quaia & Miles, 2001).
Acknowledgments
We thank Tom Ruffner, Nick Nichols, and Lee Jensen for technical assistance, Ed Fitzgibbon, John McClurkin, Kelvin Chen and Art Hays for software support, Jean Steinberg for secretarial assistance, and our subjects for their patience.
References
- Allman J, Miezin F, McGuinness E. Direction- and velocity-specific responses from beyond the classical receptive field in the middle temporal visual area (MT) Perception. 1985a;14:105–126. doi: 10.1068/p140105. [DOI] [PubMed] [Google Scholar]
- Allman J, Miezin F, McGuinness E. Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annual Review of Neuroscience. 1985b;8:407–430. doi: 10.1146/annurev.ne.08.030185.002203. [DOI] [PubMed] [Google Scholar]
- Born RT, Groh JM, Zhao R, Lukasewycz SJ. Segregation of object and background motion in visual area MT: effects of microstimulation on eye movements. Neuron. 2000;26:725–734. doi: 10.1016/s0896-6273(00)81208-8. [DOI] [PubMed] [Google Scholar]
- Braddick O. Segmentation versus integration in visual motion processing. Trends in Neuroscience. 1993;16:263–268. doi: 10.1016/0166-2236(93)90179-p. [DOI] [PubMed] [Google Scholar]
- Bradley DC, Andersen RA. Center-surround antagonism based on disparity in primate area MT. The Journal of Neuroscience. 1998;18:7552–7565. doi: 10.1523/JNEUROSCI.18-18-07552.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bradley DC, Qian N, Andersen RA. Integration of motion and stereopsis in middle temporal cortical area of macaques. Nature. 1995;373:609–611. doi: 10.1038/373609a0. [DOI] [PubMed] [Google Scholar]
- Busettini C, FitzGibbon EJ, Miles FA. Short-latency disparity vergence in humans. Journal of Neurophysiology. 2001;85:1129–1152. doi: 10.1152/jn.2001.85.3.1129. [DOI] [PubMed] [Google Scholar]
- Collewijn H, Van Der Mark F, Jansen TC. Precise recording of human eye movements. Vision Research. 1975;15:447–450. doi: 10.1016/0042-6989(75)90098-x. [DOI] [PubMed] [Google Scholar]
- Cumming BG, DeAngelis GC. The physiology of stereopsis. Annual Review Neuroscience. 2001;24:203–238. doi: 10.1146/annurev.neuro.24.1.203. [DOI] [PubMed] [Google Scholar]
- Cumming BG, Parker AJ. Binocular neurons in V1 of awake monkeys are selective for absolute, not relative, disparity. The Journal of Neuroscience. 1999;19:5602–5618. doi: 10.1523/JNEUROSCI.19-13-05602.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeAngelis GC, Cumming BG, Newsome WT. Cortical area MT and the perception of stereoscopic depth. Nature. 1998;394:677–680. doi: 10.1038/29299. [DOI] [PubMed] [Google Scholar]
- DeAngelis GC, Newsome WT. Organization of disparity-selective neurons in macaque area MT. The Journal of Neuroscience. 1999;19:1398–1415. doi: 10.1523/JNEUROSCI.19-04-01398.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eifuku S, Wurtz RH. Response to motion in extrastriate area MSTl: center-surround interactions. Journal of Neurophysiology. 1998;80:282–296. doi: 10.1152/jn.1998.80.1.282. [DOI] [PubMed] [Google Scholar]
- Eifuku S, Wurtz RH. Response to motion in extrastriate area MSTl: disparity sensitivity. Journal of Neurophysiology. 1999;82:2462–2475. doi: 10.1152/jn.1999.82.5.2462. [DOI] [PubMed] [Google Scholar]
- Erkelens CJ, Collewijn H. Eye movements and stereopsis during dichoptic viewing of moving random-dot stereograms. Vision Research. 1985a;25:1689–1700. doi: 10.1016/0042-6989(85)90141-5. [DOI] [PubMed] [Google Scholar]
- Erkelens CJ, Collewijn H. Motion perception during dichoptic viewing of moving random-dot stereograms. Vision Research. 1985b;25:583–588. doi: 10.1016/0042-6989(85)90164-6. [DOI] [PubMed] [Google Scholar]
- Gellman RS, Carl JR, Miles FA. Short latency ocular-following responses in man. Visual Neuroscience. 1990;5:107–122. doi: 10.1017/s0952523800000158. [DOI] [PubMed] [Google Scholar]
- Hays AV, Richmond BJ, Optican LM. A UNIX-based multiple process system for real-time data acquisition and control. WESCON Conference Proceedings. 1982;2:1–10. [Google Scholar]
- Howard IP, Gonzalez EG. Human optokinetic nystagmus in response to moving binocularly disparate stimuli. Vision Research. 1987;27:1807–1816. doi: 10.1016/0042-6989(87)90109-x. [DOI] [PubMed] [Google Scholar]
- Howard IP, Simpson WA. Human optokinetic nystagmus is linked to the stereoscopic system. Experimental Brain Research. 1989;78:309–314. doi: 10.1007/BF00228902. [DOI] [PubMed] [Google Scholar]
- Kawano K, Miles FA. Short-latency ocular following responses of monkey. II. Dependence on a prior saccadic eye movement. Journal of Neurophysiology. 1986;56:1355–1380. doi: 10.1152/jn.1986.56.5.1355. [DOI] [PubMed] [Google Scholar]
- Kawano K, Shidara M, Watanabe Y, Yamane S. Neural activity in cortical area MST of alert monkey during ocular following responses. Journal of Neurophysiology. 1994;71:2305–2324. doi: 10.1152/jn.1994.71.6.2305. [DOI] [PubMed] [Google Scholar]
- Kumar T, Glaser DA. Depth discrimination of a line is improved by adding other nearby lines. Vision Research. 1992;32:1667–1676. doi: 10.1016/0042-6989(92)90159-g. [DOI] [PubMed] [Google Scholar]
- Mackensen G. Untersuchungen zur Physiologie des optokinetischen Nystagmus. Klinische Monatsblätter für Augenheilkunde. 1953;123:133–143. [PubMed] [Google Scholar]
- Masson GS, Busettini C, Miles FA. Vergence eye movements in response to binocular disparity without depth perception. Nature. 1997;389:283–286. doi: 10.1038/38496. [DOI] [PubMed] [Google Scholar]
- Masson GS, Busettini C, Yang DS, Miles FA. Short-latency ocular following in humans: sensitivity to binocular disparity. Vision Research. 2001;41:3371–3387. doi: 10.1016/s0042-6989(01)00029-3. [DOI] [PubMed] [Google Scholar]
- Maunsell JH, Van Essen DC. The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. The Journal of Neuroscience. 1983a;3:2563–2586. doi: 10.1523/JNEUROSCI.03-12-02563.1983. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maunsell JH, Van Essen DC. Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. Journal of Neurophysiology. 1983b;49:1148–1167. doi: 10.1152/jn.1983.49.5.1148. [DOI] [PubMed] [Google Scholar]
- Miles FA. The neural processing of 3-D visual information: evidence from eye movements. The European Journal of Neuroscience. 1998;10:811–822. doi: 10.1046/j.1460-9568.1998.00112.x. [DOI] [PubMed] [Google Scholar]
- Miles FA, Kawano K, Optican LM. Short-latency ocular following responses of monkey. I. Dependence on temporospatial properties of visual input. Journal of Neurophysiology. 1986;56:1321–1354. doi: 10.1152/jn.1986.56.5.1321. [DOI] [PubMed] [Google Scholar]
- Nakayama K. Biological image motion processing: a review. Vision Research. 1985;25:625–660. doi: 10.1016/0042-6989(85)90171-3. [DOI] [PubMed] [Google Scholar]
- Prince SJ, Pointon AD, Cumming BG, Parker AJ. The precision of single neuron responses in cortical area V1 during stereoscopic depth judgments. The Journal of Neuroscience. 2000;20:3387–3400. doi: 10.1523/JNEUROSCI.20-09-03387.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Regan D, Erkelens CJ, Collewijn H. Necessary conditions for the perception of motion in depth. Investigative Ophthalmology and Visual Science. 1986;27:584–597. [PubMed] [Google Scholar]
- Robinson DA. A method of measuring eye movement using a scleral search coil in a magnetic field. IEEE Transactions on Biomedical Engineering. 1963;BME-10:137–145. doi: 10.1109/tbmel.1963.4322822. [DOI] [PubMed] [Google Scholar]
- Roy JP, Komatsu H, Wurtz RH. Disparity sensitivity of neurons in monkey extrastriate area MST. The Journal of Neuroscience. 1992;12:2478–2492. doi: 10.1523/JNEUROSCI.12-07-02478.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stoner GR, Albright TD. Image segmentation cues in motion processing: Implications for modularity in vision. Journal of Cognitive Neuroscience. 1993;5:129–149. doi: 10.1162/jocn.1993.5.2.129. [DOI] [PubMed] [Google Scholar]
- Takemura A, Inoue Y, Kawano K. Visually driven eye movements elicited at ultra-short latency are severely impaired by MST lesions. Annals of the New York Academy of Sciences. 2002;956:456–459. doi: 10.1111/j.1749-6632.2002.tb02854.x. [DOI] [PubMed] [Google Scholar]
- Takemura A, Inoue Y, Kawano K, Quaia C, Miles FA. Single-unit activity in cortical area MST associated with disparity-vergence eye movements: evidence for population coding. Journal of Neurophysiology. 2001;85:2245–2266. doi: 10.1152/jn.2001.85.5.2245. [DOI] [PubMed] [Google Scholar]
- Tanaka K, Hikosaka K, Saito H, Yukie M, Fukada Y, Iwai E. Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. The Journal of Neuroscience. 1986;6:134–144. doi: 10.1523/JNEUROSCI.06-01-00134.1986. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas OM, Cumming BG, Parker AJ. A specialization for relative disparity in V2. Nature Neuroscience. 2002;5:472–478. doi: 10.1038/nn837. [DOI] [PubMed] [Google Scholar]
- Uka T, DeAngelis GC. MT neurons do not signal relative disparity. Journal of Vision. 2002;2(7):37a. http://journalofvision.org/2/7/37/
- Ungerleider LG, Desimone R. Cortical connections of visual area MT in the macaque. The Journal of Comparative Neurology. 1986;248:190–222. doi: 10.1002/cne.902480204. [DOI] [PubMed] [Google Scholar]
- Van Essen DC, Maunsell JH, Bixby JL. The middle temporal visual area in the macaque: myeloarchitecture, connections, functional properties and topographic organization. The Journal of Comparative Neurology. 1981;199:293–326. doi: 10.1002/cne.901990302. [DOI] [PubMed] [Google Scholar]
- Westheimer G. Cooperative neural processes involved in stereoscopic acuity. Experimental Brain Research. 1979;36:585–597. doi: 10.1007/BF00238525. [DOI] [PubMed] [Google Scholar]
- Westheimer G, Mitchell AM. Eye movement responses to convergent stimuli. Archives of Ophthalmology. 1956;55:848–856. doi: 10.1001/archopht.1956.00930030852012. [DOI] [PubMed] [Google Scholar]
- Yang DS, FitzGibbon EJ, Miles FA. Short-latency disparity-vergence eye movements in humans: sensitivity to simulated orthogonal tropias. Vision Research. 2003;43:431–443. doi: 10.1016/s0042-6989(02)00572-2. [DOI] [PMC free article] [PubMed] [Google Scholar]