Abstract
Processing of visual information in the central (foveal) and peripheral visual field is vastly different. To achieve a homogeneous representation of the visual world across eye movements, the visual system needs to compensate for these differences. By introducing subtle changes between peripheral and foveal inputs across saccades, one can test this compensation. We morphed shapes between a triangle and a circle and presented two different change directions (circularity decrease or increase) at varying magnitudes across a saccade. In a change-discrimination task, observers disproportionally often reported percepts of circularity increase. To test the relationship with visual-field differences, we measured perception when shapes were exclusively presented either in the periphery (before a saccade), or in the fovea (after a saccade). We found that overall shapes were perceived as more circular before than after a saccade and the more pronounced this difference was for a participant, the smaller was their circularity-increase bias in the change-discrimination task. We propose that visual-field differences have a direct and an indirect influence on transsaccadic perception of shape change. The direct influence is based on the distinct appearance of shape in the central and peripheral visual field in a trial, causing an increase of the perceptual magnitude of circularity-decrease changes. The indirect influence is based on long-term build-up of transsaccadic expectations; if a change is opposite (circularity increase) to the expectation (circularity decrease), it should elicit a strong error signal facilitating change detection. We discuss the concept of transsaccadic expectations and theoretical implications for transsaccadic perception of other feature changes.
Keywords: Transsaccadic perception, Intrasaccadic changes, Visual stability, Shape/form perception, Sensorimotor contingencies, Transsaccadic expectation/prediction
1. Introduction
The human visual system achieves a high visual resolution and a large field of view despite limitations in processing. The centre of the visual field, namely the fovea, provides highly detailed and relatively undistorted information due to the high density of cone photoreceptors (Oesterberg, 1935; Curcio et al., 1990) and an overrepresentation in the visual cortex (e.g., Dow et al., 1981; Azzopardi & Cowey, 1993; Dumoulin & Wandell, 2008). The periphery provides a large field of view, albeit with less detailed and more spatially distorted information (for reviews, see Strasburger et al., 2011; Rosenholtz, 2016). One function of saccades is to bring relevant objects into the fovea, which inevitably leads to a drastic change in the incoming low-level information due to this physiological disparity between foveal and peripheral processing. Given that human perception appears to be homogeneous and stable across eye movements, there must exist a mechanism eliminating such self-induced differences between pre- and postsaccadic information and previous research revealed a number of behavioural observations that might be the result of such a compensation mechanism.
One line of research reports relatively poor performance when externally induced visual changes at the moment of a saccadic eye movement have to be detected. This phenomenon is generally referred to as saccadic suppression and applies to a number of visual object properties such as spatial position (saccadic suppression of displacement, e.g., Bridgeman et al., 1975), object contour (Henderson, 1997; Demeyer et al., 2010), orientation (Henderson & Hollingworth, 1999; De Graef & Verfaillie, 2002; Grzeczkowski et al., 2020), object type and token (Henderson & Hollingworth, 2003), luminance (Henderson et al., 2008), and spatial frequency (Weiß et al., 2015). This elevation of change-detection thresholds during a saccade compared to fixation has been interpreted in the sense that the visual system has a tendency to discard small intrasaccadic changes and instead to maintain the assumption of a stable external world (e.g., MacKay, 1972). A prior assumption of external stability might hence be one measure by the visual system to compensate for self-induced discrepancies such as due to visual-field differences. Interestingly, saccadic suppression of change detection is not inevitable as accompanying signals can facilitate intrasaccadic change detection such as target blanking (e.g., Deubel et al., 1996; 2002), changes in image size (McConkie & Currie, 1996), form changes (Demeyer et al., 2010), orthogonal target displacements (Wexler & Collins, 2014), and luminance or surface feature changes (Tas et al., 2012). Such visual events may break the stability assumption; but this and alternative explanations for their facilitative effect are still debated (e.g. Tas et al., 2012; Ziesche et al., 2017; Born, 2019) because a comprehensive charactarisation of the circumstances that lead to the facilitation is still missing.
Another line of research suggests that differences across the visual field are accounted for by the means of transsaccadic learning and transsaccadic predictions. Specifically, it has been shown that presaccadic stimuli appear more alike to a consistently accompanying postsaccadic stimulus after a relatively brief learning phase (e.g., Cox et al., 2005; Herwig & Schneider, 2014; Valsecchi & Gegenfurtner, 2016; for a review see Stewart, Valsecchi, & Schütz, 2020). Consistent with predictive coding theory (e.g., Rao & Ballard, 1999; Friston, 2009; for a review see de Lange et al., 2018), it has been suggested that a visual signal (Edwards et al., 2017), based on the recent transsaccadic experience, is generated upon processing of the presaccadic input and integrated with it leading to the biased appearance of the presaccadic stimulus. In essence, this line of research also suggests an experience-based mechanism (as any prediction should be based on experience) and this more specified predictive-coding mechanism might be likely candidates for how the visual system compensates for self-induced discrepancies and might as well be at the basis of intrasaccadic change detection (Ehinger et al., 2015).
To further characterise transsaccadic perception of change as well as to understand its relationship with appearance differences across the visual field, we investigated transsaccadic change perception a) of a key feature to mediate object constancy referred to as shape, form, or contour curvature (Kayaert et al., 2003; El-Shamayleh & Pasupathy, 2016), and b) with or without an accompanying signal that is known to facilitate change detection: a postsaccadic blank (Deubel et al., 1996). Additionally, we tested shape appearance pre- and postsaccadically, i.e., in the peripheral and central visual field. It is known from previous literature that the shape of geometric objects is perceived differently in the fovea and periphery (Baldwin et al., 2016; Coates et al., 2017; Valsecchi et al., 2018). Differences in appearance could have a direct effect on change perception as they could either perceptually increase or decrease the magnitude of a given physical discrepancy between pre- and postsaccadic inputs. For example, if shape is generally perceived as more circular in the periphery than in the fovea, intrasaccadic changes that increase circularity across a saccade should be reduced in perceived magnitude. Another and more indirect influence may come from transsaccadic predictions that are based on experienced transsaccadic contingencies. For example, in a scenario in which a less circular shape is predicted to follow after a saccade, a prediction error should be larger for more circular postsaccadic shapes and changes may be detected more easily.
2. Methods
The goal of this study was to investigate perception of shape changes across saccades and its interaction with perceptual differences between the peripheral and the foveal visual field. A second experiment was conducted to narrow down possible explanations for the direction of the observed bias in Experiment 1. Both experiments were divided into two parts: part A investigated transsaccadic shape change perception, and part B pre- (peripheral) and postsaccadic (foveal) shape appearance.
2.1. Participants
In Experiment 1, we tested 18 participants who were unaware of the purpose of the study of which one had to be excluded for not having executed a saccade in 98% of trials in part B. The data of 17 participants (10 females, 7 males; mean age = 23 years, range = 21–25 years) was used for analysis. In Experiment 2, a different group of 18 participants, who were unaware of the purpose of the study, was tested. Five of these participants had to be excluded. One did not complete both experimental parts. The four other excluded participants showed detection thresholds (in part A) that were unreasonably high (outside of our measurement range). That means that those participants did not achieve 75%-correct responses in at least one condition even with the largest shape changes we could apply. Thirteen participants (9 females, 4 males; mean age = 24 years, range = 20–28 years) remained for analysis. All participants were students of Marburg University, had normal or corrected-to-normal vision, and gave informed consent prior participation. The study was conducted in accordance with the principles of the Declaration of Helsinki (1964) and authorized by the local ethics committee of the psychology department at Marburg University (proposal number 2015–35 k).
2.2. Stimuli
The presaccadic fixation stimulus in Experiment 1 and the pre- and postsaccadic fixation stimuli in Experiment 2 were a combination of a bull’s-eye and crosshair (Thaler et al., 2013) with a diameter of 0.6° of visual angle, and of colour chosen randomly out of an array of colours generated in DKL colour-space (Derrington et al., 1984), with randomised polarity and isoluminance towards the grey background. The postsaccadic fixation stimulus in Experiment 1 was a black disk of 0.15° in diameter. Shape stimuli as depicted in Fig. 1A and Fig. 2A were similar to the ones used by Herwig et al. (2015) and Paeye et al. (2018), and were generated based on an equilateral triangle which sides increased in curvature k in discrete steps of 0.1 going from k = 0 (full triangle) to k = 1 (full circle). Curvature k corresponds to the ratio of the circumradius and the radius of the three circles used for the geometrical construction of a Reuleaux triangle (Reuleaux, 1875). The circumradii of the shapes (k = 0, k = 0.1, …, k = 1) in Experiment 1 were 1.72°, 1.58°, 1.46°, 1.38°, 1.31°, 1.25°, 1.21°, 1.18°, 1.15°, 1.13°, 1.11° respectively. This was done to keep the area covered by each figure approximately the same for all shapes at 5885 pixels (Fig. 1A). In Experiment 2, all shape stimuli had a circumradius of 1.28° (Fig. 2A). All shape stimuli were dark grey (RGB: 56, 56, 56).
2.3. Design
Two experiments with two parts each were conducted in this study. In both experiments, intrasaccadic change detection was measured in part A and differences between pre- and postsaccadic appearance in part B. The crucial difference between Experiment 1 and 2 was that in Experiment 1, only one stimulus was shown before and after a saccade and that participants had to discriminate the direction of the intrasaccadic shape change (stimulus became more circular or more triangular) in part A. In Experiment 2, a pair of stimuli was shown before and after a saccade and participants had to discriminate which of the two stimuli changed its shape during the saccade in part A. In part B of both experiments, participants had to judge whether a shape perceived pre- or postsaccadically was either more circular or more triangular than the mean shape across all stimuli seen throughout the experiment (method of single stimuli; Morgan et al., 2000) independently of the number of shape stimuli presented in a trial. We used a staircase procedure in part A and the method of single stimuli in part B of both experiments. In Experiment 1A, two staircases were assigned to each change direction and blanking condition. One staircase started with the smallest possible change magnitude of 0.1 |Δk| and the other with the largest possible change magnitude of 1 |Δk|. The presaccadic shape was chosen randomly amongst all shapes that were not too close to the end of the shape range in respect to the applied change magnitude and direction.
For example, if the change in a trial was assigned to −0.2 Δk, possible presaccadic shapes were all shapes except 0 and 0.1 k. If the change direction reported by the participant differed from the physical change direction the response was classified as a miss and the change magnitude was increased by a step size of 0.1 |Δk| for the next trial. If the reported change direction equalled the physical change direction, the response was classified as a hit and after two consecutive hits the change magnitude was decreased by the step size. Each staircase was running for 50 trials resulting in 400 trials in total for Experiment 1A. All conditions were tested interleaved and trial order was randomised. The design of Experiment 2A was similar to the one of Experiment 1A but the trial number for each staircase was 70 and there was no blanking condition, resulting in 280 trials for Experiment 2A. In Experiment 1B and 2B, 11 curvature values k (0.1, 0.2, 0.3, 0.4, 0.45, 0.5, 0.55, 0.6, 0.7, 0.8, 0.9) were tested for the presaccadic and postsaccadic condition with 15 repetitions each resulting in 330 trials. The two conditions were tested interleaved and trial order was randomised. In Experiments 1B and 2B participants completed a training of similar design as the main part of the experiment but without repetitions resulting in 22 trials. Training trials were excluded from analysis.
2.4. Equipment
For Experiment 1, stimuli were displayed on a VIEWPixx monitor at a 1920 × 1080 px resolution and a 120 Hz refresh rate. The display had a size of 51.5 × 29 cm and was viewed at a distance of 60 cm. The screen was calibrated to ensure a linear gamma correction and it had a luminance of 0.39, 54, and 105 cd/m2 for black, grey, and white pixels respectively. Eye movements were recorded with a desktop-mounted EyeLink 1000 (SR Research Ltd., Ontario, Canada) with a sampling rate of 1000 Hz. For Experiment 2, stimuli were presented using a back-projection setup, using a PROPixx projector (VPixx Technologies, Saint Bruno, QC, Canada), with a resolution of 1920 × 1080 px and a refresh rate of 120 Hz, projected onto a 91 × 51-cm screen from Stewart Filmscreen (Torrance, CA). Viewing distance was 106 cm. The screen was calibrated to ensure a linear gamma correction and to minimize the central hot spot, and it had a luminance of 2.07, 71, and 140 cd/m2 for black, grey, and white pixels respectively. Eye movements were recorded using a tower-mounted EyeLink 1000 Plus (SR Research Ltd., Ontario, Canada), with a sampling rate of 1000 Hz. Experimental software and analysis were written in MATLAB (Mathworks, Natick, MA, USA), using Psychophysics Toolbox (Brainard, 1997; Pelli, 1997) for stimulus display and the EyeLink Toolbox (Cornelissen et al., 2002) for eye tracker operation. Participants responded using a standard keyboard (vertical plus-sign button on number pad for towards-triangular or more-triangular responses and horizontal zero button on number pad for towards circular or more-circular responses; up- and down arrow keys for upper/lower responses in Experiment 2A) and their head position was stabilised using a forehead- and chinrest.
2.5. Procedure
Participants started each trial by pressing the space bar while fixating a central fixation stimulus. In Experiment 1A, the presaccadic shape appeared to the left or right at an eccentricity of 15° of visual angle on the horizontal axis after a duration jittered between 750 and 1500 ms. The participants were instructed to execute a saccade toward the centre of the peripheral shape, which was marked by a black dot (Fig. 1B). The fixation stimulus at screen centre remained on screen for additional 200 ms or until a saccade was detected. A trial was aborted when no saccade was detected within 1.8 s after saccade target onset. Upon saccade detection, the shape stimulus was replaced either immediately (no-blank condition), or removed (the black dot remained) for 200 ms (blank condition) and then replaced by the postsaccadic shape stimulus. The postsaccadic stimulus was displayed for half of the duration of the presaccadic stimulus in a given trial of the blank condition, and plus 30 ms in a given trial of the no-blank condition (to compensate for the time during the saccade). The extra time between trial start and response screen onset in a blank trial (due to the postsaccadic blank) was added to the no-blank condition but after the postsaccadic stimulus presentation; i.e., the central dot at saccade target position remained on screen for 170 ms. Finally, the blank screen prompted participants to give a response by button press, indicating whether the change was perceived as going toward a more triangular shape or toward a more circular shape. A high tone was played when the gaze behaviour in that trial was incorrect according to the criteria stated for trial exclusions below. A low tone was played when the response for the change direction was incorrect. No tone was played and the trial ended immediately after the response was given when gaze behaviour and response were correct.
In the trial procedure of Experiment 1B (Fig. 1D), either a shape stimulus plus central dot (presaccadic condition), or solely the black dot (postsaccadic condition) appeared presaccadically at an eccentricity of 15° of visual angle on the horizontal axis after a duration jittered between 750 and 1500 ms from trial start. Upon saccade detection, the presaccadic stimulus was either reduced to the uninformative central dot (presaccadic condition: shape information only presaccadically) or the shape stimulus was added (postsaccadic condition: shape information only postsaccadically). Postsaccadic-stimulus presentation duration equalled half the participant’s median presaccadic-stimulus presentation duration over all completed trials of the presaccadic condition plus 30 ms. After the postsaccadic shape stimulus offset, the black target dot remained on screen for another 170 ms. The consecutive blank screen prompted participants to give a response by button press indicating, whether the perceived shape was more triangular or more circular than the mean of all shapes seen thus far. There was no feedback given on the correctness of the response but a high tone was played for irregular gaze behaviour similarly to part A. In the 22 training trials, both kinds of feedback were given. The order of completion of part A and B was counterbalanced across participants and data was collapsed across order (AB or BA) as analysis revealed no effect of order.
The procedures of Experiment 2A (Fig. 2B) and B (Fig. 2D) were similar to the one of Experiment 1A and B respectively, except that two shape stimuli (without central black dots) were shown pre- and postsaccadically, one below and one above a second fixation stimulus centred between them, with a distance of 2.5° between the centre of one shape and the centre of the second fixation stimulus. Eccentricity from the first fixation stimulus was ± 5° on the horizontal axis. In Experiment 2A, the two shapes were always different presaccadically and identical postsaccadically and responses were given to indicate the location of the shape change (top or bottom). The presentation duration of the postsaccadic stimuli equalled half the presentation duration of the presaccadic stimuli on a given trial. In Experiment 2B, the presentation duration of the postsaccadic stimuli equalled half the participant’s median presentation duration of the presaccadic stimuli over all completed trials of the presaccadic condition and the empty response screen followed the postsaccadic shape stimuli offset immediately.
2.6. Eye-movement analysis and trial exclusions
For eye-movement data analysis saccades were detected offline using the EyeLink 1000 algorithm (velocity threshold = 22°/s, acceleration threshold = 3800°/s2). Saccade onset was defined as the first sample after saccade-target onset in which a saccade was detected; likewise, saccade offset was defined as the last sample after saccade onset in which a saccade was detected. Postsaccadic landing position was taken at the point of saccade offset. Saccade latency was defined as the time (resolution of 1 ms) between saccade-target onset and saccade onset. Results regarding saccade latencies can be found in the Supplementary material.
Trials, which contained blinks in the time between 300 ms to saccade-target onset and response-screen onset, trials, in which the switch between pre- and postsaccadic stimulus was not achieved in the time of the saccade (e.g., due to small, consecutive saccades instead of one large saccade), and trials, in which not the full sequence of events was run through were excluded from analysis. We further excluded trials with saccade latencies below 50 ms or above 600 ms. Further trials were excluded when gaze position deviated more than 2° on the horizontal axis or more than 1.5° on the vertical axis, from saccade target centre in the time between saccade landing and shape stimulus offset. In total, 11 ± 10% (mean ± standard deviation, over participants and conditions) of trials were excluded from Experiment 1A, 17 ± 10% from Experiment 1B, 5 ± 4% from Experiment 2A, and 10 ± 9% from Experiment 2B.
2.7. Psychophysical analysis
To obtain psychometric functions for each participant for Experiments 1A (Fig. 1C), perceptual choices were converted into proportion circularity-increase responses for each shape change tested. A cumulative Gaussian was fitted to the data using psignifit 4.0 toolbox (Schütt et al., 2016). The point of subjective stability (PSS) was estimated as the magnitude and direction of shape change (Δk) corresponding to 50% circularity-increase responses. A negative PSS indicates a bias for reporting circularity-increase shape changes. The just-noticeable difference (JND) was defined as the standard deviation of the cumulative Gaussian, with a lower JND indicating higher precision for shape-change discrimination.
Similarly to the data analysis for Experiment 1A, responses in Experiment 1B and 2B were converted into proportion more-circular (than the mean shape) responses for each shape tested, and psychometric functions were fitted (Fig. 1E, Fig. 2E). The point of subjective equality (PSE, parameter equivalent to PSS) was estimated as the degree of curvature (k) corresponding to 50% more-circular responses. A PSE above 0.5 indicates a bias for perceiving shapes as more triangular; accordingly, a PSE below 0.5 indicates a bias to perceive shapes as more circular. The just-noticeable difference (JND) was defined as the standard deviation of the cumulative Gaussian, with a lower JND indicating higher precision for shape discrimination.
Perceptual choices in Experiment 2A were converted into proportion correct responses for each shape change magnitude tested for both change-direction conditions. A cumulative Gaussian starting at chance level of 50%-correct responses was fitted to the data for each participant using psignifit 4.0 toolbox (Schütt et al., 2016). The detection threshold was estimated as the absolute magnitude of shape change (|Δk|) necessary for a participant to reach 75%-correct responses. A lower threshold indicates higher sensitivity to the corresponding shape-change direction (Fig. 2C). For all statistical tests, the alpha value was set to 0.05 and t-tests were two-tailed.
3. Results
3.1. Experiment 1 – Shape perception biases and blanking effect
In Experiment 1A, we increased or decreased the circularity of the shape stimulus during the saccade and asked participants to report the perceived direction of the change. The mean point of subjective stability (PSS) was −0.11 ± 0.16 Δk for the no-blank condition and −0.03 ± 0.09 Δk for the blank condition (Fig. 3A). The mean PSS for the no-blank condition was significantly different from zero (t(16) = −2.89, p = 0.011) indicating that participants had a bias to report transsaccadic shape changes of increasing circularity. A tendency for such a bias was also observed in the blank condition but it was not significantly different from zero (t(16) = −1.21, p = 0.243) and the difference between PSS for the no-blank and blank condition was significant (t(16) = −3.20, p = 0.006). The mean just-noticeable difference (JND) for shape change discrimination in Experiment 1A was 0.40 ± 0.14 |Δk| for the no-blank condition and 0.25 ± 0.07 |Δk| for the blank condition (Fig. 3B). JNDs were significantly different (t(16) = 5.85, p < 0.0001) between blanking conditions. In sum, participants were significantly more precise (JNDs) and more accurate (PSS) at discriminating shape-change direction in the blank condition compared to the no-blank condition. This result indicates a blanking effect for shape changes.
In Experiment 1B, we measured the appearance of the shapes presaccadically in the periphery and postsaccadically in the fovea. The mean point of subjective equality (PSE) in Experiment 1B was 0.46 ± 0.10 k for the presaccadic condition and 0.54 ± 0.09 k for the postsaccadic condition (Fig. 3C). The mean PSE for the presaccadic condition (t(16) = −1.70, p = 0.109) and postsaccadic condition (t(16) = 1.72, p = 0.107) were both not significantly different from the true mean of the shape stimuli of 0.5 k, but significantly different from each other (t(16) = −3.93, p = 0.0012). This indicates that participants perceived the shapes on average as more circular presaccadically in the periphery and as more triangular postsaccadically in the fovea. The mean just-noticeable difference (JND) in Experiment 1B was 0.13 ± 0.05 k for the presaccadic condition and 0.12 ± 0.06 k for the postsaccadic condition (Fig. 3D). The difference in JNDs between the pre- and postsaccadic condition was not significant (t(16) = 0.43, p = 0.675), which indicates that participants were equally precise at discriminating shapes from the mean shape pre- and postsaccadically1.
Most interestingly, the overall bias in the change discrimination task (PSS in Experiment 1A) cannot be explained by a direct influence of appearance differences between presaccadic peripheral and postsaccadic foveal vision (differences between PSEs in Experiment 1B). In fact, the more circular appearance in pre- compared to postsaccadic vison should increase the perceived change magnitude for circularity-decrease but participants showed a bias to report circularity-increase changes instead (see also Figure S1). To obtain a more detailed insight into the relationship between appearance differences and change discrimination biases, we analysed the impact of individual differences between pre- and postsaccadic shape perception (differences between pre- and postsaccadic PSEs of Experiment 1B) on participants’ biases (PSS of Experiment 1A) in the change discrimination task (Fig. 3E). A positive correlation between the PSE differences and PSS was observed for the no-blank condition (slope m = 1.14, pm = 0.017, y-intercept n = −0.20, pn < 0.001, r2 = 0.33) and a similarly oriented but non-significant relationship for the blank condition (m = 0.44, pm = 0.172, n = −0.06, pn = 0.09, r2 = 0.12). The positive slope may suggest that perceptual differences between pre- and postsaccadic perception do have a direct influence on transsaccadic change perception. Participants who perceived the shapes on average as more triangular postsaccadically than presaccadically (positive PSE differences in Fig. 3E) showed a smaller bias to disproportionally often report changes with circularity increase (PSS values closer to zero in Fig. 3E). Above and beyond this direct influence, the significantly negative intercept for the no-blank condition again shows that there was a bias to report circularity increase more often. The origin of this bias remains an open question that we will address in the discussion.
As we observed that the overall circularity-increase bias was reduced in the blank condition, where participants also were more precise (lower JNDs in part A) we further tested whether the magnitude of the bias was related to the precision across participants. The negative correlation for the no-blank condition (m = −0.70, pm = 0.015, n = 0.17, pn = 0.131, r2 = 0.33) shown in Fig. 3F indicates that lower precision in change discrimination was accompanied by a larger bias. The smaller variance across JNDs in the blank condition did not seem to affect the bias (m = −0.01, pm = 0.981, n = −0.02, pn = 0.811, r2 < 0.01). These results indicate that participants who had a harder time discriminating intrasaccadic shape changes (showed greater JNDs) benefited most from the circularity-increase change direction in terms of detectability (more negative PSS). Similarly, when there was a postsaccadic blank (i.e., JNDs were low) both change directions were equally well detectable.
3.2. Experiment 2 – Perceptual bias for circularity-increase changes
In Experiment 1A, we observed a bias for circularity-increase reports that led to a shift of the PSS. Theoretically, this bias alone could be interpreted as a perceptual bias, a response bias for one response alternative or even a response bias for one of the two response keys. However, the correlation between the bias in Experiment 1A and the differences in pre- and postsaccadic appearance in Experiment 1B (Fig. 3E) cannot be explained by any response bias and strongly suggest a perceptual bias. To provide further evidence that this was a perceptual bias and not a mere response bias for one response alternative or for one response key, we performed Experiment 2. Here, a pair of shape stimuli was shown before and after the saccade and only one stimulus changed its shape during the saccade. Participants had to report which of the two stimuli was changed. The mean detection threshold was 0.53 ± 0.20 |Δ k| for the circularity-decrease condition and 0.33 ± 0.10 |Δk| for the circularity-increase condition (Fig. 4A). Detection thresholds were significantly lower when shapes increased in circularity across a saccade compared to a circularity decrease (t(12) = 3.97, p = 0.002). This result replicates the change-direction bias observed in Experiment 1A and rules out the possibility of a response bias, meaning that participants not only reported but also perceived circularity-increase changes dis-proportionally often. In other words, the most likely explanation for the circularity-increase bias in PSSs in Experiment 1 are the lower detection thresholds for circularity increases compared to circularity decreases in Experiment 2.
Similarly to Experiment 1B, we measured the appearance of the shapes presaccadically in the periphery and postsaccadically near the fovea in Experiment 2B. The mean point of subjective equality (PSE) from Experiment 2B was 0.42 ± 0.06 k for the presaccadic condition and 0.46 ± 0.06 k for the postsaccadic condition (Fig. 4B). The mean PSE of the presaccadic condition was significantly different from the true mean of 0.5 k (t(12) = −4.68, p < 0.001), but that of the postsaccadic condition was not (t(12) = −2.14, p = 0.053). Mean PSEs of both conditions were significantly different from each other (t(12) = −5.57, p < 0.001). This replicates the finding from Experiment 1B that participants perceived the shapes on average as more circular presaccadically in the peripheral visual field and as more triangular postsaccadically near the central visual field. The mean just-noticeable difference (JND) from Experiment 2B was 0.12 ± 0.05 k for the presaccadic condition and 0.13 ± 0.05 k for the postsaccadic condition (Fig. 4C). The difference in JNDs between the pre- and postsaccadic condition was not significant (t(12) = −1.11, p = 0.291), which indicates that participants were equally precise at discriminating shapes from the mean shape pre- and postsaccadically, as it was the case in Experiment 1B.
4. Discussion
In this study, we investigated the perception of shape changes during saccadic eye movements and its relationship to pre- and postsaccadic appearance of shape. Our results confirm that transsaccadic perception of shape changes underlies the same effects that apply to similar (Deubel et al., 2002, Experiment 3; Grzeczkowski, van Leeuwen, et al., 2020) and other object features: performance at intrasaccadic change detection was relatively poor under normal conditions (no-blank condition) and an accompanying postsaccadic blank facilitated change detection (Fig. 3B). On the other hand, shape changes seem to be extraordinary (but see section 4.3 Transsaccadic expectations and other feature changes) as the direction of change influenced change detectability under normal conditions such that changes with increased circularity were detected more often than changes with decreased circularity (Fig. 3A & Fig. 4A). We could rule out that this was due to a simple response bias for choice category as we implemented a criterion-free paradigm in Experiment 2. We can also rule out the possibility that the bias in shape-change discrimination might be due to changes in size (circumradius) or covered area between shapes as we fixed one of these metrics in each experiment (Fig. 1A & Fig. 2A).
We found that shape appearance was distinct between pre- and postsaccadic perception such that shapes generally appeared more circular presaccadically in the peripheral visual field (at 15° in Experiment 1, and at 5° in Experiment 2) compared to postsaccadically in the fovea (Experiment 1, Fig. 3C) or near it (Experiment 2, Fig. 4B). This means that the differences in appearance cannot directly explain the overall bias in the perception of shape-changes in terms of a perceptual increase of the circularity-increase change magnitude. In fact, a more circular appearance of shape in the periphery should reduce the magnitude of a shape change that increased circularity across a saccade. Our finding on appearance differences may be compared to other findings on appearance differences between peripheral and foveal vision. For example, it was shown that stimulus size appears smaller in the periphery (Newsome, 1972), and numerosity (number of dots in a dot cloud) appears lower in the periphery (Valsecchi et al., 2013; but see Hübner & Schütz, 2017). What determines less triangular appearance in the periphery might be related to what causes the size or numerosity reduction (see also section 4.2 Shape across the visual field). However, we want to emphasise that our and these other findings on visual-field differences in the appearance of visual features are not directly comparable. Pre- and postsaccadic perception are not equivalent to mere perception at the periphery and fovea. This may especially be the case for spatial features such as spatial frequency, numerosity, or shape since it has been shown that the preparation of a saccade abolishes visual crowding (Harrison et al., 2013), and enhances spatial resolution (Li et al., 2016; 2019). Measuring pre- and postsaccadic appearance represents a more complete account in regard to transsaccadic perception. This may be especially evident considering that presaccadic appearance likely results from an integration of presaccadic sensory information with the prediction for the postsaccadic outcome (e.g., Herwig et al., 2015; Valsecchi & Gegenfurtner, 2016). This integration will inevitably make pre- and postsaccadic appearance more similar.
We further found that inter-individual variations of pre- and postsaccadic differences (differences between PSEs of Experiment 1B) systematically influenced shape-change perception (shifts in the PSS of Experiment 1A) as shown by a significant positive correlation between the two (Fig. 3E). This correlation can only be based on a perceptual bias and cannot be explained by any response bias. Taken together, our results may suggest that visual-field differences have a direct and an indirect influence on transsaccadic perception of shape changes. The direct influence is based on the distinct appearance of shape pre- and postsaccadically; if a shape appears more circular before than after the saccade, shape changes with circularity increase should have a smaller perceptual magnitude and be missed more easily than changes with circularity decrease. However, the perceived magnitude of a shape change only seems to play a subsidiary role as we found an overall bias in the opposite direction. Change direction predominantly affected shape-change perception and this may be due to visual field differences as well, but indirectly. We suggest that a life-time experience of appearance changes leads to the build-up of transsaccadic expectations2 that serve as a measure for the visual system to evaluate perceptual evidence for or against external stability. One might infer from the pre- and postsaccadic appearance differences of shape that the typical experience of the visual system should be a circularity decrease in saccade direction (perceived circularity is higher presaccadically than postsaccadically) and that similar experiences with real-world shapes have formed the expectation responsible for the observed bias. The principal assumption we make is that a contradiction of such an expectation, i.e., a circularity-increase change should be evaluated as strong evidence against stability and facilitating change detection, leading to the overall bias for circularity increase. It seems likely that participants, who relied more strongly on expectations than others benefited more from a circularity-increase change i.e., showed a stronger circularity-increase bias and also showed smaller differences in pre- and postsaccadic appearance (as presaccadic appearance would more strongly be influenced by the prediction).
According to formulations in predictive coding theory (Feldman & Friston, 2010; Bastos et al., 2012), participants who rely more on predictions and down-weight predictions errors should also show lower sensory precision. Evidence following this line comes from the correlation of individual differences in change-discrimination precision (JNDs in Experiment 1A) with individual bias strength (Fig. 3F). Participants who were less precise might have down-weighted predictions errors (in classical terms: they had a stronger assumption of stability) and hence, tolerated larger discrepancies between pre- and postsaccadic information. Those participants revealed a larger circularity-increase bias, which suggests that this change direction caused prediction errors strong enough to make the external change detectable despite the down-weighting. It should, however, be mentioned that increased change-discrimination precision might also be due to larger pre- and postsaccadic appearance differences in those participants, which, potentially, facilitated the detection of circularity-decrease changes more than it impaired the detection of circularity-increase changes (Figure S2). Given trials with a postsaccadic blank, JNDs were overall smaller, a circularity-increase bias was nullified, and there was no more correlation between individual precision and bias strength. This pattern of results would be expected if a postsaccadic blank already caused a maximally large prediction error (in classical terms: abolished the stability assumption) and there would have been nothing left for strong evidence coming from a circularity-increase change to add.
4.1. Transsaccadic expectations
A striking commonality amongst all visual events that improve intrasaccadic change detection performance is that they are unexpected with respect to what can be learned from every-day transsaccadic experience (O’Regan & Noë, 2001). For example, discrepancies between saccade landing position and postsaccadic target position (referred to as retinal error) in parallel to saccade direction are “experienced” by the visual system to a greater degree due to an individual’ s natural landing variability (van Opstal & van Gisbergen, 1989; Niemeier et al., 2003). On the contrary, orthogonal displacements place saccade targets outside the typically experienced, oval window of saccade landing variability (Niemeier et al., 2007; Wexler & Collins, 2014; Atsma et al., 2016). Such an orthogonal error should contradict what could be learned from everyday experiences and therefore facilitate detection of a change. A second example may be that visual disruption that can be anticipated by the visual system, such as the visual blank caused by blinks, does not facilitate transsaccadic change detection in contrast to externally imposed blank periods (Deubel et al., 2004). In general, it seems that less frequently experienced discrepancies reach consciousness and facilitate change detection while more frequently experienced discrepancies fail to reach consciousness and change detection is suppressed. Similarly, we show that, due to pre- and postsaccadic appearance differences, the typical transsaccadic experience of shape is that circularity decreases in saccade direction. Appearance differences experienced throughout life might form transsaccadic expectations about the typical magnitude and, importantly, the typical direction of change. Hence, changes that are opposite to the expected change direction should lead to an increased error or may be taken as strong evidence for a change in the external world, reducing the impact of an assumption of external stability3.
Change detection facilitation due to a specific change direction has, until now, only been reported for saccade target displacements (McConkie & Currie, 1996; Niemeier et al., 2007; Wexler & Collins, 2014; Atsma et al., 2016; Souto et al., 2016). The underlying concepts of two models (Niemeier et al., 2003; Atsma et al., 2016) that can explain such a facilitation for target displacements orthogonal- compared to parallel to saccade direction may be similar to what was first suggested by MacKay (1972); namely, a dichotomy between the two possible scenarios of either an external change or no external change for or against which evidence can be evaluated based on transsaccadic expectations. Transsaccadic predictions appear to be the measure for the visual system by that transsaccadic expectations (experience-based knowledge on transsaccadic contingencies) become effective. To give a simplified example, if the visual system has learned that shapes typically become more triangular across a saccade, the visual signal that gets generated for, e.g., a medium shape of k = 0.5 in the periphery, should be of a more triangular shape (e.g., k = 0.1) and fed back to lower visual areas before the postsaccadic information arrives. The discrepancy (also referred to as prediction error in predictive coding) between this prediction (that relies on presaccadic sensory information and transsaccadic expectations) and the actual postsaccadic shape should be larger when the postsaccadic shape is more circular (e.g., k = 0.7), than when the postsaccadic shape information would be more triangular (e. g., k = 0.2), and a larger error should facilitate change perception. The overall bias we found for circularity increase suggests that a transsaccadic prediction (more triangular), rather than the presaccadic information (more circular), is compared to the postsaccadic information. An integration of the prediction with the presaccadic input may take place subsequently and, possibly, only when no postsaccadic input was available e.g., when presaccadic appearance is tested. Models on intrasaccadic change perception (e.g. Atsma et al., 2016) should incorporate transsaccadic predictions that are specific to the learned transsaccadic contingencies of the feature at hand.
Alternative theoretical accounts for intrasaccadic change detection have been proposed to explain benefits from target blanking and are based on the potential benefit provided by the extra amount of input-free time during the blank period, enabling either a sufficient read-out of the presaccadic target information, or providing sufficient time to process upcoming postsaccadic information outside the time window of suppression of contrast sensitivity (e.g. Zimmermann et al., 2013; Zie-sche et al., 2017). Such accounts fail to offer a potential explanation for our shape-change direction bias, and a row of other findings on transsaccadic change perception. For example, the improvement of displacement detection due to accompanying object-form changes (Demeyer et al., 2010) or other accompanying feature changes (Tas et al., 2012), or a stronger blanking effect for children compared to adults (Stewart, Hübner, & Schütz, 2020). Overall, an account based on evidence evaluation for or against a stable transsaccadic percept appears to be the more comprehensive theory for visual stability across saccades and, with consideration of feature-specific transsaccadic expectations, the most likely theory behind our findings.
4.2. Shape across the visual field
Assuming that transsaccadic expectations led to the observed circularity-increase bias, it should be evaluated what the particular character of the typically experienced saccade-induced contingency is, that could have led to such an expectation. To do that, we need to evaluate what determines shape information in the periphery compared to the fovea. We know that the peak of the spatial contrast sensitivity function is shifted to lower spatial frequencies in the periphery compared to the fovea (e.g., Rovamo et al., 1992), which may imply that two intersecting lines or edges become less visible in the periphery the smaller the angle separating them (the sharper a corner). In addition, spatial localisation of available visual information is more difficult in the periphery (Rentschler & Treutwein, 1985; Levi & Klein, 1986; Hess & Hayes, 1994), potentially leading to distorted shape information and edges that are spatially misaligned. Illustrations of the approximated distortion in low-level peripheral processing for shape can be found in the work by Valsecchi et al. (2018), who manipulated overlapping geometric shape stimuli using an image-manipulation algorithm that was designed to simulate all aspects of low-level peripheral processing (Eidolon factory, Koenderink et al., 2017). Taken together, these studies point at two key properties that might determine low-level shape information across the visual field: spatial detail (sharpness) and shape continuity (degree of distortion).
Our finding that shapes are perceived as more circular in the periphery (Fig. 3C & Fig. 4B) could be caused by the limited processing capacity of both of these properties. Fine corners were either not represented for the lack of visual detail or they were mis-localised to some degree that gave the impression of not being part of the figure/shape. Alternatively, they might be removed in order to rectify spatial disarray in the periphery. For instance, perceptual illusions such as the honeycomb illusion (Bertamini et al., 2016, 2019) may indicate that fine visual detail is reasonably well resolvable and localisable in the periphery but becomes less visible for the sake of a simple geometrical shape representation. Consistently with this interpretation, Valsecchi and colleagues (2018) showed that irregular shapes appear less irregular in the periphery than in the fovea; and it is known that feedback information is at the basis of shape perception (e.g., Hupé et al., 1998; Murray et al., 2002; Kok & de Lange, 2014). This would mean that for our intermediate shapes, even when corners could be resolved and located presaccadically they might have been rationalised to represent a circle as a less ambiguous shape.
In conclusion, all possibilities predict that spatial detail such as corners should rather add to an object’ s shape across a saccade than disappear. This may be due to the lower resolution, higher localisation uncertainty, or some mid-level rationalisation for circles in the periphery. Given that this low- or mid-level discrepancy was measurable between pre- and postsaccadic appearance (Fig. 3C & Fig. 4B) we cannot identify whether transsaccadic expectations were learned from appearance differences or from lower-level differences.
4.3. Transsaccadic expectations and other feature changes
Shape is known to mediate object constancy (Kayaert et al., 2003; El-Shamayleh & Pasupathy, 2016) and may even be one of the most relevant properties for the deduction of laws following from sensorimotor contingencies (e.g., Koenderink, 1985; O’Regan & Noë, 2001). Nevertheless, there might or should be transsaccadic expectations for other object feature changes. The nature of such an expectation might strongly depend on or be determined by the compensation mechanism that the visual system uses to work around the processing limitations of peripheral vision. In other words, the build-up of transsaccadic expectations may be based on appearance of stimuli rather than on the earlier visual information. Recent findings by Cicchini et al. (2021) support this assumption demonstrating that visual priors in serial dependence are based on illusory stimulus properties rather than on physical ones. The authors also showed that those priors interact, however, with the physical rather than the illusory properties of a current stimulus. This complex interplay of prior expectations and stimulus appearance versus the early sensory information induced by it make stimulus features interesting that reveal an oppositional relationship between early versus later stimulus information and in foveal versus peripheral vision.
For example, high spatial frequency gratings are harder to make out in the periphery (e.g., Rovamo et al., 1992), reflecting a reduced availability of early, high spatial frequency information. On the other hand, spatial frequency has been shown to appear higher in the periphery compared to the fovea (Davis et al., 1987). Models on explaining the appearance difference across the visual field have been favouring a spatial-frequency channel-labelling mechanism (Davis et al., 1987; Davis, 1990). While these relationships would have to be confirmed by measuring pre- and postsaccadic appearance, a bias to perceive spatial frequency as higher in the periphery should lead to a transsaccadic expectation that predicts decreasing spatial frequency across saccades. It follows that changes that increase spatial frequency across saccades should be perceived more often. If this were true, it would also mean that transsaccadic expectations are built on appearance information rather than on low-level information. This hypothesis may be contradicted by Weiß et al. (2015), who did not report a bias in change detection for spatial frequency. However, since it was not the experimental goal of Weiß et al. (2015) to investigate a change-direction bias, the measurement applied in this study might not have been suited optimally for this purpose and further investigation may be needed here.
It may also well be, that the more complex a stimulus becomes i.e., the more feature dimensions the visual system can work with (e.g., colour + shape + luminance, or even feature combinations across modalities, see Stuckenberg et al., 2021), the more learned contingencies can be applied and compared to the incoming transsaccadic information. An accumulation of agreements with transsaccadic expectations for every feature may outweigh contradictions with transsaccadic expectations on spatial position such as large displacements or even blanks. This may become apparent in intrasaccadic displacement studies that found higher detection thresholds for naturalistic stimuli (McConkie & Currie, 1996); or a smaller blanking effect with complex stimuli (Tas et al., 2012; Stewart, Hübner, & Schütz, 2020).
Finally, the influence of transsaccadic expectations may be manifold and become apparent not solely in conscious categorisation but also in reaction time (Huber-Huber et al., 2019; Stewart, Hübner, & Schütz, 2020; Huber-Huber & Melcher, 2021) or, potentially, fixation duration (e.g. Henderson & Hollingworth, 2003), and pupil dilation (Preuschoff et al., 2011). Transsaccadic learning, that is the short-term learning of highly repetitive transsaccadic contingencies (e.g. Cox et al., 2005; Herwig & Schneider, 2014; Weiß et al., 2014; Valsecchi & Gegenfurtner, 2016), may also be affected by (long-term) transsaccadic expectations: on the one hand, larger prediction errors in one change direction might result in an increased updating of transsaccadic predictions and hence cause a larger learning effect (Rescorla & Wagner, 1972). One the other hand, larger prediction errors might be interpreted as evidence of object discrepancy as in causal-inference models (Körding et al., 2007; Atsma et al., 2016) and lead to a relatively weaker learning effect (Köller et al., 2020). Interestingly, in a transsaccadic-learning study that used the same shape stimuli as here, the participant group that experienced circularity increases across saccades showed an overall larger learning effect than the group that learned circularity decreases (Paeye et al., 2018, Experiment 2). However, it is unclear whether this difference between groups reflects a genuine difference in learning or whether it is due to differences in the baseline conditions between groups (judgements for unchanged objects). Furthermore, this difference was not always present (Paeye et al., 2018, Experiment 1). Further investigation would be needed to isolate an effect of long-term transsaccadic expectations on short-term learning of transsaccadic contingencies.
In summary, the character of transsaccadic expectations is likely to be specific for every visual feature dimension. Contradictions of and agreements with expectations in one feature dimension might affect change perception in general (for any other feature dimension) and may also be accumulated for or against external stability. In addition to change perception, transsaccadic expectations might affect several behavioural and perceptual measurements.
5. Conclusion
We found an overall shape-change direction bias for predominantly perceiving intrasaccadic shape changes that increased circularity across saccades. We further found that shape was perceived as more circular in presaccadic peripheral vision compared to postsaccadic foveal vision; but this appearance difference cannot directly explain the circularity-increase bias. We did, however, find a modulation of the overall bias on an inter-individual level presumably following from a direct but subsidiary influence of the appearance difference on the perceived magnitude of intrasaccadic shape changes. We conclude that the overall bias was due to an indirect influence of appearance differences across the visual field via a life-time learning of transsaccadic contingencies i. e., the built-up of transsaccadic expectations. This concept links transsaccadic perception of change or visual stability to a predictive-coding framework and implications following from this concept for other visual features in transsaccadic perception remain to be tested in the future.
Supplementary Material
Appendix A. Supplementary data
Supplementary data to this article can be found online at https://doi.org/10.1016/j.visres.2021.05.005.
Acknowledgements
We thank Sarah M. Fischer, Miriam Heinzl, and Xaver Funk for helping with data collection.
This project has received funding from the European Research Council under the European Union’s Horizon 2020 research and innovation programme (grant agreement no. 676786).
Data is available at doi: 10.5281/zenodo.4568199.
Footnotes
Note that this result would not be expected given the typical superiority of central compared to peripheral vison; but it was intended by our design as we halved the postsaccadic presentation duration in relation to the presaccadic presentation duration.
We use the term expectation to refer to implicit knowledge about the typical transsaccadic percept (the change from pre- to postsaccadic appearance resulting from a shift of feature information across the visual field). This knowledge should be acquired form life-time experience of such transsaccadic contingencies. The term prediction will be used to refer to the visual signal that is generated on demand by higher-level areas and that is based on presaccadic information and on transsaccadic expectations.
We use the term stability assumption not as a reference for a general tendency to assume stability but as one of two possible outcomes of the evaluation of transsaccadic information. The stability assumption may be a generalised phrase to refer to learned contingencies observed in our typically stable world, i.e., it represents the knowledge of re-occurring patterns of (visual) information resulting from eye- or body motion, and observations that are in accordance with this experience do not reach consciousness (the world remains stable).
CRediT authorship contribution statement
Carolin Hübner: Conceptualization, Methodology, Software, Investigation, Formal Analysis, Data curation, Writing - original draft, Visualization. Alexander C. Schütz: Conceptualization, Methodology, Supervision, Resources, Writing - review & editing, Funding acquisition.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
References
- Atsma J, Maij F, Koppen M, Irwin DE, Medendorp WP, Beierholm U. Causal Inference for Spatial Constancy across Saccades. PLoS Computational Biology. 2016;12(3):e1004766. doi: 10.1371/journal.pcbi.1004766. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Azzopardi P, Cowey A. Preferential representation of the fovea in the primary visual cortex. Nature. 1993;361(6414):719–721. doi: 10.1038/361719a0. [DOI] [PubMed] [Google Scholar]
- Baldwin J, Burleigh A, Pepperell R, Ruta N. The Perceived Size and Shape of Objects in Peripheral Vision. I-Perception. 2016;7(4):2041669516661900. doi: 10.1177/2041669516661900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bastos AM, Usrey WM, Adams RA, Mangun GR, Fries P, Friston K. Neuron. 4. Vol. 76. Cell Press; 2012. Canonical Microcircuits for Predictive Coding; pp. 695–711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bertamini M, Cretenoud AF, Herzog MH. Exploring the Extent in the Visual Field of the Honeycomb and Extinction Illusions. I-Perception. 2019;10(4):2041669519854784. doi: 10.1177/2041669519854784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bertamini M, Herzog MH, Bruno N. The honeycomb illusion: Uniform textures not perceived as such. I-Perception. 2016;7(4):1–15. doi: 10.1177/2041669516660727. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Born S. Saccadic suppression of displacement does not reflect a saccade-specific bias to assume stability. Vision (Switzerland) 2019;3(4):49. doi: 10.3390/vision3040049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brainard DH. The Psychophysics Toolbox. Spatial Vision. 1997;10(4):433–436. doi: 10.1163/156856897X00357. [DOI] [PubMed] [Google Scholar]
- Bridgeman B, Hendry D, Stark L. Failure to detect displacement of the visual world during saccadic eye movements. Vision Research. 1975;15(6):719–722. doi: 10.1016/0042-6989(75)90290-4. [DOI] [PubMed] [Google Scholar]
- Cicchini GM, Benedetto A, Burr DC. Perceptual history propagates down to early levels of sensory analysis. Current Biology. 2021;31(6):1245–1250.:e2. doi: 10.1016/j.cub.2020.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coates DR, Wagemans J, Sayim B. Diagnosing the Periphery: Using the Rey-Osterrieth Complex Figure Drawing Test to Characterize Peripheral Visual Function. I-Perception. 2017;8(3):2041669517705447. doi: 10.1177/2041669517705447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cornelissen FW, Peters EM, Palmer J. The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox. Behavior Research Methods, Instruments, and Computers. 2002;34(4):613–617. doi: 10.3758/BF03195489. [DOI] [PubMed] [Google Scholar]
- Cox DD, Meier P, Oertelt N, DiCarlo JJ. “Breaking” position-invariant object recognition. Nature Neuroscience. 2005;8(9):1145–1147. doi: 10.1038/nn1519. [DOI] [PubMed] [Google Scholar]
- Curcio CA, Sloan KR, Kalina RE, Hendrickson AE. Human photoreceptor topography. Journal of Comparative Neurology. 1990;292(4):497–523. doi: 10.1002/(ISSN)1096-986110.1002/cne.v292:410.1002/cne.902920402. [DOI] [PubMed] [Google Scholar]
- Davis ET. Modeling shifts in perceived spatial frequency between the fovea and the periphery. Journal of the Optical Society of America A. 1990;7(2):286. doi: 10.1364/josaa.7.000286. [DOI] [PubMed] [Google Scholar]
- Davis ET, Yager D, Jones BJ. Comparison of perceived spatial frequency between the fovea and the periphery. Journal of the Optical Society of America A, Optics and Image Science. 1987;4(8):1606–1611. doi: 10.1364/JOSAA.4.001606. [DOI] [PubMed] [Google Scholar]
- De Graef P, Verfaillie K. Transsaccadic memory for visual object detail. Progress in Brain Research. 2002;140:181–196. doi: 10.1016/S0079-6123(02)40050-7. [DOI] [PubMed] [Google Scholar]
- de Lange FP, Heilbron M, Kok P. How Do Expectations Shape Perception? Trends in Cognitive Sciences. 2018;22(9):764–779. doi: 10.1016/Jtics.2018.06.002. [DOI] [PubMed] [Google Scholar]
- Demeyer M, De Graef P, Wagemans J, Verfaillie K. Object form discontinuity facilitates displacement discrimination across saccades. Journal of Vision. 2010;10(6) doi: 10.1167/10.6.17. [DOI] [PubMed] [Google Scholar]
- Derrington AM, Krauskopf J, Lennie P. Chromatic mechanisms in lateral geniculate nucleus of Macaque. The Journal of Physiology. 1984;357:241–265. doi: 10.1113/jphysiol.1984.sp015499. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Deubel H, Bridgeman B, Schneider WX. Different effects of eyelid blinks and target blanking on saccadic suppression of displacement. Perception and Psychophysics. 2004;66(5):772–778. doi: 10.3758/BF03194971. [DOI] [PubMed] [Google Scholar]
- Deubel H, Schneider WX, Bridgeman B. Postsaccadic target blanking prevents saccadic suppression of image displacement. Vision Research. 1996;36(7):985–996. doi: 10.1016/0042-6989(95)00203-0. [DOI] [PubMed] [Google Scholar]
- Deubel H, Schneider WX, Bridgeman B. Transsaccadic memory of position and form. Progress in Brain Research. 2002;140:165–180. doi: 10.1016/S0079-6123(02)40049-0. [DOI] [PubMed] [Google Scholar]
- Dow BM, Snyder AZ, Vautin RG, Bauer R. Magnification factor and receptive field size in foveal striate cortex of the monkey. Experimental Brain Research. 1981;44(2):213–228. doi: 10.1007/BF00237343. [DOI] [PubMed] [Google Scholar]
- Dumoulin SO, Wandell BA. Population receptive field estimates in human visual cortex. Neuroimage. 2008;39(2):647–660. doi: 10.1016/Jneuroimage.2007.09.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Edwards G, Vetter P, McGruer F, Petro LS, Muckli L. Predictive feedback to V1 dynamically updates with sensory input. Scientific Reports. 2017;7(1):1–12. doi: 10.1038/s41598-017-16093-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ehinger BV, König P, Ossandon JP. Predictions of visual content across eye movements and their modulation by inferred information. Journal of Neuroscience. 2015;35(19):7403–7413. doi: 10.1523/JNEUROSCI.5114-14.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- El-Shamayleh Y, Pasupathy A. Contour curvature as an invariant code for objects in visual area V4. Journal of Neuroscience. 2016;36(20):5532–5543. doi: 10.1523/JNEUROSCI.4139-15.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Feldman H, Friston KJ. Attention, uncertainty, and free-energy. Frontiers in Human Neuroscience. 2010;4 doi: 10.3389/fnhum.2010.00215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friston K. The free-energy principle: A rough guide to the brain? Trends in Cognitive Sciences. 2009;13(7):293–301. doi: 10.1016/j.tics.2009.04.005. [DOI] [PubMed] [Google Scholar]
- Grzeczkowski L, Deubel H, Szinte M. Stimulus blanking reveals contrastdependent transsaccadic feature transfer. Scientific Reports. 2020:1–9. doi: 10.1101/819110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grzeczkowski L, van Leeuwen J, Belopolsky AV, Deubel H. Spatiotopic and saccade-specific transsaccadic memory for object detail. Journal of Vision. 2020;20(7):1–12. doi: 10.1167/JOV.20.7.2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harrison WJ, Mattingley JB, Remington RW. Eye Movement Targets Are Released from Visual Crowding. Journal of Neuroscience. 2013;33(7):2927–2933. doi: 10.1523/JNEUROSCI.4172-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henderson JM. Transsaccadic memory and integration during real-world object perception. Psychological Science. 1997;8(1):51–55. doi: 10.1111/j.1467-9280.1997.tb00543.x. [DOI] [Google Scholar]
- Henderson JM, Brockmole JR, Gajewski DA. Differential detection of global luminance and contrast changes across saccades and flickers during active scene perception. Vision Research. 2008;48(1):16–29. doi: 10.1016/j.visres.2007.10.008. [DOI] [PubMed] [Google Scholar]
- Henderson JM, Hollingworth A. The role of fixation position in detecting scene changes across saccades. Psychological Science. 1999;10(5):438–443. doi: 10.1111/1467-9280.00183. [DOI] [Google Scholar]
- Henderson JM, Hollingworth A. Eye movements and visual memory: Detecting changes to saccade targets in scenes. Perception and Psychophysics. 2003;65(1):58–71. doi: 10.3758/BF03194783. [DOI] [PubMed] [Google Scholar]
- Herwig A, Schneider WX. Predicting object features across saccades: Evidence from object recognition and visual search. Journal of Experimental Psychology General. 2014;143(5):1903–1922. doi: 10.1037/a0036781. [DOI] [PubMed] [Google Scholar]
- Herwig A, Weiß K, Schneider WX. When circles become triangular: How transsaccadic predictions shape the perception of shape. Annals of the New York Academy of Sciences. 2015;1339(1):97–105. doi: 10.1111/nyas.12672. [DOI] [PubMed] [Google Scholar]
- Hess RF, Hayes A. The coding of spatial position by the human visual system: Effects of spatial scale and retinal eccentricity. Vision Research. 1994;34(5):625–643. doi: 10.1016/0042-6989(94)90018-3. [DOI] [PubMed] [Google Scholar]
- Huber-Huber C, Buonocore A, Dimigen O, Hickey C, Melcher D. The peripheral preview effect with faces: Combined EEG and eye-tracking suggests multiple stages of transsaccadic predictive and non-predictive processing. Neuroimage. 2019 May;200:344–362. doi: 10.1016/Jneuroimage.2019.06.059. [DOI] [PubMed] [Google Scholar]
- Huber-Huber C, Melcher D. The behavioural preview effect with faces is susceptible to statistical regularities: Evidence for predictive processing across the saccade. Scientific Reports. 2021;11:1–10. doi: 10.1038/s41598-020-79957-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hübner C, Schütz AC. Numerosity estimation benefits from transsaccadic information integration. Journal of Vision. 2017;17(13):1–16. doi: 10.1167/17.13.12.doi. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hupe JM, James AC, Payne BR, Lomber SG, Girard P, Bullier J. Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature. 1998;394(6695):784–787. doi: 10.1038/29537. [DOI] [PubMed] [Google Scholar]
- Kayaert G, Biederman I, Vogels R. Shape tuning in macaque inferior temporal cortex. Journal of Neuroscience. 2003;23(7):3016–3027. doi: 10.1523/jneuroSci23-07-03016.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koenderink JJ. Brain Mechanisms and Spatial Vision. Springer Netherlands; Dordrecht: 1985. pp. 31–58. [DOI] [Google Scholar]
- Koenderink J, Valsecchi M, Doorn A, van Wagemans J, Gegenfurtner K. Eidolons: Novel stimuli for vision research. Journal of Vision. 2017;17(2):7–7. doi: 10.1167/17.2.7. [DOI] [PubMed] [Google Scholar]
- Kok P, de Lange FP. Shape perception simultaneously up- and downregulates neural activity in the primary visual cortex. Current Biology. 2014;24(13):1531–1535. doi: 10.1016/Jcub.2014.05.042. [DOI] [PubMed] [Google Scholar]
- Koöller CP, Poth CH, Herwig A. Object discrepancy modulates feature prediction across eye movements. Psychological Research. 2020;84(1):231–244. doi: 10.1007/s00426-018-0988-5. [DOI] [PubMed] [Google Scholar]
- Kording KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L, Sporns O. Causal inference in multisensory perception. PLoS ONE. 2007;2(9):e943. doi: 10.1371/journal.pone.000094310.1371/journal. pone.0000943.g00110.1371/journal.pone.0000943.g00210.1371/journal. pone.0000943.g00310.1371/journal.pone.0000943.t00110.1371/journal. pone.0000943.s00110.1371/journal.pone.0000943.s00210.1371/journal. pone.0000943.s003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levi DM, Klein SA. Sampling in spatial vision. Nature. 1986;320(6060):360–362. doi: 10.1038/320360a0. [DOI] [PubMed] [Google Scholar]
- Li HH, Barbot A, Carrasco M. Saccade Preparation Reshapes Sensory Tuning. Current Biology. 2016;26(12):1564–1570. doi: 10.1016/Jcub.2016.04.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li HH, Pan J, Carrasco M. Presaccadic attention improves or impairs performance by enhancing sensitivity to higher spatial frequencies. Scientific Reports. 2019;9(1) doi: 10.1038/s41598-018-38262-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- MacKay DM. Voluntary eye movements as questions. Bibliotheca Ophtalmologica. 1972;82:369–376. [PubMed] [Google Scholar]
- McConkie GW, Currie CB. Visual Stability Across Saccades while Viewing Complex Pictures. Journal of Experimental Psychology: Human Perception and Performance. 1996;22(3):563–581. doi: 10.1037/0096-1523.22.3.563. [DOI] [PubMed] [Google Scholar]
- Morgan MJ, Watamaniuk SNJ, McKee SP. The use of an implicit standard for measuring discrimination thresholds. Vision Research. 2000;40(17):109–117. doi: 10.1016/S0042-6989(00)00093-6. [DOI] [PubMed] [Google Scholar]
- Murray SO, Kersten D, Olshausen BA, Schrater P, Woods DL. Shape perception reduces activity in human primary visual cortex. Proceedings of the National Academy of Sciences of the United States of America. 2002;99(23):15164–15169. doi: 10.1073/pnas.192579399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Newsome LR. Visual angle and apparent size of objects in peripheral vision. Perception & Psychophysics. 1972;12(3):300–304. doi: 10.3758/BF03207209. [DOI] [Google Scholar]
- Niemeier M, Crawford JD, Tweed DB. Optimal transsaccadic integration explains distorted spatial perception. Nature. 2003;422(6927):76–80. doi: 10.1038/nature01439. [DOI] [PubMed] [Google Scholar]
- Niemeier M, Crawford JD, Tweed DB. Optimal inference explains dimension-specific contractions of spatial perception. Experimental Brain Research. 2007;179(2):313–323. doi: 10.1007/s00221-006-0788-9. [DOI] [PubMed] [Google Scholar]
- O’Regan JK, Noe A. A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences. 2001;24(5):939–973. doi: 10.1017/S0140525X01000115. [DOI] [PubMed] [Google Scholar]
- Oesterberg G. In: Topography of the Layer of Rods and Cones in the Human Retina. Busek A, editor. NYT Nordisk Forlag; 1935. [Google Scholar]
- Paeye C, Collins T, Cavanagh P, Herwig A. Calibration of peripheral perception of shape with and without saccadic eye movements. Attention, Perception, and Psychophysics. 2018;80(3):723–737. doi: 10.3758/s13414-017-1478-3. [DOI] [PubMed] [Google Scholar]
- Pelli DG. The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision. 1997;10(4):437–442. doi: 10.1163/156856897X00366. [DOI] [PubMed] [Google Scholar]
- Preuschoff K, ‘t Hart BM, Einhäuse W. Pupil dilation signals surprise: Evidence for noradrenaline’s role in decision making. Frontiers in Neuroscience. 2011 Sep;5:1–12. doi: 10.3389/fnins.2011.00115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rao RPN, Ballard DH. Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience. 1999;2(1):79–87. doi: 10.1038/4580. [DOI] [PubMed] [Google Scholar]
- Hübner C, Schütz AC, Rentschler I, Treutwein B. Loss of spatial phase relationships in extrafoveal vision. Nature. 1985;313(6000):308–310. doi: 10.1038/313308a0. [DOI] [PubMed] [Google Scholar]
- Rescorla RA, Wagner AR. A Theory of Pavlovian Conditioning: Variations in the Effectiveness of Reinforcement and Nonreinforcement. In: Black AH, Prokasy WF, editors. Clasical conditioning II: Current research and theory. Appleton Century Crofts; 1972. pp. 64–99. [Google Scholar]
- Reuleaux F. Theoretische Kinematik: Grundzüge einer Theorie des Maschinenwesens. Friedrich Vieweg und Sohn; 1875. [Google Scholar]
- Rosenholtz R. Capabilities and Limitations of Peripheral Vision. Annual review of vision science. 2016;2(1):437–457. doi: 10.1146/annurev-vision-082114-035733. Annual Reviews. [DOI] [PubMed] [Google Scholar]
- Rovamo J, Franssila R, Näsänen R. Contrast sensitivity as a function of spatial frequency, viewing distance and eccentricity with and without spatial noise. Vision Research. 1992;32(4):631–637. doi: 10.1016/0042-6989(92)90179-M. [DOI] [PubMed] [Google Scholar]
- Schütt HH, Harmeling S, Macke JH, Wichmann FA. Painfree and accurate Bayesian estimation of psychometric functions for (potentially) overdispersed data. Vision Research. 2016;122:105–123. doi: 10.1016/j.visres.2016.02.002. [DOI] [PubMed] [Google Scholar]
- Souto D, Gegenfurtner KR, Schütz AC. Saccade adaptation and visual uncertainty. Frontiers in Human Neuroscience. 2016 May;10:227. doi: 10.3389/fnhum.2016.00227. 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stewart EEM, Hübner C, Schütz AC. Stronger saccadic suppression of displacement and blanking effect in children. Journal of Vision. 2020;20(10):13. doi: 10.1167/jov.20.10.13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stewart EEM, Valsecchi M, Schütz AC. A review of interactions between peripheral and foveal vision. Journal of Vision. 2020;20(12):1–25. doi: 10.1167/jov.20.12.2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Strasburger H, Rentschler I, Jüttner M. Peripheral vision and pattern recognition: A review. Journal of Vision. 2011;11(5) doi: 10.1167/11.5.13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stuckenberg Maria V, Schröger Erich, Widmann Andreas. Modulation of early auditory processing by visual information: Prediction or bimodal integration? Attention, Perception, & Psychophysics. 2021;83(4):1538–1551. doi: 10.3758/s13414-021-02240-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tas AC, Moore CM, Hollingworth A. An object-mediated updating account of insensitivity to transsaccadic change. Journal of Vision. 2012;12(11):18–18. doi: 10.1167/12.11.18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thaler L, Schütz AC, Goodale MA, Gegenfurtner KR. What is the best fixation target? The effect of target shape on stability of fixational eye movements. Vision Research. 2013;76:31–42. doi: 10.1016/j.visres.2012.10.012. [DOI] [PubMed] [Google Scholar]
- Valsecchi M, Gegenfurtner KR. Dynamic Re-calibration of Perceived Size in Fovea and Periphery through Predictable Size Changes. Current Biology. 2016;26(1):59–63. doi: 10.1016/j.cub.2015.10.067. [DOI] [PubMed] [Google Scholar]
- Valsecchi M, Koenderink J, van Doorn A, Gegenfurtner KR. Prediction shapes peripheral appearance. Journal of Vision. 2018;18(13):1–14. doi: 10.1167/18.13.21. [DOI] [PubMed] [Google Scholar]
- Valsecchi M, Toscani M, Gegenfurtner KR. Perceived numerosity is reduced in peripheral vision. Journal of Vision. 2013;13(13):7–7. doi: 10.1167/13.13.7. [DOI] [PubMed] [Google Scholar]
- van Opstal AJ, van Gisbergen JAM. Scatter in the metrics of saccades and properties of the collicular motor map. Vision Research. 1989;29(9):1183–1196. doi: 10.1016/0042-6989(89)90064-3. [DOI] [PubMed] [Google Scholar]
- Weiß K, Schneider WX, Herwig A. Associating peripheral and foveal visual input across saccades : A default mode of the human visual system? Journal of Vision. 2014;14(11):1–15. doi: 10.1167/14.11.7.doi. 7. [DOI] [PubMed] [Google Scholar]
- Weiß K, Schneider WX, Herwig A. A “blanking effect” for surface features: Transsaccadic spatial-frequency discrimination is improved by postsaccadic blanking. Attention, Perception, and Psychophysics. 2015;77(5):1500–1506. doi: 10.3758/s13414-015-0926-1. [DOI] [PubMed] [Google Scholar]
- Wexler M, Collins T. Orthogonal steps relieve saccadic suppression. Journal of Vision. 2014;14(2):1–9. doi: 10.1167/14.2.13. [DOI] [PubMed] [Google Scholar]
- Ziesche A, Bergelt J, Deubel H, Hamker FH. Pre- and postsaccadic stimulus timing in saccadic suppression of displacement - A computational model. Vision Research. 2017;138:1–11. doi: 10.1016/j.visres.2017.06.007. [DOI] [PubMed] [Google Scholar]
- Zimmermann E, Morrone MC, Burr DC. Spatial position information accumulates steadily over time. Journal of Neuroscience. 2013;33(47):18396–18401. doi: 10.1523/JNEUROSCI.1864-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.