Abstract
When the two eyes view large dissimilar patterns that induce binocular rivalry, alternating waves of visibility are experienced, as one pattern sweeps the other out of conscious awareness. Here we show tight linkage between dynamics of perceptual waves during rivalry and neural events in human primary visual cortex (V1).
The cortex is an excitable medium through which waves of neural activity can propagate1,2. A rare opportunity to observe the perceptual concomitants of wave propagation is conferred by binocular rivalry, the perceptual alternations induced when incompatible patterns are presented to the two eyes3. During an alternation, one sees a travelling wave in which the dominance of one pattern emerges locally and expands progressively as it renders the other pattern invisible4. Several converging lines of evidence suggest that primary visual cortex (V1) may be involved in the spatiotemporal dynamics of these perceptual travelling waves, but that involvement remained to be demonstrated. Toward that end, we used functional magnetic resonance imaging (fMRI) to measure and characterize travelling waves of cortical activity during rivalry.
Human observers viewed a dichoptic display designed to induce perceptual waves (Fig. 1a). The rival images were a low-contrast radial grating viewed by one eye and a high-contrast spiral grating viewed by the other eye, each restricted to an annular region of the visual field centered on the point of fixation. Exploiting rivalry’s susceptibility to transient stimulation5, we triggered shifts in perceptual dominance by a brief and abrupt increase in the contrast in a small region of the low-contrast grating at the top of the annulus (see Supplementary Methods and Supplementary Fig. 1 online). This contrast pulse typically evoked a perceptual travelling wave such that observers perceived the local dominance of the low-contrast image to spread around the annular region, starting at the top of the annulus and progressively erasing the high-contrast image from visual awareness4 (Supplementary Video 1 online). Observers pressed a key when a perceptual wave reached a target area (marked by nonius lines) at the bottom of the annulus. Upon this key press, the two monocular gratings disappeared until the beginning of the next trial.
Figure 1.

Travelling waves of cortical activity in human V1. (a) Stimuli, rival gratings viewed dichoptically. Percept, snap shot of travelling wave in which the low contrast pattern was seen to spread around the annulus, starting at the top. (b) Gray scale, anatomical image passing through the posterior occipital lobe, roughly perpendicular to the Calcarine sulcus. Red outline, subregion of V1 corresponding retinotopically to the upper-right quadrant of the stimulus annulus. Green outline, subregion of V1 corresponding to the lower-right quadrant. Inset, time series of the predicted neural activity according to a simplified model (see Supplementary Methods online). Red and green curves, time series of the measured fMRI responses corresponding to the two outlined subregions, averaged across ~1000 trials for one observer. Red and green arrows, locations in time where these curves peak. (c) Temporal delay in the fMRI responses as a function of cortical distance from the V1 representation of the top of the annulus, categorized by behavioral latency, and averaged across observers. Steeper slope corresponds to slower speed. Larger y-intercept corresponds to longer initial delay. Error bars, SEM. (d) Estimated propagation speed of the underlying neural activity, averaged across behavioral latencies. Dashed line, best-fit to the mean across observers.
If activity in visual cortex reflects the spatiotemporal dynamics of rivalry, then there should be a wave of cortical activity coincident with the perceptual wave (Fig. 1b). Specifically, the peak of the fMRI responses at locations along the path of the cortical wave should be increasingly delayed with increasing distance from the cortical representation of the top of the annulus, because: 1) locations further from the point of origin of the travelling wave will respond to the high contrast for longer durations, and 2) fMRI responses in V1 increase monotonically with stimulus contrast6. It is important to keep in mind, however, that the physical contrasts of both rival gratings remained unchanged – only the perceptual transitions associated with rivalry provided the potential conditions for travelling waves of cortical activity.
Primary visual cortex (V1) did indeed exhibit travelling waves of activity while observers experienced perceptual travelling waves (Fig. 1c and Supplementary Video 2 online). Gray matter corresponding to the V1 representation of the stimulus annulus was identified using conventional retinotopic mapping procedures7. For each voxel within this subregion of V1 gray matter, we calculated the temporal delay of the fMRI responses, averaged across trials (see Supplementary Methods online). The resulting temporal delays increased with distance from the V1 representation of the top of the stimulus annulus. The correlation between temporal delay and cortical distance was statistically significant in each individual observer (P < 0.05, Pearson χ2 test). This occurred despite there being no wave-like changes in the stimulus itself.
The dynamics of these cortical waves of V1 activity correlated with the latency of the perceptual waves (Fig. 1c). We segregated the trials into three categories based on the latency of the observers’ key press responses and averaged the fMRI data across trials, separately for each range of behavioral latencies. Both the speed (slope of the best-fit line) and the initial delay (y-intercept) of the cortical waves increased with behavioral latency (P < 0.0001 ; bootstrap statistical test, see Supplementary Methods online for details).
To more directly compare the fMRI data with the perceptual phenomena during rivalry, we estimated the speed of propagation of the underlying cortical activity from the measured fMRI responses (Fig. 1d). This was done using a model of the underlying neural activity along with a model for how the fMRI signal depended on the underlying neural activity (see Supplementary Methods online for details). In addition to the unknown neural response latencies, the model had five free parameters: one parameter corresponded to the ratio of the amplitudes of the tonic neural activity for each of the two stimulus contrasts, one parameter characterized the amplitude of transient neural responses evoked by abrupt stimulus onset at the beginning of each trial, and three free parameters were used to characterize the hemodynamic impulse response. Values for these five parameters were determined, separately for each observer, by fitting the model to the fMRI responses evoked by physical travelling waves. In a separate “replay” experiment, sequences of monocular images were shown to observers, mimicking perceptual waves under nonrivalry conditions. Note that we had complete information about the timing of neural events during this replay experiment; only the neural response amplitudes and the hemodynamic parameters were determined by fitting the fMRI responses to the physical travelling waves. Then, with those five parameters fixed, we fitted the model to the fMRI responses measured during rivalry, . resulting in estimates for the latencies of the underlying neural activity, separately for each voxel of V1 gray matter. A linear fit of the neural latencies revealed wave propagation speeds across the three observers of 1.6 – 2 cm/s; these propagation speeds compare favorably to the speed value of 2.2 cm/s estimated from psychophysical measurements using essentially the same stimulus4.
In summary, the time course of cortical activity varied systematically across the retinotopic map in V1, in correspondence with the subjective perception of travelling waves during binocular rivalry. These results go well beyond those from previous single-unit electrophysiology8–10 and neuroimaging studies11–15 by demonstrating that V1 activity reflects the spatiotemporal dynamics of perception during rivalry. Furthermore, the data in Figure 1c demonstrate the capability of fMRI to resolve timing differences of ~115 ms over a distance of ~3.5 mm. It remains to be seen if these cortical waves originate in V1 via long-range intracortical connections, or if they are evoked by feedback from higher-order visual cortical areas.
Supplementary Material
Acknowledgments
We thank N. Logothetis, C. Koch and the late F. Crick for comments on an earlier version of the manuscript. Supported by grants from the National Institutes of Health to D.J.H. (EY12741) and to R.B. (EY14437), and a grant from the Korea Institute of Science & Technology Evaluation and Planning to S.H.L. (M103KV010021-04K2201-02140). Data were acquired while D.J.H. and S.H.L. were at Stanford University. Part of this work was completed while R.B. was a visiting scholar at New York University.
Footnotes
Competing interests statement. The authors declare that they have no competing financial interests.
References
- 1.Hughes JR. The phenomenon of travelling waves: a review. Clin Electroencephalogr. 1995;26:1–6. doi: 10.1177/155005949502600103. [DOI] [PubMed] [Google Scholar]
- 2.Ermentrout GB, Kleinfeld D. Traveling Electrical Waves in Cortex: Insights from Phase Dynamics and Speculation on a Computational Role. Neuron. 2001;29:33–44. doi: 10.1016/s0896-6273(01)00178-7. [DOI] [PubMed] [Google Scholar]
- 3.Wheatstone C. On some remarkable, and hitherto unobserved, phenomena of binocular vision. . Phil.Trans.R.Soc.Lond. 1838;128:371–394. [PubMed] [Google Scholar]
- 4.Wilson HR, Blake R, Lee S. H Dynamics of travelling waves in visual perception. Nature. 2001;412:907–910. doi: 10.1038/35091066. [DOI] [PubMed] [Google Scholar]
- 5.Wolfe JM. Reversing ocular dominance and suppression in a single flash. Vision Res. 1984;24:471–478. doi: 10.1016/0042-6989(84)90044-0. [DOI] [PubMed] [Google Scholar]
- 6.Heeger DJ, Huk AC, Geisler WS, Albrecht D. G Spikes versus BOLD: what does neuroimaging tell us about neural activity? Nat Neurosci. 2000;3:631–633. doi: 10.1038/76572. [DOI] [PubMed] [Google Scholar]
- 7.Engel SA, Rumelhart DE, Wandell BA, Lee AT, Glover GH, Chichilnisky EJ, Shadlen MN. fMRI of human visual cortex. Nature. 1994;369:525. doi: 10.1038/369525a0. [DOI] [PubMed] [Google Scholar]
- 8.Logothetis NK, Schall J. D Neural correlates of subjective visual perception. Science. 1989;245:761–763. doi: 10.1126/science.2772635. [DOI] [PubMed] [Google Scholar]
- 9.Leopold DA, Logothetis N. K Activity changes in early visual cortex reflect monkeys’ percepts during binocular rivalry. Nature. 1996;379:549–553. doi: 10.1038/379549a0. [DOI] [PubMed] [Google Scholar]
- 10.Sheinberg DL, Logothetis N. K The role of temporal cortical areas in perceptual organization. Proc Natl Acad Sci. 1997;94:3408–3413. doi: 10.1073/pnas.94.7.3408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lumer ED, Friston KJ, Rees G. Neural Correlates of Perceptual Rivalry in the Human Brain. Science. 1998;280:1283–1293. doi: 10.1126/science.280.5371.1930. [DOI] [PubMed] [Google Scholar]
- 12.Tong F, Nakayama K, Vaughan JT, Kanwisher N. Binocular rivalry and visual awareness in human extrastriate cortex. Neuron. 1998;21:753–9. doi: 10.1016/s0896-6273(00)80592-9. [DOI] [PubMed] [Google Scholar]
- 13.Tong F, Engel S. Interocular rivalry revealed in the cortical blind-spot representation. Nature. 2001;411:195–199. doi: 10.1038/35075583. [DOI] [PubMed] [Google Scholar]
- 14.Polonsky A, Blake R, Braun J, Heeger D. Neural activity in human primary visual cortex correlates with perception during binocular rivalry. Nature Neurosci. 2000;3:1153–1159. doi: 10.1038/80676. [DOI] [PubMed] [Google Scholar]
- 15.Lee SH, Blake R. V1 activity is reduced during binocular rivalry. J Vis. 2002;2:618–626. doi: 10.1167/2.9.4. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
