Abstract
The robust steady‐state cortical activation elicited by flickering visual stimulation has been exploited by a wide range of scientific studies. As the fundamental neural response inherits the spectral properties of the gazed flickering, the paradigm has been used to chart cortical characteristics and their relation to pathologies. However, despite its widespread adoption, the underlying neural mechanisms are not well understood. Here, we show that the fundamental response is preceded by high‐gamma (55–125 Hz) oscillations which are also synchronised to the gazed frequency. Using a subdural recording of the primary and associative visual cortices of one human subject, we demonstrate that the latencies of the high‐gamma and fundamental components are highly correlated on a single‐trial basis albeit that the latter is consistently delayed by approximately 55 ms. These results corroborate previous reports that top‐down feedback projections are involved in the generation of the fundamental response, but, in addition, we show that trial‐to‐trial variability in fundamental latency is paralleled by a highly similar variability in high‐gamma latency. Pathology‐ or paradigm‐induced alterations in steady‐state responses could thus originate either from deviating visual gamma responses or from aberrations in the neural feedback mechanism. Experiments designed to tease apart the two processes are expected to provide deeper insights into the studied paradigm.
Keywords: cross‐frequency coupling (CFC), electrocorticography (ECoG), frequency tagging, phase locking, phase‐amplitude coupling (PAC), photic driving, SSVEP
The robust steady‐state cortical activation elicited by flickering visual stimulation has been exploited by a wide range of neuroscientific and clinical studies, but the neural mechanisms behind its generation are not well understood. In this manuscript, we show that the fundamental response is preceded by high‐gamma (55–125 Hz) oscillations which are also synchronised to the gazed frequency. Using a subdural recording of the primary and associative visual cortices of one human subject, we demonstrate that both latencies of the gamma and fundamental components are highly correlated on a single‐trial basis albeit that the latter is consistently delayed by approximately 55 ms.
1. INTRODUCTION
From the earliest studies on the visual system (Adrian & Matthews, 1934; Walter, Dovey, & Shipton, 1946), flickering stimulation has routinely been adopted to elicit robust neural activations using either on–off or luminosity modulations with a checkerboard (Krolak‐Salmon et al., 2003), gratings (Kim, Grabowecky, Paller, Muthu, & Suzuki, 2007), or plain rectangles (Lee, Pokorny, Smith, & Kremers, 1994). The evoked neural response, which inherits the spectral properties of the stimulation, is often referred to as the “steady‐state visual evoked potential” (SSVEP) or, in clinical studies, as “photic driving” (Regan, 1966; van der Tweel & Lunel, 1965). Its high signal‐to‐noise ratio and low sensitivity to ocular artefacts render it a robust response that is relatively easy to detect in electrophysiological settings (Vialatte, Maurice, Dauwels, & Cichocki, 2010). Flickering stimulation is also routinely used in combination with hemodynamic recording modalities (e.g., functional magnetic resonance imaging [fMRI]) where the neural response is reflected in increased BOLD responses which have formed the basis for the development of a non‐invasive retinotopic mapping procedure of visual cortical areas (Engel, Glover, & Wandell, 1997) and even lateral geniculate nucleus (LGN) (Chen, Zhu, Thulborn, & Ugurbil, 1999). It is worth noting that the steady‐state response elicited by flickering stimuli not only contributed to advances in basic research, but also many clinical studies have used the properties (e.g., amplitude, latency) of the automatic cortical response as a marker for the assessment of neurological or psychiatric conditions (Vialatte et al., 2010), and as the basis for the most efficient brain‐computer interfaces (Chen et al., 2015; Wittevrongel, Khachatryan, Fahimi Hnazaee, Camarrone, et al., 2018) aimed to support communication‐impaired patients (Combaz et al., 2013; Hwang et al., 2017; Lesenfants et al., 2014).
However, despite its widespread adoption, relatively little is known about the cortical mechanisms involved in the processing of the repetitive visual input and the origin of the fundamental steady‐state response. While there is general consensus that this response mainly originates in the primary visual cortex, the neural mechanisms behind its genesis are still unknown: it is not clear whether it is a pure sensory response or whether larger cortico‐cortical and/or cortico‐thalamic networks contribute to it (Vialatte et al., 2010). Studying the visual system in humans is not trivial, as early visual neural responses are often highly localised and involve intricate interactions with subcortical structures (e.g., LGN) and higher‐order areas (e.g., MT+). Traditional neuroimaging techniques have been used to explain the phenomenon, but they proved to be suboptimal. Non‐invasive electrical recording modalities have limited spatial resolution (e.g., EEG) or are not widely available (e.g., MEG, OPM (Boto et al., 2017)); and indirect or hemodynamic measures (e.g., fMRI, fNIRS, PET) lack the temporal resolution to study the fast‐changing dynamics and probe causal relationships. Invasive electrophysiological recording modalities, such as electrocorticography (ECoG) or stereotactic EEG, most commonly implanted during the treatment of intractable epilepsy, provide a unique means to study the human brain, even though the coverage of the primary visual cortex is rarely considered as occipital epilepsies are relatively uncommon (Taylor, Scheffer, & Berkovic, 2003) and not targeted for ressective surgery (eloquent cortex) (Heo, Kim, Chung, & Lee, 2017).
In an early study (Kamp, Sem‐Jacobsen, Leeuwen, & T‐Weel, 1960), sinusoidally modulated light was presented to a human subject with an implant of multiple depth electrodes. Even though a series of contacts extended into the occipital cortex, the electrophysiological activations in this area were not reported and mainly qualitative results were discussed. A more recent study (Krolak‐Salmon et al., 2003) reported the presence of steady‐state responses following the screen's refresh rate (60–70 Hz) in LGN and the optic radiation of one patient and at highly localised areas along the calcarine fissure in two other patients. As this study was not aimed at flicker stimulation, these results were rather unexpected and potential neural mechanisms involved in the fundamental response were not discussed. Similarly, other invasive studies using flickering stimuli in humans did not discuss potential mechanisms, but rather exploited the steady‐state response as a tool for probing other neural functions (Jonas et al., 2016; Winawer et al., 2013).
Given the growing amount of scholarly literature reporting on results obtained from flickering visual stimuli, it would be highly beneficial, both for clinical studies and basic visual research, to gain a deeper understanding of the neural mechanisms involved in the genesis of the fundamental response.
In this study, we report on a case of one epilepsy patient who was implanted with a large subdural grid covering the entire occipital cortex of the right hemisphere, including the inter‐hemispheric fissure. The patient participated in an experiment during which the luminosity of rectangles presented in the foveal and peripheral visual field was sinusoidally modulated at a temporal frequency between 11 and 15 Hz. In addition to the expected phase‐locked fundamental response, we observed highly synchronised activity in the high‐gamma band which was strong related to the fundamental response on a single‐trial level.
2. RESULTS
One patient with intractable epilepsy participated in an experiment with six flickering rectangles arranged in a two‐by‐three design (Figure 1a). The rectangles spanned a visual angle of 8.4∘ horizontally and 5.5∘ vertically, with a horizontal and vertical spacing between rectangles of 2.9 and 1.4∘, respectively. During each trial, the patient fixated his gaze on one of the rectangles which were all flickering for 4 seconds. The flicker was achieved by adjusting the luminosity of the rectangles based on a sampled sinusoidal profile (Manyakov et al., 2013). Then, 4 sessions of 60 trials were performed in each of which the rectangles were assigned a unique combination of a frequency between 11 and 15 Hz and a phase of 0, 120, 180, or 240° (Table 1). However, as the patient was bedridden, the experiment was performed in a hospital room using a laptop monitor with a non‐linear gamma profile. Prior to the analysis of the data, the “sinusoidal” stimulation profile was therefore corrected to reflect the actual stimulation profile presented to the subject (Supplementary Figure S1).
TABLE 1.
Target | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Session | 1 | 2 | 3 | 4 | 5 | 6 | ||||
1 | 12/0 |
|
|
|
|
14/0 | ||||
2 | 13/0 |
|
|
|
|
14/0 | ||||
3 | 11/0 | 15/π | 13/0 | 13/π | 11/π | 15/0 | ||||
4 | 13/0 | 15/π | 14/0 | 14/π | 13/π | 15/0 |
2.1. V1 is highly phase locked to the gazed stimulation
In this study, we focus on the neural activation generated in response to the foveal stimulation. A phase locking analysis between the gazed stimulation profile and the neural activations at the fundamental frequency (filtered signal between 10 and 16 Hz, Supplementary Figure S2) shows a total of nine electrodes that exhibit a significant increase in phase locking value (PLV) that is consistent across all used frequencies. These electrodes span V1, V2, and V4 with the activity in the primary visual cortex exhibiting, as expected (Wittevrongel, Khachatryan, Fahimi Hnazaee, Carrette, et al., 2018), the most stable locking to the stimulation (electrode 36, indicated with a red star in Figure 1b).
At this location in V1, the fundamental response is highly synchronised to the gazed flickering (median PLV = 0.78 ± 0.03) and is significantly different from the PLV during the pre‐ and post‐stimulation intervals (median PLV = 0.24 ± 0.03 and 0.25 ± 0.03 respectively; all Z ≥ 4.782, p < .0001, Bonferroni‐corrected Wilcoxon signed‐rank test, Figure 1d, Supplementary Figure S3 for the eight other significant channels). The phase locking angle between the fundamental response and the stimulation exhibits a strong positive circular‐linear correlation with respect to the gazed frequency (ρ = .849) (Figure 1c). A circular Watson–Williams (i.e., a circular analysis of variance [ANOVA]) test shows a significant effect of the gazed frequency on the phase locking angle (F(4,359) = 328.12, p < .0001). While previous works have used the slope of the circular‐linear relationship to estimate the latency of the fundamental response (di Russo & Spinelli, 1999; di Russo, Teder‐Sälejärvi, & Hillyard, 2003), this work opted to calculate the latency in the time domain as this allowed us to obtain the latency of individual trials instead of a single measurement across groups. The median latency for each gazed frequency ranges from 112 ms when gazing the 11 Hz frequency to 125 ms for the 15 Hz frequency, with a positive trend towards higher frequencies (Figure 1e, Supplementary Figure S4). A Kruskal–Wallis test reveals a significant effect of the gazed frequency on the fundamental latency (χ2(4,359) = 70.83, p < .0001), and further pairwise comparison using the Bonferroni‐corrected Wilcoxon rank‐sum test shows a significant difference between the latencies for 11 Hz targets with all others (Z = 3.301, p = .0096 for 12 Hz; Z ≥ 5.853, p < .0001 for 13 till 15 Hz), for the latencies of 12 Hz targets with the all others (Z = 3.473, p = .0051 for 13 Hz; Z ≥ 4.377, p < .0001 for 14 and 15 Hz) and between the latencies of 13 and 15 Hz targets (Z = 2.821, p = .0492). The variability in fundamental latency is similar across all frequencies with the inter‐quartile ranges varying between 7.81 and 8.79 ms.
2.2. High‐gamma amplitude oscillations at the gazed frequency
To identify other potential frequency components that synchronise to the stimulation, a phase‐amplitude coupling analysis between the phase of the stimulation and the amplitude of the neural response over the frequency spectrum was performed. The modulograms reveal consistent strong coupling in the higher frequency components between 55 and 125 Hz (Figure 2a). Based on these results, the remainder of this work defines the high‐gamma band as the spectral range from 55 until 125 Hz.
Inspection of the average high‐gamma amplitude across all trials reveals increased activity as early as 40 ms after the onset of the stimulus, evidenced by a significant difference compared to the amplitudes at the stimulation onset (Z > 5.29, p < .001, Bonferroni‐corrected Wilcoxon signed‐rank test, Supplementary Figure S5). The average high‐gamma amplitude per unique frequency‐phase combination additionally shows oscillations at the gazed frequency that begin shortly after the stimulation onset and cease following stimulation offset (Figure 2c for 12 Hz and zero phase, Supplementary Figure S6 for the other frequencies). A single‐trial phase‐amplitude coupling analysis corroborates this finding and reveals that the coupling between the phase of the gazed stimulation and the high‐gamma amplitude is highly localised in V1 (electrode 36, Figure 2b). For all gazed frequencies, the modulation index (MI; i.e., a measure of the coupling strength) at this location is significantly higher than those of a surrogate group in which the gamma amplitude and the gazed stimulation profile of random trials were paired with each other (Kruskal–Wallis χ2(5, 2359) = 420.48, p < .001; all Z > 7.01, p < .001, Bonferroni‐corrected Wilcoxon rank‐sum test, Figure 2d, Supplementary Figure S7). The strongest coupling is elicited by the 12 Hz stimulus. Its MI is significantly larger than that of the other stimulation frequencies (all Z > 8.57, p < .001, pairwise Wilcoxon rank‐sum tests with Bonferroni correction).
Similar to the latency of the fundamental response, the latency of the high‐gamma response for each trial was measured in the time‐domain as the time between the peak of the stimulus and the peak of the gamma amplitude (Supplementary Figure S8). The high‐gamma latency exhibits a consistent increase with gazed frequency, from 61.04 ms for the 11 Hz to 68.36 ms for the 15 Hz stimulation (Figure 2e). All latencies were normally distributed (Lilliefors test p > .01), and ANOVA shows a significant effect of the gazed frequency on the high‐gamma latency (F(4,359) = 8.91, p < .001). Further pairwise comparison, using Bonferroni‐corrected unpaired t tests, reveals a significant difference between the latencies when gazing at a 15 Hz target and all other frequency targets (all t > 2.85, p < .05), and at an 11 Hz target compared to 13 and 14 Hz targets (both t > 3.17, p < .05).
The trial‐to‐trial variability of the high‐gamma latencies is similar to that of the fundamental latencies (interquartile ranges between 7.32 and 8.79 ms). A linear regression model shows a strong positive correlation between both single‐trial latencies (R2 = .882, p < .001, Figure 2f) with a shorter high‐gamma latency consistently resulting in a shorter fundamental latency and vice versa.
2.3. From high‐gamma to fundamental response
While the high‐gamma and fundamental oscillations show strong synchronisation, the latency of the latter is considerably larger, suggesting the involvement of an additional internal neural process in the generation of the fundamental response. The single‐trial internal latencies, defined in the time‐domain as the time‐interval between the peaks of the gamma amplitude and the fundamental response, vary between 50.78 and 56.64 ms (Figure 3a, Supplementary Figure S10). Compared to the latencies reported above, the internal latencies exhibit a considerably smaller trial‐to‐trial variability with interquartile ranges varying from 1.98 to 6.10 ms when gazing at 15 and 12 Hz, respectively. The internal latencies for each gazed frequency are not consistently normally distributed (Lilliefors test, p < .001). The Kruskal–Wallis test reveals a significant effect of the gazed frequency on internal latency (χ2(4,359) = 149.31, p < .0001). Further pairwise comparisons, using Bonferroni‐corrected Wilcoxon rank‐sum tests, show significant latency differences between all combinations except between 11 and 12 Hz (Z = 1.17, p > .05) and 13 and 14 Hz (Z = 0.22, p > .05). Surprisingly, when taking into account the phase of the gazed stimulus, the internal latencies for the lower frequencies (i.e., 11 and 12 Hz) exhibit clusters around different stimulus phases, which is less evident for the other frequencies used in this study (Figure 3b).
Linear regression models between the internal latencies and fundamental or high‐gamma latencies do not show a relevant relationship, despite the significance of the former (Supplementary Figure S11, R2 = .046, p < .001 and R2 = .010, p = .06, respectively). However, the internal latencies do positively correlate with the residuals of the regression model between the high‐gamma and the fundamental latencies (Figure 3c, R2 = .865, p < .001). A trial for which the initial model exhibits a positive residual is thus linked to a larger internal latency, and vice versa. Despite the small inter‐trial variability, the internal latency indirectly affects the latency of the fundamental component, which might also explain the significant but low correlation between the single‐trial internal latencies and fundamental latencies. A multivariate regression model that includes both the high‐gamma and internal latencies indeed achieves a higher explanatory power (R2 = .972, p < .001) for the fundamental latency than a univariate model solely based on the gamma latency.
3. DISCUSSION
Despite its widespread adoption in psychophysics, visual neuroscience and clinical research, the neural mechanisms behind the steady‐state response elicited by flickering visual stimulation are still unclear. In this study, we took advantage of the high spatial, temporal and spectral resolution of subdurally recorded signals to advance our understanding of the neural effects of this widely adopted paradigm. We corroborate previous (mostly non‐invasive) findings that the primary visual cortex is most strongly involved in generating a neural response at the gazed frequency (i.e., the fundamental response). However, in addition to the fundamental oscillation, we also showed that the amplitude in the high‐gamma band (defined from 55 to 125 Hz in a data‐driven manner) resonates at the gazed frequency. The latencies of both neural oscillations are frequency‐dependant, with a higher temporal frequency resulting in larger latencies. The latency of the high‐gamma oscillation varies between 60 and 68 ms. The fundamental response exhibits latencies between 112 and 125 ms compared to the stimulation onset. The trial‐to‐trial variabilities of both latencies are similar (approximately 7 ms) with both measures being highly and positively correlated, albeit with a consistent delay of approximately 55 ms.
3.1. Fundamental response as combination of bottom‐up visual input and top‐down feedback
The photons that interact with the retina are translated into electrical pulses by specialised retinal structures which then get delivered to the LGN, a substructure of the thalamus. It is believed that the LGN mostly acts as a relay (Guillery & Sherman, 2002) that projects the retinal information to selective laminar layers in the primary visual cortex (V1) where the retinotopic organisation is preserved (Tootell, Silverman, Switkes, & de Valois, 1982). Primary sensory areas, such as V1, actively process the sensory inputs, which is reflected by increased activity in the higher spectral range (Buzsáki, Anastassiou, & Koch, 2012; Ray & Maunsell, 2011). Our phase‐amplitude coupling analysis showed indeed considerable synchronisation between the visual stimulation and the high‐gamma band amplitude in V1 with an estimated latency between 60 and 68 ms. In humans, few measurements are available of the latency between the retinal input and the associated neural activity in V1. Using averaged visual evoked potentials in a broad spectral band (0.1–70 Hz) in response to a slowly reversing checkerboard (reversal rate 1.1 Hz) and transient face stimuli (400 ms), the visual latency in humans was previously estimated to be around 62 ms in V1 (Krolak‐Salmon et al., 2003) (and at around 42 ms in LGN). More recent studies confirmed this by reporting latencies in the human primary visual cortex of 66 ms during a rapid serial visual presentation paradigm (Yoshor, Bosking, Ghose, & Maunsell, 2006), of 64 ms during the presentation of a flashing checkerboard (Self et al., 2016) and of 64 ms during a spatial attention task with visual stimuli (Martin et al., 2019). Our measurement, based on high‐gamma responses, thus coincides with previous visual latency estimates.
Interestingly, while both the high frequency and fundamental neural activations synchronise to the visual stimulation, the measured latencies suggest an indirect relationship between both. Note that the latency of the latter is measured between 112 and 125 ms, which is in line with estimations from previous studies (di Russo et al., 2003; di Russo & Spinelli, 1999). The temporal delay of approximately 55 ms compared to the high‐gamma response most likely originates from the involvement of other cortical structures via feedback projections. This theory is corroborated by reports in literature that attentional modulation affects the neural responses of the visual cortex (Jack, Shulman, Snyder, McAvoy, & Corbetta, 2006; Kim et al., 2007; Sirotin & Das, 2009). The exact nature of these feedback projections is still unclear. Potential mechanisms include the thalamic structures through corticogeniculate pathways and lateral connections to higher‐order visual areas (V2, V4). For the former, conduction latencies in an alert macaque monkey vary depending on the type of pathway and range from fast (<7ms) to slow (>14 ms) (Briggs & Usrey, 2009). Based on previous reports of highly similar visual latencies in macaque and human V1 (Schmolesky et al., 1998), these corticogeniculate latencies are likely to be similar in human subjects and do not conform to the internal latencies obtained in this study, even when assuming reciprocal connections. Furthermore, the discrepancy between the trial‐to‐trial variabilities of the high‐gamma and internal latencies additionally suggests different origins for both. The fast high‐gamma responses most likely originate from the processing of geniculate input to V1. Since the activity in LGN is affected by attention (O'Connor, Fukui, Pinsk, & Kastner, 2002), it might partially explain the variability of the high‐gamma latencies. However, the concurrent internal latencies are considerably more stable, suggesting the involvement of another neural structure. Given the mismatch between the internal and expected corticogeniculate conduction latencies and the fact that the majority of the incoming connections to V1 are from a non‐geniculate origin (Muckli & Petro, 2013), feedback projections from extrastriate visual areas seem a more plausible candidate.
The primary visual cortex can be considered the first synaptic level for visual processing (Mesulam, 1998). V1 is linked to extrastriate areas such as V2 and V4, which further process the input from V1 and additionally provide feedback to the previous synaptic level (Mesulam, 1998; Muckli & Petro, 2013). As the estimated latency per synaptic level is roughly expected to induce a delay between 10 and 15 ms (Martin et al., 2019), the measured internal latencies of approximately 55 ms would be explained by propagation and feedback over two synaptic levels. Additional evidence that the processing of flickering visual input involves several visual synaptic levels is given by the subjects' unprompted reports of perceiving illusory shapes, colours or motion while gazing at flickering stimuli, even though this (often unwanted) side‐effect is very rarely mentioned in the literature (e.g., (Blair, Erlikhman, & Caplovitz, 2019; Herrmann, 2001)). Given that higher‐order areas are involved in the processing of colour (lingual and fusiform gyri (Chao & Martin, 1999; Lueck et al., 1989), primate‐analogue V4), shapes (fusiform gyrus (Kanwisher, Woods, Iacoboni, & Mazziotta, 1997; Slotnick & White, 2013), primate‐analogue PIT) and motion (lateral occipitotemporal area (Watson et al., 1993), primate‐analogue V5), it is likely that simple visual luminosity changes indeed cross at least two synaptic levels to higher‐order visual areas which project back and eventually modulate neural activity in V1. Furthermore, this theory agrees with recent work that has provided evidence that feedforward connections rely on activations in the higher spectral range (i.e., gamma band), while feedback mainly operates in the lower spectral range (i.e., alpha/beta) (Michalareas et al., 2016; van Kerkoerle et al., 2014).
3.2. Temporal stimulus characteristics influence the neural responses
Neural response latencies are not independent of the stimuli being presented. Sinusoidal gratings with increasing spatial frequencies consistently elicit larger latencies of non‐invasively recorded visual evoked potentials in human subjects (Jones & Keck, 1978; Parker & Salzen, 1977; Vassilev, Mihaylova, & Bonnet, 2002). Primate research has furthermore shown that individual neurons along the retino‐geniculo‐cortical pathway exhibit temporal frequency tuning characteristics (e.g., in the retinal ganglion (Enroth‐Cugell, Robson, Schweitzer‐Tong, & Watson, 1983), LGN (Derrington & Lennie, 1984), and V1 cells (Hawken, Shapley, & Grosof, 1996)) which are often intrinsically linked with their respective spatial frequency tuning characteristics (Tan & Yao, 2009). While individual neurons exhibit preferences to some temporal frequencies, the subdural recordings in this study reflect local field potentials of larger cortical populations, rendering a direct comparison between the above‐mentioned studies and the current results not trivial, even though high‐gamma responses strongly correlate with neuronal spiking activity (Ray, Crone, Niebur, Franaszczuk, & Hsiao, 2008).
Nevertheless, in the current study, we show that the effect of the temporal frequency of the stimulus is not restricted to single neurons, but also affects the response latencies of larger cortical populations. More specifically, the latency of the high‐gamma response increases with increasing frequency (at least within the frequency range adopted in this study). While this trend resembles a linear function, the narrow spectral range of the tested frequencies in this study (i.e., from 11 to 15 Hz) does not warrant a more generalised conclusion. Similar to single‐cell temporal tuning characteristics in primate V1 (Hawken et al., 1996), the linear trend most likely does not hold for higher temporal frequencies.
As the high‐gamma response most likely reflects geniculo‐cortical projections, the question arises as to whether gazing different temporal frequencies also induces latency differences in LGN. The striking similarities in receptive field properties of retinal ganglion and LGN cells originally led researchers to believe that LGN does not actively contribute to the processing of visual input. However, more recent work has shown that LGN cells indeed transform the retinal information in both spatial and temporal domains (Usrey & Alitto, 2015).
3.3. Implications
Thanks to its high signal‐to‐noise ratio and stable inter‐subject response, the SSVEP has been adopted in numerous clinical studies (Vialatte et al., 2010). The brain's response to visual flickering has been used as a tool for gaining insight into neurodegenerative disorders, such as Alzheimer's (Kikuchi et al., 2002) and Parkinson's (Vanegas et al., 2019), as well as other neurological and psychiatric conditions including, but not limited to depression (Moratti, Rubio, Campo, Keil, & Ortiz, 2008), migraine (de Tommaso et al., 2014), autism (Dickinson, Gomez, Jones, Zemon, & Milne, 2018), and schizophrenia (Javitt, 2009).
The majority of these studies primarily focus on differences in the amplitude and/or latency of the fundamental response between the patients and healthy individuals. However, to date, the precise neural mechanisms that give rise to the fundamental response are not well understood. The evidence presented in the current study suggests that two processes (i.e., bottom‐up visual processing and top‐down feedback) are involved in generating the fundamental response. Thus, inter‐group variations in amplitude and/or latency observed in the above‐mentioned studies could originate either from altered properties of the retino‐geniculo‐cortical pathways, which would result in deviations of the early high‐gamma responses (which indirectly influence the fundamental response), or from pathological effects on the feedback processes that bring about the fundamental response.
One potential approach to discriminate between the initial sensory response and the feedback process would be to complement the flicker paradigm (>4Hz) with a transient stimulation paradigm (e.g., ≤1Hz). The latter allows one to obtain an isolated latency measurement of the early visual response, as the fundamental response would be absent. In combination with the properties of the fundamental response, more firm conclusions could be drawn.
3.4. Potential spurious cross‐frequency coupling
It is widely known that spurious (i.e., artefactual) cross‐frequency coupling can occur with non‐sinusoidal or asymmetric (i.e., non‐linear) signals (Aru et al., 2015; Jensen, Spaak, & Park, 2016; Scheffer‐Teixeira & Tort, 2016). The frequency spectrum of these signals typically also shows pronounced harmonic responses which can extend into the gamma range. When assessing the coupling between a lower and higher frequency component (e.g., theta–gamma coupling (Belluscio, Mizuseki, Schmidt, Kempter, & Buzsáki, 2012)), a strong relationship can be found due to the applied filtering procedure, even when there are no underlying oscillators (e.g., in white noise) or when the oscillators are not coupled (Scheffer‐Teixeira & Tort, 2016). It is important to note that the raw neural responses to the flickering stimulation used in our study are strongly oscillatory but not purely sinusoidal. Averaging the broadband responses reveal triangular or sawtooth waveforms with sharp transitions from low to high amplitude (Figure 4a). As such, the corresponding frequency spectrum indeed shows strong harmonic components which extend beyond the traditional high‐gamma frequency range (>120 Hz) (Supplementary Figure S2). However, in addition to these harmonics, the spectrum also shows overall increased amplitudes in the gamma range extending until 250 Hz, indicating that the raw signal does contain a more general gamma signature.
The cross‐frequency analysis between the phase of the fundamental response (10–16 Hz) and the amplitude of the high‐gamma component (55–125 Hz) shows strong coupling, and it is therefore important to corroborate this finding with additional evidence that the coupling is not spurious. A first piece of evidence for true coupling is given by the modulogram in Figure 2a, which shows that the coupling between the phase of the stimulation profile and the amplitude of the neural response at subdural channel 36 is covering a broad gamma band range. For example, the modulogram for the 12 Hz stimulus shows a smooth curve displaying increased coupling between 55 and 125 Hz. Each point in this curve is obtained by filtering the neural response in a 5‐Hz bandwidth centred at the corresponding frequency f (i.e., filtered between f − 2.5 and f + 2.5 Hz). Note that for a large amount of centre frequencies the band pass does not include any 12 Hz harmonics. Notably, the maximal coupling is obtained when the signal is filtered between 88.5 and 93.5 Hz (i.e., centre frequency of 91 Hz). If the coupling would mainly originate from the harmonics, the modulogram would have contained peaks at multiples of the stimulation frequency under consideration.
A second source of evidence for true coupling comes from the fundamental phase angles at which the high‐gamma amplitude is maximal. A coupling analysis between the phase of the fundamental component and the amplitude of the high‐gamma component at subdural channel 36 reveals that the phase angles at which the high‐gamma amplitude are significantly different across the five stimulation frequencies (F(4,359) = 626.5, p < .0001, Watson–Williams test), and reveal a clear negative trend (Figure 4b, Supplementary Figure S9). If the gamma oscillations were due to the non‐sinusoidal shape (and its harmonics), one would expect a fixed relationship between the fundamental and gamma components. To illustrate this, we ran a simulation with a simulated sawtooth signal at frequencies between 11 and 15 Hz. In this case, the signal is not a result of coupled oscillators and any gamma components are artefacts due to the filtering of the non‐sinusoidal signature. Also here, a strong phase‐amplitude coupling is found between the fundamental and high‐gamma component, but the maximal high‐gamma amplitudes are consistently synchronised to the same phase angles (Figure 4e), as expected (Kramer, Tort, & Kopell, 2008). This discrepancy between the results of the simulated and neural data gives further confidence that the reported coupling is not artefactual.
Finally, we also took a closer look at the characteristics of the gamma oscillations of the neural and simulated data. Here, we found that in the neural data, the time during which the gamma amplitude increases is similar for all stimulation frequencies (Figure 4c), while there was a clear negative trend for the simulated data (Figure 4f). This shows that the gamma response does not originate from a filtering artefact and that the equal length of the gamma “bursts” is likely intrinsic to the underlying neuronal population.
3.5. Open questions
While reports have shown contiguous steady‐state responses until 100 Hz (Herrmann, 2001), it has been shown that the spectrum can be divided into three bands based on the signal‐to‐noise ratio: low (<15 Hz), medium (15–25 Hz), and high (25–60 Hz) (Regan, 1989; Wang, Wang, Gao, Hong, & Gao, 2006). This has led to the hypothesis that these bands differ in the neural mechanism behind their steady‐state responses (Vialatte et al., 2010). The stimulation frequencies used in this study were limited to a narrow frequency band in the lower spectral range, and we are currently not able to comment on whether the same neural mechanisms are involved in generating of the steady‐state response for flickering of a higher frequency band. Future studies using data acquisition and analysis techniques described in the current study could shed light on this question.
It is known that the latency of the fundamental steady‐state response is subject to attentional modulation (di Russo et al., 2003; di Russo & Spinelli, 1999). Given the results presented in this work, the question arises whether attentional modulation would resort to a similar effect on the gamma oscillations. An experimental paradigm in which the subject's attention level is manipulated could shed light on whether the gamma component solely represents visual processing or whether top‐down effects also have an effect. In addition, it could enable one to analyse the exact relationship between the gamma oscillation and the ensuing fundamental response.
3.6. Strengths and limitations
Compared to previous studies, the present study takes advantage of more advanced signal analysis methods in combination with a direct intracranial occipital surface recording in a human subject, thus providing a high spatial, temporal and spectral resolution unattainable with traditional scalp‐recorded EEG or fMRI. As intracranial recordings are only warranted for clinical purposes (e.g., refractory epilepsy) and that occipital lobe epilepsies are rare (Taylor et al., 2003) or often considered inoperable (Heo et al., 2017), considerably fewer opportunities arise to record from subdural electrode implantations over primary visual areas in humans. The present study is therefore based on the data of a single subject and might raise questions about the generalisation of the presented results. Even though this is a valid concern, it is worth noting that the process under consideration is a primal visual response, which is, unlike cognitive responses, less likely to vary across individuals and is even homologue across species (Orban, van Essen, & Vanduffel, 2004; van Essen, 2003). Furthermore, both the high‐gamma and fundamental latencies reported in this work are in accordance with scientific literature, even though they were never described jointly in a single study.
While the current study focuses on neural responses to the foveal stimulation, simultaneous peripheral flickering stimulation was presented during the experiment. However, the retinotopic organisation of the primary visual cortex allows us to avoid the cortical areas that actively process the peripheral stimulus. Indeed, in a previous paper (Wittevrongel, Khachatryan, Fahimi Hnazaee, Carrette, et al., 2018), we have already highlighted the peripheral processing in distinct cortical areas in V1 which were not included in the analyses of the present study.
4. CONCLUSION
The steady‐state response is a cortical activation elicited by flickering visual stimulation and is widely used to investigate cerebral processes and to assess neural pathologies. However, the neural mechanisms behind its generation are currently not well understood. Here we show that the fundamental steady‐state response of frequencies between 11 and 15 Hz is preceded by coupled oscillations in the gamma band (55–125 Hz). The fundamental component consistently trails the gamma oscillation with about 55 ms and the latencies of both components are strongly correlated on a single‐trial level. These results imply that variations in the steady‐state responses due to the pathology or experimental task could originate from two sources. Identifying the precise origin of the variation will ultimately lead to a deeper understanding of the investigated paradigm.
5. MATERIALS AND METHODS
5.1. Subject
A 38‐year old male patient (right‐handed, corrected‐to‐normal vision) with refractory non‐photosensitive epilepsy participated in the study. He was admitted to the hospital (UZ Gent) for the monitoring of seizure activity and the functional mapping of the eloquent cortex (visual, language, etc.). A large subdural grid containing 48 (6 × 8) platinum electrodes embedded in silastic (Ad‐Tech) was implanted on the right occipital cortex: convexity and mesial inter‐hemispheric cortex. Each electrode had a 4.0 mm diameter with 2.3 mm exposure and 10 mm contact spacing. Functional mapping confirmed that a large part of the grid was located over the visual cortex. ECoG data were continuously recorded throughout the experiment at a sampling rate of 1,024 Hz using an SD LTM 64 Express (Micromed, Italy) medically certified device. Prior to analysis, an epileptologist (co‐author A. M.) manually verified the data to identify the subdural contacts located on the pathological tissue. While two such electrodes were identified, none of them were located on the cortical area relevant for the present purpose.
The study was conducted in accordance with the current version of the Declaration of Helsinki (2013) following prior ethical approval from the ethical committee of Gent University Hospital. Prior to participating, the patient was informed about the aim of our study, the experimental procedure and what would be done with the recorded data to which he gave his written consent.
5.2. Localisation of ECoG electrodes
Based on the pre‐implantation MRI scan of the patient, cortical reconstruction and volumetric segmentation was performed with the FreeSurfer image analysis suite (version 5.3.0) (Fischl, 2012). The FreeSurfer output was then loaded into Brainstorm (Tadel, Baillet, Mosher, Pantazis, & Leahy, 2011) and co‐registered with a post‐implant CT using the SPM12 (Penny, Friston, Ashburner, Kiebel, & Nichols, 2011) extension. The coordinates of the implanted electrodes were manually obtained from the artefacts in the CT scan and projected on the cortical surface. All cortical visualisations were done using the Brainstorm toolbox (Tadel, Baillet, Mosher, Pantazis, & Leahy, 2011).
5.3. Experimental design
The experimental interface consisted of six identical rectangular targets (8.8 × 5.8 cm) presented on a 60 Hz laptop monitor (Dell Latitude E6430). A number (from 1 to 6) was displayed in the centre of each target which served as the fixation point for the corresponding rectangle. The bed‐ridden subject viewed the laptop monitor from approximately 60 cm. At this distance, the visual angle of by the rectangles was 8.4 × 5.5∘ and the distance from the fixation point to the edge of the neighbouring target 5.5∘ horizontally and 4.1∘ vertically.
The experiment consisted of four sessions in each of which the six rectangles were assigned a unique combination of frequency and phase (Table 1). Each session consisted of 90 trials. At the beginning of each trial, one of the targets was cued by maintaining its green colour while the other rectangles were shown in grey (Figure 1a). The subject was instructed to direct his/her gaze at the cued target and maintain fixation for the entire duration of the subsequent stimulation. When the subject pressed a key on the keyboard, all rectangles reverted back to their green colour. After 1 s, the 4‐s stimulation was initiated during which all targets were flickering in accordance with their frequency/phase combination achieved by means of sinusoidally modulating their luminosities (Manyakov et al., 2013). Between trials, the subject was allowed to take shorter breaks and a longer break (±5 min) between sessions. In each session, all targets were cued 15 times in a pseudorandom order. A visualisation of one trial can be seen in Figure 1a.
The experiment was implemented in and presented using MATLAB (2012a) with the Psychophysics Toolbox (version 3) (Kleiner et al., 2007) for precise timing.
5.4. Data analysis
5.4.1. Correction of the stimulation profile
As the commercial laptop monitor used in the experiment did not have a linear gamma profile, the sinusoidally sampled luminosity profile requested in the implementation did not actually reflect a sinusoidal profile to the subject. Therefore, prior to analysis, the sinusoidal stimulation profile was corrected to reflect the actual stimulation profile presented to the subject. This was done with the help of a Chroma Meter CS‐100A (Konica Minolta, Belgium) to measure the luminosity output level of the monitor for each unique requested intensity level. Using the obtained gamma curve (Supplementary Figure S1a), the sinusoidal stimulation profile was then corrected and rescaled in the range from −1 to 1 (Supplementary Figure S1b).
5.4.2. Pre‐processing
The raw ECoG data were re‐referenced offline to the common average reference and cut into 6 s epochs from 1 s prior to stimulation onset until 1 s after the stimulation offset. Each epoch was then labelled with the frequency and phase of the gazed (foveal) target. In total, 360 (=90 × 4) labelled epochs were extracted for further analysis.
5.4.3. Extraction of the fundamental response
As the SSVEP is characterised by a prominent peak at the fundamental frequency, analysis typically focuses on a narrow stimulus‐dependent band‐pass filter around this frequency. However, to avoid potential filter‐artefacts (e.g., phase distortion) introduced by selective filtering for each epoch, in this work, all epochs were filtered with an identical fourth‐order zero‐phase Butterworth band‐pass filter with cut‐off frequencies of 10 and 16 Hz, determined by the (Fourier) frequency spectrum that exhibited a pronounced increase within these bounds compared to the spectrum of pre‐ and post‐stimulus signals (Supplementary Figure S2). It is worth noting that, even though the zero‐phase filter temporally smears out the amplitude of the signal (de Cheveigné & Nelken, 2019), maintaining the correct phase information is crucial for our analysis. From the filtered epochs, the analytic amplitude and phase of each epoch were then obtained as the real and imaginary part of the Hilbert transform respectively.
5.4.4. Phase locking
Traditionally, phase locking is used to investigate functional connectivity by assessing whether neural responses at two distinct spatial locations are in synchronisation within a given frequency band. However, in this study, the phase of the fundamental component, extracted using the procedure detailed above, was analysed with regard to the phase of the stimulation profile presented to the subject. The phase of the stimulation profile was obtained by the imaginary part of the Hilbert transformed gamma‐corrected sinusoidal profile in which the original stimulation profile was given by 2πft + ϕ, where f is the frequency of the gazed target, ϕ is the phase of the gazed target and t ∈ [−1, 5] is the stimulation time sampled at the sampling rate of the epochs.
Using the temporal phase traces of the stimulus and the fundamental response, phase locking for each epoch can be calculated by subtracting the latter from the former and by projecting the resultant phase difference for each sample on the unit circle (Lachaux, Rodriguez, Martinerie, & Varela, 1999):
(1) |
where Φt is the phase difference between the stimulus and the fundamental response at time t, and j is the imaginary number. The PLV can then be determined as (Lachaux et al., 1999):
(2) |
where t1 and t2 are the indices of the first and last time sample to be included and N is the total number averaged samples. For the pre‐ and post‐stimulation PLVs, only the samples with t < 0 and t > 4 were considered, respectively, and for the phase locking during the stimulation the samples in the interval between 0 and 4 s: t ∈ [0, 4]. The phase locking angle is then given by the phase of the averaged vector in Equation (2).
The circular‐linear correlation between the phase locking angles and the gazed frequency was estimated using the approach described in (Kempter, Leibold, Buzsáki, Diba, & Schmidt, 2012); the Watson–Williams test was performed using the CircStat toolbox (Berens, 2009).
5.4.5. Calculation of the modulogram
To identify other components that synchronise with the stimulation, a phase‐amplitude coupling analysis was performed. For each epoch, the instantaneous phase of the corresponding gazed stimulus was extracted using the procedure described above. The amplitude of the neural response was extracted by filtering the epoch between f − 2.5 and f + 2.5Hz using a fourth‐order zero‐phase Butterworth filter followed by the extraction of the instantaneous amplitude using the Hilbert transform. In line with the procedure described in (Tort, Komorowski, Eichenbaum, & Kopell, 2010), the extracted stimulus phase and response amplitude were then used to calculate the MI for the epoch under consideration. Briefly, the phase signal was binned in increments of 5°; the corresponding amplitude signal was averaged to obtain an average amplitude per phase bin, which was then normalised to a unit vector. An adaptation of the Kullback–Leibler distance subsequently yielded the MI:
(3) |
where N is the number of phase bins and P(j) is the normalised average amplitude in phase bin j. The modulation indices of the epochs during which the same frequency was gazed were then averaged and the centre frequency f was varied from 3 to 150 Hz in steps of 2 Hz to obtain the modulogram shown in Figure 2a.
5.4.6. Extraction of the high‐gamma response
To extract the amplitude of the gamma band for each trial, a similar procedure as for the fundamental response was used. First, the filtering ranges were obtained in a data‐driven manner by calculating and plotting the modulograms with the help of the procedure described in the previous section. Each re‐referenced epoch was then band‐pass filtered between 55 and 125 Hz by means of a fourth‐order zero‐phase Butterworth filter followed by Hilbert transform to obtain the instantaneous amplitude.
The 95% confidence interval for each time point, as shown by the shaded area in Figure 2c and Supplementary Figure S6, was obtained from 1,000 bootstrapped samples and calculated using the bias‐corrected and accelerated approach. The data points in each bootstrapped sample were sampled with replacement from the instantaneous high‐gamma amplitudes of all epochs labelled with the given frequency and zero phase.
5.4.7. Phase‐amplitude coupling
The coupling between the stimulation and the high‐gamma amplitude was quantified using phase‐amplitude coupling. First, for each epoch, the phase of the stimulation and the instantaneous amplitude of the high‐gamma response epoch were extracted using the procedures described above. The coupling between the two traces was then determined by calculating the MI as described above. The modulation indices were grouped per gazed frequency and a surrogate group was included to obtain a baseline on the MI for non‐coupled signals. The surrogate group consisted of the instantaneous high‐gamma amplitude traces of 1,000 random epochs, selected (with replacement) from all the epochs. Each of those amplitude traces was then matched with the phase trace of the stimulation profile of a randomly selected epoch after which the MI was calculated. Since the Lilliefors test showed that the modulation indices of the groups were not consistently normally distributed, we used the Wilcoxon rank‐sum test to compare the distributions of the modulation indices for each of the five stimulation frequencies and the surrogate group to each other.
5.4.8. Fundamental and high‐gamma latency
The fundamental, high‐gamma and internal latencies were measured in the time‐domain as the time‐interval between the peaks of the corresponding components (i.e., stimulation profile and fundamental amplitude, stimulation profile and instantaneous high‐gamma amplitude, and instantaneous high‐gamma amplitude and fundamental amplitude, respectively).
First, for each epoch, the time‐domain averages (Luo & Sullivan, 2010; Wittevrongel, Khachatryan, Fahimi Hnazaee, Camarrone, et al., 2018; Wittevrongel & van Hulle, 2017) of the two components were obtained by cutting both components into consecutive overlapping segments whose length equals three periods of the corresponding stimulation frequency. The first sample of each segment (i.e., the cutting points) was given by multiples of one period of the gazed frequency. Next, the peaks of both time‐domain averages were determined using the findpeaks function in MATLAB with a minimum inter‐peak distance set to 75% of the period of the gazed frequency to make the procedure more robust. As the coupling or phase locking was already established prior to the latency analyses, this parameter does not bias the measurement. As the components are periodic in nature, multiple peak‐to‐peak latencies can be obtained: the reported latencies were the smallest ones that exceeded a predefined latency. For the fundamental component, the minimal latency was set to 80 ms as previous studies have reported estimated fundamental latency of 100–150 ms. For the high‐gamma latencies, the minimal latency was set to 30 ms based on previous literature that reported the earliest responses in V1 around 40 ms. For the internal latencies, no minimal latency was set.
5.4.9. Regression analysis
The relationship between the different latency measurements was assessed using linear regression models. As the different groups have different mean values, the latencies were z‐scored per group (i.e., gazed frequency) prior to fitting, allowing them to be fit in a single model. To avoid large effects of a few outlier trials on the measured relationship between the three latency measures, a robust linear regression analysis was performed with a bisquare weight function.
A similar procedure was used to obtain the regression model between the fundamental latency and the phase locking angle shown in Supplementary Figure S4b. However, as the phase locking angle is a circular measurement, its z‐scoring was performed using the circular mean and circular SD provided by the CircStat toolbox (Berens, 2009).
5.5. Simulation
To evaluate the presence of spurious phase‐amplitude coupling, we compared our results with those obtained from a simulation in which we used artificially generated triangular/sawtooth signals. For each trial, a sawtooth signal at the corresponding stimulation frequency was created that reached its maximal value at 70% of each period. These signals were then fed into the same phase‐amplitude coupling analysis as used for the neural signals. In both cases, the fundamental phase was obtained by filtering the signals between 10 and 16 Hz, applying the Hilbert transform and extracting the instantaneous phase. For the high‐gamma amplitude, the signals were filtered between 55 and 125 Hz, after which the Hilbert transform was applied and the instantaneous amplitude extracted. The coupling between the phase and amplitudes followed the same procedure as described in Section 5.4.5.
One of the characteristics we compared between the neural and simulated signals was the time during which the gamma amplitude increases. To obtain this measurement for a given trial, the high‐gamma amplitude was extracted using the procedure described above. From the amplitude trace, the time‐domain average was obtained using the same procedure as described in Section 5.4.8. From the average segment, the gamma rising time was given as the time between the minimal and subsequent maximal gamma amplitude. This procedure was repeated for each trial and the results were summarised per stimulation frequency.
CONFLICT OF INTEREST
The authors declare no conflict of interest.
AUTHOR CONTRIBUTIONS
Benjamin Wittevrongel and Elvira Khachatryan designed the experiment; Benjamin Wittevrongel, Elvira Khachatryan, Evelien Carrette, Paul Boon, Alfred Meurs, and Dirk Van Roost collected the data; Benjamin Wittevrongel performed the analysis; Benjamin Wittevrongel, Elvira Khachatryan, and Marc M. Van Hulle interpreted the results and wrote the manuscript.
ETHICS STATEMENT
Prior to participating, the patient was informed about the aim of our study, the experimental procedure and what would be done with the recorded data to which he gave his written consent.
Supporting information
ACKNOWLEDGMENTS
The authors would like to thank Marc De Paep for his help with measuring the gamma profile of the laptop monitor, Prof Rufin Vogels for a constructive discussion of the results and Dr Ana Kotarcic for her input while writing the manuscript. B. W. is supported by a post‐doctoral mandate from KU Leuven (PDM/19/176). M. M. V. H. is supported by research grants received from the European Union's Horizon 2020 Research and Innovation Programme under grant agreement No. 857375; the Financing Program (PFV/10/008) and the special research fund of the KU Leuven (C24/18/098); the Belgian Fund for Scientific Research – Flanders (G088314N, G0A0914N, and G0A4118N); the Inter‐university Attraction Poles Programme – Belgian Science Policy (IUAP P7/11); and the Hercules Foundation (AKUL 043).
Wittevrongel B, Khachatryan E, Carrette E, et al. High‐gamma oscillations precede visual steady‐state responses: A human electrocorticography study. Hum Brain Mapp. 2020;41:5341–5355. 10.1002/hbm.25196
Benjamin Wittevrongel and Elvira Khachatryan contributed equally to this study.
Funding information Fonds Wetenschappelijk Onderzoek, Grant/Award Numbers: G088314N, G0A0914N, G0A4118N; KU Leuven, Grant/Award Numbers: PDM/19/176, C24/18/098; Hercules Foundation, Grant/Award Number: AKUL 043; Inter‐university Attraction Poles Programme – Belgian Science Policy, Grant/Award Number: IUAP P7/11; Financing Program, Grant/Award Number: PFV/10/008; European Union's Horizon 2020 Research and Innovation Programme, Grant/Award Number: 857375
DATA AVAILABILITY STATEMENT
The dataset supporting the conclusions of this article is not publicly available due to the sensitive nature of the data. Any requests for obtaining the dataset can be directed toward co‐author E. C. (evelien.carrette@ugent.be).
REFERENCES
- Adrian, E. D. , & Matthews, B. H. (1934). The Berger rhythm: Potential changes from the occipital lobes in man. Brain, 57, 355–385. [DOI] [PubMed] [Google Scholar]
- Aru, J. , Aru, J. , Priesemann, V. , Wibral, M. , Lana, L. , Pipa, G. , … Vicente, R. (2015). Untangling cross‐frequency coupling in neuroscience. Current Opinion in Neurobiology, 31, 51–61. [DOI] [PubMed] [Google Scholar]
- Belluscio, M. A. , Mizuseki, K. , Schmidt, R. , Kempter, R. , & Buzsáki, G. (2012). Cross‐frequency phase–phase coupling between theta and gamma oscillations in the hippocampus. Journal of Neuroscience, 32, 423–435. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berens, P. (2009). Circstat: A MATLAB toolbox for circular statistics. Journal of Statistical Software, 31(10), 1–21. [Google Scholar]
- Blair, C. D. , Erlikhman, G. , & Caplovitz, G. P. (2019). The wandering circles: A flicker rate and contour‐dependent motion illusion. Perception, 10, 2041669519875156. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boto, E. , Meyer, S. S. , Shah, V. , Alem, O. , Knappe, S. , Kruger, P. , … Brookes, M. J. (2017). A new generation of magnetoencephalography: Room temperature measurements using optically‐pumped magnetometers. NeuroImage, 149, 404–414. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Briggs, F. , & Usrey, W. M. (2009). Parallel processing in the corticogeniculate pathway of the macaque monkey. Neuron, 62, 135–146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buzsáki, G. , Anastassiou, C. A. , & Koch, C. (2012). The origin of extracellular fields and currents—EEG, ECoG, LFP and spikes. Nature Reviews Neuroscience, 13, 407–420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chao, L. L. , & Martin, A. (1999). Cortical regions associated with perceiving, naming, and knowing about colors. Journal of Cognitive Neuroscience, 11, 25–35. [DOI] [PubMed] [Google Scholar]
- Chen, W. , Zhu, X.‐H. , Thulborn, K. R. , & Ugurbil, K. (1999). Retinotopic mapping of lateral geniculate nucleus in humans using functional magnetic resonance imaging. Proceedings of the National Academy of Sciences of the United States of America, 96, 2430–2434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen, X. , Wang, Y. , Nakanishi, M. , Gao, X. , Jung, T. P. , & Gao, S. (2015). High‐speed spelling with a noninvasive brain–computer interface. Proceedings of the National Academy of Sciences of the United States of AmericaProceedings of the National Academy of Sciences of the United States of America, 112, E6058–E6067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Combaz, A. , Chatelle, C. , Robben, A. , Vanhoof, G. , Goeleven, A. , Thijs, V. , … Laureys, S. (2013). A comparison of two spelling brain‐computer interfaces based on visual p3 and SSVEP in locked‐in syndrome. PLoS One, 8, e73691. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Cheveigné, A. , & Nelken, I. (2019). Filters: When, why, and how (not) to use them. Neuron, 102, 280–293. 10.1016/j.neuron.2019.02.039 [DOI] [PubMed] [Google Scholar]
- de Tommaso, M. , Ambrosini, A. , Brighina, F. , Coppola, G. , Perrotta, A. , Pierelli, F. , … Schoenen, J. (2014). Altered processing of sensory stimuli in patients with migraine. Nature Reviews Neurology, 10(3), 144–155. 10.1038/nrneurol.2014.14. [DOI] [PubMed] [Google Scholar]
- Derrington, A. , & Lennie, P. (1984). Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. The Journal of Physiology, 357, 219–240. [DOI] [PMC free article] [PubMed] [Google Scholar]
- di Russo, F. , & Spinelli, D. (1999). Electrophysiological evidence for an early attentional mechanism in visual processing in humans. Vision Research, 39, 2975–2985. [DOI] [PubMed] [Google Scholar]
- di Russo, F. , Teder‐Sälejärvi, W. A. , & Hillyard, S. A. (2003). Steady‐state VEP and attentional visual processing In The cognitive electrophysiology of mind and brain (pp. 259–274). Amsterdam, The Netherlands: Elsevier. [Google Scholar]
- Dickinson, A. , Gomez, R. , Jones, M. , Zemon, V. , & Milne, E. (2018). Lateral inhibition in the autism spectrum: An SSVEP study of visual cortical lateral interactions. Neuropsychologia, 111, 369–376. [DOI] [PubMed] [Google Scholar]
- Engel, S. A. , Glover, G. H. , & Wandell, B. A. (1997). Retinotopic organization in human visual cortex and the spatial precision of functional MRI. Cerebral Cortex, 7, 181–192. [DOI] [PubMed] [Google Scholar]
- Enroth‐Cugell, C. , Robson, J. , Schweitzer‐Tong, D. , & Watson, A. (1983). Spatio‐temporal interactions in cat retinal ganglion cells showing linear spatial summation. The Journal of Physiology, 341, 279–307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fischl, B. (2012). FreeSurfer. NeuroImage, 62, 774–781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guillery, R. , & Sherman, S. M. (2002). Thalamic relay functions and their role in corticocortical communication: Generalizations from the visual system. Neuron, 33, 163–175. [DOI] [PubMed] [Google Scholar]
- Hawken, M. , Shapley, R. M. , & Grosof, D. (1996). Temporal‐frequency selectivity in monkey visual cortex. Visual Neuroscience, 13, 477–492. [DOI] [PubMed] [Google Scholar]
- Heo, W. , Kim, J. S. , Chung, C. K. , & Lee, S. K. (2017). Relationship between cortical resection and visual function after occipital lobe epilepsy surgery. Journal of Neurosurgery, 129, 524–532. [DOI] [PubMed] [Google Scholar]
- Herrmann, C. S. (2001). Human EEG responses to 1–100 Hz flicker: Resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Experimental Brain Research, 137, 346–353. [DOI] [PubMed] [Google Scholar]
- Hwang, H.‐J. , Han, C. H. , Lim, J. H. , Kim, Y. W. , Choi, S. I. , An, K. O. , … Im, C. H. (2017). Clinical feasibility of brain‐computer interface based on steady‐state visual evoked potential in patients with locked‐in syndrome: Case studies. Psychophysiology, 54, 444–451. [DOI] [PubMed] [Google Scholar]
- Jack, A. I. , Shulman, G. L. , Snyder, A. Z. , McAvoy, M. , & Corbetta, M. (2006). Separate modulations of human v1 associated with spatial attention and task structure. Neuron, 51, 135–147. [DOI] [PubMed] [Google Scholar]
- Javitt, D. C. (2009). When doors of perception close: Bottom‐up models of disrupted cognition in schizophrenia. Annual Review of Clinical Psychology, 5, 249–275. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jensen, O. , Spaak, E. , & Park, H. (2016). Discriminating valid from spurious indices of phase‐amplitude coupling. eNeuro, 3, ENEURO.0334–ENEU16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jonas, J. , Jacques, C. , Liu‐Shuang, J. , Brissart, H. , Colnat‐Coulbois, S. , Maillard, L. , & Rossion, B. (2016). A face‐selective ventral occipito‐temporal map of the human brain with intracerebral potentials. Proceedings of the National Academy of Sciences of the United States of America, 113, E4088–E4097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jones, R. , & Keck, M. J. (1978). Visual evoked response as a function of grating spatial frequency. Investigative Ophthalmology & Visual Science, 17, 652–659. [PubMed] [Google Scholar]
- Kamp, A. , Sem‐Jacobsen, C. W. , Storm Van Leeuwen, W. , & van der Tweel, L. (1960). Cortical responses to modulated light in the human subject. Acta Physiologica Scandinavica, 48, 1–12. [DOI] [PubMed] [Google Scholar]
- Kanwisher, N. , Woods, R. P. , Iacoboni, M. , & Mazziotta, J. C. (1997). A locus in human extrastriate cortex for visual shape analysis. Journal of Cognitive Neuroscience, 9, 133–142. [DOI] [PubMed] [Google Scholar]
- Kempter, R. , Leibold, C. , Buzsáki, G. , Diba, K. , & Schmidt, R. (2012). Quantifying circular–linear associations: Hippocampal phase precession. Journal of Neuroscience Methods, 207, 113–124. [DOI] [PubMed] [Google Scholar]
- Kikuchi, M. , Wada, Y. , Takeda, T. , Oe, H. , Hashimoto, T. , & Koshino, Y. (2002). EEG harmonic responses to photic stimulation in normal aging and Alzheimer's disease: Differences in interhemispheric coherence. Clinical Neurophysiology, 113, 1045–1051. [DOI] [PubMed] [Google Scholar]
- Kim, Y. J. , Grabowecky, M. , Paller, K. A. , Muthu, K. , & Suzuki, S. (2007). Attention induces synchronization‐based response gain in steady‐state visual evoked potentials. Nature Neuroscience, 10, 117. [DOI] [PubMed] [Google Scholar]
- Kleiner, M. , Brainard, D. , Pelli, D. , Ingling, A. , Murray, R. , & Broussard, C. (2007). What's new in psychtoolbox‐3. Perception, 36(14), 1–16. [Google Scholar]
- Kramer, M. A. , Tort, A. B. , & Kopell, N. J. (2008). Sharp edge artifacts and spurious coupling in EEG frequency comodulation measures. Journal of Neuroscience Methods, 170, 352–357. [DOI] [PubMed] [Google Scholar]
- Krolak‐Salmon, P. , Hénaff, M.‐A. , Tallon‐Baudry, C. , Yvert, B. , Guénot, M. , Vighetto, A. , … Bertrand, O. (2003). Human lateral geniculate nucleus and visual cortex respond to screen flicker. Annals of Neurology, 53(1), 73–80. 10.1002/ana.10403. [DOI] [PubMed] [Google Scholar]
- Lachaux, J.‐P. , Rodriguez, E. , Martinerie, J. , & Varela, F. J. (1999). Measuring phase synchrony in brain signals. Human Brain Mapping, 8, 194–208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee, B. B. , Pokorny, J. , Smith, V. C. , & Kremers, J. (1994). Responses to pulses and sinusoids in macaque ganglion cells. Vision Research, 34, 3081–3096. [DOI] [PubMed] [Google Scholar]
- Lesenfants, D. , Habbal, D. , Lugo, Z. , Lebeau, M. , Horki, P. , Amico, E. , … Noirhomme, Q. (2014). An independent SSVEP‐based brain–computer interface in locked‐in syndrome. Journal of Neural Engineering, 11, 035002. [DOI] [PubMed] [Google Scholar]
- Lueck, C. J. , Zeki, S. , Friston, K. J. , Deiber, M.‐P. , Cope, P. , Cunningham, V. J. , … Frackowiak, R. S. J. (1989). The colour centre in the cerebral cortex of man. Nature, 340, 386–389. [DOI] [PubMed] [Google Scholar]
- Luo, A. , & Sullivan, T. J. (2010). A user‐friendly SSVEP‐based brain–computer interface using a time‐domain classifier. Journal of Neural Engineering, 7, 026010 10.1088/1741-2560/7/2/026010 [DOI] [PubMed] [Google Scholar]
- Manyakov, N. V. , Chumerin, N. , Robben, A. , Combaz, A. , van Vliet, M. , & van Hulle, M. M. (2013). Sampled sinusoidal stimulation profile and multichannel fuzzy logic classification for monitor‐based phase‐coded SSVEP brain–computer interfacing. Journal of Neural Engineering, 10, 036011. [DOI] [PubMed] [Google Scholar]
- Martin, A. B. , Yang, X. , Saalmann, Y. B. , Wang, L. , Shestyuk, A. , Lin, J. J. , … Kastner, S. (2019). Temporal dynamics and response modulation across the human visual system in a spatial attention task: An ECoG study. Journal of Neuroscience, 39, 333–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mesulam, M.‐M. (1998). From sensation to cognition. Brain: A Journal of Neurology, 121, 1013–1052. [DOI] [PubMed] [Google Scholar]
- Michalareas, G. , Vezoli, J. , van Pelt, S. , Schoffelen, J. M. , Kennedy, H. , & Fries, P. (2016). Alpha‐beta and gamma rhythms subserve feedback and feedforward influences among human visual cortical areas. Neuron, 89, 384–397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moratti, S. , Rubio, G. , Campo, P. , Keil, A. , & Ortiz, T. (2008). Hypofunction of right temporoparietal cortex during emotional arousal in depression. Archives of General Psychiatry, 65, 532–541. [DOI] [PubMed] [Google Scholar]
- Muckli, L. , & Petro, L. S. (2013). Network interactions: Non‐geniculate input to v1. Current Opinion in Neurobiology, 23, 195–201. [DOI] [PubMed] [Google Scholar]
- O'Connor, D. H. , Fukui, M. M. , Pinsk, M. A. , & Kastner, S. (2002). Attention modulates responses in the human lateral geniculate nucleus. Nature Neuroscience, 5, 1203–1209. [DOI] [PubMed] [Google Scholar]
- Orban, G. A. , van Essen, D. , & Vanduffel, W. (2004). Comparative mapping of higher visual areas in monkeys and humans. Trends in Cognitive Sciences, 8, 315–324. [DOI] [PubMed] [Google Scholar]
- Parker, D. , & Salzen, E. (1977). Latency changes in the human visual evoked response to sinusoidal gratings. Vision Research, 17, 1201–1204. [DOI] [PubMed] [Google Scholar]
- Penny, W. D. , Friston, K. J. , Ashburner, J. T. , Kiebel, S. J. , & Nichols, T. E. (2011). Statistical parametric mapping: The analysis of functional brain images, New York, NY: Elsevier. [Google Scholar]
- Ray, S. , Crone, N. E. , Niebur, E. , Franaszczuk, P. J. , & Hsiao, S. S. (2008). Neural correlates of high‐gamma oscillations (60–200 Hz) in macaque local field potentials and their potential implications in electrocorticography. Journal of Neuroscience, 28, 11526–11536. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ray, S. , & Maunsell, J. H. (2011). Different origins of gamma rhythm and high‐gamma activity in macaque visual cortex. PLoS Biology, 9, e1000610. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Regan, D. (1966). Some characteristics of average steady‐state and transient responses evoked by modulated light. Electroencephalography and Clinical Neurophysiology, 20, 238–248. [DOI] [PubMed] [Google Scholar]
- Regan, D. (1989). Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine. New York, NY: Elsevier. [Google Scholar]
- Scheffer‐Teixeira, R. , & Tort, A. B. (2016). On cross‐frequency phase‐phase coupling between theta and gamma oscillations in the hippocampus. eLife, 5, e20515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schmolesky, M. T. , Wang, Y. , Hanes, D. P. , Thompson, K. G. , Leutgeb, S. , Schall, J. D. , & Leventhal, A. G. (1998). Signal timing across the macaque visual system. Journal of Neurophysiology, 79, 3272–3278. [DOI] [PubMed] [Google Scholar]
- Self, M. W. , Peters, J. C. , Possel, J. K. , Reithler, J. , Goebel, R. , Ris, P. , … Roelfsema, P. R. (2016). The effects of context and attention on spiking activity in human early visual cortex. PLoS Biology, 14, e1002420. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sirotin, Y. B. , & Das, A. (2009). Anticipatory haemodynamic signals in sensory cortex not predicted by local neuronal activity. Nature, 457, 475–479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Slotnick, S. D. , & White, R. C. (2013). The fusiform face area responds equivalently to faces and abstract shapes in the left and central visual fields. NeuroImage, 83, 408–417. [DOI] [PubMed] [Google Scholar]
- Tadel, F. , Baillet, S. , Mosher, J. C. , Pantazis, D. , & Leahy, R. M. (2011). Brainstorm: A user‐friendly application for MEG/EEG analysis. Computational Intelligence and Neuroscience, 2011, 1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tan, Z. , & Yao, H. (2009). The spatiotemporal frequency tuning of LGN receptive field facilitates neural discrimination of natural stimuli. Journal of Neuroscience, 29, 11409–11416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taylor, I. , Scheffer, I. E. , & Berkovic, S. F. (2003). Occipital epilepsies: Identification of specific and newly recognized syndromes. Brain, 126, 753–769. [DOI] [PubMed] [Google Scholar]
- Tootell, R. B. , Silverman, M. S. , Switkes, E. , & de Valois, R. L. (1982). Deoxyglucose analysis of retinotopic organization in primate striate cortex. Science, 218, 902–904. [DOI] [PubMed] [Google Scholar]
- Tort, A. B. , Komorowski, R. , Eichenbaum, H. , & Kopell, N. (2010). Measuring phase‐amplitude coupling between neuronal oscillations of different frequencies. Journal of Neurophysiology, 104, 1195–1210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Usrey, W. M. , & Alitto, H. J. (2015). Visual functions of the thalamus. Annual Review of Vision Science, 1, 351–371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van der Tweel, L. , & Lunel, H. V. (1965). Human visual responses to sinusoidally modulated light. Electroencephalography and Clinical Neurophysiology, 18, 587–598. [DOI] [PubMed] [Google Scholar]
- van Essen, D. C. (2003). Organization of visual areas in macaque and human cerebral cortex. The Visual Neurosciences, 1, 507–521. [Google Scholar]
- van Kerkoerle, T. , Self, M. W. , Dagnino, B. , Gariel‐Mathis, M.‐A. , Poort, J. , van der Togt, C. , & Roelfsema, P. R. (2014). Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex. Proceedings of the National Academy of Sciences, 111(40), 14332–14341. 10.1073/pnas.1402773111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vanegas, M. I. , Blangero, A. , Galvin, J. E. , Di Rocco, A. , Quartarone, A. , Ghilardi, M. F. , & Kelly, S. P. (2019). Altered dynamics of visual contextual interactions in Parkinson’s disease. npj Parkinson's Disease, 5(1), 10.1038/s41531-019-0085-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vassilev, A. , Mihaylova, M. , & Bonnet, C. (2002). On the delay in processing high spatial frequency visual information: Reaction time and VEP latency study of the effect of local intensity of stimulation. Vision Research, 42, 851–864. [DOI] [PubMed] [Google Scholar]
- Vialatte, F.‐B. , Maurice, M. , Dauwels, J. , & Cichocki, A. (2010). Steady‐state visually evoked potentials: Focus on essential paradigms and future perspectives. Progress in Neurobiology, 90, 418–438. [DOI] [PubMed] [Google Scholar]
- Walter, W. G. , Dovey, V. , & Shipton, H. (1946). Analysis of the electrical response of the human cortex to photic stimulation. Nature, 158, 540–541. [DOI] [PubMed] [Google Scholar]
- Wang, Y. , Wang, R. , Gao, X. , Hong, B. , & Gao, S. (2006). A practical VEP‐based brain‐computer interface. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 14, 234–240. [DOI] [PubMed] [Google Scholar]
- Watson, J. D. G. , Myers, R. , Frackowiak, R. S. J. , Hajnal, J. V. , Woods, R. P. , Mazziotta, J. C. , … Zeki, S. (1993). Area V5 of the human brain: evidence from a combined study using positron emission tomography and magnetic resonance imaging. Cerebral Cortex, 3(2), 79–94. 10.1093/cercor/3.2.79. [DOI] [PubMed] [Google Scholar]
- Winawer, J. , Kay, K. N. , Foster, B. L. , Rauschecker, A. M. , Parvizi, J. , & Wandell, B. A. (2013). Asynchronous broadband signals are the principal source of the bold response in human visual cortex. Current Biology, 23, 1145–1153. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wittevrongel, B. , Khachatryan, E. , Fahimi Hnazaee, M. , Camarrone, F. , Carrette, E. , de Taeye, L. , … van Hulle, M. M. (2018). Decoding steady‐state visual evoked potentials from electrocorticography. Frontiers in Neuroinformatics, 12, 65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wittevrongel, B. , Khachatryan, E. , Fahimi Hnazaee, M. , Carrette, E. , de Taeye, L. , Meurs, A. , … van Hulle, M. M. (2018). Representation of steady‐state visual evoked potentials elicited by luminance flicker in human occipital cortex: An electrocorticography study. NeuroImage, 175, 315–326. [DOI] [PubMed] [Google Scholar]
- Wittevrongel, B. , & van Hulle, M. M. (2017). Spatiotemporal beamforming: A transparent and unified decoding approach to synchronous visual brain‐computer interfacing. Frontiers in Neuroscience, 11, 630. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yoshor, D. , Bosking, W. H. , Ghose, G. M. , & Maunsell, J. H. (2006). Receptive fields in human visual cortex mapped with surface electrodes. Cerebral Cortex, 17, 2293–2302. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The dataset supporting the conclusions of this article is not publicly available due to the sensitive nature of the data. Any requests for obtaining the dataset can be directed toward co‐author E. C. (evelien.carrette@ugent.be).