Biases in sensory perception can arise from both experimental manipulations and personal trait-like features. These idiosyncratic biases and their neural underpinnings are often overlooked in studies on the physiology underlying perception. A potential candidate mechanism reflecting such idiosyncratic biases could be spontaneous alpha band activity, a prominent brain rhythm known to influence perceptual reports in general.
Keywords: alpha oscillations, audiovisual perception, electrophysiology (EEG), idiosyncratic bias, interindividual variability, time perception
Abstract
Biases in sensory perception can arise from both experimental manipulations and personal trait-like features. These idiosyncratic biases and their neural underpinnings are often overlooked in studies on the physiology underlying perception. A potential candidate mechanism reflecting such idiosyncratic biases could be spontaneous alpha band activity, a prominent brain rhythm known to influence perceptual reports in general. Using a temporal order judgment task, we here tested the hypothesis that alpha power reflects the overcoming of an idiosyncratic bias. Importantly, to understand the interplay between idiosyncratic biases and contextual (temporary) biases induced by experimental manipulations, we quantified this relation before and after temporal recalibration. Using EEG recordings in human participants (male and female), we find that prestimulus frontal alpha power correlates with the tendency to respond relative to an own idiosyncratic bias, with stronger α leading to responses matching the bias. In contrast, alpha power does not predict response correctness. These results also hold after temporal recalibration and are specific to the alpha band, suggesting that alpha band activity reflects, directly or indirectly, processes that help to overcome an individual's momentary bias in perception. We propose that combined with established roles of parietal α in the encoding of sensory information frontal α reflects complementary mechanisms influencing perceptual decisions.
SIGNIFICANCE STATEMENT The brain is a biased organ, frequently generating systematically distorted percepts of the world, leading each of us to evolve in our own subjective reality. However, such biases are often overlooked or considered noise when studying the neural mechanisms underlying perception. We show that spontaneous alpha band activity predicts the degree of biasedness of human choices in a time perception task, suggesting that alpha activity indexes processes needed to overcome an individual's idiosyncratic bias. This result provides a window onto the neural underpinnings of subjective perception, and offers the possibility to quantify or manipulate such priors in future studies.
Introduction
Perception is not only driven by the incoming sensory information but is also shaped by expectations, knowledge and other individual biases. These can arise from both temporary contextual effects and long-term priors. Temporary biases can be experimentally manipulated by changing the probability of one response over another, or through contextual recalibration (Summerfield and Egner, 2009; de Lange et al., 2018). The long-term priors comprise life-long learned and stable assumptions about the world, such as the sun shining from above (Sun and Perona, 1998). These priors may vary between individuals, but are stable for a given individual, and reflect idiosyncratic biases. These are often unknown to the experimenter and may be shadowed by experimental manipulations or regarded as interindividual noise eliminated during data analysis (Kanai and Rees, 2011; Wexler et al., 2015; Grabot and van Wassenhove, 2017; Rahnev and Denison, 2018; Lebovich et al., 2019). We here argue that such interindividual variability in temporary and idiosyncratic biases provides key perspectives on the neural mechanisms underlying perception. Particularly, we ask whether prestimulus oscillatory activity reflects the neural underpinnings of how such idiosyncratic biases affect perception, and if so, how these interact with those reflecting temporary biases.
The influence of prior expectations and knowledge on perceptual decisions is often thought to arise from high-level prefrontal and parietal regions, and is conveyed to sensory areas via top-down mechanism (Engel et al., 2001; Summerfield and Lange, 2014; de Lange et al., 2018). One neural signature supposedly reflecting these underlying processes is alpha band activity (van Kerkoerle et al., 2014; Mayer et al., 2016; Michalareas, et al., 2016; Sherman et al., 2016), generally known to be predictive of upcoming perceptual decisions (Ergenoglu et al., 2004; Hanslmayr et al., 2007; van Dijk et al., 2008; Mathewson et al., 2009). Recent studies have suggested that prestimulus alpha activity may reflect the criterion used to commit a specific response and may hence reflect a perceptual or decisional bias (Limbach and Corballis, 2016; Craddock et al., 2017; Iemi et al., 2017; Iemi and Busch, 2018; Rohe et al., 2019). Along such a role in perceptual decision-making, alpha activity was shown to correlate with subjective awareness (Lange et al., 2013; Benwell, et al., 2017; Gulbinaite et al., 2017) and decision confidence (Samaha et al., 2017; Wöstmann et al., 2019b). Still, it remains unclear whether prestimulus activity indeed reflects processes shaping an individual's intrinsic bias or processes facilitating veridical sensory encoding, as previous work did not unambiguously quantify the relation of spontaneous brain activity to idiosyncratic and temporary biases.
We have previously proposed the hypothesis that alpha band activity compensates for an individual's idiosyncratic bias: thereby low alpha power enhances the probability to respond against the bias, whereas high power increases the tendency to follow the bias (Grabot and van Wassenhove, 2017; Grabot et al., 2017). To directly test this hypothesis, we here used a temporal order judgment task, in which perception is shaped by idiosyncratic biases (Freeman et al., 2013; Grabot and van Wassenhove, 2017; Ipser et al., 2018) and can be manipulated by inducing temporary biases through temporal recalibration. Importantly, our paradigm was specifically designed to dissociate intrinsic biases from overall task performance. This allowed us to test whether prestimulus activity is predictive of the correctness or the degree of biasedness of a response, factors that were confounded in previous work. Our results confirm that a decrease in prestimulus alpha power enhances the probability to respond against the individual idiosyncratic bias and that interindividual fluctuations in alpha power correlate with the magnitude of this perceptual bias. Furthermore, by testing the influence of contextual recalibration (Fujisaki et al., 2004; Van der Burg et al., 2013) we show that this relation persists after temporal recalibration, suggesting that alpha power reflects both idiosyncratic and temporary biases.
Materials and Methods
Participants
Forty right-handed naive participants with normal or corrected-to-normal vision and normal hearing were tested in a first screening session (10 male, 30 female; mean ± SD age = 24 ± 3 years). Each provided written informed consent in accordance with the Declaration of Helsinki (World Medical Association, 2013), and the study was approved by the local ethics committee of Bielefeld University. The screening session was designed to collect a planned sample of 24 participants, balanced according to their preferred temporal order (see Results section), and with a negative JND1 and a positive JND2 (just noticeable difference; defined as in Fig. 1B). Twelve participants were excluded based on the screening data, including 10 whose JNDs fell outside the range of tested stimulus onset asynchronies (according to the criteria used by Spence et al., 2001), one whose JNDs were both negative, and one who did not complete the entire session. In total, 28 participants joined the EEG session, four of which had to be excluded because they had <20 trials in at least one condition. Thus, in the final analysis, we included 24 participants (7 male, 17 female; age = 24 ± 2 years mean ± SD).
Stimuli
The experiment was controlled using the Psychophysics Toolbox v3.0.14 (http://psychtoolbox.org/) and run using MATLAB vR2017a (MathWorks). The visual stimuli were white rings (outer diameter = 12°, inner diameter = 8°, 275 cd/m2) presented for 25 ms (3 frames) and centered on a gray LCD screen (refresh rate = 120 Hz, resolution = 1920× 1080 pixels, 16 cd/m2). Participants were asked to fixate a black cross presented in the middle of the screen during the whole experiment. Auditory stimuli were sine-wave tones (2 kHz) presented for 25 ms (including 5 ms fade-in and 5 ms fade-out) at a comfortable hearing level (73 dB). They were presented trough speakers placed behind each side of the monitor screen to ensure a perceived colocalization of sound and visual stimuli. The relative timing of auditory and visual stimuli was tested to be precise up to ± 3 ms using an oscilloscope and a photodiode.
Screening session
The experiment comprised a screening session and two EEG sessions based on a temporal order judgment (TOJ) task (Fig. 1A). The three sessions took place within ∼10 d (7 ± 6 d between the screening session and the first EEG session, and 3 ± 2 d between the 2 EEG sessions). Experiments took place in a darkened and electrically shielded room (Desone Ebox), where the participant sat at 90 cm distance from the screen.
The screening session aimed at estimating the temporal thresholds associated with judging the temporal order of a pair of audiovisual stimuli (Fig. 1A,B). The individual thresholds were then used as stimulus onset asynchrony (SOA) in the following EEG sessions, ensuring a similar ratio of Afirst and Vfirst responses. In the screening session, the audiovisual stimuli were separated by 12 different SOAs: ± 20, ± 50, ± 80, ± 110, ± 160, ± 250 ms. Negative values indicate that the sound was presented first.
The task was performed in three conditions: without recalibration (no), after sound-leading recalibration (A200V) and after visual-leading recalibration (V200A). In the no recalibration condition, participants were presented with a pair of audiovisual stimuli and had to judge which of the two came first, in a two-alternative forced choice, by pressing a key on a keyboard. The trials in A200V- and V200A- recalibration conditions were split into three blocks per condition. Each block consisted of an exposure phase and a test phase. During the exposure phase, 84 audiovisual pairs with an identical SOA of 200 ms were presented at ∼1 Hz (uniform distribution: 900–1100 ms). In A200V recalibration (respectively, V200A) blocks, 80 trials were audio-leading (respectively, visual-leading), whereas 4 deviant trials were visual-leading (resp. audio-leading). To enhance recalibration effects and to ensure that participants kept their attention focused they were asked to detect these deviant trials as fast as possible (Heron et al., 2010). The hit rate was on average 84 ± 10% and the false alarm rate was 1 ± 1% (mean ± SD). The exposure phase was immediately followed by a test phase. Top-up trials were used to maintain recalibration (Fujisaki et al., 2004; Vroomen et al., 2004). We used a minimum number of top-up trials sufficient to enhance recalibration effects (Cai et al., 2012) and tested two consecutive audiovisual pair at once. Three top-up trials were presented at ∼1 Hz (uniform distribution: 900–1100 ms). 700 ms after the last top-up trial, the black fixation cross turned green, indicating to the participant to judge the order of the two next pairs of AV stimuli.
For all conditions (no, A200V, V200A), intertrial interval delays were uniform between 900 and 1100 ms. In the screening session, each SOA was repeated 24 times per condition. The screening session consisted of no recalibration block, followed by three A200V recalibration and three V200A recalibration blocks, with randomized order. Participants were allowed to take a short break between blocks. Before the experiment, they were trained with 10 repetitions of maximal SOAs (±250 ms) for each recalibration condition and received feedback. Button mapping for responses was balanced between participants.
PSS and JNDs estimation
In the screening session, we determined the order bias [point of subjective simultaneity (PSS)] and the JNDs for each participant using the method of constant stimuli. For each recalibration condition (no, A200V, and V200A), the percentage of Vfirst responses from the screening session was determined as a function of SOA and fit using a psychometric curve described by a logistic function with three parameters: bias, slope and lapse rate (Spence and Squire, 2003; Mégevand et al., 2013). We chose a three-parameter model based on a piloting test (n = 6) which revealed a lower Bayesian information and Akaike information criterion for this model compared with two-parameter (bias and slope) or four-parameter (bias, slope, lapse rate for auditory-leading stimuli, lapse rate for visual-leading stimuli) models. Here, the goodness of fit (R2) was 90.2 ± 8.3% on average across participants (mean ± SD). The PSS, JND1, and JND2 were defined as the SOA for which a participant's performance was respectively at chance level (50), 30, and 70% (Fig. 1B) for each recalibration condition (no, A200V, and V200A). To obtain a balanced design between correctness and bias (Fig. 1D), it was necessary that each individual's JND1 was negative (sound-leading SOA), and each JND2 positive (visual-leading). To achieve this, we had to adjust the definition of JNDs for five participants (the JNDs performance ratios deviating from 30/70 for these participants were respectively: 23/70 in V200A condition; 30/78 in no condition, 30/87 in A200V condition, 30/78 in V200A condition; 30/93 in V200A condition; 30/95 in no condition, 30/82 in A200V condition, 30/90 in V200A condition; 30/92 in no condition, 30/75 in A200V condition).
EEG sessions
Each EEG session consisted of two no recalibration, four A200V recalibration and four V200A recalibration blocks. Here, we used the three pairs of JNDs derived from the screening session as SOAs, and each SOA was repeated 200 times per condition (hence featuring 2 stimulus conditions per recalibration condition). The ITI preceding test trials was randomly drawn from a uniform distribution between 1.5 and 1.7 s. Four catch trials (SOA = ± 250 ms) were introduced in each block (∼4% of the total number of trials) to test the involvement of the participants. Eighty-eight percent ± 7% (mean ± SD) of the catch trials were correctly detected. The no recalibration blocks were always presented first, followed by the eight recalibration blocks in a randomized order.
EEG acquisition and preprocessing
EEG signals were recorded using an active 128 channel Biosemi system, with additional four electrodes placed near the outer canthi and below the eyes to record the electro-occulogram. Electrode offsets were <25 mV.
Off-line preprocessing and analysis were performed with MATLAB R2017a (MathWorks) using the Fieldtrip toolbox (Oostenveld et al., 2011). The data were bandpass filtered between 0.2 and 90 Hz, resampled to 50 Hz and epoched from −1.5 s before the first stimulus onset to 1 s after. We performed an independent component analysis (ICA) and removed ICA components that reflect eye movement artefacts, localized muscle activity or poor electrode contacts (12 ± 6 rejected components per block, mean ± SD). These were identified following definitions provided in the literature (Hipp and Siegel, 2013; O'Beirne and Patuzzi, 1999). Furthermore, trials with amplitude exceeding 150 μV after 1 Hz high-passed filtering and trials with reaction times <200 ms were rejected. In total, 3 ± 5% of trials (mean ± SD) were rejected across all participants. The EEG signals were not re-referenced to facilitate the analysis of local alpha power and phase effects (Yao et al., 2005).
Logistic modeling of behavioral data
To quantify the influence of the current stimulus and the previous stimulus or previous response on single-trial responses, we used generalized linear models using a binomial distribution with a logit link function. The model parameters were estimated using maximum likelihood methods based on Laplace approximation for each participant. The outcome variable was the response of the current trial (respN: Afirst = 1, Vfirst = 0), the predictors were the physical stimulus of the current trial (stimN: Alead = 1, Vlead=−1), the physical stimulus of the previous trial (stimN-1: Alead = 1, Vlead=−1), and the response of the previous trial (respN-1: Afirst = 1, Vfirst=−1). All variables were treated as categorical variables. We first determined which behavioral model was explaining best the variance of the dataset by comparing Bayesian information criterion (BIC) after summing it across participants (Table 1).
Table 1.
Model | BIC |
---|---|
(1) respN = stimN | 1341 |
(2) respN = stimN + stimN-1 | 1115 |
(3) respN = stimN + respN-1 | 0 |
(4) respN = stimN + stimN-1 + respN-1 | 73 |
(5) respN = stimN + respN-1 + stimN*respN-1 | 39 |
(6) respN = stimN + respN-1 + stimN-1 + stimN*respN-1 | 112 |
(7) respN = stimN + respN-1 + stimN-1 + stimN_1*respN-1. | 202 |
(8) respN = stimN + respN-1 + stimN-1 + stimN*stimN-1 | 210 |
The table lists the group-averaged BIC differences from the best model (Model 3). The BIC were summed across participants.
Time-frequency analysis
We extracted the single-trial power in different frequency bands between −1.5 and 0.5 s around the first stimulus onset. To avoid any poststimulus contamination, each trial was windowed (with a function equal to zero after stimulus onset and equal to 1 before, with a 27.5 ms transition realized by a Hann window). The alpha power was obtained by using Morlet wavelets (10 Hz, 3.5 cycles, which gives a spectral bandwidth of 7.1–12.8 Hz and a temporal resolution of 350 ms) and log-transformed. We ensured that the individual α peak frequency (IAF) matched the chosen generic alpha band, by extracting the global IAF from the power spectrum density computed on a −1.5 to −0.1 s prestimulus time window. These ranged from 7.1 to 11.4 Hz (average ±SD = 9.8 ± 1.3 Hz, median = 10.0 Hz). We also extracted the power from theta (6 Hz, 3.5 cycles, spectral bandwidth = 4.3–7.7 Hz), low β (17 Hz, 5 cycles, spectral bandwidth = 13.6–20.4 Hz) and high β bands (25 Hz, 5 cycles, spectral bandwidth = 20-30 Hz).
To investigate whether prestimulus alpha power was predictive of response correctness or biasedness, the alpha power was z-scored for each participant using the average and standard deviation across all trials and time points between −600 and −200 ms for each sensor. We ignored the 200 ms just before stimulus onset, as this time period is affected (given the wavelet length) by the windowing procedure, and we aimed to reduce any post-stimulus influence on spectral estimates as much as possible. The trials were then split into two groups depending on the contrast of interest (correct vs incorrect response, matching-bias vs against-bias responses). On average across participants, there were 551 ± 71 trials in the correct condition, 228 ± 70 in the incorrect, 397 ± 72 in the matching-bias condition and 382 ± 61 in the against-bias condition (mean ± SD). For the correlation analyses with the PSS, we used the raw alpha power differences between Afirst and Vfirst responses without baseline or z-scoring to be able to compare absolute changes in α between participants.
Source reconstruction
We performed source reconstruction on the prestimulus alpha activity (−600 to −200 ms) using Dynamical Imaging of Coherent Sources (DICS) and re-referenced data (Gross et al., 2001). Cross-spectral density matrices were computed using multiple tapers in the alpha band (centered in 10 Hz, spectral smoothing of 3 Hz). We created a forward model by using a standard 3D source model with 6 mm dipole spacing and a MRI template from Fieldtrip, on which we manually aligned the 128-electrode array. We then computed the common inverse filter from all trials using DICS and applied this filter to each condition.
Phase analysis
We used the phase opposition sum (POS) index to determine whether the instantaneous prestimulus alpha phase was concentrated around a mean value statistically different between two conditions (VanRullen, 2016). For this, we equalized the number of trials for conditions of each contrast, leading to 228 ± 68 trials for the correctness contrast and 341 ± 45 for the biasedness contrast (mean ± SD across participants). We computed POS index, based on the intertrial coherence, for each condition, sensor and time point between −600 and −200 ms, as follows:
Statistical analyses
The power difference (−600 to −200 ms) between conditions was tested using a nonparametric cluster-based permutation procedure based on paired-sample t tests (Fig. 2A) using the following parameters: two-sided t test, α level for thresholding individual points at p = 0.05, minimal number of neighbors in a cluster of three, t statistics performed on the maximal sum across cluster, 4000 randomizations. The same procedure was used to assess the significance of the Pearson correlation.
The phase difference between conditions was statistically assessed using a permutation-based approach (VanRullen, 2016). For each participant, a surrogate distribution was built by randomly shuffling the trials label and recalculating the POS for each new shuffling (number of repetitions: 1000). Then, a group-level surrogate distribution was built by randomly picking a POS sample for each participant and averaging the samples across participants (number of repetitions: 100,000). Last, a cluster-based permutation procedure was used to compare the empirical POS values to the group-level surrogate distribution (cluster threshold corresponding to the two-sided 95th percentile), ensuring a correction for the multiple-comparison problem.
We computed the Bayes factor for paired t tests and Pearson correlation using the bayesFactor toolbox in MATLAB and the BayesFactor package with R (v3.5.3), and interpreted the Bayes factor following Jarosz and Wiley (2014).
Results
Temporary and idiosyncratic biases in time perception
The participants' task was to judge which of two stimuli in an audiovisual pair of asynchronous stimuli was presented first. In an initial screening session, we determined the idiosyncratic bias of each participant. If a participant exhibited the tendency (across a set of balanced stimulus-onset asynchronies) to perceive the flash first more often, we would deem the flash-first response (Vfirst) as matching this individual's bias (matching-bias) and the sound-first response (Afirst) as against-bias (Fig. 1B). We computed the PSS as a proxy for an individual's bias (Grabot and van Wassenhove, 2017) and the JNDs for each individual and condition (Fig. 1B). In a planned sample, 12 participants were biased toward Vfirst responses (negative PSS, mean ± SD = −44 ± 46 ms) and 12 were biased toward Afirst responses (positive PSS, mean ± SD = 38 ± 31 ms).
To induce a temporary bias, we tested participants' perception after prolonged exposure to constant audio-leading or visual-leading delays of 200 ms (A200V and V200A conditions). As expected, recalibration significantly changed the perceived simultaneity (Table 2). A repeated-measure one-way ANOVA showed that there was a significant effect of recalibration on PSS (F(2,23) = 3.48, p = 0.039, η2p = 0.67; Fig. 2A). A post hoc t test revealed that the PSS after A200V recalibration significantly decreased compared with V200A recalibration [t(23) = −2.51, p = 0.019, CI95 = (−23, −2) ms, effect size = 12 ms, BF = 2.80]. In addition, the PSS significantly differed between the A200V and no recalibration conditions [t(23) = −2.34, p = 0.028, CI95 = (−29, −2) ms, effect size = 16 ms, BF = 2.04], but not between the V200A and no recalibration conditions [t(23) = −0.45, p = 0.657, CI95 = (−17, 11) ms, effect size = 3 ms, BF = 0.23].
Table 2.
Condition | No | A200V | V200A |
---|---|---|---|
PSS, ms | −3 ± 57 | −17 ± 41 | −6 ± 41 |
JND1, ms | −83 ± 54 | −85 ± 57 | −70 ± 54 |
JND2, ms | +77 ± 75 | +48 ± 46 | +58 ± 63 |
Recalibration also induced a change in perceptual sensitivity, as measured by the difference between JND1 and JND2 (denoted ΔJND). A repeated-measure one-way ANOVA showed that there was a significant effect of recalibration (F(2,23) = 3.85, p = 0.028). A post hoc t test revealed that the ΔJND during no recalibrationdiffered significantly from the A200V [t(23) = −2.30, p = 0.031, CI95 = (−54, −3) ms, effect size = 28 ms, BF = 1.90] and V200A conditions [t(23) = −2.22, p = 0.037, CI95 = (−63, −2) ms, effect size = 32 ms, BF = 1.66], showing that the temporal order judgements became less sensitive after recalibration.
Behavioral results from the EEG sessions
The same participants then performed the same temporal order judgment task while EEG was recorded. Here, we used only two audiovisual SOAs as stimuli per condition (no, A200V, and V200A conditions) defined as the individual JND1/2 extracted for each individual from the screening session. The behavioral data confirmed that the selection of JNDs for the EEG experiment was appropriate and resulted in the expected percentage of Vfirst responses (30% for JND1 and 70% for JND2; Fig. 2B): a one-sample t test indicated that the difference between the actual percentage of Vfirst responses and the a priori percentage was not statistically different [t(143) = 1.23, CI95 = (−0.009, 0.038), p = 0.220, BF = 0.19]. Using a sound-leading (JND1) and a flash-leading (JND2) delay for each individual allowed us to orthogonalize the correctness and the biasedness of the responses while ensuring a sufficient number of trials per response (Fig. 1D). Because our population was composed of 12 participants favoring flash-first responses and 12 participants favoring sound-first responses, the correctness and the biasedness of the responses are also orthogonal to the responses (Afirst, Vfirst).
Alpha activity reflects processes that help to overcome an idiosyncratic bias
Given the presumed role of prestimulus alpha band activity in shaping subsequent perceptual responses, we quantified the relation between alpha activity and the idiosyncratic biases. To investigate whether alpha power predicted the correctness or biasedness of a subsequent response, we extracted alpha power from −600 to −200 ms before the onset of the first stimulus in no recalibration condition and entered this into a 2 × 2 ANOVA combined with aspatiotemporal cluster-based permutation test (Fig. 3A). Importantly, the contrasts for correctness and biasedness were orthogonal given the experimental design and were controlled for the physical order of stimuli presentation. We found a significant positive cluster for biasedness over left fronto-central sensors (−598 to −438 ms, cluster-value = 291.50, p = 0.044), suggesting that an increase in alpha power predicts a matching-bias response (Fig. 3A, right). No effect (even at a reduced p < 0.15) was found for correctness, nor was there any significant interaction. A Bayesian analysis revealed that there is positive or substantial evidence that alpha power averaged across the left frontal cluster does not differ between correct and incorrect response (BF = 0.21), that there is no interaction effect (BF = 0.27), and confirmed decisive evidence for an effect of biasedness (BF = 112).
To localize the neural generators underlying the effect of biasedness, we performed a source reconstruction on prestimulus alpha activity and contrasted matching-bias and against-bias responses. This revealed a cluster in left temporo-frontal areas, consistent with the left frontal topography (Fig. 3B). The center of mass of this cluster (at an uncorrected p < 0.05) was located in the left rolandic operculum (MNI coordinates: −60, + 5, +6, corresponding to Brodmann area 44). Based on the AAL atlas, this cluster comprised prominent parts of the left frontal inferior operculum, rolandic operculum and temporal superior area, with 64% of the grid points contained in the cluster falling in left frontal areas, 27% in left temporal areas, and 9% in the left postcentral area and the insula (Fig. 3B).
If prestimulus alpha band activity indeed reflects processes that help to overcome an idiosyncratic bias, the difference in power between responses (Afirst and Vfirst) should not only show a general association with biasedness but should also scale in proportion to the strength of the individual bias, hence the magnitude of the individual PSS. To test this, we computed a Pearson correlation between the difference in prestimulus alpha power (Afirst-Vfirst) and the individual PSS extracted from the no recalibration condition (Fig. 3C). This revealed a significant cluster over left fronto-central sensors (−598 to −438 ms, cluster value = 436.09, p = 0.037), the location of which was consistent with the results from the ANOVA above. Within this cluster, the correlation coefficient between the alpha power difference and the PSSs was R = 0.61 [bootstrap-based CI95% = (0.27, 0.82), BF = 11; Fig. 3C]. As a control, we also tested within the same cluster whether the alpha power difference between correct and incorrect response correlated with the PSS, and found no evidence for a significant correlation (R = −0.04, p = 0.864, BF = 0.16).
We explored whether this result was specific to the alpha band by repeating the above analysis for the theta, low β and high β bands. No significant clusters were found for biasedness in any of these bands (Fig. 4). However, high beta band activity was related to correctness (−298 to −218 ms, cluster-value = −395.21, p = 0.002), with decreased beta power in occipital central electrodes predicting a correct response. To investigate the amount of evidence in favor of the null hypothesis, we calculated a Bayes factor for a paired t test at each sensor and time point. 67.5, 75.4, and 70.5% of the data points in the theta, low β and high β bands respectively showed positive and substantial evidence for the null hypothesis (BF < 1/3), whereas only 1.2, 0.8, and 1.3% of the data point in the same bands showed positive and substantial evidence (BF > 3) for a difference in biasedness (Table 3). Given the large number of data points tested, we consider these few 'significant' data points as false-positives, because their number does not exceed a threshold at α = 0.05. On the contrary, >5% of the data points in the high beta band showed positive and substantial evidence for a difference in correctness, in line with the significant cluster found.
Table 3.
Theta, % | Low beta, % | High beta, % | |
---|---|---|---|
Correctness | |||
BF > 3 | 2.2 | 2.9 | 5.4 |
BF < 1/3 | 69.1 | 60.2 | 57.5 |
Biasedness | |||
BF > 3 | 1.2 | 0.8 | 1.3 |
BF < 1/3 | 67.5 | 75.4 | 70.5 |
Occurrence of (sensors, time point) couple with BF > 3, denoting a positive and substantial evidence for a difference between conditions (correct vs incorrect or matching-bias vs against-bias) and BF < 1/3, denoting a positive and substantial evidence for the null hypothesis (no difference).
We also investigated whether the phase of alpha activity was predictive of whether the following response was correct or biased, because previous studies suggested a link between alpha phase, detection performance and prior expectation (Busch et al., 2009; Sherman et al., 2016). A nonparametrical permutation-based procedure on the POS index (VanRullen, 2016) revealed no significant effects for correctness or biasedness (Fig. 3D).
Prestimulus α reflects both idiosyncratic and temporary biases
Next, we investigated the interplay between the idiosyncratic bias and the temporary biases induced by recalibration. If alpha activity is reflective of neural processes that are affected by both types of biases, we would expect that the relationship between alpha power and the biasedness of responses would remain the same across recalibration conditions. If, however, α indexes only an idiosyncratic bias, we would expect that the explanatory power differs between recalibration conditions, because the influence of any long-term biases is shadowed by the temporary influence of recalibration. To address this, we focused on the cluster (i.e., electrodes and time points) that showed a significant α effect both for the ANOVA contrast and the correlation analysis in the no recalibration condition (−598 to −438 ms, 19 electrodes; Fig. 3A,C).
To quantify whether alpha power is predictive of either the original idiosyncratic bias, or a updated bias emerging from recalibration, we split trials from A200V and V200A conditions (1) according to correctness and biasedness relative to the recalibrated biases (PSSA200V and PSSV200A), or (2) relative to the original idiosyncratic bias (PSSno). We then entered these alpha power values into a linear mixed-effect model with the factors correctness, biasedness, their interaction, and participants as a random effect (Fig. 5A). When using the adapted PSSs, α was significantly related to biasedness (χ2(1) = 4.90, p = 0.027, BF = 2.06), but not to correctness (χ2(1) = 0.13, p = 0.715, BF = 0.22), and the interaction was not significant (χ2(1) = 1.06, p = 0.303, BF = 0.20). When using the non-adapted PSS, no factors were significant (biasedness: χ2(1) = 0.26, p = 0.611, BF = 0.24; correctness: χ2(1) = 0.13, p = 0.720, BF = 0.23; interaction: χ2(1) = 0.43, p = 0.509, BF = 0.02). Furthermore, a model comparison based on a likelihood ratio test showed that the model using the adapted PSSs (LL = 96.1) was explaining significantly more variance than the non-adapted model (LL = 94.5, χ2 = 2.76, p < 10−3). An estimated Bayes factor suggested that the model with the adapted PSSs was 10 times more likely to occur than the model with the PSSno. These results suggest that prestimulus alpha power predicts whether a subsequent response will follow or not the momentary and contextually adapted bias.
Trial-by-trial dependencies
Temporal recalibration is not only observed after prolonged exposure but can also emerge on a trial-by-trial basis (Van der Burg et al., 2013, 2015). We investigated whether and how the previous trial influenced the alpha band activity before the subsequent trial and contributed to the behavioral response in the subsequent trial. First, we asked whether the previous stimulus (stimN-1) or the previous response (respN-1) significantly influenced the subsequent response (respN), by comparing the ability of distinct linear models based on different combinations of these predictors to predict the subsequent response (Table 1). The model providing the most parsimonious account of the data (according to the group-level BIC criterion) was the model with stimN and respN-1 as predictors (BIC = 43 848; Table 1). The model estimates and t values averaged across participants were as follows: β(intercept) = −0.97 ± 0.84, p < 0.05 for 21/24 participants; β(stimN = Alead) = 1.63 ± 0.76, p < 0.05 for 23/24 participants; β(respN-1 = Afirst) = 0.06 ± 0.97, p < 0.05 for 20/24 participants; df = 1 546 ± 70 (mean ± SD; Fig. 5B). Because a previous study has suggested that trial-by-trial temporal recalibration is driven by the previous stimulus rather than the previous response (Van der Burg et al., 2018), we implemented a second analysis to better contrast the influence of stimN-1 and respN-1. For this, we removed the natural correlation between these two predictors by equalizing, for each participant, the number of trials between responses (Afirst or Vfirst) for a given previous stimulus (Alead or Vlead), and recomputed the linear model with these predictors. Still, stimN-1 was a significant predictor for only 6 of 24 participants (β= −0.143 ± 0.285, t = −0.801 ± 1.529, p < 0.05 for 6 participants), whereas respN-1 was significant for most participants(β = 0.157 ± 0.962, t = 1.062 ± 5.945, p < 0.05 for 21 participants; df = 947 ± 203; mean ± SD). Hence in the present data, subsequent responses are more tied to the previous response than the previous stimulus.
We then asked whether the alpha activity before the subsequent trial was related to the stimuli or behavior in the previous trial (Fig. 5C). We sorted trials according to either the stimulus order (Alead vs. Vlead), the response (Afirst vs. Vfirst), and the biasedness (matching-bias vs. against-bias) of the previous trial. A spatiotemporal cluster-based permutation test revealed no significant effects. In particular, for biasedness, one cluster over frontal electrodes did not pass the significance threshold at 0.05 (p = 0.111; −498 to −418 ms; Bayesian analysis: 57.5% of the data points with BF < 1/3, 0.7% with BF > 3), suggesting that the previous stimuli or responses did not influence the prestimulus alpha activity for the subsequent trial.
Using additional analyses we further ruled out that α mediates, or modulates, the influence of the response in the previous trial on the current trial: a mediation analysis on alpha power from the left frontal cluster, revealed no significant mediation (path from respN-1 to the alpha power: a = 0.022, p = 0.051; path from the alpha power to the respN: b = 0.05, p =0.031; mediation term: ab = 5.2e-5, p = 0.424). Further, logistic modeling of the subsequent response revealed no interaction between α and the previous response (β(intercept) = −0.01 ± 0.53, p < 0.05 for 20/24 subj; β(respN-1 = Alead) = 0.07 ± 0.78, p < 0.05 for 20/24 subj; β(α) = 0.04 ± 0.07, p < 0.05 for 2/24 subj, β(α*respN-1) = −0.04 ± 0.12, p < 0.05 for 3/24 subj; df= 1 546 ± 70; mean ± SD).
Discussion
Idiosyncratic biases are ubiquitous in human behavior but are often ignored in experimental work (Matthews and Meck, 2014; Ipser et al., 2017; Kosovicheva and Whitney, 2017). Their origin remains unknown but the persistency of these biases over time suggests that they arise from structural or functional characteristics of an individual's brain (Kanai and Rees, 2011). Indeed, previous work has speculated about the relation of such biases with interindividual differences in genotypes, neurotransmitters levels, brain structure or signatures of spontaneous brain activity (Kanai and Rees, 2011; Mennes et al., 2011; Kleinschmidt et al., 2012; Romei et al., 2013; Haegens et al., 2014; Matthews and Meck, 2014; Chechlacz et al., 2015; Marshall et al., 2015).
We here focus on a prevailing signature of spontaneous brain activity, alpha band oscillations, and tested the previously speculated hypothesis that alpha band activity relates to the degree of how biased an individual response is (Grabot et al., 2017). Our results show that a decrease in frontal prestimulus alpha power is associated with an increased chance that the subsequent response will go against an idiosyncratic bias, but is not predictive of whether the response will be correct. Further, the stronger an individual idiosyncratic bias, the more alpha power will differentiate between responses that match and mismatch the bias. Importantly, this relation also holds after temporal recalibration, a manipulation that affects contextual short-term biases in perception. Finally, we found that this relation is specific to the alpha band. Hence, our results show that frontal prestimulus alpha band activity indexes processes that help to overcome an individual's momentary, rather than only a stable and long-term, bias.
A mechanistic role of alpha power
Previous studies have dissociated two patterns of alpha activity typically described in relation to perception: a frontal α involved in cognitive control, and a parieto-occipital α involved in spatial perception (Noonan et al., 2016; Sadaghiani and Kleinschmidt, 2016; Wöstmann et al., 2019a). We suggest that the alpha activity observed here is part of a frontal network and discuss its function in relation to perceptual decisions within this framework.
Parieto-occipital α is usually observed in studies on spatial attention, which show that lateralized changes in alpha power are predictive of subsequent target detection performance (Sauseng et al., 2005; Thut et al., 2006; Romei et al., 2010). Recent studies tried to define the point of action of alpha activity in the framework of signal detection theory (Iemi et al., 2017; Iemi and Busch, 2018). These suggest that α reflects an additive mechanism affecting sensory encoding more than the decision process (Limbach and Corballis, 2016; Iemi et al., 2017), and relates more to subjective awareness and confidence than perceptual accuracy (Samaha et al., 2017; Wöstmann et al., 2019a; Iemi and Busch, 2018). Given that alpha power correlates with sensory neural firing rates (Klimesch et al., 2007; Jensen and Mazaheri, 2010; Haegens et al., 2011; Klimesch, 2012), alpha power can be interpreted as reflecting the overall excitability in those regions encoding the sensory information. Our experiment was designed to dissociate a response bias from performance and does not allow an unambiguous interpretation in the framework of signal detection theory. However, the prominent localization of α effects over frontal sites found here is rather suggestive of an origin that is distinct from this parietal α.
Frontal α has been linked to cognitive control and the selection of task-relevant information (Sauseng et al., 2005; Sadaghiani and Kleinschmidt, 2016; Wöstmann et al., 2019a). Thereby, frontal α may affect decision-making independently of the sensory evidence, for example, by adding a fixed proportional probability to choose one response over the other. In that case, the response bias could change without changing the overall fraction of correct responses. Still, at a mechanistic level this frontal origin and its functional interpretation can be linked to an understanding of the possibly multiple roles of alpha band activity in perception: in a complete sensory-decision cascade, parietal α may affect early sensory encoding (Lou et al., 2014; Iemi et al., 2017), whereas frontal α may affect the selection of a specific response independently of the outcome of the preceding sensory computation.
In terms of the underlying neurobiological correlates, idiosyncratic biases have been suggested to arise from individual variability in specific structural brain features or functional connectivity (Freeman, et al., 2013; Grabot and van Wassenhove, 2017; Ipser et al., 2018). These structuro-functional differences may have been shaped by developmental experience, hence introducing individual differences in the sensory decision-making process. Similarly, cognitive control rests on consistent rules learned from past experience (Miller, 2000). One could therefore speculate that changes in frontal α reflect the degree to which such structuro-functional imbalances shape behavior and are reflective of how cognitive control impacts perceptual reports. How precisely frontal alpha band activity affects the degree of biasedness of perceptual reports remains to be investigated, similar as the direct links between alpha band activity and structuro-functional connectivity, and how these relate to cognitive control.
Decreased beta power predicts correct responses
We found that decreased beta power (20–30 Hz) was predictive of correct responses. This fits with results obtained using similar audiovisual simultaneity judgment tasks and with several studies relating β decrease to a better sensory encoding (Griffiths et al., 2019) and β increase to illusory (hence incorrect) perception (for review, see Keil and Senkowski, 2018; Kaiser et al., 2019). However, one study reported an opposite relationship between accuracy and beta power in a spatial auditory task (Bernasconi et al., 2011), calling for more systematic studies on how the nature of stimuli and task influence the neural generators of relevant beta activity and its influence on performance.
The apparent asymmetry of temporal recalibration
We found no significant effect of VA recalibration on participants' PSS. This is in contrast to AV recalibration, which significantly reduced the PSS. Such an asymmetry between AV and VA recalibration has been observed consistently in multiple studies (Fujisaki et al., 2004; Vroomen et al., 2004; Ikumi and Soto-Faraco, 2014; Kösem et al., 2014), yet a clear explanation remains missing. One possibility is that in everyday life we are mainly confronted with VA asynchronies, as light travels faster than sound and for many actions the visual movement precedes any produced sound. The consistency of this observation across studies suggests that our brain may indeed be differentially sensitive to AV and VA adaptation, in the same way that integrating audiovisual events leads to an asymmetric temporal binding window (van Wassenhove et al., 2007; Stevenson et al., 2012).
Distinct mechanisms mediating prolonged and single-trial recalibration
The neural correlates of temporal recalibration are still poorly understood (Stekelenburg et al., 2011; Kösem et al., 2014; Simon et al., 2017, 2018). We found that prestimulus alpha activitypredicts the degree of biasedness to perception after prolonged temporal recalibration, but does not mediate trial-by-trial recalibration, i.e., the influence of a previous response on behavior (Van der Burg et al., 2013). This suggests that distinct mechanisms underlie prolonged and single-trial recalibration, a conclusion supported by psychophysical experiments in the temporal (Van der Burg et al., 2015) and the spatial domains (Bruns and Röder, 2015, 2019; Watson et al., 2019). A role of alpha activity in reflecting an individual's overall perceptual tendency without interacting with trial-by-trial dependencies is also supported by a recent study on multisensory integration (Rohe et al., 2019). Assuming that α reflects the influence of cognitive control, the dissociation of alpha activity and trial-by-trial recalibration could reflect the need to strike a balance between the sustainability of a temporally consistent internal state, and the flexibility required to cope with dynamic environments. Frontal alpha activity would help sustaining internal states in line with long-term experience without interfering with other trial-by-trial adaptive mechanisms that also shape perception.
Alternatively, the perceptual dependencies often described as single-trial recalibration may in fact not be a genuine recalibration effect but reflect a bias to repeat a previous response in consecutive trials (Keane et al., 2019; Roseboom, 2019). Our data revealed a significant choice-repetition bias, which is inconsistent with a recalibration effect (exposing participants to audio-leading stimuli would increase their tendency for Vfirst responses). However, because a genuine recalibration effect can be observed when one controls for choice-repetition biases (Keane et al., 2019), further work is needed to determine the neural mechanisms underlying single-trial temporal recalibration. In the spatial domain one study recently suggested that recalibration induced by discrepant multisensory information arises from medial parietal brain regions involved in episodic and spatial memory (Park and Kayser, 2019), suggesting that in the spatial domain single-trial and long-term recalibration emerge from distinct neural structures (Bruns and Röder, 2010; Bruns et al., 2011; Bosen et al., 2017). Still, further studies are required to directly compare the neural mechanisms underlying different time scales of adaptive behavior within and across different domains of sensory information.
Footnotes
This work was supported by the European Research Council (ERC-2014-CoG to C.K.; Grant 646657).
The authors declare no competing financial interests.
References
- Bernasconi F, Manuel AL, Murray MM, Spierer L (2011) Pre-stimulus beta oscillations within left posterior sylvian regions impact auditory temporal order judgment accuracy. Int J Psychophysiol 79:244–248. [DOI] [PubMed] [Google Scholar]
- Benwell CS, Tagliabue CF, Veniero D, Cecere R, Savazzi S, Thut G (2017) Prestimulus EEG power predicts conscious awareness but not objective visual performance. eNeuro 4:ENEURO.0182-17.2017 10.1523/ENEURO.0182-17.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bosen AK, Fleming JT, Allen PD, O'Neill WE, Paige GD (2017) Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities. Exp Brain Res 235:585–595. 10.1007/s00221-016-4820-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruns P, Röder B (2010) Tactile capture of auditory localization: an event-related potential study. Eur J Neurosci 31:1844–1857. 10.1111/j.1460-9568.2010.07232.x [DOI] [PubMed] [Google Scholar]
- Bruns P, Röder B (2015) Sensory recalibration integrates information from the immediate and the cumulative past. Sci Rep 5:12739. 10.1038/srep12739 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruns P, Röder B (2019) Spatial and frequency specificity of the ventriloquism aftereffect revisited. Psychol Res 83:1400–1415. 10.1007/s00426-017-0965-4 [DOI] [PubMed] [Google Scholar]
- Bruns P, Spence C, Röder B (2011) Tactile recalibration of auditory spatial representations. Exp Brain Res 209:333–344. 10.1007/s00221-011-2543-0 [DOI] [PubMed] [Google Scholar]
- Busch NA, Dubois J, VanRullen R (2009) The phase of ongoing EEG oscillations predicts visual perception. J Neurosci 29:7869–7876. 10.1523/JNEUROSCI.0113-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cai M, Stetson C, Eagleman DM (2012) A neural model for temporal order judgments and their active recalibration: a common mechanism for space and time? Front Psychol 3:1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chechlacz M, Gillebert CR, Vangkilde SA, Petersen A, Humphreys GW (2015) Structural variability within frontoparietal networks and individual differences in attentional functions: an approach using the theory of visual attention. J Neurosci 35:10647–10658. 10.1523/JNEUROSCI.0210-15.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Craddock M, Poliakoff E, El-deredy W, Klepousniotou E, Lloyd DM (2017) Pre-stimulus alpha oscillations over somatosensory cortex predict tactile misperceptions. Neuropsychologia 96:9–18. 10.1016/j.neuropsychologia.2016.12.030 [DOI] [PubMed] [Google Scholar]
- de Lange FP, Heilbron M, Kok P (2018) How do expectations shape perception? Trends Cogn Sci 22:764–779. 10.1016/j.tics.2018.06.002 [DOI] [PubMed] [Google Scholar]
- Engel AK, Fries P, Singer W (2001) Dynamic prediction: oscillations and synchrony in top-down processing. Nat Rev Neurosci 2:704–716. 10.1038/35094565 [DOI] [PubMed] [Google Scholar]
- Ergenoglu T, Demiralp T, Bayraktaroglu Z, Ergen M, Beydagi H, Uresin Y (2004) Alpha rhythm of the EEG modulates visual detection performance in humans. Brain Res Cogn Brain Res 20:376–383. 10.1016/j.cogbrainres.2004.03.009 [DOI] [PubMed] [Google Scholar]
- Freeman ED, Ipser A, Palmbaha A, Paunoiu D, Brown P, Lambert C, Leff A, Driver J (2013) Sight and sound out of synch: fragmentation and renormalisation of audiovisual integration and subjective timing. Cortex 49:2875–2887. 10.1016/j.cortex.2013.03.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fujisaki W, Shimojo S, Kashino M, Nishida S (2004) Recalibration of audiovisual simultaneity. Nat Neurosci 7:773–778. 10.1038/nn1268 [DOI] [PubMed] [Google Scholar]
- Grabot L, van Wassenhove V (2017) Time order as psychological bias. Psychol Sci 28:670–678. 10.1177/0956797616689369 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grabot L, Kösem A, Azizi L, van Wassenhove V (2017) Prestimulus alpha oscillations and the temporal sequencing of audiovisual events. J Cogn Neurosci 29:1566–1582. 10.1162/jocn_a_01145 [DOI] [PubMed] [Google Scholar]
- Griffiths BJ, Mayhew SD, Mullinger KJ, Jorge J, Charest I, Wimber M, Hanslmayr S (2019) Alpha/beta power decreases track the fidelity of stimulus-specific information. eLife 8:e49562 10.7554/eLife.49562 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gross J, Kujala J, Hämäläinen M, Timmermann L, Schnitzler A, Salmelin R (2001) Dynamic imaging of coherent sources: studying neural interactions in the human brain. Proc Natl Acad Sci U S A 98:694–699. 10.1073/pnas.98.2.694 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gulbinaite R, İlhan B, VanRullen R (2017) The triple-flash illusion reveals a driving role of alpha-band reverberations in visual perception. J Neurosci 37:7219–7230. 10.1523/JNEUROSCI.3929-16.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haegens S, Cousijn H, Wallis G, Harrison PJ, Nobre AC (2014) Inter- and intra-individual variability in alpha peak frequency. Neuroimage 92:46–55. 10.1016/j.neuroimage.2014.01.049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haegens S, Nácher V, Luna R, Romo R, Jensen O (2011) α-Oscillations in the monkey sensorimotor network influence discrimination performance by rhythmical inhibition of neuronal spiking. Proc Natl Acad Sci U S A 108:19377–19382. 10.1073/pnas.1117190108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanslmayr S, Aslan A, Staudigl T, Klimesch W, Herrmann CS, Bäuml KH (2007) Prestimulus oscillations predict visual perception performance between and within subjects. Neuroimage 37:1465–1473. 10.1016/j.neuroimage.2007.07.011 [DOI] [PubMed] [Google Scholar]
- Heron J, Roach NW, Whitaker D, Hanson JV (2010) Attention regulates the plasticity of multisensory timing. Eur J Neurosci 31:1755–1762. 10.1111/j.1460-9568.2010.07194.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hipp JF, Siegel M (2013) Dissociating neuronal gamma-band activity from cranial and ocular muscle activity in EEG. Front Hum Neurosci 7:338. 10.3389/fnhum.2013.00338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Iemi L, Busch NA (2018) Moment-to-moment fluctuations in neuronal excitability bias subjective perception rather than strategic decision-making. eNeuro 5:ENEURO.0430-17.2018 10.1523/ENEURO.0430-17.2018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Iemi L, Chaumon M, Crouzet SM, Busch NA (2017) Spontaneous neural oscillations bias perception by modulating baseline excitability. J Neurosci 37:807–819. 10.1523/JNEUROSCI.1432-16.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ikumi N, Soto-Faraco S (2014) Selective attention modulates the direction of audio-visual temporal recalibration. PLoS BiolS One 9:e99311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ipser A, Agolli V, Bajraktari A, Al-Alawi F, Djaafara N, Freeman ED (2017) Sight and sound persistently out of synch: stable individual differences in audiovisual synchronisation revealed by implicit measures of lip-voice integration. Sci Rep 7:46413. 10.1038/srep46413 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ipser A, Karlinski M, Freeman ED (2018) Correlation of individual differences in audiovisual asynchrony across stimuli and tasks: new constraints on Temporal Renormalization theory. J Exp Psychol Hum Percept Perform 44:1283–1293. 10.1037/xhp0000535 [DOI] [PubMed] [Google Scholar]
- Jarosz AF, Wiley J (2014) What are the odds? A practical guide to computing and reporting Bayes factors. J Probl Solving 7:2 10.7771/1932-6246.1167 [DOI] [Google Scholar]
- Jensen O, Mazaheri A (2010) Shaping functional architecture by oscillatory alpha activity: gating by inhibition. Front Hum Neurosci 4:186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaiser M, Senkowski D, Busch NA, Balz J, Keil J (2019) Single trial prestimulus oscillations predict perception of the sound-induced flash illusion. Sci Rep 9:5983. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kanai R, Rees G (2011) The structural basis of inter-individual differences in human behaviour and cognition. Nat Rev Neurosci 12:231–242. 10.1038/nrn3000 [DOI] [PubMed] [Google Scholar]
- Keane B, Bland NS, Matthews N, Carroll TJ, Wallis G (2019) Rapid recalibration of temporal order judgements: response bias accounts for contradictory results. Eur J Neurosci. Advance online publication. Retrieved August 20, 2019. doi: 10.1111/ejn.14551 10.1111/ejn.14551 [DOI] [PubMed] [Google Scholar]
- Keil J, Senkowski D (2018) Neural Oscillations Orchestrate Multisensory Processing. The Neuroscientist 24:609–626. [DOI] [PubMed] [Google Scholar]
- Kleinschmidt A, Sterzer P, Rees G (2012) Variability of perceptual multistability: from brain state to individual trait. Philos Trans R Soc Lond B Biol Sci 367:988–1000. 10.1098/rstb.2011.0367 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klimesch W. (2012) α-Band oscillations, attention, and controlled access to stored information. Trends Cogn Sci 16:606–617. 10.1016/j.tics.2012.10.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klimesch W, Sauseng P, Hanslmayr S (2007) EEG alpha oscillations: the inhibition-timing hypothesis. Brain Res Rev 53:63–88. 10.1016/j.brainresrev.2006.06.003 [DOI] [PubMed] [Google Scholar]
- Kösem A, Gramfort A, van Wassenhove V (2014) Encoding of event timing in the phase of neural oscillations. Neuroimage 92:274–284. 10.1016/j.neuroimage.2014.02.010 [DOI] [PubMed] [Google Scholar]
- Kosovicheva A, Whitney D (2017) Stable individual signatures in object localization. Curr Biol 27:R700–R701. 10.1016/j.cub.2017.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lange J, Oostenveld R, Fries P (2013) Reduced occipital alpha power indexes enhanced excitability rather than improved visual perception. J Neurosci 33:3212–3220. 10.1523/JNEUROSCI.3755-12.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lebovich L, Darshan R, Lavi Y, Hansel D, Loewenstein Y (2019) Idiosyncratic choice bias naturally emerges from intrinsic stochasticity in neuronal dynamics. Nat Hum Behav 3:1190–1202. [DOI] [PubMed] [Google Scholar]
- Limbach K, Corballis PM (2016) Prestimulus alpha power influences response criterion in a detection task. Psychophysiology 53:1154–1164. 10.1111/psyp.12666 [DOI] [PubMed] [Google Scholar]
- Lou B, Li Y, Philiastides MG, Sajda P (2014) Prestimulus alpha power predicts fidelity of sensory encoding in perceptual decision making. Neuroimage 87:242–251. 10.1016/j.neuroimage.2013.10.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marshall TR, Bergmann TO, Jensen O (2015) Frontoparietal structural connectivity mediates the top-down control of neuronal synchronization associated with selective attention. PLoS Biol 13:e1002272 10.1371/journal.pbio.1002272 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mathewson KE, Gratton G, Fabiani M, Beck DM, Ro T (2009) To see or not to see: prestimulus alpha phase predicts visual awareness. J Neurosci 29:2725–2732. 10.1523/JNEUROSCI.3963-08.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Matthews WJ, Meck WH (2014) Time perception: the bad news and the good. Wiley Interdiscip Rev Cogn Sci 5:429–446. 10.1002/wcs.1298 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mayer A, Schwiedrzik CM, Wibral M, Singer W, Melloni L (2016) Expecting to see a letter: alpha oscillations as carriers of top-down sensory predictions. Cereb Cortex 26:3146–3160. 10.1093/cercor/bhv146 [DOI] [PubMed] [Google Scholar]
- Mégevand P, Molholm S, Nayak A, Foxe JJ (2013) Recalibration of the multisensory temporal window of integration results from changing task demands. PLoS One 8:e71608. 10.1371/journal.pone.0071608 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mennes M, Zuo XN, Kelly C, Di Martino A, Zang YF, Biswal B, Castellanos FX, Milham MP (2011) Linking inter-individual differences in neural activation and behavior to intrinsic brain dynamics. Neuroimage 54:2950–2959. 10.1016/j.neuroimage.2010.10.046 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Michalareas G, Vezoli J, van Pelt S, Schoffelen JM, Kennedy H, Fries P (2016) Alpha-beta and gamma rhythms subserve feedback and feedforward influences among human visual cortical areas. Neuron 89:384–397. 10.1016/j.neuron.2015.12.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller EK. (2000) The prefontral cortex and cognitive control. Nat Rev Neurosci 1:59–65. 10.1038/35036228 [DOI] [PubMed] [Google Scholar]
- Noonan MP, Adamian N, Pike A, Printzlau F, Crittenden BM, Stokes MG (2016) Distinct Mechanisms for Distractor Suppression and Target Facilitation. J Neurosci 36:1797–1807. [DOI] [PMC free article] [PubMed] [Google Scholar]
- O'Beirne GA, Patuzzi RB (1999) Basic properties of the sound-evoked post-auricular muscle response (PAMR). Hear Res 138:115–132. 10.1016/S0378-5955(99)00159-8 [DOI] [PubMed] [Google Scholar]
- Oostenveld R, Fries P, Maris E, Schoffelen JM (2011) FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Computat Intell Neurosci 2011:156869. 10.1155/2011/156869 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Park H, Kayser C (2019) Shared neural underpinnings of multisensory integration and trial-by-trial perceptual recalibration in humans. eLife 8:e47001 10.7554/eLife.47001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rahnev D, Denison RN (2018) Suboptimality in perceptual decision making. Behav Brain Sci 41:E223 10.1017/S0140525X18000936 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rohe T, Ehlis AC, Noppeney U (2019) The neural dynamics of hierarchical Bayesian causal inference in multisensory perception. Nat Commun 10:1907. 10.1038/s41467-019-09664-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romei V, Gross J, Thut G (2010) On the role of prestimulus alpha rhythms over occipito-parietal areas in visual input regulation: correlation or causation? J Neurosci 30:8692–8697. 10.1523/JNEUROSCI.0160-10.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Romei V, Murray MM, Cappe C, Thut G (2013) The contributions of sensory dominance and attentional bias to cross-modal enhancement of visual cortex excitability. J Cogn Neurosci 25:1122–1135. 10.1162/jocn_a_00367 [DOI] [PubMed] [Google Scholar]
- Roseboom W. (2019) Serial dependence in timing perception. J Exp Psychol Hum Percept Perform 45:100–110. 10.1037/xhp0000591 [DOI] [PubMed] [Google Scholar]
- Sadaghiani S, Kleinschmidt A (2016) Brain networks and α-oscillations: structural and functional foundations of cognitive control. Trends Cogn Sci 20:805–817. 10.1016/j.tics.2016.09.004 [DOI] [PubMed] [Google Scholar]
- Samaha J, Iemi L, Postle BR (2017) Prestimulus alpha-band power biases visual discrimination confidence, but not accuracy. Conscious Cogn 54:47–55. 10.1016/j.concog.2017.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sauseng P, Klimesch W, Stadler W, Schabus M, Doppelmayr M, Hanslmayr S, Gruber WR, Birbaumer N (2005) A shift of visual spatial attention is selectively associated with human EEG alpha activity. Eur J Neurosci 22:2917–2926. 10.1111/j.1460-9568.2005.04482.x [DOI] [PubMed] [Google Scholar]
- Sherman MT, Kanai R, Seth AK, VanRullen R (2016) Rhythmic influence of top-down perceptual priors in the phase of prestimulus occipital alpha oscillations. J Cogn Neurosci 28:1318–1330. 10.1162/jocn_a_00973 [DOI] [PubMed] [Google Scholar]
- Simon DM, Nidiffer AR, Wallace MT (2018) Single trial plasticity in evidence accumulation underlies rapid recalibration to asynchronous audiovisual speech. Sci Rep 8:12499. 10.1038/s41598-018-30414-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simon DM, Noel JP, Wallace MT (2017) Event related potentials index rapid recalibration to audiovisual temporal asynchrony. Front Integr Neurosci 11:8. 10.3389/fnint.2017.00008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spence C, Shore DI, Klein RM (2001) Multisensory prior entry. J Exp Psychol Gen 130:799–832. 10.1037/0096-3445.130.4.799 [DOI] [PubMed] [Google Scholar]
- Spence C, Squire S (2003) Multisensory integration: maintaining the perception of synchrony. Curr Biol 13:R519–R521. 10.1016/S0960-9822(03)00445-7 [DOI] [PubMed] [Google Scholar]
- Stekelenburg JJ, Sugano Y, Vroomen J (2011) Neural correlates of motor–sensory temporal recalibration. Brain Res 1397:46–54. 10.1016/j.brainres.2011.04.045 [DOI] [PubMed] [Google Scholar]
- Stevenson RA, Zemtsov RK, Wallace MT (2012) Individual differences in the multisensory temporal binding window predict susceptibility to audiovisual illusions. J Exp Psychol Hum Percept Perform 38:1517–1529. 10.1037/a0027339 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Summerfield C, Egner T (2009) Expectation (and attention) in visual cognition. Trends Cogn Sci 13:403–409. 10.1016/j.tics.2009.06.003 [DOI] [PubMed] [Google Scholar]
- Summerfield C, Lange FP (2014) Expectation in perceptual decision making: neural and computational mechanisms. Nat Rev Neurosci 15:745–756. 10.1038/nrn3838 [DOI] [PubMed] [Google Scholar]
- Sun J, Perona P (1998) Where is the sun? Nat Neurosci 1:183–184. 10.1038/630 [DOI] [PubMed] [Google Scholar]
- Thut G, Nietzel A, Brandt SA, Pascual-Leone A (2006) Alpha-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection. J Neurosci 26:9494–9502. 10.1523/JNEUROSCI.0875-06.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van der Burg E, Alais D, Cass J (2013) Rapid recalibration to audiovisual asynchrony. J Neurosci 33:14633–14637. 10.1523/JNEUROSCI.1182-13.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van der Burg E, Alais D, Cass J (2015) Audiovisual temporal recalibration occurs independently at two different time scales. Sci Rep 5:14526. 10.1038/srep14526 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van der Burg E, Alais D, Cass J (2018) Rapid recalibration to audiovisual asynchrony follows the physical—not the perceived—temporal order. Atten Percept Psychophys 80:2060–2068. [DOI] [PubMed] [Google Scholar]
- van Dijk H, Schoffelen JM, Oostenveld R, Jensen O (2008) Prestimulus oscillatory activity in the alpha band predicts visual discrimination ability. J Neurosci 28:1816–1823. 10.1523/JNEUROSCI.1853-07.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Kerkoerle T, Self MW, Dagnino B, Gariel-Mathis MA, Poort J, van der Togt C, Roelfsem PR (2014) Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex. Proc Natl Acad Sci U S A 111:14332–14341. 10.1073/pnas.1402773111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Wassenhove V, Grant KW, Poeppel D (2007) Temporal window of integration in auditory-visual speech perception. Neuropsychologia 45:598–607. 10.1016/j.neuropsychologia.2006.01.001 [DOI] [PubMed] [Google Scholar]
- VanRullen R. (2016) How to evaluate phase difference between trial groups in ongoing electrophysiological signals. Front Neurosci 10:426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vroomen J, Keetels M, de Gelder B, Bertelson P (2004) Recalibration of temporal order perception by exposure to audio-visual asynchrony. Cogn Brain Res 22:32–35. 10.1016/j.cogbrainres.2004.07.003 [DOI] [PubMed] [Google Scholar]
- Watson DM, Akeroyd MA, Roach NW, Webb BS (2019) Distinct mechanisms govern recalibration to audio-visual discrepancies in remote and recent history. Sci Rep 9:8513 10.1038/s41598-019-44984-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wexler M, Duyck M, Mamassian P (2015) Persistent states in vision break universality and time invariance. Proc Natl Acad Sci U S A 112:14990–14995. 10.1073/pnas.1508847112 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wöstmann M, Alavash M, Obleser J (2019a) Alpha oscillations in the human brain implement distractor suppression independent of target selection. J Neurosci 39:9797–9805. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wöstmann M, Waschke L, Obleser J (2019b) Prestimulus neural alpha power predicts confidence in discriminating identical auditory stimuli. Eur J Neurosci 49:94–105. 10.1111/ejn.14226 [DOI] [PubMed] [Google Scholar]
- Yao D, Wang L, Oostenveld R, Dremstrup K, Lars N, Arendt-Nielsen Chen AC (2005) A comparative study of different references for EEG spectral mapping: the issue of the neutral reference and the use of the infinity reference. Physiol Meas 26:173–184. 10.1088/0967-3334/26/3/003 [DOI] [PubMed] [Google Scholar]