Abstract
Pre-stimulus alpha (8–12 Hz) and beta (16–20 Hz) oscillations have been frequently linked to the prediction of upcoming sensory input. Do these frequency bands serve as a neural marker of linguistic prediction as well? We hypothesized that if pre-stimulus alpha and beta oscillations index language predictions, their power should monotonically relate to the degree of predictability of incoming words based on past context. We expected that the more predictable the last word of a sentence, the stronger the alpha and beta power modulation. To test this, we measured neural responses with magnetoencephalography of healthy individuals during exposure to a set of linguistically matched sentences featuring three levels of sentence context constraint (high, medium and low constraint). We observed fluctuations in alpha and beta power before last word onset, and modulations in M400 amplitude after last word onset. The M400 amplitude was monotonically related to the degree of context constraint, with a high constraining context resulting in the strongest amplitude decrease. In contrast, pre-stimulus alpha and beta power decreased more strongly for intermediate constraints, followed by high and low constraints. Therefore, unlike the M400, pre-stimulus alpha and beta dynamics were not indexing the degree of word predictability from sentence context.
Subject terms: Electroencephalography - EEG, Cognitive neuroscience
Introduction
Sentence level language comprehension results from dynamic cognitive processes which combine and unify smaller linguistic units to create meaning1–6. These cognitive processes occur online, while the sentence unfolds, instantiating unified meaning which relates to the computation of semantics, spanning the whole utterance. During this process, a context representation is compared and updated on a moment to moment basis. The bias provided by the momentarily established context alters subsequent linguistic processing7–9. One classical approach to investigate the impact of linguistic predictions at the neuronal level is to measure the N400 component, which is called the M400 in magnetoencephalographic (MEG) studies10–12. The N400 functionally marks how surprising the occurrence of a target word is provided the past sentential context13. The N400 amplitude is stronger for anomalous or unexpected items, but importantly it is also influenced by how constraining the preceding sentential context is (i.e. how predictive are subsequent linguistic items based on past context), such that the N400 amplitude increases with lower sentence context constraints11,14–18. While not being linked to predictive processes directly, these N400 modulations suggests that sentence context constraints alter predictions that are encoded prior to target word occurrence.
Prediction in its minimal sense can be understood as changes in brain states in response to contextual information which facilitate the processing of new input19,20. Recent evidence suggests that neural rhythmic activity could be involved in the prediction of linguistic input during sentence processing. Neural oscillatory responses have been linked to the N400 and semantic predictions, such as theta (4–7 Hz) oscillations21,22 and gamma band (>40 Hz) activity23–26. Importantly however, theta and gamma oscillatory activity has mostly been observed as neural markers for semantic predictions after target word presentation. In contrast, and to the interest of the present study, other brain oscillatory responses in the alpha (8–12 Hz) and beta (16–20 Hz) frequency ranges have been linked to both domain-general and linguistic predictive mechanisms prior to the apparition of a target word. Alpha and beta oscillations are hypothesized to reflect a domain-general mechanism for the prediction of upcoming sensory input27,28 and to constitute top-down mechanisms that shape the communication of sensory information between distant neural networks29–31. Beyond sensory processing, recent theory and evidence suggests that alpha and beta oscillations would also be involved in linguistic prediction19,23,28. Decreases in alpha power21,25,32,33 and low-beta power25,33,34 have previously been linked to the processing of sentential context constraints. Specifically, the power decrease has been found to be stronger when sentential context is highly predictive of the last word of the sentence than when the prediction of the last word cannot be made based on past context21,25,32–37. The power decrease has been explained to reflect stronger engagement of the brain areas of the language network in scenarios in which predictions can be formed from past sentential context25,38. Yet, the evidence for alpha and beta oscillations being involved in language prediction is still debated, as it has only been observed between extreme situations, i.e. between very predictable sentences or completely unpredictable sentences21,25,33. If alpha and beta power reflect the degree of predictability of an upcoming word, we hypothesized that alpha/beta power should gradually decrease with higher context constraint.
To test this, we presented multiple graded groups of sentences context constraints. Participants passively read sentences belonging to either a low (LC), medium (MC) or high (HC) context constraining condition (Table 1). Crucially, we constructed the sentence material using triplets of sentences, and modulating the context constrain by only changing one word in the sentence (see Methods for details). Neuronal activity was measured online using MEG, before and after display of a target word. Based on previous findings21,25, we predicted that pre-stimulus alpha and beta power would differ between different conditions of predictability. The power decrease is expected to be strongest for the HC, followed by the MC and LC condition (Fig. 1).
Table 1.
Stimulus material examples | |
---|---|
Condition | Stimulus |
HC | (NL) Op dit gebouw heb je een goed uitzicht. |
(EN) On this building you got a good view. | |
MC | (NL) Op deze toren heb je een goed uitzicht. |
(EN) On this tower you got a good view. | |
LC | (NL) In deze wijk heb je een goed uitzicht. |
(EN) In this area you got a good view. |
The context constraining conditions were manipulated by changing one context constraining word.
Materials & Methods
Participants
In total, thirty-five students (mean age 24 years, range 18–43; 16 males) took part in the experiment. All participants provided their informed consent in accordance with the declaration of Helsinki, and the local ethics committee (CMO region Arnhem-Nijmegen). All experimental protocols were approved by the review board of the Donders Centre for Cognitive Neuroimaging prior to the start of the experiment. The participants were all Dutch native speakers, right-handed, had normal or corrected-to-normal vision and none of them suffered from neurological impairment or dyslexia. Two participants were excluded because they did not finish the experiment. Therefore, thirty-three participants were included for further analyses (mean age 24 years, range 18–43; 15 males).
Stimulus material
The stimulus set consisted of 253 sentence triplets, including 203 critical and 50 filler sentence triplets. Each sentence within a critical triplet belonged to either a high context (HC), medium context (MC), or low context (LC) constraining condition. The different degree of constraint within a triplet was achieved by manipulating only one word, the context constraining word, which was always at the same position within a sentence with regard to a triplet (Table 1). Across the conditions, these context constraining words were matched with regard to word length (F(2, 606) = 0.784, p = 0.457, with a Mean (SE) of HC: 7.12 (2.26); MC: 7.1 (2.54); LC: 7.37 (2.61)) and word frequency (F(2, 584) = 1.984, p = 0.138, with Mean (SE) of HC: 2.4 (0.78); MC: 2.56 (0.87); LC: 2.5 (0.84); based on the Dutch SUBTLEX-NL database40. The stimuli were pretested in a sentence completion task in order to verify the step-like degree of context constraints within a triplet (from high, to medium, to low). For this task - independent from the MEG experiment - a sample of participants (N = 51) were required to complete a sentence presented on a computer screen, for which the final word was missing. Participants performed the experiment with one of three counterbalanced lists. Each list included the same number of critical sentences from either of the three context constraining conditions. The validation of the conditions was performed in two subsequent steps: first, the degree of context constraint per sentence was evaluated by calculating the percentage of participants that would finish a sentence with the same word. These probabilities are thought to reflect the degree to which the sentential context biases subsequent language processing. As expected, HC sentences resulted in the highest percentage of participants proposing the same word as cloze (Mean (SE) = 77% (17.74)), followed by MC (Mean (SE) = 50% (18.67)) and LC (Mean (SE) = 28% (11.97)). The three conditions differed significantly from each other with regard to their degree of context constraints (F(2, 606) = 442.842, p < 0.001).
Second, and in order to create the final stimulus set, the final word from the HC sentences with the highest percentage was chosen as sentence ending for all sentences within a triplet. This approach resulted in cloze probabilities for the final word - the target word - that were different from the percentages of the context constraints for the MC and LC conditions. Still, the cloze probabilities differed significantly between conditions (F(2, 606) = 468.155, p < 0.001), with HC showing the highest cloze probability (Mean (SE) = 77% (17.74)), followed by MC (Mean (SE) = 42% (25.94)) and LC (Mean (SE) = 15% (15.82)). The cloze probabilities are thought to reflect how surprising the final word occurrence is, given the past sentential context. In our stimulus set, context constraint measures were highly correlated with measures of cloze probability (r = 0.93, p < 0.001).
In the MEG experiment, participants were presented with one of the counterbalanced lists, with an additional set of 50 filler sentences. The filler sentences did not differ between lists but followed a different sentence structure as compared to the critical sentences.
Experimental procedure
Participants were comfortably seated in a dimly illuminated and magnetically shielded room. All participants were instructed to place their arms on the arm rest of the chair, with access to a button box with their right hand. In front of each participant, at a distance of 80 cm and with a 25°–35° viewing angle, a screen was located on which all stimulus material was displayed. The words were shown in black, on a grey background. Participants were instructed to silently read the displayed sentences on the screen, and to focus on the content of each sentence. Furthermore, it was highlighted that sometimes (after 20% of the sentences; subjects were not informed about the precise percentage) a question would be asked about the content of the previous displayed sentence. The participants were then required to answer this question with ‘yes’ or ‘no’ by button press. The answer possibilities (‘yes’/‘no’) were randomly displayed on the left or right side of the screen and a left or right button had to be pressed accordingly. These question trials were catch trials, intended to ensure that participants were actively processing the meaning of the sentences, without focusing their attention on the contextual constraints. A trial started with the display of a fixation cross in the middle of the screen for 500 ms. The fixation cross was followed by a blank screen for a random interval of 500–1200 ms. Subsequently, the word-by-word presentation of the sentence began, with each word being displayed for 200 ms, followed by a blank screen of 800 ms. An interval of 1000 ms was chosen in order to record pre-stimulus alpha and beta activity that is not influenced by the evoked response to the previous displayed word. After a sentence ended, another blank screen occurred for 2000 ms (Fig. 1). After that, either a catch question was displayed, with the whole question in the middle of the screen and the yes-no answers randomly split to the left or right side, or the next trial began. In total, participants read 253 sentences (253 trials) in random order, which came from one of three lists, counterbalanced on the three levels of context constraints. The total amount of trials was divided into four blocks, separated by small breaks in-between. The length of a break was self-determined by the participants and the task could be continued by button press. In total, the data acquisition lasted 60 min.
Data acquisition
All data were acquired using a 275 axial gradiometers CTF Omega MEG system. Horizontal and vertical bipolar electrooculography (EOG) as well as electrocardiography (ECG) were recorded in order to discard eye blinks, eye movements and heart beats contaminated trials. All electrophysiological signals were low-pass filtered at 300 Hz, digitized at 1200 Hz, and stored for off-line analysis. Three coils were placed on the nasion and the left and right ear canal to register the head position with respect to the gradiometers. The coils enabled real-time monitoring of the head position throughout the experiment41. Next to the MEG recordings, magnetic resonance images (MRIs) were obtained from 32 of the participants with a 1.5 T or 3.0 T Siemens system. By means of attached markers at the same anatomical locations as the head coils, the MRIs could be aligned to the MEG coordinate system.
Data preprocessing
All data were analyzed using the open-source Matlab toolbox Fieldtrip42. From the MEG data, a time-window of interest was segmented 2 s before and after the onset of a sentence’s final word for each trial. This segmentation therefore included the blank delay period just before onset of the target word, where the effect of context constraints is expected to occur, and the period after onset of the target word. The segmented data were low-pass filtered at 150 Hz. The 50 Hz line noise components were removed by using a notch filter. Artifact identification and rejection was done in three steps. First, MEG jump and muscle artifacts were identified by visual inspection of amplitude variance over trials. Second, artifacts related to eye-movements and cardiac activity were identified and removed by means of an independent component analysis (fastICA)43, followed by backprojection. The independent components were visually inspected and removed from the sensor data, if they resembled heartbeat, eye-movements or blinks (as compared to the recorded EOG and ECG). Third, the resulting data were again visually inspected to remove any remaining artifacts. From this procedure, on average 11% of trials and 1.5% of MEG sensors were excluded from further analysis.
Event-Related Field (ERF) analysis
Event-related fields were investigated to observe M400 modulations after the last word onset. This correlate is the magnetic counterpart of the classical N400 measured by electroencephalography and inhabits the same time-course and response properties44,45. For each condition, the epochs were first low-pass filtered at 35 Hz. All ERFs were then baseline corrected based on a time window of −300 ms–0 ms relative to target word onset. To facilitate comparison across participants the ERFs were transformed to a combined synthetic planar gradient representation46. The M400 component was calculated by averaging over the planar gradient field amplitude from 250 ms to 600 ms following target word onset.
Time-frequency analysis
Time-frequency analysis was first done for the time-window of −800 ms to 0 ms relative to the sentence’s target word onset, including only the blank delay period. Additionally, the M400 sensitive time-window after target word onset was considered for time-frequency analyses, including a window from 200 ms up to 700 ms. Alpha and beta power were estimated for each condition using fast Fourier transform for a frequency range of 8 Hz to 12 Hz for the alpha, and 16 Hz to 20 Hz for the beta frequency bands (based on Wang et al.25), with a Hanning-tapered 500 ms sliding window in time steps of 10 ms. No baseline correction was performed on the time-frequency data, statistics were performed by contrasting individual conditions of context constraints. Time-frequency plots were created using a wider frequency range of 2 Hz to 30 Hz (using a fixed 500 ms sliding Hanning window in time steps of 10 ms and frequency steps of 2 Hz) for a time window of −1000 ms to 1000 ms. Power was averaged over channel clusters that were a result of the statistical comparison between conditions for the alpha and beta frequency band respectively.
Source analysis
To estimate the sources of the oscillatory activity, the Dynamical Imaging of Coherent Sources (DICS) beamforming approach was applied to the data47. The volume conduction model was constructed from the individual anatomical MRI as a single shell representation of the inside of the skull. This model was used to compute the forward model according to Nolte48. The initial co-registration between the headmodel and MEG sensors was achieved by manually identifying the anatomical landmarks of the nasion and two auricular fiducials, and was additionally refined, using the subject-specific three-dimensional digitised representation of the scalp, as obtained by a Polhemus digitizer. The source space was discretized into a three dimensional grid with a 6 mm resolution. Source reconstruction was performed using a spatial filter, which was computed by combining the cross-spectral density (CSD) matrices from all three conditions (HC, MC, LC). The CSDs were computed using the Fast Fourier transform of the data with multitapering, with a center frequency of 10 Hz or 18 Hz for the alpha (averaged over the time window 540–0 ms, relative to target word onset) and beta (averaged over 450–0 ms) frequency band respectively. All visualizations are based on interpolated data onto the MNI template. The different conditions of the source reconstructed data were compared based on cluster-based permutation statistics as described below.
Cluster-Based permutation statistics
Statistical evaluation was done using non-parametric cluster-based permutation tests49. First, we computed F-statistics to quantify the effect of context constraints (three levels: HC, MC, LC) for each sensor and time point. These F-statistics were used to define the clusters for the non-parametric statistical testing: clusters consisted of samples whose F-values were above threshold (threshold: F-value associated with a p-value of 5%) and were adjacent in space and time. Cluster-level statistics were computed by taking the sum of F-values within each cluster. The distribution of the cluster-level statistics under the null hypothesis was obtained by repeating this procedure for 5000 permutations of random relabeling of the conditions. Clusters whose test-statistics fell in the highest 5th percentile of its reference distribution were considered significant.
Results
Behavioral performance
In order to confirm the participant’s attention to the experimental task, their performance was measured during catch trials that occurred after presentation of 20% of the sentences. The overall accuracy measures show a mean ceiling performance of 95% (SE = 4.65), 96% (SE = 4.42) and 97% (SE = 2.83) for the HC, MC and LC sentences respectively. There were no significant differences in accuracy with respect to the different conditions (Accuracy: F(2, 31) = 0.474, p = 0.627). This indicates that the participants were paying attention to the content of the presented sentences.
Event-Related fields after target word onset
In this experiment, participants read words preceded by a context with different degrees of constraint (three context-constraint conditions: high, medium and low context constraints) while brain signals were recorded online. We first analyzed the effect of context constraints on the event-related fields upon target word presentation. Based on previous literature11,14 we expected a monotonous relationship between cloze probability and the M400 component. Consistently, as can be seen from the amplitude fluctuations of the event-related activity (Fig. 2), amplitude differences between the three conditions emerged within the typical M400 time-window. The M400 amplitude strength decreased with increasing cloze probability, such that the HC condition displayed the lowest M400 amplitude, followed by the MC and LC conditions. The cluster-based statistics revealed a main effect of context constraints on the M400 amplitude strength in a pre-defined time window of 250 ms to 600 ms after target word onset; this effect was most pronounced over a left-frontal localized cluster of sensors (Fig. 2, cluster p = 0.005). The post-hoc contrasts (based on pairwise T-tests) revealed that the effect was mainly driven by a difference between HC vs. LC (p < 0.001) and HC vs. MC (p = 0.013). Although the M400 amplitude was smaller for MC than for LC condition, this difference was not significant. These effects were overall in line with the current literature showing that the M400 amplitude reflects semantic retrieval and unification of the target word with the preceding context.
Alpha/Beta power modulations before target word onset
Next, we investigated the effect of content constraints on alpha and beta power modulations before target word onset. Based on earlier research25, an effect was suggested to occur during the delay period, just before the display of the target word. The cluster-based statistics for the alpha (8–12 Hz) frequency band revealed a significant difference between all three conditions with regard to power (p = 0.019) for a time-window of −540 ms to 0 ms relative to target word onset. This effect was most pronounced over a widespread set of sensors, including anterior, central and posterior sensors (Fig. 3). Over these sensors, alpha power showed the strongest decrease for the MC condition, followed by HC and LC (Fig. 3). The post-hoc contrasts of these conditions indicate that the power decrease is significantly different between HC vs. MC (p = 0.023), MC vs. LC (p < 0.001), and HC vs. LC. (p = 0.026). Post-hoc comparisons of power (averaged over t(alpha) = −540–0 ms and t(beta) = −450 ms−0 ms) with respect to the whole spectrum (2 Hz to 30 Hz) showed that the strongest difference between context constraints peaks in the lower alpha range (8 Hz, Fig. 4).
We performed source reconstruction to allow for a more detailed description of the brain areas involved in the observed sensor-level effect. Source-level statistical evaluation indicated that this effect was most pronounced in parietal areas, with a bias to the right hemisphere (Fig. 5, p = 0.003, cluster-based corrected).
The sensor-level analyses in the beta (16–20 Hz) frequency band revealed a similar tendency as for the alpha results, though the effects were not significant (cluster with lowest p-value in cluster-based corrected statistics: p = 0.077, see Figs. 6 and 7).
Source statistics in turn indicated a significant F-contrast across all conditions with the effect being most pronounced over a set of frontal and parietal areas, biased to left frontal cortex (Fig. 8, p = 0.002, cluster-based corrected). The power fluctuations were, similar to the results on alpha power, non-monotonically related to each other. The MC condition was again displaying the strongest decrease followed by HC and then the LC condition (Figs. 6, 7).
Alpha/Beta power modulations after target word onset
To cover any oscillatory effects within the M400 sensitive time-window, alpha and beta power modulations were investigated as a function of context constraints after target word onset. The individual cluster-based statistics for both frequency bands revealed no significant difference between the three conditions with regard to power, within this particular time-window.
Discussion
The current study investigated the role of pre-stimulus alpha and beta oscillations as a neural marker for sentence context constraints. Our results confirm the sensitivity of pre-stimulus alpha and beta power to different levels of constraint. Power of alpha and beta decreases when sentential context constraints are high as compared to when the context constraints are low, in line with previous findings21,25,33. However, we report the strongest decrease in alpha and beta power for the medium context constrain conditions. The data contradicts our initial hypothesis and instead indicate that pre-stimulus alpha and beta oscillations are non-monotically related to the amount of contextual constraint which in turn reflects the predictability of the sentence ending. In line with earlier findings, the M/N400 amplitude was monotonically modulated by the degree of constraint, resulting in the lowest amplitude for high, followed by medium and low context constraints. The results suggest that pre-stimulus alpha and beta oscillations and the M/N400 component are neural markers that relate to distinct processes during sentence context evaluation.
In agreement with classic findings, our results show the M/N400 magnitude monotonically decreases with increasing context constraints, and this finding can be taken as support for M/N400 integration and/or predictability accounts11. In contrast, the pre-stimulus alpha/beta power fluctuations do not linearly relate to the degree of predictability of the target word given its sentential context. Our findings partially replicate previous results, showing that high context constraints induced a stronger alpha/beta power decrease than low constraint21,23,25. Yet, the stronger alpha/beta power decrease for medium context constraints suggest that alpha and beta power does not reflect the degree of predictability of the target word given its context. Furthermore, while we initially defined the alpha frequency band between 8–12 Hz as in previous reports21,32,38,50, post-hoc analysis show that the strongest effects of context constraint were observed in the lower alpha range around 8 Hz. This suggests that alpha effects previously linked to sentential constraint processing25 may be more prominently observed in the lower alpha range. The interpretation of the results could still be framed within the general mechanistic account of alpha being indicative of neuronal engagement38, considering that lower alpha band activity in the 7–9 Hz has been linked to information gating regarding visual processing51,52. In addition to the differences in amplitude fluctuations between pre-stimulus alpha and beta oscillations and post-stimulus M400, our effects exhibit distinct topographical properties. The sources of the M400 have previously been localized to temporal as well as prefrontal areas, with a stronger prominence in the left hemisphere (see Lau and colleagues53). The topography of the M400 results in the present study is in line with these common findings. In contrast, the sources of the pre-stimulus alpha and beta power changes cover distinct areas. Alpha power modulations were most pronounced over parietal areas, and beta power effects were most pronounced over dorsolateral prefrontal areas. While alpha and beta power reacted similarly to the amount of context constrain within a sentence, the source reconstruction of these effects suggest that alpha power modulations and beta power effects do not reflect the same process. These results capture different alpha and beta dynamics that were reported in studies contrasting low and high sentence context constraints processing only25,39. These studies located the alpha and beta power differences predominantly over left inferior frontal areas and left middle and posterior temporal regions.
Pre-stimulus alpha and beta power modulations are not consistent with processes that relate to predictability. However, their dynamics and topographies could speculatively indicate that they relate to attention and/or working memory operations taking place during sentence processing39. Alpha oscillations have been previously related to attentional gating and the maintenance of task relevant items in working memory54–60. Parietal alpha power is shown to decrease with working memory load during encoding58,61,62, and may reflect the relative engagement of networks involved in the encoding of items to keep in memory, and the active inhibition of task irrelevant items56. The dorsolateral prefrontal cortex is a crucial region recruited for working memory operations63–65. The beta activity reported in our study could potentially reflect working memory load processing capacity66. This mechanism is crucial during sentence processing, where pre-stimulus alpha and beta oscillations could be then involved in the preselection and maintenance of lexical candidates39 (see also Piai and colleagues67). The set of target candidates that need to be retrieved and maintained should in particular be guided by semantic context68. We speculate that the amount of possible lexical items to be encoded and maintained might differ depending on the degree of constraint, which would lead to distinct alpha and beta power modulations before target word onset. Compared to low or high context constraining sentences, intermediate context constraints may generate the highest competition between lexical candidates. In the high context constraining conditions, few items are competing, which would require low working memory demands. In low context constraining conditions, the sentential context is broad enough that the number of alternative candidates for sentence ending would be much higher than working memory capacities, resulting in working memory processes being disengaged in this setting. Eventually, in medium context constraining settings, more distractors are to be maintained in working memory than in other context constrains conditions, which in turn is reflected by the stronger alpha power decrease.
As an alternative explanation, the changes in alpha and beta activity could also reflect an overall change of alertness or attentional lapses as a function of the predictability of the stimulus61,69. In these studies, participants who had higher alpha power at the presentation of a relevant sentential context were more likely to discard this sentential information for incoming linguistic processing. A decrease in alpha power prior to target word onset could thus potentially reflect general higher levels of alertness that would affect the processing of relevant contextual words. However, we do not think that changes in alertness can explain our results as we controlled our design to result in similar levels of alertness across conditions by randomizing the presentation of the sentences and matching linguistic features like word frequency and length.
In sum, using sentences with different context constraints that are matched on other linguistic variables like lexical frequency and word length, this MEG study shows that pre-stimulus alpha/beta power in the course of the sentence is modulated by context constraints. However, the alpha/beta power decrease is strongest for medium constraining sentences, which defies previous interpretations of this marker in light of a prediction mechanism. The non-monotonic sensitivity of the alpha/beta power fluctuations to these different levels of constraints highlight the importance of including intermediate conditions in language research. Therefore, our results do not support the hypothesis that alpha and beta oscillatory markers reflect linguistic predictability, and a mechanistic account relating alpha/beta oscillations and the degree of sentence context constraint remains to be elaborated.
Author contributions
All authors contributed to study concept and design. Data collection, analysis and interpretation were performed by René Terporten, data analysis was supported by Bohan Dai. Project execution, development and data interpretation were supervised by Anne Kösem and Peter Hagoort. Data analysis was supervised by Anne Kösem and Jan-Mathijs Schoffelen. René Terporten wrote the manuscript and Anne Kösem, Jan-Mathijs Schoffelen and Peter Hagoort provided critical revision. All authors approved the final version of the manuscript for submission.
Data availability
The datasets generated during and/or analyzed during the current study are available in the Donders repository, https://data.donders.ru.nl/collections/di/dccn/DSC_3011097.01_968?4.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Cairns HS, Cowart W, Jablon AD. Effects of prior context upon the integration of lexical information during sentence processing. J. Verbal Learn. Verbal Behav. 1981;20:445–453. doi: 10.1016/S0022-5371(81)90551-X. [DOI] [Google Scholar]
- 2.Glucksberg S, Kreuz RJ, Rho SH. Context can constrain lexical access: Implications for models of language comprehension. J. Exp. Psychol. Learn. Mem. Cogn. 1986;12:323. doi: 10.1037/0278-7393.12.3.323. [DOI] [Google Scholar]
- 3.Hagoort, P. Chapter 28 - MUC (Memory, Unification, Control): A Model on the Neurobiology of Language Beyond Single Word Processing. In Neurobiology of Language (eds. Hickok, G. & Small, S. L.) 339–347 (Academic Press). 10.1016/B978-0-12-407794-2.00028-6.(2016)
- 4.Morris RK. Lexical and message-level sentence context effects on fixation times in reading. J. Exp. Psychol. Learn. Mem. Cogn. 1994;20:92–103. doi: 10.1037/0278-7393.20.1.92. [DOI] [PubMed] [Google Scholar]
- 5.Moss HE, Marslen-Wilson WD. Access to word meanings during spoken language comprehension: Effects of sentential semantic context. J. Exp. Psychol. Learn. Mem. Cogn. 1993;19:1254–1276. doi: 10.1037/0278-7393.19.6.1254. [DOI] [PubMed] [Google Scholar]
- 6.Rommers J, Dijkstra T, Bastiaansen M. Context-dependent Semantic Processing in the Human. Brain: Evidence from Idiom Comprehension. J. Cogn. Neurosci. 2012;25:762–776. doi: 10.1162/jocn_a_00337. [DOI] [PubMed] [Google Scholar]
- 7.Federmeier KD. Thinking ahead: The role and roots of prediction in language comprehension. Psychophysiology. 2007;44:491–505. doi: 10.1111/j.1469-8986.2007.00531.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Frank SL, Willems RM. Word predictability and semantic similarity show distinct patterns of brain activity during language comprehension. Lang. Cogn. Neurosci. 2017;32:1192–1203. doi: 10.1080/23273798.2017.1323109. [DOI] [Google Scholar]
- 9.Xu J, Kemeny S, Park G, Frattali C, Braun A. Language in context: emergent features of word, sentence, and narrative comprehension. NeuroImage. 2005;25:1002–1015. doi: 10.1016/j.neuroimage.2004.12.013. [DOI] [PubMed] [Google Scholar]
- 10.Janssen EM, van der Ven SHG, van Hoogmoed AH, Leseman PPM. The effect of anticipated achievement feedback on students’ semantic processing as indicated by the N400 cloze effect. Learn. Instr. 2017;47:80–90. doi: 10.1016/j.learninstruc.2016.10.003. [DOI] [Google Scholar]
- 11.Kutas M, Federmeier KD. Thirty years and counting: Finding meaning in the N400 component of the event related brain potential (ERP) Annu. Rev. Psychol. 2011;62:621–647. doi: 10.1146/annurev.psych.093008.131123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tromp J, Peeters D, Meyer AS, Hagoort P. The combined use of virtual reality and EEG to study language processing in naturalistic environments. Behav. Res. Methods. 2018;50:862–869. doi: 10.3758/s13428-017-0911-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Frank SL, Otten LJ, Galli G, Vigliocco G. The ERP response to the amount of information conveyed by words in sentences. Brain Lang. 2015;140:1–11. doi: 10.1016/j.bandl.2014.10.006. [DOI] [PubMed] [Google Scholar]
- 14.DeLong KA, Urbach TP, Kutas M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nat. Neurosci. 2005;8:1117. doi: 10.1038/nn1504. [DOI] [PubMed] [Google Scholar]
- 15.Diaz MT, Swaab TY. Electrophysiological differentiation of phonological and semantic integration in word and sentence contexts. Brain Res. 2007;1146:85–100. doi: 10.1016/j.brainres.2006.07.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Freunberger D, Roehm D. The costs of being certain: Brain potential evidence for linguistic preactivation in sentence processing. Psychophysiology. 2017;54:824–832. doi: 10.1111/psyp.12848. [DOI] [PubMed] [Google Scholar]
- 17.Ito A, Corley M, Pickering MJ, Martin AE, Nieuwland MS. Predicting form and meaning: Evidence from brain potentials. J. Mem. Lang. 2016;86:157–171. doi: 10.1016/j.jml.2015.10.007. [DOI] [Google Scholar]
- 18.Van Petten C, Luka BJ. Prediction during language comprehension: Benefits, costs, and ERP components. Int. J. Psychophysiol. 2012;83:176–190. doi: 10.1016/j.ijpsycho.2011.09.015. [DOI] [PubMed] [Google Scholar]
- 19.Kuperberg GR, Jaeger TF. What do we mean by prediction in language comprehension? Lang. Cogn. Neurosci. 2016;31:32–59. doi: 10.1080/23273798.2015.1102299. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Molinaro N, Monsalve IF, Lizarazu M. Is there a common oscillatory brain mechanism for producing and predicting language? Lang. Cogn. Neurosci. 2016;31:145–158. doi: 10.1080/23273798.2015.1077978. [DOI] [Google Scholar]
- 21.Rommers J, Dickson DS, Norton JJS, Wlotko EW, Federmeier KD. Alpha and theta band dynamics related to sentential constraint and word expectancy. Lang. Cogn. Neurosci. 2017;32:576–589. doi: 10.1080/23273798.2016.1183799. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Molinaro, N., Barraza, P. & Carreiras, M. Long-range neural synchronization supports fast and efficient reading: EEG correlates of processing expected words in sentences. NeuroImage72, (2013). [DOI] [PMC free article] [PubMed]
- 23.Lewis AG, Wang L, Bastiaansen M. Fast oscillatory dynamics during language comprehension: Unification versus maintenance and prediction? Brain Lang. 2015;148:51–63. doi: 10.1016/j.bandl.2015.01.003. [DOI] [PubMed] [Google Scholar]
- 24.Wang, L., Zhu, Z. & Bastiaansen, M. Integration or Predictability? A Further Specification of the Functional Role of Gamma Oscillations in Language Comprehension. Front. Psychol. 3, (2012). [DOI] [PMC free article] [PubMed]
- 25.Wang L, Hagoort P, Jensen O. Language Prediction Is Reflected by Coupling between Frontal Gamma and Posterior Alpha Oscillations. J. Cogn. Neurosci. 2017;30:432–447. doi: 10.1162/jocn_a_01190. [DOI] [PubMed] [Google Scholar]
- 26.Mamashli F, Khan S, Obleser J, Friederici AD, Maess B. Oscillatory dynamics of cortical functional connections in semantic prediction. Hum. Brain Mapp. 2019;40:1856–1866. doi: 10.1002/hbm.24495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Arnal LH, Giraud A-L. Cortical oscillations and sensory predictions. Trends Cogn. Sci. 2012;16:390–398. doi: 10.1016/j.tics.2012.05.003. [DOI] [PubMed] [Google Scholar]
- 28.Lewis, A. G., Schoffelen, J.-M., Schriefers, H. & Bastiaansen, M. A Predictive Coding Perspective on Beta Oscillations during Sentence-Level Language Comprehension. Front. Hum. Neurosci. 10 (2016). [DOI] [PMC free article] [PubMed]
- 29.Bastos AM, et al. Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels. Neuron. 2015;85:390–401. doi: 10.1016/j.neuron.2014.12.018. [DOI] [PubMed] [Google Scholar]
- 30.Bonnefond, M., Kastner, S. & Jensen, O. Communication between Brain Areas Based on Nested Oscillations. eNeuro4 (2017). [DOI] [PMC free article] [PubMed]
- 31.Fries P. Rhythms For Cognition: Communication Through Coherence. Neuron. 2015;88:220–235. doi: 10.1016/j.neuron.2015.09.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Lam NHL, Schoffelen J-M, Uddén J, Hultén A, Hagoort P. Neural activity during sentence processing as reflected in theta, alpha, beta, and gamma oscillations. NeuroImage. 2016;142:43–54. doi: 10.1016/j.neuroimage.2016.03.007. [DOI] [PubMed] [Google Scholar]
- 33.Piai, V., Rommers, J. & Knight, R. T. Evidence for a causal link between left posterior alpha-beta power decreases and context-driven word production. bioRxiv 150748 10.1101/150748 (2017).
- 34.Bastiaansen M, Hagoort P. Frequency-based Segregation of Syntactic and Semantic Unification during Online Sentence Level Language Comprehension. J. Cogn. Neurosci. 2015;27:2095–2107. doi: 10.1162/jocn_a_00829. [DOI] [PubMed] [Google Scholar]
- 35.Wang L, et al. Beta oscillations relate to the N400m during language comprehension. Hum. Brain Mapp. 2012;33:2898–2912. doi: 10.1002/hbm.21410. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Weiss, S. & Mueller, H. M. “Too Many betas do not Spoil the Broth”: The Role of Beta Brain Oscillations in Language Processing. Front. Psychol. 3 (2012). [DOI] [PMC free article] [PubMed]
- 37.Willems RM, Oostenveld R, Hagoort P. Early decreases in alpha and gamma band power distinguish linguistic from visual information during spoken sentence comprehension. Brain Res. 2008;1219:78–90. doi: 10.1016/j.brainres.2008.04.065. [DOI] [PubMed] [Google Scholar]
- 38.Jensen, O. & Mazaheri, A. Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition. Front. Hum. Neurosci. 4, (2010). [DOI] [PMC free article] [PubMed]
- 39.Piai V, Roelofs A, Rommers J, Maris E. Beta oscillations reflect memory and motor aspects of spoken word production. Hum. Brain Mapp. 2015;36:2767–2780. doi: 10.1002/hbm.22806. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Keuleers E, Brysbaert M, New B. SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles. Behav. Res. Methods. 2010;42:643–650. doi: 10.3758/BRM.42.3.643. [DOI] [PubMed] [Google Scholar]
- 41.Stolk A, Todorovic A, Schoffelen J-M, Oostenveld R. Online and offline tools for head movement compensation in MEG. NeuroImage. 2013;68:39–48. doi: 10.1016/j.neuroimage.2012.11.047. [DOI] [PubMed] [Google Scholar]
- 42.Oostenveld, R., Fries, P., Maris, E. & Schoffelen, J.-M. FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data. Comput. Intell. Neurosci. 2011 (2011). [DOI] [PMC free article] [PubMed]
- 43.Hyvärinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13:411–430. doi: 10.1016/S0893-6080(00)00026-5. [DOI] [PubMed] [Google Scholar]
- 44.Halgren E, et al. N400-like Magnetoencephalography Responses Modulated by Semantic Context, Word Frequency, and Lexical Class in Sentences. NeuroImage. 2002;17:1101–1116. doi: 10.1006/nimg.2002.1268. [DOI] [PubMed] [Google Scholar]
- 45.Lau E, Almeida D, Hines PC, Poeppel D. A lexical basis for N400 context effects: Evidence from MEG. Brain Lang. 2009;111:161–172. doi: 10.1016/j.bandl.2009.08.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Bastiaansen MCM, Knösche TR. Tangential derivative mapping of axial MEG applied to event-related desynchronization research. Clin. Neurophysiol. 2000;111:1300–1305. doi: 10.1016/S1388-2457(00)00272-8. [DOI] [PubMed] [Google Scholar]
- 47.Gross J, et al. Dynamic imaging of coherent sources: Studying neural interactions in the human brain. Proc. Natl. Acad. Sci. 2001;98:694–699. doi: 10.1073/pnas.98.2.694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Nolte G. The magnetic lead field theorem in the quasi-static approximation and its use for magnetoencephalography forward calculation in realistic volume conductors. Phys. Med. Biol. 2003;48:3637–3652. doi: 10.1088/0031-9155/48/22/002. [DOI] [PubMed] [Google Scholar]
- 49.Maris E, Oostenveld R. Nonparametric statistical testing of EEG- and MEG-data. J. Neurosci. Methods. 2007;164:177–190. doi: 10.1016/j.jneumeth.2007.03.024. [DOI] [PubMed] [Google Scholar]
- 50.Mathewson KE, Gratton G, Fabiani M, Beck DM, Ro T. To See or Not to See: Prestimulus α Phase Predicts Visual Awareness. J. Neurosci. 2009;29:2725–2732. doi: 10.1523/JNEUROSCI.3963-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Busch NA, VanRullen R, Spontaneous EEG. oscillations reveal periodic sampling of visual attention. Proc. Natl. Acad. Sci. 2010;107:16048–16053. doi: 10.1073/pnas.1004801107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Hanslmayr S, Volberg G, Wimber M, Dalal SS, Greenlee MW. Prestimulus Oscillatory Phase at 7 Hz Gates Cortical Information Flow and Visual Perception. Curr. Biol. 2013;23:2273–2278. doi: 10.1016/j.cub.2013.09.020. [DOI] [PubMed] [Google Scholar]
- 53.Lau EF, Phillips C, Poeppel D. A cortical network for semantics: (de)constructing the N400. Nat. Rev. Neurosci. 2008;9:920–933. doi: 10.1038/nrn2532. [DOI] [PubMed] [Google Scholar]
- 54.Hanslmayr, S., Staudigl, T. & Fellner, M.-C. Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis. Front. Hum. Neurosci. 6 (2012). [DOI] [PMC free article] [PubMed]
- 55.Röhm D, Klimesch W, Haider H, Doppelmayr M. The role of theta and alpha oscillations for language comprehension in the human electroencephalogram. Neurosci. Lett. 2001;310:137–140. doi: 10.1016/S0304-3940(01)02106-1. [DOI] [PubMed] [Google Scholar]
- 56.Roux F, Uhlhaas PJ. Working memory and neural oscillations: alpha–gamma versus theta–gamma codes for distinct WM information? Trends Cogn. Sci. 2014;18:16–25. doi: 10.1016/j.tics.2013.10.010. [DOI] [PubMed] [Google Scholar]
- 57.Bastiaansen MCM, Posthuma D, Groot PFC, de Geus EJC. Event-related alpha and theta responses in a visuo-spatial working memory task. Clin. Neurophysiol. 2002;113:1882–1893. doi: 10.1016/S1388-2457(02)00303-6. [DOI] [PubMed] [Google Scholar]
- 58.Jensen O, Tesche CD. Frontal theta activity in humans increases with memory load in a working memory task. Eur. J. Neurosci. 2002;15:1395–1399. doi: 10.1046/j.1460-9568.2002.01975.x. [DOI] [PubMed] [Google Scholar]
- 59.Piai V, et al. Direct brain recordings reveal hippocampal rhythm underpinnings of language processing. Proc. Natl. Acad. Sci. 2016;113:11366–11371. doi: 10.1073/pnas.1603312113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Bastiaansen, M. & Hagoort, P. Oscillatory neuronal dynamics during language comprehension. In Progress in Brain Research (eds. Neuper, C. & Klimesch, W.) vol. 159 179–196 (Elsevier, 2006). [DOI] [PubMed]
- 61.Boudewyn MA, et al. Sensitivity to Referential Ambiguity in Discourse: The Role of Attention, Working Memory, and Verbal Ability. J. Cogn. Neurosci. 2015;27:2309–2323. doi: 10.1162/jocn_a_00837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Sauseng P, Klimesch W, Schabus M, Doppelmayr M. Fronto-parietal EEG coherence in theta and upper alpha reflect central executive functions of working memory. Int. J. Psychophysiol. 2005;57:97–103. doi: 10.1016/j.ijpsycho.2005.03.018. [DOI] [PubMed] [Google Scholar]
- 63.Barbey AK, Koenigs M, Grafman J. Dorsolateral Prefrontal Contributions to Human Working Memory. Cortex J. Devoted Study Nerv. Syst. Behav. 2013;49:1195–1205. doi: 10.1016/j.cortex.2012.05.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Duncan J, Owen AM. Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci. 2000;23:475–483. doi: 10.1016/S0166-2236(00)01633-7. [DOI] [PubMed] [Google Scholar]
- 65.Duncan J. The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour. Trends Cogn. Sci. 2010;14:172–179. doi: 10.1016/j.tics.2010.01.004. [DOI] [PubMed] [Google Scholar]
- 66.Yoon JH, Grandelis A, Maddock RJ. Dorsolateral Prefrontal Cortex GABA Concentration in Humans Predicts Working Memory Load Processing Capacity. J. Neurosci. 2016;36:11788–11794. doi: 10.1523/JNEUROSCI.1970-16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Piai V, Roelofs A, Maris E. Oscillatory brain responses in spoken word production reflect lexical frequency and sentential constraint. Neuropsychologia. 2014;53:146–156. doi: 10.1016/j.neuropsychologia.2013.11.014. [DOI] [PubMed] [Google Scholar]
- 68.Levelt, W. J. M. Speaking: From Intention to Articulation. (MIT Press, 1993).
- 69.Boudewyn MA, Carter CS. I must have missed that: Alpha-band oscillations track attention to spoken language. Neuropsychologia. 2018;117:148–155. doi: 10.1016/j.neuropsychologia.2018.05.024. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets generated during and/or analyzed during the current study are available in the Donders repository, https://data.donders.ru.nl/collections/di/dccn/DSC_3011097.01_968?4.