Abstract
The electroencephalographic (EEG) correlates of degraded speech perception have been explored in a number of recent studies. However, such investigations have often been inconclusive as to whether observed differences in brain responses between conditions result from different acoustic properties of more or less intelligible stimuli or whether they relate to cognitive processes implicated in comprehending challenging stimuli. In this study we used noise vocoding to spectrally degrade monosyllabic words in order to manipulate their intelligibility. We used spectral rotation to generate incomprehensible control conditions matched in terms of spectral detail. We recorded EEG from 14 volunteers who listened to a series of noise vocoded (NV) and noise-vocoded spectrally-rotated (rNV) words, while they carried out a detection task. We specifically sought components of the EEG response that showed an interaction between spectral rotation and spectral degradation. This reflects those aspects of the brain electrical response that are related to the intelligibility of acoustically degraded monosyllabic words, while controlling for spectral detail. An interaction between spectral complexity and rotation was apparent in both evoked and induced activity. Analyses of event-related potentials showed an interaction effect for a P300-like component at several centro-parietal electrodes. Time-frequency analysis of the EEG signal in the alpha-band revealed a monotonic increase in event-related desynchronization (ERD) for the NV but not the rNV stimuli in the alpha band at a left temporo-central electrode cluster from 420–560 ms reflecting a direct relationship between the strength of alpha-band ERD and intelligibility. By matching NV words with their incomprehensible rNV homologues, we reveal the spatiotemporal pattern of evoked and induced processes involved in degraded speech perception, largely uncontaminated by purely acoustic effects.
Keywords: speech intelligibility, degraded speech, noise-vocoding, alpha oscillations, left inferior temporal cortex
Introduction
Despite the great acoustic variability of the speech signal, normally-hearing listeners are able to understand speech seemingly effortlessly in day-to-day situations. In order for this to be possible, the human speech perception system must be robust in the face of both natural variability and acoustic degradations. Natural variability can arise from the different realization of speech sounds by different speakers, who can be understood even though they vary in terms of their size and sex (Peterson and Barney, 1952; Smith et al., 2005), accent (Clarke and Garrett, 2004; Clopper and Pisoni, 2004; Evans and Iverson, 2004), and speech rate (Miller and Liberman, 1979), or may suffer from articulation disorders such as dysarthria (Darley et al., 1969; Kent et al., 1989). Beyond signal variations related to the speaker, external factors also have an impact on the quality of speech that is heard, such as transmission through telecommunications systems, in which case it is heavily filtered, the presence of background noise masking part of the speech signal, the presence of echoes, or the presence of multiple talkers simultaneously.
In order to investigate the mechanisms of speech perception, researchers are increasingly turning to paradigms employing artificial acoustic degradations of speech, which allow fine-grained manipulation of the level of intelligibility of a speech signal, rendering the behavioral or neural correlates of speech intelligibility amenable to investigation. Several types of manipulations have been employed, such as interrupted speech (Heinrich et al., 2008; Shahin et al., 2009), masking with noise (Davis and Johnsrude, 2003; Golestani et al., 2013), time-compression (Altmann and Young, 1993; Mehler et al., 1993; Dupoux and Green, 1997; Pallier et al., 1998; Sebastian-Galles et al., 2000), or noise-vocoding (Shannon et al., 1995). We chose to employ the latter of these, as it has been the subject of intensive research both behaviorally (e.g., Davis et al., 2005; Stacey and Summerfield, 2007; Hervais-Adelman et al., 2008, 2011; Dahan and Mead, 2010) and increasingly in neuroimaging experiments (e.g., Scott et al., 2000; Davis and Johnsrude, 2003; Scott et al., 2006; McGettigan et al., 2011; Obleser and Kotz, 2011; Hervais-Adelman et al., 2012; Evans et al., 2013).
An increasing amount of evidence regarding the neural correlates of degraded speech perception is becoming available. Functional magnetic resonance imaging (fMRI) has been extensively used to detect brain regions active while listening to degraded speech (e.g., Scott et al., 2000; Davis and Johnsrude, 2003; Giraud et al., 2004; Davis and Johnsrude, 2007; McGettigan et al., 2011; Hervais-Adelman et al., 2012; Wild et al., 2012a), while electro-encephalography (EEG) and magneto-encephalography (MEG) have been employed to study the timing of degraded speech processing through measures such as evoked response potentials and synchronized brain oscillations (e.g., Obleser and Kotz, 2011; Sohoglu et al., 2012; Peelle et al., 2013). Such experiments also provide insights into the cerebral processes that support speech perception in hearing-impaired listeners.
Neuronal oscillations are an important tool in the study of different brain functions, such as speech perception, as they address the issue of synchronization of neuronal networks within a given brain region as well as between regions, based on data obtained non-invasively and at the temporal scale neuronal activity occurs. Recent studies (reviewed by Weisz and Obleser, 2014) have focused on brain oscillations in auditory processing and speech perception. Among the different “brain rhythms”, which differ from each other on the basis of their characteristic frequency (e.g., delta oscillations are of low frequency, 1–3 Hz, while gamma oscillations have a high frequency of 30–80 Hz) and which seem to play a role in speech processing, a major stream of research has focused on the alpha rhythm (the range of 8–13 Hz). Traditionally, alpha rhythm has been considered as being highly related to visual spatial attention (Thut et al., 2006), beginning with the reports of Hans Berger in the late 1920s (Berger, 1929). Berger (1929) observed that opening the eyes lead to clear attenuation of previously visible oscillations in the 10 Hz range over occipital electrodes. Since then, numerous studies have reported findings about the close relationship of alpha rhythm activity and the visual system (e.g., Makeig et al., 2002; Becker et al., 2008; Busch et al., 2009; Mathewson et al., 2009) as well as working memory tasks (Jokisch and Jensen, 2007) to attentional and other cognitive paradigms (for a review, see Klimesch, 1999).
Despite this strong interest in alpha rhythm, much less is known about the relationship of alpha activity and auditory processing. This may be in part owed to the fact that resting alpha is much more prominent in occipital electrodes, likely detecting visual-cortical activity rather than in temporal electrodes. This might be related to the larger volume of the visual cortex compared to the auditory cortex and to the fact that it is impossible to completely deprive a healthy, hearing individual from auditory input but easy to close one’s eyes and thereby block visual input (for a review on auditory alpha see Weisz et al., 2011). The first reports of auditory-cortical oscillations in the alpha-band originate from MEG studies, in which the rhythm was initially named “tau” (Tiihonen et al., 1991; Lehtela et al., 1997). Lehtela et al. (1997) demonstrated that the presentation of short (500 ms) noise bursts was followed by decreases in alpha power, localized in the superior temporal lobes, suggesting a role for alpha as a marker of auditory processing similar to that shown in the visual system. Regarding alpha oscillations and speech perception, Krause et al. (1997) reported stronger alpha-band suppression for listening to a comprehensible text passage as when compared to listening to the same passage being played backwards (Krause et al., 1997). Despite their scarcity, such studies point to a functional role of alpha oscillations in processing speech.
In a more recent study, Obleser and Weisz (2012) investigated the role of alpha suppression in speech comprehension using degraded speech. They employed noise-vocoding, a form of artificial degradation which reduces the spectral information in the auditory signal (Shannon et al., 1995), in a graded manner, permitting the generation of stimuli on a continuum from unintelligible to intelligible, by increasing the spectral fidelity of the vocoding. The method is described in Section Stimuli below. Obleser and Weisz (2012) used words at different levels of intelligibility and hypothesized that alpha suppression should be enhanced with intelligibility, reflecting less need for functional inhibition and less effortful speech processing. This idea is compatible with the conception of alpha oscillations as a mechanism of gating or suppressing task-irrelevant high frequency oscillations (Osipova et al., 2008; Jensen and Mazaheri, 2010). In other words, a decrease in alpha power in a task-relevant region would accompany the disinhibition of gamma oscillations in the same region, which are thought to reflect active processing. In general, alpha suppression is accompanied by an increase of oscillations in the gamma band, which reflects engagement/processing as it has been shown by intracranial studies in animals and humans (e.g., Paller et al., 1987; Fries, 2005; Kaiser and Lutzenberger, 2005; Crone et al., 2006; Womelsdorf et al., 2007).
Obleser and Weisz (2012) showed a linear increase in alpha suppression as a function of word intelligibility. They interpret this finding as reflecting the listeners’ effort or ability to comprehend degraded speech. The alpha suppression was localized in superior parietal, prefrontal and anterior temporal areas. This may indicate that these brain regions are more active during the task, assuming that a local decrease in alpha power is a marker of activation of the region in question. This idea is backed by early findings of changes in resting-state alpha power as well as by numerous more recent EEG-fMRI studies which reported an inverse relationship between alpha-power and BOLD signal, under rest as well as during stimulation (Laufs et al., 2003; Moosmann et al., 2003; Goncalves et al., 2006; de Munck et al., 2007; Becker et al., 2011). Furthermore, a more recent study showed an even more direct inverse relationship between alpha-power and neuronal firing rate in monkeys (Haegens et al., 2011). The localization of the alpha-suppresion effect reported by Obleser and Weisz (2012) is partially in agreement with previous fMRI studies seeking to identify the brain regions implicated in the processing of degraded but potentially comprehensible speech (Scott et al., 2000; Narain et al., 2003; Giraud et al., 2004; Eisner et al., 2010; Wild et al., 2012a,b), revealing recruitment of brain areas involved in speech processing in general, such as bilateral superior temporal gyrus (STG) and superior temporal sulcus (STS), together with a more left-lateralized inferior-frontal and motor network.
In the present study, our aims were twofold: (1) we aimed to dissociate the EEG signatures of intelligibility and spectral complexity while listening to degraded speech, using a paradigm similar to the one published by Obleser and Weisz (2012). To this end, we asked participants to listen carefully to noise-vocoded (NV) words with different levels of degradation (therefore different levels of spectral complexity), and importantly, to the spectrally rotated version of the same stimuli. Spectrally rotated speech (Blesser, 1972) retains the same amount of spectral complexity as its non-rotated equivalent but it is incomprehensible to the naïve listener [although listeners may adapt to it after extensive training (Green et al., 2013)]. In this way, we had a spectrally-matched control condition for each level of intelligibility in order to rule out the possibility that alpha suppression is purely driven by low-level acoustic properties of the signal. Importantly, we used monosyllabic words, which are very challenging for naïve listeners to understand when degraded, in order to increase task difficulty and limit the use of top-down processes. As lexical and prosodic information facilitate comprehension and perceptual learning of degraded speech (e.g., Davis et al., 2005), by using monosyllabic words our listeners would have to rely almost exclusively on the acoustic information they could extract from the degraded input. The nature of this acoustic input was therefore essential for comprehension, given the lack of other sources of information in the stimuli and (2) by using the approach described above, we wanted to examine both induced and evoked correlates for degraded speech processing, their timing, their topography as well as the putative cerebral sources underlying the observed effects. Although the work presented here employs artificial acoustic degradation to examine the neural underpinnings of degraded speech perception, we hope that the findings will also be relevant to the cerebral processes that help to compensate for degraded auditory input in hearing impaired listeners.
Materials and methods
Participants
Fourteen right-handed native French speakers (two male) participated in the study. Participants self-reported as being right-handed and having no history of hearing or visual impairment. They all gave written informed consent to participate in the study, which was approved by the local ethics committee of the University Hospital of Geneva, and received financial compensation of 40 CHF.
Stimuli
Stimuli were 360 monosyllabic French nouns, among which 36 animal names, selected from the “Lexique 3” database for French words.1 The animal names were used as targets in the detection task we employed. All words, apart from the animal names, were divided into three groups, matched for spoken wordform frequency (F2,321 = 0.205, p = 0.82; Group 1 mean = 31.94/million, Group 2 mean = 27.43/million and Group 3 mean = 28.37/million). The animal names used had mean frequency = 15.41/million. Stimulus matching was achieved using the Match program.2
The words were recorded in a soundproof chamber by a male native French speaker and digitized at a 44.1 kHz sampling rate. Recordings were denoised using the algorithm implemented in Audacity software3 and trimmed at zero-crossings preceding and succeeding the words. Root mean square (RMS) amplitude of each of the extracted stimuli was set to a fixed level, and the stimuli were then bandpass filtered between 50 and 5000 Hz using a sixth order butterworth filter. Stimuli were then NV using 1, 4, 8 and 16 frequency bands following the procedure described by Shannon et al. (1995). Stimuli were filtered into quasi-logarithmically spaced frequency bands intended to mimic the tonotopic organization of the cochlea (Greenwood, 1990) between 50 and 5000 Hz, using second order butterworth filters and full-wave rectified, producing the amplitude envelope of each band. Each envelope was convolved with noise band-pass filtered into the same frequency range as the source band. The amplitude-modulated carriers were then recombined to produce NV words. The number of frequency bands has been shown to be a crucial factor for the intelligibility of vocoded words, with higher numbers of bands producing more intelligible stimuli (Shannon et al., 1995). The four NV versions of each word were created, producing a continuum from completely unintelligible (1-band noise-vocoded, NV1) to relatively easily comprehensible (16-band noise-vocoded, NV16).
Bandpass-filtered and NV words were also spectrally rotated, in order to create a control condition preserving the same amount of spectral information but rendering the input incomprehensible. Spectral rotation was achieved based on a procedure defined by Blesser (1972) and implemented following the procedure described by Scott et al. (2000). The speech signal was rotated around the midpoint of the frequency range of the bandpass filtered input (i.e., 2.5 kHz) and then pre-emphasized using a finite response (FIR) filter with the same long-term spectral distribution as the original input. Finally, signal was modulated by a sinusoid at 5 kHz. NV1 words were not spectrally rotated, since their spectral profile is that of white noise, i.e., flat, and would not be altered by rotation. Example NV and spectrally-rotated NV stimuli are illustrated in Figure 1.
These manipulations yielded four levels of spectral detail, crossed with the factor spectral rotation: band-pass filtered words (BP), NV16 words, 8-band noise-vocoded words (NV8) and 4-band noise-vocoded words (NV4) and their spectrally rotated homologues (rBP, rNV16, rNV8, rNV4), as well as a 1-band NV (NV1, equivalent to signal-correlated noise) control condition.
The experiment was divided into three blocks (see Section Procedure, below), for which stimulus selection proceeded as follows. Words were randomly selected from the pool of 108 non-target stimuli of each stimulus group, and allocated without replacement to one of the four non-rotated conditions (NV4, NV8, NV16, BP). Each selected word was also allocated to the spectrally rotated condition at the same level of spectral detail. Twenty seven words were allocated to each level of degradation per block. Due to the limited number of target stimuli (the 36 animal names) these were randomly allocated without replacement to each of the four levels of degradation, with a new randomization applied for each of the three blocks, thus each target stimulus appeared three times in a non-rotated condition and three times in a rotated condition over the course of the experiment. For each block, 27 words were randomly selected without replacement from the whole pool of stimuli and allocated to the NV1 condition. There were therefore 81 non-target stimuli per condition and 27 target stimuli in each condition barring NV1, for a total of 279 trials in each of the three blocks.
Procedure
Participants were seated in front of a computer screen, at a distance of approximately 1 m, in a sound-insulated Faraday cage. The overhead light in the booth was turned off while EEG was recorded. Stimuli were delivered through ER4 noise-isolating in-ear headphones (Etymotic Research Inc., Elk Grove Village, Illinois) at a comfortable sound level, adjusted at the beginning of the experiment.
The experiment was divided into three blocks of 12.5 min and 279 trials each. Participants were instructed to listen carefully to the words and respond each time they heard an animal name by pressing a button on a response-box placed on a table in front of them with their right index finger. Brain electrical activity was recorded during the whole period of each block. Short breaks took place after the end of the first two blocks in order to check, and if necessary reduce, the impedances of the electrodes.
Each trial began with the appearance of a fixation cross at the center of the screen. The stimulus was presented after a silent interval whose duration was randomly jittered on a uniform distribution between 400 and 600 ms after the onset of the fixation cross. The fixation cross remained on screen during the presentation of the word so as to encourage fixation and minimize eye movements. 1000 ms after the offset of the stimulus a symbol appeared on-screen for 1000 ms, indicating to participants that they could blink if they wished. By cueing blinks we aimed to ensure that any blinking-related electrical artefacts would not contaminate the recording of EEG responses to the stimuli. The structure of a single trial is illustrated in Figure 2.
EEG recording
Brain electrical responses were recorded with a 256-electrode Electrical Geodesics HyrdoCel system (Electrical Geodesics Inc., Eugene, Oregon). Signal was recorded continuously and digitized at a sampling rate of 1000 Hz. By default, the recording system sampled at 20 kHz before applying an analog hardware antialiasing filter with a cut-off frequency of 4 kHz and downsampling the signal to 1000 Hz, and applying a software low-pass Butterworth filter with a cutoff of 400 Hz. The reference electrode was the Cz, situated at the vertex. Electrode impedances were checked at the beginning of the session and after the first and second recording blocks and were under 30 kΩ at the beginning of each block.
Data analysis
Behavioral data
We computed and analyzed accuracy scores and response times for correct trials. We also analyzed the number of false alarms per condition.
EEG data preprocessing and artifact removal
EEG data were initially analyzed using custom Matlab (The Mathworks, Natick, MA) scripts and the freely available EEGLAB toolbox (Delorme and Makeig, 2004). Data were re-referenced to average reference and downsampled to 200 Hz (after low-pass filtering to avoid aliasing). For further analyses a set of 204 channels was analyzed (channels covering the cheeks were excluded). The three blocks per subject were concatenated and an Independent Components Analysis (ICA) was computed on the whole dataset using the Infomax routine from the Matlab-based EEGLAB toolbox (Delorme and Makeig, 2004) in order to remove blink artefacts and 50 Hz line-noise. The resulting data were filtered between 0.75 and 40 Hz using a fifth order Butterworth bandpass filter and separated into epochs starting 800 ms before the sound onset and finishing 1000 ms after. A baseline correction was applied by subtracting from each epoch the mean signal computed over 200 ms preceding the onset of the stimulus. The filtered and epoched data were scanned to detect epochs in which the amplitude between 300 ms pre-stimulus onset and the end of the epoch was higher than 75 μV or lower than −75 μV. These epochs were considered outliers and were excluded from further analysis.
Furthermore, only trials with non-target words and no button presses (i.e., false alarms) were kept for further EEG analyses.
Analysis of evoked activity—ERP analysis
Single-trial evoked responses were averaged for each condition separately to examine the component of neural activity being phase-locked to the stimulation event, i.e., to obtain condition-specific event-related potentials (ERPs). Data were analyzed in a time window from −100 to 1000 ms about stimulus onset.
Analysis of induced activity—time-frequency analysis
Using the EEGLAB toolbox, we chose a hanning-tapered short-term fast-fourier-transformation (stFFT) to compute time-frequency representations of our data in the range of the alpha band (8–13 Hz). These time-frequency power fluctuations (referred to as TFα, in μV2) were then converted to dB logarithmic scale using the following equation:
(1) |
and finally averaged across the defined frequency band. As for the ERPs, data were analyzed in a time window from −100 to 1000 ms.
ANOVA
The ERPs as well as the stFFT data were submitted to a repeated-measures ANOVA, including two factors: spectral detail (four levels, 4-bands, 8-bands, 16-bands and band-pass filtered), and spectral rotation (two levels, non-rotated and rotated), and including subject as a random factor. We were specifically interested in the interaction of spectral detail and spectral rotation to identify correlates of degraded word processing, which are not confounded with the factor of spectral detail. ANOVA was performed for each time point and electrode.
Inverse solution modeling
For the ERPs as well as the stFFT results we used the weighted minimum norm (WMN) approach (Lin et al., 2006), which belongs to the family of distributed inverse solution methods. We computed inverse solutions by applying the WMN inverse matrix to the data (5018 solution points, no regularization). The lead field model we employed was a LSMAC model (locally spherical model with anatomical constraints, for details about this approach see Brunet et al., 2011) which then in turn is applied to the MNI brain template (ICBM152) coregistered to EEG electrodes. Standard spatial electrode positions were used in all subjects, co-registered to the template MRI by adjusting the position of the nasion, inion, Cz and pre-auricular landmarks.
For the ERP data, condition and subject specific averages were inverted using the method described above and then subject to the same ANOVA procedure as the surface EEG data. To compute the inverse equivalent of the stFFT surface data in the alpha-band, we filtered the single EEG trials for each condition and subject in the alpha frequency band, inverted them and then averaged the normed (i.e., scalar) values of all single trials (similar to the approach used by de Pasquale et al., 2013). This results in a temporally resolved representation of alpha-band power distributed across 5018 solution points in the inverse space. Afterwards, these WMN inverted averages were subject to the ANOVA procedure as stated above. For visualization, results were projected onto the co-registered MNI brain template using the Cartool toolbox (Brunet et al., 2011).
Results
Behavioral data
Mean accuracy values for the non-rotated potentially intelligible conditions were 26, 66, 80 and 91% for the 4-bands, 8-bands, 16-bands and bandpass-filtered stimuli respectively. Accuracy values entered in a one-way ANOVA with spectral detail as the within-subject factor (four levels: 4-bands, 8-bands, 16-bands and bandpass-filtered), which revealed a significant main effect of spectral detail (F(3,39) = 339.931, p < 10-6, partial-η2 = 0.96). The mean accuracy value per condition is displayed in Figure 3A.
Response times for the intelligible correct trials were also computed and entered in a one-way repeated-measures ANOVA with spectral detail as the within-subjects factor (four levels, as described above). There was a significant main effect of spectral detail (F(3,39) = 26.531, p < 0.001, partial-η2 = 0.67) with response latencies being faster for intelligible trials and slower for more degraded words. Response time results are displayed in Figure 3B. We did not compute accuracy values or response times for the rotated trials, as no response could be categorized as “correct” in the face of incomprehensible stimuli. Those instances where participants did respond must be considered false alarms.
We also analyzed the number of false alarms as we expected more false alarms in the unintelligible or potentially intelligible but difficult conditions. The 1-band NV words were not included in this analysis. Number of false alarms was entered a repeated-measures ANOVA with spectral detail (four-levels, as described above) and spectral rotation (two levels: spectrally rotated and non-rotated) as within-subjects factors. There was a significant main effect of spectral complexity (F(3,19) = 5.037, p = 0.021, partial-η2 = 0.279) and a significant spectral complexity by rotation interaction (F(3,19) = 8.534, p = 0.001, partial-η2 = 0.396). The mean false alarms per condition is displayed in Figure 3C.
Evoked activity—ERP analysis
Average ERPs were entered into a two-way, repeated measures analysis of variance with number of frequency bands (i.e., spectral detail) and rotation as within-subjects factors. ANOVA was performed for each channel and sample point. To correct for multiple comparisons, we employed the approach of controlling the false discovery rate, FDR (Benjamini and Yekutieli, 2001) using a threshold of p(FDR) < 0.05. In order to ensure we report robust results, we additionally disregard results involving fewer than two electrodes or having a duration of less than three consecutive sample points (15 ms). After FDR correction, we found the following main effects, at p(FDR) < 0.05, (uncorrected p-values are provided here): There was a significant main effect of rotation, temporally centered around 305 ms, involving up to eight supra-threshold electrodes. At the centroparietal peak electrode 132, F(1,13) = 57.59, p < 3.97*10-6, the effect ranged from 295 to 325 ms. A main effect of spectral detail was found in a set of seven left superior-parietal and right temporal electrodes, in a time-window ranging from 185 to 215 ms post stimulus-onset. At the centroparietal peak electrode 81, F(3,39) = 16.5, p < 4.45*10-7.
The focus of our analysis was the interaction between the number of frequency bands and spectral rotation which was intended to specifically reveal the EEG signatures of listening to degraded words, while controlling for the impact of spectral complexity. We observed a significant spectral detail by rotation interaction located over a set of spatially coherent central parieto-frontal electrodes, in one distinct post-stimulus time-window, from 305–390 ms, peaking at 345 ms (comprising a cluster of up to five supra-threshold electrodes around electrode 186, with maximum F(3,39) = 21.96, p < 1.72*10-8, Figures 4A, B). It appears that the effect in this time-window is driven specifically by a significantly greater positivity in response to the bandpass-filtered words in comparison to all other categories of stimuli (see Figure 4D). In order to confirm this hypothesis, a post-hoc analysis was carried out, comparing the clear condition with all others, pooled, in a univariate ANOVA, including subject as a random factor. This showed that the clear condition was indeed significantly different from all the others F (1,13) = 45.303, p < 0.001, partial-η2 = 0.777.
Induced activity—time-frequency analysis
ANOVA and correction for multiple comparisons was performed as for the ERP analysis reported above. After FDR correction, we found no significant main effects. We found a significant interaction in the alpha-band, at electrodes situated over the left temporal lobe, from 462–633 ms, with the peak of this effect found at 533 ms (comprising a spatially coherent cluster of eight supra-threshold electrodes around left-temporal electrode 75 with maximum F(3,39) = 12.12, p < 9.23*10-6 see Figures 5A, B). This spatiotemporally coherent effect was manifest as a decrease in alpha-band power (i.e., alpha suppression) as a function of stimulus clarity for the NV but not rNV conditions (see Figures 5D, E). In contrast to the earlier effect revealed in the ERP analysis, this effect showed a graded response, suggesting sensitivity to the difficulty of comprehending words at different levels of degradation. Sidak-corrected post-hoc pairwise comparisons comparing the alpha-band power averaged over the 5 electrodes showing the greatest interaction effect in the period from 462–633 ms for the four potentially-comprehensible conditions partly support this: NV4 > NV16 (p = 0.021), NV4 > BP (p = 0.011), NV8 shows marginally less alpha power than BP (p = 0.063), other comparisons not significant. Although not all pairwise differences between the levels are significant, this is suggestive of increasing alpha-suppression with increasing intelligibility.
Inverse solutions
For visualization of results in the inverse space, we performed identical statistics as those on the surface data, confined to the two temporal windows showing FDR-corrected effects in both the ERP and the induced activity. The results are presented in Figures 4C, 5C showing the resulting F-values averaged over the time-window of interest.
For effects on evoked activity, the source of the corresponding effect (i.e., the interaction between spectral complexity and rotation) in the time window from 300–400 ms with a peak at approximately −13, −27, 63 (MNI co-ordinates) principally located in medial precentral gyrus (BA6, extending posteriorly into BA4). This effect is shown in Figure 4C.
The source corresponding to the interaction between spectral complexity and rotation in the alpha band (time window 450–650 ms) was localized to the left superior temporal lobe/inferior parietal lobe. The maximum effect was located at −46, −27, 20 (MNI co-ordinates), and spanned the posterior reaches of the left supramarginal gyrus, and covered the superior posterior temporal gyrus. The effect is presented in Figure 5C.
Discussion
Behavioral data demonstrate that the rNV conditions were unintelligible to the participants in this study, while the intelligibility of the NV conditions increased as a function of the number of frequency bands used, as previously demonstrated (e.g., Shannon et al., 1995; Davis and Johnsrude, 2003). Although we did not obtain responses for every trial, we are confident that the d’ measures established for the target-detection task reflect the mean level of intelligibility of each of the conditions employed.
Our analysis of the EEG data revealed two time-periods in which the brain response is significantly affected by the potential intelligibility of a stimulus. In the earlier one of these, we show an effect in evoked activity that appears to relate to the early identification of clear stimuli as a special category. Its timing and its topography suggest that we may be detecting modulation of the P300 component (for a review of the P300, see Polich, 2007). The P300 is usually apparent as a positivity in the midline parieto-frontal electrodes and is observed in tasks, such as the animal name detection task used here, that require stimulus discrimination. Its appearance has been suggested to be an index of the occurrence of stimulus events sufficiently important to inhibit concurrent processes, and has therefore been associated with attention and memory processes (Polich, 2007). In the present case, it could reflect the fact that deciding whether the stimulus is a target or not is substantially easier when the word is more easily intelligible. Another possibility is that because the clear stimuli are categorically different from all others, this relatively early effect results from an oddball effect (Polich and Margala, 1997). This is also supported by the fact that the probability of a clear stimulus being presented was relatively low, at only 13%. The fact that this evoked effect seems to be rather central than left-lateralized could also be seen to support the view of this component being rather a general cognitive component than one specific to language processing.
We did not find effects in the evoked responses that we can more specifically ascribe to comprehension processes. This may be the result of the inherent difficulty of time-locking EEG responses to specific events during auditory word processing. Although we used the acoustic onset of the stimuli as our marker for the beginning of each epoch, given that we are interested in comprehension processes rather than auditory processes, this may not be the best point. Ideally, we might have used the recognition point determined using (for example) gating (Grosjean, 1980). This issue, of course, applies to all studies of spoken word perception that use measures with a high temporal resolution.
During a second time-window, we showed a significant interaction between spectral rotation and spectral complexity on induced activity—specifically the alpha band, reflecting increased alpha suppression as a function of increasing spectral complexity in the NV (i.e., potentially comprehensible) and not the rNV (always unintelligible) stimuli. This finding is superficially similar to that reported by Obleser and Weisz (2012), who demonstrated a connection between alpha-band suppression and intelligibility of stimuli. However, by including the spectrally rotated stimuli as an unintelligible control condition we extended this finding by confirming that the relationship between alpha-suppression and intelligibility is almost certainly the result of brain mechanisms that extract meaning from words, rather than the result of purely acoustic analysis of more vs. less complex auditory input. Furthermore, the effects we find occur earlier than those reported by Obleser and Weisz (2012). This may be the result of our having employed exclusively monosyllabic words rather than the mixture mono-, bi- and trisyllabic words they employed.
As discussed in Section Introduction, the functional role of auditory alpha is unclear, although it is increasingly becoming a focus of attention in the field of speech perception. At present, the relevant evidence seems to indicate that alpha-power suppression is related to comprehension, and it has been suggested that this could relate to the role of alpha-band activity in suppressing higher-frequency oscillations. It may be the case that alpha-band activity reveals an inhibitory process that suppresses processes whose occurrence is indicated by the presence of higher-frequency oscillations (Osipova et al., 2008). Thus, alpha-suppression may reflect the release of inhibition of processing. In the present case, where alpha-suppression reflects the intelligibility of auditory input, it is highly likely that the process indexed by this effect is related to word identification and comprehension. This effect is present in the time range of the N400 complex, which is related to semantic processing (Kutas and Hillyard, 1984).
Increased alpha-suppression for more easily comprehensible words during this time window is consistent with the idea that this effect reveals the on-average greater semantic processing in the easier compared to the harder conditions. However, a less prosaic explanation of this effect would be that the relatively higher alpha power in the more challenging conditions reflects increased functional inhibition related to the demands placed on attention and working memory by the challenge of comprehending acoustically degraded speech. Indeed, several studies have shown that the ability to comprehend degraded speech is influenced by working memory capacity (Ronnberg et al., 2008, 2010; Zekveld et al., 2009, 2011, 2012; Rudner et al., 2011) and selective attention (Shinn-Cunningham and Best, 2008; Wild et al., 2012b). It is possible that this effect is the manifestation of the inhibitory networks that are required to maintain selective attention and working memory processes to support the comprehension of degraded speech. A possibility raised by Obleser and Weisz (2012) is that the increase in alpha-suppression observed in response to less degraded stimuli is not necessarily increased suppression as a function of increased intelligibility, but increasing alpha-power as stimulus intelligibility falls. If this is the case, then the effect may be explained if alpha is considered to be a gating mechanism that inhibits other cognitive processes locally while challenging speech comprehension takes place.
Our data indicate that—in comparison to baseline—there is indeed an increase in alpha-power in response to the most challenging NV condition, indeed suggesting that the role of temporal alpha may be to actively regulate the engagement of downstream cognitive processes (confirmed by one-tailed posthoc t-test, p = 0.017). In the present case, it is possible that suppressing the final stages of word-identification processes (i.e., lexical access or semantic access) is a way of improving word-identification accuracy by enabling additional time for processing of the acoustic input. The possibility that the identification processes are delayed as a function of degradation can be investigated in future studies.
The effect at this time was localized to a region incorporating the left supramarginal gyrus (SMG), left inferior parietal lobule, and the posterior left superior temporal gyrus. This approximate localization situates the effect in a region that has been considered by some authors to be part of Wernicke’s region (Geschwind, 1972; Bogen and Bogen, 1976) and has also been associated with sensorimotor integration during speech comprehension (Hickok and Poeppel, 2007). A role for sensorimotor integration during degraded speech comprehension would be consistent with the notion that, when confronted with degraded speech, the speech comprehension system falls back on higher-level (top-down) mechanisms to help resolve the degraded acoustic input. In this case, since very little linguistic information is present in the degraded monosyllabic stimuli, such information could potentially be articulatory in nature (e.g., as suggested by Hervais-Adelman et al., 2012). Nevertheless, beyond implicating this region in degraded speech processing, evidence for its exact role is scant.
The localization of the source of this alpha-suppression effect using a weighted minimum norm estimate was rather different to that shown by Obleser and Weisz (2012) using a beamformer approach. While we show relatively localized sources, they showed more distributed sources incorporating anterior temporal regions, parietal lobes, right dorsolateral prefrontal cortex and left inferior frontal regions.
Another potentially fruitful line of enquiry concerns the link between alpha-suppression and the pulvinar nucleus of the thalamus. Although we do not directly observe any effects in the pulvinar in this study, an investigation by Erb et al. (2012) implicated this structure as being linked to individuals’ ability to learn to comprehend NV speech. Activity in the pulvinar nucleus has been suggested as a driver of alpha suppression (Lopes da Silva et al., 1980; Liu et al., 2012), and is also linked to attentional control in vision (e.g., Kastner et al., 2004; Smith et al., 2009) and audition (Wester et al., 2001), while attention has been found to affect the cerebral processing of NV speech (Wild et al., 2012b). Although at this stage this potential link is highly speculative, we would suggest that the thalamo-cortical networks implicated in alpha-band activity are worthwhile targets for investigations of speech comprehension.
Interestingly, we do not find regions in which alpha-suppression shows the opposite response to intelligibility (i.e., alpha is more suppressed when stimuli are harder to understand). This is inconsistent with the fMRI literature, in which many studies have demonstrated the recruitment of additional brain areas when speech perception is challenging due to acoustic degradation compared to when it is clear. For example, several studies have demonstrated that left inferior frontal gyrus regions are engaged when acoustically degraded speech is presented (Davis and Johnsrude, 2003; Giraud et al., 2004; Obleser et al., 2007; Hervais-Adelman et al., 2012; Wild et al., 2012b), others have shown increased recruitment of anterior and posterior temporal lobe structures in the face of acoustic degradation (Scott et al., 2000; Narain et al., 2003; Evans et al., 2013). We would have expected to see such effects reflected in the EEG signature of degraded speech processing. That we do not find effects in this direction in these data is puzzling and demands further investigation. However, generation of alpha oscillations can differ considerably from site to site, even within the visual system. This has been reported for example with regard to originating layers of alpha and even relationship of the measured alpha oscillations to behavioral performance (Bollimunta et al., 2008).
Another interesting detail is that the sites of our observed major effect in the alpha-band and the sites of highest spectral power in the alpha-band do not spatially coincide. As is commonly known, occipital electrodes exhibit much higher resting-state alpha power than the remaining electrodes. The left-temporal cluster identified in our study shows only moderate prestimulus alpha-amplitude. Yet its modulation is highly significant. This demonstrates that while such alpha modulation might be more difficult to identify, it can nonetheless be extracted.
In general, the link between alpha rhythm and language/word processing is relatively sparsely described. While there seems to be some consensus about auditory alpha/tau (see Lehtela et al., 1997), the idea of higher-level language-related alpha oscillations is still quite recent (e.g., Obleser and Weisz, 2012) and highly exciting. Whether this points to an even more universal role of alpha oscillations than previously envisioned remains to be seen and will require further investigations in more diverse experimental settings.
Conclusion
Taken together, the data presented above suggest that the auditory system can rapidly differentiate easily-comprehensible speech (approximately 300 ms after stimulus onset), and that potentially-comprehensible degraded speech can begin to be processed differently to incomprehensible speech as early as 480 ms after stimulus onset. We demonstrate that alpha-band power in the left temporal lobe is modulated by stimulus intelligibility. Spatial and temporal features of this effect seem to suggest this effect indexes the ease of access to word meaning. Our paradigm ensures that the alpha-band desynchronization we observe is not simply related to increasing spectral detail in the stimuli, and thus confirms that alpha-band desynchronization at left temporal sites reflects word intelligibility. These findings provide insights into the neural mechanisms of degraded speech perception, and may be taken to suggest that one strategy in compensating for acoustically-degraded input may be to suppress recognition processes that ordinarily take place rapidly and automatically, in order to permit additional processing to be carried out on the degraded signal.
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This work was supported by a Marie Curie fellowship to Robert Becker and received funding from the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 267171. Christoph M. Michel is supported by the Swiss National Science Foundation (Grant No. 310030_132952). Alexis Hervais-Adelman and Maria Pefkou were supported by the Swiss National Science Foundation (Grant No. 320030_122085 awarded to Professor Narly Golestani). The EEG equipment and Cartool software are supported by the Center for Biomedical Imaging (CIBM), Geneva and Lausanne, Switzerland. We would like to thank the reviewers for their careful reading of the manuscript and their helpful comments.
Footnotes
1http://www.lexique.org, New et al. (2001)
2www.mrccbu.cam.ac.uk/~maarten/match.htm, Van Casteren and Davis (2007)
References
- Altmann G. T. M., Young D. (1993). “Factors affecting adaptation to time-compressed speech,” Paper Presented at the Third European Conference on Speech Communication and Technology. http://www.isca-speech.org/archive/eurospeech_1993/e93_0333.html [Google Scholar]
- Becker R., Reinacher M., Freyer F., Villringer A., Ritter P. (2011). How ongoing neuronal oscillations account for evoked fMRI variability. J. Neurosci. 31, 11016–11027 10.1523/jneurosci.0210-11.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Becker R., Ritter P., Villringer A. (2008). Influence of ongoing alpha rhythm on the visual evoked potential. Neuroimage 39, 707–716 10.1016/j.neuroimage.2007.09.016 [DOI] [PubMed] [Google Scholar]
- Benjamini Y., Yekutieli D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Stat. 29, 1165–1188 10.1214/aos/1013699998 [DOI] [Google Scholar]
- Berger H. (1929). Über das elektrenkephalogramm des menschen. Eur. Arch. Psychiatry Clin. Neurosci. 87, 527–570 10.1007/BF01797193 [DOI] [Google Scholar]
- Blesser B. (1972). Speech perception under conditions of spectral transformation. I. Phonetic characteristics. J. Speech Hear. Res. 15, 5–41 [DOI] [PubMed] [Google Scholar]
- Bogen J. E., Bogen G. M. (1976). Wernicke’s region—where is it? Ann. N Y Acad. Sci. 280, 834–843 10.1111/j.1749-6632.1976.tb25546.x [DOI] [PubMed] [Google Scholar]
- Bollimunta A., Chen Y., Schroeder C. E., Ding M. (2008). Neuronal mechanisms of cortical alpha oscillations in awake-behaving macaques. J. Neurosci. 28, 9976–9988 10.1523/jneurosci.2699-08.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brunet D., Murray M. M., Michel C. M. (2011). Spatiotemporal analysis of multichannel EEG: CARTOOL. Comput. Intell. Neurosci. 2011:813870 10.1155/2011/813870 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Busch N. A., Dubois J., Vanrullen R. (2009). The phase of ongoing EEG oscillations predicts visual perception. J. Neurosci. 29, 7869–7876 10.1523/jneurosci.0113-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clarke C. M., Garrett M. F. (2004). Rapid adaptation to foreign-accented English. J. Acoust. Soc. Am. 116, 3647–3658 10.1121/1.1815131 [DOI] [PubMed] [Google Scholar]
- Clopper C. G., Pisoni D. B. (2004). Effects of talker variability on perceptual learning of dialects. Lang. Speech 47, 207–239 10.1177/00238309040470030101 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crone N. E., Sinai A., Korzeniewska A. (2006). High-frequency gamma oscillations and human brain mapping with electrocorticography. Prog. Brain Res. 159, 275–295 10.1016/s0079-6123(06)59019-3 [DOI] [PubMed] [Google Scholar]
- Dahan D., Mead R. L. (2010). Context-conditioned generalization in adaptation to distorted speech. J. Exp. Psychol. Hum. Percept. Perform. 36, 704–728 10.1037/a0017449 [DOI] [PubMed] [Google Scholar]
- Darley F. L., Aronson A. E., Brown J. R. (1969). Clusters of deviant speech dimensions in the dysarthrias. J. Speech Hear. Res. 12, 462–496 [DOI] [PubMed] [Google Scholar]
- Davis M. H., Johnsrude I. S. (2003). Hierarchical processing in spoken language comprehension. J. Neurosci. 23, 3423–3431 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davis M. H., Johnsrude I. S. (2007). Hearing speech sounds: top-down influences on the interface between audition and speech perception. Hear. Res. 229, 132–147 10.1016/j.heares.2007.01.014 [DOI] [PubMed] [Google Scholar]
- Davis M. H., Johnsrude I. S., Hervais-Adelman A. G., Taylor K., Mcgettigan C. (2005). Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. J. Exp. Psychol. Gen. 134, 222–241 10.1037/0096-3445.134.2.222 [DOI] [PubMed] [Google Scholar]
- de Munck J. C., Goncalves S. I., Huijboom L., Kuijer J. P., Pouwels P. J., Heethaar R. M., et al. (2007). The hemodynamic response of the alpha rhythm: an EEG/fMRI study. Neuroimage 35, 1142–1151 10.1016/j.neuroimage.2007.01.022 [DOI] [PubMed] [Google Scholar]
- de Pasquale F., Sabatini U., Della Penna S., Sestieri C., Caravasso C. F., Formisano R., et al. (2013). The connectivity of functional cores reveals different degrees of segregation and integration in the brain at rest. Neuroimage 69, 51–61 10.1016/j.neuroimage.2012.11.051 [DOI] [PubMed] [Google Scholar]
- Delorme A., Makeig S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 10.1016/j.jneumeth.2003.10.009 [DOI] [PubMed] [Google Scholar]
- Dupoux E., Green K. (1997). Perceptual adjustment to highly compressed speech: effects of talker and rate changes. J. Exp. Psychol. Hum. Percept. Perform. 23, 914–927 10.1037/0096-1523.23.3.914 [DOI] [PubMed] [Google Scholar]
- Eisner F., Mcgettigan C., Faulkner A., Rosen S., Scott S. K. (2010). Inferior frontal gyrus activation predicts individual differences in perceptual learning of cochlear-implant simulations. J. Neurosci. 30, 7179–7186 10.1523/jneurosci.4040-09.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Erb J., Henry M. J., Eisner F., Obleser J. (2012). Auditory skills and brain morphology predict individual differences in adaptation to degraded speech. Neuropsychologia 50, 2154–2164 10.1016/j.neuropsychologia.2012.05.013 [DOI] [PubMed] [Google Scholar]
- Evans B. G., Iverson P. (2004). Vowel normalization for accent: an investigation of best exemplar locations in northern and southern British English sentences. J. Acoust. Soc. Am. 115, 352–361 10.1121/1.1635413 [DOI] [PubMed] [Google Scholar]
- Evans S., Kyong J. S., Rosen S., Golestani N., Warren J. E., Mcgettigan C., et al. (2013). The pathways for intelligible speech: multivariate and univariate perspectives. Cereb. Cortex [Epub ahead of print]. 10.1093/cercor/bht083 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fries P. (2005). A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn. Sci. 9, 474–480 10.1016/j.tics.2005.08.011 [DOI] [PubMed] [Google Scholar]
- Geschwind N. (1972). Language and the brain. Sci. Am. 226, 76–83 10.1038/scientificamerican0472-76 [DOI] [PubMed] [Google Scholar]
- Giraud A. L., Kell C., Thierfelder C., Sterzer P., Russ M. O., Preibisch C., et al. (2004). Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing. Cereb. Cortex 14, 247–255 10.1093/cercor/bhg124 [DOI] [PubMed] [Google Scholar]
- Golestani N., Hervais-Adelman A., Obleser J., Scott S. K. (2013). Semantic versus perceptual interactions in neural processing of speech-in-noise. Neuroimage 79, 52–61 10.1016/j.neuroimage.2013.04.049 [DOI] [PubMed] [Google Scholar]
- Goncalves S. I., De Munck J. C., Pouwels P. J., Schoonhoven R., Kuijer J. P., Maurits N. M., et al. (2006). Correlating the alpha rhythm to BOLD using simultaneous EEG/fMRI: inter-subject variability. Neuroimage 30, 203–213 10.1016/j.neuroimage.2005.09.062 [DOI] [PubMed] [Google Scholar]
- Green T., Rosen S., Faulkner A., Paterson R. (2013). Adaptation to spectrally-rotated speech. J. Acoust. Soc. Am. 134, 1369 10.1121/1.4812759 [DOI] [PubMed] [Google Scholar]
- Greenwood D. D. (1990). A cochlear frequency-position function for several species—29 years later. J. Acoust. Soc. Am. 87, 2592–2605 10.1121/1.399052 [DOI] [PubMed] [Google Scholar]
- Grosjean F. (1980). Spoken word recognition processes and the gating paradigm. Percept. Psychophys. 28, 267–283 10.3758/bf03204386 [DOI] [PubMed] [Google Scholar]
- Haegens S., Nacher V., Luna R., Romo R., Jensen O. (2011). Alpha-oscillations in the monkey sensorimotor network influence discrimination performance by rhythmical inhibition of neuronal spiking. Proc. Natl. Acad. Sci. U S A 108, 19377–19382 10.1073/pnas.1117190108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heinrich A., Carlyon R. P., Davis M. H., Johnsrude I. S. (2008). Illusory vowels resulting from perceptual continuity: a functional magnetic resonance imaging study. J. Cogn. Neurosci. 20, 1737–1752 10.1162/jocn.2008.20069 [DOI] [PubMed] [Google Scholar]
- Hervais-Adelman A., Carlyon R. P., Johnsrude I. S., Davis M. H. (2012). Brain regions recruited for the effortful comprehension of noise-vocoded words. Lang. Cogn. Process. 27, 1145–1166 10.1080/01690965.2012.662280 [DOI] [Google Scholar]
- Hervais-Adelman A., Davis M. H., Johnsrude I. S., Carlyon R. P. (2008). Perceptual learning of noise vocoded words: effects of feedback and lexicality. J. Exp. Psychol. Hum. Percept. Perform. 34, 460–474 10.1037/0096-1523.34.2.460 [DOI] [PubMed] [Google Scholar]
- Hervais-Adelman A., Davis M. H., Johnsrude I. S., Taylor K. J., Carlyon R. P. (2011). Generalization of perceptual learning of vocoded speech. J. Exp. Psychol. Hum. Percept. Perform. 37, 283–295 10.1037/a0020772 [DOI] [PubMed] [Google Scholar]
- Hickok G., Poeppel D. (2007). The cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393–402 10.1038/nrn2113 [DOI] [PubMed] [Google Scholar]
- Jensen O., Mazaheri A. (2010). Shaping functional architecture by oscillatory alpha activity: gating by inhibition. Front. Hum. Neurosci. 4:186 10.3389/fnhum.2010.00186 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jokisch D., Jensen O. (2007). Modulation of gamma and alpha activity during a working memory task engaging the dorsal or ventral stream. J. Neurosci. 27, 3244–3251 10.1523/jneurosci.5399-06.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaiser J., Lutzenberger W. (2005). Cortical oscillatory activity and the dynamics of auditory memory processing. Rev. Neurosci. 16, 239–254 10.1515/revneuro.2005.16.3.239 [DOI] [PubMed] [Google Scholar]
- Kastner S., O’connor D. H., Fukui M. M., Fehd H. M., Herwig U., Pinsk M. A. (2004). Functional imaging of the human lateral geniculate nucleus and pulvinar. J. Neurophysiol. 91, 438–448 10.1152/jn.00553.2003 [DOI] [PubMed] [Google Scholar]
- Kent R. D., Weismer G., Kent J. F., Rosenbek J. C. (1989). Toward phonetic intelligibility testing in dysarthria. J. Speech Hear. Disord. 54, 482–499 [DOI] [PubMed] [Google Scholar]
- Klimesch W. (1999). EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Brain Res. Rev. 29, 169–195 10.1016/s0165-0173(98)00056-3 [DOI] [PubMed] [Google Scholar]
- Krause C. M., Porn B., Lang A. H., Laine M. (1997). Relative alpha desynchronization and synchronization during speech perception. Brain Res. Cogn. Brain Res. 5, 295–299 10.1016/s0926-6410(97)00009-8 [DOI] [PubMed] [Google Scholar]
- Kutas M., Hillyard S. A. (1984). Brain potentials during reading reflect word expectancy and semantic association. Nature 307, 161–163 10.1038/307161a0 [DOI] [PubMed] [Google Scholar]
- Laufs H., Krakow K., Sterzer P., Eger E., Beyerle A., Salek-Haddadi A., et al. (2003). Electroencephalographic signatures of attentional and cognitive default modes in spontaneous brain activity fluctuations at rest. Proc. Natl. Acad. Sci. U S A 100, 11053–11058 10.1073/pnas.1831638100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lehtela L., Salmelin R., Hari R. (1997). Evidence for reactive magnetic 10-Hz rhythm in the human auditory cortex. Neurosci. Lett. 222, 111–114 10.1016/s0304-3940(97)13361-4 [DOI] [PubMed] [Google Scholar]
- Lin F.-H., Witzel T., Ahlfors S. P., Stufflebeam S. M., Belliveau J. W., Hämäläinen M. S. (2006). Assessing and improving the spatial accuracy in MEG source localization by depth-weighted minimum-norm estimates. Neuroimage 31, 160–171 10.1016/j.neuroimage.2005.11.054 [DOI] [PubMed] [Google Scholar]
- Liu Z., De Zwart J. A., Yao B., Van Gelderen P., Kuo L. W., Duyn J. H. (2012). Finding thalamic BOLD correlates to posterior alpha EEG. Neuroimage 63, 1060–1069 10.1016/j.neuroimage.2012.08.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Loftus G. R., Masson M. E. J. (1994). Using confidence intervals in within-subjects designs. Psychon. Bull. Rev. 1, 476–490 10.3758/BF03210951 [DOI] [PubMed] [Google Scholar]
- Lopes da Silva F. H., Vos J. E., Mooibroek J., Van Rotterdam A. (1980). Relative contributions of intracortical and thalamo-cortical processes in the generation of alpha rhythms, revealed by partial coherence analysis. Electroencephalogr. Clin. Neurophysiol. 50, 449–456 10.1016/0013-4694(80)90011-5 [DOI] [PubMed] [Google Scholar]
- Makeig S., Westerfield M., Jung T.-P., Enghoff S., Townsend J., Courchesne E., et al. (2002). Dynamic brain sources of visual evoked responses. Science 295, 690–694 10.1126/science.1066168 [DOI] [PubMed] [Google Scholar]
- Mathewson K. E., Gratton G., Fabiani M., Beck D. M., Ro T. (2009). To see or not to see: prestimulus α phase predicts visual awareness. J. Neurosci. 29, 2725–2732 10.1523/jneurosci.3963-08.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McGettigan C., Warren J. E., Eisner F., Marshall C. R., Shanmugalingam P., Scott S. K. (2011). Neural correlates of sublexical processing in phonological working memory. J. Cogn. Neurosci. 23, 961–977 10.1162/jocn.2010.21491 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mehler J., Sebastian N., Altmann G., Dupoux E., Christophe A., Pallier C. (1993). Understanding compressed sentences: the role of rhythm and meaning. Ann. N Y Acad. Sci. 682, 272–282 10.1111/j.1749-6632.1993.tb22975.x [DOI] [PubMed] [Google Scholar]
- Miller J. L., Liberman A. M. (1979). Some effects of later occurring information on the perception of stop consonants and semi-vowels. Percept. Psychophys. 25, 457–465 10.3758/bf03213823 [DOI] [PubMed] [Google Scholar]
- Moosmann M., Ritter P., Krastel I., Brink A., Thees S., Blankenburg F., et al. (2003). Correlates of alpha rhythm in functional magnetic resonance imaging and near infrared spectroscopy. Neuroimage 20, 145–158 10.1016/s1053-8119(03)00344-6 [DOI] [PubMed] [Google Scholar]
- Narain C., Scott S. K., Wise R. J., Rosen S., Leff A., Iversen S. D., et al. (2003). Defining a left-lateralized response specific to intelligible speech using fMRI. Cereb. Cortex 13, 1362–1368 10.1093/cercor/bhg083 [DOI] [PubMed] [Google Scholar]
- New B., Pallier C., Ferrand L., Matos R. (2001). Une base de données lexicales du français contemporain sur internet: LEXIQUE. Annee Psychol. 101, 447–462 10.3406/psy.2001.1341 [DOI] [Google Scholar]
- Obleser J., Kotz S. A. (2011). Multiple brain signatures of integration in the comprehension of degraded speech. Neuroimage 55, 713–723 10.1016/j.neuroimage.2010.12.020 [DOI] [PubMed] [Google Scholar]
- Obleser J., Weisz N. (2012). Suppressed alpha oscillations predict intelligibility of speech and its acoustic details. Cereb. Cortex 22, 2466–2477 10.1093/cercor/bhr325 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Obleser J., Zimmermann J., Van Meter J., Rauschecker J. P. (2007). Multiple stages of auditory speech perception reflected in event-related FMRI. Cereb. Cortex 17, 2251–2257 10.1093/cercor/bhl133 [DOI] [PubMed] [Google Scholar]
- Osipova D., Hermes D., Jensen O. (2008). Gamma power is phase-locked to posterior alpha activity. PLoS One 3:e3990 10.1371/journal.pone.0003990 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paller K. A., Kutas M., Mayes A. R. (1987). Neural correlates of encoding in an incidental learning paradigm. Electroencephalogr. Clin. Neurophysiol. 67, 360–371 10.1016/0013-4694(87)90124-6 [DOI] [PubMed] [Google Scholar]
- Pallier C., Sebastian-Galles N., Dupoux E., Christophe A., Mehler J. (1998). Perceptual adjustment to time-compressed speech: a cross-linguistic study. Mem. Cognit. 26, 844–851 10.3758/bf03211403 [DOI] [PubMed] [Google Scholar]
- Peelle J. E., Gross J., Davis M. H. (2013). Phase-locked responses to speech in human auditory cortex are enhanced during comprehension. Cereb. Cortex 23, 1378–1387 10.1093/cercor/bhs118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peterson G. E., Barney H. L. (1952). Control methods used in a study of the vowels. J. Acoust. Soc. Am. 24, 175–184 10.1121/1.1906875 [DOI] [Google Scholar]
- Polich J. (2007). Updating P300: an integrative theory of P3a and P3b. Clin. Neurophysiol. 118, 2128–2148 10.1016/j.clinph.2007.04.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Polich J., Margala C. (1997). P300 and probability: comparison of oddball and single-stimulus paradigms. Int. J. Psychophysiol. 25, 169–176 10.1016/s0167-8760(96)00742-8 [DOI] [PubMed] [Google Scholar]
- Ronnberg J., Rudner M., Foo C., Lunner T. (2008). Cognition counts: a working memory system for ease of language understanding (ELU). Int. J. Audiol. 47(Suppl. 2), S99–S105 10.1080/14992020802301167 [DOI] [PubMed] [Google Scholar]
- Ronnberg J., Rudner M., Lunner T., Zekveld A. A. (2010). When cognition kicks in: working memory and speech understanding in noise. Noise Health 12, 263–269 10.4103/1463-1741.70505 [DOI] [PubMed] [Google Scholar]
- Rudner M., Ronnberg J., Lunner T. (2011). Working memory supports listening in noise for persons with hearing impairment. J. Am. Acad. Audiol. 22, 156–167 10.3766/jaaa.22.3.4 [DOI] [PubMed] [Google Scholar]
- Scott S. K., Blank C. C., Rosen S., Wise R. J. S. (2000). Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123, 2400–2406 10.1093/brain/123.12.2400 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scott S. K., Rosen S., Lang H., Wise R. J. (2006). Neural correlates of intelligibility in speech investigated with noise vocoded speech—a positron emission tomography study. J. Acoust. Soc. Am. 120, 1075–1083 10.1121/1.2216725 [DOI] [PubMed] [Google Scholar]
- Sebastian-Galles N., Dupoux E., Costa A., Mehler J. (2000). Adaptation to time-compressed speech: phonological determinants. Percept. Psychophys. 62, 834–842 10.3758/bf03206926 [DOI] [PubMed] [Google Scholar]
- Shahin A. J., Bishop C. W., Miller L. M. (2009). Neural mechanisms for illusory filling-in of degraded speech. Neuroimage 44, 1133–1143 10.1016/j.neuroimage.2008.09.045 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shannon R. V., Zeng F. G., Kamath V., Wygonski J., Ekelid M. (1995). Speech recognition with primarily temporal cues. Science 270, 303–304 10.1126/science.270.5234.303 [DOI] [PubMed] [Google Scholar]
- Shinn-Cunningham B. G., Best V. (2008). Selective attention in normal and impaired hearing. Trends Amplif. 12, 283–299 10.1177/1084713808325306 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith A. T., Cotton P. L., Bruno A., Moutsiana C. (2009). Dissociating vision and visual attention in the human pulvinar. J. Neurophysiol. 101, 917–925 10.1152/jn.90963.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith D. R., Patterson R. D., Turner R., Kawahara H., Irino T. (2005). The processing and perception of size information in speech sounds. J. Acoust. Soc. Am. 117, 305–318 10.1121/1.1828637 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sohoglu E., Peelle J. E., Carlyon R. P., Davis M. H. (2012). Predictive top-down integration of prior knowledge during speech perception. J. Neurosci. 32, 8443–8453 10.1523/jneurosci.5069-11.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stacey P. C., Summerfield Q. (2007). Effectiveness of computer-based auditory training in improving the perception of noise-vocoded speech. J. Acoust. Soc. Am. 121, 2923–2935 10.1121/1.2713668 [DOI] [PubMed] [Google Scholar]
- Thut G., Nietzel A., Brandt S. A., Pascual-Leone A. (2006). Alpha-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection. J. Neurosci. 26, 9494–9502 10.1523/jneurosci.0875-06.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tiihonen J., Hari R., Kajola M., Karhu J., Ahlfors S., Tissari S. (1991). Magnetoencephalographic 10-Hz rhythm from the human auditory cortex. Neurosci. Lett. 129, 303–305 10.1016/0304-3940(91)90486-d [DOI] [PubMed] [Google Scholar]
- Van Casteren M., Davis M. H. (2007). Match: a program to assist in matching the conditions of factorial experiments. Behav. Res. Methods 39, 973 10.3758/bf03192992 [DOI] [PubMed] [Google Scholar]
- Weisz N., Hartmann T., Muller N., Lorenz I., Obleser J. (2011). Alpha rhythms in audition: cognitive and clinical perspectives. Front. Psychol. 2:73 10.3389/fpsyg.2011.00073 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weisz N., Obleser J. (2014). Synchronisation signatures in the listening brain: a perspective from non-invasive neuroelectrophysiology. Hear. Res. 307, 16–28 10.1016/j.heares.2013.07.009 [DOI] [PubMed] [Google Scholar]
- Wester K., Irvine D. R., Hugdahl K. (2001). Auditory laterality and attentional deficits after thalamic haemorrhage. J. Neurol. 248, 676–683 10.1007/s004150170113 [DOI] [PubMed] [Google Scholar]
- Wild C. J., Davis M. H., Johnsrude I. S. (2012a). Human auditory cortex is sensitive to the perceived clarity of speech. Neuroimage 60, 1490–1502 10.1016/J.Neuroimage.2012.01.035 [DOI] [PubMed] [Google Scholar]
- Wild C. J., Yusuf A., Wilson D. E., Peelle J. E., Davis M. H., Johnsrude I. S. (2012b). Effortful listening: the processing of degraded speech depends critically on attention. J. Neurosci. 32, 14010–14021 10.1523/jneurosci.1528-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Womelsdorf T., Schoffelen J. M., Oostenveld R., Singer W., Desimone R., Engel A. K., et al. (2007). Modulation of neuronal interactions through neuronal synchronization. Science 316, 1609–1612 10.1126/science.1139597 [DOI] [PubMed] [Google Scholar]
- Zekveld A. A., Kramer S. E., Festen J. M. (2011). Cognitive load during speech perception in noise: the influence of age, hearing loss and cognition on the pupil response. Ear Hear. 32, 498–510 10.1097/aud.0b013e31820512bb [DOI] [PubMed] [Google Scholar]
- Zekveld A. A., Kramer S. E., Kessens J. M., Vlaming M. S., Houtgast T. (2009). The influence of age, hearing and working memory on the speech comprehension benefit derived from an automatic speech recognition system. Ear Hear. 30, 262–272 10.1097/aud.0b013e3181987063 [DOI] [PubMed] [Google Scholar]
- Zekveld A. A., Rudner M., Johnsrude I. S., Heslenfeld D. J., Ronnberg J. (2012). Behavioral and fMRI evidence that cognitive ability modulates the effect of semantic context on speech intelligibility. Brain Lang. 122, 103–113 10.1016/j.bandl.2012.05.006 [DOI] [PubMed] [Google Scholar]