Abstract
Inhibitory control is a cognitive process that inhibits a response. It is used in everyday activities, such as driving a motorcycle, driving a car and playing a game. The effect of this process can be compared to the red traffic light in the real world. In this study, we investigated brain connectivity under human inhibitory control using the phase lag index and inter-trial coherence (ITC). The human brain connectivity gives a more accurate representation of the functional neural network. Results of electroencephalography (EEG), the data sets were generated from twelve healthy subjects during left and right hand inhibitions using the auditory stop-signal task, showed that the inter-trial coherence in delta (1–4 Hz) and theta (4–7 Hz) band powers increased over the frontal and temporal lobe of the brain. These EEG delta and theta band activities neural markers have been related to human inhibition in the frontal lobe. In addition, inter-trial coherence in the delta-theta and alpha (8–12 Hz) band powers increased at the occipital lobe through visual stimulation. Moreover, the highest brain connectivity was observed under inhibitory control in the frontal lobe between F3-F4 channels compared to temporal and occipital lobes. The greater EEG coherence and phase lag index in the frontal lobe is associated with the human response inhibition. These findings revealed new insights to understand the neural network of brain connectivity and underlying mechanisms during human response inhibition.
Keywords: electroencephalography (EEG), inhibitory control, brain connectivity, inter-trial coherence (ITC), frontal lobe, temporal lobe, delta band, theta band
1. Introduction
The ability to suppress an ongoing motor action is known as inhibitory control or response inhibition. It is necessary for the control of executive function of the brain. Usually, inhibitory control is investigated using the stop-signal task or go/no-go task in the laboratory scale. In this study, we utilized auditory stop-signal task to examine the visual and auditory sensory pathways under the inhibitory control of different hands. Moreover, visual and auditory stimuli are used in real environment [1] and we investigated the neural activities of visual and auditory stimuli in the brain during inhibition. In the real-world, we receive many inputs simultaneously from several sensory systems, like visual and auditory stimuli. The process of auditory stimulation is generated in the temporal lobe of the central nervous system, specifically in the primary auditory cortex [2] and the process of visual stimulation occurred in the occipital lobe of the central nervous system, particularly in the primary visual cortex [3]. Therefore, we observed the brain connectivity between the frontal, temporal and occipital lobes of the brain. Previous research reported that coherence has been used to investigate connectivity between two regions of the brain under multisensory integration [4,5]. In our study, we measured brain connectivity in visual and auditory stimuli under human inhibitory control of the left hand as well as the right hand using the phase lag index and the inter-trial coherence (ITC) methods.
Furthermore, recent studies reported that significant electroencephalography (EEG) oscillations of visual perception were found in the alpha (8–12 Hz) and theta (4–7 Hz) band powers [6,7]. The human brain oscillation has been observed under multisensory integration using a decomposition of EEG signals over time and frequency. In resting state, the brain’s EEG signals have been interrupted by visual and auditory stimuli (i.e., multisensory integration effect in the human brain) [8]. In addition, EEG phase synchronization between two brain regions oscillations was measured by calculating the phase relationships between two EEG signals [9,10]. The phase lag index provides direct information of the brain connectivity under multisensory integration, which is not possible for other EEG signal analyses methods, such as event-related potential (ERP) and event-related spectral perturbation (ERSP) [8]. However, previous studies have reported that the phase lag index of brain oscillations is influenced in visual and auditory perception in response to different sensory stimulations [11,12]. In addition, brain dynamics of visual stimulus has been found in the auditory cortex of the brain [13,14,15].
Most previous studies of human response inhibition investigated the EEG neural activities under right-handed subjects with stop-signal task [16,17]. In the current study, we compared the EEG neural activities of both left-hand and right-hand response inhibitions. However, it is not clear that both groups have shown similar or different patterns of EEG oscillation in brain. It was reported that left-handed subjects showed less hemispheric asymmetries than right-handed subjects [18,19]. Studies of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) have been reported that the frontal lobe was activated during human response inhibition [20,21,22]. In addition, inability of human inhibitory control has been associated with some neurological disorders including attention deficit hyperactivity disorder (ADHD) or obsessive-compulsive disorder (OCD) [23,24]. In this paper, we investigated the cortical neural network under multisensory integration with hand response inhibitions. For the first time, we examined the brain connective by phase lag index and inter-trial coherence methods. We hypothesized that multisensory integration will affect brain connectivity in the frontal, temporal and occipital lobes of the brain.
2. Materials and Methods
2.1. Participants
Twelve male subjects and one female subject aged from 25 to 30 participated in the stop signal task. A total of 13 subjects joined this study. To eliminate gender differences in the EEG signal analysis [25], all subjects were men in this study. All subjects performed the right hand response (RHR) and left hand response (LHR) inhibitions. In go trials (75%), all subjects were instructed to respond to a square (LHR) and a circle (RHR). In stop trials (25%), an auditory stop signal (beep sound, 750 Hz, 100 ms long) was used to instruct subjects to inhibit both their left hand and right hand responses. All healthy participants were right-handed without hearing, vision impairment or psychological disorders. This study was carried out in accordance with the recommendations of the Institutional Review Board (IRB) of the National Taiwan University, Taipei, Taiwan. The study was approved by the Research Ethics Committee of the National Taiwan University, Taipei, Taiwan. All participants gave their written informed consent in accordance with the Research Ethics Committee of National Taiwan University, Taipei, Taiwan.
2.2. Experimental Scenario
The stop-signal task is a race between the go and stop trials. In the stop signal task, frequent go stimuli (75%) and infrequent stop stimuli (25%) were presented, giving the participants realistic feeling of response inhibition, as shown in Figure 1. In this study, the subjects performed an auditory stop signal task, in which the go and stop trials occurred at random. An auditory beep tone signal indicates subjects to inhibit their response in stop trial [20,21]. Moreover, the go-trial was a shape-judgment task, in which subjects need to discriminate between a square and a circle symbol, as shown in Figure 1. In go-trials (75% of trials), only visual stimuli were presented and subjects were instructed to respond to a square and a circle as quickly and accurately as possible. In stop trials (25% of trials), the visual stimuli were followed by an auditory stop signal (beep sound, 750 Hz, 100 ms long) and the subjects were instructed to inhibit their left and right hand responses. The fixation cross sign and visual-auditory stimuli were shown in the center of the computer screen, on a black background. Each go trial was started with a white central fixation cross for 250 ms, followed by a square or a circle symbol for 1000 ms. In the 25% of randomized stop-trials, subjects received a binaural auditory tone over the headphones. This short beep was presented for 100 ms as a stop signal, which triggered the subjects to inhibit their response, regardless of the symbol presented. In the stop trial, a stop signal was presented after a variable of stop signal delay (SSD). The SSD was originally set at 250 ms and it was adjusted continuously by the staircase tracking method. According to the staircase tracking process, when the subject response inhibition was successful, SSD increased by 50 ms; when the subject response inhibition was failed, the SSD decreased by 50 ms. This staircase tracking method increased the complexity of the stop signal task. The objective of the staircase follow-up procedure was to converge on an SSD where subjects successfully inhibited 50% of the stop trials. This allows the calculation of the stop signal reaction time (SSRT) by subtracting the SSD latency from the reaction time (RT) in go trials. However, the presentation of visual and auditory stimuli in the stop signal task began when the participants pressed the enter key on the keyboard. The response keys were used “Z” for square (left hand response), and “/” for circle (right hand response). The experimental was terminated when the ESC key was pressed. In this work, 180 go trails and 60 stop trials were executed for each participant.
2.3. Acquisition of EEG Signals
The EEG signals were collected from all subjects using a Scan NuAmps Express system (Compumedics USA Inc., Charlotte, NC, USA). The 32-channel EEG cap was used with Ag-AgCl electrodes. The arrangement of all EEG channels were fixed according to the international standard 10-20 system, as shown in Figure 2. To reduce the size of the data and eliminate noise, the EEG signals were sampled at 500 Hz and filtered with a bandpass (1–40 Hz) using an infinite impulse response (IIR) filter before further analysis. The EEG signals were preprocessed using custom routines in MATLAB R2012b (The MathWorks Inc., Natick, MA, USA). Independent component analysis (ICA) is an effective method for removing various types of artifacts, such as eye-movement and eye blinking artifacts, muscle artifacts and environmental noise. To extract clear EEG signals of the human response inhibition, ICA decomposition is a preferred computational method for the separation of the blind source in EEG signals [26,27]. The ICA was performed using the functions of the EEGLAB toolbox (10.2.2.4bVersion, UC San Diego, Swartz Center for Computational Neuroscience, La Jolla, CA, USA) [28]. Each epoch was extracted from 500 to 1300 ms in successful go (SG) and successful stop (SS) trials. Figure 3 shows all steps of EEG signal processing to measure brain connectivity under human inhibition.
2.4. Inter-Trial Coherence (ITC) Analysis of EEG Signals
In this study, we used inter-trial coherence method to quantify the degree of phase consistency between two trials of EEG signal, as described in Equation (1), where “N” denotes the number of trials; “t” represents the time of EEG signal trials, “f” stands for the frequency of EEG signal trials and the “φ” was a value between –π and π in EEG signals [28].
(1) |
This method measured the time-frequency analysis trial-by-trial to examine the brain dynamics of inhibition. The results obtained with the ITC method were more accurate than traditional time domain and frequency domain analysis, such as the event-related potential (ERP) and event-related spectral perturbation (ERSP). The ITC method observed the synchronization of EEG signals at a specific latency and frequency from where EEG signals were time locked. In other words, the ITC method decomposed the ERP into their respective phase-locked frequency bands and provided additional information about the relationship between ERP and brain oscillations [8]. In this work, ITC analysis was performed using the ITC functions of the EEGLAB toolbox 10.2.2.4b [28]. The ITC analysis addressed the phase synchronization and desynchronization of EEG signals under response inhibition with visual and auditory stimuli. The ITC value varies from 0 to 1, where a zero indicates the absence of synchronization between two EEG signals while the value 1 represents a perfect synchronization between two EEG signals [6,29].
2.5. Brain Connectivity with Phase Locking Value (PLV)
Phase lag index has been recognized as a promising technique to the analysis of brain connectivity. The phase lock value (PLV) is a statistical method that has been used to investigate synchronization or desynchronization between EEG signals, and was used to measure the phase connectivity between the two EEG channels in this work. The Equation (2) we used for the analysis of phase lag index is shown as follows:
(2) |
where “N” is the number of samples in the time window considered. The “φ1” and “φ2” are the phase values of the two EEG signals from two channels. The PLV is always a value between 0 and 1 that reflects how two EEG signals synchronize or synchronize with each other. The phase coherence was calculated using the Hilbert transformation [30]. The phase coherence was observed between eleven pairs of EEG channels including F3-F4, F3-T7, T7-O1, O1-O2, T8-O2, F4-8, F4- F4-O2, F3-O2, F3-O1 and T7-T8 in the frequency range 1–40 Hz. To investigate brain connectivity under response inhibition, the selected 11 pairs of EEG channels covered the whole area of the brain. Most human inhibition related studies have observed that event related with synchronization occurred in theta (4–7 Hz), alpha (8–12 Hz), and beta (13–30 Hz) frequency bands under response inhibition function [31,32,33,34].
3. Results
3.1. EEG-Inter-Trial Coherence (ITC) Results
Results of the average ITC of all male subjects are shown in Figure 4, Figure 5, Figure 6 and Figure 7, in which non-significant ITC values are colored green while significant values (p < 0.05) are in yellow or red. In each of these inter-trial coherence (ITC) plots, the y-axis is the frequency range (Hz) and the x-axis indicates the time in milliseconds. The ITC plots were acquired for successful go (SG) (visual stimuli), successful stop (SS) (auditory stimuli) trials during left- and right-hand response inhibitions. Besides, to the left side of each ITC plot is a panel with a blue signal that shows the average power of ITC at each frequency. The green and black dotted lines in the left panel show the threshold of ITC significance in each frequency band relative to the baseline period (p < 0.05).
Brain activities related to human inhibitory control were investigated under left- and right-hand response inhibitions in the frontal cortex (F3, FZ, F4). Figure 4 shows the increase of ITC activities in the delta (1–4 Hz) and theta (4–7 Hz) frequency bands, which were observed after visual and auditory stimuli during successful stop (SS) trials in the frontal cortex. These findings are similar to the previous study of inhibitory control [31]. Consequently, the frontal area of the brain is actively associated with the process of inhibitory control. In addition, Figure 4 displays the increase of ITC activities of alpha (8–12 Hz) and beta (13–30 Hz) bands after visual stimuli in successful go (SG) trials. These increases of ITC activities in alpha and beta bands are related to the movement of the hand. The functional role of the frontal cortex in human inhibition show a significant increase of ITC in delta and theta bands under LHR and RHR inhibitory controls as elicited through comparing SS-SG.
Figure 5 presents the increase of ITC activities in the delta (1–4 Hz), theta (4–7 Hz) and alpha (8–12 Hz) bands in the occipital cortex (O1, O2, OZ) with auditory stimuli in successful stop (SS) trials of left and right hand response inhibitions. Figure 5 also shows the increase of ITC activities of the beta band (13–30 Hz) in the occipital cortex after visual perception during successful go (SG) trials of left and right response. Additionally, Figure 6 and Figure 7 display the increase of ITC activities of the delta (1–4 Hz) and theta (4–7 Hz) bands in the right temporal cortex (T8, TP8) with auditory stimuli during successful stop (SS) condition. Figure 6 also revealed increased ITC activities in the delta (1–4 Hz), theta (4–7 Hz) and alpha (8–12 Hz) bands in the right temporal cortex after visual stimulation under the successful go (SG) condition, suggesting a novel neural signature of human response inhibition in the auditory cortex under SS and SG conditions. In addition, increased ITC activities in the delta (1–4 Hz), theta (4–7 Hz) and alpha (8–12 Hz) bands in the left temporal (T7, TP7) cortex under the SS and SG conditions are observed as well (see Figure 7).
3.2. Differences in EEG Activities between Male And Female Subjects
Differences in EEG activity between male and female subjects were investigated to show gender differences in the EEG signal analysis. Figure 8 shows the increase of ITC activities in the delta (1–4 Hz), theta (4–7 Hz), alpha (8–12 Hz) and beta (13–30 Hz) frequency bands, which were observed after visual and auditory stimuli during SS-SG condition in the frontal and occipital cortices. Figure 9 displays the increase of ITC activities in the delta (1–4 Hz), theta (4–7 Hz), alpha (8–12 Hz) and beta (13–30 Hz) frequency bands which were detected after visual and auditory stimuli during SS-SG condition in the left temporal and right temporal cortices. The EEG activity patterns in a single female subject were observed to be slightly higher than in male subjects. The EEG activity patterns in a single female subject were observed to be gradually higher than in male subjects. A previous study reported that gender differences in the EEG signal analysis under cognitive activity, they women indicated significantly higher alpha relative power than men during all cognitive conditions, while men revealed significantly higher beta relative power than women [25]. Our study observed similar higher EEG activity patterns of the alpha power band in women than in men.
3.3. Brain Connectivity under Human Inhibitory Control using Visual and Auditory Stimuli
The brain dynamics of visual and auditory stimuli under human inhibition involves all regions of the brain. A previous study of time-frequency analysis reported that human inhibitory control is related to the frontal cortex and the pre-supplementary motor area [31]. Therefore, in this study, we developed a brain connectivity model to examine the neural connection between the frontal, central, temporal, parietal and occipital cortices. We examined the phase lock value (PLV) of eleven pairs of EEG channels, including the frontal cortex (F3-F4), left frontotemporal (F3-T7), left temporal-occipital (T7-O1), occipital (O1-O2), right temporal-occipital (T8-O2), right frontotemporal (F4-T8), right frontal-left occipital (F4-O1), right frontal-occipital (F4-O2), left frontal-right occipital (F3-O2), left frontal-occipital (F3-O1) and temporal (T7-T8) cortices. These eleven pairs of EEG channels were selected to measure the brain connectivity under human response inhibition, as shown in Figure 10.
Figure 10A shows the brain connectivity of resting-state in pre-stimulus condition under right-hand response (RHR) inhibition at successful stop (SS) condition. Figure 10B displays the increase of neural connectivity in the frontal cortex (F3-F4), right frontal-left occipital lobes (F4-O1), right frontal-occipital (F4-O2) lobes and occipital (O1-O2) lobe under visual stimuli (SSD) at successful stop (SS) condition. Figure 10C shows the increase of brain connectivity in frontal cortex (F3-F4) electrodes, right frontal-occipital lobes (F3-O1) electrodes, left frontal- right occipital lobes (F3-O2) electrodes, right frontal-temporal lobes (F3-T7) electrodes, right temporal-occipital lobes (T7-O1) electrodes and temporal lobe (T7-T8) electrodes during auditory stimulus (SSRT) at successful stop (SS) condition.
Likewise, Figure 10D shows the brain connectivity of resting-state in pre-stimulus condition under left-hand response (RHR) inhibition at successful stop (SS) condition. Figure 10E displays the increase of brain connectivity in the frontal lobe (F3-F4), the left frontal-right occipital lobes (F3-O2), the right frontal-temporal lobes (F4-T8), the right frontal-occipital lobes (F4-O2) and right temporal-occipital lobes (T8-O2) under the visual stimuli (SSD) at successful stop (SS) condition. Figure 10F shows increase of neural connectivity in the frontal lobe (F3-F4), the left frontal-occipital lobes (F3-O1), the left frontal-left occipital lobes (F3-O2), the left temporal-occipital lobes (T7-O1), the right temporal occipital lobes (T8-O2) and the temporal lobe (T7-T8) during the auditory stimuli (SSRT) at successful stop (SS) condition. However, in this study, all subjects performed both left- and right-hand response inhibition randomly. Therefore, we assumed that all subjects had mixed neural connectivity of LHR and RHR inhibitions. The brain connectivity in the frontal regions we observed agreed with the results of previous studies on human inhibition [35,36].
Moreover, Figure 11A, C shows the brain connectivity of resting-state in pre-stimulus state under RHR and LHR inhibitions in the successful go (SG) condition. Figure 11B presents the increased brain connectivity in the right frontal-occipital (F4-O2) and left temporal-occipital (T7-O1) lobes after visual stimuli (RT). Figure 11D displays the nonsignificant difference in the frontal, temporal and occipital regions of the brain.
4. Discussion
In the present study, the neural network of human inhibitory control was deciphered using both visual and auditory perceptions. We examined the brain connectivity between the frontal, temporal and occipital cortices under hand response inhibitions using visual and auditory stimuli. A key finding from the EEG results was the increase of ITC in delta, theta bands, and brain connectivity in frontal-temporal lobes of the brain under the successful stop (SS) condition. In addition, an increased ITC activity in the beta band was observed during the successful go (SG) condition in the frontal lobe. The increased ITC activity of the delta and theta bands in the temporal lobe suggests a novel neural marker for human inhibitory control.
4.1. Neural Oscillations under Inhibition with Visual and Auditory Stimuli
The multimodal neural network can be generated by two or more sensory stimulations. For example, when we hear someone’s voice (auditory), we also see their lips moving (visual) [37]. In the real world, simulations to someone do not occur one by one but normally come at the same time, just like watching while listening. In this situation, the EEG dynamics of the brain is very difficult to recognize, such as the discrimination between neuronal activities related to visual from auditory stimuli [38,39,40,41,42,43,44,45]. This study revealed how multisensory information integrates into the human brain under inhibition and the results should be helpful for understanding how auditory inputs affect visual perception and behavior.
Previous studies reported that visual and auditory sensory inputs can modulate the neural activity in the temporal lobe [46,47,48,49]. In addition, the neurons of the superior colliculus brain had been observed to receive multisensory inputs [50]. Visual and auditory perceptions commonly work together to facilitate the identification and location of sensory input sources in the environment. The superior colliculus brain plays an important role in the relationships between auditory and visual stimuli [1]. Previous study examined the effect of multisensory integration in the theta frequency band at the superior colliculus brain [51,52]. In our work, we found a similar theta ITC increase in the frontal lobe and temporal lobe. The spatial distribution of visual and auditory stimuli in the frontal, central and occipital lobe was studied [53]. According to that work, it was discovered that the delta and theta bands increase with audiovisual stimulation in somatosensory cortex, at least in monkey.
4.2. Brain Dynamics under Human Inhibitory Control
It has been observed that there is increased activities of theta and alpha power bands in frontal and pre-supplementary area under human response inhibition [31]. In the current work, we also discovered similar increased EEG activities of theta and alpha power bands in the frontal cortex of the brain [31]. In addition, we established a brain connectivity neural network model during left- and right-hand response inhibitions. EEG-coherence is a mathematical technique that can be used to determine if two or more regions of the brain have similar oscillatory neuronal activities. Since the 1960s, EEG phase coherence has been applied to evaluate the similarity of the frequency band across EEG signals. In the recent neurological disorders study, it has been used to measure the brain connectivity [54,55].
EEG phase coherence is an analysis of the inconsistency of time alterations between EEG channels. Moreover, the Fourier transform provides a direct association between the time and frequency domains and characterizes the time alteration as a phase difference or phase angle. If the phase angle is stable and constant over time (i.e., phase locked), then the coherence is 1.0, and if the time differences between two time series differ from moment to moment, then coherence will be 0. The EEG phase coherence is often understood as a “connection” analysis, and as a measure of the functional association between two regions of the brain [56,57]. The coherence between EEG channels represents the neural network of brain dynamics under human inhibition. The EEG phase differences are frequently used to calculate “directed coherence,” which is a quantity of the directional flow of information between two EEG electrode sites [58,59]. EEG phase differences were also used to evaluate conduction velocities and synaptic integration times as one increases the inter-electrode distance in different directions [60,61,62,63]. In our work, we investigated the greater EEG phase coherence in the frontal cortex (F3-F4) under human inhibitory control. These findings suggest that all subjects have strong brain connectivity neural network correlated with inhibitions of the left and right hand responses. In addition, we examined the EEG coherence in the temporal and occipital lobes of the brain. Accordingly, inter-trial coherence (ITC) was found maximal in inhibition of right-hand response compared to inhibition of left-hand response. In addition, we observed after auditory stimuli that all subjects showed strong brain modulation compared to visual stimuli. Thus, we established a brain connectivity neural network model under inhibition. In this model, we found some neural network pathways are similar to the previous studies of brain network [35,36].
It is noticeable that there were some limitations of the current work. All participants were males and; therefore, it may not be suitable to directly apply the conclusion to female subjects. In the future, we will carry out studies on female subjects and compare the results of brain connectivity of the male versus female groups. The experiment design in our study was adopted from a well-known stop signal task, which used only 2D image and might not be demonstrative enough in actual environments. Our future study may construct a real-environment based experiment scenario in virtual reality (VR) and augmented reality (AR). Before applying these advanced technologies, we could at present conclude that the brain connectivity neural network model under human inhibition with visual and auditory sensory established in this work is sound under normal experimental scenarios, although more researches shall be conducted to fully dissect the underlying significance of the developed model.
5. Conclusions
In present study, for the first time, we utilized inter-trial coherence and phase lag index to measure the brain connectivity under human inhibitory control. We have established an inhibitory neural network model. In addition, neural signatures related to human inhibitory control were examined in the frontal cortex and temporal lobe of the brain. EEG-ITC marker of visual and auditory stimuli were identified in the occipital and temporal lobes of the brain. Our study also suggested that visual stimulus can restore or evoke oscillatory responses in the auditory cortex. Besides, the EEG-ITC coherence increased in the delta and theta bands over the temporal lobe of the brain was recognized as a neural marker of human inhibition. The increased brain connectivity in the frontal lobe of the brain showed the strength of neural connection under human inhibitory control. Finally, an inhibitory brain network model under human response inhibition of left-hand and right-hand using visual and auditory stimuli was proposed, which is supposed helpful for understanding the neural network pathways under inhibition.
Acknowledgments
The authors would like to thank all the subjects who participated in this work.
Author Contributions
Conceptualization, R.K.C. and L.-W.K.; methodology, R.K.C.; software, R.K.C.; validation, R.K.C.; L.-W.K.; formal analysis, R.K.C.; investigation, R.K.C. and L.-W.K.; resources, L-W.K.; data curation, R.K.C.; writing—original draft preparation, R.K.C., W.-C.L. and L.-W.K.; writing—review and editing, R.K.C., W.-C.L. and L.-W.K.; visualization, R.K.C.; supervision, W.-C.L. and L.-W.K.; project administration, L.-W.K.; funding acquisition, L.-W.K. All authors have read and agreed to the published version of the manuscript.
Funding
This study is supported by the Center For Intelligent Drug Systems and Smart Bio-Devices (IDS2B) from The Featured Areas Research Center Program within the framework of the Higher Education Sprout Project by the Ministry of Education (MOE) in Taiwan, and by the Ministry of Science and Technology (MOST), Taiwan, under the Contracts MOST 108-2221-E-009-045-MY3 and 108-2321-B-010-014-MY2.This work is supported by the National Chung-Shan Institute of Science and Technology, under Contract XC08208PA59PE-CS.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- 1.King A.J. Visual influences on auditory spatial learning. Phil. Trans. R. Soc. 2009;364:331–339. doi: 10.1098/rstb.2008.0230. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Martini F., Nath J. Anatomy and Physiology. 2nd ed. Benjamin Cummings; San Francisco, CA, USA: 2010. [Google Scholar]
- 3.Nicholls J., Martin A.R., Wallace B., Fuchs P. From Neuron to Brain. 4th ed. Sinauer; Sunderland, MA, USA: 2001. [Google Scholar]
- 4.Senkowski D., Schneider T.R., Foxe J.J., Engel A.K. Crossmodal binding by neural coherence: Implications for multisensory processing. Trends Neurosci. 2008;31:401–409. doi: 10.1016/j.tins.2008.05.002. [DOI] [PubMed] [Google Scholar]
- 5.Kaiser J., Naumer M.J. Multisensory Object Perception in the Primate Brain. Springer; Heidelberg, Germany: 2010. Cortical Oscillations and Multisensory Interactions in Humans; pp. 71–82. [Google Scholar]
- 6.Busch N., Dubois J., VanRullen R. The Phase of Ongoing EEG Oscillations Predicts Visual Perception. J. Neurosci. 2009;29:7869–7876. doi: 10.1523/JNEUROSCI.0113-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Mathewson K.E., Gratton G., Fabiani M., Beck D.M., Ro T. To see or not to see: Prestimulus alpha phase predicts visual awareness. J. Neurosci. 2009;29:2725–2732. doi: 10.1523/JNEUROSCI.3963-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Makeig S., Debener S., Onton J., Delorme A. Mining event-related brain dynamics. Trends Cogn. Sci. 2004;8:204–210. doi: 10.1016/j.tics.2004.03.008. [DOI] [PubMed] [Google Scholar]
- 9.Tass P., Rosenblum M.G., Weule J., Kurths J., Pikovsky A., Volkmann J. Detection of n:m phase locking from noisy data: Application to magnetoencephalography. Phys. Rev. Lett. 1998;81:3291–3294. doi: 10.1103/PhysRevLett.81.3291. [DOI] [Google Scholar]
- 10.Palva J.M., Palva J.M., Kaila K. Phase Synchrony among Neuronal Oscillations in the Human Cortex. J. Neurosci. 2005;25:3962–3972. doi: 10.1523/JNEUROSCI.4250-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Basar E. EEG-brain Dynamics: Relation Between EEG and Brain Evoked Potentials. Elsevier; Amsterdam, The Nertherlands: 1980. [Google Scholar]
- 12.Makeig S., Westerfield M., Jung T.P., Enghoff S., Townsend J., Courchesne E., Sejnowski T.J. Dynamic Brain Sources of Visual Evoked Responses. Science. 2002;295:690–694. doi: 10.1126/science.1066168. [DOI] [PubMed] [Google Scholar]
- 13.Kayser C., Petkov C.I., Logothetis N.K. Visual Modulation of Neurons in Auditory Cortex. Cereb. Cortex. 2008;18:1560–1574. doi: 10.1093/cercor/bhm187. [DOI] [PubMed] [Google Scholar]
- 14.Lakatos P., O’Connell M.N., Barczak A., Mills A., Javitt D.C., Schroeder C.E. The Leading Sense: Supramodal Control of Neurophysiological Context by Attention. Neuron. 2009;64:419–430. doi: 10.1016/j.neuron.2009.10.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Thorne J.D., De Vos M., Viola F.C., Debener S. Cross-Modal Phase Reset Predicts Auditory Task Performance in Humans. J. Neurosci. 2011;31:3853–3861. doi: 10.1523/JNEUROSCI.6176-10.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Verbruggen F., Logan G.D., Stevens M.A. STOP-IT: Windows executable software for the stop-signal paradigm. Behav. Res. Methods. 2008;40:479–483. doi: 10.3758/BRM.40.2.479. [DOI] [PubMed] [Google Scholar]
- 17.Elchlepp H., Lavric A., Chambers C.D., Verbruggen F. Proactive inhibitory control: A general biasing account. Cogn. Psychol. 2016;86:27–61. doi: 10.1016/j.cogpsych.2016.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Vingerhoets G., Acke F., Nys J., Vandemaele P., Achten E., Alderweireldt A.-S. Cerebral lateralization of praxis in right- and left-handedness: Same pattern, different strength. Hum. Brain Mapp. 2011;33:763–777. doi: 10.1002/hbm.21247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Reid C.S., Serrien D.J. Handedness and the excitability of cortical inhibitory circuits. Behav. Brain Res. 2012;230:144–148. doi: 10.1016/j.bbr.2012.02.008. [DOI] [PubMed] [Google Scholar]
- 20.Verbruggen F., Logan G.D. Response inhibition in the stop-signal paradigm. Trends Cogn. Sci. 2008;12:418–424. doi: 10.1016/j.tics.2008.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Logan G.D. On the ability to inhibit thought and action: A users’ guide to the stop-signal paradigm. In: Dagenbach D., Carr T.H., editors. Inhibitory Processes in Attention, Memory, and Language. Academic Press; San Diego, CA, USA: 1994. pp. 188–239. [Google Scholar]
- 22.Serrien D.J., Orth M., Evans A.H., Lees A.J., Brown P. Motor inhibition in patients with Gilles de la Tourette syndrome: Functional activation patterns as revealed by EEG coherence. Brain. 2004;128:116–125. doi: 10.1093/brain/awh318. [DOI] [PubMed] [Google Scholar]
- 23.Chambers C.D., Garavan H., Bellgrove M.A. Insights into the neural basis of response inhibition from cognitive and clinical neuroscience. Neurosci. Biobehav. Rev. 2009;33:631–646. doi: 10.1016/j.neubiorev.2008.08.016. [DOI] [PubMed] [Google Scholar]
- 24.Aron A.R., Dowson J.H., Sahakian B., Robbins T. Methylphenidate improves response inhibition in adults with attention-deficit/hyperactivity disorder. Boil. Psychiatry. 2003;54:1465–1468. doi: 10.1016/S0006-3223(03)00609-7. [DOI] [PubMed] [Google Scholar]
- 25.Corsi-Cabrera M., Ramos J., Guevara M.A., Arce C., Gutierrez S. Gender Differencesm in the Eeg During Cognitive Activity. Int. J. Neurosci. 1993;72:257–264. doi: 10.3109/00207459309024114. [DOI] [PubMed] [Google Scholar]
- 26.Jung T.-P., Makeig S., Westerfield M., Townsend J., Courchesne E., Sejnowski T.J. Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects. Clin. Neurophysiol. 2000;111:1745–1758. doi: 10.1016/S1388-2457(00)00386-2. [DOI] [PubMed] [Google Scholar]
- 27.Jung T.-P., Makeig S., McKeown M.J., Bell A.J., Lee T.-W., Sejnowski T.J. Imaging brain dynamics using independent component analysis. Proc. IEEE. 2001;89:1107–1122. doi: 10.1109/5.939827. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Delorme A., Makeig S. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods. 2004;134:9–21. doi: 10.1016/j.jneumeth.2003.10.009. [DOI] [PubMed] [Google Scholar]
- 29.Onton J., Makeig S. Information-based modeling of event-related brain dynamics. Prog Brain Res. Elsevier. 2006;159:99–120. doi: 10.1016/S0079-6123(06)59007-7. [DOI] [PubMed] [Google Scholar]
- 30.Lachaux J.P., Rodriguez E., Martinerie J., Varela F.J. Measuring phase synchrony in brain signals. Hum. Brain Mapp. 1999;8:194–208. doi: 10.1002/(SICI)1097-0193(1999)8:4<194::AID-HBM4>3.0.CO;2-C. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ko L.-W., Shih Y.-C., Chikara R.K., Chuang Y.-T., Chang E.C. Neural Mechanisms of Inhibitory Response in a Battlefield Scenario: A Simultaneous fMRI-EEG Study. Front. Hum. Neurosci. 2016;10:185. doi: 10.3389/fnhum.2016.00185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Chikara R.K., Ko L.W. Neural Activities Classification of Human Inhibitory Control Using Hierarchical Model. Sensors. 2019;19:3791. doi: 10.3390/s19173791. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Driver J., Noesselt T. Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments. Neuron. 2008;57:11–23. doi: 10.1016/j.neuron.2007.12.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Chikara R.K., Chang E.C., Lu Y.-C., Lin D.-S., Lin C.-T., Ko L.-W. Monetary Reward and Punishment to Response Inhibition Modulate Activation and Synchronization Within the Inhibitory Brain Network. Front. Hum. Neurosci. 2018;12:27. doi: 10.3389/fnhum.2018.00027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Duann J.-R., Ide J., Luo X., Li C.-S.R. Functional connectivity delineates distinct roles of the inferior frontal cortex and presupplementary motor area in stop signal inhibition. J. Neurosci. 2009;29:10171–10179. doi: 10.1523/JNEUROSCI.1300-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Noh K., Shin K.S., Shin D., Hwang J.Y., Kim J.S., Jang J.H., Chung C.K., Kwon J.S., Cho K.-H. Impaired coupling of local and global functional feedbacks underlies abnormal synchronization and negative symptoms of schizophrenia. BMC Syst. Boil. 2013;7:30. doi: 10.1186/1752-0509-7-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Sumby W.H., Pollack I. Visual contributions to speech intelligibility in noise. J. Acoust. Soc. Am. 1954;26:212–215. doi: 10.1121/1.1907309. [DOI] [Google Scholar]
- 38.McGurk H., Macdonald J. Hearing lips and seeing voices. Nature. 1976;264:746–748. doi: 10.1038/264746a0. [DOI] [PubMed] [Google Scholar]
- 39.Mowery T., Kotak V.C., Sanes D.H. The onset of visual experience gates auditory cortex critical periods. Nat. Commun. 2016;7:10416. doi: 10.1038/ncomms10416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Giard M.H., Peronnet F. Auditory-visual integration during multimodal object recognition in humans:a behavioral and electrophysiological study. J. Cogn. Neurosci. 1999;11:473–490. doi: 10.1162/089892999563544. [DOI] [PubMed] [Google Scholar]
- 41.Molholm S., Ritter W., Murray M.M., Javitt D.C., Schroeder C.E., Foxe J.J. Multisensory auditory–visual interactions during early sensory processing in humans: A high-density electrical mapping study. Cogn. Brain Res. 2002;14:115–128. doi: 10.1016/S0926-6410(02)00066-6. [DOI] [PubMed] [Google Scholar]
- 42.Ko L.W., Lu Y.C., Bustince H., Chang Y.C., Chang Y., Ferandez J., Wang Y.K., Sanz J.A., Dimuro G.P., Lin C.T. Multimodal Fuzzy Fusion for Enhancing the Motor-Imagery-Based Brain Computer Interface. IEEE Comput. Intell. Mag. 2019;14:96–106. doi: 10.1109/MCI.2018.2881647. [DOI] [Google Scholar]
- 43.Chikara R.K., Komarov O., Ko L.W. Neural signature of event-related N200 and P300 modulation in parietal lobe during human response inhibition. Int. J. Comput. Biol. Drug Des. 2018;11:171–182. doi: 10.1504/IJCBDD.2018.090842. [DOI] [Google Scholar]
- 44.Lin C.-T., Huang T.-Y., Liang W.-C., Chiu T.-T., Chao C.-F., Hsu S.-H., Ko L.-W. Assessing Effectiveness of Various Auditory Warning Signals in Maintaining Drivers’ Attention in Virtual Reality-Based Driving Environments. Percept. Motor Skills. 2009;108:825–835. doi: 10.2466/pms.108.3.825-835. [DOI] [PubMed] [Google Scholar]
- 45.Lin C.-T., Huang K.-C., Chuang C.-H., Ko L.-W., Jung T.-P. Can arousing feedback rectify lapses in driving? Prediction from EEG power spectra. J. Neural Eng. 2013;10:056024. doi: 10.1088/1741-2560/10/5/056024. [DOI] [PubMed] [Google Scholar]
- 46.Schroeder C.E., Lakatos P., Kajikawa Y., Partan S., Puce A. Neuronal oscillations and visual amplification of speech. Trends Cogn. Sci. 2008;12:106–113. doi: 10.1016/j.tics.2008.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Schroeder C.E., Foxe J.J. Multisensory contributions to low-level, ‘unisensory’ processing. Curr. Opin. Neurobiol. 2005;15:454–458. doi: 10.1016/j.conb.2005.06.008. [DOI] [PubMed] [Google Scholar]
- 48.Bizley J.K., King A.J. Visual-auditory spatial processing in auditory cortical neurons. Brain Res. 2008;1242:24–36. doi: 10.1016/j.brainres.2008.02.087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.King A.J. The superior colliculus. Curr. Biol. 2004;14:R335–R338. doi: 10.1016/j.cub.2004.04.018. [DOI] [PubMed] [Google Scholar]
- 50.Stein B.E., Stanford T.R. Multisensory integration: Current issues from the perspective of the single neuron. Nat. Rev. Neurosci. 2008;9:255–266. doi: 10.1038/nrn2331. [DOI] [PubMed] [Google Scholar]
- 51.Stein B.E., Stanford T.R., Ramachandran R., Perrault T.J., Rowland B.A. Challenges in quantifying multisensory integration: Alternative criteria, models, and inverse effectiveness. Exp. Brain Res. 2009;198:113–126. doi: 10.1007/s00221-009-1880-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Sakowitz O.W., Quiroga R.Q., Schürmann M., Başar E. Spatio-temporal frequency characteristics of intersensory components in audiovisually evoked potentials. Cogn. Brain Res. 2005;23:316–326. doi: 10.1016/j.cogbrainres.2004.10.012. [DOI] [PubMed] [Google Scholar]
- 53.Demiralp T., Bayraktaroğlu Z., Lenz D., Junge S., Busch N., Maess B., Ergen M., Herrmann C.S. Gamma amplitudes are coupled to theta phase in human EEG during visual perception. Int. J. Psychophysiol. 2007;64:24–30. doi: 10.1016/j.ijpsycho.2006.07.005. [DOI] [PubMed] [Google Scholar]
- 54.Lakatos P., Chen C.-M., O’Connell M.N., Mills A., Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron. 2007;53:279–292. doi: 10.1016/j.neuron.2006.12.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Bowyer S.M. Coherence a measure of the brain networks: Past and present. Neuropsychiatr. Electrophysiol. 2016;2:1051. doi: 10.1186/s40810-015-0015-7. [DOI] [Google Scholar]
- 56.Thatcher R.W., Krause P.J., Hrybyk M. Cortico-cortical associations and EEG coherence: A two-compartmental model. Electroencephalogr. Clin. Neurophysiol. 1986;64:123–143. doi: 10.1016/0013-4694(86)90107-0. [DOI] [PubMed] [Google Scholar]
- 57.Tiesinga P., Sejnowski T.J. Mechanisms for Phase Shifting in Cortical Networks and their Role in Communication through Coherence. Front. Hum. Neurosci. 2010;4:1–14. doi: 10.3389/fnhum.2010.00196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Kaminski M., Blinowska K.J., Szelenberger W. Topographic analysis of coherence and propagation of EEG activity during sleep wakefulness. EEG Clin. Neurophysiol. 1997;102:216–227. doi: 10.1016/S0013-4694(96)95721-5. [DOI] [PubMed] [Google Scholar]
- 59.Thatcher R.W. Coherence, Phase Differences, Phase Shift, and Phase Lock in EEG/ERP Analyses. Dev. Neuropsychol. 2012;37:476–496. doi: 10.1080/87565641.2011.619241. [DOI] [PubMed] [Google Scholar]
- 60.Riddle C.N., Baker S.N. Manipulation of peripheral neural feedback loops alters human corticomuscular coherence. J. Physiol. 2005;566:625–639. doi: 10.1113/jphysiol.2005.089607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Suzuki H. Phase relationships of alpha rhythm in man. Jpn. J. Physiol. 1974;24:569–586. doi: 10.2170/jjphysiol.24.569. [DOI] [PubMed] [Google Scholar]
- 62.Thatcher R.W., North D.M., Biver C.J. Development of cortical connections as measured by EEG coherence and phase delays. Hum. Brain Mapp. 2008;29:1400–1415. doi: 10.1002/hbm.20474. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Naue N., Rach S., Strüber D., Huster R.J., Zaehle T., Körner U., Herrmann C.S. Auditory Event-Related Response in Visual Cortex Modulates Subsequent Visual Responses in Humans. J. Neurosci. 2011;31:7729–7736. doi: 10.1523/JNEUROSCI.1076-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]