Abstract
Motor imagery-based brain-computer interface (MI-BCI) currently represents a new trend in rehabilitation. However, individual differences in the responsive frequency bands and a poor understanding of the communication between the ipsilesional motor areas and other regions limit the use of MI-BCI therapy. Objective: Bimanual training has recently attracted attention as it achieves better outcomes as compared to repetitive one-handed training. This study compared the effects of three MI tasks with different visual feedback. Methods: Fourteen healthy subjects performed single hand motor imagery tasks while watching single static hand (traditional MI), single hand with rotation movement (rmMI), and bimanual coordination with a hand pedal exerciser (bcMI). Functional connectivity is estimated by Transfer Entropy (TE) analysis for brain information flow. Results: Brain connectivity of conducting three MI tasks showed that the bcMI demonstrated increased communications from the parietal to the bilateral prefrontal areas and increased contralateral connections between motor-related zones and spatial processing regions. Discussion/Conclusion: The results revealed bimanual coordination operation events increased spatial information and motor planning under the motor imagery task. And the proposed bimanual coordination MI-BCI (bcMI-BCI) can also achieve the effect of traditional motor imagery tasks and promotes more effective connections with different brain regions to better integrate motor-cortex functions for aiding the development of more effective MI-BCI therapy. Clinical and Translational Impact Statement The proposed bcMI-BCI provides more effective connections with different brain areas and integrates motor-cortex functions to promote motor imagery rehabilitation for patients’ impairment.
Keywords: Bimanual coordination, motor imagery, brain connectivity
I. Introduction
Recent studies have reached a consensus on the feasibility of motor imagery-based brain-computer interface (MI-BCI) for stroke rehabilitation applications, especially in upper limb rehabilitation [1]–[3]. Motor imagery is the dynamic cognitive state achieved by rehearsing a motor action in the working memory without any overt motor output. In traditional MI-BCI therapy, patients perform one hand motor imagery tasks through electroencephalography signals (Mu and Beta sensorimotor rhythms, SMR) that communicate between the human brain and a computer to provide sensory feedback [1] or control the assistance device (e.g., exoskeleton) for muscle strength training [4], [5]. Patients exhibited significantly improved the upper limb function [6], motion-related neural activity in the ipsilesional site [7]–[9], and brain connectivity of the motor cortex [10] with MI-BCI therapy. Several researchers have also noted neuroplasticity changes and structural reorganization in the brain of stroke patients [11]–[13] after a period of training with MI-BCI. MI-BCI is known to repair and restore motor functions [6], [10], [11], [14], [15] by inducing changes in brain activity initiated by attempted movements of the affected hand, promoting motor recovery of remaining neurons and cortex reorganization in the ipsilesional motor areas. Nevertheless, some studies note that it can have a negative impact on motion recovery due to the plasticity of activated ipsilateral motion projections, competitive interactions, and compensatory movements after stroke [16]–[19]. As bilateral motion facilitates both spatial and time coordination [20], bilateral arm training (BAT) has been recently used to reconcile these problems. Bilateral arm training is known to enable (a) motor cortex disinhibition of the injured hemisphere, (b) enhanced paths from the contralesional region to recruitment, and (c) upregulation of descending motor neuron commands to propriospinal neurons [21], [22]. Although the effects of BAT are still debated [23], [24], few studies have studied the bimanual MI [25], [26] and its effect on the patients with movement deficits [27]–[29]. Bimanual movement was associated with power suppression in alpha, beta and gamma spectral bands. Even the activation pattern of bi-manual MI is difference for these patients, it still can be accurately classified and be used for restoration of motor function of highly disabled patients.
A major challenge that limits the use of MI-BCI therapy in stroke patients is the use of channel-based information to discriminate MI patterns. This is because the responsive frequency bands of MI-BCI are not consistent between subjects and within subjects [30], and main MI-BCI features and alpha (mu) rhythm event-related desynchronization (ERD)/synchronization (ERS) responses may be altered after stroke [31]. This instability is complex as the main ERD/ERS features for MI-BCI could occur in different experiment time intervals, on different frequency bands, and in different brain areas. Even though some machine learning approaches [32]–[36] can improve classification accuracy [37], [38], these characteristics make it difficult to extract EEG features for MI-BCI training [39], [40] and subsequent classification. A promising approach to handle this limitation is to consider the relationship between sources of brain signal using brain connectivity method that offers linchpin information about neural interactions related to MI and identifies reliable biomarkers in stroke rehabilitation to assess motor recovery [2], [41]–[43].
Although MI-BCI can improve the movement function of the ipsilesional motor cortex, brain connectivity analysis can provide more clear evidence to support the notion that performing the unilateral motor imagery tasks benefits the connections between the ipsilesional motor region and other brain areas.
In this study, we designed a bimanual coordination MI-BCI (bcMI-BCI) that incorporates the BAT concept to study brain connectivity when performing unilateral motor imagery tasks. In addition, we compare bcMI-BCI with another two conditions: traditional signal static hand and single hand with rotation MI-BCI for the differences in brain connectivity, analyzed by transfer entropy (TE) [44], which naturally merges directional and dynamic information.
This study will compare three different motor imagery tasks: (a) Traditional MI (tMI) (b) Rotation Movement MI (rmMI) and, (c) Bimanual Coordination MI (bcMI). For the results of this study, we would approve the effect of bcMI and rmMI by comparing with tMI using machine learning algorithms: common spatial pattern (CSP) for feature extraction and linear discriminant analysis (LDA) for MI classification. Furthermore, this study aims to explore brain connectivity while performing ipsilateral motor imagery tasks in tMI, rmMI, and bcMI. We hypothesized that brain connectivity analysis would reveal that the proposed novel rehabilitation approach of bimanual and rotated motor imagery effectively reorganizes neurons for motor function and reconnects other brain regions to achieve complete hand coordination function.
II. Materials and Methods
A. Participants
Fourteen healthy adults were recruited to participate the experiments (mean age 23.2 years, range 21–27 years). All subjects are right-handed with no mental or medical illnesses and no previous experience with MI-BCI. Before the experiment, they signed a consent form indicating that they have a clear understanding of the experimental protocol, which was approved by the Research Ethics Committee for Human Subject Protection, National Chiao Tung University.
B. Experimental Design and Procedure
Three types of motor imagery tasks (as Fig. 1a-c) were designed to investigate differences in brain connectivity, including the (1) Traditional MI task (tMI), (2) Rotation Movement MI task (rmMI), and (3) Bimanual Coordination MI task (bcMI). As motor imagery and observation recruit the same brain regions, the subjects were asked to watch a video of the three conditions. In the tMI task, subjects performed motor imagery by imagining the rotation movement of the assigned hand while watching a video of the designated imagery hand statically holding one side of the hand pedal exerciser. The designated hand is indicated by an orange arrow in the middle of the exerciser. In the rmMI task, subjects imagined rotation movement of the assigned hand while watching a video of the designated imagery hand holding one pedal of the exerciser and performing rotation movements with it. In the bcMI task, subjects performed motor imagery by imagining the rotation movement of only the assigned hand while watching the video showing both hands holding each pedal of the exerciser to perform rotation movements. The assigned single hand was indicated by the yellow arrow in the video.
FIGURE 1.
Three visual feedbacks for motor imagery tasks and the experimental paradigm. (a) Traditional MI task (tMI): assigned hand is static, (b) Rotation Movement MI task (rmMI): assigned hand performs the rotation movement in a forward fashion, (c) Bimanual Coordination MI task (bcMI): two hands perform the rotation movement in a forward fashion. The orange arrow points to the assigned hand for the motor imagery task. (d) The experimental procedure was divided into three stages, including the fixation stage (−2~0 s), motor imagery stage (0~10 s), and resting stage (10~13 s).
During the MI experiment, all participants sat in an electrically shielded cabin watching a 24” monitor from a 1-m distance. As shown in Fig. 1d, each trial started with the fixation stage (−2 to 0 sec) where the participants were instructed to look an image of a mini hand pedal exerciser in all three MI conditions. Then, a specific video of the MI tasks, played based on the MI condition of the trial, lasted for ten seconds and served as the motor imagery stage (0 to 10 s). During this motor imagery stage, subjects must imagine the rotation movement of single-hand assigned by the orange arrow in the top middle of the exerciser. Left and right arrows are randomly presented with the same probability. Then, a blank scenery screen is shown for three seconds as the resting stage (10 to 13s). The duration of each trial is 13 seconds (as Fig. 1d). For the three MI conditions, twenty trials are performed for each hand imagery and there were a total of 120 trials. The participants were instructed to remain still during the trial to reduce noise in the recorded EEG signal.
C. EEG Acquisition and Signal Preprocessing
EEG data were acquired with a 32 Ag/AgCl electrode cap referenced to the average of left and right mastoids and a SynAmps amplifier (Compumedics Neuroscan Ltd, Australia) digitized at a 1000-Hz sampling rate. The contact impedance between all electrodes and the skin was maintained at
. Before further data analysis, the raw EEG signals were bandpass filtered between 0.5 and 50 Hz using a zero-phase FIR filter (EEGLAB toolbox [45]). Then, filtered data were downsampled from 1000 Hz to 250 Hz to reduce computational complexity. In addition, independent Component Analysis (ICA) was applied to decompose the EEG signals into independent time courses presumably arising from distinct brain sources [46]–[48]. Components related to eye movements and blinking were identified by visual inspection and removed. And each channels’ related components were selected to reconstruct EEG channels’ signals which preserve the original signal feature as much as possible. After which, the trials relating to the three different MI conditions were extracted as epochs.
D. Quantification of ERD and ERS
Since the mu (alpha) ERD and ERS are the main index for MI-BCI [30], we used this index to confirm whether these three tasks can evoke the same MI phenomena. To compute the time course of ERD in alpha band (8 to 13 Hz), a similar procedure was adopted as reported in the literature [49], [50]. These procedure involves the following four steps: (1) bandpass filtering of all event-related MI trials, (2) squaring of the amplitude samples to obtain power samples, (3) averaging of power samples across all trials, and (4) averaging samples over time to smooth the data and reduce the variability. The ERD/ERS was here defined as percentage power decrease (ERD) or power increase (ERS) in relation to the average of first two seconds fixation stage (~2~0 s) before the motor imagery stage (0~5 s). The power in the interested frequency band in the period after the event is given by ‘A’, whereas baseline is given by ‘R’. ERD% is expressed as follows:
![]() |
where both A and R are EEG power averages of all trials in the specific MI tasks.
E. Feature Extraction and Classification of Motor Imagery
After EEG signal preprocessing, a typical signal processing pipeline is used for feature extraction and classification approaches for MI-BCI verification and applications. Currently, common spatial pattern (CSP) is one of the most common feature extraction methods used in MI BCI [51], [52]. CSP is a spatial filtering method used to minimize the variance of one class and maximize the variance of another class simultaneously [53]–[57]. Therefore, it is sensitive to binary differences, such as the left- and right-motor imagery [51], [52]. However, it is not easy to identify the optimal frequency range for each subject. To solve this problem, the sub band CSP (SB-CSP) method [58], a filter bank composed of different interested sub bands as inputs, was applied in this study. The equations are as follows:
Two windows from the multivariate signal are represented as
with size
and
samples and
with size
and
samples. To make the rate of variance maximum between two windows, the CSP algorithm defines component
and is represented as follows:
![]() |
The solutions are obtained by calculating the two covariance matrices below:
![]() |
When computing the generalized eigenvalue decomposition of the two matrices, eigenvectors are obtained for matrix as
and sorted by the descending diagonal matrix D of eigenvalues
as follows:
![]() |
Then,
will be
.
Subsequently, linear discriminant analysis (LDA) is applied to identify the EEG signals in each sub-band spectrum [59]. LDA is a well-known binary classification method that can project data in a new space using
to minimize the within class scatter and maximize the scatter between classes [56]. The accuracy of CSP combined the LDA approach for MI BCI classification had been discussed in our previous work [60], and detailed information can be found in those studies. In this study, the raw EEG data are filtered into three frequency bands including alpha (8 to 13 Hz) and beta (13 to 30 Hz) for adopting the SB-CSP and LDA to investigate the accuracy of each MI task.
F. Functional Connectivity Estimated By Transfer Entropy
Brain connectivity analysis, particularly functional and effective connectivity, represents one of the most promising approaches to investigate the brain operation of MI and improve MI-BCI performance [2], [42], [61]. Transfer entropy (TE) is the best-known method in this area, which naturally incorporates directional and dynamical information because it is inherently asymmetric and based on transition probabilities [44]. In previous works, TE has demonstrated its robustness against volume conduction and its effectiveness in investigating nonlinear interactions between brain areas [44], [61]–[63].
TE is a model-free measure based on information theory and can be used to calculate the amount of directed information transmission between two systems [64]. TE is deduced from information and conditional transition probabilities between any two processes evolving in time. Let
and
be two processes that represent two interacting systems (time series) that can be approximated by stationary Markov processes. Thereupon, using a delay embedded vector (
, we could easily reconstruct the full state space of the processes of interest. The dimension of the embedding space was d, and the delay was
[44]. According to the assumption, the system S could be approximated by a stationary Markov process of order d. Then, the transition probability of the system was described as follows:
. The entropy rate of system X is defined as the amount of additional information required to represent the value of the additional state. All previous states of the systems are known and can be computed as follows:
![]() |
The conditional probability
is calculated from the joint probabilities
. The probabilities
are estimated via kernel estimation or the k-nearest neighbor approach [65]. To measure the amount of information transferred from process Y to process X, the entropy rate of system X is defined as the amount of additional information required to represent the value of the additional state. As noted for all previous states of the systems, we deduce this state as follows:
![]() |
If two different processes were not dependent, there is no transfer of information, and it would cause
, where the state of X only depends on d states of X. According to previous work, it used Kullback divergence or mutual information to compute a measure of deviation from this generalized Markov property. The information flow from Y to X, which is called transfer entropy
, was computed as follows [64]:
![]() |
where u was the prediction time. The joint probabilities
can be estimated by kernel density estimation or the k-nearest neighbor approach [62]. Conditional transition probabilities were determined from the embedding vector to sum the TE value. To estimate the TE value, it is necessary to reconstruct the embedding space of the data [63]. The embedding space was reconstructed by
. The dimension d was obtained by an effective search algorithm, and the delay
was determined by Cao’s criterion [66]. The equation can be rewritten as follows:
![]() |
TE indicates directional information flow and was inherently asymmetric; thus,
. However, when the two signals of processes are independent,
.
The estimation of parameters and the calculation of TE were performed using TRENTOOL (Version 2.0.4) [63]. In this study, prediction time u was set to 1 and K was set to 4 for the k-nearest neighbor approach as suggested by a previous study [65]. The window(T) of Theiler correction was set to 1 to remove the autocorrelation effect from the density estimation.
In this study, the estimation of effective connectivity between the selected channels have been conducted over various MI conditions and different EEG frequency bands, alpha (8-13Hz), beta (14-30Hz), and gamma (31-50Hz) bands, for both left- and right-hand motor imagery. The TE mean values and standard deviations of any two of the selected channels’ connectivity pairs (source to sink) across all subjects have been calculated for each MI task under three frequency bands when they performed left- and right-hand imagery.
G. Statistical Analysis
The TE values of the MI stage in three EEG frequency bands were normalized by subtracting the mean baseline (fixation stage) for the motor imagery of both hands under each MI condition. Therefore, in this study, the normalized TE values are relative-TE values, which represent the changes with respect to the baseline period. Nine electrodes (F3, Fz, F4, C3, Cz, C4, P3, Pz and P4) were selected to investigate brain connectivity during the motor imagery stage of the three MI conditions. For further analysis, subjects’ TE values of the connectivity pairs in each MI task were averaged and tested using the Wilcoxon signed rank test with an FDR correction (p<0.05). Given the complexity of the MI task, two comparisons (rMI vs rmMI; bcMI vs rmMI) were taken in this study to test whether the rotation movement and bilateral coordination can evoke more brain interaction when performing single hand motor imagery tasks.
III. Experimental Results
A. ERD/ERS for Three MI Tasks
Fig. 2 shows the comparisons of averaged ERD of contralateral and ipsilateral channels under left and right hand motor imagery for three MI tasks (tMI, rmMI,and bcMI). The Wilcoxon signed rank test with FDR-adjusted was used to compare the difference between the ERD at the two channels (C3 and C4) under the motor imagery stage of both hands for the three MI tasks. As shown in Fig. 2, the alpha power was significantly suppressed at the contralateral channel as compared to the ipsilateral channel for motor imagery of both hands under all MI tasks (p<0.05), except for the right hand imagery in the tMI condition (p=0.061). The results demonstrate that the slightly complex video feedback employed in these MI conditions did not disturb the MI performance, and all participants were able to successfully perform the assigned motor imagery, which were reflected in the alpha desynchronization changes at the motor area.
FIGURE 2.
Mu (alpha) ERD comparisons of contralateral and ipsilateral channels under left and right-hand motor imagery (corresponding to a and b) for three MI tasks, including the traditional MI task (tMI), rotation movement MI task (rmMI) and bimanual coordination MI task (bcMI). The stars (*) represent the statistical significant levels (Wilcoxon signed rank test), * for p<0.05 and *** for p<0.001. The y-axis is alpha power change relative baseline (%).
B. Classification Accuracy of Three MI Tasks
To confirm whether MI-BCI performance is influenced by the rotation movement (rmMI) and both hands representation (bcMI) designed in this study, the CSP and LDA were applied to test the classification accuracy of these three MI conditions.
The optimal value for the parameter ‘m’ in the CSP algorithm was determined by testing values in the range of 1 to 8 to maximize the classification accuracy. For each value of m, after the CSP projection, 10-fold cross validation was applied to data 100 times. The test results for all subject under the three MI conditions were averaged and these results are shown in Fig. 3 Based on these results, ‘m’ = 5 achieves the highest accuracy value (90.83). Thus, m = 5 is selected for the CSP projections under every MI condition.
FIGURE 3.
The selection of parameter comparisons for CSP.
After extracting the EEG features by CSP, LDA was applied to perform the classification for all the three MI conditions. Here, 10-fold cross validation was applied 100 times. Fig. 4 shows the accuracy distributions of three MI tasks. Although the highest accuracy rate (92.1 ± 6) is noted for tMI condition, the rmMI and bcMI conditions still achieve high classification accuracies (91.5 ± 6.7 and 87.1 ± 5.2). In Fig. 2, tMI and rmMI seem to be more lateralized than bcMI, but in Fig. 4, the accuracy of MI tasks has no significant difference among the three tasks. Therefore, the rotation movement and the bi-hand presentations of visual feedback do not impede the operation and the classification of motor imagery. These results demonstrate that the participants were able to follow the experiment instructions and perform motor imagery of the assigned single hand successfully in all three MI tasks without any distraction.
FIGURE 4.
Box plot of classification accuracy distributions of tMI, rmMI, and bcMI (Wilcoxon rank sum test, p < 0.05).
The above accuracy results of LDA classification with CSP filters among three MI tasks indicate that the newly proposed MI conditions can also evoke similar responses as compared to the traditional MI condition as all participants were able to correctly perform the motor imagery under all conditions without any prior experience.
C. Functional Connectivity Under Various MI Conditions
In Fig. 5 and Fig. 6, the TE mean values of 72 connectivity pairs (source to sink) from nine selected channels for each MI task have been evaluated under three frequency band (alpha, beta, and gamma bands).
FIGURE 5.
Pairwise comparisons of TE topographic connectivity between rmMI and tMI tasks. Only statistical tests that achieved significance (p<0.05) were retained. 2R > 1R and 2L > 1L mean the significantly increased amount of connectivity of the rmMI task under right-hand motor imaginary and left-hand motor imagery relative to the tMI task, respectively.
FIGURE 6.
Pairwise comparisons of TE topographic connectivity between bcMI and rmMI tasks. Only statistical tests that achieved significance (p<0.05) were retained. 3R > 2R and 3L > 2L mean the significantly increased amount of connectivity of the bcMI task under right-hand motor imaginary and left-hand motor imagery relative to the rmMI task, respectively.
The pairwise connectivity measures that achieve statistical significance (FDR-adjusted p<0.05) during tMI and rmMI conditions are shown in Fig. 5. Fig. 6 shows the statistically significant pairwise connectivity measures during rmMI and bcMI conditions. These results illustrate minimal differences among three frequency bands in the comparisons between the tMI and rmMI conditions. In the contrast, the bcMI shows more significant and complex connectivity than the rmMI for all three bands, especially in the left hand imagery.
As shown in Fig. 5, no significant differences in alpha bands were found between the rmMI and tMI. However, rmMI exhibited increased information flow of the beta band from C4 to C3 (right-hand imagery), Pz to Cz (left-hand imagery) and C4 to Fz (left-hand imagery). The difference was also shown in the gamma band analysis for left-hand imagery only, including from Pz to Cz, Pz to Fz, Fz to Pz and F3 to P3. Since the alpha and beta are the basic brain indices for motor imagery, the rotation movement of rmMI does not seem to influence the operation of motor imagery at the motor area. The space information of visual rotation exhibits a feed-forward pattern from the parietal to central area with the beta rhythm and can be used to adjust the position of the imaged hand via fronto-parietal gamma synchronization.
In Fig. 6, the bcMI task demonstrated an increase amount of connectivity compared to the rmMI task. With the EEG alpha features, bcMI task infers directional flow from Pz to Cz, P3 to P4, P3 to F3, C3 to P4 and F3 to P3 when performing right-hand imagery tasks and from P3 to F4, Pz to P3, Pz to F3 and Pz to F4 in the left-hand MI condition. In the beta analysis, observed significant brain connectivity changes are found from P3 to F3, P3 to F4, C3 to P4, C3 to Fz and Cz to P4 in the right hand MI and from P3 to Pz, P3 to F4, Pz to F4, C3 to P3, F3 to F4 and F4 to P3 for imaging the left hand. Similar results are found in the gamma band. Compared to the rmMI, the bcMI task exhibited increased information flow from P3 to Fz, Pz to Cz and C3 to P4 for right-hand MI and from P3 to F4, Pz to F3, Pz to F4, C3 to P3, F3 to F4 and Fz to P3 for the left-hand imagery condition. Significant differences are noted when performing the right- and left-hand imagery tasks in this comparison.
IV. Discussion and Conclusion
In this study, novel MI-BCI, bimanual and rotated motor imagery is proposed to explore brain connectivity when performing ipsilateral motor imagery tasks. The basic MI phenomena were supported in all three conditions based on the ERD changes in the contralateral alpha frequency band, and the results were classified by CSP and LDA.
The subjects performed the ipsilateral motor imagery task with bilateral or rotation visual feedback. Based on these MI criteria, the bcMI-BCI can evoke increased brain connectivity, especially when performing the left-hand imagery task.
As shown in Fig. 6, in the right-hand imagery task, the contralateral parietal site was strongly connected to the contralateral frontal region across all frequency bands and provided two-way communication via alpha rhythm. Moreover, left motor area showed increased information flow to the ipsilateral parietal region with all three frequency EEG features. In the left-hand imagery task, with the exception of the space information of rotation movement that was sent from the parietal to both lateral frontal regions that are related to motor action planning, the ipsilateral parietal region had a strong connection with the contralateral frontal areas across all frequency bands. However, bidirection flows were noted in the beta and gamma analysis. A more interesting finding is the interaction between the bilateral frontal electrodes via beta and gamma rhythms.
Based on our experimental results, this study supports the following conclusions:
-
(1)
mutual communication occurs between the prefrontal area (F3 and F4), which indicates that the nonimagined hand (ipsilateral site) and imagined hand (contralateral site) interact with each other for motor preparation and bilateral arm coordination after receiving visual feedback;
-
(2)
communication occurs from the parietal region to bilateral frontal area (Pz to F3 and F4), which indicates that rotation of the hand-bike kept providing the spatial location information of each hand for motor planning. Because the neural patterns are influenced by the function of handedness, less connectivity in right hand condition could be due to all participants are the same right-handed and can image more efficiently [67].
In summary, this study demonstrates the dynamic connectivity when using bcMI and could be used as the index to investigate the reorganization and reconnection of motor cortex with the MI rehabilitation approach.
V. Limitations
Although the current study validated the brain connectivity while executing bcMI to investigate the reorganization and reconnection of the motor cortex with the MI rehabilitation approach, the present demonstration still has some limitations.
First, the connectivity of bimanual and rotated motor condition could be still influenced by the methodological limitation. Therefore, the weighted effect of rotation movement or solely the bimanual component should be further investigated with bimanual static imagery.
Second, although the study has yielded consistent results across the subjects participating in the experiment, more testing samples and comparison tests were still needed to confirm effectiveness and robustness.
Third, our findings exhibit the ordinary people’s brain connectivity of bcMI as the index; however, for further MI rehabilitation, the future work of the study should collect more data from the patient subjects, such as the stroke patients, for validation.
Funding Statement
This work was supported in part by the Ministry of Science and Technology, Taiwan, under Contract MOST 106-2218-E-009-027-MY3, Contract MOST 109-2221-E-009-050-MY2, and Contract MOST 110-2221-E-A49-130-MY2; and in part by the Australian Research Council (ARC) under Discovery under Grant DP210101093 and Grant DP220100803.
Contributor Information
Kuan-Chih Huang, Email: kchuang.ece91g@g2.nctu.edu.tw.
Chin-Teng Lin, Email: chin-teng.lin@uts.edu.au.
References
- [1].Cervera M. A.et al. , “Brain-computer interfaces for post-stroke motor rehabilitation: A meta-analysis,” Ann. Clin. Transl. Neurol., vol. 5, no. 5, pp. 651–663, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [2].Hamedi M., Salleh S. H., and Noor A. M., “Electroencephalographic motor imagery brain connectivity analysis for BCI: A review,” Neural Comput., vol. 28, no. 6, pp. 999–1041, Jun. 2016. [DOI] [PubMed] [Google Scholar]
- [3].Lance B.et al. , “Towards serious games for improved BCI,” in Handbook of Digital Games and Entertainment Technologies. Singapore: Springer, 2017, pp. 197–224. [Google Scholar]
- [4].Frolov A. A.et al. , “Post-stroke rehabilitation training with a motor-imagery-based brain-computer interface (BCI)-controlled hand exoskeleton: A randomized controlled multicenter trial,” Frontiers Neurosci., vol. 11, p. 400, Jul. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [5].Zhang D., Ren Y., Gui K., Jia J., and Xu W., “Cooperative control for a hybrid rehabilitation system combining functional electrical stimulation and robotic exoskeleton,” Frontiers Neurosci., vol. 11, p. 725, Dec. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [6].Remsik A. B.et al. , “Ipsilesional mu rhythm desynchronization and changes in motor behavior following post stroke BCI intervention for motor rehabilitation,” Frontiers Neurosci., vol. 13, p. 53, Mar. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [7].Bundy D. T.et al. , “Contralesional Brain–Computer interface control of a powered exoskeleton for motor recovery in chronic stroke survivors,” Stroke, vol. 48, no. 7, pp. 1908–1915, Jul. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [8].Ramos-Murguialday A.et al. , “Brain-machine interface in chronic stroke rehabilitation: A controlled study,” Ann. Neurol., vol. 74, no. 1, pp. 8–100, Jul. 2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [9].Soekadar S. R., Witkowski M., Mellinger J., Ramos A., Birbaumer N., and Cohen L. G., “ERD-based online brain-machine interfaces (BMI) in the context of neurorehabilitation: Optimizing BMI learning and performance,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 5, pp. 542–549, Oct. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [10].Várkuti B.et al. , “Resting state changes in functional connectivity correlate with movement recovery for BCI and robot-assisted upper-extremity training after stroke,” Neurorehabilitation Neural Repair, vol. 27, no. 1, pp. 53–62, 2013. [DOI] [PubMed] [Google Scholar]
- [11].Caria A.et al. , “Chronic stroke recovery after combined BCI training and physiotherapy: A case report,” Psychophysiology, vol. 48, no. 4, pp. 578–582, Apr. 2011. [DOI] [PubMed] [Google Scholar]
- [12].Song J.et al. , “Characterizing relationships of DTI, fMRI, and motor recovery in stroke rehabilitation utilizing brain-computer interface technology,” Frontiers Neuroeng., vol. 7, p. 31, Jul. 2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [13].Zich C., Debener S., Schweinitz C., Sterr A., Meekes J., and Kranczioch C., “High-intensity chronic stroke motor imagery neurofeedback training at home: Three case reports,” Clin. EEG Neurosci., vol. 48, no. 6, pp. 403–412, Nov. 2017. [DOI] [PubMed] [Google Scholar]
- [14].Daly J. J., Cheng R., Rogers J., Litinas K., Hrovat K., and Dohring M., “Feasibility of a new application of noninvasive brain computer interface (BCI): A case study of training for recovery of volitional motor control after stroke,” J. Neurol. Phys. Therapy, vol. 33, no. 4, pp. 203–211, 2009. [DOI] [PubMed] [Google Scholar]
- [15].Muralidharan A., Chae J., and Taylor D. M., “Extracting attempted hand movements from EEGs in people with complete hand paralysis following stroke,” Frontiers Neurosci., vol. 5, p. 39, Mar. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [16].Cauraugh J. H., Kim S. B., and Duley A., “Coupled bilateral movements and active neuromuscular stimulation: Intralimb transfer evidence during bimanual aiming,” Neurosci. Lett., vol. 382, nos. 1–2, pp. 39–44, Jul. 2005. [DOI] [PubMed] [Google Scholar]
- [17].Carson R. G., “Neural pathways mediating bilateral interactions between the upper limbs,” Brain Res. Rev., vol. 49, no. 3, pp. 641–662, Nov. 2005. [DOI] [PubMed] [Google Scholar]
- [18].Manganotti P., Acler M., Zanette G. P., Smania N., and Fiaschi A., “Motor cortical disinhibition during early and late recovery after stroke,” Neurorehabil. Neural Repair, vol. 22, no. 4, pp. 396–403, Jul./Aug. 2008. [DOI] [PubMed] [Google Scholar]
- [19].Jang S. H., “Motor function-related maladaptive plasticity in stroke: A review,” NeuroRehabilitation, vol. 32, no. 2, pp. 311–316, 2013. [DOI] [PubMed] [Google Scholar]
- [20].Takeuchi N. and Izumi S., “Maladaptive plasticity for motor recovery after stroke: Mechanisms and approaches,” Neural Plast, vol. 2012, Oct. 2012, Art. no. 359728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [21].Lee S., Kim Y., and Lee B.-H., “Effect of virtual reality-based bilateral upper extremity training on upper extremity function after stroke: A randomized controlled clinical trial,” Occupational Therapy Int., vol. 23, no. 4, pp. 357–368, Dec. 2016. [DOI] [PubMed] [Google Scholar]
- [22].Whitall J.et al. , “Bilateral and unilateral arm training improve motor function through differing neuroplastic mechanisms: A single-blinded randomized controlled trial,” Neurorehabilitation Neural Repair, vol. 25, no. 2, pp. 118–129, 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [23].Cauraugh J. H., Lodha N., Naik S. K., and Summers J. J., “Bilateral movement training and stroke motor recovery progress: A structured review and meta-analysis,” Hum. Movement Sci., vol. 29, no. 5, pp. 853–870, Oct. 2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [24].Chen P.-M., Kwong P. W. H., Lai C. K. Y., and Ng S. S. M., “Comparison of bilateral and unilateral upper limb training in people with stroke: A systematic review and meta-analysis,” PLoS ONE, vol. 14, no. 5, May 2019, Art. no. e0216357. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Deiber M.-P., Caldara R., Ibañez V., and Hauert C.-A., “Alpha band power changes in unimanual and bimanual sequential movements, and during motor transitions,” Clin. Neurophysiol., vol. 112, no. 8, pp. 1419–1435, Aug. 2001. [DOI] [PubMed] [Google Scholar]
- [26].Rueda-Delgado L. M., Solesio-Jofre E., Serrien D. J., Mantini D., Daffertshofer A., and Swinnen S. P., “Understanding bimanual coordination across small time scales from an electrophysiological perspective,” Neurosci. Biobehavioral Rev., vol. 47, pp. 614–635, Nov. 2014. [DOI] [PubMed] [Google Scholar]
- [27].Vuckovic A., Pangaro S., and Finda P., “Unimanual versus bimanual motor imagery classifiers for assistive and rehabilitative brain computer interfaces,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 26, no. 12, pp. 2407–2415, Dec. 2018. [DOI] [PubMed] [Google Scholar]
- [28].Luft F.et al. , “Distinct cortical activity patterns in Parkinson’s disease and essential tremor during a bimanual tapping task,” J. NeuroEngineering Rehabil., vol. 17, no. 1, pp. 1–10, Mar. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [29].Vourvopoulos A., Jorge C., Abreu R., Figueiredo P., Fernandes J.-C., and Badia S. B. I, “Efficacy and brain imaging correlates of an immersive motor imagery BCI-driven VR system for upper limb motor rehabilitation: A clinical case report,” Frontiers Hum. Neurosci., vol. 13, p. 244, Jul. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Kam T.-E., Suk H.-I., and Lee S.-W., “Non-homogeneous spatial filter optimization for ElectroEncephaloGram (EEG)-based motor imagery classification,” Neurocomputing, vol. 108, pp. 58–68, May 2013. [Google Scholar]
- [31].Platz T.et al. , “Multimodal EEG analysis in man suggests impairment-specific changes in movement-related electric brain activity after stroke,” Brain, vol. 123, pp. 2475–2490, Dec. 2000. [DOI] [PubMed] [Google Scholar]
- [32].Jin J., Liu C., Daly I. M. Y., Li S., Wang X., and Cichocki A., “Bispectrum-based channel selection for motor imagery based brain-computer interfacing,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 28, no. 10, pp. 2153–2163, Oct. 2020. [DOI] [PubMed] [Google Scholar]
- [33].Jin J., Xiao R., Daly I., Miao Y., Wang X., and Cichocki A., “Internal feature selection method of CSP based on L1-norm and Dempster–Shafer theory,” IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 11, pp. 4814–4825, Nov. 2021. [DOI] [PubMed] [Google Scholar]
- [34].Feng J.et al. , “Towards correlation-based time window selection method for motor imagery BCIs,” Neural Netw., vol. 102, pp. 87–95, Jun. 2018. [DOI] [PubMed] [Google Scholar]
- [35].Jin J., Miao Y., Daly I., Zuo C., Hu D., and Cichocki A., “Correlation-based channel selection and regularized feature optimization for MI-based BCI,” Neural Netw., vol. 118, pp. 262–270, Oct. 2019. [DOI] [PubMed] [Google Scholar]
- [36].Tabar Y. R. and Halici U., “A novel deep learning approach for classification of EEG motor imagery signals,” J. Neural Eng., vol. 14, no. 1, Feb. 2017, Art. no. 016003. [DOI] [PubMed] [Google Scholar]
- [37].Wu S.-L.et al. , “Fuzzy integral with particle swarm optimization for a motor-imagery-based brain-computer interface,” IEEE Trans. Fuzzy Syst., vol. 25, no. 1, pp. 21–28, Feb. 2017. [Google Scholar]
- [38].Wu D., King J.-T., Chuang C.-H., Lin C.-T., and Jung T.-P., “Spatial filtering for EEG-based regression problems in Brain–Computer interface (BCI),” IEEE Trans. Fuzzy Syst., vol. 26, no. 2, pp. 771–781, Apr. 2018. [Google Scholar]
- [39].Asensio-Cubero J., Gan J. Q., and Palaniappan R., “Multiresolution analysis over simple graphs for brain computer interfaces,” J. Neural Eng., vol. 10, no. 4, Aug. 2013, Art. no. 046014. [DOI] [PubMed] [Google Scholar]
- [40].Teo W.-P. and Chew E., “Is motor-imagery brain-computer interface feasible in stroke rehabilitation?” PM&R, vol. 6, no. 8, pp. 723–728, 2014. [DOI] [PubMed] [Google Scholar]
- [41].Bajaj S., Butler A. J., Drake D., and Dhamala M., “Brain effective connectivity during motor-imagery and execution following stroke and rehabilitation,” NeuroImage Clin, vol. 8, pp. 572–582, Jan. 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [42].Rathee D., Cecotti H., and Prasad G., “Estimation of effective fronto-parietal connectivity during motor imagery using partial Granger causality analysis,” in Proc. Int. Joint Conf. Neural Netw. (IJCNN), Jul. 2016, pp. 2055–2062. [Google Scholar]
- [43].Wang L., Zhang J., Zhang Y., Yan R., Liu H., and Qiu M., “Conditional Granger causality analysis of effective connectivity during motor imagery and motor execution in stroke patients,” Biomed Res Int, vol. 2016, Oct. 2016, Art. no. 3870863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [44].Vicente R., Wibral M., Lindner M., and Pipa G., “Transfer entropy—A model-free measure of effective connectivity for the neurosciences,” J. Comput. Neurosci., vol. 30, no. 1, pp. 45–67, Feb. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [45].Delorme A. and Makeig S., “EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis,” J. Neurosci. Methods, vol. 134, no. 1, pp. 9–21, Mar. 2004. [DOI] [PubMed] [Google Scholar]
- [46].Onton J., Westerfield M., Townsend J., and Makeig S., “Imaging human EEG dynamics using independent component analysis,” Neurosci. Biobehavioral Rev., vol. 30, no. 6, pp. 808–822, Jan. 2006. [DOI] [PubMed] [Google Scholar]
- [47].Makeig S., Bell A. J., Jung T.-P., and Sejnowski T. J., “Independent component analysis of electroencephalographic data,” in Proc. Adv. Neural Inf. Process. Syst., 1996, pp. 145–151. [Google Scholar]
- [48].Makeig S., Jung T.-P., Bell A. J., Ghahremani D., and Sejnowski T. J., “Blind separation of auditory event-related brain responses into independent components,” Proc. Nat. Acad. Sci. USA, vol. 94, no. 20, pp. 10979–10984, 1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [49].Pfurtscheller G. and Da Silva F. L. H., “Event-related EEG/MEG synchronization and desynchronization: Basic principles,” Clin. Neurophysiol. vol. 110, no. 11, pp. 1842–1857, Nov. 1999. [DOI] [PubMed] [Google Scholar]
- [50].Leocani L., Toro C., Manganotti P., Zhuang P., and Hallett M., “Event-related coherence and event-related desynchronization/synchronization in the 10 hz and 20 hz EEG during self-paced movements,” Electroencephalogr. Clin. Neurophysiol./Evoked Potentials Sect., vol. 104, no. 3, pp. 199–206, May 1997. [DOI] [PubMed] [Google Scholar]
- [51].Zhang R.et al. , “Control of a wheelchair in an indoor environment based on a brain–computer interface and automated navigation,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 24, no. 1, pp. 128–139, Jan. 2016. [DOI] [PubMed] [Google Scholar]
- [52].Wei P., He W., Zhou Y., and Wang L., “Performance of motor imagery brain-computer interface based on anodal transcranial direct current stimulation modulation,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 21, no. 3, pp. 404–415, May 2013. [DOI] [PubMed] [Google Scholar]
- [53].Müller-Gerking J., Pfurtscheller G., and Flyvbjerg H., “Designing optimal spatial filters for single-trial EEG classification in a movement task,” Clin. Neurophysiol., vol. 110, no. 5, pp. 787–798, May 1999. [DOI] [PubMed] [Google Scholar]
- [54].Koles Z. J., “The quantitative extraction and topographic mapping of the abnormal components in the clinical EEG,” Electroencephalogr. Clin. Neurophysiol., vol. 79, no. 6, pp. 440–447, Dec. 1991. [DOI] [PubMed] [Google Scholar]
- [55].Lugger K., Flotzinger D., Schlögl A., Pregenzer M., and Pfurtscheller G., “Feature extraction for on-line EEG classification using principal components and linear discriminants,” Med. Biol. Eng. Comput., vol. 36, no. 3, pp. 309–314, May 1998. [DOI] [PubMed] [Google Scholar]
- [56].Coyle D., Satti A., and McGinnity T. M., “Predictive-spectral-spatial preprocessing for a multiclass brain-computer interface,” in Proc. Int. Joint Conf. Neural Netw. (IJCNN), Jul. 2010, pp. 1–8. [Google Scholar]
- [57].Coyle D., Satti A., Prasad G., and McGinnity T. M., “Neural time-series prediction preprocessing meets common spatial patterns in a brain-computer interface,” in Proc. 30th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., Aug. 2008, pp. 2626–2629. [DOI] [PubMed] [Google Scholar]
- [58].Novi Q., Guan C., Dat T. H., and Xue P., “Sub-band common spatial pattern (SBCSP) for brain-computer interface,” in Proc. 3rd Int. IEEE/EMBS Conf. Neural Eng., May 2007, pp. 204–207. [Google Scholar]
- [59].Zhang R., Xu P., Guo L., Zhang Y., Li P., and Yao D., “Z-score linear discriminant analysis for EEG based brain-computer interfaces,” PLoS ONE, vol. 8, no. 9, Sep. 2013, Art. no. e74433. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [60].Wu S.-L., Wu C.-W., Pal N. R., Chen C.-Y., Chen S.-A., and Lin C.-T., “Common spatial pattern and linear discriminant analysis for motor imagery classification,” in Proc. IEEE Symp. Comput. Intell., Cognit. Algorithms, Mind, Brain (CCMB), Apr. 2013, pp. 146–151. [Google Scholar]
- [61].Grosse-Wentrup M., “Understanding brain connectivity patterns during motor imagery for brain-computer interfacing,” in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 561–568. [Google Scholar]
- [62].Lee J., Nemati S., Silva I., Edwards B. A., Butler J. P., and Malhotra A., “Transfer entropy estimation and directional coupling change detection in biomedical time series,” Biomed. Eng. OnLine, vol. 11, no. 1, p. 19, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [63].Lindner M., Vicente R., Priesemann V., and Wibral M., “TRENTOOL: A MATLAB open source toolbox to analyse information flow in time series data with transfer entropy,” BMC Neurosci., vol. 12, no. 1, p. 119, Nov. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [64].Schreiber T., “Measuring information transfer,” Phys. Rev. Lett., vol. 85, no. 2, p. 461, Jul. 2000. [DOI] [PubMed] [Google Scholar]
- [65].Kraskov A., Stogbauer H., and Grassberger P., “Estimating mutual information,” Phys. Rev. E, Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top., vol. 69, no. 6, Jun. 2004, Art. no. 066138. [DOI] [PubMed] [Google Scholar]
- [66].Cao L., “Practical method for determining the minimum embedding dimension of a scalar time series,” Phys. D, Nonlinear Phenomena, vol. 110, nos. 1–2, pp. 43–50, Dec. 1997. [Google Scholar]
- [67].Serrien D. J. and Sovijarvi-Spape M. M., “Manual dexterity: Functional lateralisation patterns and motor efficiency,” Brain Cognition, vol. 108, pp. 6–42, Oct. 2016. [DOI] [PubMed] [Google Scholar]














