Abstract
BACKGROUND:
This study focused on developing an upper limb rehabilitation program. In this regard, a steady state visual evoked potential (SSVEP) triggered brain computer interface (BCI)-functional electrical stimulation (FES) based action observation game featuring a flickering action video was designed.
OBJECTIVE:
In particular, the synergetic effect of the game was investigated by combining the action observation paradigm with BCI based FES.
METHODS:
The BCI-FES system was contrasted under two conditions: with flickering action video and flickering noise video. In this regard, 11 right-handed subjects aged between 22–27 years were recruited. The differences in brain activation in response to the two conditions were examined.
RESULTS:
The results indicate that T3 and P3 channels exhibited greater Mu suppression in 8–13 Hz for the action video than the noise video. Furthermore, T4, C4, and P4 channels indicated augmented high beta (21–30 Hz) for the action in contrast to the noise video. Finally, T4 indicated suppressed low beta (14–20 Hz) for the action video in contrast to the noise video.
CONCLUSION:
The flickering action video based BCI-FES system induced a more synergetic effect on cortical activation than the flickering noise based system.
Keywords: Brain computer interface (BCI), functional electrical stimulation (FES), flickering action video, steady state visual evoked potential (SSVEP), action observation, rehabilitation, upper limb, mirror neuron system (MNS)
1. Introduction
Stroke is the main cause of neurological disability and restricted body movements [1]. Previous studies on motor recovery have indicated that the most rapid recovery occurs during the first few weeks after a stroke [2]. Several clinical experiments have indicated that repetitive rehabilitation exercises such as ‘sitting down and up on a chair’ and ‘arm exercise using a ball’ are crucial for motor learning and recovery of stroke patients [3, 4, 5]. Further, rehabilitation treatments tend to focus on restoration of lost motor functions. However, patients with severe motor impairment have difficulty to perform repetitive rehabilitation exercises which may lead to successful recovery.
Treatments based on activation of the mirror neuron system (MNS) can facilitate brain plasticity in patients who have severe disability [6, 7, 8, 9]. The MNS is a neural mechanism related to the ability of understanding and imitating the actions of another person [10, 11, 12, 13, 14]. Specifically, mirror neuron activation appears to induce a response similar to actual exercising in the motor cortex when an action is observed [9, 15]. Activation of the MNS is indicated by suppression of the Mu band (8 to 13 Hz) in the sensorimotor cortex [16, 17, 18, 19, 20, 21]. Mu suppression is generated by desynchronization of the cells in the sensorimotor cortex during action observing, exercising, and imaging [16, 17, 18, 19, 20]. Therefore, patients unable to perform movement can experience stimulation of the motor cortex and learn the motions by watching an action video.
In this study, we developed a steady state visual evoked potential (SSVEP) triggered brain computer interface (BCI)-functional electrical stimulation (FES) based action observation game featuring a flickering action video for stroke patients who were unable to move their upper limbs. Although it may cause tiredness due to flickering stimuli, a SSVEP-based BCI system has advantages such as no need training and higher classification accuracy compared to a motor-imagery based BCI system [22]. In stroke patients who have difficulties performing motor-imagery, the SSVEP triggering system can be more useful to induce repetitive movement through FES. The FES is an effective method for assisting and improving motor functions in rehabilitation [23, 24]. It has been used as a neuroprosthetic, which generates functional movement of paralyzed muscle such as grasping, standing, and walking [25, 26]. The therapeutic application of FES has benefits of increasing muscle strength and endurance, and reducing muscle spasticity [23, 27, 28, 29]. Furthermore, it induces motor cortex activation through repetitive movement exercise [30, 31, 32, 33, 34]. In previous studies, the effect of FES was enhanced when applied in combination with other therapies than when applied alone [35, 36, 37].
Utilization of FES while watching the action video can be expected to stimulate the MNS synergistically to consequently improve rehabilitation effects in patients who cannot control the upper limbs. Synchronization between arm movement in the action video and real arm movement by the FES can significantly activate the motor cortex to enhance rehabilitation effects [38]. Therefore, synergetic effects of the flickering action video-based BCI-FES system need further investigation. In this regard, this study conducted experiments to compare an action video which activated the MNS and a noise video which could not. Subsequently, differences in brain activation in response to the two conditions were examined. It should be noted that this experiment recruited healthy subjects to evaluate the feasibility of the program. The results are likely to advance understanding of faster and improved rehabilitation.
2. Methods
2.1. Subjects
The experiment was conducted on 11 right-handed healthy subjects aged between 22 and 27 years. Subjects who consumed coffee and cold medication were excluded. All subjects were first provided with the instructions regarding the experiment, providing information about the experiment, the purpose of the study, and the data protection policy and signed the written consent form for this experiment (IRB no. DSMC2019-03-018-002).
2.2. Instruments used in the experiment
In this study, an electroencephalogram (EEG) acquisition device (DSI-24; WEARABLE Sensing, San Diego, USA) was utilized to obtain EEG signals and an FES device (Microstim; Medel GmbH Inc, Hamburg, Germany) was utilized to electrically stimulate the wrist extensor muscles. A personal computer analyzed the EEG signal and ran the game contents in real time. The DSI-24 comprised 21 electrodes which were placed according to the 10–20 system (Fig. 1). The classification and analysis of EEG signals were based on 19 channels (Fp1, Fp2, F7, F3, Fz, F4, F8, T3, C3, Cz, C4, T4, T5, P3, Pz, P4, T6, O1, and O2). Further, the Microstim had two electrodes to provide electrical stimulation pulses and induce muscle contractions (Fig. 1). The stimulation level was adjusted to avoid strain on the muscles.
2.3. Experimental conditions
Two conditions were established in this experiment: (i) flickering action video condition (Fig. 2c) where the upper limb of the subject was periodically raised and lowered in the video area of the game and (ii) flickering noise video condition (Fig. 2d) where the brightness and contrast of the video matched those of the action video. It should be noted that the game was played in the same manner for the two conditions.
2.4. Classifier training session
The training session involved subjects watching the flickering action video (Fig. 2c) or the flickering noise video (Fig. 2d) for a duration of 3 minutes to subsequently classify the SSVEP. The SSVEP would peak dominantly for the O1 and O2 channels of the occipital lobe while watching the flickering videos. It should be noted that peak SSVEP was observed at 15 Hz if the subjects watched the flickering action video at 15 Hz. Therefore, the presence of SSVEP was utilized to ascertain if the subjects were watching the video or not.
Each training session had seven trials and each trial comprised a block characterized by watching a white crosshair image with black background for 10 sec and subsequently watching the noise or action video for 15 sec (Fig. 3a). Finally, the measured EEG signal was transmitted to design an SSVEP distinguishing classifier. There was no FES stimulation during the training session.
2.5. Classifier design and classification process
Individual classifiers were designed with OpenVIBE software (ver. 1.2.0) (INRIA, Rennes, France) to distinguish between ‘watching the flickering video’ and ‘rest state’ of subjects. Common spatial pattern (CSP) filters and classifiers were designed using training data obtained for the 19 channels (Fp1, Fp2, F7, F3, Fz, F4, F8, T3, C3, Cz, C4, T4, T5, P3, Pz, P4, T6, O1, and O2). For this, the EEG data for two groups (1: action video or noise video; 2: rest) were used to design CSP filters and classifier for each group. The signal obtained for the 19 channels and transmitted through a temporal filter with SSVEP and mu ranging from 14.5–15.5 and 8–13 Hz, respectively. Subsequently, two CSP filters were created using the filtered signal so that it could maximize the variance of the signal between two states. As a next step, the original signal pass thorough again the temporal filter and the CSP filters followed by estimation of the power average for the two frequency bands to generate feature vectors. Using these feature vectors, the classifier was designed to distinguish the ‘watching video state’ from the ‘rest state’. After designing the CSP filters and the classifier, the CSP filters and classifiers was applied to thr real-time system. The real time data pass through the signal processing pipeline which was composed of the temporal filtering and the CSP filters, and finally the classifier gave command to control FES activation and game playing.
2.6. Game program design
The game program featured a farmer plucking apples by raising the arm and a flickering video area adjacent to the farmer (Fig. 2b). The video play and raising of the farmer’s arm occurred synchronously if a detectable SSVEP was evoked while watching the flickering video. Subsequently, the FES device provided electrical stimulation to induce wrist extension movements in the subjects. In particular, the upper limb in the video was raised from 0–2.25 sec (out of 3.75 sec) when SSVEP was detected for the entire duration of the action video. Subsequently, the farmer ‘plucked’ the golden apple and rested the arm for the remainder experiment at which point the subject’s wrist returned to resting position. It should be noted that if no SSVEP was evoked during the game play, the farmer’s arm would be lowered and the FES would be switched off. Consequently, the subject’s wrist would remain in the resting position and the farmer would not obtain the apple. The same process was followed for the noise video.
2.7. Experimental procedure
In this study, the subjects were instructed to sit on a chair in front of a desk while resting their arms on the table. One set of surface electrodes positioned on extensor carpi radialis (ECR) muscle of the dominant arm. The cathode was placed over the motor point of ECR muscle, and the anode on the surface of the forearm distal to cathode. The amplitude was set to produce wrist extension movement, and was adjusted to minimize discomfort during stimulation. They were further instructed to not move their hands, feet, and heads during all processes except the rest time. As indicated in Fig. 3c, first, the resting state EEG was obtained over a duration of 3 min while the subjects sat in a relaxed manner with their eyes open. Subsequently, the classifier training session was conducted with the action and noise video conditions (3 minutes each). A classifier was generated after concluding the training session. The experiment comprised running one of the action or noise video condition for 5 min followed by rest for 5 min without measuring the EEG signal. Finally, the game program was conducted by playing the other video for 5 min. The order of providing the action and noise videos was counter balanced. The training and experimental sessions had 7 and 12 trials, respectively. Each trial comprised watching a white crosshair image with black background for 10 seconds followed by watching the noise or action video for 15 seconds. There was no FES stimulation during the training session. The total experimental time was approximately 30 minutes. Great care was taken to ensure that subjects were participating in the experiments. The subjects were asked if they had any adverse effects including eye discomfort, dizziness, and headache during each experiment session.
2.8. EEG analysis
In this study, the EEG signal were obtained from 19 channels (Fp1, Fp2, F7, F3, Fz, F4, F8, T3, C3, Cz, C4, T4, T5, P3, Pz, P4, T6, O1, and O2) . However, only T3, T4, C3, C4, P3, and P4 were analyzed to investigate the effects on motor function. Data analysis was performed using MATLAB (MathWorks, Natick, USA). The EEG data were sampled at a rate of 256 Hz. Further, EEG data filtered with band pass filtering ranged from 5 to 30 Hz and electrooculography (EOG) was removed using the automatic artifact removal algorithm (Mathematics Department, Macquarie University, Sydney, Australia). The mean of epoch data was made zero by demean process which is subtracting the average value of the raw data of the epoch. Subsequently, the analysis utilized epochs ranging from 70 to 70 uv to avoid transfer to epochs characterized by high peaks. The epoch for the short-time Fourier transform (STFT) ranged from 1 sec before the video starts to the end of the video. A single trial comprised playing the white crosshair with black background for 10 sec followed by playing the action video for 3.75 sec. This block was repeated four times. Further, 1 to 0 sec was always brought at 9 to 10 sec of white crosshair with black background. Subsequently, the STFT was performed with Hamming window to obtain the magnitude of temporal frequency. The STFT values were averaged from 1 sec before the start image to the start image. Further, the average values were divided by STFT values obtained at 3.75 sec. Finally, the values were log transformed.
2.9. Statistics
Paired -test was conducted to compare spectrum of the measured EEG data between action video and noise video condition using function test in MATLAB (Mathworks, Natick, USA).
3. Results
All subjects completed the experiment with no adverse events. The classifying accuracy for our classifier for flickering action video and noise video was 93.51 6.96% and 91.08 7.36% respectively when a 10-fold cross validation test was conducted. Figure 4 presents the results of the frequency analysis for action and noise videos played during the game program session. The graphs indicate log values of the EEG signal with frequency ranging from 5 to 30 Hz. Red represents the action video while blue represents the noise video. Paired-t test was performed for identifying significant differences. Further, ranges less than the significant threshold ( 0.05) have been represented as blue lines under the graphs. The results indicated a suppressed Mu band for the action video than the noise video for T3 and P3. Further, T4, C4, and P4 indicated an augmented high beta band for the action video than the noise video. In contrast, T4 indicated a suppressed low beta band for the action video than the noise video.
4. Discussion
This study investigated the effects of a rehabilitation game based on action observation and FES. Flickering action video could evoke the activations of the MNS and provide highly detectable SSVEP responses simultaneously. It could be contrasted to simple motor imagery paradigm which could reveal lower detection rate and more individual variability than SSVEP based control paradigm, even though motor imagery could evoke the activations of the MNS. In addition, the flickering action video combined with FES could be expected to reveal synergetic effects on the motor learning mechanism. In this regard, differences in brain activation due to flickering action and flickering noise videos were determined using BCI based FES.
The T3 and T4 electrodes were located over the temporal lobe which processes information from memory, sound, smell, and taste [39]. The primary function of the temporal lobe is to process auditory signals to aid formation of long-term memories and processing of new information [39]. In this study, T3 indicated a suppressed Mu band for the action video than the noise video (Fig. 4). The neural substrates responsible for the elaboration of new motor patterns includes the key centers of the mirror neuron system [9]. Therefore, action observation induced Mu suppression can activate the MNS to play an important role in rehabilitation therapy of patients [40, 41].
Furthermore, T4 indicated a suppressed low beta band (14 to 20 Hz) and an augmented high beta band (21 to 30 Hz) for the action video. Beta band indicates an active state of awakening or consciousness and logical thinking [39, 42]. Beta band can be divided into two bandwidths attributed to reactivity differences in tasks [42]. Low beta is generally associated with quiet, focused, and introverted concentration while high beta is related to significant stress, anxiety, high energy, and high arousal [39]. As indicated by the results, T4 was characterized by low beta suppression and high beta increase during the action video condition, thus suggesting that the subjects were more immersed in and focused on the game. These results indicate that action videos can aid active participation during BCI-FES programs. Additionally, the action video indicated high beta suppression (27–28 Hz) in T4. One can argue that the action video might lead to severe stress or excessive immersion. However, the range of significant difference between tow conditions was too narrow.
The C3 and C4 electrodes were located on the motor cortex of the lateral and medial surfaces of the cerebral hemisphere [43]. These are important areas for motor recovery. Therefore, the upper limb rehabilitation effect was mainly observed in the supplementary motor area (SMA), the premotor cortex, and the primary sensorimotor cortex [44, 45]. The C3 channel indicated Mu suppression under both conditions; however, the differences were not significant. This result could be attributed to a larger motor cortex activation by the FES than the difference between the action and noise videos. It should be noted that the non-significant differences between the two conditions (Fig. 4) could be attributed to the severe deviation caused by the FES [46]. However, T3 and P3 indicated significant differences since they were located relatively far from the center of the motor cortex and were less likely to be affected by the FES. The FES likely resulted in Mu suppression in the left hemisphere and high beta augmentation in the right hemisphere. The subjects were stimulated by attaching the FES device on their right arms, thus suggesting that the effect of the FES was likely stronger in the left hemisphere. Further, C4 indicated augmented high beta for the action video than the noise video. Therefore, the subjects were more focused while watching the game program.
The P3 and P4 channels were located on the parietal lobe which is involved in several complex tasks, sensory control, visual perception, movement, cognition, and information processing [39, 47, 48]. Further, the parietal lobe is closely linked to the occipital lobe [49]. Previous clinical studies indicated activation of the SMA and posterior parietal regions when a fake hand was threatened with a needle [50, 51, 52]. In this study, P3 indicated a suppressed Mu band for the action video. This could be attributed to the response of the parietal lobe which recognizes objects and accepts sensory information from observations.
5. Conclusions
We explored electrical brain activity during performance of flickering action video based BCI-FES system, how electrical activity may different compared with noise video condition. The results indicated larger cortical activation and high beta attenuation of action video based BCI-FES system compared with noise video. The results provide preliminary evidence of possibility of rehabilitation game based on utilizing the action video with FES in neurorehabilitation field in the future. Further clinical trial and application for patient are needed.
Acknowledgments
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (no. NRF-2017R1A2B4011920).
Conflict of interest
None to report.
References
- [1]. Takahashi M, Takeda K, Otaka Y, Osu R, Hanakawa T, Gouko M, Ito K. Event related desynchronization-modulated functional electrical stimulation system for stroke rehabilitation: a feasibility study. J Neuroeng Rehabil. 2012; 9: 56. doi: 10.1186/1743-0003-9-56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [2]. Kwakkel G, Wagenaar RC, Koelman TW, Lankhorst GJ, Koetsier JC. Effects of intensity of rehabilitation after stroke. A research synthesis. Stroke. 1997; 28: 1550-1556. doi: 10.1161/01.str.28.8.1550. [DOI] [PubMed] [Google Scholar]
- [3]. Bayouk JF, Boucher JP, Leroux A. Balance training following stroke: effects of task-oriented exercises with and without altered sensory input. Int J Rehabil Res. 2006; 29: 51-59. doi: 10.1097/01.mrr.0000192100.67425.84. [DOI] [PubMed] [Google Scholar]
- [4]. Yan T, Hui-Chan CW, Li LS. Functional electrical stimulation improves motor recovery of the lower extremity and walking ability of subjects with first acute stroke: a randomized placebo-controlled trial. Stroke. 2005; 36: 80-85. doi: 10.1161/01.STR.0000149623.24906.63. [DOI] [PubMed] [Google Scholar]
- [5]. Jones EG. Cortical and subcortical contributions to activity-dependent plasticity in primate somatosensory cortex. Annu Rev Neurosci. 2000; 23: 1-37. doi: 10.1146/annurev.neuro.23.1.1. [DOI] [PubMed] [Google Scholar]
- [6]. Buccino G, Solodkin A, Small SL. Small, Functions of the mirror neuron system: implications for neurorehabilitation. Cogn Behav Neurol. 2006; 19: 55-63. doi: 10.1097/00146965-200603000-00007. [DOI] [PubMed] [Google Scholar]
- [7]. Garrison KA, Winstein CJ, Aziz-Zadeh L. The mirror neuron system: a neural substrate for methods in stroke rehabilitation. Neurorehabil Neural Repair. 2010; 24: 404-412. doi: 10.1177/1545968309354536. [DOI] [PubMed] [Google Scholar]
- [8]. Sale P, Franceschini M. Action observation and mirror neuron network: a tool for motor stroke rehabilitation. Eur J Phys Rehabil Med. 2012; 48: 313-318. Retrieved from https//www.ncbi.nlm.nih.gov/pubmed/22522432. [PubMed] [Google Scholar]
- [9]. Small SL, Buccino G, Solodkin A. The mirror neuron system and treatment of stroke. Dev Psychobiol. 2012; 54: 293-310. doi: 10.1002/dev.20504. [DOI] [PubMed] [Google Scholar]
- [10]. Meltzoff AN, Decety J. What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience. Philos Trans R Soc Lond B Biol Sci. 2003; 358: 491-500. doi: 10.1098/rstb.2002.1261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [11]. Rizzolatti G, Craighero L. The mirror-neuron system. Annu Rev Neurosci. 2004; 27: 169-192. doi: 10.1146/annurev.neuro.27.070203.144230. [DOI] [PubMed] [Google Scholar]
- [12]. Gallese V, Fadiga L, Fogassi L, Rizzolatti G. Action recognition in the premotor cortex. Brain. 1996; 119(Pt 2): 593-609. doi: 10.1093/brain/119.2.593. [DOI] [PubMed] [Google Scholar]
- [13]. Rizzolatti G, Fogassi L, Gallese V. Neurophysiological mechanisms underlying the understanding and imitation of action. Nat Rev Neurosci. 2001; 2: 661-670. doi: 10.1038/35090060. [DOI] [PubMed] [Google Scholar]
- [14]. Iacoboni M, Woods RP, Brass M, Bekkering H, Mazziotta JC, Rizzolatti G. Cortical mechanisms of human imitation. Science. 1999; 286: 2526-2528. doi: 10.1126/science.286.5449.2526. [DOI] [PubMed] [Google Scholar]
- [15]. Ogoshi S, Ogoshi Y, Momose S, Takezawa T, Mitsuhashi Y. Mu rhythm suppression during the imagination of observed action Conf Proc IEEE Eng Med Biol Soc. 2013; 2013: 4310-4313. doi: 10.1109/EMBC.2013.6610499. [DOI] [PubMed] [Google Scholar]
- [16]. Braadbaart L, Williams HGJ, Waiter DG. Do mirror neuron areas mediate mu rhythm suppression during imitation and action observation? Med Eng Phys. 2013; 89: 99-105. doi: 10.1016/j.ijpsycho.2013.05.019. [DOI] [PubMed] [Google Scholar]
- [17]. Pineda JA, Allison BZ, Vankov A. The effects of self-movement, observation, and imagination on mu rhythms and readiness potentials (RP’s): toward a brain-computer interface (BCI). IEEE Trans Rehabil Eng. 2000; 8: 219-222. [DOI] [PubMed] [Google Scholar]
- [18]. Gastaut HJ, Bert J. EEG changes during cinematographic presentation; moving picture activation of the EEG. Electroencephalogr Clin Neurophysiol. 1954; 6: 433-444. doi: 10.1016/0013-4694(54)90058-9. [DOI] [PubMed] [Google Scholar]
- [19]. Babiloni C, Carducci F, Cincotti F, Rossini PM, Neuper C, Pfurtscheller G, Babiloni F. Human movement-related potentials vs desynchronization of EEG alpha rhythm: a high-resolution EEG study. Neuroimage. 1999; 10: 658-665. doi: 10.1006/nimg.1999.0504. [DOI] [PubMed] [Google Scholar]
- [20]. Cochin S, Barthelemy C, Lejeune B, Roux S, Martineau J. Perception of motion and qEEG activity in human adults. Electroencephalogr Clin Neurophysiol. 1998; 107: 287-295. doi: 10.1016/s0013-4694(98)00071-6. [DOI] [PubMed] [Google Scholar]
- [21]. Wang B, Zhang J, Wang C, Hong J. Effectiveness of action observed for sports function rehabilitation based on mirror neuron. URAI. 2016; 338-341. doi: 10.1109/URAI.2016.7734056. [DOI] [Google Scholar]
- [22]. Zhang W, Tan C, Sun F, Wu H, Zhang B. A Review of EEG-Based Brain-Computer Interface Systems Design. Brain Science Advances. 2018; 4: 156-67. doi: 10.26599/BSA.2018.9050010. [DOI] [Google Scholar]
- [23]. Rushton DN. Functional electrical stimulation and rehabilitation – an hypothesis. Med Eng Phys. 2003; 25: 75-78. [DOI] [PubMed] [Google Scholar]
- [24]. Langhorne P, Coupar F, Pollock A. Motor recovery after stroke: a systematic review. Lancet Neurol. 2009; 8: 741-754. doi: 10.1016/S1474-4422(09)70150-4. [DOI] [PubMed] [Google Scholar]
- [25]. Degnan GG, Wind TC, Jones EV, Edlich R. A Review on functional electrical stimulation in tetraplegic patients to restore hand function. Journal of Long-Term Effects of Medical Implants. 2017; 27: 293-306. [DOI] [PubMed] [Google Scholar]
- [26]. Sabut SK, Bhattacharya SD, Manjunatha M. Functional electrical stimulation on improving foot drop gait in poststroke rehabilitation: a review of its technology and clinical efficacy. Critical Reviews in Biomedical Engineering. 2013; 41: 149-160. doi: 10.1615/critrevbiomedeng.2013007621. [DOI] [PubMed] [Google Scholar]
- [27]. Zheng X, Chen D, Yan T, Jin D, Zhuang Z, Tan Z, Wu W. A randomized clinical trial of a functional electrical stimulation mimic to gait promotes motor recovery and brain remodeling in acute stroke. Behavioural Neurology. 2018; 8923520-8923520. doi: 10.1155/2018/8923520. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [28]. Schardong J, Kuinchtner GC, Sbruzzi G, Plentz RDM, da Silva AMV. Functional electrical stimulation improves muscle strength and endurance in patients after cardiac surgery: a randomized controlled trial. Brazilian Journal of Physical Therapy. 2017; 21: 268-273. doi: 10.1016/j.bjpt.2017.05.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [29]. Peckham PH, Knutson JS. Functional electrical stimulation for neuromuscular applications. Annual Review of Biomedical Engineering. 2005; 7: 327-360. doi: 10.1146/annurev.bioeng.6.040803.140103. [DOI] [PubMed] [Google Scholar]
- [30]. Ulloa ER, Pineda JA. Recognition of point-light biological motion: mu rhythms and mirror neuron activity. Behav Brain Res. 2007; 183: 188-194. doi: 10.1016/j.bbr.2007.06.007. [DOI] [PubMed] [Google Scholar]
- [31]. Carey JR, Kimberley TJ, Lewis SM, Auerbach EJ, Dorsey L, Rundquist P, Ugurbil K. Analysis of fMRI and finger tracking training in subjects with chronic stroke. Brain. 2002; 125: 773-788. doi: 10.1093/brain/awf091. [DOI] [PubMed] [Google Scholar]
- [32]. Liepert J, Bauder H, Wolfgang HR, Miltner WH, Taub E, Weiller C. Treatment-induced cortical reorganization after stroke in humans. Stroke. 2000; 31: 1210-1216. doi: 10.1161/01.str.31.6.1210. [DOI] [PubMed] [Google Scholar]
- [33]. Koski L, Mernar TJ, Dobkin BH. Immediate and long-term changes in corticomotor output in response to rehabilitation: correlation with functional improvements in chronic stroke. Neurorehabil Neural Repair. 2004; 18: 230-249. doi: 10.1177/1545968304269210. [DOI] [PubMed] [Google Scholar]
- [34]. Platz T, van Kaick S, Moller L, Freund S, Winter T, Kim IH. Impairment-oriented training and adaptive motor cortex reorganisation after stroke: a fTMS study. J Neurol. 2005; 252: 1363-1371. doi: 10.1007/s00415-005-0868-y. [DOI] [PubMed] [Google Scholar]
- [35]. Barsi GI, Popovic DB, Tarkka IM, Sinkjaer T, Grey MJ. Cortical excitability changes following grasping exercise augmented with electrical stimulation. Exp Brain Res. 2008; 191: 57-66. doi: 10.1007/s00221-008-1495-5. [DOI] [PubMed] [Google Scholar]
- [36]. Reynolds C, Osuagwu BA, Vuckovic A. Influence of motor imagination on cortical activation during functional electrical stimulation. Clinical Neurophysiology. 2015; 126: 1360-1369. doi: 10.1016/j.clinph.2014.10.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [37]. Khaslavskaia S, Sinkjaer T. Motor cortex excitability following repetitive electrical stimulation of the common peroneal nerve depends on the voluntary drive. Exp Brain Res. 2005; 162: 497-502. doi: 10.1007/s00221-004-2153-1. [DOI] [PubMed] [Google Scholar]
- [38]. Yeom H, Chang YH. Autogenic EMG-controlled functional electrical stimulation for ankle dorsiflexion control. J Neurosci Methods. 2010; 193: 118-125. doi: 10.1016/j.jneumeth.2010.08.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [39]. Abhang AP, Gawali WB, Mehrotra CS. Introduction to EEG- and Speech-Based Emotion Recognition, Academic Press: Massachusetts, USA, 2016: pp. 1-79. [Google Scholar]
- [40]. Pineda JA. The functional significance of mu rhythms: translating “seeing” and “hearing” into “doing”. Brain Res Brain Res Rev. 2005; 50: 57-68. doi: 10.1016/j.brainresrev.2005.04.005. [DOI] [PubMed] [Google Scholar]
- [41]. Oberman LM, Hubbard EM, McCleery JP, Altschuler EL, Ramachandran VS, Pineda JA. EEG evidence for mirror neuron dysfunction in autism spectrum disorders. Brain Res Cogn Brain Res. 2005; 24: 190-198. doi: 10.1016/j.cogbrainres.2005.01.014. [DOI] [PubMed] [Google Scholar]
- [42]. Kropotov DJ. Functional Neuromarkers for Psychiatry, Academic Press: Massachusetts, USA, 2016; pp. 107-119. [Google Scholar]
- [43]. Georgopoulos PA. Advances in Psychology, North-Holland: Amsterdam, Netherlands, 1997, pp. 244-262. [Google Scholar]
- [44]. Schaechter JD. Motor rehabilitation and brain plasticity after hemiparetic stroke. Prog Neurobiol. 2004; 73: 61-72. doi: 10.1016/j.pneurobio.2004.04.001. [DOI] [PubMed] [Google Scholar]
- [45]. Johansen-Berg H, Dawes H, Guy C, Smith SM, Wade DT, Matthews PM. Correlation between motor improvements and altered fMRI activity after rehabilitative therapy. Brain. 2002; 125: 2731-2742. doi: 10.1093/brain/awf282. [DOI] [PubMed] [Google Scholar]
- [46]. Quandt F, Hummel FC. The influence of functional electrical stimulation on hand motor recovery in stroke patients: a review. Exp Transl Stroke Med. 2014; 6: 9. doi: 10.1186/2040-7378-6-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47]. Lingford-Hughes A, Kalk N. Core Psychiatry (Third ed), WB. Saunders: Pennsylvania, USA, 2012; pp. 13-34.
- [48]. Jeannerod M. International Encyclopedia of the Social & Behavioral Sciences, Pergamon: Oxford, UK, 2001; pp. 16224-16228. [Google Scholar]
- [49]. Johns P. Clinical Neuroscience, Churchill Livingstone: London, UK, 2014; pp. 27-47. [Google Scholar]
- [50]. Ehrsson HH, Wiech K, Weiskopf N, Dolan RJ, Passingham RE. Threatening a rubber hand that you feel is yours elicits a cortical anxiety response Proc Natl Acad Sci U S A. 2007; 104: 9828-9833. doi: 10.1073/pnas.0610011104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [51]. Lloyd D, Morrison I, Roberts N. Role for human posterior parietal cortex in visual processing of aversive objects in peripersonal space. J Neurophysiol. 2006; 95: 205-214. doi: 10.1152/jn.00614.2005. [DOI] [PubMed] [Google Scholar]
- [52]. Evans N, Blanke O. Shared electrophysiology mechanisms of body ownership and motor imagery. Neuroimage. 2013; 64: 216-228. doi: 10.1016/j.neuroimage.2012.09.027. [DOI] [PubMed] [Google Scholar]