Abstract
Background
Many individuals with moderate and severe stroke are unable to use their paretic hand. Presently, the effect of conventional therapy on regaining meaningful hand function in this population is limited. Efforts have been made to use brain-machine interfaces (BMI) to control hand function. To date, almost all of BMI classification algorithms are designed for detecting hand movements with a resting arm. However, many functional movements require simultaneous movements of arm and hand. Arm movement will possibly impact the detection of intended hand movements, specifically for individuals with chronic stroke who have muscle synergies. The most prevalent UE synergy --- flexor synergy --- is expressed as an abnormal coupling between shoulder abductors and elbow/wrist/finger flexors.
Objective
We hypothesized that due to flexor synergy, shoulder-abductor activity would affect the detection of the hand-opening (a movement inhibited by flexion synergy) but not the hand-closing task (a movement facilitated by the flexion synergy).
Methods
We evaluated the accuracy of a BMI classification algorithm in detecting hand-opening versus closing after reaching a target with two different shoulder-abduction loads in six individuals with stroke.
Results
We found a decreased accuracy in detecting hand-opening when a stroke individual intends to open the hand while activating shoulder abductors. However, such decreased accuracy with increased shoulder loading was not shown during detecting a hand-closing task.
Conclusions
This study supports that one should consider the effect of shoulder abduction activity when designing BMI classification algorithms for the purpose of restoring hand function in individuals with moderate to severe stroke.
Keywords: Brain-machine interface, stroke, basic hand function, loss of independent joint control, muscle synergies
I. INTRODUCTION
Stroke is the leading cause of disability in the United States. About 40% of all individuals after a stroke are not able to use their paretic hand [1]. Presently, for individuals with severely affected upper extremity (UE) post stroke, the evidence that conventional therapy can restore meaningful hand function is limited [2–6]. Therefore, exploring the usage of a brain-machine interface (BMI) to control a neuroprosthesis that provides an artificial means to regain basic hand function merits further investigation.
Since 2008, the effect of BMI-mediated detection of activities, such as grasping or finger extension, has been tested in individuals with stroke [7–17]. However, these BMI studies have detected the intention of hand movements in isolation without consideration of the effect of arm activity on the hand. In reality, arm activity is often required to implement functional motor tasks, such as reaching and grasping an object. This clear gap between the current BMI classification algorithm design and real-world requirements could significantly impact the effectiveness of the targeted neuroprosthetics and negatively influence a stroke user’s willingness to use it.
The importance of exploring the effect of proximal arm activity on detecting a hand-task in individuals with stroke comes from the loss of independent joint control in the paretic arm due to the abnormal muscle synergies. The most prevalent muscle synergy [18, 19], the so-called flexor synergy, is expressed as an abnormal coupling between shoulder abductors and elbow/wrist/finger flexors in the paretic upper limb. Recent research in our lab provided evidence demonstrating that due to the flexor synergy, lifting the paretic arm resulted in synergy-related finger/wrist EMG activity and thus reducing the ability of a more severely impaired stroke individual to generate volitional wrist/finger extension [20]. Furthermore, we found that synergy-induced abnormal muscle coactivation patterns were associated with changes in cortical activity [21]. Therefore, it is likely that synergic activities also impact the accuracy of a BMI classification algorithm. As previous studies already shown that abduction affected the elbow/wrist/finger extension more than flexion, we hypothesized that shoulder abduction would affect the detection of a hand-opening (i.e., a task inhibited by the synergy) but not a hand-closing task (i.e., a hand movement that is less affected by the synergy as compared to opening).
II. Method
A. Subject
Six subjects with chronic hemiparetic stroke were recruited for this study (see Table 1 for subject information). All the subjects sustained a unilateral lesion at least 1 year before participating in the study. The following inclusion criteria were applied to the participants: 1) without motor impairment in the non-paretic limb; 2) without brainstem and/or cerebellar lesions; 3) without severe concurrent medical problems (e.g. cardiorespiratory impairment); 4) without acute or chronic pain in the upper extremities or spine; 5) able to provide informed consent; 6) able to elevate the paretic limb against gravity up to horizontal and generate some active elbow extension, and 7) able to understand the required tasks. The level of impairment severity were evaluated using the upper extremity portion of the Fugl-Meyer Motor Assessment (FMA) [22]. Participants scoring 10 to 60 out of 66 on the FMA were admitted in the study. All of subjects provided written consent that was approved by the Institutional Review Board of Northwestern University prior to participating in this study.
TABLE I.
Patient | Age | Sex | Affected hand | Dominant hand |
Site of Lesion | Time since incident (y) |
FMS (/66) |
FMS for hand (/14) |
---|---|---|---|---|---|---|---|---|
S1 | 63 | M | L | R | R. Corona radiata | 5.3 | 43 | 8 |
S2 | 52 | M | L | R | R. IC & R. Put & R. Cl | 13 | 10 | 1 |
S3 | 61 | M | L | R | R. Thalamus & IC-G | 7.6 | 24 | 3 |
S4 | 55 | F | R | R | L. Dorsal Lateral SMA & PM. Subcortical white matter. | 9.2 | 35 | 3 |
S5 | 58 | M | L | R | R Posterior frontal cortex with MC involvement | 2.5 | 46 | 7 |
S6 | 60 | F | R | R | L Th, IC, BG, Put, GP | 4.9 | 16 | 1 |
S are subjects after stroke,
M = Male, F = Female, R =Right limb, L = Left limb, N/A = Not available, IC = Internal Capsule, SMA = Supplementary Motor Area, LS = Lateral Sulcus, ICG = Internal Capsule, Genu, Put = Putamen, Cl = Claustrum, FMS = Fugl-Meyer Scores, MC = Motor cortex, BG = Basal ganglia, GP = Globus pallidus, Th = Thalamus.
B. Experimental setup
The Arm Coordination Training (ACT3D) robot was used to modulate the shoulder load during motor tasks. This admittance controlled robot can generate constant shoulder abduction loads during reaching tasks, as shown by both kinetic and kinematic data, and can thus precisely modulate the amount of flexion synergy expressed at more distal joints of the paretic upper limb [23–26].
During the all the experiments, participants sat in a Biodex chair that restrained the trunk and pelvis with straps to prevent motion during the experiment. Each subject’s forearm was strapped into a forearm-hand orthosis attached to the end effector of the ACT3D robot. At the start of the experiment, the subject’s limb lengths were measured and entered into the computer in order to scale the OpenGL-rendered graphical representation of the limb (avatar). Then the tested arm was positioned at a “home position” of a 45° shoulder flexion angle, 75° shoulder abduction angle, and 90° elbow flexion angle (see figure 1); and the “target position” was set as far as the tip of the hand could reach based on segment lengths with the configuration of a 95° shoulder-flexion angle, 75° shoulder-abduction angle, and 0° elbow-flexion angle.
Before data collection, a short training/preparation session was conducted to help subjects to get familiar with the motor tasks and associated feedback. At the beginning of a trial, the subject was instructed to move the paretic arm to the home position and relax there for 3 seconds. During this phase, the target position appeared as a blue or green sphere, with the color indicating a hand opening (blue) or closing (green) trial. The home target then disappeared indicating to the subject that s/he should reach at a comfortable speed for the target within 2 seconds (i.e., the reaching phase). The average duration of the reaching phase was about 1–1.5 seconds. A monitor continuously displayed an avatar of the true position of the tested arm/hand during the reaching phase. In some instances, subjects were unable to reach the target. In this case, they were instructed to perform the task to the best of their ability. After reaching or attempting to reach the target for more than 2 seconds, the target position changed to yellow and the position of the avatar then went to the target position where it was frozen. Upon seeing the yellow target, the subject was instructed to concentrate on either opening or closing the hand for 1 to 2 seconds while holding his/her arm in the same posture.
The hand opening/closing tasks were performed with 2 different shoulder loads: the “supported” condition, where subjects were supported by a frictionless haptic table generated by the robot; or the “unsupported” condition, during which the virtual table was lowered by 5 cm, requiring the subject to actively elevate and hold the paretic arm against gravity above the haptic table. When performing the hand task during the “unsupported” condition, a beeping sound was given to the subject when the paretic arm touched the table. All subjects were able to elevate the paretic arm once hearing the beeping sound. If during an a block of 20–30 trials, there were 3 consecutive trials with a short beeping signal, the data collection was paused and a longer resting period was incorporated before starting the next block. Overall, 4 different tasks (opening /closing tasks in supported or unsupported conditions) were performed by each subject. Subjects finished the opening and closing tasks under the supported condition on the first day and the unsupported condition 2 or 3 days later. In each condition, opening and closing tasks were performed randomly in several blocks of 20–30 trials for a total of 120–200 trials for each task. The experiment for each session lasted approximately 4 hours, including 2 hours for setup time and 2 hours for data collection. To minimize fatigue, a resting period of 8–20 seconds between trials was implemented as well as a 10–20 minute period between blocks.
We simultaneously collected EMG signals from the wrist/finger extensors (extensor carpi radialis longus & brevis and the extensor digitorum) and flexors (flexor carpi radialis and the flexor digitorum superficialis) of the tested arm, as well as 160-channel EEG from the scalp and 2-chanel electrooculography (EOG) signals from above and beneath the eye (Biosemi, Inc., Active II, Amsterdam, The Netherlands) during each session (see figure 1). All signals were collected with the reference placed at both ears and sampled at 1024 Hz.
C. EEG Data analysis
The 160-channel EEG signals were first visually inspected to identify and remove channels constantly contaminated by noise (i.e., channels with bad contact or movement artifacts). On average, about 8–10 peripheral channels were eliminated. The remaining EEG signals were then aligned to the onset of wrist/finger flexor (for closing task, or for opening task when the activity of wrist/finger extensors was absent) or wrist/finger extensor (for opening task). Subsequently, they were segmented from −1 s to 1 s with 0 representing the onset of EMG activity. The segmented EEG signals were then baseline corrected by removing the average voltage level during the baseline phase (−1 to −0.8 s) from all data points in the segment. Subsequently, a finite-difference Surface Laplacian [27] transformation was applied to each EEG channel as a spatial high-pass filter to reduce the smearing effects caused by the head volume conductor and to increase the signal-to-noise-ratio [28]. This resulted in the elimination of the outermost electrodes (about 29 channels), and thus a spatial pattern of activation was generated by a total of about 120 electrodes throughout all sessions. Additionally, visual inspection of the processed signals was performed to remove trials contaminated by ocular or movement artifacts. Within each shoulder load condition, 80–150 trials remained for the two hand tasks combined. These remaining trials were then down-sampled to 256 Hz and exported to MATLAB for further analysis.
In the MATLAB environment, a classification algorithm utilizing time-frequency synthesized spatial patterns (TFSP) [29–31] with a newly-added rejection scheme was implemented as follows:
First, for a single trial of EEG data, the signal from one channel was decomposed into 13 frequency bands using constant Q value (Q = 4) band-pass filters with their center frequencies ranging from 5–34 Hz. Subsequently, the Hilbert transform was used to extract profiles of the oscillatory activities, which were then divided into 72 equal-length time intervals (55 ms of each interval) with a 50% overlap. Next, the instantaneous power (i.e., integration of the profile) was calculated in each of the time–frequency bins, and thus the EEG signal from a single channel was represented by a 72×13 matrix of coefficients. The above processing was repeated in all channels. As a result of above decomposition process, a single trial EEG signal was characterized by a series of spatial features represented in each of the 72×13 time-frequency bins (t-f bins).
After decomposing spatial feature onto 72×13 t-f bins, the classification of the hand-opening/closing tasks was performed for the supported and unsupported conditions separately. Under a given shoulder load, we first calculated the characteristic spatial patterns for each hand task in each of the specific t-f bins by averaging all the spatial patterns within such specific t-f bin (i.e., for a given shoulder load, the characteristic spatial patterns (P) for hand-opening and for hand-closing , where n and m were the indices of trials; and N and M were the total number of the trials in the training datasets for opening and closing task, respectively). Then, a similarity judgment Sp(t, f) within a specific time–frequency bin (t,f) was made by comparing correlation coefficients between the spatial pattern of a testing trial (p) and the two characteristic spatial patterns (P) as follows:
(1) |
A Sp(t, f) equal to 1 or −1 indicated a detection result of hand-opening or a hand-closing trial; and 0 represented an uncertain judgment. As shown in the equation (1), at this first-level, the correlation coefficient between the testing trial and the 2 characteristic patterns was used to quantify the distance between the testing trial and the characteristic pattern. The decision of one t-f bin went to the class whose characteristic pattern was closer to the testing trial. A rejection scheme was added to the original TFSP BMI algorithm at each of the time-frequency bins. When the difference in the similarity judgment was smaller than the rejection threshold (Threj), the corresponding grid did not contribute to the final decision-making. The output of the first-level Sp(t, f) by each of the t-f bins was then used at the second level to determine a final decision. The second level synthesis worked akin a voting system, in which each individual (equal to each of the t-f bins) voted, and the final judgment went to the decision that was agreed by most of the individuals. All the accepted grids shared the same voting rights, and the final judging decision R(p) regarding the class of a testing trial was made by summing the results over the entire 72×13 time–frequency grids as follows: R(p)= sign (sum(Sp(t,f))). A positive R(p) indicated that a majority of bins judge that the current trial was a hand-opening event, while a negative one indicated a hand-closing event. No trial would be rejected completely unless R(p)= sign (sum(Sp(t,f))=0, which never happened in any test trials to date.
Finally, we calculated the true positive rate (TPR, defined as the number of hand-opening trials that were correctly recognized, normalized by the number of total hand-opening trials) and true negative rate (TNR, defined as the number of hand-closing trials that were correctly recognized, normalized by the number of total hand-closing trials). The BMI algorithm was repeated with a rejection threshold of 0 to 0.95 with a step increase of 0.05. The leave-four-out cross validation method [32] was used to test the overall performance under either the supported or unsupported conditions with each of the given rejection thresholds.
In order to understand the neural underpinnings of our results, we further identified the t-f bins that performed differently under ‘supported’ and ‘unsupported’ conditions, separately for each of the 2 hand tasks. To implement this, we first gave a score equal to 1, −1 or 0 to each of the t-f bins, if it detected a single trial correctly, falsely, or refused to make a decision, respectively. The final recognition score of a t-f bin was then calculated by summing the scores cross all of the trials with the rejection threshold setting as 0.35 (i.e., the overall optimal rejection threshold). Subsequently, we used a one-way Repeated Measure of Analysis of Variance (RMANOVA) to identify t-f bins with a significant change in the recognition score when a different level of limb support was applied (dependent factor: recognition score, independent factor: ‘supported’ vs. ‘unsupported’ condition, samples are different trials, p<0.05). These t-f bins were defined as shoulder-load sensitive t-f bins (SS t-f bins). Finally, we counted the number of SS t-f bins in Theta (4–7 Hz), Alpha1 (8–10 Hz), Alpha2 (10–13 Hz), Beta1 (13–20 Hz), and Beta2 (20–30 Hz) bands before and after the EMG onset.
To explore the spatial features, we reconstructed the cortical activity of subject S2 from 0 to 50 ms while performing hand-opening and hand-closing tasks using his paretic left arm under the supported and unsupported conditions. Inverse source reconstruction was conducted using the LORETA method (Lp=1) [33, 34] based on ensemble-averaged EEG signals and a subject-specific boundary element head model developed by subject-specific anatomic MRI. Although the inverse procedure was performed over the whole cortex, only the activities in the region of interest (ROI), consisted of the bilateral the premotor (PM), supplementary motor area (SMA, including both preSMA and SMA proper), primary motor (M1) and primary somatosensory (S1) cortices were shown. Due to the absence of MRI data in the remaining 5 subjects, cortical activity reconstruction was not performed in the other 5 subjects.
Statistical analyses were applied to detect the difference at a p<0.05 significance level or a trend of reaching significance at a p between 0.05 and 0.1.
III. Results
Overall, equal numbers of hand opening and closing trials were used: A two-way ANOVA (hand task, support level) analysis result showed no significant difference in the trail numbers between the hand-opening and closing tasks (p=0.78, F=0.07) or between the unsupported versus supported conditions (p=0.40, F=0.75).
The box plots of true positive rates (TPR) and true negative rates (TNR) under the supported and unsupported conditions with each of the rejection thresholds were plotted in figure 2. Results from a one-way MANOVA (independent factor: shoulder abduction load with the rejection threshold as the nested factor; dependent factors: TPR and TNR) showed that shoulder abduction load significantly influenced the accuracy rate for detecting hand-opening (F=28.737, p<0.0001) but not the accuracy rate for detecting a hand-closing (F=0.0824, p>0.1). Scheffe post-hoc tests showed that the classification algorithm detected the hand opening with significantly higher accuracy during the supported condition as compare to the unsupported condition (mean difference =12.8%, p<0.0001).
Across-subjects mean and standard errors of the number of shoulder-load sensitive t-f bins (SS t-f bins) were shown in Figure 3. As shown in figure 3, overall more SS t-f bins were found for the hand-opening task (gray bars of figure 3) than for the hand-closing task (white bars). A three-way RMANOVA was used to test the effect of the time window (2 levels--- before and after EMG onset), frequency band (5 levels) and hand task (2 levels --- opening and closing tasks) on the number of SS t-f bins. Results of RMANOVA reported a significant effect of the hand task (F=9.854, p=0.0257) on the number of SS t-f bins but not the other two factors (time window: F=0.091, p=0.7745; and frequency band: F=0.353, p=0.839). There were no significant interactions between these three within-subject factors, either. A non-parametric Friedman post-hot test reported a significantly greater number of SS t-f bins in low beta band (13–20 Hz) after EMG onset for hand opening task as compared to closing task (p<0.05). No other significant results were found by the post-hoc analysis.
Cortical activities of subject S2 from 0 to 50 ms while performing hand-opening and - closing tasks with the paretic left arm during supported and unsupported conditions were shown in figure 4. As illustrated in Figure 4, during the supported condition, only the contralateral M1/S1 cortical regions were involved in the hand-opening task (figure 4 a); however, bilateral activity was detected during the hand-closing task (figure 4 c). Thus the spatial patterns during the supported condition for the two hand tasks were quite different. However, during the unsupported condition, bilateral cortical activity was observed for both the hand-opening and - closing tasks (see figure 4 b and d). The similarity in cortical spatial patterns for the two hand tasks during the unsupported condition reduced the accuracy of the classification algorithm.
IV. Discussion
Our results obtained from the paretic arm of 6 subjects with chronic hemiparetic stroke showed a significant reduction in the accuracy of detecting the hand opening with an increased shoulder abduction load. However, such shoulder-abduction induced reduction in the accuracy was not demonstrated in hand-closing task.
The loss of independent joint control in individuals of stroke affects the accuracy in detecting the hand-opening task
We believe that the SABD-load induced reduction in the accuracy for detecting hand-opening task is due to changes in brain activity that also results in a flexor synergy. Previous reports from our laboratory have shown that the flexion synergy decreases the ability to reach [25, 26] and open the hand [21], when increased shoulder abduction loading was applied. The main underlying neural mechanism is postulated to be an increased reliance on brainstem descending pathways, like the cortico-reticular spinal tract (CRST), due to the loss of corticospinal tract (CST) fibers from the lesioned hemisphere. It is well known that CST monosynaptically facilitates contralateral extensor and flexor muscles [35], and ipsilateral CST activation of spinal motoneurons is absent or very weak [36]. In contrast, CRST is a bilaterally organized system. Previous studies have shown that CRST projects to both motoneurons and interneurons involved in digital control [37]. CRST tends to facilitate flexors and suppress extensors ipsilaterally, and the reverse contralaterally [38–40]. Thus it is possible that the ipsilateral CRST and remaining CST projections are both effective resources to drive hand-closing regardless of the supporting conditions. The case of hand opening is more complex. As we already know that ipsilateral CRST suppresses extensors. Therefore, residual CRST from the non-lesioned ipsilateral side may not be a good backup for hand opening, and hand opening may be primarily depended on contralateral residual CS. Such dependence on contralateral residual CST is also reflected as the greater paralysis of finger extensors regardless of shoulder abductor activity [41]. During the supported condition, using contralateral residual CST for opening task versus using bilateral CRST and CST for closing task might allow for the detection of the two hand tasks. However, when additional shoulder abductor muscle was required, ipsilateral CRST was used for both hand-tasks and contralateral cortical activity related to hand opening might no longer be detectable. This explanation was supported by the cortical activity results from a single subject, as shown in figure 4. It was also supported by the significant change of the number of SS t-f bins in detecting hand opening at lower beta band (13–20 Hz) after EMG onset when different SABD loading was required. As reported before, cortico-muscular communication conducted via the CRST oscillates in a lower frequency band (10–15 Hz) [42, 43] than that conducted via CST that is in a higher frequency band [15–40 hz see 44]. Our finding of a significant difference in the number of SS t-f bins for hand-opening task in the low beta band probably also reflects that CST and CRST were used to drive hand opening during the ‘supported’ as compared to the ‘unsupported’ condition.
In short, our results show that shoulder loading has a significant impact on the accuracy of detecting a hand-opening task in individuals with stroke, presumably because hand-opening is more exclusively dependent on activity in the contralateral lesioned hemisphere via the lateral CST. Conversely, the impact of shoulder abduction loading on the detecting of hand-closing task is not significant, presumably because hand-closing can be generated by both contralateral cortical activity via the CST and ispilateral cortical activity via the CRST.
Possible limitations in the interpretation of our data
Previous literature has shown that the human brain, even after a stroke, can still adapt to a BMI device to improve performance [12]. Because we always conducted experiments under the supported condition on the first day, and experiments under the unsupported condition about 2 or 3 days later, it is reasonable to expect that the effect of learning could impact our findings. In case a subject learned from the 1st day’s experiment, any potential learning effects should favor the unsupported condition, and thus, imply an even lower detection rate under an unsupported condition if there is no effect of learning. Therefore, the order of the experiments should not invalidate our results. If anything it should only strengthen them. Furthermore, there is no reason to believe that the effect of learning would affect the hand-opening and -closing tasks differently. Because of the above 2 reasons, we ruled out an effect of learning on our findings.
Results of conducting the experiments in a fixed sequence could also be affected by some random differences: such as the subject’s overall mental state, noise from random sources, day-to-day impedance differences between electrodes and skin, and so on. These differences will be reflected as baseline differences and have been removed from analysis. Furthermore, because of their random nature, there is no reason to believe that noise from random sources should bias one testing condition over another.
Other possible confounding factors that may impact our signals are muscle fatigue and EMG contamination of EEG activity. It is possible that, the subject may be more fatigued on the 2nd day than that on the 1st day. To avoid this issue, we have separated the 2 experiments by 2 or 3 days. In order to limit the effects of muscle fatigue within a day, we included longer resting periods between trials and between blocks for experiments in the unsupported condition. No subjects reported fatigue during or after the experiment. We also checked the frequency spectrum of EMG data. We did not find a significant difference in the EMG spectrum between the first 10 and last 10 trials. Therefore, no clear evidence of muscle fatigue was found. Consequently, we argued that muscle fatigue was not a primary contributor to the observed decrease in BMI performance when a greater shoulder abduction load was applied.
Additionally, higher muscle artifacts might be introduced to EEG signals under the unsupported condition as compared to the supported condition. The increased EMG activity mostly affected the outside EEG electrodes, which were removed from further analysis, thereby reducing their influence on EEG signals. Furthermore, we argued that if EMG activity indeed contaminated EEG to a greater extent when the arm was not supported, then it should have affected both the opening and closing tasks similarly. However, our results showed that different shoulder loads only significantly affected the accuracy in detection of the hand-opening task. To further confirm that EMG did not affect time-frequency bins differently for various conditions, a two-way repeated measure of ANOVA (i.e., supporting conditions and the hand tasks) was used to compare the spectrum in two control frequency bands: 30–40 Hz and 40–50 Hz. In these two bands, the spectrum should not be significantly modulated by a brain signal change but could very easily be modulated by an EMG artifact signal. Repeated measures of MANOVA did not report any significant effects (p>0.1).
The difference in sensory input under the supported and unsupported conditions as well as additional motor output for shoulder abduction under unsupported condition could also contribute to the changes in BMI performance. We argued that the sensory input and motor output caused by shoulder abductor activation were the same to both hand-opening and hand-closing task. However, we only observed the changes in the BMI performance for hand-opening task but not for hand-closing task. Therefore, the common sensorimotor information caused by the shoulder activity cannot explain selective changes in the BMI performance for the hand-opening task only but not for the closing task.
Finally, our discussion of possible neural mechanisms for our findings (i.e., shoulder loading affects the BMI performance of hand opening task but not closing task) was partially based on imaging results from a single subject. Imaging results on increased number of subjects are required for a more solid answer to the neural mechanisms. In short, our results provide for the first time evidence that shoulder loadings impact the BMI performance differently for hand opening as opposed to closing task.
Clinical implications and future directions
In this paper, we provided evidence of a decreased accuracy of the classification algorithm in detecting hand opening when an individual after a stroke intended to activate the hand while also activating shoulder abductors. This conclusion is based on the off-line performance of the TFSP algorithm. However, this conclusion is likely generalizable to real-time applications as well. Our conclusion about shoulder activity impacting the accuracy in detecting hand tasks can probably also be generalized to other joints, such as the elbow and the wrist; and to other synergetic patterns, such as the impact of shoulder adduction on the detection of the hand-closing task. In short, our results demonstrate the necessity of considering the impact of multi-joint activity when designing a BMI device such as a neuroprosthetics for potential future clinical usage in individuals with stroke and suggest that regaining more independent shoulder and elbow control may be vital to improve BMI performance for the purpose of recapturing basic hand function.
Acknowledgment
This work was supported by NIH grants [UL1 RR025741, R01 HD047569-01A1 and 2R01HD039343-11A1] as well as by the NIDRR grant [H133G120287].
Footnotes
The work represented in this paper was done at Northwestern University.
References
- 1.Kwakkel G, et al. Probability of regaining dexterity in the flaccid upper limb: impact of severity of paresis and time since onset in acute stroke. Stroke. 2003;34(9):2181–2186. doi: 10.1161/01.STR.0000087172.16305.CD. [DOI] [PubMed] [Google Scholar]
- 2.Jorgensen HS, et al. Acute stroke: Prognosis and a prediction of the effect of medical treatment on outcome and health care utilization: The Copenhagen Stroke Study. Neurology. 1997;49(5):1335–1342. doi: 10.1212/wnl.49.5.1335. [DOI] [PubMed] [Google Scholar]
- 3.Dewald JPA, et al. Upper-Limb Discoordination in Hemiparetic Stroke: Implications for Neurorehabilitation. Top Stroke Rehabil. 2001;8(1):1–12. doi: 10.1310/WA7K-NGDF-NHKK-JAGD. [DOI] [PubMed] [Google Scholar]
- 4.Langhorne P, Coupar F, Pollock A. Motor recovery after stroke: a systematic review. Lancet Neurol. 2009;8(8):741–754. doi: 10.1016/S1474-4422(09)70150-4. [DOI] [PubMed] [Google Scholar]
- 5.Sethi A, et al. Effect of intense functional task training upon temporal structure of variability of upper extremity post stroke. J Hand Ther. 2013;26(2):132–137. doi: 10.1016/j.jht.2012.09.001. quiz 138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Lum PS, et al. Robotic approaches for rehabilitation of hand function after stroke. Am J Phys Med Rehabil. 2012;91(11) Suppl 3:S242–S254. doi: 10.1097/PHM.0b013e31826bcedb. [DOI] [PubMed] [Google Scholar]
- 7.Ang KK, et al. A large clinical study on the ability of stroke patients to use an EEG-based motor imagery brain-computer interface. Clin EEG Neurosci. 2011;42(4):253–258. doi: 10.1177/155005941104200411. [DOI] [PubMed] [Google Scholar]
- 8.Ang KK, et al. Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke. Front Neuroeng. 2014;7:30. doi: 10.3389/fneng.2014.00030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bai O, et al. A high performance sensorimotor beta rhythm-based brain-computer interface associated with human natural motor behavior. J Neural Eng. 2008;5(1):24–35. doi: 10.1088/1741-2560/5/1/003. [DOI] [PubMed] [Google Scholar]
- 10.Bamdadian A, et al. Online semi-supervised learning with KL distance weighting for motor imagery-based BCI. Conf Proc IEEE Eng Med Biol Soc. 2012;2012:2732–2735. doi: 10.1109/EMBC.2012.6346529. [DOI] [PubMed] [Google Scholar]
- 11.Broetz D, et al. Combination of brain-computer interface training and goal-directed physical therapy in chronic stroke: a case report. Neurorehabil Neural Repair. 2010;24(7):674–679. doi: 10.1177/1545968310368683. [DOI] [PubMed] [Google Scholar]
- 12.Buch E, et al. Think to move: a neuromagnetic brain-computer interface (BCI) system for chronic stroke. Stroke. 2008;39(3):910–917. doi: 10.1161/STROKEAHA.107.505313. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Caria A, et al. Chronic stroke recovery after combined BCI training and physiotherapy: a case report. Psychophysiology. 2011;48(4):578–582. doi: 10.1111/j.1469-8986.2010.01117.x. [DOI] [PubMed] [Google Scholar]
- 14.Daly JJ, et al. Feasibility of a new application of noninvasive Brain Computer Interface (BCI): a case study of training for recovery of volitional motor control after stroke. J Neurol Phys Ther. 2009;33(4):203–211. doi: 10.1097/NPT.0b013e3181c1fc0b. [DOI] [PubMed] [Google Scholar]
- 15.Gomez-Rodriguez M, et al. Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery. J Neural Eng. 2011;8(3):036005. doi: 10.1088/1741-2560/8/3/036005. [DOI] [PubMed] [Google Scholar]
- 16.Prasad G, et al. Applying a brain-computer interface to support motor imagery practice in people with stroke for upper limb recovery: a feasibility study. J Neuroeng Rehabil. 2010;7:60. doi: 10.1186/1743-0003-7-60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Varkuti B, et al. Resting state changes in functional connectivity correlate with movement recovery for BCI and robot-assisted upper-extremity training after stroke. Neurorehabil Neural Repair. 2013;27(1):53–62. doi: 10.1177/1545968312445910. [DOI] [PubMed] [Google Scholar]
- 18.Dewald JP, et al. Abnormal muscle coactivation patterns during isometric torque generation at the elbow and shoulder in hemiparetic subjects. Brain. 1995;118(Pt 2):495–510. doi: 10.1093/brain/118.2.495. [DOI] [PubMed] [Google Scholar]
- 19.Twitchell TE. The restoration of motor function following hemiplegia in man. Brain. 1951;74:443–480. doi: 10.1093/brain/74.4.443. [DOI] [PubMed] [Google Scholar]
- 20.Lan Y, Yao J, Dewald J. Increased shoulder abduction loads decreases volitional finger extension in individuals with chronic stroke: Preliminary findings. Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE; IEEE; Chicago, IL. 2014. pp. 5808–5811. [DOI] [PubMed] [Google Scholar]
- 21.Miller LC, Dewald JP. Involuntary paretic wrist/finger flexion forces and EMG increase with shoulder abduction load in individuals with chronic stroke. Clin Neurophysiol. 2012;123(6):1216–1225. doi: 10.1016/j.clinph.2012.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Fügl-Meyer AR, et al. The post-stroke hemiplegic patient I. A method for evaluation of physical performance. Scandinavian Journal of Rehabilitation Medicine. 1975;7:13–31. [PubMed] [Google Scholar]
- 23.Chen A, et al. North American Congress on Biomechanics. Ann Arbor, MI: 2008. Deterioration of kinematic and muscle performance and associated cortical activity related to increased shoulder abduction drive in chronic hemiparetic stroke. [Google Scholar]
- 24.Dewald JP, et al. Upper-limb discoordination in hemiparetic stroke: implications for neurorehabilitation. Top Stroke Rehabil. 2001;8(1):1–12. doi: 10.1310/WA7K-NGDF-NHKK-JAGD. [DOI] [PubMed] [Google Scholar]
- 25.Ellis MD, Sukal-Moulton T, Dewald JP. Progressive shoulder abduction loading is a crucial element of arm rehabilitation in chronic stroke. Neurorehabil Neural Repair. 2009;23(8):862–869. doi: 10.1177/1545968309332927. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Sukal TM, Ellis MD, Dewald JP. Shoulder abduction-induced reductions in reaching work area following hemiparetic stroke: neuroscientific implications. Exp Brain Res. 2007;183(2):215–223. doi: 10.1007/s00221-007-1029-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Pascual-Marqui RD, Biscay-Lirio R. Spatial resolution of neuronal generators based on EEG and MEG measurements. Int J Neurosci. 1993;68(1–2):93–105. doi: 10.3109/00207459308994264. [DOI] [PubMed] [Google Scholar]
- 28.Hjorth B. An on-line transformation of EEG scalp potentials into orthogonal source derivations. Electroencephalogr Clin Neurophysiol. 1975;39(5):526–530. doi: 10.1016/0013-4694(75)90056-5. [DOI] [PubMed] [Google Scholar]
- 29.Deng J, Yao J, Dewald JP. Classification of the intention to generate a shoulder versus elbow torque by means of a time-frequency synthesized spatial patterns BCI algorithm. J Neural Eng. 2005;2(4):131–138. doi: 10.1088/1741-2560/2/4/009. [DOI] [PubMed] [Google Scholar]
- 30.Wang T, Deng J, He B. Classifying EEG-based motor imagery tasks by means of time-frequency synthesized spatial patterns. Clin Neurophysiol. 2004;115(12):2744–2753. doi: 10.1016/j.clinph.2004.06.022. [DOI] [PubMed] [Google Scholar]
- 31.Zhou J, et al. EEG-based classification for elbow versus shoulder torque intentions involving stroke subjects. Comput Biol Med. 2009;39(5):443–452. doi: 10.1016/j.compbiomed.2009.02.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Devijver PA, Kittler J. Pattern Recognition: A Statistical Approach. London: Prentice-Hall; 1982. [Google Scholar]
- 33.Pascual-Marqui RD, et al. Functional imaging with low-resolution brain electromagnetic tomography (LORETA): a review. Methods Find Exp Clin Pharmacol. 2002;24(Suppl C):91–95. [PubMed] [Google Scholar]
- 34.Pascual-Marqui RD, Michel CM, Lehmann D. Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. Int J Psychophysiol. 1994;18(1):49–65. doi: 10.1016/0167-8760(84)90014-x. [DOI] [PubMed] [Google Scholar]
- 35.Baker SN, Lemon RN. Computer simulation of post-spike facilitation in spike-triggered averages of rectified EMG. J Neurophysiol. 1998;80(3):1391–1406. doi: 10.1152/jn.1998.80.3.1391. [DOI] [PubMed] [Google Scholar]
- 36.Soteropoulos DS, Edgley SA, Baker SN. Lack of evidence for direct corticospinal contributions to control of the ipsilateral forelimb in monkey. J Neurosci. 2011;31(31):11208–11219. doi: 10.1523/JNEUROSCI.0257-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Riddle CN, Baker SN. Convergence of pyramidal and medial brain stem descending pathways onto macaque cervical spinal interneurons. J Neurophysiol. 2010;103(5):2821–2832. doi: 10.1152/jn.00491.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Davidson AG, Buford JA. Bilateral actions of the reticulospinal tract on arm and shoulder muscles in the monkey: stimulus triggered averaging. Exp Brain Res. 2006;173(1):25–39. doi: 10.1007/s00221-006-0374-1. [DOI] [PubMed] [Google Scholar]
- 39.Davidson AG, Schieber MH, Buford JA. Bilateral spike-triggered average effects in arm and shoulder muscles from the monkey pontomedullary reticular formation. J Neurosci. 2007;27(30):8053–8058. doi: 10.1523/JNEUROSCI.0040-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Herbert WJ, Davidson AG, Buford JA. Measuring the motor output of the pontomedullary reticular formation in the monkey: do stimulus-triggered averaging and stimulus trains produce comparable results in the upper limbs? Exp Brain Res. 2010;203(2):271–283. doi: 10.1007/s00221-010-2231-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Kamper DG, et al. Weakness is the primary contributor to finger impairment in chronic stroke. Arch Phys Med Rehabil. 2006;87(9):1262–1269. doi: 10.1016/j.apmr.2006.05.013. [DOI] [PubMed] [Google Scholar]
- 42.Grosse P, Brown P. Acoustic startle evokes bilaterally synchronous oscillatory EMG activity in the healthy human. J Neurophysiol. 2003;90(3):1654–1661. doi: 10.1152/jn.00125.2003. [DOI] [PubMed] [Google Scholar]
- 43.Nishimura Y, Isa T. Cortical and subcortical compensatory mechanisms after spinal cord injury in monkeys. Exp Neurol. 2011 doi: 10.1016/j.expneurol.2011.08.013. [DOI] [PubMed] [Google Scholar]
- 44.Soteropoulos DS, Baker SN. Cortico-cerebellar coherence during a precision grip task in the monkey. Journal of neurophysiology. 2006;95(2):1194–1206. doi: 10.1152/jn.00935.2005. [DOI] [PubMed] [Google Scholar]