Abstract
Objective
Brain-computer interfaces (BCIs) based on motor control have been suggested as tools for stroke rehabilitation. Some initial successes have been achieved with this approach, however the mechanism by which they work is not yet fully understood.
One possible part of this mechanism is a, previously suggested, relationship between the strength of the event-related desynchronization (ERD), a neural correlate of motor imagination and execution, and corticospinal excitability. Additionally, a key component of BCIs used in neurorehabilitation is the provision of visual feedback to positively reinforce attempts at motor control. However, the ability of visual feedback of the ERD to modulate the activity in the motor system has not been fully explored.
Approach
We investigate these relationships via transcranial magnetic stimulation delivered at different moments in the ongoing ERD related to hand contraction and relaxation during BCI control of a visual feedback bar.
Main results
We identify a significant relationship between ERD strength and corticospinal excitability, and find that our visual feedback does not affect corticospinal excitability.
Significance
Our results imply that efforts to promote functional recovery in stroke by targeting increases in corticospinal excitability may be aided by accounting for the time course of the ERD.
1. Introduction
Brain-computer interfaces (BCIs) can be used to translate planned movements into the actions of a computer or robotic system [1, 2]. They do so by detecting the event-related desynchronization (ERD) in the electroencephalogram (EEG), a localised reduction in ongoing sensorimotor rhythm power (in the frequency band 8 - 20Hz) related to body movement imagination and execution [3]. The ERD is observed even in cases when the user of the BCI did not produce any muscle activity [4]. Thus, BCIs can be constructed based on either movement execution or imagination. This type of movement imagination / execution based BCI has numerous potential applications, including for communication [5], robot control [6], and wheelchair control [7].
One promising application of ERD-based BCI is stroke rehabilitation [8] and other forms of movement assistance and rehabilitation [9]. By detecting attempted movements a BCI may be used to provide positive reinforcement feedback to an individual undergoing stroke rehabilitation while they attempt to perform movement. A measure of the ongoing sensorimotor rhythm activity that reflects attempted movement, the ERD strength [10, 3], is fed back to the user of the BCI system via a visual feedback modality. The ERD reflects movement intention and may be observed even in cases where no movement is achieved [11], thus it is suitable for use in stroke rehabilitation, wherein individuals attempt to move but may be unable to achieve movement. The feedback of the ERD aims to increase corticospinal excitability and hence lead to long term improvements in their movement strength [8, 12] and has been shown to result in an increase in functional recovery from stroke [13].
Functional recovery following stroke involves changes in levels of corticospinal excitability [14]. It has been suggested that the strength of the ERD may be a reliable index of corticospinal excitability in both healthy individuals and stroke patients [15, 16]. Specifically, it has been reported that when brain stimulation is delivered at increasing ERD strengths the resulting motor evoked potential (MEP), a measure of corticospinal excitability, also increases [16].
Additionally, neural stimulation has been proposed as a tool to promote corticospinal excitability changes as an aid to stroke recovery. Specifically, techniques such as transcranial direct current stimulation (tDCS) and transcranial magnetic stimulation (TMS) have been shown to promote corticospinal excitability and aid stroke recovery [17]. However, the efficacy of this proposal is unclear. In particular, the nature of the relationship between the ERD and corticospinal excitability and the effect of ERD-based BCI use on corticospinal excitability remains an open-question.
We seek to further explore this relationship between ERD strength and corticospinal excitability. Specifically, we aim to identify how corticospinal activity changes as a function of ERD strength. We also aim to explore how TMS affects levels of corticospinal excitability when used in a BCI context i.e. how the provision of visual feedback to a BCI user affects the relationship between different ERD strengths and corticospinal excitability. To this end we aimed to explore the effect of brain state dependent stimulation (the delivery of brain stimulation at a time point and/or magnitude determined by direct measures of the current activity in the brain [18]) and its effect on the magnitude of the MEP. We also introduce direct visual feedback of measured ERD strengths to participants.
Additionally, we also seek to further explore initial observations made in previous explorations of the relationship between ERD strength and corticospinal excitability. Specifically, we introduce a sham stimulation condition to validate that the observed relationships between the ERD and corticospinal excitability, initially reported in [16], are a genuine result of brain state dependent stimulation. We used a BCI motor imagination / execution task, in which participants were asked to imagine and make hand contraction and relaxation movements in response to a cue.
We make the following hypotheses:
-
(i)
ERD strength is positively related to corticospinal excitability (confirming reports in [16]).
-
(ii)
Visual feedback of ERD strength to participants (as used within BCI systems designed for aiding rehabilitation) modulates corticospinal excitability.
2. Methods
2.1. Participants
Twelve individuals (5 male, 4 left handed, aged 21-36 years, median age = 25) were recruited via email to participate in the experiments. Each participant provided informed consent to participate and was reimbursed for their participation with £20.00 (GBP) and up to £5.00 (GBP) for travel expenses.
Participants were recruited via email advertisements to a mailing list of participants who had previously participated in other TMS studies. Participants were screened on the basis that they were healthy adults in the age range 18 to 65 years at the time of the study. Participants were screened for inclusion in the study based on the University of Reading School of Clinical Language Sciences rules of operation for TMS studies, which were based on the recommended screening procedures outlined by Rossi et al. [19]. No participants had prior experience with BCI systems.
Ethical approval for the study was granted by the University of Reading research ethics committee, where the research was conducted by the authors, who were based in this institution at the time of the research.
2.2. Experiment design
2.2.1. Structure
An overview of the experiment structure is illustrated in Figure 1. The participant’s EEG is recorded and used to measure the strength of their ERD, which is then used to deliver stimulation and/or feedback, depending on the trial type. The resulting MEP is measured from the arm.
The experiment consisted of 1 session on a single day, which contained 5 runs. The first run was a calibration run, which aimed to identify the optimal scalp location for measuring each participant‘s ERD via the EEG. This was followed by 4 testing runs, in which the participants were tasked with attempting right hand contractions and relaxations during different combinations of brain stimulation and both with and without visual feedback of their current ERD strength.
The calibration run consisted of 40 trials, of which 20 were cued movement trials and 20 were rest trials. For each trial type participants were first presented with a fixation cross in the centre of the screen, which remained on screen for between 2-4 s, pseudo-randomly drawn from a uniform distribution. This was followed by a cue for 5 s, which indicated the action the participant should take; either ‘move’ or ‘rest’. For the ‘rest’ trials participants were instructed to remain still, avoiding arm movement, eye movement, and any other movements.
Participants were instructed to have their right arm resting with the hand open and palm facing upwards throughout the run. For the move trials, participants were instructed to repeatedly flex and extend the fingers of their right hand. They were instructed to make the movements at a speed that was comfortable to them and keep repeating the movements while the ‘move’ cue remained on screen.
After the cue disappeared there was a 3 s inter-stimulus interval period before the next fixation cross appeared on screen. The trial timing is illustrated in Figure 1. Trial types were pseudorandomly ordered.
During the testing runs the trials were structured in the same way. However, there were three different types of cue presented to the participants. In addition to the ‘move’ and ‘rest’ cues participants were also presented with a ‘move with feedback’ cue. This involved the presentation of visual feedback indicating the current ERD strength to the participants and took the form of a vertical bar, which filled from the bottom of the screen and indicated the current moment-to-moment ERD strength of the participants, this is illustrated in the center of Figure 2.
In addition, during some trials transcranial magnetic stimulation (TMS) (either real or sham) was delivered over the participant‘s motor cortex during the cued portion of the trial. Further details on this are described in subsequent sections.
2.2.2. Feedback
During the feedback trials participants were presented with a visual representation of their current ERD strength. This took the form of a vertical bar, which filled from the bottom upwards reflecting the current ERD(%). This is illustrated in the center of Figure 2.
The feedback bar was updated once every 100 ms for the 5 s duration of the cued period of the trial. There were an equal number of feedback and non-feedback trials in the experiment and they were presented in pseudorandom order to the participant.
2.2.3. Experiment conditions
TMS was delivered to the participant‘s stimulation location (see section 2.4) at different time points in the trials determined by the ERD time course and depending on the trial type. Specifically, during a single trial TMS (either real or sham) was delivered either once or not at all according to the type of trial. There were a total of 5 types of trial used during the testing portion of the experiment.
Specifically, these trial types were differentiated by the time within the trial at which TMS was delivered. TMS was delivered at 10, 20, 30, and 40% of ERD strength and at 33 ms after the cue presentation time. By delivering TMS at these different points in the ERD time course it is possible to evaluate the relationship between ERD strength and cortical excitability.
In addition to these conditions, a sham TMS condition was also used in which sham TMS was delivered in response to the same conditions (see section 2.4 for details). The experiment contained an equal number of both sham and real TMS conditions. Finally, there was also a rest condition in which no TMS (either real or sham) was delivered and the participant was instructed to just rest and avoid movement.
In summary, after the calibration run the experiment consisted of 4 test runs, each of which contained 50 trials. Forty five percent of these 200 trials (90 trials) used real TMS and 45% used sham TMS. The remaining 10% were rest trials. Both the trials in which real TMS was delivered and sham TMS was delivered were split into 5 groups, each containing 18 trials. For each of these groups of trials TMS was delivered according to one of the conditions described above. Finally, of the 18 trials in each group half (9 trials) included the use of visual feedback of the ERD strength to the participant and half did not. This is summarised in Table 1.
Table 1.
Trial type (trials) | Delivery of TMS (trials) | Feedback (trials) |
---|---|---|
Real TMS (90) | 10% ERD (18) | Yes (9) |
No (9) | ||
20% ERD (18) | Yes (9) | |
No (9) | ||
30% ERD (18) | Yes (9) | |
No (9) | ||
40% ERD (18) | Yes (9) | |
No (9) | ||
Fixed 33 ms after cue presentation (18) | Yes (9) | |
No (9) | ||
Sham TMS (90) | 10% ERD (18) | Yes (9) |
No (9) | ||
20% ERD (18) | Yes (9) | |
No (9) | ||
30% ERD (18) | Yes (9) | |
No (9) | ||
40% ERD (18) | Yes (9) | |
No (9) | ||
Fixed 33 ms after cue presentation (18) | Yes (9) | |
No (9) | ||
Rest (20) | - | - |
2.3. Recording
2.3.1. Electroencephalogram
The electroencephalogram (EEG) was recorded from participants throughout the experiment via a 32-channel EEG amplifier (BrainProducts, Germany). EEG was recorded from 32 channels arranged following a modified version of the extended international 10/20 system for electrode placement, with electrodes clustered over the left motor cortex. This is illustrated in Figure 3.
EEG was sampled at a rate of 500Hz and impedances were kept below 10 kΩ for all channels over all participants.
2.3.2. Electromyogram
The electromyogram (EMG) was recorded from the participant‘s right forearm over the flexor digitorum superficialis muscle. The ground electrode was attached to the styloid process of the ulna near the wrist. The EMG signals were recorded at a sample rate of 4,000Hz via a PowerLab data recording system (ADI instruments, USA).
2.4. Transcranial magnetic stimulation
TMS was delivered in single pulses at key moments during the experiment via a MagStim 200 stimulator (MagStim, USA). A 10 mm diameter figure 8 coil was used to deliver the TMS at 120% of resting motor threshold, with thresholds identified for each participant prior to the testing runs [20].
Stimulation thresholds and locations for each participant were identified, following procedures outlined in [20], by first systematically moving the stimulation coil over the left motor cortex in small incremental steps and periodically stimulating while visually inspecting the recorded EMG. When a good spot was found the resting threshold was then identified by increasing / decreasing the stimulation level until a level was found for which 5 out of 10 stimulations produced a visible MEP (defined as an MEP with a peak-to-peak amplitude in the 50 ms after the TMS pulse of at least 50 µV).
Sham TMS was delivered by a second figure 8 TMS coil from a second MagStim 200 system (BiStim2 2002). This coil was positioned approximately 10 cm above the participant’s head, far enough away to not cause any stimulation. This sham coil was stimulated with an additional 10% output to produce a similar acoustic effect for the participant to the real stimulation coil.
2.5. Brain-computer interface
A brain-computer interface (BCI) was constructed to measure ERD strength and feed it back to participants during each trial.
2.5.1. Channel identification
ERD was used as a measure of movement intention[11]. The exact set of EEG channels that optimally record the ERD can differ between participants due to differences in head shape and small inter-participant differences in EEG cap positioning [21]. Therefore, the calibration run was used to identify a set of EEG channels from which to get the best measure of the ERD from each participant.
A set of candidate bi-polar EEG channel pairs were considered as possible candidate channel pairs from which to measure the ERD. These are listed in Table 2.
Table 2.
Channel pairs | |
---|---|
F7 - FC5 | C3 - CP3 |
F5 - FC3 | C1 - CP1 |
F3 - FC1 | Cz - Pz |
FC5 - C5 | CP5 - P5 |
FC3 - C3 | CP3 - P3 |
FC1 - C1 | CP1 - P1 |
C5 - CP5 | CPz - Pz |
The ERD strength was measured for each bi-polar channel pair for each trial in the calibration run. The pair of bi-polar channels which had the largest median recorded ERD during the move trials was then used as the channel pair for measuring the ERD strength from that participant during the subsequent runs.
2.5.2. Event-related desynchronization
The ERD was measured by taking Welch’s power spectral density estimate of the magnitude of the EEG within the frequency band 8 - 20Hz (the alpha and lower beta frequency bands), as this frequency range was found in pilot testing (and reported in previous literature [22, 23]) to contain the majority of the ERD during motor execution tasks. The Welch spectrogram was taken from a 1 s long segment of EEG beginning from the delivery of the cue to move (or imagine movement) given to the participant. Additionally, a measure of ERD strength in the baseline period of the trial was taken by estimating the median power within the 2 s prior to the start of the cued task period (the last 2 s of the fixation cross presentation time).
To avoid contamination of the ERD measurement by transitory large amplitude TMS artefacts in the EEG, samples with amplitudes greater than 100 uV were discarded. The TMS artefact in the EEG was observed to be in the range of several hundred to over 1,000 uV, and very short (<10 ms including settling period) so this method is appropriate.
The ERD was then rescaled as a percentage of baseline activity via
(1) |
where ‘Baseline’ denotes the median activity in the pre-movement cued period (calculated the same way as the activity in the cued period, via Welch’s spectrogram) and ‘ERD’ denotes the median activity, calculated via Welch’s spectrogram, in the cued movement period of the trial.
During the 5 s cued movement period in the testing runs, the ERD(%) was recalculated every 100 ms within a sliding window approach with a window length of 2 s covering the most recent 2 s of recorded EEG.
2.6. Analysis
2.6.1. Artefact rejection
The EEG data was first visually inspected for artefacts. This was done by a researcher experienced in EEG inspection (author ID, 6 years experience) who was blinded to the current trial conditions for the visual inspection process. Incidences of artefacts were manually labelled for each trial for every participant. Trials were then discounted from further analysis if any of the following conditions were met.
-
(i)
The cued period of the trial contained electromyogram (EMG) artefacts on one or more EEG channels.
-
(ii)
The cued period of the trial contained movement artefacts on one of more EEG channels.
Discounting these trials from subsequent analysis means that the results are based on trials for which there is no large artefact contamination. Therefore, delivery of TMS and visual feedback during these trials is based on ERD strength only and not on artefact contamination.
2.6.2. Motor evoked potentials
Motor evoked potentials (MEPs) were measured in terms of their amplitude in the time period 0.01 - 0.1 s relative to delivery of the TMS (either real or sham). For trials in which no TMS was provided (the rest trials and trials in which the participant did not produce sufficient ERD to trigger either a real or sham TMS) the MEP amplitude and latency was extracted from a time period relative to the median TMS time from all trials in which TMS was delivered for the same participant. The MEP amplitude was measured as the peak to peak difference in amplitudes within this 0.01 – 0.1 s window.
2.6.3. Statistical testing
An ANOVA was used to determine the effects of the factors ‘TMS type’, ‘ERD level’, and ‘Feedback’. ‘TMS type’ has three levels: ‘Real TMS’, ‘Sham TMS’, and ‘Rest’ (no TMS delivered). ‘ERD level’ has 6 levels: ‘10% of ERD strength’, ‘20% of ERD strength’, ‘30% of ERD strength’, ‘40% of ERD strength’, ‘Fixed time TMS’, and ‘Rest’ (no TMS delivered). Finally, ‘Feedback’ has two levels: ‘Feedback’, and ‘No feedback’.
The ANOVA was applied to the participant population with an additional random factor ’Participant number’. Subsequent exploratory analysis was conducted to explore the effects of different stimulation times and feedback on MEP amplitudes and latencies, and on ERD strengths.
3. Results
3.1. Artefact rejection
The artefact rejection process resulted in 8.48% of the trials being rejected due to artefact contamination. This left a total of 2,041 trials in the dataset over all participants. Trials were removed approximately uniformly over all participants, with each participant having a median of 11 trials removed due to artefact contamination.
Additionally, the placement of the EMG electrodes differed between participants due to day-to-day differences in placement of the leads. This means that the amplitude of the MEPs recorded from some participants was inverted when compared to others. In order to correct for this, to allow for comparative visual inspections of MEPs between participants, the mean MEPs recorded from each participant were plotted and then visually inspected. For participants with inverted grand average MEPs (MEPs in which the first deflection from zero was positive) the polarity of the MEPs were corrected by negating the amplitude of the recorded MEP signals.
3.2. Event-related (de)synchronisation
The strength of the baseline used to calculate the ERD strength during movement attempts was first evaluated. An ANOVA with factors ‘Participant’, ‘TMS type’, ‘ERD level’, and ‘Feedback’ was applied to identify any effects of experimental conditions on baseline strength. No significant effects were observed (p > 0.05) suggesting that baseline EEG was consistent across conditions.
The strength of the event-related desynchronization was explored. The root mean squared amplitude of the ERD was calculated over the 5 s trials and compared across conditions via the ANOVA with factors ‘Participant’, ‘TMS type’, ‘ERD level’, and ‘Feedback’. This confirmed a significant effect of the interaction terms ‘Participant’ × ‘TMS type’ (F(10,1664) = 4.07, p < 0.001) and ‘Participant’ × ‘Feedback’ (F(10,1664) = 3.01, p = 0.0009).
To correct for these effects of ‘participant’, z-scoring (subtraction of the mean and division by the standard deviation) was used to correct for inter-participant differences. We then applied an ANOVA to the z-scored data with factors ‘Participant’, ‘TMS type’, ‘ERD strength’, and ‘Feedback’. This revealed a main effect of ‘TMS type’ (F(1,1664) = 16.25, p < 0.001) and ‘ERD strength’ (F(4,1664) = 3.15, p = 0.0137). This suggests the need for separate analysis of the effects of TMS delivery at different ERD strengths for the two different TMS conditions ‘real’ and ‘sham’.
Therefore, the ANOVA was repeated twice, once for real TMS and once for sham TMS to investigate the effects of each of these types of stimulation, at different times relative to the ERD time course, and feedback, on the ERD. When sham TMS was used no significant effects of the timing of the stimulation (relative to the ERD strength), or feedback were found (p > 0.05). However, when real TMS was used a significant effect of the timing of the stimulation on the ERD strength was noted F(4,824) = 3.56, p = 0.0069.
To investigate this effect further the ERD strength is plotted as a function of the timing of the TMS in Figure 4.
This suggests that, when TMS is delivered over the motor cortex during an ongoing ERD, the strength of the ERD is modulated depending on the timing of the TMS. Specifically, if TMS is delivered at 20% ERD strength this acts to increase the overall strength of the ERD (as measured by the root mean squared amplitude of the ERD).
3.3. Corticospinal excitability
We then investigated the effect of the different factors (‘Participant’, ‘TMS type’, ‘ERD strength’, and ‘Feedback’) on corticospinal excitability (as measured by the MEP strength) via the ANOVA. The results revealed that there were significant effects of the factor ‘TMS type’ (F(1,1571) = 89.22, p < 0.001) and stimulation time as a percentage of ‘ERD strength’ (F(4,1571) = 5.786, p < 0.001), but no significant effect of ‘Feedback’ (F(1,1571) = 0.11, p = 0.749).
We then checked the effect of the TMS condition on the magnitude of the MEPs to confirm that the observed effects were a result of genuine stimulation and not an effect of other extraneous factors, such as, for example, the participants reacting to the noise of the TMS device. Welch’s ANOVA was used to compare MEP peak-to-peak amplitudes (measured from individual trials) between real and sham TMS conditions and a significant effect of the real TMS was observed (Welch ANOVA F = 291.28, p < 0.001).
For all trials for which real TMS was used, a 3-level ANOVA with factors ‘Participant’, ‘stimulation time’, and ‘feedback’ was then applied to identify which factors had the greatest impact on the observed MEP amplitudes. Significant effects were observed for the factors ‘Participant’ (F(10,820) = 7.78, p = 0.0095) and ‘stimulation time’ (F(4,820) = 5.04, p = 0.0017).
This indicates that, as with the ERD response, there were inter-participant differences in MEP responses to the real TMS. These were corrected for by z-scoring the peak-to-peak MEP amplitude and latency values measured from each MEP on a per-participant basis.
The relationship between ERD strength and corticospinal excitability (as measured by the MEP peak-to-peak amplitudes after z-scoring) was first investigated when no feedback was presented to the participants. Figure 5 illustrates the effect of stimulation time on the amplitude of the recorded MEPs over all participants when real TMS was used and feedback was not presented.
It may be observed that the magnitude of the MEP varies as a non-linear function of the ERD strength and that the largest MEP occurred when stimulation was delivered at 30% ERD. This suggests that corticospinal excitability within the motor cortex changes as a function of the time course of the ERD and peaks relatively early in the ERD time course.
This is confirmed by applying a Welch’s ANOVA to evaluate the effect of stimulation time on MEP peak-to-peak amplitudes for trials in which real TMS was used and no feedback was provided. A significant effect of stimulation time was observed F(4) = 9.09, p < 0.001
When feedback was provided to the participants a relationship was also observed between stimulation time and MEP peak-to-peak amplitude. This is demonstrated via the use of Welch’s ANOVA F(4) = 3.93, p = 0.0043.
Additionally, when feedback was provided to participants there appeared to be a reduction in the overall amplitude of the MEP strength at each stimulation time (although this reduction in MEP amplitude was not observed to be significant when the 3-factor ANOVA, with factors ‘TMS type’, ‘ERD strength’, and ‘Feedback’ was applied). It also appears to cause the time, relative to the time-course of the ERD, at which the corticospinal excitability peaks to shift towards 20% of the ERD strength. This is illustrated in Figure 6 and is consistent with the effect of ERD-dependent delivery of TMS (stimulation time) on the total ERD magnitude (as illustrated in Figure 4).
Note that, when comparing Figure 6 with Figure 5, the MEP amplitudes are lower and the MEP amplitudes observed at 20% of ERD are larger when feedback was presented. Thus, feedback appears to cause a reduction in general corticospinal excitability (although this is not significant) and a possible slightly earlier peaking of corticospinal excitability relative to the timing of the ERD.
It is also important to note that the use of feedback does not affect the peak-to-peak amplitudes of the MEPs when TMS was delivered at specific times during the trial, instead of when TMS was delivered as a function of ERD strength (p > 0.05). Thus, feedback, by itself, does not appear to change the level of corticospinal excitability throughout the trial. Instead there is a possibility (indicated by the slight shift in the peak of the excitability) that it may act to change the corticospinal excitability as a function of the ERD time-course; however, this cannot be confirmed by the current results.
3.4. Participant effects
Similar effects were also observed when the relationship between corticospinal excitability and ERD strength and the effect of feedback was investigated on a per-participant basis. Specifically, the relationships between MEP amplitudes and stimulation times as a function of ERD strength, were inspected for each participant, with and without feedback, in Figure 7.
It may be observed that, in general, there is a strong relationship between ERD strength and MEP amplitudes, both with and without feedback provided to participants. This confirms that the results observed over the group are common across the population and not a result of a single outlying participant.
4. Discussion
The ERD is known to reflect the localised activation of cortical neurons in the motor cortex during motor imagination and execution [10]. It is commonly used as a control signal in brain-computer interfaces and is fed back, visually, to stroke patients during BCI-based stroke rehabilitation [22].
Previous work has suggested a link between corticospinal excitability and ERD strength [16], but without the use of appropriate control conditions, such as sham TMS, it has not been possible to be fully confident in the transferability of this finding. Additionally, it is not known what effect visual feedback of ERD strength, as used during BCI-based neuro-rehabilitation, has on corticospinal excitability. As promoting corticospinal excitability is thought to be an important component of successful stroke recovery [24, 14] it is important to investigate the effects of both the time-course of the ERD and BCI-based visual feedback of the ERD strength on corticospinal excitability.
We observed a relationship between ERD strength and corticospinal excitability. Specifically, corticospinal excitability was modulated as a function of ERD strength and is at its greatest between 20% to 30% of the ERD. This is not an artefact of the participants reacting to the acoustic stimulus associated with the TMS system (as verified via the use of a sham condition) and occurred both with and without visual feedback presented to the participants. This confirms our first hypothesis, that ERD strength relates to corticospinal excitability.
However, the presentation of visual feedback of our participant’s ERD strengths to our participants while they attempted movement was not observed to significantly affect corticospinal excitability. Specifically, the mean RMS of the MEP strengths with and without feedback were 0.0041 and 0.0054 (p > 0.1, t-test). Thus, we were not able to confirm our second hypothesis, that BCI-based visual feedback of ERD strength modulates corticospinal excitability.
This result appears at odds with previous reports that ERD-based BCIs (the majority of which use visual feedback [25]) are able to promote functional recovery after stroke. Specifically, motor re-learning is commonly thought to be contingent on promoting corticospinal excitability and, therefore, we would expect to observe a relationship between the presentation of visual feedback and corticospinal excitability. One possible explanation for this lack of observation is the fact that the visual feedback is, perhaps, not ecologically relevant to the learning task in this case. For example, in [26] visual feedback takes the form of a simple picture of a hand opening and closing as the participant attempts the same action. This type of feedback, although not much more involved than the simple bar plot we use, is perhaps more directly intuitive to participants and could be more successful in inducing changes in corticospinal excitability.
A second possible explanation may relate to either sample size or effect size. It is possible that a larger number of participants may reveal further detail about relationships between feedback and cortical excitability. Additionally, in a number of previous studies evaluating BCI for stroke rehabilitation participants were provided with a BCI over numerous sessions over a series of different training days [27, 12]. Thus, it is possible that a longer training paradigm with our participants may also have revealed a more subtle effect of visual feedback.
It should be noted that calculation of ERD strength from the previous 2 s of EEG means that, for the first 2 s of the trial an edge effect is observed where there is some overlap between the ERD window and the baseline window. This is consistent with prior work [16] and has a small effect on the estimated ERD strength for a very short time period, but is not thought to alter the results.
Previous work has shown that neuroplasticity (a key feature of stroke rehabilitation) may be induced in a participant if sensory stimulation is delivered, according to Hebbian learning principles, with precise timing [28]. Specifically, if sensory stimulation is delivered at a time such that it arrives at the motor cortex at the same time as the peak motor related cortical potential this has been reported to induce greater neuroplasticity [29]. However, if the timing of the sensory stimulation is such that the arrival of the afferent nerve stimulation volley at the motor cortex does not coincide with the peak motor-related cortical potential (MRCP) strength this has been reported to suppress neuroplasticity [28].
In contrast to this previous work, our findings show an approximately linear relationship between cortical excitability and the strength of the ERD. The ERD has a considerably longer duration than the MRCP and peak ERD occurs shortly (500-750 ms) after the timing of the peak of the MRCP [30]. Thus, our observation of a peak in cortical excitability at 30% ERD strength may suggest that cortical excitability peaks around the time of the peak MRCP. However, further investigation would be needed to clarify this.
Overall, this suggests that in order to induce neuroplasticity in participants sensory stimulation should be delivered at the time of maximum cortical excitability. Cortical excitability linearly relates to the ERD time course, which peaks shortly after the peak MRCP. However, further investigations are needed to explore the exact nature of the timings that are needed to optimize this process.
A relationship between the strength of motor impairment following stroke and the ERD has previously been reported [31]. When considered with our observations that ERD strength relates to corticospinal excitability this suggests that corticospinal excitability may be modulated by stroke-related motor strength inhibition.
However, our finding that the provision of our visual feedback to participants does not act to modulate corticospinal excitability during motor control has potential implications for the field of brain-computer interfacing. Visual feedback of ERD strength is commonly used in BCI applications and is widely regarding as a motivating factor for participants to allow them to train their ERD in order to use it more effectively for controlling motor-control based BCIs. Our results suggest that the exact type of feedback used may be important when deploying BCI in a stroke rehabilitation context.
An important consideration to make regarding our study is that the feedback used within the BCI system was relatively simplistic. It is likely that more ecologically relevant feedback (such a visual displays of hands or robotic systems, as used in [27], or functional electrical stimulation, as used in [32]), could lead to clearer results.
Additionally, our measure of the ERD from our participants is not the only way to characterize ERD strength. We used a bi-polar channel montage to record EEG data, an approach that is common to a large amount of ERD-based BCI research and that is considered by many researchers to accurately capture the dynamics of the ERD [26, 33]. However, it is possible that other approaches, such as spatial filtering [34], may out-perform our approach.
Furthermore, our ERD features were extracted from the frequency band 8-20Hz, which is known to cover the majority of the ERD response range and is commonly used in ERD-based BCI studies [3]. However, the ERD is also known to involve activity in higher frequency bands from 20-30Hz [3], and it is possible that a wider frequency band could more accurately capture the ERD.
In summary, our results, in part, replicate those reported in [16], in that corticospinal excitability was observed to exhibit a non-linear relationship with the strength of the event-related desynchronization. In addition, we also noted that the timing of the ERD closely relates to the time course of corticospinal excitability. Thus, if one wishes to enhance corticospinal excitability via the use of BCI or brain-state dependent brain stimulation it is important to ensure that the stimulation is delivered at the right moment (either at 20% or 30% of the ERD strength) within the ongoing motor imagination or execution related sensorimotor rhythm activity. These cognitive processes are reflected in the ERD and, therefore, brain-state dependent delivery of brain stimulation may be a promising route of research to explore in future stroke rehabilitation systems.
Acknowledgments
This work was supported by the Medical research Council [grant number MR/K014250/1 to NPH].
References
- [1].Wolpaw JR, Birbaumer N, Heetderks WJ, McFarland DJ, Peckham PH, Schalk G, Donchin E, Quatrano LA, Robinson CJ, Vaughan TM. Brain-computer interface technology: a review of the first international meeting. IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society. 2000 Jun;8:164–173. doi: 10.1109/tre.2000.847807. [DOI] [PubMed] [Google Scholar]
- [2].Hwang H-J, Kim S, Choi S, Im C-H. EEG-based Brain-Computer Interfaces (BCIs): A Thorough Literature Survey. International Journal of Human-Computer Interaction. 2013 Apr;29:130429122442009. [Google Scholar]
- [3].Pfurtscheller G, Lopes da Silva F. Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical Neurophysiology. 1999 Nov;110:1842–1857. doi: 10.1016/s1388-2457(99)00141-8. [DOI] [PubMed] [Google Scholar]
- [4].Jeannerod M. Mental imagery in the motor cortex. Neuropsychologia. 1995;33:1143–1419. doi: 10.1016/0028-3932(95)00073-c. [DOI] [PubMed] [Google Scholar]
- [5].Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain-computer interfaces for communication and control. Clin Neurophysiol. 2002 Jun;113:767–791. doi: 10.1016/s1388-2457(02)00057-3. [DOI] [PubMed] [Google Scholar]
- [6].Ramos-Murguialday A, Schürholz M, Caggiano V, Wildgruber M, Caria A, Hammer EM, Halder S, Birbaumer N. Proprioceptive feedback and brain computer interface (BCI) based neuroprostheses. PloS one. 2012 Jan;7:e47048. doi: 10.1371/journal.pone.0047048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [7].Leeb R, Friedman D, Müller-Putz GR, Scherer R, Slater M, Pfurtscheller G. Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic. Computational Intelligence and Neuroscience. 2007;2007:8. doi: 10.1155/2007/79642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [8].Ang KK, Guan C. Brain-Computer Interface in Stroke Rehabilitation. 2013 Jun; doi: 10.1109/EMBC.2012.6346874. [DOI] [PubMed] [Google Scholar]
- [9].Daly JJ, Wolpaw JR. Brain-computer interfaces in neurological rehabilitation. Lancet neurology. 2008 Nov;7:1032–43. doi: 10.1016/S1474-4422(08)70223-0. [DOI] [PubMed] [Google Scholar]
- [10].Pfurtscheller G, Aranibar A. Event-related cortical desynchronization detected by power measurements of scalp EEG. Electroencephalography and clinical neurophysiology. 1977 Jun;42:817–26. doi: 10.1016/0013-4694(77)90235-8. [DOI] [PubMed] [Google Scholar]
- [11].Müller-Putz GR, Zimmermann D, Graimann B, Nestinger K, Korisek G, Pfurtscheller G. Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients. Brain research. 2006;1137(1):84–91. doi: 10.1016/j.brainres.2006.12.052. [DOI] [PubMed] [Google Scholar]
- [12].Pichiorri F, Morone G, Petti M, Toppi J, Pisotta I, Molinari M, Paolucci S, Inghilleri M, Astolfi L, Cincotti F, Mattia D. Brain-computer interface boosts motor imagery practice during stroke recovery. Annals of neurology. 2015 May;77:851–65. doi: 10.1002/ana.24390. [DOI] [PubMed] [Google Scholar]
- [13].Pichiorri F, Morone G, Pisotta I, Secci M, Cincotti F, Paolucci S, Molinari M, Mattia D. Randomized Controlled Trial to Evaluate a BCI-Supported Task-Specific Training for Hand Motor Recovery after Stroke. Converging Clinical and Engineering Research on Neurorehabilitation Biosystems & Biorobotics. 2013;1 [Google Scholar]
- [14].Clarkson AN, Carmichael ST. Cortical excitability and post-stroke recovery. Biochemical Society transactions. 2009 Dec;37:1412–4. doi: 10.1042/BST0371412. [DOI] [PubMed] [Google Scholar]
- [15].Lepage J-F, Saint-Amour D, Théoret H. EEG and neuronavigated single-pulse TMS in the study of the observation/execution matching system: are both techniques measuring the same process? Journal of neuroscience methods. 2008 Oct;175:17–24. doi: 10.1016/j.jneumeth.2008.07.021. [DOI] [PubMed] [Google Scholar]
- [16].Aono K, Miyashita S, Fujiwara Y, Kodama M, Hanayama K, Masakado Y, Ushiba J. Relationship between event-related desynchronization and cortical excitability in healthy subjects and stroke patients. The Tokai journal of experimental and clinical medicine. 2013 Jan;38:123–8. [PubMed] [Google Scholar]
- [17].O’Malley MK, Ro T, Levin HS. Assessing and inducing neuroplasticity with transcranial magnetic stimulation and robotics for motor function. Archives of physical medicine and rehabilitation. 2006 Dec;87:S59–66. doi: 10.1016/j.apmr.2006.08.332. [DOI] [PubMed] [Google Scholar]
- [18].Sergeeva EG, Henrich-Noack P, Bola M, Sabel BA. Brain-state-dependent non-invasive brain stimulation and functional priming: a hypothesis. Frontiers in human neuroscience. 2014;8:899. doi: 10.3389/fnhum.2014.00899. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [19].Rossi S, Hallett M, Rossini PM, Pascual-Leone A. Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research. Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology. 2009 Dec;120:2008–39. doi: 10.1016/j.clinph.2009.08.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [20].Rossini P, Burke D, Chen R, Cohen L, Daskalakis Z, Di Iorio R, Di Lazzaro V, Ferreri F, Fitzgerald P, George M, Hallett M, et al. Non-invasive electrical and magnetic stimulation of the brain, spinal cord, roots and peripheral nerves: Basic principles and procedures for routine clinical and research application. An updated report from an I.F.C.N. Committee. Clinical Neurophysiology. 2015 Jun;126:1071–1107. doi: 10.1016/j.clinph.2015.02.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [21].Pfurtscheller G, Brunner C, Schlögl A, Lopes da Silva FH. Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage. 2006 May;31:153–9. doi: 10.1016/j.neuroimage.2005.12.003. [DOI] [PubMed] [Google Scholar]
- [22].Pfurtscheller G, Neuper C. Motor imagery and direct brain-computer communication. Proceedings of the IEEE. 2001 Jul;89:1123–1134. [Google Scholar]
- [23].Neuper C, Müller-Putz GR, Scherer R, Pfurtscheller G. Motor imagery and EEG-based control of spelling devices and neuroprostheses. Prog Brain Res. 2006 Jan;159:393–409. doi: 10.1016/S0079-6123(06)59025-9. [DOI] [PubMed] [Google Scholar]
- [24].Dobkin BH. Strategies for stroke rehabilitation. Lancet neurology. 2004 Sep;3:528–36. doi: 10.1016/S1474-4422(04)00851-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Ang KK, Guan C. Brain-Computer Interface in Stroke Rehabilitation. Journal of Computing Science and Engineering. 2013 Jun;7:139–146. [Google Scholar]
- [26].Ono T, Shindo K, Kawashima K, Ota N, Ito M, Ota T, Mukaino M, Fujiwara T, Kimura A, Liu M, Ushiba J. Brain-computer interface with somatosensory feedback improves functional recovery from severe hemiplegia due to chronic stroke. Frontiers in neuroengineering. 2014;7:19. doi: 10.3389/fneng.2014.00019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [27].Ang KK, Guan C, Chua KSG, Ang BT, Kuah C, Wang C, Phua KS, Chin ZY, Zhang H. Clinical study of neurorehabilitation in stroke using EEG-based motor imagery brain-computer interface with robotic feedback. Conference proceedings : … Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference; 2010. Jan, pp. 5549–52. [DOI] [PubMed] [Google Scholar]
- [28].Mrachacz-Kersting N, Jiang N, Stevenson AJT, Niazi IK, Kostic V, Pavlovic A, Radovanovic S, Djuric-Jovicic M, Agosta F, Dremstrup K, Farina D. Efficient neuroplasticity induction in chronic stroke patients by an associative brain-computer interface. Journal of Neurophysiology. 2016 Mar;115:1410–1421. doi: 10.1152/jn.00918.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [29].Stefan K, Kunesch E, Benecke R, Cohen LG, Classen J. Mechanisms of enhancement of human motor cortex excitability induced by interventional paired associative stimulation. The Journal of physiology. 2002 Sep;543:699–708. doi: 10.1113/jphysiol.2002.023317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Toro C, Deuschl G, Thatcher R, Sato S, Kufta C, Hallett M. Event-related desynchronization and movement-related cortical potentials on the ECoG and EEG. Electroencephalography and Clinical Neurophysiology/ Evoked Potentials. 1994 Oct;93:380–389. doi: 10.1016/0168-5597(94)90126-0. [DOI] [PubMed] [Google Scholar]
- [31].Kaiser V, Daly I, Pichiorri F, Mattia D, Müller-Putz G, Neuper C. Relationship between electrical brain responses to motor imagery and motor impairment in stroke. Stroke. 2012;43(10):2735–2740. doi: 10.1161/STROKEAHA.112.665489. [DOI] [PubMed] [Google Scholar]
- [32].Meng Fei, Tong Kai-yu, Chan Suk-tak, Wong Wan-wa, Lui Ka-him, Tang Kwok-wing, Gao Xiaorong, Gao Shangkai. BCI-FES training system design and implementation for rehabilitation of stroke patients. 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence); IEEE; 2008. Jun, pp. 4103–4106. [Google Scholar]
- [33].Vuckovic A, Hasan MA, Osuagwu B, Fraser M, Allan DB, Conway BA, Nasseroleslami B. The influence of central neuropathic pain in paraplegic patients on performance of a motor imagery based Brain Computer Interface. Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology. 2015 Nov;126:2170–80. doi: 10.1016/j.clinph.2014.12.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [34].Müller-Gerking J, Pfurtscheller G, Flyvbjerg H. Designing optimal spatial filters for single-trial EEG classification in a movement task. Clinical Neurophysiology. 1999 May;110:787–798. doi: 10.1016/s1388-2457(98)00038-8. [DOI] [PubMed] [Google Scholar]