Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Feb 1.
Published in final edited form as: Neurorehabil Neural Repair. 2016 Oct 28;31(2):178–189. doi: 10.1177/1545968316675432

Motor Learning In Stroke: Trained Patients are Not Equal to Untrained Patients with Less Impairment

Robert M Hardwick a, Vikram A Rajan a, Amy J Bastian a,b, John W Krakauer a, Pablo A Celnik a
PMCID: PMC5292612  NIHMSID: NIHMS820483  PMID: 27789762

Abstract

Background and Objective

Stroke rehabilitation assumes motor learning contributes to motor recovery, yet motor learning in stroke has received little systematic investigation. Here we aimed to understand whether training on a motor skill will allow a chronic stroke patient to resemble another individual with lesser impairment.

Methods

We examined motor learning in healthy control participants and groups of stroke survivors with mild-to-moderate or moderate-to-severe motor impairment. Participants performed a series of isometric contractions of the elbow flexors to navigate an on-screen cursor to different targets, and trained to perform this task over a four day period. The speed-accuracy trade-off function (SAF) was assessed for each group both before and after training, controlling for differences in self-selected movement speeds between individuals.

Results

The initial SAF for each group was proportional to their impairment. Both groups of patients were able to improve their task performance through skill acquisition (characterized by increased precision/reduced variability following training) to match the baseline (i.e. untrained) performance of a group with less impairment. However, training data showed performance reached a plateau prior to the final SAF assessment, indicating that further training would be of limited benefit to trained participants.

Conclusions

A patient can train on a task to match the baseline performance of an untrained individual, but their respective responses to training from this point on show they remain categorically different. This has important implications for decisions relating to the focus of rehabilitation efforts in the chronic stage as well as returning to work and other activities.

Keywords: Motor Skills, Motor Skills Disorders, Motor Disorders, Motor Activity, Speed-Accuracy Trade-Off, Motor Control, Hemiparesis, Motor Impairment

Introduction

Stroke is a leading cause of adult disability, leaving 30–66% of patients with lasting motor impairment1,2. It has long been proposed that motor recovery following stroke is a form of relearning3,4 and there is considerable overlap between the brain regions involved in both processes57. However, while acquiring skill at a task may allow a patient to perform at the same level as an individual with lesser impairment, this does not necessarily make them equal. For example, well recovered stroke patients can match the performance of healthy controls on a motor task, but differences exist in the neural networks that underlie performance for each group8. Furthermore, matched performance does not necessarily imply that both groups have the same ability to continue improving given the opportunity for practice. These differences can complicate judgments regarding patient’s capacity to return to work and other activities9, and which rehabilitation activities they should focus on. Here we propose that acquiring skill through motor training raises a similar issue; a patient who has trained on a task may ‘appear better’, masking categorical differences in their abilities. Consider two hypothetical patients – patient A, who has mild motor impairment, and patient B, who is more severely impaired. Patient A performs better in a movement task than patient B. Patient B then trains at the task, reaching the same performance level as Patient A. If Patient B is now equal to Patient A, they should have similar capacity for further improvement with training. If this is not the case, (for example, if Patient B has reached a performance plateau beyond which further training has a limited effect), then a categorical difference remains between these patients despite their matching task performance.

In comparison to healthy individuals, stroke patients select slower voluntary movement speeds when performing movement tasks10. As speed and accuracy are inherently linked11, a confound arises when comparing the accuracy of movements performed at different speeds. This limitation makes it difficult to interpret previous results, such as cases where patients improve their accuracy yet decrease their speed12. In such cases, it is impossible to determine whether a patient improved their ability to perform the task (through skill acquisition), or whether they simply changed the aspect of performance on which they focused (e.g. sacrificed speed for accuracy while remaining at the same overall level of ability). The only way to disambiguate these alternatives is to first derive the speed-accuracy trade-off function (SAF13) for a given task; participants are required to complete the task in a fixed time, allowing accuracy to be measured without the confounding effects of differences in speed. Once derived, skill represents a shift in the SAF1315.

Here we introduce a serial voluntary isometric elbow force task, a modified version of the serial voluntary isometric pinch task (SVIPT). This task is based on an established laboratory based model of motor learning in which participants learn to control a cursor by producing isometric forces1319. In the task used in the present study, participants controlled a cursor by exerting forces with their elbow flexor muscles, allowing comparisons of performance across participants with greater ranges of impairment than would be possible with the standard (hand controlled) SVIPT paradigm. To control for differences in movement speeds across groups, performance was assessed by comparing the speed-accuracy trade-off pre and post-training, using measures of task-level performance (i.e. binary success/failure to complete all specified aspects of the task)1318, and trial-level measures of endpoint error and variability20. We predicted that the severity of a participant’s motor impairment would limit their ability to perform the task, and that training may allow them to achieve a similar level of performance as an individual with lesser impairment. However, we hypothesized that despite their matching performance, there would be a categorical difference between these individuals; the previously untrained participant with lesser impairment would be able to make large, rapid improvements through training, while the trained participant would not.

Methods

Participants

A total of 30 participants took part in the study (see Table 1). Participants were required to successfully complete a mini-mental status examination with a score ≥27/30, excluding participants with potentially confounding cognitive deficits21. Stroke survivors with cerebellar lesions and/or ataxia were excluded from the study. All participants had a minimum biceps voluntary contraction strength of 44N to provide a suitable range for measurement with the experimental apparatus.

Table I.

Participant Information. MVC = elbow flexors maximum voluntary contraction strength, ueFMS = upper extremity Fugl-Meyer score (maximum score = 66). There were no significant differences between groups for Age, Sex, or handedness as assessed prior to stroke (see main text).

Group Age Sex ueFMS Arm tested Years Post Stroke Stroke Type Lesion location
Healthy Control 28 F 66 Dominant [R] N/A N/A N/A
70 M 66 Dominant [R] N/A N/A N/A
66 M 66 Dominant [L] N/A N/A N/A
61 F 66 Non-Dominant [L] N/A N/A N/A
58 F 66 Non-Dominant [L] N/A N/A N/A
58 M 66 Non-Dominant [L] N/A N/A N/A
51 F 66 Non-Dominant [L] N/A N/A N/A
64 F 66 Non-Dominant [L] N/A N/A N/A
55 F 66 Non-Dominant [L] N/A N/A N/A
47 M 66 Dominant [L] N/A N/A N/A

Mild to Moderate 74 M 66 Dominant [R] 5 Hemorrhagic L Frontal
66 M 66 Non-Dominant [L] 9 Hemorrhagic R Frontal/Parietal
60 M 65 Dominant [R] 2 Ischemic L Frontal
75 M 64 Dominant [R] 4 Ischemic L Frontal
43 F 61 Non-Dominant [L] 8 Hemorrhagic R Parietal
57 M 59 Non-Dominant [L] 1 Ischemic R Medulla
64 M 58 Dominant [R] 4 Ischemic L Putamen
21 M 58 Non-Dominant [L] 2 Ischemic Frontal
66 M 57 Non-Dominant [L] 3 Ischemic R Pons
58 F 56 Non-Dominant [L] 4 Hemorrhagic R Frontal

Moderate to Severe 28 F 43 Dominant [R] 4 Ischemic L Pons
69 M 43 Dominant [R] 3 Ischemic L Frontal/Parietal
54 M 40 Non-Dominant [L] 15 hemorrhagic R Frontal/Putamen
67 M 33 Dominant [R] 3 Ischemic L Thalamus
43 M 30 Non-Dominant [L] 2 Ischemic L Temporal/Putamen
28 F 30 Dominant [R] 10 Hemorrhagic L Frontal
55 F 21 Non-Dominant [L] 5 Hemorrhagic R Thalamus
51 F 21 Non-Dominant [L] 12 Hemorrhagic R Frontal/Parietal
70 F 21 Dominant [R] 11 Ischemic L Frontal/Parietal/Thalamus
63 M 13 Non-Dominant [L] 11 Hemorrhagic R Putamen

Stroke patients were split into two groups according to their upper extremity Fugl-Meyer score (ueFMS)22. In accordance with previously defined groupings2224, ‘mild-to-moderate’ patients had a ueFMS ≥50/66 (n=10, average ueFMS: 60/66), and ‘moderate-to-severe’ patients had a ueFMS <50/66 (n=10, average ueFMS: 31/66). The control group (n=10) consisted of able-bodied participants with no neurological impairments. There were no statistically significant differences between groups for participant age (one way ANOVA, F2,27=0.37, p=0.70), or handedness, defined as the dominant hand before the stroke in patients (Fisher’s exact test, p=0.31). The study was approved by the Johns Hopkins Institutional Review Board, and all subjects gave written informed consent in accordance with the declaration of Helsinki.

Apparatus

Participants sat in a robotic exoskeleton25 that supported their (affected) arm in the horizontal plane (Fig 1A), with the shoulder in 45° of transverse flexion and the elbow in 90° of flexion. Participants controlled the task by exerting isometric forces with the elbow flexor muscles, measured using a force transducer26. Participants were required to control the horizontal position of an on screen cursor (Fig 1B). Contracting the elbow flexors moved the cursor rightwards, while relaxing moved it back toward the ‘Home’ position. Participants aimed to stop the cursor within each target in the sequence ‘Home-1-Home-2-Home-3-Home-4-Home-5′. The task was designed as a modified version of the ‘serial voluntary isometric pinch task’ or SVIPT1319. Controlling the task with the elbow flexor muscles allowed inclusion of patients with poor hand control.

Fig 1.

Fig 1

Experimental setup and procedure. A) Participants sat with their (affected) arm supported by a robotic exoskeleton. A force transducer measured contractions of their elbow flexors. B) On screen display. Contracting the elbow flexors moved the cursor (white circle) to the right, while relaxing moved the cursor to the home position (grey square). A ‘go’ indicator (used in training trials) indicated to participants that they could begin a trial when ready (illustrated here as a green circle). Each trial involved navigating the cursor through the sequence Home-1-Home-2-Home-3-Home-4-Home-5. Target positions and sequence order remained fixed throughout the study. C) Procedure. Participants first completed a pre-training skill assessment, performing the task at trial durations set by an auditory metronome (indicated by tempos presented in beats per minute – see main text for further detail). One ‘run’ of the task involved completing 10 trials at each tempo in a psuedorandom order. This procedure was repeated to generate two runs of data (i.e. a total of 20 trials for each tempo). Participants later trained to perform the task over consecutive days, aiming to complete the sequence as quickly and as accurately as possible. Finally, on a separate day, participants completed a post training skill assessment.

In accordance with previous studies using this paradigm, a logarithmic transformation of force to cursor movement increased task difficulty13. The relationship between cursor position and applied force was scaled to the maximum voluntary contraction (MVC) of each participant, as calculated on the day of the pre-training skill assessment. Movement was scaled such that a contraction of 30% of the individual’s MVC would displace the cursor by 30cm from the home position (i.e. to the far right of the visual display; see Supplementary Figure III for further illustration of the positions of the targets and their boundaries). This scaling procedure controlled for differences in participant strength, and ensured that failure to complete the task would be due to control (rather than strength) deficits.

Procedure

The study comprised three phases (Fig 1C); a pre-training skill assessment (determining the baseline speed-accuracy trade-off), a training intervention (allowing participants to become skilled at the task), and a post-training skill assessment (determining whether training changed the speed-accuracy trade-off).

Skill Assessments

To assess skill we determined the speed-accuracy trade-off, measuring accuracy at fixed execution speeds. Participants were instructed to aim to move the cursor to targets in time with a metronome, with the instruction that each beat of the metronome should correspond to hitting one of the targets. One block of the task comprised completing 10 trials at a fixed tempo (the experiment involved blocks completed at nine different tempos – 24/30/38/45/60/80/100/110/120 BPM, corresponding to approximate trial durations of 12.5/10.0/7.9/6.7/5.0/3.8/3.0/2.7/2.5 seconds, respectively). Blocks were completed in a pseudorandom order (to prevent order effects) until 10 trials were collected for each of the nine tempos. This procedure was repeated twice, providing a total of 20 trials per tempo.

Training

Participants completed four training sessions on consecutive days, each comprising five blocks of 30 trials. Each training session took participants approximately 30 minutes to complete. In contrast to the skill assessments, we instructed participants to complete training trials at a self-selected pace, with the aim of completing each trial as quickly and as accurately as possible13. Participants were verbally encouraged to attempt to improve their speed and accuracy prior to each block, and rested for two minutes between blocks to prevent fatigue.

Analysis

Previous studies using the paradigm upon which the current task is based have predominantly employed binary performance measures; success is achieved by hitting all targets1318, and an average error-rate is calculated by dividing the number of successful trials by the total number of trials in the block. This provides a useful task-level index of performance, but has limited sensitivity. For example, when attempting to hit the bullseye on a dartboard, a binary measure (hitting the target) would not detect improvement if a participant missed by an average of one meter before training, then by an average of one centimeter after training. We therefore performed both a task-level assessment of success using a binary success/failure metric (empirically measuring the speed-accuracy trade-off) and also examined more detailed measures including error magnitude, cursor endpoint variability, and the number of targets the participant attempted to hit, providing more sensitive trial-level metrics20.

Skill Assessments

Task-level success was defined as moving the cursor inside each of the five targets1318. We used a mixed-design ANOVA examining three factors; the two within-participant factors of duration and session, and the between-participant factor of group. Between-group effects were compared using separate RMANOVAs for each session (factors duration and group). Within group comparisons were conducted using separate RMANOVAs (factors session and duration). We conducted planned comparisons on trial duration for each group using paired samples t-tests.

Mean Group Skill

We examined whether each group of participants represented a separate population in terms of skill performance pre and post-training. We calculated the mean error rate (i.e. averaged across all nine trial durations) for each participant, conducted a mixed-design ANOVA with factors of session and group. In a further analysis, we bootstrapped 10,000 mean group resamples, with replacement. Data from each participant contributing to a resample was entered into both the pre and post-training sample estimate, providing a repeated measures test. For example, when resampling the control group, we took the 10 original participants from the group, and randomly selected 10 participants that would contribute to the resample (allowing the same participant to be present multiple times within a resample). We then calculated the mean error rate both pre and post training for this resampled group. This process was repeated until we had generated a pool of 10,000 mean values from such resamples. We calculated 95% confidence intervals by taking 2.5 and 97.5 percentiles from this process27. This resampling analysis provides the additional benefit of controlling for the presence of participants that are not statistical outliers, yet may be considered to represent extreme values within their groups. For example, the mild-to-moderate group contained two stroke patients with ueFMS values of 66/66. While these scores would appear to indicate these patients have no motor impairment, an alternate view is that these patients may have motor impairments to which the ueFMS is not sensitive, but may be revealed by more sensitive examinations of their motor capabilities (such as the present task). A key benefit of resampling with replacement is that this process includes samples wherein these potentially extreme values are both over-represented (samples in which they were randomly selected for inclusion >2/10) or absent (samples in which they were not randomly selected for inclusion), allowing us to determine whether their presence or absence changed the results of the study.

Trial Endpoint Errors

Magnitudes of errors made when attempting to hit each target were measured as the shortest distance from the cursor endpoint to the outer boundary of the corresponding target (consistent with errors participants observed during the task). Attempts falling within the target boundaries thus had 0cm error. If a participant omitted a target then 0cm error was assigned; we took this conservative approach as another analysis examined omission errors (see supplementary materials), and because omitting a target is fundamentally different from attempting to move to it and missing. Error within each trial was summed and analyzed using a mixed-design ANOVA with factors duration, session, and group. We conducted similar analyses for variability (see supplementary materials). A further analysis considered the magnitude of errors for each individual target (see supplementary materials).

Training Data

Previous studies have combined speed and accuracy data to assess ‘skill’ throughout training1318. However, such a comparison here would not be valid due to differences in the baseline SAF for each group (see discussion and supplementary materials). We instead conducted separate mixed-design ANOVAs on durations and error rates, with a within subject factor day and a between subject factor group. Planned t-tests compared mean performance for subsequent days. We made no comparisons between group ‘deltas’ to avoid confounding differences in baseline performance28.

Results

Task Skill Assessments

The mixed-design ANOVA comparing error rates revealed a significant duration × session × group interaction, F16,216=3.49, p<0.001. Between-group comparisons were conducted using separate mixed-design ANOVAs for each skill assessment.

Participants With Greater Motor Impairment Had Less Skill Pre And Post Training

In the pre-training skill assessment (Figure 2A), error rates were greater when participants completed trials with shorter durations (mixed-design ANOVA, main effect of duration, F8,16 = 145.01, p<0.001). Participants with greater motor impairment also made more errors that varied depending on trial duration (group × duration interaction, F16,216=12.58, p<0.001). Control participants were more accurate than mild-to-moderate patients for durations from 3.8–12.5s (all p<0.05), and more accurate than moderate-to-severe patients for durations from 3.0–12.5s (all p<0.05). Mild-to-moderate patients were more accurate than moderate-to-severe patients for durations from 3.0–12.5s (all p<0.05).

Fig 2.

Fig 2

Task-level skill assessment results and training data distributions. Open and closed shapes show group average performance before and training, respectively. A) Between-group comparisons of performance before (left) and after (right) training, highlighting significant differences in group performance for both sessions. B) Within group comparisons of performance pre and post-training for the control, mild-to-moderate impairment, and moderate-to-severe impairment groups, respectively. C) Histograms showing the number of times that participants completed training trials at a particular speed. Error bars present SEM.

The post-training skill assessment identified similar effects. Error rates were greater when trial durations were shorter (mixed-design ANOVA, main effect of duration, F8,16 = 147.17, p<0.001). Participants with greater motor impairment again made more errors dependent on the trial duration (duration × group interaction, F16,216=4.58, p<0.001). Control participants were more accurate than mild-to-moderate patients for durations from 3.75–12.5s and 2.5–2.7s (all p<0.05), and more accurate than moderate-to-severe patients for all durations (all p<0.05). Mild-to-moderate patients were more accurate than moderate-to-severe patients for durations from 3–10s (all p<0.05).

All Groups Performed Better In The Post-Training Skill Assessment

Figure 2B presents pre vs post comparisons of performance for each group. Control participants were able to reduce their error rates across the entire range of trial durations examined (RMANOVA, effects of session, F1,9=16.69, p<0.01, and duration, F8,72=95.53, p<0.001, but no significant session × duration interaction, F8,72=1.43, p=0.20; this indicates differences were not driven by any particular duration – planned pre vs post comparisons for each trial duration were all p<0.05).

Participants with mild-to-moderate impairment were able to improve their performance across some (but not all) trial durations (RMANOVA, significant session × duration interaction, F8,72=2.46, p<0.05. Mild-to-moderate patients improved over durations from 2.7–10.0s (all p<0.05), but not at the fastest or slowest durations tested (2.5s/12.5s, both p>0.18).

Participants with moderate-to-severe impairment improved their performance over a limited range of trial durations (RMANOVA, session × duration interaction, F8,72=7.00, p<0.001.) Moderate-to-severe patients improved their performance only at the slower movement durations from 5.0s–12.5s (all p < 0.05), but not the faster durations from 2.5–3.75s (all p>0.3).

Training Increased Patient Skill To The Level Of An Untrained Group With Less Impairment

The mixed-design ANOVA examining mean error rates revealed significant main effect of session, F1,27=52.23, p<0.001, but no session × group interaction, F2,27=0.16, p=0.99. Fig 3 presents the resampling analysis of mean error rates in skill assessments. Distributions indicate each group represented a separate population before and after training (Fig 3A–B). Notably, there was considerable overlap between post-training performance of some groups with pre-training performance of others (see Fig 3C). Post-training moderate-to-severe patients did not differ from pre-training mild-to-moderate patients. Similarly, post-training mild-to-moderate patients did not differ from the pre-training healthy controls.

Fig 3.

Fig 3

Estimates of group mean error rates during SAF assessments. Estimates were generated from 10,000 resamples of the data for each group. A) Pre-training estimates of mean error rates. B) Post-training estimates of mean error rates. Note that A and B illustrate that each group are separate populations both before and after training. C) 95% confidence intervals for the pre and post-training data, and overlays of the pre and post-training data; 95% confidence intervals are presented above the distributions, illustrating significant differences between groups and sessions. Note that post-training performance for the moderate-to-severe group overlaps pre-training performance for the mild-to-moderate group, and that the post-training performance for the mild-to-moderate group overlaps pre-training performance for the healthy control group.

Training Reduced Cursor Endpoint Error

Fig 4A illustrates the effects of training on cursor endpoint errors. Participants made larger errors on faster trials (mixed design ANOVA, main effect duration, F8,216 = 38.10, p<1×10−36), and greater impairment exacerbated this effect (duration × group, F16,216=5.099, p<1×10−8). All participants made smaller errors following training (main effect of session, F1,27=9.55, p<0.005) across a range of trial durations (duration × session interaction, F8,216=2.312, p<0.05), though error magnitudes were still higher in participants with greater impairment (session × group, F2,27=3.93, p<0.05), particularly when completing faster trials(duration × session × group interaction, F16,216 = 2.578, p<0.01).

Fig 4.

Fig 4

Endpoint Error magnitudes and cursor endpoint positions. A) Within group comparisons of pre and post-training endpoint errors, illustrating the significant effects of trial duration and session on performance. Error bars present SEM. B) Average cursor endpoint positions for the three groups. Squares show group average endpoints for the different targets, represented by the correspondingly colored shaded regions. Numbers above shaded regions denote target number.

Fig 4B illustrates the pattern of endpoint positions across the three groups. A post-hoc analysis (see supplementary material) indicated that participants made larger errors when attempting to hit targets closer to the home position (i.e. those targets that required the execution of smaller, more precise isometric forces). Both speed and impairment exacerbated the magnitude of these errors, while training reduced them.

Training Data

Participants Reached A Plateau In Performance During Training

Training performance is presented in Fig 5. During training sessions participants completed the task at self-selected speeds. With training all groups started to complete trials at faster speeds, though this did not differ across groups (mixed-model ANOVA, main effect of day, F1,3=6.12, p<0.01, but no day × group interaction, F2,6=1.61, p=0.15). There was a significant reduction in trial duration between days 1–2, t29=2.35, p<0.05, a trend for reduction between days 2–3, t29=2.04, p=0.051, and no significant change between days 3–4, t29=0.18, p=0.86. There was also a difference in the speed between groups (main effect group, F2,27=10.29, p<0.001). Trial durations for the control group were significantly shorter than those of the mild-to-moderate group (p<0.05) and the moderate-to-severe group (p<0.001). The mild-to-moderate group had significantly shorter trial durations than the moderate-to-severe group (p<0.05).

Fig 5.

Fig 5

Performance during training. Each maker presents the group mean for a block (30 trials) of training data. A) Group average movement times over training indicate movement times plateaued on day 3 of training (i.e. no significant difference between days 3–4). B) Mean group error rates showed no change over the course of training. Error bars present SEM.

In contrast, error rates did not differ with training (mixed-design ANOVA, no effect of day, F1,3=0.73, p=0.54), or across groups (no main effect of group, F2,27=1.94, p=0.16, and no day × group interaction, F2,6=0.68, p=0.67). Planned comparisons between subsequent days indicated no differences in error rates (all t<1.8). Planned between-group comparisons indicated no significant differences in error rates between healthy controls and patients with mild-to-moderate impairment (p=0.86), the healthy controls and the moderate-to-severe group (p=0.12), or the mild-to-moderate and the moderate-to-severe groups (p=0.08).

Discussion

The present study examined the ability of chronic stroke patients to learn a motor task with their paretic arm, comparing their performance with healthy controls. We controlled for changes in performance attributable to moving along baseline speed-accuracy trade-off functions (e.g. improving accuracy by decreasing speed) by assessing performance at fixed trial durations in skill assessments. Pre-training assessments indicated all three groups had different SAFs, with greater impairment associated with an inferior SAF. All groups improved their performance with training as evidenced by shifts in the SAF, however, post-training comparisons still indicated clear between-group differences in performance. More detailed trial-level measures identified that all groups improved their performance in the same manner; by reducing the endpoint error and variability of their movements. A resampling analysis indicated that trained patients were able to match the untrained baseline performance of patients with lesser impairment. Critically, data from training indicated that trained patients had reached a plateau in their performance. Therefore, despite their matched performance, a categorical difference remained between these groups; the untrained groups could make large, rapid improvements with training that the trained groups could not.

The present study operationalized skill as a speed-accuracy trade-off function1319. During training participants improved their speed in completing the task; during skill assessments, where trial duration was fixed, this translated to increased accuracy after training. Comparisons of performance across training indicate participants reached a performance plateau during the study (large reductions in trial durations between days 1–2, smaller changes from days 2–3 of training, and no differences between days 3–4). This plateau is consistent with previous studies that have found training leads to initial rapid gains in performance, but that as participants gain experience with a task further training only leads to smaller, gradual improvements29,30. The level of performance at which this plateau in learning occurred was affected by the severity of motor impairment; healthy controls reached a plateau with a greater level of performance than mild-to-moderate stroke patients, who in turn reached a plateau with a greater level of performance than moderate-to-severe patients. Notably, the post-training performance of the moderate-to-severe group did not differ from pre-training performance of the mild-to-moderate group (see overlapping dark red and light blue distributions in Fig 3C), and the post-training performance of the mild-to-moderate group did not differ from the pre-training performance of healthy controls (see overlapping dark blue and light yellow distributions from Fig 3C). From this it could be argued that training led the moderate-to-severe group to be equal to the mild-to-moderate group, and that further training would allow both groups to reach the same level of performance as healthy controls. However, the trained patients had reached a performance plateau by day three of the study, whereby further training had a negligible effect on performance. In contrast, the groups that had not yet trained still had the capacity to make rapid improvements through motor learning. This categorical difference between the trained and untrained groups indicates that training to acquire the same level of performance as a group with less impairment does not make the groups equivalent. This is because the mechanisms underlying performance – being impaired and acquiring skill as opposed to having less impairment – are not the same.

Baseline performance differences across impairment levels prevent comparisons of the amount learned by one group versus another. In our view such analyses are conceptually fraught. For example, assessing performance changes using the difference between baseline and post-training performance would suggest all groups learned to an equal extent – in contrast, calculating the percentage change from the baseline would suggest patients with moderate-to-severe impairment learned more. Thus, arbitrary model selection could lead to differing results28. Furthermore, there is considerable evidence that the relationship between training and performance is non-linear; as people become increasingly skilled they require more training to achieve small gains in performance31. Here we avoided this conceptual pitfall by comparing absolute levels of performance, rather than normalized changes. We conclude that all groups improved their performance of the task through skill acquisition, but the final level of performance each group achieved was still affected by their motor impairment.

The task-level measure used in skill assessments examined performance with a binary metric, insensitive to more subtle improvements in performance. Trial-level analyses revealed improvements in endpoint precision and variability following training; such improved quality of control is typically observed in skill acquisition20,3235. However, despite this improvement in movement control the patients’ performance still remained proportional to the severity of their impairment. This suggests that chronic patients can learn and improve control within a task36, but this is not necessarily enough to change more coarse (i.e. task-level success/failure) measures of performance.

Strengths and Limitations

The present study employed principles developed using an established laboratory-based skill task to study motor learning in stroke. Modifying this task to use the elbow flexor muscles (as opposed to the hand) allowed the inclusion of patients with a wide range of neurological impairment. Controlling for differences in the speed-accuracy trade-off also allowed separation of changes in skill from changes in the way the task was performed (i.e. prevented participants from slowing down to increase their accuracy). Furthermore, distinguishing between task-level success and more detailed trial-level metrics is an important advance for studying motor control in stroke, and for the interpretation of results of this task. Here, trial-level metrics revealed increases in endpoint precision/decreases in variability that drive changes in task-level measures of success or failure. Such two-tier analysis allows a greater depth of interpretation of how motor learning changes performance.

The present study used an established laboratory-based paradigm to conduct a finely controlled investigation of motor learning capacity in both chronic stroke patients and healthy controls. Notably, the primary goal of the task was to assay motor learning, rather than to approximate functional relevance. However, we anticipate that the skill learning processes studied here would also apply to the learning of more ecologically relevant tasks.

Our patient sample spanned a wide range of impairment, including two patients with ueFMS of 66/66. It could be argued that the inclusion of patients with ‘no impairment’ may compromise the study. In contrast, we view this as a strength of the present investigation, as it allowed us to study motor learning in patients with a full range of impairment (i.e. a ueFMS of 66/66 does not rule out impairments in learning). Secondly, the resampling analysis included randomly generated samples in which these patients were both present and completely absent, indicating that their inclusion did not change the empirical result of the study.

The present result examined motor learning over a relatively short (four day) period. This was sufficient to show that a patient can train to match the performance of an untrained individual with less impairment. Even if sub-threshold changes in performance occurred beyond the plateau identified on days 3–4, the small magnitude of such changes is consistent with our central point; an untrained patient can make rapid and significant improvements in comparison to a trained patient. It could be proposed that training over several months or years could lead to greater improvements, and that the brain may still be undergoing training-induced changes. That said, longer studies based on motor learning principles have shown limited impact in chronic stroke3740. In contrast to the relatively static levels of impairment seen in chronic stroke, there is evidence that spontaneous biological recovery early after stroke can lead to substantial improvements in patient’s neurological motor function4145. Recent evidence in a mouse model indicates that initiating training during the period early, but not later, after stroke leads to a greater improvements than would be expected through spontaneous biological recovery alone46. Future investigations will determine whether training early after stroke can be similarly beneficial in humans4749.

Clinical Implications

Models of motor rehabilitation propose that motor recovery following stroke is a form of relearning3,4. Our results indicate that motor learning allows stroke patients with a wide range of impairment to improve their performance of a trained task with their affected arm. Patients improved in the same manner as healthy controls (i.e. through learning to control the cursor with increased precision/reduced variability), indicating the same behavioral processes underlie improved performance in all groups. This illustrates that as long as a patient can perform a task at baseline, they should have a capacity to improve at the task with training. However, despite a preserved ability to learn through motor training, the overall level of performance patients were able to achieve was still affected by their motor impairment. This indicates that studies in patients with chronic stroke should focus on training functionally relevant tasks to the limit allowed by impairment, and/or on teaching compensatory strategies50.

Previous imaging work has indicated that chronic stroke patients may achieve levels of performance that match healthy individuals, yet differing neural networks underlie this performance8. We have previously argued that such differences complicate decisions regarding capacity to return to work and other activities9, and can affect decision making when focusing the target of rehabilitation interventions. Results of the present study indicate that the acquisition of motor skill can lead to similar problems in assessing the capabilities of patients. A patient who has trained on a task on which they are assessed may have performance equal to that of an individual with lesser impairment. However, this does not mean that these patients are now equal, as evidenced by the difference in their abilities to improve with training. This should be considered when determining the rehabilitation activities they should focus on, and taken into account when assessing a patient’s ability to return to work and other activities9.

Conclusions

In conclusion, we compared the effects of motor training in healthy individuals and chronic stroke patients with different levels of impairment. We controlled for the performance confound (i.e. reducing speed to improve accuracy) by assessing performance at fixed trial durations, allowing detection of changes in motor skill (i.e. shifts in the speed-accuracy trade-off). Patients improved their performance through skill acquisition in a manner analogous to healthy controls (i.e. increased precision/reduced variability). Training improved patient performance to the same level as the untrained baseline of a group with less impairment. However, over the course of the training sessions each group reached a performance plateau whereby more practice did not lead to further improvement. Our results indicate that chronic stroke patients can improve the control of their paretic arm through motor learning, yet remain categorically different to untrained individuals who have the same level of performance but with lesser impairment.

Supplementary Material

Acknowledgments

Grant Support: NIH grant R01HD073147.

Footnotes

Disclosures: None

References

  • 1.Richards L, Pohl P. Therapeutic interventions to improve upper extremity recovery and function. Clin Geriatr Med. 1999;15:819–32. [PubMed] [Google Scholar]
  • 2.Organization WH. International Classification of Functioning, and Disability Health (ICF) 2010 [Google Scholar]
  • 3.Carr JH, Shepherd RB. A Motor Learning Model for Stroke Rehabilitation. Physiotherapy. 1989;75:372–380. [Google Scholar]
  • 4.Horak FB. Assumptions Underlying Motor Control for Neurologic Rehabilitation. In: Lister M, editor. Contemporary management of motor control problems. Proceedings of the II STEP conference. Alexandria, VA: Foundations for Physical Therapy; 1991. pp. 11–27. [Google Scholar]
  • 5.Rehme AK, Eickhoff SB, Rottschy C, Fink GR, Grefkes C. Activation likelihood estimation meta-analysis of motor-related neural activity after stroke. Neuroimage. 2012;59:2771–82. doi: 10.1016/j.neuroimage.2011.10.023. [DOI] [PubMed] [Google Scholar]
  • 6.Hardwick RM, Rottschy C, Miall RC, Eickhoff SB. A quantitative meta-analysis and review of motor learning in the human brain. Neuroimage. 2013;67:283–97. doi: 10.1016/j.neuroimage.2012.11.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Hardwick RM, Lesage E, Eickhoff CR, Clos M, Fox P, Eickhoff SB. Multimodal connectivity of motor learning-related dorsal premotor cortex. Neuroimage. 2015;123:114–28. doi: 10.1016/j.neuroimage.2015.08.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Sharma N, Baron J-C, Rowe JB. Motor imagery after stroke: relating outcome to motor network connectivity. Ann Neurol. 2009;66:604–16. doi: 10.1002/ana.21810. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Celnik P, Hillis AE. Reconnecting the dots after stroke. Ann Neurol. 2009;66:570–1. doi: 10.1002/ana.21811. [DOI] [PubMed] [Google Scholar]
  • 10.Turnbull GI, Charteris J, Wall JC. A comparison of the range of walking speeds between normal and hemiplegic subjects. Scand J Rehabil Med. 1995;27:175–82. [PubMed] [Google Scholar]
  • 11.Fitts PM. The information capacity of the human motor system in controlling the amplitude of movement. J Exp Psychol. 1954;47:381–91. [PubMed] [Google Scholar]
  • 12.Platz T, Denzler P, Kaden B, Mauritz KH. Motor learning after recovery from hemiparesis. Neuropsychologia. 1994;32:1209–23. doi: 10.1016/0028-3932(94)90103-1. [DOI] [PubMed] [Google Scholar]
  • 13.Reis J, Schambra HM, Cohen LG, et al. Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc Natl Acad Sci U S A. 2009;106:1590–5. doi: 10.1073/pnas.0805413106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Cantarero G, Tang B, O’Malley R, Salas R, Celnik P. Motor learning interference is proportional to occlusion of LTP-like plasticity. J Neurosci. 2013;33:4634–41. doi: 10.1523/JNEUROSCI.4706-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Cantarero G, Lloyd A, Celnik P. Reversal of long-term potentiation-like plasticity processes after motor learning disrupts skill retention. J Neurosci. 2013;33:12862–9. doi: 10.1523/JNEUROSCI.1399-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Reis J, Fischer JT, Prichard G, Weiller C, Cohen LG, Fritsch B. Time- but Not Sleep- Dependent Consolidation of tDCS-Enhanced Visuomotor Skills. Cereb Cortex. 2015;25:109–17. doi: 10.1093/cercor/bht208. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Schambra HM, Abe M, Luckenbaugh DA, Reis J, Krakauer JW, Cohen LG. Probing for hemispheric specialization for motor skill learning: a transcranial direct current stimulation study. J Neurophysiol. 2011;106:652–61. doi: 10.1152/jn.00210.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Wymbs NF, Bastian AJ, Celnik PA. Motor Skills Are Strengthened through Reconsolidation. Curr Biol. 2016;26:338–343. doi: 10.1016/j.cub.2015.11.066. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Saucedo Marquez CM, Zhang X, Swinnen SP, Meesen R, Wenderoth N. Task-specific effect of transcranial direct current stimulation on motor learning. Front Hum Neurosci. 2013;7:333. doi: 10.3389/fnhum.2013.00333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Shmuelof L, Krakauer JW, Mazzoni P. How is a motor skill learned? Change and invariance at the levels of task success and trajectory control. J Neurophysiol. 2012;108:578–94. doi: 10.1152/jn.00856.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
  • 22.Fugl-Meyer AR, Jääskö L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med. 1975;7:13–31. [PubMed] [Google Scholar]
  • 23.Cirstea MC, Ptito A, Levin MF. Arm reaching improvements with short-term practice depend on the severity of the motor deficit in stroke. Exp brain Res. 2003;152:476–88. doi: 10.1007/s00221-003-1568-4. [DOI] [PubMed] [Google Scholar]
  • 24.Ellis MD, Sukal-Moulton TM, Dewald JPA. Impairment-Based 3-D Robotic Intervention Improves Upper Extremity Work Area in Chronic Stroke: Targeting Abnormal Joint Torque Coupling With Progressive Shoulder Abduction Loading. IEEE Trans Robot. 2009;25:549–555. doi: 10.1109/TRO.2009.2017111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Scott SH. Apparatus for measuring and perturbing shoulder and elbow joint positions and torques during reaching. J Neurosci Methods. 1999;89:119–27. doi: 10.1016/s0165-0270(99)00053-9. [DOI] [PubMed] [Google Scholar]
  • 26.Charles SK, Okamura AM, Bastian AJ. Does a basic deficit in force control underlie cerebellar ataxia? J Neurophysiol. 2013;109:1107–16. doi: 10.1152/jn.00152.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Hardwick RM, Celnik PA. Cerebellar direct current stimulation enhances motor learning in older adults. Neurobiol Aging. 2014;35:2217–21. doi: 10.1016/j.neurobiolaging.2014.03.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Kitago T, Krakauer JW. Motor learning principles for neurorehabilitation. Handb Clin Neurol. 2013;110:93–103. doi: 10.1016/B978-0-444-52901-5.00008-3. [DOI] [PubMed] [Google Scholar]
  • 29.Newell A, Rosenbloom PS. Mechanisms of skill acquisition and the law of practice. Cogn Ski their Acquis. 1981;6:1–55. [Google Scholar]
  • 30.Heathcote A, Brown S, Mewhort DJ. The power law repealed: the case for an exponential law of practice. Psychon Bull Rev. 2000;7:185–207. doi: 10.3758/bf03212979. [DOI] [PubMed] [Google Scholar]
  • 31.Wymbs NF, Grafton ST. The Human Motor System Supports Sequence-Specific Representations over Multiple Training-Dependent Timescales. Cereb Cortex. 2015;25:4213–25. doi: 10.1093/cercor/bhu144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Barden JM, Balyk R, James Raso V, Moreau M, Bagnall K. Repetitive pointing to remembered proprioceptive targets improves 3D hand positioning accuracy. Hum Mov Sci. 2005;24:184–205. doi: 10.1016/j.humov.2005.03.004. [DOI] [PubMed] [Google Scholar]
  • 33.Madeleine P, Madsen TMT. Changes in the amount and structure of motor variability during a deboning process are associated with work experience and neck-shoulder discomfort. Appl Ergon. 2009;40:887–94. doi: 10.1016/j.apergo.2008.12.006. [DOI] [PubMed] [Google Scholar]
  • 34.Müller H, Sternad D. Motor learning: changes in the structure of variability in a redundant task. Adv Exp Med Biol. 2009;629:439–56. doi: 10.1007/978-0-387-77064-2_23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Scholz JP, Schöner G. The uncontrolled manifold concept: identifying control variables for a functional task. Exp brain Res. 1999;126:289–306. doi: 10.1007/s002210050738. [DOI] [PubMed] [Google Scholar]
  • 36.Winstein CJ, Merians AS, Sullivan KJ. Motor learning after unilateral brain damage. Neuropsychologia. 1999;37:975–87. doi: 10.1016/s0028-3932(98)00145-6. [DOI] [PubMed] [Google Scholar]
  • 37.Lo AC, Guarino PD, Richards LG, et al. Robot-assisted therapy for long-term upper-limb impairment after stroke. N Engl J Med. 2010;362:1772–83. doi: 10.1056/NEJMoa0911341. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Kitago T, Goldsmith J, Harran M, et al. Robotic therapy for chronic stroke: general recovery of impairment or improved task-specific skill? J Neurophysiol. 2015 doi: 10.1152/jn.00336.2015. jn.00336.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Lang KC, Thompson PA, Wolf SL. The EXCITE Trial: reacquiring upper-extremity task performance with early versus late delivery of constraint therapy. Neurorehabil Neural Repair. 2013;27:654–63. doi: 10.1177/1545968313481281. [DOI] [PubMed] [Google Scholar]
  • 40.Kitago T, Liang J, Huang VS, et al. Improvement after constraint-induced movement therapy: recovery of normal motor control or task-specific compensation? Neurorehabil Neural Repair. 2013;27:99–109. doi: 10.1177/1545968312452631. [DOI] [PubMed] [Google Scholar]
  • 41.Prabhakaran S, Zarahn E, Riley C, et al. Inter-individual variability in the capacity for motor recovery after ischemic stroke. Neurorehabil Neural Repair. 2008;22:64–71. doi: 10.1177/1545968307305302. [DOI] [PubMed] [Google Scholar]
  • 42.Cramer SC. Repairing the human brain after stroke: I. Mechanisms of spontaneous recovery. Ann Neurol. 2008;63:272–87. doi: 10.1002/ana.21393. [DOI] [PubMed] [Google Scholar]
  • 43.Jørgensen HS, Nakayama H, Raaschou HO, Olsen TS. Stroke. Neurologic and functional recovery the Copenhagen Stroke Study. Phys Med Rehabil Clin N Am. 1999;10:887–906. [PubMed] [Google Scholar]
  • 44.Hankey GJ, Spiesser J, Hakimi Z, Bego G, Carita P, Gabriel S. Rate, degree, and predictors of recovery from disability following ischemic stroke. Neurology. 2007;68:1583–7. doi: 10.1212/01.wnl.0000260967.77422.97. [DOI] [PubMed] [Google Scholar]
  • 45.Duncan PW, Goldstein LB, Matchar D, Divine GW, Feussner J. Measurement of motor recovery after stroke. Outcome assessment and sample size requirements. Stroke. 1992;23:1084–9. doi: 10.1161/01.str.23.8.1084. [DOI] [PubMed] [Google Scholar]
  • 46.Zeiler SR, Hubbard R, Gibson EM, et al. Paradoxical Motor Recovery From a First Stroke After Induction of a Second Stroke: Reopening a Postischemic Sensitive Period. Neurorehabil Neural Repair. 2015 doi: 10.1177/1545968315624783. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Zeiler SR, Krakauer JW. The interaction between training and plasticity in the poststroke brain. Curr Opin Neurol. 2013;26:609–16. doi: 10.1097/WCO.0000000000000025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Stinear CM, Byblow WD. Predicting and accelerating motor recovery after stroke. Curr Opin Neurol. 2014;27:624–30. doi: 10.1097/WCO.0000000000000153. [DOI] [PubMed] [Google Scholar]
  • 49.Hardwick RM, Celnik PA. Non-invasive Brain Stimulation in Physical Medicine and Rehabilitation. Curr Phys Med Rehabil Reports. 2014;2:300–309. [Google Scholar]
  • 50.van Kordelaar J, van Wegen EEH, Nijland RHM, Daffertshofer A, Kwakkel G. Understanding adaptive motor control of the paretic upper limb early poststroke: the EXPLICIT-stroke program. Neurorehabil Neural Repair. 2013;27:854–63. doi: 10.1177/1545968313496327. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

RESOURCES