Summary
In ball sports, we are taught to follow through, despite the inability of events after contact or release to influence the outcome [1, 2]. Here we show that the specific motor memory active at any given moment critically depends on the movement that will be made in the near future. We demonstrate that associating a different follow-through movement with two motor skills that normally interfere [3–7] allows them to be learned simultaneously, suggesting that distinct future actions activate separate motor memories. This implies that when learning a skill, a variable follow-through would activate multiple motor memories across practice, whereas a consistent follow-through would activate a single motor memory, resulting in faster learning. We confirm this prediction and show that such follow-through effects influence adaptation over time periods associated with real-world skill learning. Overall, our results indicate that movements made in the immediate future influence the current active motor memory. This suggests that there is a critical time period both before [8] and after the current movement that determines motor memory activation and controls learning.
Highlights
-
•
Future movements determine which motor memory is currently active and modifiable
-
•
Skills that otherwise interfere can be learned if each has a unique follow-through
-
•
A single skill is learned faster if its follow-through is consistent
-
•
Selection of motor memories depends on both lead-in and follow-through movements
For a motor skill to be learned, its motor memory must be stored, protected from interference, and reactivated for modification during practice. Howard et al. demonstrate that future movement determines which motor memory is currently active and that a consistent follow-through constrains skill acquisition to a single memory, thereby speeding up learning.
Results and Discussion
For a motor skill to be learned over a prolonged period of time, the motor memory of the skill must be stored, protected from interference by intervening tasks, and reactivated for modification when the skill is practiced. Given the widespread notion of the importance of a consistent follow-through in many sports [1, 2], here we examine whether the currently active motor memory might depend on the movement that we are going to make in the near future. We examine a motor skill that is known to be long lasting but also subject to interference—learning to reach in the presence of a dynamic (force-field) perturbation generated on the hand by a robotic interface [4, 9]. When two force fields that act in opposing directions are presented alternately, there is substantial interference, preventing learning of either [4–7]. We first examined whether linking such skills that interfere to different follow-through movements might activate separate motor memories for each, thereby allowing both skills to be learned without interference.
Participants grasped the handle of a robotic interface (Figure S1) and made a reaching movement (in one of four directions) through a perturbing force field to a central target, followed immediately by a second unperturbed, follow-through movement to one of two possible final targets (Figure 1A, follow-through; see the Supplemental Experimental Procedures for full details). The field direction (clockwise or counter-clockwise) was randomly selected on each trial but was uniquely specified by the target (present throughout the trial) to which the follow-through movement would be made (association of force-field direction and follow-through movement was counter-balanced across participants). So that predictive force compensation could be assessed independently from co-contraction, channel trials [10, 11], in which the movement was confined to a simulated mechanical channel from the starting to central target, were randomly applied throughout the experiment. Participants performed 75 blocks of 18 trials each in the force field, and to examine learning, we compared differences in the kinematic error and force compensation between the first four blocks and final four blocks in the exposure phase using an ANOVA with a main factor of epoch (two levels) and random factor of participant (eight levels). We found both a significant reduction in kinematic error (Figure 1B, brown; F1,7 = 16.8; p = 0.005; hand paths shown in Figure S2A) and increase in force compensation (Figure 1C, brown; F1,7 = 17.706; p = 0.004) reaching around 40% of full compensation over a session. In contrast, when a second group of participants were presented with the final target, which again was predictive of the field direction, but did not follow-through to the target (Figure 1A, no follow-through), there was substantial interference between the motor skills, as expected [8, 12, 13]. Although we observed a small reduction in kinematic error in this group (Figure 1B, blue; F1,7 = 12.371; p = 0.01; hand paths shown in Figure S2B) there was no significant increase in force compensation (Figure 1C, blue; F1,7 = 0.434; p = 0.531), suggesting that participants solely used non-specific co-contraction to reduce their error [14–16]. Finally, we contrasted the adaptation in the two groups of subjects using an ANOVA with epoch (two levels) and group (follow-through or no follow-through). There was a significant interaction effect for both kinematic error (F1,124 = 7.388; p = 0.08) and force compensation (F1,124 = 21.55; p < 0.001), indicating that interference was strongly reduced in the follow-through group.
These results show that (despite the unperturbed kinematics of the movements to the central target being similar for both final targets; Table S1), when a follow-through movement is made that is predictive of the field direction, there is substantial reduction in interference. This suggests that different follow-throughs may activate distinct motor memories. Therefore, during skill learning on a single task, identical future movements on each trial (i.e., consistent follow-through) may access a single motor memory. In contrast, a variable follow-through may access multiple motor memories across trials, with any learning being spread across multiple memories, leading to a decrease in the speed of skill acquisition.
We tested this prediction in two groups who experienced a single force field whose direction was fixed across all trials. Both groups made a movement in the force field to a central target followed by an unperturbed follow-through movement to a final target (Figure 2A). For one group, the follow-through movement was always made to the same target (consistent follow-through), whereas the other group made a follow-through movement on each trial to a randomly selected target from nine possible locations (variable follow-through). The direction of the force-field and follow-through movements was counter-balanced across participants. Importantly, the kinematics (and variability) of unperturbed movements to the central target were not significantly different between the two groups (Table S2), and there was no difference in the initial errors in the force field between the two groups (ANOVA on maximum perpendicular error of the first two exposure trials with a main factor of experimental group: F1,46 = 0.801; p = 0.375). However, significantly faster learning was observed for the consistent, compared to the variable, follow-through group for both kinematic error (Figure 2B; F1,5940 = 155.041; p < 0.001) and force compensation (Figure 2C; F1,660 = 3.921; p = 0.048) as shown using an ANOVA across all exposure trials with the main effects of experimental group and trial number. The same analysis, performed on the first one-third of the exposure trials, showed significantly faster learning for the consistent compared to the variable follow-through group for both kinematic error (F1,1980 = 93.171; p < 0.001) and force compensation (F1,220 = 9.057; p = 0.003). By the end of the session, there were no significant differences in either the kinematic error (F1,94 = 1.668; p = 0.2) or force compensation (F1,94 = 0.163; p = 0.687) (ANOVA on the last four trials with the main effect of experimental group), showing that both groups eventually learned the same amount for this simple skill.
We used a dual-rate model to examine whether changes in the parameters that govern learning might account for the differences that we observed in skill acquisition rate, but not final level of learning. The time course of learning novel dynamics is well accounted for by two interacting processes: a fast process that adapts and decays quickly and a slower process that adapts and decays more gradually [17]. Each process is characterized by a learning rate that controls how strongly the motor memory is updated based on errors and a retention factor determining the movement-to-movement retention of the motor memory. We fit this dual-rate model to our participants’ learning (model is fit to the group-averaged data; Figure 2C, thick lines), and this showed that the differences between the groups was primarily due to the retention factor of the fast process (Figure 2D; Afast p < 0.001 between groups, other parameters non-significant), suggesting that variable follow-through leads to decreased retention across trials [18].
Could our results on simple force-field learning over the course of an experimental session apply to real-world learning taking place over much more extended periods? In real-world tasks, such as a tennis or golf stroke, the lead-in to the movement is critical for task success, as it will determine characteristics such as variability at contact [19, 20]. Moreover, the recent past has been shown to also affect the selection of the current motor memory [8]. We examined the extent to which two motor skills, opposing force fields, could be simultaneously learned when the skill being currently experienced depended on a nonlinear combination of the past (lead-in) and future (follow-through) movements.
Participants made movements from two possible starting locations (Figure 3A; S1 or S2) through two via points (V1 and V2) to one of two possible target locations (T1 or T2). A force field was applied between the via points whose direction on each trial was uniquely specified, according to an exclusive-or (XOR) rule, by the starting and target locations used on that trial (Figure 3A). Critically, the direction of the force field could not be predicted based on either the start location or the target location alone, but rather depended on both the start and final locations in a non-linear manner. The direction of the force field relative to the movements was counter-balanced across participants. Participants performed 240 blocks of 26 trials over 5 days, and to examine learning, we compared differences in the kinematic error and force compensation for the first four blocks and final four blocks in the force field using an ANOVA with a main factor of epoch (two levels) and random factor of participants (six levels). This was a surprisingly hard task to learn, and over the 5 days of practice, participants showed both a strong and gradual reduction in error (Figure 3B; F1,5 = 36.750; p = 0.002) and increase in force compensation (Figure 3C; F1,5 = 61.981; p = 0.001) to around 50%. Participants learned to access the motor memories based on the nonlinear rule as shown by the force compensation being of the appropriate sign for all four possible movements (Figures 3D and S3), with the largest variance in the data accounted for by an XOR rule (Figure 3E). These results demonstrate that participants can utilize both past and future movements to produce a nonlinear separation of motor memories. This shows that the temporal events in close proximity to a movement, both before and after, are critical in determining the motor memory in which the skill is stored. Moreover, even for a relatively simple skill, such as force-field learning (compared to a tennis or golf stroke), the learning is slowly acquired over time courses on the order of real-world skill learning and is highly dependent on both the lead-in and follow-through. Although we have focused on learning simple force fields in constrained arm movements, previous work suggests that the mechanisms underlying such learning generalize to whole-body movement such as posture [21] and walking [22–24], as well as other more naturalistic movements [25].
Previous studies have examined a range of contextual cues that might allow the separation of motor memories. While static cues (e.g., color) have a very limited ability to separate motor memories [12, 13], dynamic moving cues [13, 26], different concurrent motion of the other arm [27–29], or the lead-in to a movement [8, 30] often have a substantial effect. Moreover, separating the location of learning either proprioceptively or visually facilitates learning of opposing force fields [13, 31, 32]. Models of such contextual effects in the motor system posit that they arise from the engagement of separate neural populations, e.g., [27]. Since it known that that future motor planning affects neural activity [33], it seems likely that the follow-through effect that we report either directly engages the separate neural populations that leads to the generation of movement or does so by affecting the initial state of the dynamical systems of neurons in the motor system that control movement [34].
Although we have shown that consistent follow-through leads to faster learning through selection of a single memory, this does not preclude other potential advantages of the follow-though, such as injury reduction or other biomechanical advantages [2]. Although several contextual cues have previously been shown to reduce interference [13, 26, 27, 29, 30, 32, 35, 36], our study is the first to show that different follow-through movements can reduce interference substantially, demonstrating the importance of future motor events in controlling current motor learning. Our findings suggest that distinct follow-throughs associated with different motor skills, such as different tennis strokes, will help maintain these skills in separate motor memories, thereby protecting them from interference when learning other skills. Moreover, even for a single skill, maintaining a consistent follow-through will speed up learning. An intriguing question is why a particular follow-through might be preferred when learning a skill. Our results suggest that variability in the follow-through, which might arise from planning variability [37], motor noise [19, 20, 38], or other sources of variability [39], would lead to a reduction in the speed of skill acquisition. Therefore, it may be optimal to choose the follow-through for a skill that can be executed with the minimum variability.
Author Contributions
I.S.H., D.M.W., and D.W.F. designed the study. I.S.H. ran the experiments. I.S.H., D.M.W., and D.W.F. performed the data analysis. I.S.H., D.M.W., and D.W.F. wrote the paper.
Acknowledgments
We thank the Wellcome Trust (WT091547MA and WT097803MA), Human Frontier Science Program, Plymouth University, and Royal Society (Noreen Murray Professorship in Neurobiology to D.M.W.) for support. We thank Sae Franklin and Christopher Ford for their assistance with running the experiments and Amy Bastian for comments on the manuscript.
Footnotes
This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Contributor Information
Ian S. Howard, Email: ian.howard@plymouth.ac.uk.
David W. Franklin, Email: dwf25@cam.ac.uk.
Supplemental Information
References
- 1.Karageanes S.J., Scher S. Baseball. In: Karageanes S.J., editor. Principles of Manual Sports Medicine. Lippincott Williams & Wilkins; 2005. pp. 453–464. [Google Scholar]
- 2.Knudson D., Elliott B. Biomechanics of tennis stroke. In: Hung G.K., Pallis J.M., editors. Biomedical Engineering Principles in Sports. Kluwer Academic; 2004. pp. 153–181. [Google Scholar]
- 3.Shadmehr R., Holcomb H.H. Neural correlates of motor memory consolidation. Science. 1997;277:821–825. doi: 10.1126/science.277.5327.821. [DOI] [PubMed] [Google Scholar]
- 4.Brashers-Krug T., Shadmehr R., Bizzi E. Consolidation in human motor memory. Nature. 1996;382:252–255. doi: 10.1038/382252a0. [DOI] [PubMed] [Google Scholar]
- 5.Caithness G., Osu R., Bays P., Chase H., Klassen J., Kawato M., Wolpert D.M., Flanagan J.R. Failure to consolidate the consolidation theory of learning for sensorimotor adaptation tasks. J. Neurosci. 2004;24:8662–8671. doi: 10.1523/JNEUROSCI.2214-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Karniel A., Mussa-Ivaldi F.A. Does the motor control system use multiple models and context switching to cope with a variable environment? Exp. Brain Res. 2002;143:520–524. doi: 10.1007/s00221-002-1054-4. [DOI] [PubMed] [Google Scholar]
- 7.Krakauer J.W., Ghilardi M.F., Ghez C. Independent learning of internal models for kinematic and dynamic control of reaching. Nat. Neurosci. 1999;2:1026–1031. doi: 10.1038/14826. [DOI] [PubMed] [Google Scholar]
- 8.Howard I.S., Ingram J.N., Franklin D.W., Wolpert D.M. Gone in 0.6 seconds: the encoding of motor memories depends on recent sensorimotor states. J. Neurosci. 2012;32:12756–12768. doi: 10.1523/JNEUROSCI.5909-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Shadmehr R., Brashers-Krug T. Functional stages in the formation of human long-term motor memory. J. Neurosci. 1997;17:409–419. doi: 10.1523/JNEUROSCI.17-01-00409.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Scheidt R.A., Reinkensmeyer D.J., Conditt M.A., Rymer W.Z., Mussa-Ivaldi F.A. Persistence of motor adaptation during constrained, multi-joint, arm movements. J. Neurophysiol. 2000;84:853–862. doi: 10.1152/jn.2000.84.2.853. [DOI] [PubMed] [Google Scholar]
- 11.Milner T.E., Franklin D.W. Impedance control and internal model use during the initial stage of adaptation to novel dynamics in humans. J. Physiol. 2005;567:651–664. doi: 10.1113/jphysiol.2005.090449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Gandolfo F., Mussa-Ivaldi F.A., Bizzi E. Motor learning by field approximation. Proc. Natl. Acad. Sci. USA. 1996;93:3843–3846. doi: 10.1073/pnas.93.9.3843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Howard I.S., Wolpert D.M., Franklin D.W. The effect of contextual cues on the encoding of motor memories. J. Neurophysiol. 2013;109:2632–2644. doi: 10.1152/jn.00773.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Burdet E., Osu R., Franklin D.W., Milner T.E., Kawato M. The central nervous system stabilizes unstable dynamics by learning optimal impedance. Nature. 2001;414:446–449. doi: 10.1038/35106566. [DOI] [PubMed] [Google Scholar]
- 15.Osu R., Franklin D.W., Kato H., Gomi H., Domen K., Yoshioka T., Kawato M. Short- and long-term changes in joint co-contraction associated with motor learning as revealed from surface EMG. J. Neurophysiol. 2002;88:991–1004. doi: 10.1152/jn.2002.88.2.991. [DOI] [PubMed] [Google Scholar]
- 16.Franklin D.W., Osu R., Burdet E., Kawato M., Milner T.E. Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model. J. Neurophysiol. 2003;90:3270–3282. doi: 10.1152/jn.01112.2002. [DOI] [PubMed] [Google Scholar]
- 17.Smith M.A., Ghazizadeh A., Shadmehr R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol. 2006;4:e179. doi: 10.1371/journal.pbio.0040179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ingram J.N., Flanagan J.R., Wolpert D.M. Context-dependent decay of motor memories during skill acquisition. Curr. Biol. 2013;23:1107–1112. doi: 10.1016/j.cub.2013.04.079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Harris C.M., Wolpert D.M. Signal-dependent noise determines motor planning. Nature. 1998;394:780–784. doi: 10.1038/29528. [DOI] [PubMed] [Google Scholar]
- 20.Todorov E., Jordan M.I. Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 2002;5:1226–1235. doi: 10.1038/nn963. [DOI] [PubMed] [Google Scholar]
- 21.Ahmed A.A., Wolpert D.M. Transfer of dynamic learning across postures. J. Neurophysiol. 2009;102:2816–2824. doi: 10.1152/jn.00532.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Emken J.L., Benitez R., Sideris A., Bobrow J.E., Reinkensmeyer D.J. Motor adaptation as a greedy optimization of error and effort. J. Neurophysiol. 2007;97:3997–4006. doi: 10.1152/jn.01095.2006. [DOI] [PubMed] [Google Scholar]
- 23.Finley J.M., Bastian A.J., Gottschall J.S. Learning to be economical: the energy cost of walking tracks motor adaptation. J. Physiol. 2013;591:1081–1095. doi: 10.1113/jphysiol.2012.245506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Torres-Oviedo G., Bastian A.J. Natural error patterns enable transfer of motor learning to novel contexts. J. Neurophysiol. 2012;107:346–356. doi: 10.1152/jn.00570.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ingram J.N., Wolpert D.M. Naturalistic approaches to sensorimotor control. Prog. Brain Res. 2011;191:3–29. doi: 10.1016/B978-0-444-53752-2.00016-3. [DOI] [PubMed] [Google Scholar]
- 26.Cothros N., Wong J., Gribble P.L. Visual cues signaling object grasp reduce interference in motor learning. J. Neurophysiol. 2009;102:2112–2120. doi: 10.1152/jn.00493.2009. [DOI] [PubMed] [Google Scholar]
- 27.Nozaki D., Kurtzer I., Scott S.H. Limited transfer of learning between unimanual and bimanual skills within the same limb. Nat. Neurosci. 2006;9:1364–1366. doi: 10.1038/nn1785. [DOI] [PubMed] [Google Scholar]
- 28.Howard I.S., Ingram J.N., Wolpert D.M. Context-dependent partitioning of motor learning in bimanual movements. J. Neurophysiol. 2010;104:2082–2091. doi: 10.1152/jn.00299.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Yokoi A., Hirashima M., Nozaki D. Gain field encoding of the kinematics of both arms in the internal model enables flexible bimanual action. J. Neurosci. 2011;31:17058–17068. doi: 10.1523/JNEUROSCI.2982-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wainscott S.K., Donchin O., Shadmehr R. Internal models and contextual cues: encoding serial order and direction of movement. J. Neurophysiol. 2005;93:786–800. doi: 10.1152/jn.00240.2004. [DOI] [PubMed] [Google Scholar]
- 31.Hwang E.J., Smith M.A., Shadmehr R. Dissociable effects of the implicit and explicit memory systems on learning control of reaching. Exp. Brain Res. 2006;173:425–437. doi: 10.1007/s00221-006-0391-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Hirashima M., Nozaki D. Distinct motor plans form and retrieve distinct motor memories for physically identical movements. Curr. Biol. 2012;22:432–436. doi: 10.1016/j.cub.2012.01.042. [DOI] [PubMed] [Google Scholar]
- 33.Cisek P., Kalaska J.F. Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron. 2005;45:801–814. doi: 10.1016/j.neuron.2005.01.027. [DOI] [PubMed] [Google Scholar]
- 34.Churchland M.M., Cunningham J.P., Kaufman M.T., Foster J.D., Nuyujukian P., Ryu S.I., Shenoy K.V. Neural population dynamics during reaching. Nature. 2012;487:51–56. doi: 10.1038/nature11129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Addou T., Krouchev N., Kalaska J.F. Colored context cues can facilitate the ability to learn and to switch between multiple dynamical force fields. J. Neurophysiol. 2011;106:163–183. doi: 10.1152/jn.00869.2010. [DOI] [PubMed] [Google Scholar]
- 36.Imamizu H., Sugimoto N., Osu R., Tsutsui K., Sugiyama K., Wada Y., Kawato M. Explicit contextual information selectively contributes to predictive switching of internal models. Exp. Brain Res. 2007;181:395–408. doi: 10.1007/s00221-007-0940-1. [DOI] [PubMed] [Google Scholar]
- 37.Churchland M.M., Afshar A., Shenoy K.V. A central source of movement variability. Neuron. 2006;52:1085–1096. doi: 10.1016/j.neuron.2006.10.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.van Beers R.J. Motor learning is optimally tuned to the properties of motor noise. Neuron. 2009;63:406–417. doi: 10.1016/j.neuron.2009.06.025. [DOI] [PubMed] [Google Scholar]
- 39.Beck J.M., Ma W.J., Pitkow X., Latham P.E., Pouget A. Not noisy, just wrong: the role of suboptimal inference in behavioral variability. Neuron. 2012;74:30–39. doi: 10.1016/j.neuron.2012.03.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.