Abstract
We review practice-induced changes in two variance components defined based on the uncontrolled manifold hypothesis: One of them affects task performance while the other one does not. Practice leads to a drop in the former component (higher accuracy), while the latter can drop, stay unchanged, or even increase. The last scenario can be achieved with practice that challenges performance stability.
Keywords: Synergy, practice, variability, redundancy, abundance
INTRODUCTION: TRADITIONAL VIEW ON MOTOR LEARNING
Practice may have a number of goals, for example, to become stronger, faster, or more accurate. In this review, we consider only the latter goal of practice when the timing of a task and the level of effort are either prescribed or can be selected freely by the performer. Such tasks are common in both everyday life (e.g., slicing cheese, moving a cup of coffee filled to the brim, and walking along a narrow path) and athletics (e.g., archery, playing pool, putting in golf, and some gymnastic exercises). All these movements, just as all natural human movements, are characterized by problems of motor redundancy (3). This implies that the number of constraints associated with typical tasks is lower than the number of variables produced by elements (elemental variables or degrees-of-freedom, DOFs) at any level of description of the neuromotor system.
In his studies of professional blacksmiths, Bernstein (2) showed that the consistent motor performance (consistent trajectories of the hammer) could result from variable behavior of individual elements involved in the movement (variable joint rotations). Based on these and other studies, Bernstein offered a view on a staged process involved in skill acquisition. This, now classical, view (4, 32) considers three stages of motor learning. At the first stage, redundant DOFs are eliminated by adding constraints to the movement. At the second stage, some DOFs are gradually released which results in added variability at the level of elements. At the third stage, the elements are coordinated to utilize the reactive phenomena induced in movement execution. In this review, we will describe an alternative view that does not involve changes in the number of DOFs but rather changes in their co-variation patterns in the process of motor learning (14, 35).
When one deals with a redundant system, there are different strategies of achieving similar levels of accuracy. For example, variability of the output of each element can decrease with practice. Alternatively, the outputs of individual elements may remain noisy but their co-variation can improve leading to lower variability of a functionally important performance variable, to which all of the elements contribute. In this review, we present evidence for a less obvious strategy: Individual elements become more variable with practice while their combined output becomes less variable. Our studies are based on a recently developed view on the problem of motor redundancy, which considers the apparently redundant design of the neuromotor system as abundant, that is, as contributing to both stability of motor actions and the ability to perform multiple tasks based on the same set of elements. The main hypothesis has been that properly organized practice can lead to an increase in variability within the space of elemental variables accompanied by a drop in the variability in performance variables due to the improved co-variation.
MOTOR ABUNDANCE, SYNERGIES, AND THE UNCONTROLLED MANIFOLD HYPOTHESIS
The alternative view on the apparently redundant design of the human body has been cast as the principle of abundance (11, 18). This principle is based on a general view that the system for movement production is physical (physiological), not computational (17). The word “controller” is used in this framework as a substitute for decision-making processes within the central nervous system with currently unknown physics. According to the principle of abundance, families of solutions are always facilitated for any motor task in the space of elemental variables. Such families reflect different stability of the movement trajectory in different directions within the space of elemental variables: Directions that correspond to changes in important performance variables are relatively more stable compared to directions that do not change those variables. Effectively, relatively large amounts of variability are produced compatible with task-related patterns of important performance variables. Besides being a reflection of high stability of performance, these large amounts of variability allow performing secondary tasks with the same set of elemental variables without negative interference with the primary task (37). For example, a soccer player kicking a ball has to use many muscles of the trunk and extremities that are also involved in providing stability of the vertical posture. A toddler kicking a ball frequently loses balance and falls. When a person learns how to unite the involved muscle groups into functional units (synergies) that provide postural stability while allowing large amounts of variability in the muscle activation space, kicking the ball can be performed without causing postural problems. The variability resulting from such an abundant design has been viewed as a prerequisite for flexibility and adaptability in biological behavior (15, 25).
Neural mechanisms that bring about task-specific patterns of variability have been termed synergies (16, 20). Synergies can be characterized by two indices, the average (across trials) sharing of important performance variables among elemental variables and across-trials co-variation in the space of elemental variables. The latter characteristic has been quantified within the framework of the uncontrolled manifold (UCM) hypothesis (30). The UCM hypothesis states that neural mechanisms act to constrain variability in a redundant space of elemental variables to a sub-space (UCM) compatible with a desired value of an important performance variable. In contrast, variability along the UCM is relatively less constrained. The stars in Figure 1 are exact solutions for a task to produce a fixed sum of two elemental variables (E1 and E2), while the dots are attempts with errors. The dashed line is the UCM for this task, and variance along the UCM does not affect the performance (VUCM, sometimes addressed as “good variance”), while variance orthogonal to the UCM (VORT) affects task performance and, therefore, it is sometimes addressed as “bad variance”. A synergy index has been used: ΔV = (VUCM − VORT)/VTOT, where VTOT is the total variance in the space of elemental variables and each variance index is computed per DOF in the corresponding space. When ΔV > 0, it is concluded that a motor synergy stabilizes the performance variable, for which the index has been computed.
CHANGES IN MOTOR SYNERGIES WITH PRACTICE
Practice with the purpose to increase accuracy is expected to lead to more consistent performance, which means that a drop in the corresponding VORT is expected. Changes in VUCM are much harder to predict because, by definition, VUCM has no effect on performance. Figure 2 illustrates five possibilities of changes in VUCM (and ΔV) with practice. First, all variance components can change proportionally resulting in no changes in ΔV (Figure 2A). Second, ΔV can drop if VUCM decreases more than VORT (Figure 2B). In the other three scenarios (Figure 2C–E), ΔV is increased, which may be associated with a relatively small drop in VUCM, no changes in VUCM, or even an increase in VUCM (cf. (17)). Data compatible with all the scenarios illustrated in Figure 2 have been published: Indeed, a drop in the synergy index (9), no change in this index (8), and an increase in the index (12, 35) have been reported after practice emphasizing accuracy of performance. Our main hypothesis is illustrated conceptually by panel E in Figure 2. This panel shows that an increase in variability within the space of elemental variables (caused by an increase in VUCM) can be accompanied by a drop in the variability in the performance variable (reflected in low VORT) due to the improved co-variation. Until recently, no studies showed changes in the structure of variance corresponding to Fig. 2E.
Recent studies (reviewed in (17)) have suggested a two-stage process of how DOFs are coordinated, rather than frozen and released, to stabilize performance. Both stages were observed in a study of accurate three-finger force production with unexpected transcranial magnetic stimuli applied over the contralateral primary motor cortex (21). The first stage was characterized by a significant drop in VORT with minimal changes in VUCM, while during the second phase VUCM decreased with little change in VORT. The first stage was interpreted as developing a synergy with respect to the explicit task requirement. During the second stage, performance was tuned with respect to other factors such as coping with the perturbing effects of the transcranial magnetic stimuli. This resulted in selecting particular combinations of individual finger forces within the UCM leading to a smaller area within the UCM that was used by the subject. During the second stage, the synergy index dropped. It is also possible that, during the second stage, VORT drops to such a low level that the reduction in the variability of performance approaches a plateau, while VUCM continues to drop. During this second stage, practice optimizes features of performance other than those explicitly defined by the task, for example those related to possible perturbations (as in (21)), comfort, avoiding fatigue, etc. As a result, the synergy index computed for the explicitly defined performance variables drops. An interpretation of the two-stage process mediating effects of practice on coordination has been developed (17) based on the equilibrium-point hypothesis (10).
The idea on the two stages of changes in motor synergies suggests that learning a motor task involves developing coordination among elements rather than searching for a unique solution for optimal performance. It follows naturally the classical idea of “repetition without repetition” introduced by Bernstein (3), which implies that the individual repeats a process of achieving the task goal under varying initial conditions and external forces, which results in non-repetitive patterns of elemental variables providing for stability of important features of the action.
IT IS GOOD TO HAVE “GOOD VARIABILITY”
Human movements are always performed in varying external conditions, which are impossible to predict with certainty. In addition, excitability of neural structures involved in movement production varies from trial to trial. These factors make all movements, even well-practiced ones, unlike each other and emphasize the requirements for movement stability. Under this term, we imply an ability to accomplish a task (a final value or a time profile of an important performance variable) under varying initial conditions and possible transient perturbations. This feature is reflected in the structure of across-trials variance in the space of elemental variables quantified with the indices VUCM, VORT, and ΔV. In particular, low VUCM, which seems irrelevant to movement outcome, is a sign of stereotypy, a control strategy that may be able to accomplish the task but only in a highly sterile environment, when no major changes in the initial conditions and external forces happen. In more natural conditions, we believe that sufficiently high VUCM values reflect stability of the movement. One more benefit of high amount of VUCM is that the individual has the flexibility of performing a secondary task while keeping the stability of the first task performance. The larger range of the VUCM allows the two solution spaces for the two tasks to overlap (37).
Imagine walking down the hallway with a mug filled with coffee held in the hand. This everyday task is performed easily, while it represents a very complex mechanical problem of keeping the vertical axis of the mug parallel to the direction of gravity at all times despite the poorly predictable ground reaction forces acting at each step and other forces that propagate through the mechanically linked body segments. Preserving stability of the important variable (mug orientation) is possible only with the help of a multi-joint synergy that channels all the perturbations into a kinematic sub-space compatible with the required mug orientation (cf. 24). Having large amounts of VUCM also allows using the same arm to perform another task (e.g., pressing on the door handle with the elbow) without spilling the coffee.
Several of our and other’s studies have documented relatively low amounts of VUCM in populations characterized by impaired motor coordination such as healthy older persons (13), persons with Down syndrome (5, 31), and patients with Parkinson’s disease and cerebellar disorders (27, 28). The purpose of a series of our recent studies (33, 34) has been to find a way to encourage high amounts of VUCM while simultaneously making sure that performance variability is low (low VORT).
ENCOURAGING MORE “GOOD VARIABILITY”
The idea of challenging stability of action can be traced back to the classical book by Nikolai Bernstein “On Dexterity and Its Development” (4). Bernstein had an insight that achieving top-level performance in athletes, such as gymnasts, and circus performers requires practicing the task under varying initial conditions and external forces. Such manipulations naturally challenge stability of the practiced action.
There are a few important features in the practice schedule we designed to improve performance and simultaneously encourage large amounts of “good variability”. These include using non-repetitive tasks (to discourage development of stereotypical solutions) and manipulating the stability conditions for performance thus making the task more and more challenging in terms of stability without changing any of the other task attributes. While this task can be implemented for various actions, in the first studies we explored the effects of practice on accurate multi-finger force production, a task that has been well developed to address issues associated with the problem of motor redundancy ((22), reviewed in (36)).
We instructed the subjects to follow a template with the total force produced by two or more fingers (a redundant task, R-task). The template is built with concatenated half-cycles of sine-like patterns selected from a set with normal distributions of the amplitude and duration parameters (as shown in Figure 3A). A new template was presented to subjects for each attempt. We manipulated stability of the task by a gain factor (G), which altered force feedback (FFB) on the monitor:
To trace the target under such feedback is similar to moving along a ridge of a mountain with the slope modifiable with the G factor (Figure 3B). As the subjects improved their performance, the G factor increased thus making the conditions less and less stable.
A single session of practice in such conditions led to rather dramatic changes in the structure of variance in the space of commands to fingers (finger modes, (7, 19)). Our study compared effects of practice by a redundant set of fingers (R-task) with a comparable amount of practice of a similar task by each finger separately (non-redundant, NR-task) (33). Accuracy of performance improved similarly in both groups (VORT dropped by similar proportions). In contrast VUCM increased in the group that practiced the R-task while it dropped parallel to VORT in the group that practiced the NR-task. These effects of practice on the two variance components lasted for at least two weeks as the retention test showed.
Note that, even prior to practice, VUCM >> VORT, that is, there were synergies stabilizing the total force time profiles. As a result, the increase in VUCM after practice was larger than the drop in VORT resulting in the counter-intuitive increase in the total amount of variance in the space of commands to fingers. In other words, this task design allowed combining higher variability in the space of elemental variables with lower variability in important performance variables.
In a follow-up study (34), we observed similar effects in both younger and older persons, again after a single practice session that lasted for less than 1.5 h. In both studies, practicing the R-task led to an increase in the total amount of variance in the space of commands to fingers. This was accompanied by a significant improvement in accuracy of performance. A schematic illustration of the main results of these two studies is presented in Figure 2E.
Our second study also led to a somewhat discouraging result: After practice, performance of a different task improved while there was no transfer of the effects on the structure of variance. This could be due to using a simpler task as the transfer task: The subjects were asked to track a perfect sine-wave. The question whether the effects of such practice on the structure of variance and synergy index can be transferred to more ecologically valid, more complex tasks remains open. Note that several recent studies described limited transfer effects of practice in a novel sensory feedback environment (23, 29), while other studies have shown more general transfer effects of training in an unusual force field (1, 6). The controversy of transfer effects in motor learning makes us cautious but optimistic about developing the practice protocol for rehabilitation.
CONCLUDING COMMENTS
Our research shows that practice can lead to changes in coordination as reflected by changed indices of motor synergies. Such effects are not limited to young healthy persons as shown by studies of the beneficial effects of practice on performance and synergy indices in individuals with Down syndrome (31) and in healthy elderly persons (26, 34). The described protocol to encourage flexible involvement of fingers can be readily applied to hand training in populations with significantly decreased relative amounts of “good variability”. We hope that effects of such training will transfer to prehensile tasks and improve stability of the hand action in ecologically valid tasks. The protocol with adjustments in stability can also be used to train a wide range of motor tasks, such as reaching movement, postural tasks, and locomotion. The positive results of improving motor synergies by properly designed tasks make us optimistic about possible future developments of the method for motor rehabilitation.
Summary.
Practice can lead to an increase in total variance within a redundant system combined with more accurate performance and improved stability.
Acknowledgments
Funding:
Supported in part by the NIH grants R01 NS-035032 and AR-048563.
References
- 1.Ahmed AA, Wolpert DM. Transfer of dynamic learning across postures. J Neurophysiol. 2009;102(5):2816–2824. doi: 10.1152/jn.00532.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Bernstein NA. A new method of mirror cyclographie and its application towards the study of labor movements during work on a workbench. Hygiene, safety and pathology of labor. 1930;5:3–9. 6, 3–11. (in Russian) [Google Scholar]
- 3.Bernstein NA. The Co-ordination and Regulation of Movements. Oxford, UK: Pergamon Press; 1967. p. 196. [Google Scholar]
- 4.Bernstein NA. On dexterity and its development. In: Latash ML, Turvey MT, editors. Dexterity and Its Development. Mahwah (NJ): Erlbaum Publ.; 1996. pp. 1–244. [Google Scholar]
- 5.Black DP, Smith BA, Wu J, Ulrich BD. Uncontrolled manifold analysis of segmental angle variability during walking: preadolescents with and without Down syndrome. Exp Brain Res. 2007;183(4):511–521. doi: 10.1007/s00221-007-1066-1. [DOI] [PubMed] [Google Scholar]
- 6.Conditt MA, Gandolfo F, Mussa-Ivaldi FA. The motor system does not learn the dynamics of the arm by rote memorization of past experience. J Neurophysiol. 1997;78(1):554–560. doi: 10.1152/jn.1997.78.1.554. [DOI] [PubMed] [Google Scholar]
- 7.DanionF, Schöner G, Latash ML, Li S, Scholz JP, Zatsiorsky VM. A mode hypothesis for finger interaction during multi-finger force-production tasks. Biol Cybern. 2003;88(2):91–98. doi: 10.1007/s00422-002-0336-z. [DOI] [PubMed] [Google Scholar]
- 8.Domkin D, Laczko J, Djupsjöbacka M, Jaric S, Latash ML. Joint angle variability in 3D bimanual pointing: uncontrolled manifold analysis. Exp Brain Res. 2005;163(1):44–57. doi: 10.1007/s00221-004-2137-1. [DOI] [PubMed] [Google Scholar]
- 9.Domkin D, Laczko J, Jaric S, Johansson H, Latash ML. Structure of joint variability in bimanual pointing tasks. Exp Brain Res. 2002;143(1):11–23. doi: 10.1007/s00221-001-0944-1. [DOI] [PubMed] [Google Scholar]
- 10.Feldman AG. Once more on the equilibrium-point hypothesis (λ-model) for motor control. J Motor Behav. 1986;18:17–54. doi: 10.1080/00222895.1986.10735369. [DOI] [PubMed] [Google Scholar]
- 11.Gelfand IM, Latash ML. On the problem of adequate language in motor control. Motor control. 1998;2(4):306–313. doi: 10.1123/mcj.2.4.306. [DOI] [PubMed] [Google Scholar]
- 12.Kang N, Shinohara M, Zatsiorsky VM, Latash ML. Learning multi-finger synergies: an uncontrolled manifold analysis. Exp Brain Res. 2004;157(3):336–350. doi: 10.1007/s00221-004-1850-0. [DOI] [PubMed] [Google Scholar]
- 13.KapurS, Zatsiorsky VM, Latash ML. Age-related changes in the control of finger force vectors. J Appl Physiol. 2010;109(6):1827–1841. doi: 10.1152/japplphysiol.00430.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Latash ML. How does our brain make its choices? In: Latash ML, Turvey MT, editors. Dexterity and Its Development. Mahwah (NJ): Erlbaum Publ.; 1996. pp. 277–304. [Google Scholar]
- 15.Latash ML. There is no motor redundancy in human movements. There is motor abundance. Motor Control. 2000;4:257–259. doi: 10.1123/mcj.4.3.259. [DOI] [PubMed] [Google Scholar]
- 16.Latash ML. Evolution of motor control: From reflexes and motor programs to theequilibrium-point hypothesis. J Hum Kinet. 2008;19:3–24. doi: 10.2478/v10078-008-0001-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Latash ML. Stages in learning motor synergies: a view based on the equilibriumpoint hypothesis. Hum Movement Sci. 2010;29(5):642–654. doi: 10.1016/j.humov.2009.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Latash ML. The bliss (not the problem) of motor abundance (not redundancy) Exp Brain Res. 2012;217(1):1–5. doi: 10.1007/s00221-012-3000-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Latash ML, Scholz JF, Danion F, Schöner G. Structure of motor variability in marginally redundant multifinger force production tasks. Exp Brain Res. 2001;141(2):153–165. doi: 10.1007/s002210100861. [DOI] [PubMed] [Google Scholar]
- 20.Latash ML, Scholz JP, Schöner G. Toward a new theory of motor synergies. Motor Control. 2007;11:276–308. doi: 10.1123/mcj.11.3.276. [DOI] [PubMed] [Google Scholar]
- 21.Latash ML, Yarrow K, Rothwell JC. Changes in finger coordination and responses to single pulse TMS of motor cortex during practice of a multi-finger force production task. Exp Brain Res. 2003;151:60–71. doi: 10.1007/s00221-003-1480-y. [DOI] [PubMed] [Google Scholar]
- 22.Li ZM, Latash ML, Zatsiorsky VM. Force sharing among fingers as a model of the redundancy problem. Exp Brain Res. 1998;119(3):276–286. doi: 10.1007/s002210050343. [DOI] [PubMed] [Google Scholar]
- 23.Malfait N, Gribble PL, Ostry DJ. Generalization of motor learning based on multiple field exposures and local adaptation. J Neurophysiol. 2005;93(6):3327–3338. doi: 10.1152/jn.00883.2004. [DOI] [PubMed] [Google Scholar]
- 24.Mattos D, Latash ML, Park E, Kuhl J, Scholz JP. Unpredictable elbow joint perturbation during reaching results in multijoint motor equivalence. J Neurophysiol. 2011;106:1424–1436. doi: 10.1152/jn.00163.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Müller H, Sternad D. Motor learning: changes in the structure of variability in a redundant task. Adv Exp Med Biol. 2009;629:439–456. doi: 10.1007/978-0-387-77064-2_23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Olafsdottir H, Zatsiorsky VM, Latash ML. The effects of strength training on finger strength and hand dexterity in healthy elderly individuals. J Appl Physiol. 2008;105(4):1166–1178. doi: 10.1152/japplphysiol.00054.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Park J, Lewis MM, Huang X, Latash ML. Effects of olivo-ponto-cerebellar atrophy (OPCA) on finger interaction and coordination. Clin Neurophysiol. 2012;124(5):991–998. doi: 10.1016/j.clinph.2012.10.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Park J, Wu YH, Lewis MM, Huang X, Latash ML. Changes in multifinger interaction and coordination in Parkinson’s disease. J Neurophysiol. 2012;108(3):915–924. doi: 10.1152/jn.00043.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Rochet-Capellan A, Richer L, Ostry DJ. Nonhomogeneous transfer reveals specificity in speech motor learning. J Neurophysiol. 2012;107(6):1711–1717. doi: 10.1152/jn.00773.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Scholz JP, Schöner G. The uncontrolled manifold concept: identifying control variables for a functional task. Exp Brain Res. 1999;126(3):289–306. doi: 10.1007/s002210050738. [DOI] [PubMed] [Google Scholar]
- 31.Scholz JP, Kang N, Patterson D, Latash ML. Uncontrolled manifold analysis of single trials during multi-finger force production by persons with and without Down syndrome. Exp Brain Res. 2003;153(1):45–58. doi: 10.1007/s00221-003-1580-8. [DOI] [PubMed] [Google Scholar]
- 32.Vereijken B, van Emmerick REA, Whiting HTA, Newell KM. Free(z)ing degrees of freedom in skill acquisition. J Motor Behav. 1992;24(1):133–142. [Google Scholar]
- 33.Wu YH, Pazin N, Zatsiorsky VM, Latash ML. Practicing elements versus practicing coordination: changes in the structure of variance. J Motor Behav. 2012;44(6):471–478. doi: 10.1080/00222895.2012.740101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Wu YH, Pazin N, Zatsiorsky VM, Latash ML. Improving finger coordination in young and elderly persons. Exp Brain Res. 2013;226(2):273–283. doi: 10.1007/s00221-013-3433-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Yang JF,Scholz JP. Learning a throwing task is associated with differential changes in the use of motor abundance. Exp Brain Res. 2005;163(2):137–158. doi: 10.1007/s00221-004-2149-x. [DOI] [PubMed] [Google Scholar]
- 36.Zatsiorsky VM, Latash ML. Multifinger prehension: an overview. J Motor Behav. 2008;40(5):446–476. doi: 10.3200/JMBR.40.5.446-476. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Zhang W, Scholz JP, Zatsiorsky VM, Latash ML. What do synergies do? Effects of secondary constraints on multidigit synergies in accurate force-production tasks. J Neurophysiol. 2008;99(2):500–513. doi: 10.1152/jn.01029.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]