Skip to main content
The Journal of Neuroscience logoLink to The Journal of Neuroscience
. 2013 Feb 13;33(7):2754–2760. doi: 10.1523/JNEUROSCI.1553-12.2013

Learning to be Lazy: Exploiting Redundancy in a Novel Task to Minimize Movement-Related Effort

Rajiv Ranganathan 1,2,, Adenike Adewuyi 4, Ferdinando A Mussa-Ivaldi 1,2,3,4
PMCID: PMC3711630  NIHMSID: NIHMS445841  PMID: 23407935

Abstract

A key issue in motor control is to understand how the motor system chooses a solution from the multiple solutions that exist to achieve any particular task goal. One hypothesis is that redundancy may be resolved by minimizing movement-related costs. However, testing this prediction in motor learning has been problematic in simple laboratory tasks, like reaching, because the motor system already has extensive prior knowledge about redundancy in these tasks. Here, we used a novel task where healthy human participants performed finger movements to guide a computer cursor to different targets on the screen. Through training, all participants learned to perform successful goal-directed movements. Our findings showed that subjects did not develop a single inverse map from target to hand posture. Instead, they learned to use distinct hand postures to get to a single target, using a strategy in which the final hand posture at the target depended on the starting hand posture. Furthermore, postures chosen also depended upon the information content of visual feedback, with precise visual feedback resulting in postures that minimized movement-related costs. These results reinforce the idea that redundancy is exploited to minimize movement-related costs and that feedback plays a critical role in modulating this ability to effectively take advantage of the abundance of degrees of freedom.

Introduction

There exist two competing approaches in motor control that describe how the nervous system resolves the issue of redundancy (Bernstein, 1967). The first approach is to reduce redundancy by introducing constraints between the multiple degrees of freedom (Donders, 1848; Borghese et al., 1996), whereas the second approach resolves redundancy by minimizing movement-related costs (Hollerbach and Suh, 1987; Mussa-Ivaldi et al., 1988; Mussa-Ivaldi and Hogan, 1991; Todorov and Jordan, 2002). This latter strategy can be considered as “exploiting redundancy” because to achieve any particular task goal, the solution corresponding to the least movement cost is not unique—rather, different solutions to achieve the same task goal may be adopted depending on the initial conditions of the movement. In humans, evidence for exploiting redundancy to minimize movement-related costs has been shown in several reaching studies where the choice of arm posture used to get the hand to a particular location in external space depends on the starting arm posture (Soechting et al., 1995; Gielen et al., 1997; Medendorp et al., 2000; Vetter et al., 2002).

This hypothesis that the nervous system resolves redundancy by minimizing movement-related costs makes a specific prediction in motor learning: early in learning, when the controller does not have adequate knowledge of the redundancy in the system, the final postures used for getting to a particular task location when starting from different starting postures should be less separable (i.e., less distinct). With further practice, however, once the controller determines the redundancy in the system, it could use this redundancy to minimize movement related-costs. This strategy would imply that the final postures chosen for a particular task location would be distinct for movements initiated from different starting postures, leading to an increase in separability with learning (along with a decrease in the movement-related cost). This prediction is in contrast to the constraint-inducing strategy where the separability between these final postures should decrease with learning (i.e., participants would effectively converge to a single final posture for getting to a task location since the redundancy is reduced by the induced constraints).

However, a potential difficulty with testing this prediction using familiar tasks like reaching is that the motor system already has extensive knowledge of how the multiple degrees of freedom relate to the task-relevant variable (e.g., how changes in the joint angles of the arm relate to changes in hand position) and therefore, this prior knowledge of redundancy may confound the effects of learning in these tasks. Here, we addressed this issue by using a novel task which involved controlling a computer cursor using changes in hand posture (Mosier et al., 2005; Danziger et al., 2009; Liu et al., 2011). We examined the hand posture adopted when the cursor was always at a single target location. We found that participants adopted distinct hand postures at the target, using a strategy in which the final hand posture depended on the starting hand posture. This strategy tended to minimize movement-related costs, but only in the presence of precise visual feedback.

Materials and Methods

Participants

Eighteen young healthy adults (9 females, mean age = 24 ± 2 years) participated in the study. All participants were right handed. Participants provided informed consent and all procedures were approved by the Northwestern University IRB.

Task

Participants wore a Cyberglove (Immersion Technologies) on their right hand that measured a total of 19 joint angles (the 3 wrist sensors were excluded). The 19 joint angles of the hand were linearly mapped on to the position of a cursor on a screen and the task of the participants was to move the cursor to different targets that were displayed on a 5 × 5 grid (Fig. 1A). The sampling frequency was set at 60 Hz. Vision of the participants' arm and hand was obscured using black cloth that was draped over the arm.

Figure 1.

Figure 1.

Experimental setup. A, Schematic of the task. Participants wore a Cyberglove that measured 19 degrees of freedom from the hand. This 19-dimensional vector (h) was linearly mapped to the 2-D position (p) of a cursor on a screen. Participants were instructed to move the cursor to different targets shown on the screen—the dark gray targets were the training targets and the light gray targets were the generalization targets. B, Practice schedule for participants on Day 1 and Day 2. C, Visual feedback for different groups for a movement performed in the direction indicated by the arrow. For the purpose of clarity, only a subset of the 5 × 5 target grid is shown. At any point in time, all groups saw only the instantaneous position of the cursor (i.e., no information about the previous positions was provided).

The 19-dimensional vector (h) representing the hand posture was linearly mapped on to the 2-D position of the cursor (p) using the equation below (Mosier et al., 2005; Liu and Scheidt, 2008):

graphic file with name zns00713-2922-m01.jpg

i.e., p = Ah + p0

where the values for the mapping matrix (A) and the offset (p0) were determined from an initial calibration phase. Throughout the manuscript, vectors are represented by characters in lower case bold face whereas matrices are represented by characters in upper case bold face.

This mapping meant that each hand posture was mapped to a single cursor location but a single cursor location could be achieved using multiple hand postures. Therefore, to guide the cursor to different (x,y) locations on the screen, participants had to perform finger movements to change from one hand posture to another. Holding a static hand posture resulted in the cursor staying at a single (x,y) location.

Procedure

A schematic of the procedures is shown in Figure 1B. There were three main phases in the experiment—calibration, familiarization and training.

Calibration.

To determine the mapping matrix A and the offset p0, we had participants perform a sequence of free finger movements where they were instructed to move their fingers in as many different ways as possible while avoiding extremes of range of motion (Casadio et al., 2010) until we obtained 4000–5000 samples (∼70–90 s). Visual feedback of the 19 individual sensors was provided as a bar graph to encourage participants to explore different movements. Principal component analysis (Daffertshofer et al., 2004) using the covariance matrix was performed on this dataset and the first 2 principal components (PCs) were used as the two rows of the A matrix (i.e., the first PC corresponded to motion along the x-axis and the second PC to motion along the y-axis). Because the variation along the first PC is always greater than or equal to that along the second PC (by definition), the PCs were scaled by the square root of the respective eigenvalue to make the task difficulty comparable along both directions. The offset p0 was computed so that the mean posture from the calibration phase corresponded to the center of the 5 × 5 grid.

Familiarization.

Before training, participants performed a familiarization phase that involved trying to reach all 25 targets of the 5 × 5 grid. This was done just to ensure that all targets in the workspace were reachable. All participants were able to reach the targets without requiring a rescaling of the original mapping matrix.

Training.

Following the familiarization block, participants practiced on 4 targets—3 outer targets and one center target (indicated in dark gray squares in Fig. 1A). Practice consisted of 16 blocks that were spread over 2 d into 8 blocks/d. Each block consisted of 66 movements (60 movements with visual feedback, 3 “blind” catch trials and 3 return movements following the catch trials with visual feedback). The sequence of targets in each block was randomized but always consisted of 24 movements to the center target (8 from each outer target) and 12 movements to each of the 3 outer targets. The choice of this sequence was used as a trade-off between maximizing the number of movements to the center target (which was the focus of the data analysis) and minimizing the total number of movements (to avoid excessive fatigue within a single practice session). Participants were instructed to get to the center of each target within a movement time of 2 s.

Training groups.

Participants were randomly assigned into one of three groups that differed in the quality of visual feedback during practice (Fig. 1C). (A) In the Precise group, participants were given precise spatial information and continuous temporal feedback of the cursor position which was displayed as small circle. (B) In the Intermittent group, participants were provided precise spatial position of the cursor, but were shown the cursor only intermittently in time. The cursor was displayed only for 0.1 s every 0.5 s. (C) In the Blur group, participants were given continuous temporal feedback, but the spatial position of the cursor was corrupted with white Gaussian noise with zero mean and SD 0.2 (units were normalized relative to the size of the target square). This resulted in participants seeing a cloud of 4–6 cursors around the actual position of the cursor (Stevenson et al., 2009). All feedback manipulations were present only during movement. It is important to note that in all cases, participants saw only the instantaneous position of the cursor (i.e., the trail of cursors along the path taken by the cursor was not actually seen by the participant and is shown in the figure only for clarity). Four out-of-bounds indicators (up, down, left, right) surrounding the 5 × 5 grid were used to give feedback when participants moved outside the grid in the corresponding direction.

When the cursor stopped inside the target, precise visual feedback was provided for all groups. At the end of each trial, the corresponding target lighted up in yellow if the participants were inside the target within a movement time of 2 s. If participants took longer than 2 s to reach the target, the target was highlighted in red. A scoring system based on the movement time and accuracy was also used to keep participants motivated. The next target in the sequence was presented only when the participant successfully reached the previous target.

Blind trials.

In each training block, there were 3 blind trials that appeared randomly, but with the constraint that no blind trials appeared in the first 30 movements. Visual feedback of the cursor was unexpectedly removed during these trials. The blind trials were always directed from the center target to the outer targets. At the end of the catch trial, the cursor position was given as feedback and was subsequently followed by a return movement back to the center target. During the first 12 blocks of practice, the blind trials were directed to the same targets as those being trained, whereas in the last 4 blocks of practice the blind trials (i.e., at the end of Day 2) were directed to three generalization targets that were not part of the training targets (indicated by the light gray squares in Fig. 1A).

Data analysis

To simplify statistical analysis and presentation of the data, we grouped the 8 practice blocks of each day into two phases—the early phase, which consisted of the first 4 blocks, and the late phase, which consisted of the last 4 blocks. This meant that each phase consisted of 96 postures at the center target (32 from each outer target), which also provides greater robustness for the estimates of variance and classification accuracy.

Task performance.

The task performance was quantified by two metrics—the Euclidean error and movement straightness. The Euclidean error was quantified by the Euclidean distance between the center of the target and the cursor at the end of the movement. The end of the movement was defined as the point at which the distance between two successive glove data samples did not change by >2 units (∼1°) for 10 consecutive samples. If the movement time was >2 s, the error was computed at 2 s into the movement. For the blind trials with no visual feedback, the error was computed at the end of movement. Movement straightness was measured using the aspect ratio, i.e., the maximum perpendicular distance on the screen (measured from the line joining the start and the end points of the movement) normalized to the straight line distance between the start and end points.

Variance accounted for by first 2 PCs.

The hand postures adopted throughout the whole movement in each phase were analyzed using principal component analysis. Since the task could theoretically be achieved by using only 2 PCs (the task space is planar), we examined the fraction of variance accounted for by 2 PCs and how this changed with learning. We eliminated postures when the hand was static (i.e., when there was no change in the glove data) so that these postures were not overrepresented in the data.

Null space-task space variability at the center target.

For movements to the center target, the final postures adopted at rest were separated into null-space and the task-space components, i.e., h = hn + ht, where hn = (I19A+ A) h and ht = (A+ A) h. I19 represents the 19 × 19 identity matrix and A+ represents the Moore-Penrose pseudoinverse of the mapping matrix A (Mosier et al., 2005; Liu and Scheidt, 2008). As mentioned earlier, we chose only the center target for the analysis because the biomechanical constraints were minimized at this target. The center target corresponded to the mean hand posture during calibration, where all the joints were close to the middle of their range of motion. The total variance of these postures was then computed separately in the null space and the task space. Since the two spaces have different dimensions, the variances were normalized by the number of degrees of freedom in the task space and the null space (Scholz and Schöner, 1999).

Separability of postures at the center target.

To determine whether postures at the center target (in either the null space or the task space) were separable by the starting target, we used linear discriminant analysis. The postures in the null space and task space were computed by directly projecting the hand posture on to the 17-D null space or the 2-D task space (unlike the calculation for the variance, the null space and task space could not be embedded in the 19-D space since the linear discriminant analysis requires a full rank covariance matrix). We used half of the dataset to train the classifier and then cross-validated the classification by testing the classifier's ability to predict the starting target for the remaining half of the postures. Confidence in this procedure was estimated using a bootstrapping procedure (i.e., by repeating 50 times and randomly selecting 50% the postures for the training dataset each time). The mean classification accuracy of these 50 iterations was used as the index of separability between the 3 clusters representing postures at the center target that originated from the three outer targets). A mean classification accuracy of 100% indicates completely separable postures whereas 33% indicates no separation (chance level).

Transport efficiency.

If the separability metric showed that there were redundant solutions, we also examined whether the null space was being “effectively used” using a transport efficiency metric. To determine the transport efficiency (i.e., how much was the movement-related effort in moving to the center target), we used a surrogate analysis and computed the movement cost for the solutions that were actually used and compared it to movement costs for other possible solutions that could have potentially been used (similar to the randomization method used by Müller and Sternad, 2003). In other words, if the mean posture used for the outer targets is represented by Ti and the corresponding posture at the center target was Ci, we compared the actual movement cost (i.e., from Ti to Ci) to the cost of alternative possible solutions that could have been used (i.e., from Ti to Cj where ij) (see Fig. 4A). Although some studies have used formal definitions of movement cost (such as mechanical work—Soechting et al., 1995), given the significant complexity in the hand due to the high number of degrees of freedom and the shared musculature, we chose to use a simpler metric to quantify the movement cost by using the Euclidean distance between two hand postures.

Figure 4.

Figure 4.

Schematic to illustrate how transport efficiency can be different when postures at the center are separable. The three postures at the outer targets are denoted by T1, T2, and T3 and when the movement is initiated from these targets, the corresponding postures at the center target are C1, C2, and C3. The transport efficiency effectively compares the actual movement costs used by the subject (represented by the length of the solid lines originating from the actual starting targets—e.g., T1-C1, T2-C2 etc.) to other possible movement costs (represented by the average length of the dotted lines originating from the other targets—e.g., T2-C1, T3-C1 etc.). In the case of high transport efficiency (A, Left), the solid lines are shorter than the average of the dotted lines, indicating that the actual costs observed were smaller than the costs for other alternative solutions. However in the case of low transport efficiency (A, Right), the length of the solid lines are approximately equal to the average of the dotted lines, indicating that the actual cost was not much lower than other alternative solutions. It is important to note that even though C1, C2, C3 are shown separated, they all represent postures at a single target location (i.e., the separation is only in the null space and not in the task space). B, Transport efficiency for the different groups as a function of practice. Only the precise group showed transport efficiency significantly >0. Error bars represent 1 SE (between-participant).

For each set of postures adopted (i.e., at the three outer targets and at the center target from each of these targets), a 3 × 3 Euclidean distance matrix was constructed—where each element dij = ||ticj||, where ti represents the mean posture at the ith outer-target and cj represents the actual mean center-target posture adopted when the movement started from the jth outer target. Once this distance matrix was determined, we computed the transport efficiency (TE) as

graphic file with name zns00713-2922-m02.jpg

We bootstrapped this analysis 50 times by randomly selecting only half of the postures each time to estimate the mean and SD of the transport efficiency for each subject.

Statistical analysis

Statistical analyses on all dependent variables were performed using a Practice block (4) × Group (3) mixed-model ANOVA with practice block (1–4) as the within-subject factor and group (Precise, Intermittent, Blur) as the between-subject factor. When appropriate, corrections for sphericity were performed using the Greenhouse-Geisser correction. Post hoc comparisons for the practice block factor was done between the first and last block whereas for the group factor, the comparisons were done only between Precise and the other two groups using a Bonferroni correction. In the case of the transport efficiency where we were interested in the individual-subject data, we ran a one tailed t test to examine whether the transport efficiency was significantly >0 for each subject. We also tested whether the mean transport efficiency of each group was significantly greater than zero. The significance level of all tests was set at 0.05. For the between-group comparisons, we only compared the Precise group with the Intermittent and the Blur groups.

Results

Baseline

To verify whether there were any differences between the groups at baseline, we compared the average time required to reach a target during the initial familiarization phase when all participants had precise visual feedback. The results showed that the differences between groups were not significant at baseline (F(2,15) = 0.18, p = 0.83). The mean (±SD) movement times in the Precise, Intermittent and Blur groups were 9.7 ± 4.0 s, 10.9 ± 6.3 s and 9.2 ± 4.2 s respectively.

Euclidean error

Sample cursor trajectories (only for trials with visual feedback) for one subject in the precise group at different stages of learning are shown (Fig. 2A). The analysis of the Euclidean error showed that participants learned to reduce their error with each practice block (F(1.8,27.4) = 62.77, p < 0.01), almost approaching a plateau by the last practice block (Fig. 2B). Post hoc comparisons showed that the error in the last block of practice was significantly lower than the first block (p < 0.05). In addition, there was also a significant main effect of group, F(2,15) = 5.79, p = 0.014. Post hoc comparisons showed that the error was lower in the precise group compared with both the blur and intermittent groups (p < 0.05).

Figure 2.

Figure 2.

A, Sample data of cursor paths for trials with visual feedback for a single subject in the precise group at three different stages of practice: beginning (trials 1–60), intermediate (trials 181–240) and at the end (trials 901–960). B, C, Euclidean error computed at 2 s into the movement during the training trials with visual feedback (B) and in blind trials (C). For the blind trials, the first three blocks (two on Day 1 and the first on Day 2) involved the 3 training targets whereas the fourth block was a test of generalization to 3 untrained targets. D, Movement straightness during practice for trials with visual feedback as quantified by the aspect ratio. E, Variance accounted for (VAF) by the first 2 PCs during each practice block. Error bars represent 1 SE (between-participant).

Blind trials

The analysis for the blind trials was performed separately for the three blocks that were toward the training targets, and the fourth block that had the generalization (untrained) targets (Fig. 2C). For the blind trials toward the training targets, there was a reduction in error for the blind trials with practice (F(1.4,20.4) = 22.65, p < 0.01), but no significant differences between groups. Post hoc comparisons showed that the error in the last block of practice was significantly lower than the first block (p < 0.05). The errors for the generalization targets tended to be lower than the initial blind trials at the trained targets (Fig. 2B) although this was not statistically significant (F(1,15) = 2.79, p = 0.11). There were no significant differences between the groups. These blind trials were not considered for further analysis.

Aspect ratio

Participants produced straighter paths of the cursor with practice (F(1.9,27.9) = 47.37, p < 0.01), again approaching a plateau by the late phase of Day 2 (Fig. 2D). Post hoc comparisons showed that the aspect ratio in the last block was significantly lower than the first block (p < 0.05). There were no significant differences between the groups.

Variance accounted for by 2 PCs

The percentage of variance accounted for by the first 2 PCs increased with practice (F(3,45) = 48.53, p < 0.01), indicating that the hand postures used were closer to lying on a 2-D plane (Fig. 2E). Post hoc comparisons showed that the percentage of variance was significantly higher on the last block of practice compared with the first block (p < 0.05). No significant effect of group was found.

Variance in null-space and task-space at the center target

There was a significant reduction of both null space and task space variance with practice. For the null-space variance, there was a significant main effect of practice block (F(3,45) = 22.95, p < 0.01). Post hoc comparisons showed that the variance in the null space was smaller on the last block of practice compared with the first block (p < 0.05). The main effect of group was not significant (Fig. 3A).

Figure 3.

Figure 3.

A, B, Variance of the postures at the center target in the null space (A) and task space (B) as a function of practice (normalized per d) for the three groups. The variance decreased in both the task space and the null space for all groups with practice. Note that the scales on the vertical axes are not equal. C, D, Classification accuracy for the different groups in null space (C) and task space (D) as a function of practice. The classification accuracy was computed using a linear discriminant analysis and cross-validated by training on half the dataset and using it to predict the other half. This was repeated 50 times for each subject and the mean classification accuracy was computed. Note that the classification accuracy in the null space increases with learning, whereas the classification accuracy in the task space does not change with learning. Error bars represent 1 SE (between-participant).

For the task-space variance, there was a significant main effect of practice block (F(1.8,26.5) = 37.58, p < 0.01) and also a practice block × group interaction (F(3.53,26.5) = 2.89, p = 0.046). Analysis of this interaction showed that although all groups decreased their task space variance significantly with practice, the Intermittent group continued to decrease its variance significantly even on Day 2 (i.e., from blocks 3 and 4) (p < 0.05), whereas the other two groups did not show a significant decrease on Day 2 (Fig. 3B).

Separability of postures at the center target

The separability of postures in the null space increased with practice whereas the separability of postures in the task space showed no change. In the null space, the analysis showed a significant main effect of practice block (F(3,45) = 21.96, p < 0.01) and post hoc comparisons showed that the separability between postures in the null space was higher on the last block of practice compared with the first block (p < 0.05). The main effect of group was not significant (Fig. 3C). However, when considering the separability in the task space, the analysis showed no significant main effects or interactions (Fig. 3D).

Transport efficiency

When we compared the group differences in the early phase of Day 1, none of the groups showed a transport efficiency that was significantly greater than zero. However, when we compared the groups at the late phase on Day 2, only the precise group showed a transport efficiency that was significantly >0 (p < 0.05) (Fig. 4B). Analyses on individual participants showed that all 6 subjects in the precise group showed transport efficiency significantly greater than zero (p < 0.05).

Control experiment to check for glove hysteresis

To rule out the possibility that the separability in postures was simply due to some form of hysteresis in the Cyberglove, we ran a control condition with a single subject. A custom-made plaster cast (which covered only the palm and not the dorsal part of the hand) was made with the subject's hand in a fixed posture with the MCP joints in slight flexion (similar to the posture of grasping a computer mouse). After the calibration phase to calculate the A matrix, the offset p0 was adjusted so that resting the hand inside the cast would result in the cursor landing in the center target. This was done to effectively mimic the strategy of using the same hand posture to get to the center target. Four blocks of 60 trials were repeated with the only one difference: whenever the center target was presented, the participant simply placed his hand in the cast. When we classified the postures at the center target as a function of the starting posture, we found that the mean (±SD) classification accuracy was 38 ± 8% in the null space and 38 ± 6% in the task space. The low classification accuracy in these results show that the higher separability in the null-space observed in the participants during the experiment was not attributable to hysteresis in the glove.

Discussion

The aim of the experiment was to examine the role of redundancy when learning a novel task. Unlike tasks such as reaching where the motor system already has extensive experience with the redundancy in the motor system, here participants were completely naive to how the hand posture was mapped to the cursor position and had to discover this relation through practice. While previous studies using this protocol have examined overall changes in the null space and task space variability with learning, here we addressed the issue of whether examining the structure of this variability could yield more insight into how redundancy is used during learning.

The results of the experiment revealed two important findings: First, participants used distinct hand postures to get to the center target that systematically depended on the starting posture. The separability between these hand postures at the center target increased with learning, indicating that participants were exploiting the redundancy in the task. Second, in the presence of precise visual feedback, there was clear evidence that the strategy of using distinct hand postures from different starting targets minimized movement-related costs. This suggested that participants were not learning a posture map (i.e., associating a cursor position to a hand posture), but a transport map (i.e., associating changes in cursor position to changes in hand posture).

Our finding that the strategy chosen was a transport map closely parallels the results from reaching studies (Soechting et al., 1995; Fischer et al., 1997; Vetter et al., 2002). However, unlike earlier studies that focused on well practiced tasks (where the nervous system likely has adequate knowledge of the redundancy in the body), the current results clearly show how this transport map is formed even in cases where such knowledge of the redundancy can only be acquired with practice. Initially, when the participants learned the map, they showed high variability in the postures they select to achieve the center target. With more practice, the variability of postures was reduced but the separability increased, indicating that learning did not cause convergence into a single posture. Critically, this separation between postures was only observed in the null space and not in the task space. In other words, using the cursor position at the center target alone was not sufficient to predict the starting target of the movement whereas the projection of the hand posture in the null space was able to discriminate the starting target with high accuracy. Further, the fact that the separability increased for all groups with practice indicated that this use of redundancy was not dependent upon visual feedback of the entire trajectory. These results are consistent with the predictions of the posture model from Rosenbaum et al. (1995) with the exception of the fact that although practice resulted in a reduction in variability of the postures, it did not result in a decreased influence of the start posture on the final posture.

In addition to finding that there was a use of the null space (i.e., using redundant solutions), the transport efficiency metric further revealed that the separation in null space was a strategy to reduce changes in hand posture, supporting the idea that the motor system effectively uses redundancy to minimize movement-related costs. Here, we found that the precision of visual feedback had a critical role in determining the optimality of the chosen postures. In particular, degrading the precision of visual feedback of the cursor when it was in motion either spatially (Blur) or temporally (Intermittent) not only resulted in slower rates of learning as seen in the Euclidean error and longer movement times (Stevenson et al., 2009), but also resulted in the choice of sub-optimal postures. Even though the separability was high in all groups, only the precise feedback group showed transport efficiency that was significantly greater than zero. Therefore, even though the visual feedback was only restricted to the task space, which allowed participants to minimize the Euclidean error from the center of the target, the visual information also provided them with a better estimate of which motions contribute to task space and null space motion. This allowed participants to minimize wasteful motions in the null space. We conclude that the ability to effectively use redundancy is critically mediated by feedback (Todorov and Jordan, 2002; Ranganathan and Newell, 2008, 2009). Furthermore, this finding also supports the idea that precise visual information of the entire trajectory of the cursor contributes to the learning of the map rather than simply the final position (Liu and Scheidt, 2008).

Finally, the results are also relevant to a recent debate over the role of the null space variability in motor learning. One hypothesis is that null space variability need not be decreased with learning because it is either irrelevant to task performance (Todorov and Jordan, 2002) or that it is actually “good variance” because it reflects the ability of the system to use multiple solutions (Latash et al., 2002). However, on the other hand, other studies have shown that there is a systematic decrease in null space variability with learning and hypothesize that this may be important for forming an inverse map that uniquely maps the lower dimensional task space to the higher dimensional body space (e.g., joint angles, forces; Mosier et al., 2005; Liu and Scheidt, 2008; Casadio et al., 2010; Liu et al., 2011). The current results show that both hypotheses are not mutually exclusive. There was clearly evidence of formation of an inverse map: with learning, postures occupied a largely 2-D plane (with 2 PCs accounting for ∼80% of the variance). Although some of this variance could be attributed to the influence of peripheral and central constraints on the hand (Schieber and Santello, 2004), the reduction in null space variability at a single target location (which could have theoretically been achieved using the same posture) shows that there was indeed an active reduction in null space variability. This suggests that participants were forming a stable inverse map by eliminating most of the null space variability. However, despite this reduction, participants were also able to use the remaining null space to minimize movement-related costs (i.e., minimizing changes in hand posture), showing that residual null space variability is not simply noise but rather, it retains structure that reflects control optimizations entirely orthogonal to the kinematic goals of the task. A similar approach to reconcile these seemingly contradictory notions of optimality and redundancy has also been recently described in force control tasks (Park et al., 2010).

In summary, we found that even in a novel task where there is no prior knowledge of how the degrees of freedom map to the task space, the nervous system learns to exploit redundancy to minimize movement-related costs, similar to arm movements (Soechting et al., 1995). However, feedback plays an important role since the movement costs are minimized only in the presence of precise visual feedback. Future experiments are needed to address whether extended learning at the task could result in efficient movements without reliance on visual feedback.

Footnotes

This project was supported by a grant from the National Institutes of Health (1R01NS053581-01A2). We thank Drs. Maura Casadio and Robert Scheidt for insightful comments on an earlier version of the manuscript.

The authors declare no competing financial interests.

References

  1. Bernstein NA. The co-ordination and regulation of movements. Oxford: Pergamon; 1967. [Google Scholar]
  2. Borghese NA, Bianchi L, Lacquaniti F. Kinematic determinants of human locomotion. J Physiol. 1996;494:863–879. doi: 10.1113/jphysiol.1996.sp021539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Casadio M, Pressman A, Fishbach A, Danziger Z, Acosta S, Chen D, Tseng HY, Mussa-Ivaldi FA. Functional reorganization of upper-body movement after spinal cord injury. Exp Brain Res. 2010;207:233–247. doi: 10.1007/s00221-010-2427-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Daffertshofer A, Lamoth CJ, Meijer OG, Beek PJ. PCA in studying coordination and variability: a tutorial. Clin Biomech (Bristol, Avon) 2004;19:415–428. doi: 10.1016/j.clinbiomech.2004.01.005. [DOI] [PubMed] [Google Scholar]
  5. Danziger Z, Fishbach A, Mussa-Ivaldi FA. Learning algorithms for human-machine interfaces. IEEE Trans Biomed Eng. 2009;56:1502–1511. doi: 10.1109/TBME.2009.2013822. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Donders F. Beitrag zur Lehre von den Bewegungen des menschlichen Auges. Holland Beit Anatom Physiolog Wiss. 1848;1:105–145. [Google Scholar]
  7. Fischer MH, Rosenbaum DA, Vaughan J. Speed and sequential effects in reaching. J Exp Psychol Hum Percept Perform. 1997;23:404–428. doi: 10.1037//0096-1523.23.2.404. [DOI] [PubMed] [Google Scholar]
  8. Gielen CC, Vrijenhoek EJ, Flash T, Neggers SF. Arm position constraints during pointing and reaching in 3-D space. J Neurophysiol. 1997;78:660–673. doi: 10.1152/jn.1997.78.2.660. [DOI] [PubMed] [Google Scholar]
  9. Hollerbach JM, Suh K. Redundancy resolution of manipulators through torque optimization. IEEE J Robot Automat. 1987;3:308–316. [Google Scholar]
  10. Latash ML, Scholz JP, Schöner G. Motor control strategies revealed in the structure of motor variability. Exerc Sport Sci Rev. 2002;30:26–31. doi: 10.1097/00003677-200201000-00006. [DOI] [PubMed] [Google Scholar]
  11. Liu X, Scheidt RA. Contributions of online visual feedback to the learning and generalization of novel finger coordination patterns. J Neurophysiol. 2008;99:2546–2557. doi: 10.1152/jn.01044.2007. [DOI] [PubMed] [Google Scholar]
  12. Liu X, Mosier KM, Mussa-Ivaldi FA, Casadio M, Scheidt RA. Reorganization of finger coordination patterns during adaptation to rotation and scaling of a newly learned sensorimotor transformation. J Neurophysiol. 2011;105:454–473. doi: 10.1152/jn.00247.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Medendorp WP, Crawford JD, Henriques DY, Van Gisbergen JA, Gielen CC. Kinematic strategies for upper arm-forearm coordination in three dimensions. J Neurophysiol. 2000;84:2302–2316. doi: 10.1152/jn.2000.84.5.2302. [DOI] [PubMed] [Google Scholar]
  14. Mosier KM, Scheidt RA, Acosta S, Mussa-Ivaldi FA. Remapping hand movements in a novel geometrical environment. J Neurophysiol. 2005;94:4362–4372. doi: 10.1152/jn.00380.2005. [DOI] [PubMed] [Google Scholar]
  15. Müller H, Sternad D. A randomization method for the calculation of covariation in multiple nonlinear relations: illustrated with the example of goal-directed movements. Biol Cybern. 2003;89:22–33. doi: 10.1007/s00422-003-0399-5. [DOI] [PubMed] [Google Scholar]
  16. Mussa-Ivaldi FA, Hogan N. Integrable solutions of kinematic redundancy via impedance control. Int J Robot Res. 1991;10:481–491. [Google Scholar]
  17. Mussa-Ivaldi FA, Morasso P, Zaccaria R. Kinematic networks. A distributed model for representing and regularizing motor redundancy. Biol Cybern. 1988;60:1–16. doi: 10.1007/BF00205967. [DOI] [PubMed] [Google Scholar]
  18. Park J, Zatsiorsky VM, Latash ML. Optimality vs. variability: an example of multi-finger redundant tasks. Exp Brain Res. 2010;207:119–132. doi: 10.1007/s00221-010-2440-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Ranganathan R, Newell KM. Online feedback and the regulation of degrees of freedom in motor control. Hum Mov Sci. 2008;27:577–589. doi: 10.1016/j.humov.2008.01.002. [DOI] [PubMed] [Google Scholar]
  20. Ranganathan R, Newell KM. Influence of augmented feedback on coordination strategies. J Mot Behav. 2009;41:317–330. doi: 10.3200/JMBR.41.4.317-330. [DOI] [PubMed] [Google Scholar]
  21. Rosenbaum DA, Loukopoulos LD, Meulenbroek RG, Vaughan J, Engelbrecht SE. Planning reaches by evaluating stored postures. Psychol Rev. 1995;102:28–67. doi: 10.1037/0033-295x.102.1.28. [DOI] [PubMed] [Google Scholar]
  22. Schieber MH, Santello M. Hand function: peripheral and central constraints on performance. J Appl Physiol. 2004;96:2293–2300. doi: 10.1152/japplphysiol.01063.2003. [DOI] [PubMed] [Google Scholar]
  23. Scholz JP, Schöner G. The uncontrolled manifold concept: identifying control variables for a functional task. Exp Brain Res. 1999;126:289–306. doi: 10.1007/s002210050738. [DOI] [PubMed] [Google Scholar]
  24. Soechting JF, Buneo CA, Herrmann U, Flanders M. Moving effortlessly in three dimensions: does Donders' law apply to arm movement? J Neurosci. 1995;15:6271–6280. doi: 10.1523/JNEUROSCI.15-09-06271.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Stevenson IH, Fernandes HL, Vilares I, Wei K, Körding KP. Bayesian integration and non-linear feedback control in a full-body motor task. PLoS Comput Biol. 2009;5:e1000629. doi: 10.1371/journal.pcbi.1000629. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nat Neurosci. 2002;5:1226–1235. doi: 10.1038/nn963. [DOI] [PubMed] [Google Scholar]
  27. Vetter P, Flash T, Wolpert DM. Planning movements in a simple redundant task. Curr Biol. 2002;12:488–491. doi: 10.1016/s0960-9822(02)00715-7. [DOI] [PubMed] [Google Scholar]

Articles from The Journal of Neuroscience are provided here courtesy of Society for Neuroscience

RESOURCES