Skip to main content
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
. 2016 Nov 29;113(50):14414–14419. doi: 10.1073/pnas.1613383113

Exploration of joint redundancy but not task space variability facilitates supervised motor learning

Puneet Singh a, Sumitash Jana b, Ashitava Ghosal c,1, Aditya Murthy b,1
PMCID: PMC5167208  PMID: 27911808

Significance

Theories of reinforcement learning claim that motor variability helps in motor learning and are supported by recent experimental work. In contrast, theories of motor control propose that variability is noise that needs to be suppressed. We attempt to reconcile these apparent contradictory positions. Using the formulation of the unconstrained manifold hypothesis, we show that motor variability has two components—a part arising out of the redundancy that does not affect task-space and another component related to task-space variability. We show that the motor variability component resulting from the redundancy determines both dynamic and kinematic learning ability across subjects without affecting task-space variability.

Keywords: supervised learning, minimum-intervention principle, reaching, motor noise, motor control

Abstract

The number of joints and muscles in a human arm is more than what is required for reaching to a desired point in 3D space. Although previous studies have emphasized how such redundancy and the associated flexibility may play an important role in path planning, control of noise, and optimization of motion, whether and how redundancy might promote motor learning has not been investigated. In this work, we quantify redundancy space and investigate its significance and effect on motor learning. We propose that a larger redundancy space leads to faster learning across subjects. We observed this pattern in subjects learning novel kinematics (visuomotor adaptation) and dynamics (force-field adaptation). Interestingly, we also observed differences in the redundancy space between the dominant hand and nondominant hand that explained differences in the learning of dynamics. Taken together, these results provide support for the hypothesis that redundancy aids in motor learning and that the redundant component of motor variability is not noise.


Redundancy is a ubiquitous property that renders biological systems robust to disruptions. Goal-directed movements also display redundancy because a given movement, such as touching one’s nose, can be made in many different ways with different combinations of joint angles. Although redundancy generates flexibility, it also poses a fundamental problem for the motor system because a large component of motor variability is attributed to muscle noise (1). Thus, if muscles operated independently, the total noise (reflected in the trajectory) would be a summation of the noise due to the component parts. However, if the covariation of muscles or joints occurs such that the effect of individual muscle or joint variability is mitigated, it is possible to maintain acceptable levels of variability while maintaining a reasonable degree of redundancy that allows flexibility in behavior. Consistent with this view, it has been observed in a wide range of tasks (27) that variability is not eliminated but optimized (811) to accumulate in a task-relevant dimensions using a minimum-intervention principle (12). Such variability, that is a consequence of redundancy, can be quantified as an uncontrolled manifold (1315) in which task-independent variability is constrained to a redundant subspace (or “uncontrolled manifold”).

Although minimizing variability is expected to improve task-related performance, recent evidence suggests that motor variability paradoxically helps in motor learning (1620). Such findings are supported by ideas in reinforcement learning (21, 22), which suggest that baseline variability increases exploration, which in turn facilitates learning. Interestingly, motor variability has also been shown to help learning during supervised error-based learning tasks (16), suggesting a more general role of variability in motor learning. In this study, we tested whether variability arising from joint redundancy plays a role in supervised motor learning.

Results

We used two experimental setups shown in Fig. S1A. The subject moves the end-effector of a robot manipulator or hand from an initial point to a task-space target point. As shown in Fig. 1, the experiment had three phases—a preadaptation baseline period, followed by a phase with either one of two kinds of perturbations: a visuomotor (kinematic perturbation) or an applied viscous curl force (dynamic perturbation) and finally a postadaptation phase when the perturbation was removed. We simultaneously measured the end point and joint angles while subjects reached to the target during the baseline period as shown in Fig. S1B. The map between the joint angles and the end point (x,y) point is many-to-one, i.e., there is redundancy. The joint variability in the baseline period was quantified into two components—the joint variability due to the redundancy termed as the null-space variability that did not affect end point and the joint variability that caused changes in end point termed as task-space variability (Fig. S1C). In this work, we studied the effect of these two types of variability on the learning of kinematic and dynamic perturbations. We have studied learning in (i) simple visuomotor adaptations (two directions), (ii) generalized visuomotor adaptation (eight directions), and (iii) generalized force-field adaptation when subjects used their dominant and nondominant hand.

Fig. S1.

Fig. S1.

Experiment setup and design. (A) Subjects made point-to-point reaching movements using two such experiment setups. (B) Trackers were used to measure joint rotation angles. (C) Illustration of null-space variability: the blue circle does not affect task-space variability; the red circle affects task-space variability.

Fig. 1.

Fig. 1.

Experiment setup and design. Experiments were divided into preadaptation (baseline), adaptation, and postadaptation (washout) epochs. Subjects adapted to a visuomotor perturbation (Top) or a force-field perturbation (Bottom) in separate experiments.

Redundancy in Kinematic Learning.

We trained 40 subjects to learn point-to-point reaching movements using their dominant hand, along two directions, in a visuomotor perturbation that was set using Eq. 1. In this experiment, the cursor was rotated by 45° from the hand trajectory (Fig. S2A). The trajectory of the hand for a typical subject in the preadaptation (baseline) (Fig. S2B), visuomotor adaptation (Fig. S2C), and postadaptation epochs (Fig. S2D) are shown. Overall, the pattern of trajectories are consistent with previous work showing that whereas typical movements follow a nearly straight trajectory in the baseline condition, they show strong curved trajectories in the presence of a visuomotor perturbation. The curved trajectories gradually become straighter with practice over the course of about 60 trials (Fig. 2A). In addition, as a consequence of motor learning, subjects showed a washout effect (postadaptation) where errors in trajectory invert direction when the learned visuomotor perturbation is turned off.

Fig. S2.

Fig. S2.

Experiment setup and design. (A) Experimental apparatus and illustration of the visuomotor rotation task. (B) First five preadaptation trials from a subject showing baseline motor variability. (C) First 10 visuomotor adaptation trials (color-coded) from the same subject showing the disturbed hand trajectory. (D) First five postadaptation trials from the same subject showing the effect of adaptation. (E) Experimental apparatus and illustration of the visuomotor rotation task. (F) First five of preadaptation (baseline) trials from a subject showing motor variability in preadaptation. (G) First five of generalized visuomotor adaptation trials from the same subject showing the disturbed hand trajectory. (H) First five of postadaptation trials from the same subject showing the effect of adaptation. (I) Experimental apparatus and illustration of the viscous curl force-field. (J) First five of preadaptation (baseline) trials from a subject showing motor variability in preadaptation. (K) First five of force-field adaptation trials from the same subject showing the disturbed hand trajectory. (L) First five of postadaptation trials from the same subject showing the effect of adaptation.

Fig. 2.

Fig. 2.

Joint redundancy predicts learning rate in a visuomotor adaptation task. (A) Error at peak velocity in preadaptation, visuomotor adaptation, and postadaptation for a representative subject showing the progression of adaptation. Errors in each of the two directions are color-coded. Fitted exponential (black line) significantly accounts for most of the progression of errors across trials during adaptation. (B) Three-trial running mean ± SEM across subjects (shading is SEM). Fitted exponential curves across subjects significantly account for most of the progression of errors during adaptation (red indicates above-mean learning group; blue indicates below-mean learning group). (C) Comparison of baseline null-space variability with learning rate between the above-mean learning group (red) and below-mean learning group (blue) reveal corresponding differences in null-space variability between groups. (D) Subject-by-subject comparison (n = 40) of baseline null-space variability with learning rate shows a significant positive relationship. Two subjects whose learning rates were negative have been clamped to 0. Asterisks indicate statistically significant differences (*P < 0.05, **P < 0.005, ***P < 0.0005).

To quantify the error, we used the error at peak velocity along the trajectory. The reduction in peak velocity error (Eq. 9) was used as a metric to quantify the learning rate for each subject. To test whether the learning rate of a subject could be predicted on the basis of motor redundancy exhibited during the preadaptation (baseline period), we computed N(J) (Eq. 8), the chosen measure of variability due to redundancy space called null-space variability. We divided the population into two groups based on their learning rate (above-mean and below-mean learning group), as quantified by the fitted exponential β value (Fig. 2B). In support of the hypothesis, the null-space variability was significantly different between the two learning groups (Fig. 2C). Interestingly, we also found a strong positive correlation between baseline null-space variability and learning rate in the visuomotor adaptation task (Fig. 2D; r=0.55,P=0.0002). However, we found no correlation between baseline task-space variability and learning rate (r=0.13,P=0.43).

Redundancy in Generalized Kinematic Learning.

To test whether redundancy could aid in learning a generalized task, we next examined 10 subjects while they learned point-to-point reaching movements with the visuomotor perturbation (Eq. 1) along eight directions, where in each case, the cursor was rotated by 45° from the hand trajectory (Fig. S2E). The trajectory of the hand for a typical subject in the preadaptation (baseline) (Fig. S2F), visuomotor adaptation (Fig. S2G), and postadaptation epochs (Fig. S2H) are shown. Each individual subject’s learning curve is shown in Fig. S3, and a representative subject is shown in Fig. 3A. The average behavior pooled across 10 subjects showed a similar learning pattern (Fig. 3B; goodness of fit, r2=0.90). Again, the learning rate in the visuomotor perturbation and the null-space and task-space variability in the preadaptation baseline period was computed. A significant correlation between the null-space variability with learning rate was observed (Fig. 3C; r=0.71,P=0.021). Interestingly, we found no correlation of the baseline task-space variability with the learning rate (Fig. 3D; r=0.42,P=0.22).

Fig. S3.

Fig. S3.

Visuomotor adaptation error at peak velocity in preadaptation, adaptation, and postadaptation for all subjects (V1–V10) showing the progression of adaptation. Errors in each of the eight directions are color-coded.

Fig. 3.

Fig. 3.

Joint redundancy predicts the learning rate in a generalized visuomotor adaptation task. (A) Error at peak velocity in preadaptation, adaptation, and postadaptation showing the progression of adaptation for a subject. Errors in each of the eight directions are color-coded. (B) Eight-trial running mean ± SEM across subjects (shading is SEM). Fitted exponential curves across subjects significantly account for most of the progression of errors in the adaptation. (C) The comparison of baseline null-space variability at peak velocity with learning rate shows a significant positive relationship between joint redundancy and motor learning. (D) The comparison of baseline task-space variability at peak velocity with learning rate shows no significant relationship between variability and motor learning.

Redundancy and Dynamic Learning.

To test whether redundancy could aid in learning in other types of perturbation, we trained 10 subjects to learn point-to-point reaching movements using their dominant hand, along 8 directions, in a force-field that was set using the force-field perturbation defined by Eq. 2. In this experiment, the perturbation was proportional to the velocity of the hand but perpendicular to the hand movement direction (Fig. S2I). The trajectory of the hand for a typical subject in the preadaptation (baseline) (Fig. S2J), force-field adaptation (Fig. S2K), and postadaptation epochs (Fig. S2L) are shown. Similar to the visuomotor perturbation, and consistent with literature, typical hand movements follow a nearly straight trajectory in the baseline condition, and they show strong curved trajectories in the presence of a viscous curl force-field. The curved trajectories gradually become straighter with practice over the course of about 200 trials (Fig. 4A). In addition, as a consequence of motor learning, subjects showed a washout effect, where errors in trajectory inverted in direction when the learned force-field was turned off in the postadaptation period. This washout error converged to baseline levels within approximately 100 trials. The average behavior pooled across the 10 subjects showed a similar learning pattern (Fig. 4B; goodness of fit, r2=0.93). The learning curves of each individual subject with the dominant and nondominant hand are shown in Figs. S4 and S5, respectively. As before, the reduction in error at peak velocity (Eq. 9) was used as a metric to quantify the learning rate for each subject. In the force-field adaptation period, the mean learning rate was 0.006±0.002 for the dominant hand and 0.004±0.001 for the nondominant hand. To test whether the learning rate of a subject under a viscous perturbing force could be predicted on the basis of motor redundancy exhibited during the preadaptation (baseline period), we again computed null-space variability as in Eq. 8. We found a strong positive correlation between baseline null-space variability and learning rate in the force-field [Fig. 4C; r=0.69,P=0.027 (dominant hand), r=0.60,P=0.067 (nondominant hand)]. Consistent with that observed for the kinematic perturbation task, we found poor correlation between the learning rate and task-space variability in the baseline period [Fig. 4D; r=0.22,P=0.53 (dominant hand), r=0.13,P=0.72 (nondominant hand)].

Fig. 4.

Fig. 4.

Joint redundancy predicts rate of learning in a force-field adaptation task. (A) Error at peak velocity in preadaptation, adaptation, and postadaptation showing the progression of adaptation for a subject. (B) Eight-trial running mean ± SEM across subjects (shading is SEM). Fitted exponential curves across subjects significantly account for most of the progression of errors in the adaptation (red indicates dominant hand, blue indicates nondominant hand. (C) Comparison of baseline null-space variability at peak velocity with learning rate shows a relationship. (D) Comparison of baseline task-space variability at peak velocity with learning rate shows no significant relationship between task-space variability and motor learning.

Fig. S4.

Fig. S4.

Force-field adaptation error at peak velocity in preadaptation, adaptation, and postadaptation for all subjects with the dominant hand (D1–D10) showing the progression of adaptation. Errors in each of the eight directions are color-coded.

Fig. S5.

Fig. S5.

Force-field adaptation error at peak velocity in preadaptation, adaptation, and postadaptation for same subjects with the nondominant hand (ND1–ND10) showing the progression of adaptation. Errors in each of the eight directions are color-coded.

Redundancy and Dominant and Nondominant Hand Learning.

Differences between the learning of the dominant and nondominant arm across subjects is consistent with previous work (23) and was used as an additional approach to test the relation between null-space variability and motor learning. To test this notion, we compared the learning rate and null-space variability between the dominant and nondominant hand in 10 subjects. We observed that the mean learning rate for the nondominant hand (mean, 0.004±0.001) was significantly less than the mean learning rate for the dominant hand (mean, 0.006±0.002) (Fig. 5A; P =0.008,t(8)=3.54). Interestingly, null-space variability was also lesser in the nondominant hand (mean, 0.054±0.036) compared with the dominant hand (mean, 0.12±0.066) (Fig. 5B; P =0.035,t(8)=2.54). We observed no difference in the mean task-space variability between the dominant and nondominant hand, suggesting that task-space variability did not influence learning rate. Furthermore, we observed a strong correlation (Fig. 5D; r=0.84,P=0.002) between the difference in the learning rate and the difference in the null-space variability of the dominant and nondominant hand, suggesting that the difference in the null-space variability could partly explain the difference in learning rate. We also observed an outlier subject whose learning rate was higher in the nondominant hand compared with the dominant hand (marked as a dotted line in Fig. 5 A–C and marked in blue in Fig. 5D). Nevertheless, even for this subject, the null-space variability was greater in the nondominant hand compared with the dominant hand, in support of our hypothesis. Taken together, these findings indicate that the difference in learning rate between the dominant and nondominant hand may be a consequence of the greater redundancy in the dominant hand.

Fig. 5.

Fig. 5.

Learning differences between the dominant hand and nondominant hand. (A) Learning differences in the dominant hand (red) and nondominant hand (blue) (n = 10) reveal faster learning in the dominant hand. (B) Baseline null-space variability in the dominant and nondominant hand reveals differences in null-space variability between hands. (C) However, baseline task-space variability in the dominant hand and nondominant hand reveals no differences in task-space variability between hands. (D) Correlation between the difference in null-space variability with the difference in learning rate between the dominant hand and nondominant hand shows a significant positive relationship. The outlier subject data are shown as a dotted line (AC) and as a green dot (D).

Discussion

In contrast to previous work that has studied joint redundancy and learning in isolation, this study tested the relation between these two variables under the assumption that the extra degrees of freedom conferred by the arm is used by the motor system to facilitate learning. We have shown that task-space variability in the baseline period while reaching a target in task-space has low correlation with learning during perturbations, whereas the variability in the null-space, resulting from redundancy, aids in learning. We interpret these results as indicating that exploration of redundancy aids in motor learning when a visuomotor perturbation or a force-field perturbation is present.

Joint Redundancy.

The uncontrolled manifold hypothesis (UCM), that has its origin in the initial observations by Bernstein (24, 25) is the dominant framework to understand and quantify joint redundancy (1315). Such redundancy is now established as a ubiquitous feature of behavior observed across a variety of tasks (27). In the current study we followed the UCM framework to quantify joint redundancy. However, unlike previous work, we also quantified redundancy in individual subjects in addition to measuring the group response and observed large variability, suggesting that redundancy might be an idiosyncratic feature that is unique to each subject and/or session. In addition, unlike past work where redundancy was quantified at the maximum peak velocity or at the target location, we restricted our computation to the former in case of all perturbations. This choice was made because task-space variability is known to be highest at the peak velocity of the trajectory and smallest at the end point (target), particularly when the targets are small. Thus, quantifying redundancy at peak velocity is better suited to reveal the full scale of variability across subjects, which may be essential to understand its bearing on motor learning.

Previous work has suggested that the degree of redundancy can be task specific and can be optimized such that the motor system obeys the principle of minimum intervention in which the brain only controls task relevant variability but does not control task irrelevant or null-space variability. Although we did not explicitly study the control of null-space variability, we did observe interesting task specific differences indicating that null-space variability or task irrelevant variability also may be actively controlled and is not merely an epiphenomena of having more degrees of freedom than required for the task. For example, in our pool of subjects we observed that null-space variability was on average greater in the dynamics condition (mean, 0.11±0.069) than that in the kinematic condition (mean, 0.04±0.020) even in the preadaptation period when the reaching task was identical. This difference in null-space variability is likely to be task-specific, the basis of which remains to be elucidated.

Inline with earlier work (23) that showed differences between the dominant and nondominant hand during force-field perturbation but not during visuomotor (kinematics) perturbation, we tested null-space variability in the dominant versus nondominant hand in the dynamic perturbation task. It is particularly interesting to note that despite similar force application and task-space variability (Fig. 5C), the null-space variability was greater in the dominant hand, and further, differences within subjects correlate with corresponding differences in the learning rates (Fig. 5D). The larger null-space variability seen in the dominant hand may thus provide a natural explanation of why learning might be more potent in the dominant hand and reinforces the belief that null-space variability not only reflects the biomechanical characteristics of the arm but may reflect active control.

Dynamic and Kinematic Learning.

To study motor learning, we followed previous work that has tested the ability of subjects to implicitly adapt their motor behavior in the presence of dynamic and kinematic perturbations (2629). In our learning paradigm, subjects learned the perturbations while making movements in two directions (Fig. 2) and also in all eight directions (Fig. 3), picked at random. Hence, unlike some learning paradigms that emphasize specific learning in one direction, our learning is expected to generalize across directions. Thus, we used a single exponential fit pooled across all directions to study the average rate of learning as a single variable even though our data suggest the presence of fast and slow learning phase that has been reported in the literature (30). In the future, we hope to study direction-specific motor learning to test whether joint redundancy better correlates with the fast versus slow learning phase. Nevertheless, our results revealed learning rates that are comparable to the literature (2628, 31). The data also revealed that learning in the dominant hand was significantly faster than that in the nondominant hand (23). Second, trends indicate that some directions appear to be easier to learn, and like joint redundancy, there is a large subject-specific variability in the data, the implications of which are discussed in Relating Joint Redundancy and Motor Learning.

Relating Joint Redundancy and Motor Learning.

The strong subject-wise correlations observed in both the dynamic and kinematic learning tasks support the hypothesis that joint redundancy supports motor learning. Although our data are fundamentally correlative in nature, we were able to exploit a feature in our experiment that involved the use of the dominant and nondominant hand that resulted in differences in learning rates and redundancy. Lending further credence to the hypothesis, we found that the smaller redundancy in the nondominant hand was associated with slower learning. Moreover, the differences in learning and redundancy were also correlated (Fig. 5D). In addition, we showed similar group-wise differences in the visuomotor adaptation task showing smaller redundancy for below-mean learners compared with above-mean learners. This result notwithstanding, we do not claim that redundancy is the sole source of differences in motor learning. Kinematic learning is faster than dynamic learning despite smaller redundancy in the kinematic task compared with the dynamic task, and is likely to reflect differences in the mechanisms involved in learning these two perturbations that involve the learning of different internal models (27), with joint redundancy being a common factor that confers greater flexibility to explore motor space. Additionally, we also observed differences in the degree of redundancy and learning across directions. Although these differences were not statistically significant (they were also poorly correlated), these results suggest that redundancy not only possesses an active component that correlates with learning but also a passive component that reflects differences in the biomechanics.

Although we observed strong correlations between joint redundancy and motor learning, our results did not show a correlation between task-space variability and motor learning. In contrast, recent work by Wu et al. (16), using both reinforcement learning and error-based supervised learning, emphasizes the selective role of task relevant variability in motor learning. Although the basis of differences between these studies remain unclear, it is interesting to note that other studies suggest that task variability does not correlate with motor learning (see ref. 32 for a meta-analysis). Further research would be required to reconcile these points of view. In addition, although it is not still mechanistically clear how joint redundancy facilitates motor learning, we suggest that such active exploration of task-irrelevant space may be essential to motor learning, while simultaneously ensuring optimal motor performance by minimizing task-space variability. This possibility notwithstanding, we believe that this relation between null-space variability and motor learning can be leveraged to enhance motor learning skills and motor rehabilitation.

Materials and Methods

Subjects.

All subjects were paid for participation and gave informed consent in accordance with the guidelines of the Human Ethics Committee of the Indian Institute of Science that approved the protocol. Sixty naïve subjects participated in the study (aged 22–70 y; 42 male and 18 female). In experiment 1, 40 subjects (30 male and 10 female, all right-handed) performed a visuomotor task and in experiment 2, 10 subjects (5 male and 5 female; all right-handed) performed a generalized visuomotor task. In experiment 3, 10 subjects (7 male and 3 female; 6 right-handed, 4 left-handed subjects) performed the force-field experiment first with their dominant and after a gap of 5 d with their nondominant hands. Handedness was tested using the modified EdinburghHandedness Index (33).

Experimental Setup.

In experiment 1, subjects sat on a chair with their hand placed on the table (Fig. S1A). A monitor that displayed the targets and the cursor movement was placed in front of the subjects. The experiment was performed using the psychophysics toolbox (34) that displayed visual stimuli, sampled, and stored the data and other behavioral parameters. Hand positions and joint angles were recorded using an electromagnetic position and orientation tracking device (Liberty;Polhemus).

In all other experiments, subjects sat on a chair while their chins were supported by a chin rest, and their heads were locked with head bars on both sides of their temple as shown in Fig. S1A. Subjects looked down on a semitransparent mirror on which they saw the targets while they moved a robotic arm handle (KINARM End-Point Robot; BKIN) in a horizontal plane below the plane of the mirror. Targets were presented by an inverted monitor above the mirror setup, which gave the impression that the targets appeared in a virtual plane below the mirror aligned to the plane in which the robotic arm handle moved. All experiments were performed using TEMPO/VideoSYNC software (Reflective Computing) that displayed visual stimuli and sampled and stored the data and other behavioral parameters in real time at a resolution of 1.04 ms. Hand positions and joint angles were recorded (spatial resolution of 7.62 mm) using an electromagnetic position and orientation tracking device (Liberty; Polhemus) interfacing with TEMPO in real time at 240 Hz.

Experimental Paradigm.

In experiment 1, trials were divided into three phases: baseline or preadaptation, adaptation, and postadaptation. All subjects performed 10 practice trials. Subjects performed about 100 trials per session, with a typical session lasting about 15 min. Each trial started with the presentation of a square fixation box (1 cm) at the center of a screen where subjects had to fixate both their hand and eye. After successful fixation, a square target of length 1 cm was displayed randomly in any one of two locations that uniformly spanned a circle of 20-cm radius around the central fixation box. Trials were aborted if a premature movement was made. Auditory feedback was given when the subject performed a trial correctly.

In all other experiments, trials were divided into three phases: baseline or preadaptation, adaptation, and postadaptation. All subjects performed 30 practice trials. Subjects performed about 400 trials per session, with a typical session lasting between 1.5–2 h. Each trial started with the presentation of a square fixation box (0.4 cm) at the center of a screen where the subjects had to fixate both their eye and the robotic end-effector. After successful fixation, a square target (0.7 cm) was displayed randomly in any one of eight locations that uniformly spanned a circle of 15-cm radius around the central fixation box. Similar to experiment 1, trials were aborted if a premature movement was made. Auditory feedback was given when the subject performed a trial correctly.

To minimize the effect of transfer of learning (35), subjects were always exposed to washout trials after perturbation trials. In addition, typically and 5-d gap was given between recording the dominant and nondominant hand.

Visuomotor Perturbation.

During visuomotor perturbation (29), the cursor movement is rotated according to Eq. 1,

[PxPy]=[cosθsinθsinθcosθ][pxpy], [1]

where Px,Py correspond to the position of the cursor, px,py correspond to the actual position of the hand, and θ denotes the perturbation angle about the center of work space with θ equal to 45°. This perturbation also led to a trajectory error and to compensate the subjects altered their hand trajectory.

Force-Field Perturbation.

During force-field perturbation (31), the robot produced viscous curl forces depending on the instantaneous hand velocity as in Eq. 2,

[FxFy]=[0KK0][x˙y˙], [2]

where Fx, Fy correspond to the forces exerted on the robotic arm, x˙, y˙ correspond to the velocity components of hand, and K denotes the force perturbation coefficient along the orthogonal directions with K equal to 20 Ns/m. This force-field perturbation disturbed the hand trajectory.

Quantifying Redundancy.

To calculate the joint-space variability in different directions, a 2D forward-kinematics model was created for the human arm. The model is given by

[xy]=[l1cos(θ1)+l2cos(θ2)+l3cos(θ3)+l4cos(θ4)l1sin(θ1)+l2sin(θ2)+l3sin(θ3)+l4sin(θ4)], [3]

where the four joints rotations are clavicle protraction–retraction (θ1), shoulder horizontal abduction–adduction (θ2), elbow flexion–extension (θ3), and wrist medial–lateral (θ4) (Fig. S1B). In experiment 1, we also incorporated a fifth joint-index figure abduction–adduction, and accordingly extended Eqs. 3 and 5. The distribution of variability in joint-space was computed for baseline trials for each of the different directions at the maximum reach velocity. The mean joint configuration across trials, along each of the directions, was computed at the peak velocity v and is denoted by θ¯v. The deviation of the joint configuration for a trial k, Δθk, is obtained by subtracting the joint configuration at the peak velocity, θkv, from the mean as below:

Δθk=θ¯vθkv. [4]

Based on the 2D forward-kinematics model, the Jacobian matrix at peak velocity was computed as

J(θ¯v)=[xθ1xθ2xθ3xθ4yθ1yθ2yθ3yθ4]. [5]

The joint configuration vector ξi lying in the null-space of the Jacobian matrix was computed from

J(θ¯v)ξi=0. [6]

For each trial, the sum of the component of Δθk along the null-space directions is given by

θR=i=1mΔθk,ξiξi,m=2or3. [7]

We quantify redundancy as the sum of the squares of θR across all of the trials divided by the number of trials n. Mathematically, this is written as

N(J)=i=1n(θR)2n. [8]

In this work, the scalar N(J) is used as a measure of redundancy space as θR, from which N(J) is derived, lies in the null-space, and does not affect task-space motion (Fig. S1C).

Task-Space Variability.

We quantified the task-space variability from the hand trajectory when it reached its peak velocity. The SD of the perpendicular distance of this point from the straight line joining the start and end of the trajectory was used as the metric of task-space variability.

Quantifying Learning.

The error at the peak velocity was calculated as the perpendicular distance of the hand trajectory at peak velocity from the straight line joining the central fixation box to the target location. The error, denoted by f(n), is related to the trial number by the following equation.

f(x)=aeβx. [9]

The above equation represents a first-order learning process, and in this work, we concentrate on β, which represents the intrinsic learning for a subject. To compute the population learning in perturbation trials, errors were fitted with an exponential fit using robust least-squares method, goodness of fit for the population learning curve for visuomotor learning (r2=0.95), generalized visuomotor learning (r2=0.90), and force-field learning (r2=0.93). To test for the significance of the fits, we plotted the logarithm of error f(n) versus the number of trials n assuming the above-mentioned exponential learning model. P values of the obtained linear regressions were <0.0005 in all experiment conditions.

Statistical Analysis.

All of the correlation analyses used Pearson’s correlation. For pairwise comparisons between groups, we first checked for normality in the data using the Lilliefors test, and when it satisfied normality, we performed a pairwise two-tailed t test.

Acknowledgments

We thank Dr. Atul Gopal PA for the initial setup of the experiment and Dr. Pratik Mutha and the reviewers for helpful comments on the paper. This work was supported by grants from the Robert Bosch Centre for Cyber Physical Systems (to A.G. and P.S.) and the Department of Biotechnology–Indian Institute of Science partnership program and by the Department of Science & Technology grant Intensification of Research in High Priority Area (to A.M.).

Footnotes

The authors declare no conflict of interest.

This article is a PNAS Direct Submission.

This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1613383113/-/DCSupplemental.

References

  • 1.Harris CM, Wolpert DM. Signal-dependent noise determines motor planning. Nature. 1998;394(6695):780–784. doi: 10.1038/29528. [DOI] [PubMed] [Google Scholar]
  • 2.Tseng Y, Scholz JP, Schoner G. Goal-equivalent joint coordination in pointing: Affect of vision and arm dominance. Motor Control. 2002;6(2):183–207. doi: 10.1123/mcj.6.2.183. [DOI] [PubMed] [Google Scholar]
  • 3.Haggard P, Hutchinson K, Stein J. Patterns of coordinated multi-joint movement. Exp Brain Res. 1995;107(2):254–266. doi: 10.1007/BF00230046. [DOI] [PubMed] [Google Scholar]
  • 4.Cole KJ, Abbs JH. Coordination of three-joint digit movements for rapid finger-thumb grasp. J Neurophysiol. 1986;55(6):1407–1423. doi: 10.1152/jn.1986.55.6.1407. [DOI] [PubMed] [Google Scholar]
  • 5.Black DP, Smith BA, Wu J, Ulrich BD. Uncontrolled manifold analysis of segmental angle variability during walking: Preadolescents with and without down syndrome. Exp Brain Res. 2007;183(4):511–521. doi: 10.1007/s00221-007-1066-1. [DOI] [PubMed] [Google Scholar]
  • 6.Yang JF, Scholz JP, Latash ML. The role of kinematic redundancy in adaptation of reaching. Exp Brain Res. 2007;176(1):54–69. doi: 10.1007/s00221-006-0602-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Park J, Wu YH, Lewis MM, Huang X, Latash ML. Changes in multifinger interaction and coordination in Parkinson’s disease. J Neurophysiol. 2012;108(3):915–924. doi: 10.1152/jn.00043.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nat Neurosci. 2002;5(11):1226–1235. doi: 10.1038/nn963. [DOI] [PubMed] [Google Scholar]
  • 9.Todorov E. Optimality principles in sensorimotor control. Nat Neurosci. 2004;7(9):907–915. doi: 10.1038/nn1309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Liu D, Todorov E. Evidence for the flexible sensorimotor strategies predicted by optimal feedback control. J Neurosci. 2007;27(35):9354–9368. doi: 10.1523/JNEUROSCI.1110-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Diedrichsen J, Shadmehr R, Ivry RB. The coordination of movement: Optimal feedback control and beyond. Trends Cogn Sci. 2010;14(1):31–39. doi: 10.1016/j.tics.2009.11.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Todorov E, Jordan MI. A minimal intervention principle for coordinated movement. In: Becker S, Thrun S, Obermayer K, editors. Advances in Neural Information Processing Systems 2002. Neural Information Processing Systems Foundation; La Jolla, CA: 2002. pp. 27–34. [Google Scholar]
  • 13.Scholz JP, Schöner G. The uncontrolled manifold concept: Identifying control variables for a functional task. Exp Brain Res. 1999;126(3):289–306. doi: 10.1007/s002210050738. [DOI] [PubMed] [Google Scholar]
  • 14.Latash ML, Scholz JP, Schöner G. Motor control strategies revealed in the structure of motor variability. Exerc Sport Sci Rev. 2002;30(1):26–31. doi: 10.1097/00003677-200201000-00006. [DOI] [PubMed] [Google Scholar]
  • 15.Latash ML, Scholz JP, Schoner G. Toward a new theory of motor synergies. Motor Control. 2007;11(3):276. doi: 10.1123/mcj.11.3.276. [DOI] [PubMed] [Google Scholar]
  • 16.Wu HG, Miyamoto YR, Castro LNG, Ölveczky BP, Smith MA. Temporal structure of motor variability is dynamically regulated and predicts motor learning ability. Nat Neurosci. 2014;17(2):312–321. doi: 10.1038/nn.3616. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Herzfeld DJ, Shadmehr R. Motor variability is not noise, but grist for the learning mill. Nat Neurosci. 2014;17(2):149–150. doi: 10.1038/nn.3633. [DOI] [PubMed] [Google Scholar]
  • 18.Tumer EC, Brainard MS. Performance variability enables adaptive plasticity of ‘crystallized’ adult birdsong. Nature. 2007;450(7173):1240–1244. doi: 10.1038/nature06390. [DOI] [PubMed] [Google Scholar]
  • 19.Cashaback JG, McGregor HR, Gribble PL. The human motor system alters its reaching movement plan for task-irrelevant, positional forces. J Neurophysiol. 2015;113(7):2137–2149. doi: 10.1152/jn.00901.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Therrien AS, Wolpert DM, Bastian AJ. Effective reinforcement learning following cerebellar damage requires a balance between exploration and motor noise. Brain. 2016;139(1):101–114. doi: 10.1093/brain/awv329. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Sutton RS, Barto AG. Reinforcement Learning: An Introduction. MIT Press; Cambridge, MA: 1998. [Google Scholar]
  • 22.Barto AG. Reinforcement learning control. Curr Opin Neurobiol. 1994;4(6):888–893. doi: 10.1016/0959-4388(94)90138-4. [DOI] [PubMed] [Google Scholar]
  • 23.Sainburg RL. Evidence for a dynamic-dominance hypothesis of handedness. Exp Brain Res. 2002;142(2):241–258. doi: 10.1007/s00221-001-0913-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Whiting HTA. Human Motor Actions: Bernstein Reassessed. Vol 17 Elsevier; Amsterdam: 1983. [Google Scholar]
  • 25.Latash ML. Synergy. Oxford Univ Press; New York: 2008. [Google Scholar]
  • 26.Shadmehr R, Smith MA, Krakauer JW. Error correction, sensory prediction, and adaptation in motor control. Annu Rev Neurosci. 2010;33:89–108. doi: 10.1146/annurev-neuro-060909-153135. [DOI] [PubMed] [Google Scholar]
  • 27.Krakauer JW, Ghilardi MF, Ghez C. Independent learning of internal models for kinematic and dynamic control of reaching. Nat Neurosci. 1999;2(11):1026–1031. doi: 10.1038/14826. [DOI] [PubMed] [Google Scholar]
  • 28.Krakauer JW, Pine ZM, Ghilardi MF, Ghez C. Learning of visuomotor transformations for vectorial planning of reaching trajectories. J Neurosci. 2000;20(23):8916–8924. doi: 10.1523/JNEUROSCI.20-23-08916.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Mazzoni P, Krakauer JW. An implicit plan overrides an explicit strategy during visuomotor adaptation. J Neurosci. 2006;26(14):3642–3645. doi: 10.1523/JNEUROSCI.5317-05.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Smith MA, Ghazizadeh A, Shadmehr R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol. 2006;4(6):e179. doi: 10.1371/journal.pbio.0040179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Shadmehr R, Mussa-Ivaldi FA. Adaptive representation of dynamics during learning of a motor task. J Neurosci. 1994;14(5):3208–3224. doi: 10.1523/JNEUROSCI.14-05-03208.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.He K, et al. The statistical determinants of the speed of motor learning. PLoS Comput Biol. 2016;12(9):e1005023. doi: 10.1371/journal.pcbi.1005023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Salmaso D, Longoni AM. Problems in the assessment of hand preference. Cortex. 1985;21(4):533–549. doi: 10.1016/s0010-9452(58)80003-9. [DOI] [PubMed] [Google Scholar]
  • 34.Brainard DH. The psychophysics toolbox. Spat Vis. 1997;10:433–436. [PubMed] [Google Scholar]
  • 35.Criscimagna-Hemminger SE, Donchin O, Gazzaniga MS, Shadmehr R. Learned dynamics of reaching movements generalize from dominant to nondominant arm. J Neurophysiol. 2003;89(1):168–176. doi: 10.1152/jn.00622.2002. [DOI] [PubMed] [Google Scholar]

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES