
Keywords: computational model, electromyography, human-human interaction, muscle coactivation, visuo-haptic perception
Abstract
When moving a piano or dancing tango with a partner, how should I control my arm muscles to sense their movements and follow or guide them smoothly? Here we observe how physically connected pairs tracking a moving target with the arm modify muscle coactivation with their visual acuity and the partner’s performance. They coactivate muscles to stiffen the arm when the partner’s performance is worse and relax with blurry visual feedback. Computational modeling shows that this adaptive sensing property cannot be explained by the minimization of movement error hypothesis that has previously explained adaptation in dynamic environments. Instead, individuals skillfully control the stiffness to guide the arm toward the planned motion while minimizing effort and extracting useful information from the partner’s movement. The central nervous system regulates muscle activation to guide motion with accurate task information from vision and haptics while minimizing the metabolic cost. As a consequence, the partner with the most accurate target information leads the movement.
NEW & NOTEWORTHY Our results reveal that interacting humans inconspicuously modulate muscle activation to extract accurate information about the common target while considering their own and the partner’s sensorimotor noise. A novel computational model was developed to decipher the underlying mechanism: muscle coactivation is adapted to combine haptic information from the interaction with the partner and own visual information in a stochastically optimal manner. This improves the prediction of the target position with minimal metabolic cost in each partner, resulting in the lead of the partner with the most accurate visual information.
INTRODUCTION
Human muscles are elastic elements that increase stiffness and shorten with activation (1). The central nervous system (CNS) regulates the limbs’ stiffness by coordinating muscle activation to shape the interaction with the environment (2, 3), but how this affects haptic sensing is not known. When two connected individuals carry out a task together (Fig. 1A), they exchange haptic information about their motion plan to combine with own visual information and improve their accuracy (4). Critically, haptic information transferred by the mechanical connection is modulated by their muscle coactivation (Fig. 1B). Could individuals regulate their muscles’ activation to adapt the limbs’ stiffness and better sense the partner’s movement?
Figure 1.
Experiment to study how muscle coactivation varies during the joint tracking of 2 connected humans. A: the partners track the same randomly moving target with their wrist flexion-extension movement while being connected with a rigid virtual bar. Their wrist flexion/extension movement is recorded, as well as the myoelectrical activity of a flexor-extensor muscle pair. EMG, electromyogram. B: diagram of mechanical interaction with the partner and with own movement plan. The interaction with the partner’s hand depends on the stiffness of the connection to their motion plan modulated by their coactivation u. Both own and partner movement plans are affected by the respective visual noise. C: protocol of the experiment to study the effect of visual noise on either partner’s performance and coactivation.
To understand how physically connected individuals control their arm coactivation, we observed 22 pairs of subjects or dyads tracking a common randomly moving target using wrist flexion and extension (Ref. 5, Fig. 1A). Studies on the adaptation to unpredictable force fields (6, 7) suggest that muscle coactivation would increase with the magnitude of error to their motion plan (3) independent of its source. However, we hypothesized that interacting humans can adapt their muscle coactivation to their own sensorimotor noise and to haptic noise resulting from the interaction with the partner.
To test this hypothesis, we carried out an experiment in which the visual feedback provided to the partners was manipulated. The target observed by each partner on their individual monitor was either sharp (a 8-mm large disk) or fuzzy (a dynamic cloud of 8 normally distributed dots). We analyzed the tracking performance and wrist muscle activation of each partner and developed a computational model to understand how muscle activation is adapted to each specific noise condition.
METHODS
Participants
The experiment was approved by the Joint Research Compliance Office at Imperial College London. Forty-four participants without known sensorimotor impairments aged 18–37 yr, including 16 females, were recruited. Each participant gave written informed consent before participation. Thirty-seven participants were right-handed, five left-handed, and two ambidextrous, as assessed with the Edinburgh Handedness Inventory (8). The participants carried out the experiment in pairs or dyads. To avoid sex-related effects on the interaction behavior (9), the experiment was carried out by same-sex dyads.
Experimental Setup
The two partners of each dyad were seated on height-adjustable chairs, next to the Hi5 dual robotic interface (10). They held their respective handle with the wrist of the dominant hand and received visual feedback of the flexion/extension movement on a personal monitor (Fig. 1A). No visual feedback of the partner’s position was available as the two participants were separated by a curtain, and they were instructed not to speak to each other during the experiment.
Each Hi5 handle is connected to a current-controlled DC motor (MSS8; Mavilor) that can exert torques of up to 15 Nm and is equipped with a differential encoder (RI 58-O; Hengstler) to measure the wrist angle and a sensor (TRT-100; Transducer Technologies) to measure the exerted torque in the range [0,11.29] Nm. The two handles were controlled at 1 kHz with LabVIEW Real-Time v14.0 (National Instruments) and a data acquisition board (DAQ-PCI-6221; National Instruments) while the data were recorded at 100 Hz.
The activation of two antagonist wrist muscles, the flexor carpi radialis (FCR) and extensor carpi radialis longus (ECRL), was recorded during the movement from each participant. Electromyographic (EMG) signals were measured with surface electrodes using the medically certified noninvasive 16-channel EMG system (10). The EMG data were recorded at 100 Hz.
Tracking Task
The two partners were required to track the same visual target “as accurately as possible” on their respective monitor with (in degrees)
| (1) |
using flexion-extension movements (where t is the time). To prevent the participants from memorizing the target’s motion, t* started in each trial from a randomly selected offset time {t0 ∈ [0, 20]s|q*(t0) ≡ 0} of the multisine function. The respective tracking error
| (2) |
was displayed at the end of each 20-s-long trial.
After each trial, the target disappeared and the participants had to place their respective cursor on the starting position at the center of the screen. The next trial then started after a 5-s rest period and a 3-s countdown. The initialization of the next trial started when both participants placed their wrist on the starting position, so that each participant could take a break at will between trials by keeping the cursor away from the center of the screen.
Experimental Conditions and Protocol
In solo trials, the two partners moved the wrist independently of each other. In interactive trials, the partners’ wrists were connected by a stiff virtual spring with torque (in Nm)
| (3) |
where qo and qp (in degrees) denote own and partner’s wrist angles, respectively.
The interaction trials were carried out under two different visual feedback conditions. In the sharp condition the target was displayed as an 8-mm-diameter disk. In the fuzzy condition the target trajectory was displayed with eight normally distributed dots around the target. The cloud of dots was defined by three parameters, randomly picked from independent Gaussian distributions: the vertical distance to the target position η ∈ N(0, 15 mm), the angular distance to the target position ηq ∈ N(0, 4.58°), and the angular velocity ηq ∈ N(0, 4.01°/s). Each of the eight dots was sequentially replaced every 100 ms.
A calibration of the measured EMG (described in Muscle Activation Calibration and Cocontraction Calculation) was first carried out to map the raw EMG signal (in mV) to a corresponding torque value (in Nm), so that the activity of each participant’s flexor and extensors can be compared and combined in the data analysis. After this calibration, the participants carried out five initial solo trials to learn the tracking task and the dynamics of the wrist interface. This was followed by four blocks of 10 interaction trials, each with one of the four different noise conditions [fuzzy(self)-sharp(partner): FS, SF, SS, FF] presented in a random order, followed by five control solo trials (Fig. 1C). The participants were informed when an experimental condition would be changed but not that they were connected to the partner or which condition they would be encountering in the next trials.
Muscle Activation Calibration and Cocontraction Calculation
The participants placed their wrist in the most comfortable middle posture, set to 0°. Constrained at that posture, they were then instructed to sequentially flex or extend the wrist to exert torque. Each phase was 4 s long and was followed by a 5-s rest period to avoid fatigue. The latter period was used as a reference activity in the relaxed condition. This procedure was repeated four times at flexion/extension torque levels of {1,2,3,4} Nm and {−1,−2,−3,−4} Nm, respectively.
The recorded muscle activity of each participant was then linearly regressed against the torque values. The raw EMG signal was 1) high-pass filtered at 20 Hz by using a second-order Butterworth filter to remove drifts in the EMG and 2) rectified and passed through a low-pass second-order Butterworth filter with a 5-Hz cutoff frequency to obtain the envelope of the EMG activity.
The torque of the flexor muscle could then be modeled from the envelope of the EMG activity uf as
| (4) |
and similarly for the torque of the extensor muscle τe. The torque due to reciprocal activation of the FCR [with τf(t) ≥ 0] and ECRL [τe(t) ≤ 0] was computed as
| (5) |
and the torque due to muscle coactivation as
| (6) |
The average coactivation over all participants (as shown in Fig. 2) was computed from each participant’s normalized coactivation
| (7) |
with and the minimum and maximum of the means of all trials of the specific participant.
Figure 2.
A: evolution of group mean tracking error charted as a function of trials, where error bars represent 1 SE. The error saturated in the initial solo trials and increased with visual and haptic noise. B: evolution of normalized cocontraction as a function of trials, where error bars represent 1 SE.
EXPERIMENTAL RESULTS
To evaluate the short-term adaptation within each condition, analysis was carried out on the average measurements from the first and second half of trials (epochs). As the tracking error and muscle cocontraction were influenced by both the subject’s own visual noise and the partner’s visual noise (perceived through the spring interaction as haptic noise), they were analyzed individually with a three-way repeated-measures ANOVA with visual noise, haptic noise, and epoch as the factors in the analysis of the tracking error and cocontraction level. Bonferroni–Holm correction was used to correct for type I error in multiple post hoc comparisons for each metric.
We see in Fig. 2A that the error had decreased by the last of the initial solo trials to the same degree as the average of the last solo trials (P = 0.27, paired-samples Wilcoxon test). This indicates stable performance to analyze the different interaction conditions. The ANOVA of tracking error in these conditions indicated that the magnitude of the tracking error depended on both visual noise level [F(1,43) = 359.95, P < 0.001, = 0.21] and haptic noise level [F(1,43) = 210.46, P < 0.001, = 0.12]. There was an interaction effect between visual and haptic noise [F(1,43) = 14.83, P < 0.001, = 0.008]. Post hoc comparisons showed that there was no significant difference between noise conditions SF and FS (P = 0.14), while both were greater than in the SS condition (P < 0.001) and smaller than in the FF condition (P < 0.001). The tracking error remained at a similar level between the first and the second epochs (P = 0.38), and there was no interaction effect between either noise level and epoch (P > 0.15). Note that the connection with the partner improved the tracking performance, so that the error was smaller in the SS condition than in the solo condition [paired t test, t(43) = 6.22, P < 0.001]. This confirms observations in a similar task carried out on different setups (4, 11, 12).
The cocontraction level decreased with the epoch [F(1,43) = 53.58, P < 0.0005, = 0.56], similar to what was observed during the learning of force fields (3, 13) (Fig. 2B). Importantly, the cocontraction decreased with a larger level of own visual noise [F(1,43) = 85.91, P < 0.0005, = 0.67], whereas it increased with haptic noise from the interaction with the partner [F(1,43) = 5.53, P < 0.03, = 0.11]. Post hoc comparisons confirmed that all differences between the combinations of the visual and haptic noises were significant, with the exception of FS versus FF (P = 0.99).
To analyze how this adaptation is affected by the wrist antagonist muscles, we computed their reciprocal activation (RA, defined in Eq. 5) and coactivation (CA, Eq. 6) in the last trial. As shown in Fig. 3A, the mean RA over the subjects varied (with standard deviation 0.5 Nm) much more than the CA (standard deviation 0.1 Nm). Furthermore, RA was well correlated with the hand trajectory (|Pearson correlation| > 0.8 with P < 0.05), but CA was not correlated (|correlation| < 0.1 with P < 0.05). Figure 3B shows that RA exhibited a spectrum similar to the target trajectory, with peaks around 0.15 Hz and 0.5 Hz, whereas the spectrum of CA was essentially flat, exhibiting only a much smaller peak around 0.5 Hz. These results show that the RA was driving the tracking movement whereas the level of CA was regulated specifically to each noise condition.
Figure 3.
Activation of antagonist wrist muscles in the last trial. A: reciprocal activation (RA) and coactivation (CA) in the last trial averaged over subjects. The waveforms were aligned in time before averaging to compensate for the different temporal delays in Eq. 1. Selecting the first 10 s in aligned waveform enables us to consider 25 of the 44 subjects for the averaging. B: the RA spectrum exhibits the same peaks as the target movement, whereas the CA spectrum is essentially flat.
In summary, the experimental results indicate that during interaction the CNS spontaneously regulated muscle coactivation considering the level of the visual noise on one’s own and the partner’s targets, in agreement with our hypothesis. As a consequence, the partner with more accurate visual information increases their coactivation and thus their stiffness (14) and leads the movement. Conversely, the partner with less accurate visual information decreases their stiffness and thus their influence on the dyad’s motion control. The interactive behavior of the dyad results from the equilibrium of the coactivation adaptation in the two partners modulated by their respective sensory noise.
COMPUTATIONAL MODELING
What is the principle behind this adaptation? As the participants were not aware of the connection with the human partner (11), would coactivation be adapted as when interacting with a dynamic environment? Therefore we first tested the computational model of Ref. 3 that explains the motor learning in novel force fields. In this model, the coactivation u increases with each new trial to minimize tracking error e and decreases to minimize effort, according to
| (8) |
For each of the four noise conditions ij ∈ {SS, SF, FS, FF}, the initial cocontraction level was set as the initial experimental value . Then, by using the respective trial-by-trial tracking error {eij(k)}, k = 1,…, 10 from the experiment, the adaptation parameters α,γ in the computational model of Eq. 8 were computed to minimize the error between the learned cocontraction values after 9 iterations and the corresponding data in last experiment’s trial:
| (9) |
The parameters α* ≡ 0.5, γ* ≡ 0.06 were found by using a grid search with a step 0.01 in the range [0,2] × [0,1.5].
Simulation of the learning during the 10 trials of each condition with this tracking error minimization (TEM) model predicted cocontraction at a level increasing with the corresponding tracking error (Fig. 4A). This prediction is qualitatively different from the data, such as larger coactivation in the fuzzy relative to the sharp visual feedback condition (e.g., compare the FF and SS conditions in Fig. 4A). Therefore, the TEM model cannot explain the adaptation in the coactivation during interaction.
Figure 4.
Results of computational modeling of the coactivation adaptation to own and partner noise. A: comparison of coactivation observed during the experiment and predicted by the 2 models described in the text. The tracking error minimization (TEM) model cannot catch the modulation of coactivation with different noise conditions observed in the data, whereas the optimal information and effort (OIE) model predicts their trend well. B: the OIE model predicts a decrease of coactivation with own noise and an increase with partner noise.
The hand movement depends on the guidance toward the planned movement and on the connection to the partner (Fig. 1B). As the stiffness of the guidance increases with own coactivation (2), it is possible to weigh these two influences. Coactivation should decrease to lower the guidance to the planned movement when it is affected by visual noise. Conversely, the guidance to the planned motion should increase to counteract the effect of haptic noise when the partner receives noisy visual feedback. Therefore, the coactivation may depend both on the statistical information determining the quality of the planned motion, which relies primarily on vision, and on the partner’s accuracy in tracking the common target.
We thus propose that coactivation is modulated to maximize information from visual information and haptic information from the interaction with the partner. We introduce the optimal information and effort (OIE) model that addresses the trade-off between motion guidance and interaction noise attenuation, by selecting coactivation u to minimize the prediction error E(u) and metabolic cost u2, with the cost function
| (10) |
where σo(u) results from the effect of own visual noise on the arm movement and σp from the interaction with the partner. This minimization can be carried out through gradient descent minimization:
| (11) |
The target tracking arises from the internal guidance to the planned motion and the mechanical connection with the partner, both being subjected to the noise in the respective visual feedback (Fig. 1B).
How should the deviation σo be modeled? First, let σνo describe the tracking deviation of own wrist movement due to the target cloud. Second, the wrist’s compliance influences the tracking performance and brings in noise in the planned movement (5). Assuming that these two effects are independent and that the wrist’s viscoelasticity results in zero mean noise with deviation σκo(u), the deviation in the wrist can be calculated as
| (12) |
where σκo(u) = 5.18 + 49.65e−6.11u was identified as the least-square fit of data from the haptic experiment in Ref. 15.
Considering the relationship between the deviation σκo and the wrist’s viscoelasticity, the visual noise deviation and the partner’s noise deviation each have two values, resulting in four parameters to identify: , where “s” corresponds to the sharp and “f” to the cloudy target. These parameters, used in the noise models of Eq. 12, were computed by minimizing the variation of the cost derivative:
| (13) |
Using the collected cocontraction data {uij(10)}, a grid search for with manually presearched range in [0,12] × [0,20] × [0,10] × [0,20] with step 0.2 yields , where for each grid point γ* = 0.65 was the solution of
| (14) |
As can be seen in Fig. 4A, the OIE model predicts the modulation of coactivation with both own visual noise and haptic noise from the partner as observed in the data, in contrast to the TEM model. The adequacy of the OIE is further shown from the Akaike information criterion (AIC): the small sample size-normalized AIC value (16, 17) using OIE model prediction is −6.2, smaller than the value of −2.8 for the TEM model, suggesting that OIE is a better model than TEM considering the information loss and the number of independent parameters. The OIE model can be used to predict the coactivation for any level of own and partner’s noise, as shown in Fig. 4B.
DISCUSSION
These experimental and computational results demonstrate that interacting humans modulate their muscles’ activation to extract accurate information about the common target considering own and partner’s noise. Although it has been known that muscles’ activation is adapted to shape the mechanical interaction with the environment (2, 7), our results reveal that the CNS further regulates the limbs’ viscoelasticity to extract optimal sensory information from the interaction. Not only do individuals share haptic information to extract each other’s motion plan (4), but they further learn muscle activation to improve this estimation.
These results could not be explained by previous models of coactivation adaptation in dynamic environments, which consider only the error in the task performance (3, 18, 19). However, the observed coactivation changes with both own and partner’s noise were well predicted by the OIE model introduced in this article. The OIE adapts coactivation to maximize information from vision and haptics arising from the interaction with the partner while minimizing energy by reducing coactivation.
This mechanism skillfully regulates coactivation to extract maximum sensory information while exploiting the guidance potential from the partner: Coactivation decreases to rely more on the partner guidance when vision is fuzzy and increases when the interaction with the partner is noisy. As end-point stiffness increases with the coactivation (14), the partner with more accurate information appears to lead the movement. This “leadership” does not depend on any partner’s character but relies on the quality of sensory information in the partners. The interactive behavior then results from the concurrent adaptation of muscle activation in the partners induced by their respective sensory noise, where the more skilled partner increases their coactivation and thus their lead and the less skilled partner decreases coactivation and thus their influence on the dyad’s motion control. While these results were observed in a collaborative task, dyads with conflicting goals may use more complex strategies.
The OIE model, specifying how the CNS adapts coactivation to minimize prediction error and energy, extends previous work on motor learning and adaptation. Although the models in Refs. 20, 21 could determine the motion kinematics in the next trial from the movement error in previous trials, this new model also considers the limbs’ neuromechanics and can thus predict the interaction force and the subsequent muscle activity during motion. The OIE also extends optimal and nonlinear adaptive control models (3, 19, 22–24) by considering the consequence of action on the acquired sensory information from the environment, closing the loop between the sensory and motor actions. This adaptive sensing mechanism may give rise to interactive robots that can modify their rigidity to optimally sense their user and best assist them.
DATA AVAILABILITY
Data will be made available upon reasonable request.
GRANTS
This work was supported in part by the EC H2020 Grants PH-CODING (FETOPEN 829186), CONBOTS (ICT 871803), and REHYB (ICT 871767).
DISCLOSURES
No conflicts of interest, financial or otherwise, are declared by the authors.
AUTHOR CONTRIBUTIONS
H.B., G.C., S.H., S.E. and E.B. conceived and designed research; H.B. performed experiments; H.B., G.C., X.C., A.T., S.E., and E.B. analyzed data; H.B., G.C., X.C., A.T., S.H., and E.B. interpreted results of experiments; H.B., G.C., X.C., and E.B. developed the computational modeling; H.B., X.C., and E.B. prepared figures; G.C., X.C., S.E., and E.B. drafted manuscript; H.B., G.C., X.C., A.T., S.H., S.E., and E.B. edited and revised manuscript; H.B., G.C., X.C., A.T., S.H., S.E., and E.B. approved final version of manuscript.
ACKNOWLEDGMENTS
We thank Jonathan Eden for editing the text, Ganesh Gowrishankar for discussions on the results, and Katja Ivanova for advice on the statistics.
REFERENCES
- 1. Kirsch RF, Boskov D, Rymer WZ. Muscle stiffness during transient and continuous movements of cat muscle: perturbation characteristics and physiological relevance. IEEE Trans Biomed Eng 41: 758–770, 1994. doi: 10.1109/10.310091. [DOI] [PubMed] [Google Scholar]
- 2. Hogan N. Adaptive control of mechanical impedance by coactivation of antagonist muscles. IEEE Trans Automat Contr 29: 681–690, 1984. doi: 10.1109/TAC.1984.1103644. [DOI] [Google Scholar]
- 3. Franklin DW, Burdet E, Tee KP, Osu R, Chew C-M, Milner TE, Kawato M. CNS learns stable, accurate, and efficient movements using a simple algorithm. J Neurosci 28: 11165–11173, 2008. doi: 10.1523/JNEUROSCI.3099-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Takagi A, Ganesh G, Yoshioka T, Kawato M, Burdet E. Physically interacting individuals estimate the partner’s goal to enhance their movements. Nat Hum Behav 1: 0054, 2017. doi: 10.1038/s41562-017-0054. [DOI] [Google Scholar]
- 5. Takagi A, Usai F, Ganesh G, Sanguineti V, Burdet E. Haptic communication between humans is tuned by the hard or soft mechanics of interaction. PLoS Comput Biol 14: e1005971, 2018. doi: 10.1371/journal.pcbi.1005971. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Takahashi CD, Scheidt RA, Reinkensmeyer DJ. Impedance control and internal model formation when reaching in a randomly varying dynamical environment. J Neurophysiol 86: 1047–1051, 2001. doi: 10.1152/jn.2001.86.2.1047. [DOI] [PubMed] [Google Scholar]
- 7. Burdet E, Osu R, Franklin DW, Milner TE, Kawato M. The central nervous system stabilizes unstable dynamics by learning optimal impedance. Nature 414: 446–449, 2001. doi: 10.1038/35106566. [DOI] [PubMed] [Google Scholar]
- 8. Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9: 97–113, 1971. doi: 10.1016/0028-3932(71)90067-4. [DOI] [PubMed] [Google Scholar]
- 9. Takagi A. Mechanism of Interpersonal Sensorimotor Interaction (PhD thesis). London: Imperial College of Science, Technology and Medicine, 2015. [Google Scholar]
- 10. Melendez-Calderon A, Bagutti L, Pedrono B, Burdet E. Hi5: a versatile dual-wrist device to study human-human interaction and bimanual control. IEEE Int Conf Intell Robots Syst 2011: 2578–2583, 2011. doi: 10.1109/IROS.2011.6094422. [DOI] [Google Scholar]
- 11. Ganesh G, Takagi A, Osu R, Yoshioka T, Kawato M, Burdet E. Two is better than one: physical interactions improve motor performance in humans. Sci Rep 4: 3824, 2014. doi: 10.1038/srep03824. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Beckers N, Van Asseldonk EH, van der Kooij H. Haptic human–human interaction does not improve individual visuomotor adaptation. Sci Rep 10: 19902, 2020. doi: 10.1038/s41598-020-76706-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Thoroughman KA, Shadmehr R. Electromyographic correlates of learning an internal model of reaching movements. J Neurosci 19: 8573–8588, 1999. doi: 10.1523/JNEUROSCI.19-19-08573.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Franklin DW, So U, Kawato M, Milner TE. Impedance control balances stability with metabolically costly muscle activation. J Neurophysiol 92: 3097–3105, 2004. doi: 10.1152/jn.00364.2004. [DOI] [PubMed] [Google Scholar]
- 15. Carboni G, Nanayakkara T, Takagi A, Burdet E. Adapting the visuo-haptic perception through muscle coactivation. Sci Rep 11: 21986, 2021. doi: 10.1038/s41598-021-01344-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Portet S. A primer on model selection using the Akaike Information Criterion. Infect Dis Model 5: 111–128, 2020. doi: 10.1016/j.idm.2019.12.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Cohen N, Berchenko Y. Normalized information criteria and model selection in the presence of missing data. Mathematics 9: 2474, 2021. doi: 10.3390/math9192474. [DOI] [Google Scholar]
- 18. Theodorou EA, Büchli J, Schaal S. A generalized path integral control approach to reinforcement learning. J Mach Learn Res 11: 3137–3181, 2010. [Google Scholar]
- 19. Li Y, Ganesh G, Jarrasse N, Haddadin S, Albu-Schaeffer A, Burdet E. Force, impedance, and trajectory learning for contact tooling and haptic identification. IEEE Trans Robot 34: 1170–1182, 2018. doi: 10.1109/TRO.2018.2830405. [DOI] [Google Scholar]
- 20. Herzfeld DJ, Vaswani PA, Marko MK, Shadmehr R. A memory of errors in sensorimotor learning. Science 345: 1349–1353, 2014. doi: 10.1126/science.1253138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Takiyama K, Hirashima M, Nozaki D. Prospective errors determine motor learning. Nat Commun 6: 5925, 2015. doi: 10.1038/ncomms6925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Nelson WL. Physical principles for economies of skilled movements. Biol Cybern 46: 135–147, 1983. doi: 10.1007/BF00339982. [DOI] [PubMed] [Google Scholar]
- 23. Harris CM, Wolpert DM. Signal-dependent noise determines motor planning. Nature 394: 780–784, 1998. doi: 10.1038/29528. [DOI] [PubMed] [Google Scholar]
- 24. Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nat Neurosci 5: 1226–1235, 2002. doi: 10.1038/nn963. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data will be made available upon reasonable request.




