Abstract
In order to intercept moving objects, we need to predict the spatiotemporal features of the motion of both the object and our hand. Our errors can result in updates of these predictions to benefit interceptions in the future (adaptation). Recent studies claim that task-relevant variability in baseline performance can help adapt to perturbations, because initial variability helps explore the spatial demands of the task. In this study, we examined whether this relationship is also found in interception (temporal domain) by looking at the link between the variability of hand-movement speed during baseline trials, and the adaptation to a temporal perturbation. 17 subjects performed an interception task on a graphic tablet with a stylus. A target moved from left to right or vice versa, with varying speed across trials. Participants were instructed to intercept this target with a straight forward movement of their hand. Their movements were represented by a cursor that was displayed on a screen above the tablet. To prevent online corrections we blocked the hand from view, and a part of the cursor’s trajectory was occluded. After a baseline phase of 80 trials, a temporal delay of 100 ms was introduced to the cursor representing the hand (adaptation phase: 80 trials). This delay initially caused participants to miss the target, but they quickly accounted for these errors by adapting to most of the delay of the cursor. We found that variability in baseline movement velocity is a good predictor of temporal adaptation (defined as a combination of the rate of change and the asymptotic level of change after a perturbation), with higher variability during baseline being associated with better adaptation. However, cross-correlation results suggest that the increased variability is the result of increased error correction, rather than exploration.
Introduction
The human race is remarkably skilled in timing tasks like catching or hitting a ball [1, 2]. However, large inter-individual differences can be observed when it comes to these skills. To become successful at ball sports, a person needs to be able to accurately account for continuous changes in both the environment and their own body. To this end, we can use sensory feedback to guide our movement [3]. However, sensory feedback from our movements is processed by our brain with a delay that can reach up to about 150 ms [4–6]. This can lead to unstable movements, because corrections to errors are initiated with a delay. In order to not only rely on sensory feedback and select appropriate motor commands, we are thought to be able to predict the sensory consequences of these motor commands. Studies have shown that our brain maintains an internal forward model that holds the predictions regarding the sensory consequences [7, 8]. However, the outcome of a motor command can change due to systematic disturbances like fatigue in the muscles [9]. Accurate timing of our motor commands in a dynamic world requires continuous evaluation and updating of the predicted consequences of these motor commands [10]. This can be done by evaluating the difference between the actual and the predicted sensory consequences of a motor command (the prediction error [7, 11]). However, prediction errors do not always stem from incorrect motor commands. Noise can come from different stages of the sensorimotor process [12, 13]. Different types of noise associated with neural processes like movement planning [14–18] or execution [19–21] cause variability. In addition, trial-to-trial variability in the outcome of the movement can be caused by inaccurate estimates of the task requirements [22] and disturbances from the outside world [23]. Errors caused by these types of noise do not necessarily require updates of the internal model.
Updating the forward model is generally thought to be done by decreasing the prediction error over time (error-based learning) [24, 25]. Dominant theories in the field of motor control suggest that error correction is an optimal process [26, 27]. The amount of error correction depends on the reliability of the predicted sensory consequences and the reliability of the received sensory consequences [28]. However, in situations in which error feedback is unavailable or uninformative, the environment needs to be explored in order to find and exploit the most beneficial solution. This type of process is called reinforcement learning [29, 30]. It can also be beneficial in situations where the average end-point error is zero, but the movement is still updated in order to become more efficient [31]. Reinforcement learning, specifically exploration, usually leads to enhanced variability in the explored dimension of the behavior. Furthermore, research suggest that the nervous system could actively regulate this process when needed [32]. For this reason, we hereafter use exploration strategies to refer to the active process of learning through exploration. Some studies have found that reinforcement learning could also accelerate learning in error-based learning tasks [32]. More specifically, a benefit of task-specific baseline variability in adaptation during spatial perturbation paradigms has been found. This means that even if sensory feedback is available to the participant, more variability in the task-specific dimension could facilitate learning. It is thought that the brain has a memory of previously encountered errors [33]. Similarly, it has been proposed that predicted (future) errors might activate learned weights for motor primitives (neural mechanism that coordinate a set of movements rather than independent movements), which could elevate learning [34]. In line with this idea, reinforcement learning could lead to more experience with different movement errors and facilitate correcting future errors [35]. However, the idea that increased variability leads to better adaptation has been questioned by other studies claiming that variability originates from the different types of noise coming from motor control processes, which can have either positive, neutral or negative effects on adaptation [13].
Thus, the role of variability on adaptation is still under debate. The main question remains, can variability caused by exploration strategies directly benefit the updating of the forward model of a motor command, or are the two merely a result of error correction strategies? So far, the main focus of these studies has been the role of spatial and force-field perturbations. However, as large delays are inherent to the sensorimotor system and to contemporary electronic devices, temporal perturbation tasks have given great insights into adaptation in this domain [36–39]. It therefore is valuable to examine if task-specific variability in temporal features of movement can predict adaptation to these delays. Temporal perturbations (delays) require humans to identify a new temporal relationship between the motor command and the sensory consequences. The effect of delays on the spatial prediction error is increased with higher movement speeds (i.e. moving faster increases the gap between hand and delayed feedback), while lower speeds have less effect on the size of the prediction error. Variability in movement speed can therefore help to explore this temporal relationship, and benefit the examination of newly introduced delays. If exploration itself provides a benefit in adaptation, we do not expect the movement speed to be systematically related to previously encountered errors. However, a recent study by [40] found that error correction strategies could explain differences of the learning rate in a balancing task. If error correction rather than exploration is the main benefit for adaptation, higher rates of error correction are to be expected throughout the baseline for people that adapt more. The aim of the study was to examine if higher baseline movement speed variability can predict adaptation in a temporal timing task. As we found a positive relationship, we followed up this analysis by examining if this relationship was the result of exploratory behavior, or if higher variability might be the result of increased error correction.
Materials and methods
Participants
20 students of the university of Barcelona (20.3 ±SD 2.3 years; 15 female) participated in the experiment. All participants gave written consent. In order to be eligible for inclusion, participants’ vision and hearing needed to be normal or corrected to normal, and they needed to be free from movement restrictions or problems. The study was part of a program that has been approved by The University of Barcelona Bioethics Committee (CBUB) (Insitutional review board IRB 00003099) and was conducted in accordance to the Declaration of Helsinki.
Apparatus
The setup of the experiment is shown in Fig 1A. Participants were seated in front of a graphic tablet (Calcomp Drawing Tablet III 24240), which recorded the movements of a hand-held stylus that the participants used in the experiments. A half-silvered upward facing mirror was located above the graphic tablet. Above the mirror, a projector displayed an image of the task onto a horizontal back-projection screen, at a frame rate of 72 Hz and a resolution of 800 by 600 pixels. The participant could see the reflection of this image in the mirror. The hand and the hand-held stylus were blocked from view by the mirror. A Macintosh Pro 2.6-GHz Quad-Core computer recorded the position of the stylus at 125 Hz and controlled the projected image. We calibrated the setup by aligning the position of the stylus with the location of five projected dots. This calibration allowed us to accurately display a cursor that represented the location of the stylus above the graphic tablet. The projected background was black (depicted as gray in Fig 1A). The feedback had a systematic delay of approximately 40 ms with relation to the hand movement. This value was determined before the start of the study with an interception task (similar to the one described below), in which we compared the stylus position and the target location on trials in which participants indicated they had hit the target. The system delay will have been corrected for in all of the future display and analysis of the data.
Task
Fig 1 shows the setup and the procedure for the experiment. The goal of the task was to intercept a target (white dot) on the screen with the cursor (red dot), that followed the movement of the hand. In order to start a trial, the participant had to move the cursor to the starting position (Fig 1B-1). A high-pitched sound marked the start of the trial. Randomly across trials, the target would move from left to right or vice versa at one of 3 different speeds (17.5, 22.5 or 27.5 cm/s). The three different speeds were used to prevent participants from learning were to intercept at what time, without taking the movement of the target into account. The target path was +20 cm in the y-direction from the starting position. Participants were instructed to intercept the target with a smooth straight movement, and to end their movement well beyond the target’s trajectory line. There were no points rewarded, only when the center of the cursor hit the target, an acoustic signal would sound.
After the explanation of the task and a familiarization phase of 10 trials, the experiment started. The experiment consisted of a baseline phase followed by an adaptation phase. During the baseline phase of 80 trials, no additional delays were added to the system. During the adaptation phase, the cursor movement was delayed with an additional 100 ms compared to the hand movement (Fig 1B-2). As participants could not see their own hand, they were unaware of these additional delays. This was verified by verbal confirmation at the end of the experiment.
To discourage online corrections we blocked the cursor’s path from view between 0.5 and 16 cm (see Fig 1B-4) along the y-axis from the starting location. During the baseline this led to an average of 126 ms (95% bootstrapped CI [124-128 ms]) visibility of the cursor before it would reach the trajectory line. As a result, participants could see the cursor cross the target’s trajectory line, but online corrections were minimized.
Analysis of responses
The data was prepared for analysis with the aid of the R-program [41]. In order to account for any deficient recordings and missing data, the raw position data for the hand and cursor in the x and y direction were interpolated by steps of 0.008 s and filtered with a bidirectional Butterworth filter (cut-off = 6Hz, sampling rate = 125 Hz). The velocity and acceleration of the hand were computed by calculating the first and second order derivatives of the filtered position data with respect to time. The derivatives were calculated for each time point by dividing the change in position by the change in time over the past two time points (average Δt = 0.016s).
Of the 20 participants, one was excluded from the study due to recording issues with the graphic tablet. For the remaining 19 participants (3040 trials), we inspected the movement speed during the movement before the target’s trajectory line was reached. As we had instructed participants to move through the target’s trajectory line, we discarded trials in which subjects moved through it with very low speeds (v < 20 cm/s). Two other participants were removed from the study because the systematically failed to comply with these instructions of the task (in >25% of their trials). For the 17 included participants we removed the trials in which this was the case (2.1% of the remaining trials discarded).
We calculated the Temporal Hand Error (TE) on each trial. TE was defined as the temporal difference between the hand and the target reaching the same point on the target’s trajectory line (Fig 1B-3). The TE was baseline-corrected by subtracting the average TE of the last 30 baseline trials for each participant in order to make sure any biases within subjects were removed. Positive values denoted the hand leading the target and negative values denoted the hand lagging behind the target. In order to hit the target when a temporal perturbation was applied, subjects would have to start leading the target with their hand. The TE was used to calculate the Adaptation Score for each participant. The Adaptation Score was calculated by fitting a two-state line through the TE data points of the adaptation phase (see Fig 2), with intercept 0. The slope (a) and asymptote (b) that resulted in a minimum residuals were each first normalized across subjects and then summed. The Adaptation Score gave us the ability to reward both speed and final level of adaptation. High values of the score meant that participants were relatively fast and had more complete levels of adaptation. Low values meant that participants adapted slowly and incomplete. Although we had the possibility to analyze slope and asymptote separately (to see if speed or final level of adaptation was affected differently) we only had a few participants with higher slopes, which made this analysis more difficult (see Table 1). We therefore decided only to focus on the Adaptation Score.
Table 1. Pre-normalized slopes (a) and Asympotes (b) and adaptation scores for all the subjects.
a (unnormalized) | b (unnormalized) | Adaptation Score |
---|---|---|
7.1 | 86 | -0.298 |
3.3 | 70 | -1.49 |
8.8 | 70 | -1.03 |
1.1 | 110 | 0.503 |
7.9 | 64 | -1.42 |
34.3 | 76 | 1.33 |
1.2 | 100 | 0.266 |
1.3 | 112 | 0.684 |
3.7 | 75 | 1.49 |
7.5 | 82 | -0.465 |
7.3 | 73 | -0.991 |
3.4 | 72 | 1.08 |
1.3 | 113 | 1.67 |
1.2 | 110 | 0.611 |
1.9 | 76 | -1.28 |
2.7 | 77 | -1.15 |
0.90 | 109 | 0.492 |
Adaptation is often quantified by fitting the exponential function (exp(−τ ⋅ trial)) and calculating the time constant τ of this function. However, our pilot data showed we could not fit this function for each participant, as some participants adapted in a non-exponential way. There were 11 participants for which we were able to calculate the exponential function. In order to verify our method of quantifying adaptation, we compared τ of this exponential to our Adaptation Score and confirmed our main finding (see below) using τ instead of the Adaptation Score.
Movement onset was calculated according to algorithm A as proposed by [42] on the tangential velocity of the hand (tolerance range = 10%). The average movement speed (Mv) between the time of movement onset and the crossing of the target’s trajectory line was calculated. We also calculated the absolute movement angle (Ma) from the y-axis, calculated between movement onset and movement onset + 200 ms.
In order to identify the relationship between different kinematic variables and Temporal Hand Error, we analyzed the relationship between Mv, Ma, movement time (T), absolute target velocity (tv), (σMv)2- group (LOW = 0; HIGH = 1) and their interactions on TE. We did this with a LASSO Regression for both the baseline and adaptation phase (lambda = 0.6). LASSO Regression can be used with multicollinear variables. We calculated bootstrapped confidence intervals (95%). LASSO regression includes a penalization. Confidence intervals can therefore only provide information about the variability regarding β for each predictor, but they should be interpreted with caution when it comes to the significance of the predictors.
Additionally, we performed another analysis with this technique in order to verify the respective contributions of movement speed variability ((σMv)2) and movement angle ((σMa)2) and their interaction on the Adaptation Score. As expected with regards to our hypothesis, we found the only included predictor of the Adaptation Score to be the (σMv)2 (see Results). The remainder of our analysis was therefore focused on the role of Mv on Adaptation.
The correlation between Mv variability across baseline trials ((σMv)2) and the Adaptation Score was calculated using the rcorr- function from the Hmisc-package [43]. We used Spearman, in addition to Pearson, because Spearman (based on ranks) captures monotonic relation better than Pearson (which requires linear relations). We also calculated this relationship for τ calculated for the 11 participants that showed exponential adaptation curves.
We examined if the predictive capacity of (σMv)2 was due to the sequential effects of the TE on Mv by dividing the participants in a LOW (n = 9) and HIGH (n = 8) (σMv)2 group based on the size of their movement speed variability. In order to verify if there were group differences in variances for Mv and TE, we did F-tests on the results from the baseline phase (var.test-function for R). As we suspected that the benefit of (σMv)2 came from error correction rather than exploration, we expected sequential effects of TEt on Mvt+1. The sequential effects can show us if the error on one trial had an effect on the movement speed of consecutive trials. We verified this idea in two different ways: First, we fit a linear mixed model (lmer-function of the lme4-package [44] that examined the slopes of the HIGH and LOW (σMv)2 group, with subject as a nested random effect. We found significant effect for the HIGH (σMv)2 group, indicating that movement speed was used to account for previous encountered errors. In order to examine this effect in more detail, we calculated the cross correlation (ccf-function for R) between the TE and Mv for lag 0 through 3 for each subject individually to capture the corrective pattern. This way we could examine the effects of the movement speed on the error (lag 0) and the effect of the error on the movement speed over the next 3 trials (lag 1-3). In order to decrease the effect of any auto-correlation or common trends within the time-series we prewhitened the TE and Mv for each participant with the prewhiten-function of the psd-package. Bootstrapped confidence intervals (95%) were calculated. The results were correlated with the individual Adaptation Score results, in order to examine if sequential effects of TE on Mv could predict differences in adaptation.
Results
We first analyzed the behavior or participants within a trial for both phase 1 and 2 (see Table 2). A negative TE denoted being late, and a positive TE denoted being early. Both phases included (σMv)2-group and movement time (T) as predictors of TE. Larger movement times led to a more negative TE. The HIGH (σMv)2 group had on average more positive TE. None of the other main effects were included as predictors, although there seemed to be some small interaction effects. As movement time was one of the main predictors of error, it is likely that participants use Mv to account for errors. However, another way to account for errors is by varying the movement angle (Ma). We found a significant correlation between Mv and Ma (R = 0.62, p < 0.001), and (σMv)2 and (σMa)2 (R = 0.67, p < 0.005). The results of the LASSO Regression (λ = 0.37) showed us that only (σMv)2 was a significant predictor of the Adaptation Score (β = 0.01; 95% CI[0.008–0.020]), while (σMa)2 and (σMa)2 ⋅ (σMv)2 were dropped. The remainder of the analysis will therefore only focus on Mv.
Table 2. Predictors for temporal hand error within a trial for Phase 1 and 2.
Predictor | Phase 1 β [95%CI] | Phase 2 β [95%CI] |
---|---|---|
Ma | ⋅ | ⋅ |
Mv | ⋅ | ⋅ |
tv | ⋅ | ⋅ |
HIGH (σMv)2 | 4.74 [0.24–9.48] | 13.44 [10.55–26.88] |
T | -18.36[-36.72–(-5.52)] | -1.87[-11.68–7.43] |
Ma ⋅ Mv | -0.0016 [-0.0060–(-0.00073)] | -0.011 [-0.021–(-0.0072)] |
Ma ⋅ tv | -0.0026 [-0.0087–0.0049] | ⋅ |
Ma ⋅ HIGH (σMv)2 | ⋅ | ⋅ |
Ma ⋅ T | 0.40 [0.090–1.04] | 2.15 [1.38–4.30] |
Mv ⋅ tv | ⋅ | ⋅ |
Mv ⋅ HIGH (σMv)2 | 0.035[-0.156–0.070] | ⋅ |
Mv ⋅ T | -1.67 [-3.09–(-0.69)] | -1.28 [-2.57–(-0.72)] |
tv ⋅ HIGH (σMv)2 | 0.15 [0.02–0.35] | 0.35[0.20–0.70] |
tv ⋅ T | -0.47 [-0.93–(-0.34)] | -0.70[-1.25–(-0.58)] |
HIGH (σMv)2 ⋅ T | ⋅ | ⋅ |
The experiment was designed to study the relationship between (σMv)2 and the Adaptation score. Fig 2 shows two example subjects and their responses during the experiment. Participants showed various degrees of adaptation. Adaptation scores varied between -1.49 and +1.67 (Table 1).
Fig 3A displays the moving average (window = 4 trials) of TE throughout the task. The blue line shows the mean of the nine participants with below-average (σMv)2, and the orange line depicts the mean of the eight participants with above-average (σMv)2. The spread around these lines represent the standard deviation of the data across subjects. When the temporal perturbation of 100 ms is introduced, subjects account for this delay by reaching the target’s trajectory earlier with their hand in relation to the target. This is depicted by a more positive TE in Fig 3. Upon visual inspection there seemed to be a slightly faster adaptation for the HIGH group than for the LOW group (see Fig 3B). In order to verify this notion, we calculated an adaptation score for each participant. We found a significant correlation between (σMv)2 and the adaptation score (Pearson r = 0.51, p = 0.037). We found an even higher Spearman correlation (r = 0.61, p = 0.009), indicating that the relationship might be better described by a logarithmic curve (dashed line in Fig 3B). These findings imply that there is a strong positive relationship between (σMv)2 and the adaptation. We confirmed this result by finding a negative correlation between (σMv)2 and τ (r = -0.63, p = 0.038) (Fig 4A). This was as expected, as the Adaptation Score had a negative (albeit not significant) correlation with τ as calculated by the exponential (r = -0.54, p = 0.088) (Fig 4B).
As expected, the F-test revealed a significant difference between the HIGH and LOW variability groups in baseline Mv (F(1, 1315) = 2.5, p < 0.001). However, no differences were found for TE (F(1,1315) = 1.1, p = 0.35). This is important because it ensures that differences in sequential effects that are found between groups are not the result of differences in errors that were made.
We examined the relationship between the TE on a certain trial, and the change in Mv on the next trial for participants in the HIGH and in the LOW (σMv)2 group (see Fig 5). The mixed linear model revealed that, when the error was zero, neither of the groups significantly changed their Mv (p = 0.69 (LOW); p = 0.59 (HIGH)). The effect of TE on the next trial’s Mv was significant for the HIGH (σMv)2 group (slope = -15.9 cm/s2; p = 0.02). The LOW (σMv)2 group did not show a significant effect (slope = 6.3 cm/s2; p = 0.68). The ANOVA revealed a significant difference between groups (F(1, 1263) = 5.2, p = 0.02). This suggests that participants with a higher (σMv)2 increased their speed when encountering a negative error and vice versa, while the participants with lower (σMv)2 did not.
In order to examine if this difference can predict adaptation on an individual level, we calculated the cross correlation (ccf) between Mv at different t+lag and TE (Fig 6). A negative ccf indicates that a negative error (arriving too late) leads to increased velocities, and a more positive error (earlier) leads to decreased velocities. Consequently, a positive ccf indicates the opposite (negative error → decreased velocities; positive error → increased velocities). In congruence with Fig 6, participants with higher (σMv)2 scores seemed to have a trend towards more negative ccfs, while the participants with low (σMv)2 scores had ccfs near zero. The high (σMv)2 group showed a positive ccf(0) (i.e. the cross correlation between Mv and TE within a trial). Slower hand movements led to more negative TE and fast hand movement to positive TE. It shows that for this group there is some dependency of the TE on the Mv within a trial.
To see if this difference could explain the differences in adaptation, we calculated the correlation between the different lags and the Adaptation Score (Fig 7). The correlation between Mv and TE within a trial (lag0), i.e. how the Mv affected the TE, seemed to not be able to explain differences in adaptation. Although there is also no correlation for ccf(1), the lag2 and lag3 ccf seem to predict the Adaptation Score in this experiment. This suggests that errors might not be corrected right away, or only partially from trial to trial.
Discussion
This study found a positive relationship between variability of movement speed during the baseline phase, and the adaptation to a temporal perturbation. Our results indicate that this variability might be a result of error correction strategies, rather than exploration. Participants that corrected their movement velocity after encountering an error on average adapted more than participants who did not. To our knowledge, we are the first ones to reveal such a relationship in temporal adaptation.
The role of noise in adaptation has recently received a lot of attention. A study by Wu et al. [32] suggested that there might be a positive influence of variability on adaptation through reinforcement learning, revealed by an increased baseline variability for fast adapters. In line with these results, we found a benefit of increased baseline variability on the adaptation for temporal perturbations. However, our results suggest that participants with higher variability use their velocity more as a way to correct for errors. Our results are therefore more in line with the idea that motor noise from different types of processes can have either a positive, negative or neutral effect on adaptation [13]. Two types of noise that are relevant for adaptation are sensory noise and motor noise. Sensory noise can influence adaptation by influencing the uncertainty of the error [22, 45]. More sensory noise can lead to higher variability. However, error correction actually decreases with more uncertain sensory information. It is therefore unlikely that sensory noise was the source of the increased adaptation. Motor noise can roughly be divided into planning noise and execution noise [16]. A recent study by Vliet et al. [46] found that execution noise correlated negatively with adaptation rate, while planning noise revealed the opposite trend. Execution noise increases the uncertainty of the feedback that is received. Contrarily, more noise in the planning process can lead to more uncertain forward predictions, with a higher rate of error correction as a result. In the current study, we did not measure noise in the system directly. We therefore cannot determine the direct effect of planning noise and/or execution noise on the adaptation. However, it has been suggested that planning noise, in the form of stochastic resonance, could have a positive effect on signal detection by enhancing sub-threshold signals to supra-threshold [47–49]. Enhanced error-detection could lead to more error correction. Our results are in line with the idea that higher planning noise could increase the reliance on error feedback and lead to larger trial-to-trial corrections [46].
The question remains: why did we find a positive relationship between baseline variability and adaptation, while many other studies did not [13, 50–53]? It is likely that differences in design, such as variability measure or feedback provided, trigger variations in the accumulation of the different types of noise. In this study, we defined the average movement speed as an indicator of task-relevant variability, instead of the movement speed at the moment of interception, or the error at interception. We theorized that movement velocity would provide the richest information about the temporal contingencies of the sensorimotor system, and therefore could be more beneficial for exploration. By averaging the movement speed on each trial we believe to have filtered out a large part of the execution noise. This could have highlighted the effect of planning noise on adaptation. Similarly, Wu et al. [32] calculated the variability of deflection of a rewarded hand path throughout the movement, while He et al. [13] looked at the endpoint error. It is likely that endpoint error is more susceptible to execution noise. On the other hand, Dhawale et al. [54] suggested in a recent review that differences in results between studies might be inherent to differences in feedback. In Wu et al. [32], feedback was absent during the baseline, which may have led to an accumulation of planning noise (drift) that could not be corrected trial-to-trial [55]. In He et al. [13], feedback was provided throughout the movement, which means the variability measure might be dominated by execution noise. In the current study, we did provide error feedback in the baseline, which might be taken as evidence against the latter idea. However, these ideas together support the hypothesis that experimental designs that promote planning noise over execution noise are more likely to reveal a positive relationship between variability and adaptation.
Next, we need to consider the effect of generalization on the results. The term generalization refers to how the mapping between action and consequence generalizes to other tasks and target speeds. Research has shown that generalization of temporal perturbations is limited to tasks that are very similar to the learned task [39]. We used three different target speeds in two directions in this study. Some participants might had a better generalization from one speed to the other than others. It is possible that at the moment the perturbation was applied, some participants were able to generalize the changing consequences better for all target speeds and, as a result, adapt faster. For generalization to have an effect on our results there would need to be a relationship between movement speed variability and generalization. More variable people might develop broader tuning curves, and as a result adapt faster. We think this idea is captured well within the notion of exploration that is part of our original hypothesis: higher variability due to exploration might broaden the brain’s knowledge on the temporal contingencies over a broader range of target speeds and situations. Unfortunately our current dataset cannot give a definitive answer to the question of generalization.
Throughout the study, we mainly focused on how participants change their movement speed from trial-to-trial. However, in this task subjects were free to change their interception location or movement angle and onset time in order to account for prediction errors. This leads to a variety of strategies that participants can use to perform the task and correct for errors. These strategies are not independent of the target speed, nor independent of each other. For example, faster targets can lead to faster movements, earlier onset times and/or to broader hitting positions [56–58]. Furthermore, we found a correlation between the movement angle and the movement speed. These interconnections between movement features make it challenging to examine the participants’ strategies. However, it has been proposed that, in order to successfully hit a target, people benefit more from estimating the time it takes to reach the target’s trajectory, followed by fine-tuning the point of interception throughout the movement (online correction), as opposed to estimating when the target will reach the interception location [2]. As a result, errors are likely attributed to incorrect estimations of the time it takes to reach the target’s trajectory, rather than an incorrect estimations of interception location. As online correction was discouraged in our experiment, the reliance on error correction through changing the predicted temporal features of the movement was enhanced even further. During this experiment, successful participants used their movement speed as a control agent for trial-to-trial error correction in interception, and to a lesser extend their interception location or movement angle. This does not mean that low adapters do not have useful strategies of error correction. However, if the source of an error is temporal, using movement speed as a corrective strategy can be beneficial. Vice versa, if an error is spatial, corrections in movement angle would be more favorable. It is therefore possible that the difference in adaptation is rooted in the interpretation of the error.
Ccf(0) seemed to be slightly higher in the high variability group compared to the low variability group. This shows that participants with higher variability had a higher cross-correlation between the speed of movement and the temporal hand error in the same trial. This suggests that the temporal hand errors that participants with higher variability make are more dependent on the movement speed. This is not a surprising feature, given that more variability can more easily reveal a dependency of the temporal hand error on the movement speed. Another reason why ccf(0) is higher in the HIGH variability group is that participants with more dependency of temporal hand error on movement speed use their movement speed more as a way to correct for error and as a result, adapt more. We need to consider the possibility that this positive ccf(0) could have had an effect on the negative ccfs found in later lags. When a slow hand movement is made and a negative error occurs, it is more likely that the next movement will be faster. This therefore can lead to negative ccfs in consecutive lags. However, these differences in ccf(0) were not able to explain differences in adaptation. Therefore it seems unlikely that dependencies between Mv and TE within a trial alone could have explained more negative ccfs for consecutive lags.
To conclude, we found a correlation between movement speed variability and adaptation to a temporal perturbation. Further analysis of this relationship indicated that this is likely the result of error correction strategies that also benefited the adaptation, although the results are not conclusive. More research is needed to examine the contributions of movement speed, interception location and movement angle and the differences between temporal and spatial perturbations. Furthermore, it would be interesting to know how these error correction strategies are related to different types of noise and how the how the brain regulates these processes.
Acknowledgments
We would like to thank Cristina de la Malla and Björn Jörges for their stimulating discussion and help evaluating the manuscript.
Data Availability
The data can be found in the OSF repository: DOI 10.17605/OSF.IO/BF7SE.
Funding Statement
This work is part of the PACE project, which received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No 642961. We also received funding from grant PSI2017-83493-R of AEI/FEDER, UE. There were no commercial relationships. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Regan D. Visual factors in hitting and catching. J Sports Sci. 1997;15(6):533–58. 10.1080/026404197366985 [DOI] [PubMed] [Google Scholar]
- 2. Brenner E, Smeets JBJ. How people achieve their amazing temporal precision in interception. J Vis. 2015;15(3). 10.1167/15.3.8 [DOI] [PubMed] [Google Scholar]
- 3. Adams JA. A closed-loop theory of motor learning. J Mot Behav. 1971;3(2):111–49. 10.1080/00222895.1971.10734898 [DOI] [PubMed] [Google Scholar]
- 4. Miall RC, Weir DJ, Wolpert DM, Stein JF. Is the cerebellum a smith predictor? J Mot Behav. 1993;25(3):203–16. 10.1080/00222895.1993.9942050 [DOI] [PubMed] [Google Scholar]
- 5. López-Moliner J, Brenner E, Louw S, Smeets JBJ. Catching a gently thrown ball. Exp Brain Res. 2010;206(4):409–17. 10.1007/s00221-010-2421-1 [DOI] [PubMed] [Google Scholar]
- 6. López-Moliner J, Keil MS. People favour imperfect catching by assuming a stable world. PLoS One. 2012;7(4):e35705 10.1371/journal.pone.0035705 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Jordan MI, Rumelhart DE. Forward models: Supervised learning with a distal teacher. Cognitive science. 1992;16(3):307–354. 10.1207/s15516709cog1603_1 [DOI] [Google Scholar]
- 8. Wolpert DM, Miall RC. Forward Models for Physiological Motor Control. Neural Netw. 1996;9(8):1265–1279. 10.1016/s0893-6080(96)00035-4 [DOI] [PubMed] [Google Scholar]
- 9. Zhou S, Carey MF, Snow RJ, Lawson DL, Morrison WE. Effects of muscle fatigue and temperature on electromechanical delay. Electromyogr Clin Neurophysiol. 1998;38(2):67–73. [PubMed] [Google Scholar]
- 10. Wei K, Körding K. Relevance of error: what drives motor adaptation? J Neurophysiol. 2009;101(2):655–64. 10.1152/jn.90545.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Huang VS, Haith A, Mazzoni P, Krakauer JW. Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron. 2011;70(4):787–801. 10.1016/j.neuron.2011.04.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Faisal AA, Selen LP, Wolpert DM. Noise in the nervous system. Nature reviews neuroscience. 2008;9(4):292 10.1038/nrn2258 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. He K, Liang Y, Abdollahi F, Fisher Bittmann M, Kording K, Wei K. The Statistical Determinants of the Speed of Motor Learning. PLoS Comput Biol. 2016;12(9):e1005023 10.1371/journal.pcbi.1005023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Churchland MM, Afshar A, Shenoy KV. A central source of movement variability. Neuron. 2006;52(6):1085–96. 10.1016/j.neuron.2006.10.034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Churchland MM, Yu BM, Ryu SI, Santhanam G, Shenoy KV. Neural variability in premotor cortex provides a signature of motor preparation. J Neurosci. 2006;26(14):3697–712. 10.1523/JNEUROSCI.3762-05.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. van Beers RJ. Motor learning is optimally tuned to the properties of motor noise. Neuron. 2009;63(3):406–17. 10.1016/j.neuron.2009.06.025 [DOI] [PubMed] [Google Scholar]
- 17. Chaisanguanthum KS, Shen HH, Sabes PN. Motor variability arises from a slow random walk in neural state. J Neurosci. 2014;34(36):12071–80. 10.1523/JNEUROSCI.3001-13.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Haar S, Donchin O, Dinstein I. Individual Movement Variability Magnitudes Are Explained by Cortical Neural Variability. J Neurosci. 2017;37(37):9076–9085. 10.1523/JNEUROSCI.1650-17.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Harris CM, Wolpert DM. Signal-dependent noise determines motor planning. Nature. 1998;394(6695):780–4. 10.1038/29528 [DOI] [PubMed] [Google Scholar]
- 20. Jones KE, Hamilton AF, Wolpert DM. Sources of signal-dependent noise during isometric force production. J Neurophysiol. 2002;88(3):1533–44. 10.1152/jn.2002.88.3.1533 [DOI] [PubMed] [Google Scholar]
- 21. van Beers RJ, Haggard P, Wolpert DM. The role of execution noise in movement variability. J Neurophysiol. 2004;91(2):1050–63. 10.1152/jn.00652.2003 [DOI] [PubMed] [Google Scholar]
- 22. Osborne LC, Lisberger SG, Bialek W. A sensory source for motor variation. Nature. 2005;437(7057):412–6. 10.1038/nature03961 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Tan H, Wade C, Brown P. Post-Movement Beta Activity in Sensorimotor Cortex Indexes Confidence in the Estimations from Internal Models. J Neurosci. 2016;36(5):1516–28. 10.1523/JNEUROSCI.3204-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Mazzoni P, Krakauer JW. An implicit plan overrides an explicit strategy during visuomotor adaptation. J Neurosci. 2006;26(14):3642–5. 10.1523/JNEUROSCI.5317-05.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Shadmehr R, Smith MA, Krakauer JW. Error correction, sensory prediction, and adaptation in motor control. Annu Rev Neurosci. 2010;33:89–108. 10.1146/annurev-neuro-060909-153135 [DOI] [PubMed] [Google Scholar]
- 26. Körding KP, Wolpert DM. Bayesian integration in sensorimotor learning. Nature. 2004;427(6971):244–7. 10.1038/nature02169 [DOI] [PubMed] [Google Scholar]
- 27. Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nat Neurosci. 2002;5(11):1226–35. 10.1038/nn963 [DOI] [PubMed] [Google Scholar]
- 28. Wei K, Körding K. Uncertainty of feedback and state estimation determines the speed of motor adaptation. Front Comput Neurosci. 2010;4:11 10.3389/fncom.2010.00011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Kaelbling LP, Littman ML, Moore AW. Reinforcement learning: A survey. Journal of artificial intelligence research. 1996;4:237–285. 10.1613/jair.301 [DOI] [Google Scholar]
- 30. Sutton RS, Barto AG, et al. Introduction to reinforcement learning. vol. 135 MIT press; Cambridge; 1998. [Google Scholar]
- 31. Wolpert DM, Diedrichsen J, Flanagan JR. Principles of sensorimotor learning. Nat Rev Neurosci. 2011;12(12):739–51. 10.1038/nrn3112 [DOI] [PubMed] [Google Scholar]
- 32. Wu HG, Miyamoto YR, Gonzalez Castro LN, Ölveczky BP, Smith MA. Temporal structure of motor variability is dynamically regulated and predicts motor learning ability. Nat Neurosci. 2014;17(2):312–21. 10.1038/nn.3616 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Herzfeld DJ, Vaswani PA, Marko MK, Shadmehr R. A memory of errors in sensorimotor learning. Science. 2014;345(6202):1349–53. 10.1126/science.1253138 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Takiyama K, Hirashima M, Nozaki D. Prospective errors determine motor learning Nat Commun. 2015;6: 5925 10.1038/ncomms6925 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Herzfeld DJ, Shadmehr R. Motor variability is not noise, but grist for the learning mill. Nat Neurosci. 2014;17(2):149–50. 10.1038/nn.3633 [DOI] [PubMed] [Google Scholar]
- 36. Vercher JL, Gauthier GM. Oculo-manual coordination control: ocular and manual tracking of visual targets with delayed visual feedback of the hand motion. Exp Brain Res. 1992;90(3):599–609. 10.1007/bf00230944 [DOI] [PubMed] [Google Scholar]
- 37. Cunningham DW, Billock VA, Tsou BH. Sensorimotor adaptation to violations of temporal contiguity. Psychol Sci. 2001;12(6):532–5. 10.1111/1467-9280.d01-17 [DOI] [PubMed] [Google Scholar]
- 38. de la Malla C, López-Moliner J, Brenner E. Seeing the last part of a hitting movement is enough to adapt to a temporal delay. J Vis. 2012;12(10). 10.1167/12.10.4 [DOI] [PubMed] [Google Scholar]
- 39. de la Malla C, López-Moliner J, Brenner E. Dealing with delays does not transfer across sensorimotor tasks. J Vis. 2014;14(12). 10.1167/14.12.8 [DOI] [PubMed] [Google Scholar]
- 40. Barbado-Murillo D, Caballero Sánchez C, Moreside J, Vera-García FJ, Moreno FJ. Can the structure of motor variability predict learning rate? J Exp Psychol Hum Percept Perform. 2017;43(3):596–607. 10.1037/xhp0000303 [DOI] [PubMed] [Google Scholar]
- 41.R Core Team. R: A Language and Environment for Statistical Computing; 2013. Available from: http://www.R-project.org/.
- 42. Teasdale N, Bard C, Fleury M, Young DE, Proteau L. Determining movement onsets from temporal series. J Mot Behav. 1993;25(2):97–106. 10.1080/00222895.1993.9941644 [DOI] [PubMed] [Google Scholar]
- 43.Harrell Jr FE. Hmisc: Harrell Miscellaneous; 2018. Available from: https://CRAN.R-project.org/package=Hmisc.
- 44. Bates D, Mächler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software. 2015;67(1):1–48. 10.18637/jss.v067.i01 [DOI] [Google Scholar]
- 45. Knelange EB, López-Moliner J. Decreased Temporal Sensorimotor Adaptation Due to Perturbation-Induced Measurement Noise. Front Hum Neurosci. 2019;13:46 10.3389/fnhum.2019.00046 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. van der Vliet R, Frens MA, de Vreede L, Jonker ZD, Ribbers GM, Selles RW, et al. Individual Differences in Motor Noise and Adaptation Rate Are Optimally Related. eNeuro. 2018;5(4). 10.1523/ENEURO.0170-18.2018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Stacey WC, Durand DM. Stochastic resonance improves signal detection in hippocampal CA1 neurons. J Neurophysiol. 2000;83(3):1394–402. 10.1152/jn.2000.83.3.1394 [DOI] [PubMed] [Google Scholar]
- 48. Hänggi P. Stochastic resonance in biology. How noise can enhance detection of weak signals and help improve biological information processing. Chemphyschem. 2002;3(3):285–90. [DOI] [PubMed] [Google Scholar]
- 49. van der Groen O, Tang MF, Wenderoth N, Mattingley JB. Stochastic resonance enhances the rate of evidence accumulation during combined brain stimulation and perceptual decision-making. PLoS Comput Biol. 2018;14(7):e1006301 10.1371/journal.pcbi.1006301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50. Mattar AAG, Ostry DJ. Generalization of dynamics learning across changes in movement amplitude. J Neurophysiol. 2010;104(1):426–38. 10.1152/jn.00886.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Ostry DJ, Darainy M, Mattar AAG, Wong J, Gribble PL. Somatosensory plasticity and motor learning. J Neurosci. 2010;30(15):5384–93. 10.1523/JNEUROSCI.4571-09.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Vahdat S, Darainy M, Milner TE, Ostry DJ. Functionally specific changes in resting-state sensorimotor networks after motor learning. J Neurosci. 2011;31(47):16907–15. 10.1523/JNEUROSCI.2737-11.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Fernandes HL, Stevenson IH, Kording KP. Generalization of stochastic visuomotor rotations. PLoS One. 2012;7(8):e43016 10.1371/journal.pone.0043016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Dhawale AK, Smith MA, Ölveczky BP. The Role of Variability in Motor Learning. Annu Rev Neurosci. 2017;40:479–498. 10.1146/annurev-neuro-072116-031548 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55. van Beers RJ, van der Meer Y, Veerman RM. What autocorrelation tells us about motor variability: insights from dart throwing. PLoS One. 2013;8(5):e64332 10.1371/journal.pone.0064332 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Bairstow PJ. Analysis of hand movement to moving targets. Human Movement Science. 1987;6(3):205–231. 10.1016/0167-9457(87)90013-3 [DOI] [Google Scholar]
- 57. Brouwer AM, Brenner E, Smeets JB. Hitting moving objects. The dependency of hand velocity on the speed of the target. Exp Brain Res. 2000;133(2):242–8. 10.1007/s002210000371 [DOI] [PubMed] [Google Scholar]
- 58. Brouwer AM, Brenner E, Smeets JBJ. Hitting moving objects: is target speed used in guiding the hand? Exp Brain Res. 2002;143(2):198–211. 10.1007/s00221-001-0980-x [DOI] [PubMed] [Google Scholar]