Abstract
Recent computational and behavioral studies suggest that motor adaptation results from the update of multiple memories with different timescales. Here, we designed a model-based functional magnetic resonance imaging (fMRI) experiment in which subjects adapted to two opposing visuomotor rotations. A computational model of motor adaptation with multiple memories was fitted to the behavioral data to generate time-varying regressors of brain activity. We identified regional specificity to timescales: in particular, the activity in the inferior parietal region and in the anterior-medial cerebellum was associated with memories for intermediate and long timescales, respectively. A sparse singular value decomposition analysis of variability in specificities to timescales over the brain identified four components, two fast, one middle, and one slow, each associated with different brain networks. Finally, a multivariate decoding analysis showed that activity patterns in the anterior-medial cerebellum progressively represented the two rotations. Our results support the existence of brain regions associated with multiple timescales in adaptation and a role of the cerebellum in storing multiple internal models.
A model-based functional MRI study reveals the existence of brain regions associated with four distinct timescales in motor adaptation.
Author Summary
Motor adaptation, a form of motor learning in which motor commands are modified to compensate for disturbances in the external environment, usually proceeds at a rapid pace initially and is then followed by more gradual adjustments. This suggests that at least two learning processes are involved, but little is known about how many distinct memories the brain actually updates during motor adaptation. In addition, it is unclear whether these putative multiple motor memories reside within a single neural system that encompasses different timescales or in qualitatively distinct neural systems. We addressed these issues using a model-based functional imaging approach in which we first used behavioral data to derive a large number of possible memory “states,” each with different dynamics, and then correlated these memory states with neural activities. We identified four components: two fast, one intermediate, and one slow, each associated with different brain networks. In particular, areas in the prefrontal and parietal lobes and the posterior part of the cerebellum were associated with formation of memories for short timescales. By contrast, the inferior parietal region and the anterior-medial cerebellum were associated with formation of memories for intermediate and long timescales, respectively.
Introduction
Behavioral and computational modeling studies, on the one hand, and neuroimaging studies, on the other hand, have greatly advanced our understanding of motor adaptation. In particular, recent behavioral and computational modeling studies have shed light on the temporal structure of motor adaptation by showing that motor behavior is well accounted for by the sum of multiple motor memory states with different timescales. For instance, models with two time constants can reproduce a number of adaptation phenomena such as anterograde interference, spontaneous recovery, and savings [1–4]. A model with a larger number of time constants can account for adaptation occurring at multiple timescales, e.g., fatigue and aging [5]. In contrast, neuroimaging studies, using either functional magnetic resonance imaging (fMRI) [6–8] or positron emission tomography (PET) [9–12], have investigated the spatial distribution of the neural correlates and plastic changes across different brain regions at specific times during and after adaptation, with the prefrontal cortex (PFC), the posterior parietal cortex (PPC), and the cerebellum consistently showing activation. The PFC mostly contributes to the early, but not the late, stage of adaptation, which is consistent with its role in spatial working memory and in attention and arousal at the onsets of target presentation [13,14]. The PPC is also important in the early stage of motor adaptation [6,9,15], here again consistent with its role in working memory [13,14], planning movements and early adaptation to a new visuomotor transformation [9,16,17]. The activity of the cerebellum increases in a later stage of visuomotor adaptation [6,15,18] and correlates with the degree of savings at transfer of learning [19]. Such activation is consistent with cerebellum learning from errors [20,21], building internal models [22–24], and storing multiple motor skills [25].
However, these modeling and neuroimaging studies have been conducted independently of each other. As a result, little is known about the neural correlates of the latent (i.e., nondirectly observable from the behavioral data) motor memories at different timescales suggested by computational models. In particular, it is unclear whether the multiple motor memories proposed by the models reside within a single system that contains a distribution of possible timescales or in a finite set of qualitatively distinguishable neural systems [1,26]. In addition, because experimental behavioral data can be well accounted for by models with different number of time constants, it is unclear how many distinct memories the brain actually updates during a specific type of motor adaptation. Finally, it is unclear whether the neural substrates identified in the early and late phases of adaptation in previous fMRI studies map onto putative “fast” and “slow” processes suggested by the computational models.
Here, we combined modeling and imaging approaches via a model-based fMRI study of the spatial and temporal distribution of multiple motor memories during adaptation. Subjects adapted to two opposing visuomotor rotations in short alternating blocks. We estimated the multiple memories via a multiple-timescale adaptation model that generalizes the two-state models to multiple states with a logarithmic distribution of time scales from seconds to hours, as in a previous study [5]. A model-based approach based on regression analyses of brain activity would have insufficient power to dissociate multiple memories that are highly correlated with each other. We therefore propose a novel two-step approach. In a first step, we conducted exploratory multiple single regressions with individual memories, which avoids the problem of multicollinearity. In a second step, we performed a sparse singular value decomposition (SVD) on the voxels identified in the first step, in order to select a small number of orthogonal components. As a result, we identified four characteristic networks, each associated with formation of different time-scales of memories.
Results
Twenty-one healthy right-handed subjects used their left hand and adapted to two opposing visuomotor rotations, of 40° and −40°, respectively, presented in blocks of nine trials. At each trial, subjects were instructed to hit a circular target that appeared on the visual display by manipulating a joystick with their left hand, with the goal to decrease the distance between the cursor and the target at the end of the movement (see Fig 1 and details in Materials and Methods). The cursor was rotated 40°, −40°, or 0° from the actual movement direction depending on the task (Task 1: 40°; Task 2: −40°; Control task: 0°), which was cued by the target color (Fig 1). The tasks were presented in blocks of nine trials.
Behavioral Results and Modeling
The overall mean adaptation level of 21 subjects showed that fast adaptation occurred within task blocks, and slow adaptation occurred across the task blocks for each task (Fig 2A). Forgetting across blocks, which can be observed by comparing the last trial of a task block and the first trial of the next block of the same task, gradually decreased across blocks. Thus, visual inspection of the behavioral data suggests the existence of multiple timescales in motor memory, initially dominated by faster memories and eventually dominated by slower memories.
We modeled adaptation as the sum of multiple memory states with different time constants. As in a previous model [5], a continuous distribution of timescales was approximated by multiple time constants. We defined 30 time constants, ranging from 2 s to ~92.6 h, in a logarithmic scale (S1 Table). In addition, the contextual cue (here the target color) selects the states for a specific task, as in a previous study [2]. Thus, the motor output at each trial n is given by
(1) |
where x k = [x k,1 x k,2] with time constant τ k (k = 1,…,30). The contextual cue vector is c = [1 0]T for Task 1 and c = [0 1]T for Task 2. This model thus assumes no interference between two tasks, i.e., perfect switching (please refer to S1 Text for the rationale of this choice of a model with no interference).
The states were updated by the error feedback, e = f − y, where f is, at each trial, one of the two visuomotor rotations, 40° or −40°. Because the intertrial interval (ITI) was random (see details in Materials and Methods), we modeled time decay as an exponential function of time [27]. The update equation from trial n to n+1 for the state of motor memory with time constant τ k is thus given by
(2) |
where T(n) is the ITI following trial n and β k is the learning rate. The learning rates depend inversely on the time constant τ k, as follows:
(3) |
where r and q are strictly positive free parameters. As a result of this relationship, states with smaller time constants decay faster but are more rapidly updated [5,28].
Using averaged data of 21 subjects in actual adaptation to Tasks 1 and 2 (see details in Materials and Methods), the best-fitted parameters of the proposed model were r = 0.0333 and q = 0.201. The model fit is shown in Fig 2A, and the 30 states of Task 1 used in the fit are shown in Fig 2B. The overall fit to the averaged data was excellent (root mean squared error = 4.96°, R2 = 0.981). In addition, the fit to individual subjects’ data was satisfactory overall, although the fit was only modest for some subjects (mean ± SEM across subjects: R2 = 0.832 ± 0.189). We thus used the regressors calculated from the averaged adaptation data for the subsequent fMRI analysis.
Model-Based Regression of fMRI
Because the multiple memory states are highly correlated with each other, especially for larger time constants (for instance, the correlation coefficient between the state with τ 21 = 2.2 h and the state with τ 30 = 92.6 h was 0.994), we first entered the states as single regressors in independent univariate analyses of blood-oxygen-level dependent (BOLD) signal (see Materials and Methods).
Overall, this univariate model-based regression analysis revealed distinct patterns of regions for states with increasing time constants (Fig 3A). The faster states (τ k, ranging from 2.0 to 4.6 s; k = 1, 2, and 3) correlated mainly with activity in large regions in the frontal and parietal cortices and with activity in regions in the posterior-lateral cerebellum (see below). By contrast, the states with intermediate time constants (τ k, ranging from 2.1 to 87.9 min; k = 11,…,20) correlated with activity in a restricted area in the right anterior region of the inferior parietal lobe (aIPL, indicated by a blue circle in Fig 3A), which is the most anterior of the intraparietal sulcus. Note that the aIPL activity was prominently found in the right hemisphere, contralateral to the left hand used to perform the task but that weak activity was found in the left hemisphere when the threshold was lowered (see Discussion). The slower states (τ k, ranging from 2.2 to 92.6 h: k = 21,…,30) primarily correlated with activity in the anterior-medial cerebellum (see below). Supplementary videos show the patterns of correlated regions in both hemispheres for all time constants and corresponding regressors (S1 and S2 Videos). These patterns for each time constant were similar in both the 40° and the −40° condition.
Table 1 summarizes prominent clusters for the small (k = 1), middle (k = 16), and large (k = 30) time constants for Task 1. Significant clusters were found to be related to the fastest state (k = 1) in the parietal, frontal, and cerebellar regions when thresholded at p < 0.05 corrected for multiple comparisons (family-wise error rate [FWER]) throughout the brain at cluster level. Activity related to the middle state (k = 16) was significant in the aIPL (p < 0.05) when we applied small volume correction for the superior and inferior lobules, in line with previous studies reporting parietal contribution to visuomotor adaptation [9,15]. Activity related to the slowest state (k = 30) was significant in the left and right cerebellum at p < 0.05 corrected for the entire brain at cluster level. Fig 3B shows regional difference in the cerebellum between the fast (k = 1) and the slow (k = 30) states. Regions related to the fast state (blue) distribute in the posterior-lateral parts of the cerebellar cortex. These parts are mainly in the left and right crus 1 (see Table 1), which is connected with the prefrontal-parietal networks [29]. Note that activity was found in crus 1 not only for the fastest (k = 1) but also for relatively fast (k = 2,…,7) states (S1 Fig). By contrast, regions related to the slow state (red) distribute in the anterior-medial parts (mainly lobule 6 and partly lobule 8), which are connected with cerebral sensorimotor networks [30].
Table 1. Clusters identified by model-based regression analysis.
Peak (MNI) | Cluster Size | T-Value at Peak | Corrected p-Value | |||
---|---|---|---|---|---|---|
x | y | z | ||||
Fast state (k = 1) | ||||||
Parietal clusters | ||||||
L precuneus | -4 | -48 | 76 | |||
R angular gyrus | 42 | -68 | 46 | 2616 a | 9.24 | < 0.001 |
R precuneus | 4 | -56 | 74 | |||
L angular gyrus | -40 | -66 | 50 | 650 | 7.69 | < 0.001 |
Prefrontal cluster | ||||||
R superior frontal gyrus | 6 | 26 | 58 | 1474 b | 7.46 | < 0.001 |
R middle frontal gyrus | 50 | 24 | 40 | |||
Cerebellar clusters | ||||||
L cerebellum crus 1 | -12 | -82 | -28 | 413 | 6.69 | < 0.001 |
L cerebellum 7b | -26 | -74 | -48 | 102 | 6.04 | 0.007 |
R cerebellum crus 1 | 18 | -90 | -22 | 84 | 5.96 | 0.014 |
Temporal clusters | ||||||
L inferior temporal gyrus | -50 | -56 | -8 | 79 | 6.02 | 0.017 |
R inferior temporal gyrus | 54 | -66 | -12 | 225 | 6.74 | < 0.001 |
R middle temporal gyrus | 62 | -42 | -2 | 88 | 5.49 | 0.012 |
Precentral cluster | ||||||
L precentral gyrus | -44 | 4 | 42 | 92 | 5.66 | 0.010 |
Middle state (k = 16) | ||||||
R inferior parietal lobule | 46 | -38 | 56 | 25 | 5.30 | 0.013 c |
Slow state (k = 30) | ||||||
L cerebellum 6 | -24 | -44 | -36 | 122 | 6.19 | 0.003 |
R cerebellum 8 | 26 | -42 | -52 | 75 | 5.89 | 0.017 |
aThis cluster spans L precuneus, R angular gyrus and R precuneus.
bThis cluster spans R superior frontal gyrus and R middle frontal gyrus.
ccorrected for parietal (the superior and inferior parietal) lobules, otherwise corrected for the entire brain
Results from the univariate regression analysis with the 30-state model provided highly redundant but rich information on possible brain regions related to formation of multiple motor memories. For comparison, we checked if the standard two-state model [1,28] could explain our behavioral data and brain activity (see Materials and Methods). We found that the two-state model was a subset of the 30-state model. That is, the time constants of the fast process and the slow process in the two-state model were respectively 47.9 s and 1.5 h. These are very close to two time constants of the 30-state model, k = 9 (55.2 s) and k = 21 (2.22 h), with correlation coefficients of the states between the two models being respectively 0.993 and 0.991. Brain activity identified by the two-state model was essentially the same as that found by the states of k = 9 and k = 21 in the 30-state model (S2 Fig).
A possible concern with these univariate regression analyses is that the high-pass filtering with 128 s cut-off frequency, which is used in preprocessing to remove low-frequency noise due to scanner drift, could filter out the lower-frequency components in the cerebellum. An analysis of the frequency components of high-pass filtered BOLD signals using Fast Fourier Transform (FFT) shows that the frequency components in the cerebellum remained large enough to be correlated with the regressors with the slower time constants (see S3 Fig). A second possible concern with this analysis is that the identified activity is not related to memory states, but to errors. This is an especially valid concern for the faster states, because the memory states of the fast components correlate with the errors used for updating adaptation, with high values at the initial stages and low values at the late stages of adaptation. In our regression analysis of memory states, we included parametric regressors associated with error as those of no interest, i.e., as nuisance regressors for the decreasing effects of error-related activity on the estimation of memory-related activity. We verified that these error-associated nuisance regressors appropriately explained away the error in the regression analyses for the faster states (see S2 Text and S4 Fig).
Dimensionality Reduction
The T-map shown in Fig 3 is redundant because of highly correlated regressors. We thus applied the sparse SVD to the T-value profiles of voxels as function of time constants to extract principal components (see Materials and Methods for details). All the voxels that survived the voxel-level threshold p < 0.001 for at least one time constant in the initial exploratory regression analysis were included in this sparse SVD analysis. The SVD analysis decomposed the data matrix into the following three matrices: eigenvariates, eigenvalues, and eigenimages. For both Tasks 1 and 2, a sparse SVD model with four components was selected via the model selection method of Bayesian Information Criterion (BIC) [31]. The contributions of these four components to the variance in the matrix of T-values were (54.26%, 38.94%, 6.32%, 0.47%) and (51.38%, 39.72%, 8.35%, 0.55%) for Tasks 1 and 2, respectively. The first and second eigenvariates correspond to the fast states (the second eigenvariate has notably large values for small time constants that rapidly approach zero around 2 min), while the third and fourth eigenvariates represent the slow and middle states, respectively (Fig 4A and 4B). Because a similar pattern was observed in corresponding eigenimages for Tasks 1 and 2 (see S5 Fig and S1 and S2 Videos), their overlap is presented in Fig 4C after each image was thresholded so that the top 10% of voxels with the highest values are included in the image. The first component is located mainly around the junction between the supplementary motor area and superior frontal gyrus (SMA/SFG), and in medial occipitoparietal regions (MOP). The second is located mainly in the posterior region of the intraparietal sulcus (pIPS) and partly in the posterior cerebellum (pCBL: crura 1 and 2). The third is mainly in the anterior-medial part of the cerebellum (a-mCBL: lobules 6 and 8), and the right temporoparietal junction (TPJ). The fourth is in the anterior part of the intraparietal sulcus (aIPS), which includes the aIPL region for the middle component (e.g., k = 16), the middle temporal and inferior temporal gyri (M/ITG), and the inferior frontal gyrus (IFG). More detailed quantification of eigenimages for Tasks 1 and 2 are provided in S2–S9 Tables.
We then verified whether a reduced model with four states derived from the SVD analysis, instead of the full model with 30 states, could account for the behavioral adaption. From the eigenvariates of the T-map (Fig 4A and 4B), we constructed a reduced four-state model consisting of "eigenstates," each of which was estimated as a linear combination of the 30 regressors weighted by the corresponding eigenvalues. The variance explained by the four-state model was as high as the original 30-state model (mean squared error = 4.96°, R 2 = 0.981). Thus, the model reduced from 30 to four states based on the neural activities well explains the behavioral data.
Decoding Analysis
The above model-based regression analysis indicated contributions of the parietal and the anterior cerebellar regions to the middle and slow states, respectively. To exclude the possibility that these regression results are due to spurious correlations, we then conducted a decoding analysis to test whether the regional brain activity could be used to classify the two rotations (40° and −40°). If classification accuracy varies across the three sessions, this would indicate that activity in these regions changes with dynamics similar to the dynamics of medium or slower states. We thus applied a multivoxel pattern analysis (MVPA) to parietal regions in which BOLD signals significantly correlated with at least one of the intermediate components (k = 11,…,20), and in cerebellar regions in which signals were significantly correlated with at least one of the slow components (k = 21,…,30) (Fig 5A, see Materials and Methods). The MVPA revealed significantly above chance accuracy (50%) in the right aIPL as well as in the cerebellum for all sessions, with averaged accuracy across subjects ranging from 60% to 70% (Fig 5B). This above-chance classification is not surprising because the direction of hand movements changed depending on the rotation types. However, two-way analysis of variance (ANOVA) with regions of interest (ROIs) and sessions as a within-subject factor revealed a significant interaction between the two factors (F (2, 40) = 3.504, p < 0.05). A simple main effect analysis revealed significant increase of accuracy across sessions in the cerebellum (F (2, 80) = 10.16, p < 0.001), but no significant difference in the right aIPL (F (2, 80) = 0.736, p = 0.482). These results thus indicate that specificity of activity patterns to the task (40 or −40° rotations) increased with sessions in the cerebellum but did not change in the parietal regions. We then verified that the increase in classification accuracy across sessions observed in the cerebellum was unlikely due to behavioral confounds during adaptation (see S3 Text).
Discussion
We investigated the spatiotemporal neural correlates of motor memory involved in visuomotor adaptation via estimation of the latent memory states derived from a model with multiple states with different time constants. A univariate regression analysis, which correlated the model states with brain activity during the whole adaptation process, first located the neural substrates related to formation of the multiple motor memories. Then, a sparse SVD analysis showed four characteristic networks, associated with a specific profile of correlation with different time constants. Finally, a classification analysis showed that specific activity patterns to the rotation type were acquired in the cerebellum as adaptation proceeded.
We organize the following discussion of our results from the faster to the slower time constants. For the first few fastest constants (2 s to 4.6 s), various brain regions were activated, including frontal and parietal lobes, as well as the visual cortex, the temporal cortex, and regions in the posterior part of the cerebellum, specifically in crus 1. It is known that regions in the crus 1 are connected with prefrontal and parietal cerebral regions according to studies on cerebro-cerebellar connections in monkeys [29] and humans [30]. For slower but still relatively fast time constants up to k = 6 (15.9 s), the widespread activated regions became more localized into the PPC. A possible reason for activation of parietal activity is mental rotation, which has been known to contribute to early adaptation [7,32,33] and has been consistently localized in the superior parietal regions (e.g., [34,35]). In line with these studies, the subjects in our study who showed larger reaction times tended to perform the task better with lower directional errors (R 2 = 0.229, p = 0.028).
For intermediate time constants around 16.7 min, we found a characteristic region of activation in the right aIPL (blue circle in Fig 3). This is consistent with a prism-adaptation study [6] finding activity contralateral to the reaching hand in the lateral bank of the intraparietal sulcus, close to the aIPL activity in our study (note that subjects used the left hand in the current experiment). It has been suggested that the left parietal regions are critical for visuomotor rotation, because patients with left parietal damage show a deficit in adaptation [36,37]. We also found activity in the left aIPL correlated with intermediate time constants if the threshold is lowered (p < 0.05 uncorrected), but the activity in the right aIPL was more significant than that in the left aIPL. Muhta and colleagues showed the importance of the left parietal region for construction of visuomotor mapping based on online correction of error [36]. In contrast, we only provided terminal feedback after the end of joystick movement, and the role of online correction was relatively small. Thus, although further studies are needed to understand the contradiction in parietal laterality between our study and Mutha et al.’s, the above difference in error feedback may explain this difference.
For slower time constants, the number of correlated voxels in the aIPL decreased, and the number in the anterior-medial cerebellum increased. With time constants longer than 1 h, the main activities were identified in the anterior-medial cerebellum; this result is in line with previous studies [6,15,18]. Regions related to the slow states distribute in the anterior-medial parts and mainly in lobule 6. These cerebellar regions are connected with cerebral sensorimotor networks, including the primary motor and sensory cortices, the premotor cortex, and the supplementary motor area [30]. This suggests that the cerebellar slow states directly contribute to sensorimotor control without help from cognitive processes (prefrontal-parietal functions) probably corresponding to an “autonomous” stage [38] by constructing internal models [18,25,39]. A recent study reported that transcranial direct current stimulation (tDCS) over the cerebellum induced faster adaptation during training but did not affect retention after training [40]. Because tDCS is likely to affect neural activity in the posterior part of the cerebellum to a greater extent than in the anterior-medial part, our findings of the fast components of motor memory in the posterior part (Fig 3 and S1 Fig) are consistent with this previous study. The existence of slow components in lobule 6 is consistent with a study reporting that patients with focal degeneration in this lobule have difficulty in adapting to a visuomotor rotation [41]. In addition, activity related to kinematic errors that drive visuomotor rotation has been found in cerebellar regions, including lobule 6 [20].
The SVD analysis of variability in specificities to timescales over the brain identified four components, two fast, one middle, and one slow, each associated with different brain networks. Three groups of components (fast, middle, and slow) are consistent with a recently proposed three-component model of visuomotor adaptation [42]. The first and second SVD components are subset regions of the fastest component delineated by the regression analysis and indicate the existence of two types of fast components: one related to SMA/SFG and MOP, and the other related to posterior IPS and cerebellum. Our previous study [43] indicated that medial parietal regions (including MOP) are related to switching of internal models based on contextual cues and that posterior-lateral regions of the IPS are related to switching based on sensorimotor feedback. Analogy of the current results to our previous study suggests that the first SVD component corresponds to association between visual cue (target color) and responses for tasks, while the second one corresponds to fast adaptation (or rearrangement of haptic directions) based on sensorimotor feedback. The third component confirmed the slow component in the anterior-medial cerebellum. The fourth component in the aIPS completely includes aIPL found for the middle time constant. This component was also found in the IFG and M/ITG. Neurons in the IFG are activated when monkeys [44]and humans [45,46] observe goal-directed hand actions and when humans imagine hand actions [47]. The IFG has been suggested to contain sensorimotor memory representation related to hand movement [48]. The M/ITG is known to be involved in visual motion analysis [49], but specific interpretation of this region in the visuomotor adaptation is unknown, at least to our knowledge.
Our decoding analysis indicated that the activity pattern in the cerebellum became more specific to rotation type as adaptation proceeded. A previous study by one of us [25] showed that cerebellar activities correlated with learning to control two different cursors (rotation and velocity) were spatially segregated, supporting modular organization of internal models, thus suggesting that overlapped regions represent common properties of learning two tasks. In contrast, the results of the present study show no significant regional difference of activities in either the parietal or the cerebellar regions between visuomotor rotations of 40° and −40°(S6 Fig). We surmise that the overlap arises because the two visuomotor transformations are identical except for the rotation angle. Within this common cerebellar region, as well as in the PPC, the MVPA discriminated the representation of the opposing rotations with higher decoding accuracy than chance level. As mentioned earlier, this result is not surprising because the direction of hand movements changed depending on the rotational types and could contribute to successful decoding. Importantly, however, we observed significant increase of the decoding accuracy across sessions in the cerebellar regions related to the slow states (lobules 6 and 8), but not in the parietal regions related to middle states. The increase in classification accuracy in the cerebellum, especially from the second to the third session, does not appear to be due to changes in performance, because we could not identify significant difference in performance between the second and third sessions.
While the primary motor cortex (M1) has been involved in the late stage of adaptation in previous studies [8,40,50,51], we found no significantly correlated activities in M1. In addition, in a recent study [51], we found that MVPA could classify opposite rotational types (90° or −90°) from activity patterns in sensorimotor cortex including M1, suggesting separate representation for dual visuomotor adaptation. However, the classification was based on fMRI activity measured after intensive training on a continuous tracking task for more than 3 d and a total of 160 min. Therefore, M1 may be correlated with even slower timescales beyond the range of our study, inducing structural changes [8], although further studies would be necessary to confirm this correlation.
Unlike conventional fMRI regression analysis, model-based fMRI regression analysis allows the study of the underlying latent variables generating the behavior in motor adaptation. In previous neuroimaging studies of motor adaptation, the observable behavioral variables of interest were used to define contrasts or regressors for analysis of brain activity. However, the multiple motor memories and related activity that drive the behavior are internal to the subject undergoing adaptation and thus cannot be measured directly (although they can, in theory, be manipulated by experimental conditions such as task schedules, e.g., [52]). Here, as in a number of reinforcement learning studies (e.g., [53] for review), we circumvented this difficulty by first estimating internal memory states via computational modeling and then by using these internal variables in the regression analysis to detect neural representations related to formation of motor memories at multiple timescales. Note that we carefully designed our regression models by including possible confounding variables, notably type of task, hand movement, error, and reaction time in each trial. However, when confounding variables are correlated with memory states, such as errors with fast memory states, regression cannot completely dissociate activity related to these confounding variables from activity directly related to memory itself. In addition, our regression models did not include additional behavioral and physical quantities that may correlate with memory states in the model and that may or may not be related to formation of multiple memories, such as attention, eye movements, and repetition of the task. Thus, our results revealed the neural substrates related to formation of the multiple memories at multiple time scales, but not necessarily the neural substrates of multiple memories at multiple time scales per se. Experiments in which nuisance parameters (such as error) are varied while adaptation is constant would allow the effects of these confounds to be dissociated.
Recent studies have suggested that motor adaptation is a multifaceted process. In particular, behavior during adaptation is not only updated by error-based learning mechanisms, as we have assumed with our model, but also presumably updated by reward-based and use-dependent mechanisms [54–56]. Each of these processes likely operates at multiple time constants as well. In addition, explicit and implicit aspects of motor adaptation have been recently shown to have fast and slow dynamics, respectively [57]. Thus, although the interpretation of what “memory states” represent varies between adaptation studies, our experiment of the neural correlates related to formation of motor memories at multiple time scales is, we believe, highly relevant. Note, however, that our study does not provide a clear picture of the connectivity and spatial arrangements of the multiple neural representations involved. In particular, in line with a previous study supporting a parallel architecture of motor memories over a serial architecture [2], we have assumed a parallel architecture in our model in which all memories were updated by a common error signal (see Eq 2). Our results, however, cannot provide evidence for such parallel architecture. To further clarify the actual neural mechanism, model-based fMRI regression can be complemented by functional connectivity analysis [58] or causal and interfering manipulation of neural function via transcranial magnetic stimulation (TMS) or tDCS [59–62].
Materials and Methods
Subjects
Twenty-one right-handed and neurologically healthy volunteers participated in the study (20–50 y old, mean age of 27.3 y, six females). Handedness was assessed by a modified version of the Edinburgh Handedness Inventory [63]. Written informed consent was obtained from all subjects in accordance with the Declaration of Helsinki. The experimental protocol received approval from the local ethics committee at the Advanced Telecommunications Research Institute International.
Task Procedures
We designed a dual-task adaptation experiment with two opposing visuomotor rotations. At the beginning of each trial, a white cross appeared at the center of screen; this cross served both as the fixation point and as the initial cursor position. A round colored target of 0.7 cm radius appeared on the top of the screen 8 cm from the center. Subjects were instructed to manipulate an fMRI compatible joystick to move the cursor to the target within 1.5 s (maximum movement time); otherwise, the trial was considered a missed trial, and the data was not analyzed. After the maximum movement time, the cursor appeared in the direction of the joystick movement at 8 cm from the center for 500 ms to provide angular error feedback. To encourage subjects to respond faster, the color of the feedback cursor turned yellow if the subject did not move within 800 ms. ITIs were randomly generated from 4 to 14 s from an exponential distribution, in 2 s increments. For each trial, we calculated the angular error between the target direction and the final cursor direction from the center of the screen. Note that the size of the target was equivalent to 10° in visual angle, allowing up to ±5° of error to “hit” the target.
There were three different tasks: a control task and the two different visuomotor tasks, Tasks 1, 2, in which the cursor movement was rotated 40° and −40°, respectively. In the control task, the cursor movement was not rotated. The experiment was divided in three sessions, each session lasting about 11 min, with a 1-min break between sessions. Each session consisted of 99 trials, with 27 trials for the control task and 36 trials for each of Tasks 1 and 2. Three different target colors, red, blue, and green, were used to distinguish the different tasks. Each task was presented in blocks of nine trials, with blocks presented according to schedules such as C1212C2121C2121C1212C, where C, 1, and 2 indicate a block of nine trials for the Control, Task 1, and Task 2. There were two possible schedules starting with either Task 1 (11 subjects) or 2 (10 subjects), because we counterbalanced the sequence of Tasks 1 and 2 across subjects and sessions to eliminate any confounding effects due to schedule. Similarly, target colors were counterbalanced across subjects. Before the experiment, the participants performed a familiarization session of 150 trials of the control task.
Stimuli were presented on a liquid crystal display and projected onto a custom-made viewing screen. Subjects laid in a supine position in the scanner, viewed the screen via a mirror, and were unable to see their hand throughout this task. They were instructed to use their left thumb and index/middle pair fingers to control the joystick with the left upper arm immobilized using foam pads to minimize body motions.
Model Fitting
We used the MATLAB fmincon function to estimate the value of the two parameters r and q that minimize the mean squared error between the actual adaptations of subjects for Tasks 1 and 2 and model predictions, y(n) (see Eqs 1 and 3). The adaptation data used for the model fit were calculated by averaging the observed adaptations of 21 subjects, excluding missed trials and trials with large (>40°) overshoot. Less than 1% of the total number of trials was excluded. Because of the task sequence counterbalancing, the average was computed after inverting the sign of adaptation for ten subjects starting with Task 2.
Using the estimated parameters, we simulated the time series of the 30 states of memory for each task, x k every 1.8 s, corresponding to scanner repetition time (TR). Because the model equation (Eq 2) updates the states at each trial, we interpolated and resampled the states of memory at the time of image acquisitions, i.e., multiples of TR by calculating the decay depending on time constants following trial n. The 30 simulated memory traces for each task were used as regressors for the univariate fMRI analysis. For additional modeling with the standard two-state model [1,28], we fitted four free parameters, time constants and learning rates for the fast and the slow processes, using the same method described above. It is notable that the 30 time constants in the proposed model were predetermined with a logarithmic scale and the 30 learning rates were calculated by two free parameters (Eq 3). The estimated states of the fast and the slow processes were compared with those of the proposed model (see Results and S2 Fig).
MRI Acquisition
A 3-T Siemens Trio scanner (Erlangen, Germany) with a 12-channel head coil was used to perform T2*-weighted echo planar imaging (EPI). A total of 368 scans were acquired for each session with a gradient echo EPI sequence, and each subject underwent three sessions. The first five scans were discarded to allow for T1 equilibration. Scanning parameters were repetition time (TR), 1,800 ms; echo time (TE), 30 ms; flip angle (FA), 70°; field of view (FOV), 192 × 192 mm; matrix, 64 × 64; 30 axial slices; and slice thickness, 5 mm without gap. T1-weighted anatomical imaging with an MP-RAGE sequence was performed with the following parameters: TR, 2,250 ms; TE, 3.06 ms; FA, 9°; FOV, 256 × 256 mm; matrix, 256 × 256; 192 axial slices; and slice thickness, 1 mm without gap.
Processing of fMRI Data
Image preprocessing was performed using SPM8 software (Wellcome Trust Centre for Neuroimaging, http://www.fil.ion.ucl.ac.uk/spm). All functional images were first realigned to adjust for motion-related artifacts. The realigned images were then spatially normalized with the Montreal Neurological Institute (MNI) template and resampled into 2-mm-cube voxels with sinc interpolation. All images were spatially smoothed using a Gaussian kernel of 8 × 8 × 8 mm full width at half maximum. The smoothing was not performed for multivoxel pattern analysis (see below), as this could blur fine-grained information contained in multivoxel activity [64].
Model-Based Regression Analysis of fMRI Data
We first conducted a model-based regression analysis of fMRI data. For each of Task 1 and Task 2, the 30 memory traces with different time constants, which were estimated with the previous behavioral modeling, were used as explanatory variables (i.e., regressors) using the general linear model (GLM). To accommodate the problem of multicollinearity due to similarity of regressors between adjacent time constants, we separately estimated 30 regression models corresponding to individual time constants:
(4) |
Here, S is a time series of the BOLD signal at each voxel. The regressors (x k,1 and x k,2) in each model are time series of motor memories corresponding to one of the 30 time constants (k = 1,…,30; see Eq 1 in behavioral results and modeling) for Tasks 1 (40°) and 2 (−40°). Each of them was resampled at scan timings of brain activity and orthogonalized using an SPM function (spm_orth.m).
We included the following regressors as “effects of no interests” in the analysis. First, pulse functions that were assigned 1 at every onset of joystick movement and 0 otherwise were included to model hand movements. We assumed that convolution of these functions with a canonical hemodynamic function can model the hand movements with a short movement time in our task (mean ± SEM: 296 ± 2.50 ms), with a separate model for each trial type (Tasks 1 and 2 and the Control). In addition, two parametric regressors were included to model the effect of directional errors and reaction times (“parametric modulation” in SPM). In each trial, these parametric regressors also used the pulse functions at onset of joystick movement, but their amplitudes were modulated by directional error and reaction time. We included three boxcar functions, each of which modeled a session effect. Therefore, 12 regressors in total (3 [hand movement, error and reaction time] x 3 [tasks] + 3 [sessions]) were included as effects of no interests.
Low-frequency noise was removed using a high-pass filter with a cut-off period of 128 s, and serial correlations among scans were estimated with an autoregressive model implemented in SPM8. Contrast images of each subject, generated using a fixed-effects model, were taken into the group analysis using a random-effects model of a one-sample t-test. Because the secondary purpose of the model-based regression analysis was to recruit possible regions related to many (30) states of motor memory for the sparse singular value decomposition analysis (see below), activation was reported with a lenient threshold of p < 0.001 uncorrected for multiple comparisons at the voxel level. In further analyses, we applied a stricter inclusion criterion, a cluster-level correction based on the FWER, to representative activations such as those related to the fast, middle, or slow states.
Sparse SVD Analysis
The univariate analysis with a p-value cutoff resulted in a grand total of 23,413 and 24,676 selected voxels associated with 30 memory states for Tasks 1 and 2, respectively. Thus, the univariate analysis provided two matrices X of T-values for these selected voxels, each for one of the two tasks. We applied the sparse SVD [65] to each matrix X. The sparse SVD was implemented in a refined way with the orthogonality constraints. Specifically, we adopted the regularized estimator that minimizes the sum of squared Frobenius norm of the difference between X and UDV T and a sparsity-inducing regularization term on matrices D, UD, and VD, subject to the orthogonality constraints that both matrices U (eigenvariates) and V (eigenimages) are orthonormal, where D (eigenvalues) is a diagonal matrix. We employed the entry-wise L 1 norm, which is the sum of all absolute entries of a matrix, multiplied by a regularization parameter to regularize the three matrices D, UD, and VD. Each regularization parameter was chosen in a decreasing grid of 20 values ranging from 200 to 0.1 (equally spaced in the logarithmic scale). For each set of regularization parameters, we obtained a sparse SVD model in which the number of nonzero singular values in gives the rank of the matrix decomposition and singular vectors in can be sparse with some entries being zero. This produced a sequence of SVD models with sparse singular values and vectors. We then employed the standard BIC model selection criterion [31] to select the sparse SVD model.
Multivoxel Pattern Analysis (MVPA)
We additionally conducted an MVPA to test if the regional brain activity could be used to classify the two rotational types (40° and −40°). The ROIs include the right parietal lobe and the cerebellum. Our previous model-based regression analysis suggested that these regions are related to the middle (the parietal regions) and the slow (the cerebellum) states (blue circles in Fig 3A). The ROI of the right parietal region was the superior and the inferior parietal lobes according to anatomical map in Pick Atlas (http://fmri.wfubmc.edu/software/PickAtlas). The cerebellar ROI was anatomically defined bilaterally. Fig 5A shows the parietal and cerebellar regions enclosed by red and cyan curves, respectively. Within the parietal ROI, we applied MVPA to BOLD signals of voxels that were significantly correlated with at least one of the intermediate states (τ k, ranging from 2.1 to 87.9 min: k = 11,…,20) in the model-based regression analysis. In the cerebellum, MVPA was applied to signals that were significantly correlated with at least one of the slow states (τ k, ranging from 2.2 to 92.6 h: k = 21,…,30). The voxels selected in Tasks 1 and 2 were jointly used by taking a union.
To conduct the classification, we first modeled all 297 trials as separate pulse regressors at the onset of movement, which were convolved with a canonical hemodynamic response function. This analysis yielded 297 independently estimated parameters (beta values) for each individual voxel. The 198 trials with rotational conditions (40° or −40°) were subsequently used as inputs for the MVPA. The classification was performed with a linear support vector machine (SVM) implemented in LIBSVM (http://www.csie.ntu.edu.tw/~cjlin/libsvm/), with default parameters (a fixed regularization parameter C = 1). The separate training and testing datasets were generated with a pseudo-random half split of all the samples. Cross validation was then conducted for 1,000 times for each subject, and the average classification accuracy was estimated. The two-way ANOVA with ROIs and sessions as an intrasubject factor was used to test the differences in classification accuracies.
Supporting Information
Acknowledgments
We thank Drs. Jeong-Yoon Lee, Bosco Tjan, James Finley, and Mitsuo Kawato for their useful comments. We also thank Ms. Yuka Furukawa for subject recruitment and members of the Brain Activity Imaging Center of ATR-Promotions for technical support.
Abbreviations
- aIPL
anterior region of the inferior parietal lobe
- a-mCBL
anterior-medial part of the cerebellum
- ANOVA
analysis of variance
- BIC
Bayesian Information Criterion
- BOLD
blood-oxygen-level dependent
- EPI
echo planar imaging
- FA
flip angle
- FFT
Fast Fourier Transform
- fMRI
functional magnetic resonance imaging
- FOV
field of view
- FWER
family-wise error rate
- GLM
general linear model
- IFG
inferior frontal gyrus
- IPS
intraparietal sulcus
- ITI
intertrial interval
- M1
primary motor cortex
- M/ITG
the middle temporal and inferior temporal gyri
- MNI
Montreal Neurological Institute
- MOP
medial occipitoparietal
- MRI
magnetic resonance imaging
- PET
positron emission tomography
- PFC
prefrontal cortex
- pIPS
posterior region of the intraparietal sulcus
- pCBL
posterior cerebellum
- PPC
posterior parietal cortex
- ROI
region of interest
- SEM
standard error of the mean
- SFG
superior frontal gyrus
- SMA
supplementary motor area
- SVD
singular value decomposition
- SVM
support vector machine
- tDCS
transcranial direct current stimulation
- TE
echo time
- TPJ
temporoparietal junction
- TMS
transcranial magnetic stimulation
- TR
repetition time
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
Grant NSF BCS 1031899 to NS supported the behavioral experiment, computational modeling, and model-based fMRI part of this study. http://www.nsf.gov/div/index.jsp?div=bcs. Grant NSF CAREER Award DMS-0955316 to JL supported the SVD analysis of brain data. http://www.nsf.gov/div/index.jsp?div=DMS. Grant JSPS KAKENHI Grant Number 26120002 to HI supported the fMRI experiment and parts of imaging data analysis. http://www.jsps.go.jp/english/index.html. "Development of BMI Technologies for Clinical Application" SRPBS AMED and ImPACT Cabinet Office of Japan to HI supported parts of imaging data analysis. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Smith MA, Ghazizadeh A, Shadmehr R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS Biol. 2006;4(6):e179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Lee J-Y, Schweighofer N. Dual adaptation supports a parallel architecture of motor memory. J Neurosci. 2009;29(33):10396–404. 10.1523/JNEUROSCI.1294-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Yang Y, Lisberger SG. Learning on multiple timescales in smooth pursuit eye movements. J Neurophysiol. 2010;104(5):2850–62. 10.1152/jn.00761.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Colagiorgio P, Bertolini G, Bockisch CJ, Straumann D, Ramat S. Multiple timescales in the adaptation of the rotational VOR. J Neurophysiol. 2015;113(9):3130–42. 10.1152/jn.00688.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Kording KP, Tenenbaum JB, Shadmehr R. The dynamics of memory as a consequence of optimal adaptation to a changing body. Nat Neurosci. 2007;10(6):779–86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Luauté J, Schwartz S, Rossetti Y, Spiridon M, Rode G, Boisson D, et al. Dynamic changes in brain activity during prism adaptation. J Neurosci. 2009;29(1):169–78. 10.1523/JNEUROSCI.3054-08.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Anguera JA, Reuter-Lorenz PA, Willingham DT, Seidler RD. Contributions of spatial working memory to visuomotor learning. J Cogn Neurosci. 2010;22(9):1917–30. 10.1162/jocn.2009.21351 [DOI] [PubMed] [Google Scholar]
- 8. Landi SM, Baguear F, Della-Maggiore V. One week of motor adaptation induces structural changes in primary motor cortex that predict long-term memory one year later. J Neurosci. 2011;31(33):11808–13. 10.1523/JNEUROSCI.2253-11.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Clower DM, Hoffman JM, Votaw JR, Faber TL, Woods RP, Alexander GE. Role of posterior parietal cortex in the recalibration of visually guided reaching. Nature. 1996;383:618–21. [DOI] [PubMed] [Google Scholar]
- 10. Shadmehr R, Holcomb HH. Neural correlates of motor memory consolidation. Science. 1997;277(5327):821–5. [DOI] [PubMed] [Google Scholar]
- 11. Krakauer JW, Ghilardi M-F, Mentis M, Barnes A, Veytsman M, Eidelberg D, et al. Differential cortical and subcortical activations in learning rotations and gains for reaching: a PET study. J Neurophysiol. 2004;91(2):924–33. [DOI] [PubMed] [Google Scholar]
- 12. Della-Maggiore V, McIntosh AR. Time course of changes in brain activity and functional connectivity associated with long-term adaptation to a rotational transformation. J Neurophysiol. 2005;93(4):2254–62. [DOI] [PubMed] [Google Scholar]
- 13. Olesen PJ, Westerberg H, Klingberg T. Increased prefrontal and parietal activity after training of working memory. Nature Neurosci. 2003;7(1):75–9. [DOI] [PubMed] [Google Scholar]
- 14. Pessoa L, Gutierrez E, Bandettini PA, Ungerleider LG. Neural correlates of visual working memory: fMRI amplitude predicts task performance. Neuron. 2002;35(5):975–87. [DOI] [PubMed] [Google Scholar]
- 15. Graydon FX, Friston KJ, Thomas CG, Brooks VB, Menon RS. Learning-related fMRI activation associated with a rotational visuo-motor transformation. Brain Res Cogn Brain Res. 2005;22(3):373–83. [DOI] [PubMed] [Google Scholar]
- 16. Buneo CA, Andersen RA. The posterior parietal cortex: sensorimotor interface for the planning and online control of visually guided movements. Neuropsychologia. 2006;44(13):2594–606. [DOI] [PubMed] [Google Scholar]
- 17. Tanaka H, Sejnowski TJ, Krakauer JW. Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. J Neurophysiol. 2009;102(5):2921–32. 10.1152/jn.90834.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Imamizu H, Miyauchi S, Tamada T, Sasaki Y, Takino R, Pütz B, et al. Human cerebellar activity reflecting an acquired internal model of a new tool. Nature. 2000;403(6766):192–5. [DOI] [PubMed] [Google Scholar]
- 19. Seidler RD, Noll DC. Neuroanatomical correlates of motor acquisition and motor transfer. J Neurophysiol. 2008;99(4):1836–45. 10.1152/jn.01187.2007 [DOI] [PubMed] [Google Scholar]
- 20. Diedrichsen J, Hashambhoy Y, Rane T, Shadmehr R. Neural correlates of reach errors. J Neurosci. 2005;25(43):9919–31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Schweighofer N, Doya K, Fukai H, Chiron JV, Furukawa T, Kawato M. Chaos may enhance information transmission in the inferior olive. Proc Natl Acad Sci U S A. 2004;101(13):4655–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Wolpert DM, Miall RC, Kawato M. Internal models in the cerebellum. Trends Cogn Sci. 1998;2(9):338–47. [DOI] [PubMed] [Google Scholar]
- 23. Kawato M. Internal models for motor control and trajectory planning. Curr Opin Neurobiol. 1999;9(6):718–27. [DOI] [PubMed] [Google Scholar]
- 24. Schweighofer N, Spoelstra J, Arbib MA, Kawato M. Role of the cerebellum in reaching movements in humans. II. A neural model of the intermediate cerebellum. Eur J Neurosci. 1998;10(1):95–105. [DOI] [PubMed] [Google Scholar]
- 25. Imamizu H, Kuroda T, Miyauchi S, Yoshioka T, Kawato M. Modular organization of internal models of tools in the human cerebellum. Proc Natl Acad Sci U S A. 2003;100(9):5461–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Wolpert DM, Diedrichsen J, Flanagan JR. Principles of sensorimotor learning. Nat Rev Neurosci. 2011;12(12):739–51. 10.1038/nrn3112 [DOI] [PubMed] [Google Scholar]
- 27. Tanaka H, Krakauer JW, Sejnowski TJ. Generalization and multirate models of motor adaptation. Neural Comput. 2012;24(4):939–66. 10.1162/NECO_a_00262 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Ethier V, Zee DS, Shadmehr R. Spontaneous recovery of motor memory during saccade adaptation. J Neurophysiol. 2008;99(5):2577–83. 10.1152/jn.00015.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Kelly RM, Strick PL. Cerebellar loops with motor cortex and prefrontal cortex of a nonhuman primate. J Neurosci. 2003;23(23):8432–44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Habas C, Kamdar N, Nguyen D, Prater K, Beckmann CF, Menon V, et al. Distinct cerebellar contributions to intrinsic connectivity networks. J Neurosci. 2009;29(26):8586–94. 10.1523/JNEUROSCI.1868-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Schwarz G. Estimating the dimension of a model. Ann Stat. 1978;6(2):461–4. [Google Scholar]
- 32. Mazzoni P, Krakauer JW. An implicit plan overrides an explicit strategy during visuomotor adaptation. J Neurosci. 2006;26(14):3642–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Fernandez-Ruiz J, Wong W, Armstrong IT, Flanagan JR. Relation between reaction time and reach errors during visuomotor adaptation. Behav Brain Res. 2011;219(1):8–14. 10.1016/j.bbr.2010.11.060 [DOI] [PubMed] [Google Scholar]
- 34. Tagaris GA, Kim SG, Strupp JP, Andersen P, Ugurbil K, Georgopoulos AP. Mental rotation studied by functional magnetic resonance imaging at high field (4 tesla): performance and cortical activation. J Cogn Neurosci. 1997;9(4):419–32. 10.1162/jocn.1997.9.4.419 [DOI] [PubMed] [Google Scholar]
- 35. Vingerhoets G, de Lange FP, Vandemaele P, Deblaere K, Achten E. Motor imagery in mental rotation: an fMRI study. Neuroimage. 2002;17(3):1623–33. [DOI] [PubMed] [Google Scholar]
- 36. Mutha PK, Sainburg RL, Haaland KY. Left parietal regions are critical for adaptive visuomotor control. J Neurosci. 2011;31(19):6972–81. 10.1523/JNEUROSCI.6432-10.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Mutha PK, Sainburg RL, Haaland KY. Critical neural substrates for correcting unexpected trajectory errors and learning from them. Brain. 2011;134(12):3647–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Fitts PM, Posner MI. Human performance California: Brooks/Cole; 1967. [Google Scholar]
- 39. Bursztyn LL, Ganesh G, Imamizu H, Kawato M, Flanagan JR. Neural correlates of internal-model loading. Curr Biol. 2006;16(24):2440–5. [DOI] [PubMed] [Google Scholar]
- 40. Galea JM, Vazquez A, Pasricha N, de Xivry JJ, Celnik P. Dissociating the roles of the cerebellum and motor cortex during adaptive learning: the motor cortex retains what the cerebellum learns. Cereb Cortex. 2011;21(8):1761–70. 10.1093/cercor/bhq246 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Donchin O, Rabe K, Diedrichsen J, Lally N, Schoch B, Gizewski ER, et al. Cerebellar regions involved in adaptation to force field and visuomotor perturbation. J Neurophysiol. 2012;107(1):134–47. 10.1152/jn.00007.2011 [DOI] [PubMed] [Google Scholar]
- 42. Inoue M, Uchimura M, Karibe A, O'Shea J, Rossetti Y, Kitazawa S. Three timescales in prism adaptation. J Neurophysiol. 2015;113(1):328–38. 10.1152/jn.00803.2013 [DOI] [PubMed] [Google Scholar]
- 43. Imamizu H, Kawato M. Neural correlates of predictive and postdictive switching mechanisms for internal models. J Neurosci. 2008;28(42):10751–65. 10.1523/JNEUROSCI.1106-08.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Rizzolatti G, Fadiga L, Gallese V, Fogassi L. Premotor cortex and the recognition of motor actions. Cogn Brain Res. 1996;3(2):131–41. [DOI] [PubMed] [Google Scholar]
- 45. Buccino G, Binkofski F, Fink GR, Fadiga L, Fogassi L, Gallese V, et al. Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur J Neurosci. 2001;13(2):400–4. [PubMed] [Google Scholar]
- 46. Iacoboni M, Woods RP, Brass M, Bekkering H, Mazziotta JC, Rizzolatti G. Cortical mechanisms of human imitation. Science. 1999;286(5449):2526–8. [DOI] [PubMed] [Google Scholar]
- 47. Binkofski F, Amunts K, Stephan KM, Posse S, Schormann T, Freund HJ, et al. Broca's region subserves imagery of motion: a combined cytoarchitectonic and fMRI study. Hum Brain Mapp. 2000;11(4):273–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Schmitz C, Jenmalm P, Ehrsson HH, Forssberg H. Brain activity during predictable and unpredictable weight changes when lifting objects. J Neurophysiol. 2005;93(3):1498–509. [DOI] [PubMed] [Google Scholar]
- 49. Grill-Spector K, Malach R. The human visual cortex. Annu Rev Neurosci. 2004;27:649–77. [DOI] [PubMed] [Google Scholar]
- 50. Hadipour-Niktarash A, Lee CK, Desmond JE, Shadmehr R. Impairment of retention but not acquisition of a visuomotor skill through time-dependent disruption of primary motor cortex. J Neurosci. 2007;27(49):13413–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Ogawa K, Imamizu H. Human sensorimotor cortex represents conflicting visuomotor mappings. J Neurosci. 2013;33(15):6412–22. 10.1523/JNEUROSCI.4661-12.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Schweighofer N, Lee J-Y, Goh H-T, Choi Y, Kim SS, Stewart JC, et al. Mechanisms of the contextual interference effect in individuals poststroke. J Neurophysiol. 2011;106(5):2632 10.1152/jn.00399.2011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. O'Doherty JP, Hampton A, Kim H. Model‐Based fMRI and Its Application to Reward Learning and Decision Making. Ann N Y Acad Sci. 2007;1104(1):35–53. [DOI] [PubMed] [Google Scholar]
- 54. Huang VS, Haith A, Mazzoni P, Krakauer JW. Rethinking motor learning and savings in adaptation paradigms: model-free memory for successful actions combines with internal models. Neuron. 2011;70(4):787–801. 10.1016/j.neuron.2011.04.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55. Shmuelof L, Huang VS, Haith AM, Delnicki RJ, Mazzoni P, Krakauer JW. Overcoming motor "forgetting" through reinforcement of learned actions. J Neurosci. 2012;32(42):14617–21. 10.1523/JNEUROSCI.2184-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56. Galea JM, Mallia E, Rothwell J, Diedrichsen J. The dissociable effects of punishment and reward on motor learning. Nat Neurosci. 2015;18(4):597–602. 10.1038/nn.3956 [DOI] [PubMed] [Google Scholar]
- 57. McDougle SD, Bond KM, Taylor JA. Explicit and implicit processes constitute the fast and slow processes of sensorimotor learning. J Neurosci. 2015;35(26):9568–79. 10.1523/JNEUROSCI.5061-14.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58. Bullmore E, Sporns O. Complex brain networks: graph theoretical analysis of structural and functional systems. Nat Rev Neurosci. 2009;10(3):186–98. 10.1038/nrn2575 [DOI] [PubMed] [Google Scholar]
- 59. Hardwick RM, Celnik PA. Cerebellar direct current stimulation enhances motor learning in older adults. Neurobiol Aging. 2014;35(10):2217–21. 10.1016/j.neurobiolaging.2014.03.030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60. Block H, Celnik P. Stimulating the cerebellum affects visuomotor adaptation but not intermanual transfer of learning. Cerebellum. 2013;12(6):781–93. 10.1007/s12311-013-0486-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61. Polanía R, Nitsche MA, Paulus W. Modulating functional connectivity patterns and topological functional organization of the human brain with transcranial direct current stimulation. Hum Brain Mapp. 2011;32(8):1236–49. 10.1002/hbm.21104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62. Reis J, Robertson EM, Krakauer JW, Rothwell J, Marshall L, Gerloff C, et al. Consensus: Can transcranial direct current stimulation and transcranial magnetic stimulation enhance motor learning and memory formation? Brain Stimul. 2008;1(4):363–9. [DOI] [PubMed] [Google Scholar]
- 63. Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9(1):97–113. [DOI] [PubMed] [Google Scholar]
- 64. Mur M, Bandettini PA, Kriegeskorte N. Revealing representational content with pattern-information fMRI—an introductory guide. Soc Cogn Affect Neurosci. 2009;4(1):101–9. 10.1093/scan/nsn044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65. Zhang Z, Zha H, Simon H. Low-rank approximations with sparse factors I: Basic algorithms and error analysis. SIAM J. Matrx Anal. Appl. 2002;23:706–27. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are within the paper and its Supporting Information files.