Abstract
Neocortical spiking dynamics control aspects of behavior, yet how these dynamics emerge during motor learning remains elusive. Activity-dependent synaptic plasticity is likely a key mechanism, as it reconfigures network architectures that govern neural dynamics. Here, we examined how the mouse premotor cortex acquires its well-characterized neural dynamics that control movement timing, specifically lick timing. To probe the role of synaptic plasticity, we have genetically manipulated proteins essential for major forms of synaptic plasticity, Ca2+/calmodulin-dependent protein kinase II (CaMKII) and Cofilin, in a region and cell-type-specific manner. Transient inactivation of CaMKII in the premotor cortex blocked learning of new lick timing without affecting the execution of learned action or ongoing spiking activity. Furthermore, among the major glutamatergic neurons in the premotor cortex, CaMKII and Cofilin activity in pyramidal tract (PT) neurons, but not intratelencephalic (IT) neurons, is necessary for learning. High-density electrophysiology in the premotor cortex uncovered that neural dynamics anticipating licks are progressively shaped during learning, which explains the change in lick timing. Such reconfiguration in behaviorally relevant dynamics is impeded by CaMKII manipulation in PT neurons. Altogether, the activity of plasticity-related proteins in PT neurons plays a central role in sculpting neocortical dynamics to learn new behavior.
Introduction
Neural computations are mediated by time-varying and coordinated spiking activity across a population of neurons, referred to as neural dynamics. For example, during the planning of volitional movement, the premotor cortex exhibits slowly varying neural activity that determines the type and timing of upcoming movement, referred to as preparatory activity1,2. Previous research has shown flexible reconfiguration of dynamics, including preparatory activity, during motor learning3–16. But the neural mechanisms that reshape the neocortical dynamics to enable acquisitions of new behavior remain elusive.
Network architectures, i.e., synaptic connections, constrain neural dynamics17. Therefore, altering specific connections in the network architecture through synaptic plasticity is the primary theory for learning12,14,18. First, experience- and learning-dependent synaptic plasticity has been observed across many brain areas7,19–27. Second, essentially all neurons are equipped with molecular pathways that mediate plasticity28–32. Third, manipulations of synaptic plasticity influence learning, although this has primarily been investigated in the hippocampus, amygdala, and cerebellum33–38 and far less in the neocortex11,39–41.
The neocortex contains diverse neuronal cell types across layers, characterized by unique gene expression profiles and anatomical features42–44. These cell types often carry distinct information and contribute to different aspects of neural dynamics and behavior in expert animals performing tasks45–48. The function of synaptic plasticity during learning may also vary across neocortical cell types to shape these cell-type-dependent dynamics and behavior.
To probe the role of synaptic plasticity across cell types during motor learning, we performed a series of acute genetic manipulations of proteins required for synaptic plasticity. We studied learning of motor timing in mice, focusing on the premotor cortex, as it provides several advantages. First, neocortical dynamics in the premotor cortex and their causal roles on behaviors, including timing behavior, have been well-established in expert animals1,2,49–53. In addition, the premotor cortex has been implicated in learning across tasks and species10,54–56, making it an ideal site to examine the function of plasticity in reconfiguring dynamics during learning. Finally, animals are adept at learning motor timing, making it a quick and robust system to study learning. Leveraging this model system with molecular manipulations and high-density electrophysiology, we identified the key cell type required to shape behaviorally relevant neocortical dynamics and timing of action.
Results
CaMKII activity in ALM is necessary to learn new lick timing
We developed an operant motor timing task, in which water-restricted mice learn to delay their lick time in order to acquire water rewards (Fig.1a and Methods). Trial onset was signaled by an auditory cue (3 kHz tone, 0.6 s), and a lick after a following unsignaled delay epoch was rewarded (rewarded trials). An early lick during the delay epoch aborted the trial without a reward. Training proceeded in two stages. First, mice were trained to lick after the cue onset with a minimal delay (0.1 s, ‘cue association’). Second, the delay duration was gradually increased (‘delay training’; reaching criterion performance, 30% rewarded trials in the last 100 trials with a given delay duration, resulted in a delay increase of 0.1 s; Methods). Following this protocol, mice learned to delay lick timing within and across sessions (Fig. 1b; lick time reached 1.20 ± 0.31 s, mean ± SEM, in 6 days of delay training, n = 6 mice). High-speed videography (300 Hz) revealed that animals moved their jaw and tongue before the full tongue protrusion (Extended Data Fig. 1a–f). Yet, the delayed lick time after training was primarily due to the withholding of orofacial movement (Extended Data Fig. 1a–f).
Next, we examined whether synaptic plasticity in the anterior-lateral motor cortex (ALM; AP 2.5mm ML 1.5 mm from Bregma), a premotor cortical area responsible for orofacial movement5,57, is required for this learning. To this end, we blocked the activity of CaMKII, a Ca2+-dependent kinase required to induce major types of synaptic plasticity and learning27,29,30,32,33. A transient manipulation of CaMKII activity using a genetically-encoded photoactivatable competitive inhibitor of CaMKII, paAIP2, blocks the induction of synaptic plasticity37 in the presence of blue light without influencing the excitability of neurons (Extended Data Fig. 2a–f).
Control mice without paAIP2 expression learned new lick timing regardless of blue light illumination of ALM (470nm, 0.5mW, 0.2 Hz; Fig. 1c, first column; Methods). In contrast, AAV-mediated bilateral paAIP2 expression in ALM blocked learning when blue light was illuminated during the delay training, but not in the absence of blue light (Fig. 1c, second column; Extended Data Table 3; Extended Data Table 1 and 2). Notably, during light illumination, mice continued licking after the cue without a change in the variability of lick time (Fig.1c and Extended Data Fig 1g–j). This implies that paAIP2 manipulation does not block animals’ ability to explore different lick times across trials (which is a prerequisite for reinforcement learning58). Instead, the manipulation interferes with the ability to directionally shift the distribution of lick times, presumably guided by rewards. Similar manipulation in M1 (AP 0.0mm ML 1.5 mm from Bregma) did not block learning (Fig. 1c, third column), implying that CaMKII activity in ALM is required for delay learning.
The ALM paAIP2 manipulation did not interfere with the cue association (Fig. 1d). In expert mice trained for two weeks with a fixed delay at 1.5 s (Methods), paAIP2 manipulation did not alter the distribution of lick timing, implying that CaMKII activity in ALM is not required for mice to execute learned delayed licks (Fig. 1e). Electrophysiological recording of ALM in expert mice confirmed that paAIP2 manipulation does not directly perturb ongoing spiking dynamics during behavior (Extended Data Fig. 2g–o). Altogether, CaMKII activity in ALM is specifically required for learning new lick timing but not for the initial cue association, the execution of learned action, or ongoing spiking activity.
CaMKIIα isoform is required for synaptic plasticity and learning, while other CaMKII isoforms are implicated in different cellular functions30,59. Since paAIP2 binds to the kinase domain homologous across the CaMKII family37, paAIP2 likely blocks all of them. To test whether CaMKIIα in ALM is required for learning, we acutely knocked it out in adult ALM by injecting AAV-hsyn-cre in CaMKIIα conditional knockout mice60 (Fig. 1f and Extended Data Fig. 3c). These mice learned cue association, yet could not learn to delay lick timing (Fig. 1f), consistent with the paAIP2 manipulation. Altogether, learning new lick timing requires CaMKIIα activity in ALM.
Synaptic plasticity proteins in PT but not IT cells are required for motor learning
The major excitatory cell types in the premotor cortex include IT and PT neurons, projecting within and outside the telencephalon, respectively (Fig. 2a). Both of these cell types highly express CaMKIIα in ALM43 (Extended Data Fig. 3). The key question is whether synaptic plasticity in these diverse populations has redundant or specialized roles in learning. We generated an AAV expressing paAIP2 in a cre-dependent manner to manipulate CaMKII activity in distinct neocortical cell types (Fig. 2b). Strikingly, paAIP2 manipulation of PT neurons in ALM completely blocked delay learning without affecting the distribution of cue-triggered lick, similar to the bulk manipulation across cell types (Fig. 2b and c; Extended Data Fig.1). We observed consistent behavioral effects whether we labeled PT neurons using Sim1-cre KJ18 transgenic line61 or manipulated individual PT subtypes using retrograde AAV (PTupper and PTlower neurons with distinct subcortical projection47; 2700 ± 208 manipulated cells/animal, mean ± SEM; Fig.2c and Extended Data Fig. 4). In contrast, paAIP2 manipulations in IT neurons (layer 2/3 and 5 IT neurons) did not block learning (Fig. 2c).
To test the necessity of the CaMKIIα isoform across cell types, we acutely knocked out CaMKIIαas9. We injected AAV expressing guide RNA against CaMKIIα30 in ALM of adult mice expressing Cas962 in PTupper or IT neurons (Methods). After a month of AAV injection, a significant proportion of cells that co-express Cas9 and guide RNA lost CaMKIIα protein expression (Fig. 2d and Extended Data Fig. 3). PTupper-specific knockout of CaMKIIα blocked delay learning without any effect on cue association, whereas IT-specific knockout did not affect learning, consistent with the paAIP2 manipulations (Fig. 2e).
As an independent approach to manipulate synaptic plasticity, we inactivated Cofilin, a protein required for actin remodeling during major forms of synaptic plasticity38. To this end, we leveraged Cofilin conjugated with SuperNova (Cofilin-SuperNova), a monomer photosensitizing fluorescent protein for Chromophore Assisted Light Inactivation (CALI)38. PTupper-specific expression of Cofilin-SuperNova and orange light illumination (595 nm, 0.75 mW, 1 min every 10 min) during the delay training blocked learning without affecting cue-triggered licks (Fig. 2f). In contrast, no illumination or unconjugated SuperNova with illumination did not affect learning, implying that CALI-mediated inactivation of Cofilin blocked the learning. Consistent with the CaMKII manipulation, manipulating Cofilin in IT neurons did not affect learning. Altogether, three cell-type specific acute genetic manipulations imply that synaptic plasticity in PT but not IT neurons is necessary to learn new lick timing.
Evolution of ALM preparatory dynamics during delay learning
Since preparatory activity determines the upcoming actions2, ALM preparatory dynamics are likely tailored during learning new lick timing. To characterize preparatory activity in our behavioral task, we performed acute high-density extracellular electrophysiological recordings in ALM during learning and in expert mice (Fig. 3 and Extended Data Fig. 5; with rigorous quality control in spike sorting, Extended Data Fig. 6). Among the 3203 putative pyramidal neurons we recorded from 30 mice, we focused on 1613 neurons with preparatory activity (defined as neurons with significant activity between cue and lick, signed-rank test, p < 0.05; Methods; Extended Data Fig. 7 and Table. 3).
First, we leveraged trial-to-trial variability of lick time (CV = 0.41 ± 0.04; mean ± SEM; Extended Data Fig. 1k) to characterize how ALM preparatory dynamics change as a function of lick time in expert mice. Many ALM neurons showed ramping spiking dynamics starting at the cue onset and reaching a peak around the lick onset2,52 (Fig. 3a, cell 175, and Fig. 3b). When expert mice licked at different timing, the slope of ramping activity was altered without a change in the peak activity level (Fig 3a and b; trials with different lick times are shown in different colors). Consistently, temporal warping of spiking dynamics to normalize the lick time resulted in near-identical activity patterns across trials at both single-cell and population levels (even for non-ramping up cells, e.g., cell 232 in Fig. 3a; Fig 3b and c and Extended Data Fig. 5; Methods). Thus, the ALM preparatory dynamics are temporally stretched or compressed to trigger licking at different times in expert animals, consistent with previous observations in other tasks51–53,63,64.
Next, we examined whether similar reconfiguration in ALM dynamics underlies learning. At the beginning of delay training, mice licked early, and ALM neurons showed a transient response to the cue (Fig. 3e and f and Extended Data Fig.5; blue traces). Since strong ALM activity drives a lick5,45, this high amplitude cue response may explain immediate licks following the cue.
As mice licked later during learning, ALM dynamics progressively changed (Fig. 3e–f; from blue to red traces). First, the spiking activity following the cue decreased (‘cue response’; Fig. 3i), which may explain the loss of immediate licks. In contrast, the activity around the lick onset (‘pre-lick activity’) stayed high across trials (Fig. 3j), which may function as a ‘threshold’ activity level to trigger lick51. Second, slow dynamics (persistent or ramping activity) emerged, and filled the extended temporal gap between the cue and the delayed lick (Fig. 3k and Extended Data Fig. 7; the time between 10% to 90% activity level increased). These two modes of reconfigurations continued throughout delay training, converting the transient cue response into a ramping activity observed in the expert mice (Fig. 3f). Unlike in experts, ALM dynamics during learning were distinct across lick timings after the temporal warping (Fig. 3e–g).
During learning, Pearson’s correlation of ALM population activity between trials with different lick times is high across time points after the cue (Fig. 3h). This implies similar population activity patterns constitute preparatory activity across lick times (while the amplitude of activity changes). Consistently, a large proportion of the ALM preparatory activity is explained along a single dimension (65–80%; Extended Data Fig. 8), implying that learning reconfigures dynamics in a low-dimensional space65. In contrast, in the expert mice, population activity patterns changed between cue to lick, and thus the dimensionality is higher (Fig. 3d and Extended Data Fig. 8). Altogether, the reconfiguration of ALM preparatory dynamics during learning is qualitatively different from that in expert animals.
Blocking CaMKII activity in ALM PT neurons impedes the evolution of dynamics
We next asked how the CaMKII manipulation in PT neurons influences the reconfigurations of ALM preparatory dynamics. To this end, we performed extracellular electrophysiological recordings in ALM in conjunction with PT neuron-specific paAIP2 manipulation during delay training (Fig. 4a).
To quantify how ALM dynamics change over training, we analyzed activity chronologically (Extended Data Fig. 9a). In control mice, the dynamics slowed down over three days of delay training, consistent with the delayed lick time (Fig.4b and c, black). In addition, the cue response significantly decreased within a session on days 2 and 3 of delay training (Fig. 4d; note that the cue response reaches the ‘floor’ as mice lick later, Fig. 3i, which may explain a stronger reduction on day 2). These reconfigurations of preparatory dynamics were significantly attenuated in the animals with PT neuron-specific paAIP2 manipulations (Fig. 4c and d and Extended Data Fig. 9a). Since preparatory activity precedes movement, the impedance in its reconfiguration likely explains the lack of learning during the paAIP2 manipulation.
Lick time and ALM cue response varied across trials, even during paAIP2 manipulations (Extended Data Fig. 7 and 9). In rare trials in which mice happened to lick late during PT neuron-specific paAIP2 manipulation, ALM dynamics were similar to that in the control (Extended Data Fig. 7–9). This implies that paAIP2 manipulation in PT neurons does not perturb spontaneous fluctuations in ALM dynamics. Instead, it is required to directionally reconfigure dynamics for learning.
Potential mechanisms for synaptic plasticity to change lick time
How can synaptic plasticity in PT neurons reconfigure preparatory dynamics and drive learning? We generated a network model of ALM (Fig. 4e and Extended Data Table 4; Methods) constrained by previous findings: IT neurons form strong connections within the neocortex66. PT neurons, in contrast, do not project back to IT neurons but project to the thalamus and brainstem66 (for simplicity, we combined PT subtypes in the network model). The thalamic nuclei receiving PT input project back to ALM, and this thalamocortical loop maintains the preparatory activity67,68. The projection of PT neurons to the brainstem drives a lick when activity is high45,47,48.
This model implemented preparatory dynamics as ALM activity transitioning from the baseline activity to the threshold activity level that triggers a lick2 (Fig. 4f). At the beginning of a trial, the transient cue input rapidly pushes the activity (ball) out of the ‘baseline’ stable point, corresponding to the transient cue response (thick arrows, Fig. 4f bottom). After this transient excursion, the ball slowly rolls down the energy landscape until it reaches the threshold activity level to trigger a lick, which explains the slow ramping dynamics (thin arrows, Fig. 4f bottom). Thus, the amplitude of the cue response influences the following ramping dynamics (the energy landscape illustrates activity along a single dimension and does not explain the full dynamics, e.g., non-monotonic transient changes are affected by other dimensions). We varied the amplitude of the cue input across trials (Fig. 4e and g1), which changed the preparatory activity, and thus, induced across-trial variability in lick times as in the data. This allowed exploration of lick times required for learning58.
By imposing 1) a simple reward-dependent plasticity rule69 in the excitatory synapse between cue input and PT neurons and 2) the delay training protocol we applied to mice, the model reproduced the neural dynamics and learning observed in mice (Fig. 4e–g). A reward was provided when the network happened to ‘lick’ later than the delay. The reward-dependent plasticity potentiated the synapse, which paradoxically reduced the cue response due to strong excitatory inputs from thalamus/ALM neurons to the GABAergic neuron70 (alternatively, a model with synaptic depression without paradoxical effect reproduced similar dynamics and learning; Extended Data Fig. 10c–e). Consequently, in the following trials, the cue response was reduced, and the lick time was delayed. Thus, the plasticity allowed the network to exploit lick time guided by reward, and iterations of this cycle resulted in a gradual and directional change in preparatory dynamics and lick time (Fig. 4f and g). Without the synaptic plasticity in PT neurons, the model displayed no learning without a change in the variability of lick time, reproducing experimental observations (Fig. 4g, blue). The same network could reproduce expert dynamics by varying tonic input71 (Extended Data Fig. 10). Altogether, the model replicates the key experimental observations in this paper and proposes a potential mechanistic link among them: how synaptic plasticity in PT neurons shapes neocortical dynamics and behavior, i.e., decreased ALM cue response (Fig. 4d), generated slow dynamics (Fig. 4c), and delayed lick time (Fig. 4b).
Discussion
We provided lines of evidence supporting synaptic plasticity in PT neurons as a learning mechanism in the motor timing task. First, we performed three types of acute cell-type-specific genetic manipulations targeting proteins required for synaptic plasticity, all of which blocked delay learning when PT but not IT neurons were manipulated. Acute manipulations are unlikely to recruit developmental effects or compensatory mechanisms72. Importantly, these manipulations did not affect the execution of learned behavior, implying that the effect is specific to learning39,73. Second, we performed a series of electrophysiological recordings in and ex vivo (Extended Data Fig. 2), confirming that transient paAIP2 manipulation does not affect the excitability of neurons or ongoing spiking activity. Instead, the paAIP2 manipulation impedes the directional reconfiguration of ALM dynamics, leading to rewarded lick, without perturbing trial-to-trial fluctuations in dynamics and behavior (Fig. 4 and Extended Data Fig.7–9). This is consistent with a view that CaMKII activity in PT neurons consolidates dynamics followed by a reward, presumably via synaptic plasticity of inputs that led to successful actions (Fig 4, model).
Synaptic plasticity has been observed across nearly all brain areas and cell types, including putative IT neurons12,19,21, seemingly suggesting global and redundant learning mechanisms. Thus, it was unexpected for a subset of cell types in one cortical area to be necessary for learning.
PT neurons occupy a unique position in the neocortex: they integrate the cortical input and control the information going through the thalamocortical loop that mediates preparatory activity47,67. Plasticity in PT neurons is, thus, well suited to reconfigure preparatory activity. Interestingly, putative PT neurons (complex-tuft cells) show active structural synaptic plasticity across areas and conditions19,20,74. In addition, localized synaptic plasticity, especially at the output nodes of a network like PT neurons, is theoretically beneficial75,76. Thus, PT neurons could be a universal learning site across neocortical areas and behavioral tasks. PT neurons encode behavior more reliably than other cortical cell types46, which could result from behaviorally relevant synaptic plasticity in these neurons.
Nonetheless, the necessity of one cell type does not exclude the necessity of other cell types and brain areas. Indeed, we discovered that at least two PT subtypes are required for learning. Neural dynamics are orchestrated across brain areas, including the striatum and cerebellum. Diverse cell types across these areas may implement different aspects of motor learning23,73,77–79. Molecular pathways underlying synaptic plasticity could also be diverse, and we do not rule out plasticity without CaMKII and Cofilin. Leveraging genetic manipulations targeting various molecules underlying synaptic plasticity, it is tempting to test how multiregional cell types coordinate diverse types of learning.
A common approach in neuroscience is to manipulate spiking activity and test its effect on behavior. Yet, spiking activity inevitably propagates to connected brain areas and often interferes with movement. For instance, silencing spikes in ALM alters spiking activity across motor-related brain areas and blocks licks48,80, which complicates the interpretation of behavioral effects even if it blocks learning81. The paAIP2 manipulations, instead, do not directly affect the ongoing spiking activity or execution of learned behavior. Molecularly-based plasticity manipulations have been used to test the causality of brain areas for learning11,37,40,41,78,82. We further advanced such methods with cell-type-specific manipulation combined with in vivo high-density electrophysiology during learning. This approach could effectively map learning mechanisms across behavioral tasks and brain areas.
Animals learn appropriate types and timing of movement. CaMKII manipulations in ALM blocked learning of lick timing, without affecting the acquisition of tongue movement to the lick port or cue association (Fig.1). Thus, different mechanisms may underlie learning movement types. Interestingly, learning movement types, such as sensory-motor association and learning new kinematics, generates new M1 activity patterns during movement across days3–8,13. Although we observed low-dimensional reconfiguration of ALM preparatory dynamics within sessions (Fig. 3), longitudinal recordings are required to test the emergence of activity patterns over days. In addition, our manipulations do not distinguish the type of synaptic plasticity responsible for learning. Furthermore, the pathways providing reward information and learning rule in PT neurons are unknown. The long-term goal is to explore these questions by directly and longitudinally monitoring synaptic plasticity and spiking activity of PT neurons during learning.
Impairments in learning and memory have devastating consequences in life. PT neurons are the homologous population of neurons vulnerable to amyotrophic lateral sclerosis and frontotemporal disorder in humans83. Identifying neocortical cell types required for learning, our findings and approach could be a foundation for future translational research of various diseases and injuries that affect learning.
METHOD DETAILS
EXPERIMENTAL MODEL AND SUBJECT DETAILS
Mice
This study is based on both male and female mice (age > P60, except for acute slice recordings that were P28). We used seven mouse lines: C57BL/6J (JAX# 000664), Tlx-Cre PL56 (RRID: MMRRC_041158-UCD)61, GRP-Cre KH288 (RRID: MMRRC_031183-UCD)61, Sim1-cre KJ18 (MGI: 4367070)61, LSL-Cas9 (B6J.129(B6N)-Gt(ROSA)26Sortm1(CAG-cas9-EGFP)Fezh/J, JAX# 026175)62, CaMKIIα-cKO (JAX# 006575)60 and, Vgat-ChR2-EYFP (JAX# 014548)84. Transgenic mice with non-C57BL/6J backgrounds were backcrossed to C57BL/6J for at least three generations. See Supplementary Table 1 for mice used in each experiment.
All procedures were in accordance with protocols approved by the MPFI IACUC committee. We followed the published water restriction protocol85 (with a modification of a minimum of 0.6 ml water per day to compensate for the high humidity in Florida). Mice were housed in a 12:12 reverse light: dark cycle and behaviorally tested during the dark phase. A typical behavioral session lasted between 1 and 2 hours. Mice obtained all of their water in the behavior apparatus. Mice were implanted with a titanium headpost for head fixation and single-housed.
Virus injection
We followed published protocols (dx.doi.org/10.17504/protocols.io.bctxiwpn) for virus injection. See Supplementary Table 1 for detailed descriptions of viruses and injection coordinates. See Supplementary Table 2 for a list of viruses used in this research37,38,86.
Behavior
A day before the training of the motor-timing task, we habituated mice with the experimental setup. A water-restricted mouse was head-fixed and placed in a training rig. 100 water drops (approximately 2 μL/drop) were delivered through a lickport at random timing (inter-trial intervals (ITI) sampled from an exponential distribution with a mean of 7.5s) without any sensory cue.
Next, we performed two-step training of the motor-timing task: cue association (2–3 days) and delay training (~6 days). Both training phases shared the following general task structure: At the beginning of each trial, an auditory cue was presented, which consisted of three repeats of pure tones (3 kHz, 150 ms duration with 100 ms inter-tone intervals). A delay epoch started from the onset of the cue presentation. Licking during the delay epoch aborted the trial without water reward, followed by a 1.5 s timeout epoch. Licking during the 3 s answer epoch following the delay was considered a ‘correct lick’, and a water reward (approximately 2 μL/drop) was delivered, followed by a 1.5s consumption epoch. Trials without lick during the delay and answer epochs were considered ‘no response’ trials. Trials were separated by ITI randomly sampled from an exponential distribution with a mean of 2.2 s with 0.3 s offset (with a maximum ITI of 5 s). This prevented mice from predicting the trial onset without cue. Animals had to withhold licks during the full ITI epoch for the next trial to begin (if they licked, ITI was repeated). In a fraction of randomly interleaved trials, the auditory cue and water reward were omitted to assess spontaneous lick rate (‘no cue’ trials).
The cue association phase lasted for 2 or 3 sessions with 250–300 trials each. 15% of trials were no cue trials. The delay epoch duration was set to a minimum (0.1 s). After the second session, an animal was considered to have learned the cue association if the median lick time (the first lick time from the cue onset) in the last 100 trials was lower than 0.5 s. The few mice that failed to learn cue association within 3 sessions were excluded from the subsequent experiments (6/198 mice).
The cue association was followed by delay training which lasted for at least 6 days or until the animal reached a 1.8 s delay duration (beyond this delay, lick timing became too variable and unstable with our training condition). Sessions were terminated if animals stopped licking for 50 consecutive cue trials or reached 1000 trials. 5% of trials were no cue trials. The delay duration started at 0.1 s and automatically increased based on the performance: if the probability of correct trials in the last 100 cued trials with the same delay duration exceeded 30%, the delay duration was increased by 0.1s. The delay duration at the beginning of each session was set to 0.1s less than the final delay duration in the previous session (with a minimum delay duration of 0.1 s), as animals did not reach the criteria performance for the final delay duration on the last day.
For the electrophysiological recording of expert mice (Fig. 3 and Extended Data Fig.2g–o), animals were first trained up to 1.8 s delay following the protocol above. Then, the animals were trained with a 1.5 s delay duration for at least two weeks until their performance was stable with a masking flash (see Optogenetics). The delay duration was fixed at 1.5 s during the recording.
To avoid bias, 1) behavior was automatically controlled by Bpod (Sanworks) and custom MATLAB codes, 2) experimenters were blinded to the genotype of mice, and 3) control and experimental animals were run in parallel.
Optogenetics
For paAIP2 experiments (Fig. 1 and 2c), animals were implanted with a clear skull cap85. Stainless steel tubes (0.062” OD, 0.052” ID, 8988K36, McMaster CARR) were cut into 3mm long pieces and glued directly on top of the clear skull cap above the target region (ALM or M1) to serve as sleeves for optic fibers. 470 nm LED light (M470F3, Thorlabs) at 0.5 mW power (power measured at the fiber tip) was delivered bilaterally through fiber optics (NA 0.39, 400 μm core diameter, M98L01, Thorlabs). The light was on for 1 second every 5 seconds (0.2 Hz) throughout the training session (LED illumination timing was independent of behavior). For control light-off sessions, the LED light was directed away from the skull with the same illumination protocol (i.e., mice could see flickering light as in the light-on condition).
For SN-CALI experiments (Fig. 2f), the same clear skull protocol was used. 595 nm LED light (M595F2, Thorlabs) at 0.75 mW power was delivered bilaterally for 1 minute every 10 minutes through optic fibers.
For paAIP2 manipulation during electrophysiological recordings (Fig. 4), 470nm LED light was delivered through an optic probe holder (OFPH_100_500–0.63_FC, Doric lenses) and probe tip (0.63NA, 500 μm core diameter, OPT_500–0.63_FLT, Doric lenses). The location of the optic probe tips was adjusted to cover the whole craniotomy (~ 1.5 mm). 470 nm light at 3 mW power (at the probe tip) was delivered bilaterally for 1 second every 5 seconds (0.2 Hz).
For paAIP2 manipulation in expert mice (Fig.1e and Extended Data Fig. 2g–o), the light was turned on at least 30 minutes after the session onset. To prevent mice from distinguishing photostimulation and control trials, a ‘masking flash’ (1 ms pulses at 10 Hz) was delivered near the eyes using 470 nm LEDs (Luxeon Star) throughout the session.
Extracellular electrophysiology
A small craniotomy (diameter, 1–1.5 mm) was made over the recording sites a day before the first recording session. Extracellular spikes were recorded using 64 ch two-shank silicon probes (H-2, Cambridge Neurotech). Voltage signals were multiplexed, recorded on a PCI6133 board (National instrument), and digitized at 400 kHz (14-bit). The signals were demultiplexed into 64 voltage traces sampled at 25 kHz and stored for offline analysis. All recordings were made with the open-source software SpikeGLX (http://billkarsh.github.io/SpikeGLX/). During recordings, the craniotomy was immersed in a cortex buffer (125 mM NaCl, 5 mM KCl, 10 mM glucose, 10 mM HEPES, 2 mM MgSO4, 2 mM CaCl2; adjust pH to 7.4). Brain tissue was allowed to settle for at least five minutes before recordings.
Histology
Mice were perfused transcardially with PBS, followed by 4% PFA / 0.1 M PBS. Brains were post-fixed overnight and transferred to 20 or 30 % sucrose PB before sectioning on a freezing microtome. Coronal 50 μm free-floating sections were processed using standard fluorescent immunohistochemical techniques.
For images in Extended Data Fig. 4, all sections were stained with NeuroTrace® 435/455 Blue Fluorescent Nissl Stain (Thermo Fisher Scientific, N21479). The fluorescent label was amplified with chicken anti-GFP (Thermo Fisher Scientific, A10262) and goat anti-chicken 488 (Thermo Fisher Scientific, A11039). Slide-mounted sections were imaged on a Zeiss microscope with a Ludl motorized stage controlled with Neurolucida software (MBF Bioscience, Williston VT). Imaging was done with a 10× objective and a Hamamatsu Orca Flash 4 camera. Every section from the frontal pole through the brainstem were imaged.
For the CaMKIIα staining (Extended Data Fig. 3), GFP signal was amplified with rabbit anti-GFP (Thermo Fisher Scientific, A11122, RRID: AB_221569, 1:500) and goat anti-rabbit 488 secondary antibodies (Thermo Fisher Scientific, A11008, RRID: AB_143165, 1:500). The CaMKIIα was labeled with anti-CaMKII-α (6G9) (Cell Signaling Technology, #50049, RRID: AB_2721906, 1:250) and goat anti-rabbit 647 secondary antibodies (Thermo Fisher Scientific, A21236, RRID: AB_2535805, 1:500). Sections were imaged with a confocal laser scanning microscope (ZEISS, LSM 980) using a 20× objective.
Acute slice recording
AAV was injected into P28 mice to label PTupper neurons in ALM bilaterally (n = 5; see Extended Data Table 1 for injection coordinate). Two to three weeks later, blue light (0.5mW 0.2Hz for one hour) illumination was given to one hemisphere under isoflurane sedation. Immediately after this, a slice was prepared and recorded (we also performed ex vivo illumination of brain slices, which yielded similar results; data not shown). Mice were perfused intracardially with a chilled choline chloride solution (124 mM Choline Chloride, 2.5 mM KCl, 26 mM NaHCO3, 3.3 mM MgCl2, 1.2 mM NaH2PO4, 10 mM Glucose, and 0.5 mM CaCl2, pH 7.4 equilibrated with 95 % O2 / 5 % CO2). The brain was removed and placed in the choline chloride solution. Transverse slices (300 μm) from both hemispheres containing the ALM were cut using a vibratome (Leica) and maintained in a submerged chamber at 32 °C for 1 h and then at room temperature in oxygenated artificial cerebrospinal fluid (ACSF: 127 mM NaCl, 2.5 mM KCl, 2 mM CaCl2, 1mM MgCl2, 25 mM NaHCO3, 1.25 mM NaH2PO4 and 25 mM glucose).
paAIP2-GFP labeled ALM PTupper neurons were visualized using epifluorescent illumination. Whole-cell current-clamp recordings were obtained in labeled neurons using a Multiclamp 700B amplifier. Patch pipettes (3–6 ΩM) were filled with a potassium gluconate solution (130 mM K gluconate, 10 mM Na phosphocreatine, 4 mM MgCl2, 4 mM NaATP, 0.3 mM MgGTP, 3 mM L- Ascorbic acid, 10 mM HEPES. pH 7.2, 320 mOsm). These experiments were performed at room temperature (~25° C) in oxygenated ACSF. Recordings were digitized at 10 kHz and filtered at 2 kHz. Current injections were given in 100 pA increments from −100 to 400 pA. Threshold, AP half-width, and time of AP half-width were analyzed in the current step where the first AP was observed. Recordings were performed in both hemispheres (one with illumination before recording and the other without), and the experimenter was blinded to the identity of the illuminated hemisphere during recording. All data were acquired and analyzed with custom-written C# and MATLAB codes.
Molecular Biology
For the cell-type-specific paAIP2 manipulation, we generated AAV-CaMKII -DIO-mEGFP-P2A-paAIP2. We used the same promoter (CaMKII promoter), 3’ sequence (bGH without WPRE sequence), and serotype (AAV9) with AAV-CaMKII-mGFP-P2A-paAIP2 (addgene: 91718), which we used for bulk manipulation (Fig. 1c), to match the expression level. The paAIP2 expression with CAG promoter and WPRE sequence in PT neurons, but not in IT neurons, resulted in light-independent blocking of learning, most likely due to over-expression (data not shown). We subcloned the mEGFP-P2A-paAIP2 sequence from the pAAVCaMKII-mGFP-P2A-paAIP2 into the pAAV-CaMKII-FLEX-MCS plasmid (MPFI molecular core) using AscI and BamHI. For CRISPR/Cas9 KO of CaMKIIα, we generated pAAV-U6CaMKIIgRNA-hsyn-mScarlet. We synthesized U6-CaMKIIα gRNA sequence30 and inserted it into pAAV-hSyn-mScarlet (addgene: 131001) using XbaI and ApaI. AAV2/9 based on these plasmids were packaged by UNC vector core.
For validation of efficacy of gRNA (Extended Data Fig. 3a and b), we transfected Neuro-2A cells in 6 well plates with pCAG-cre, pLenti-Cas9-GFP (addgene: 86145), and pAAV-U6CaMKIIgRNA-hsyn-mScarlet using Lipofectamine™ 2000 (Invitrogen). Two days after lipofection, GFP+ mScarlet+ cells were sorted (BD FACSAria™ Fusion), and genome DNA was extracted using DNeasy Blood and Tissue Kit (QIAGEN). Index was added using PCR with Nextera XT Index Kit (Illumina). We used MiSeq 300 cycle ver. 2 (Illumina) for the sequencing.
QUANTIFICATION AND STATISTICAL ANALYSIS
Behavioral analysis
Mice often ignored several cue trials at the beginning of each session. In addition, sated mice stopped licking at the end of sessions. To analyze behavior while mice are engaged in the task, we analyzed all trials between the first occurrence of 5 consecutive cue trials with licks and 20 trials before the last occurrence of 3 consecutive no-response trials.
We analyzed the time of the first lick after the cue (referred to as ‘lick time’). Electrical lick ports measured lick time, detecting the tongue’s contact with the lick port. To plot learning curves in Fig.1b and c (inset), all cue trials within each session were binned every 50 trials. Then, histograms of lick time were computed for each bin and were normalized to the respective peaks.
To compare learning across conditions (Figs.1, 2 and Extended Data Fig. 1 and 7), we used the last 100 cue trials in each session to compute the median first lick time, coefficient of variation (standard deviation divided by the mean) of the first lick time, and no response rate. To calculate lick time, ‘no-response’ trials were excluded. If mice reached a 1.8 s delay before 6 days of the delay training, the training was stopped, and the lick timing on the last behavior session was duplicated for analysis.
To compare the effect of paAIP2 manipulation in expert mice, we analyzed 3 blocks of trials for within-animal comparisons (Fig.1e, and Extended Data Fig.2k and l). In Fig. 1e, we had two control conditions: ‘Light off’, data of expert mice without paAIP2 manipulation (light onset was artificially and randomly assigned from those in Light on sessions); ‘Light on, shuffle’, data of light on sessions, but the light onset was randomly reassigned across sessions.
Videography analysis
High-speed (300 Hz) videography of orofacial movement (side view) was acquired using a CMOS camera (Chameleon3 CM3-U3-13Y3M-CS, FLIR) with IR illumination (940nm LED). We used DeepLabCut87 to track the movement of the tongue and jaw. Movements along the dorsoventral direction were analyzed and plotted in Extended Data Fig 1. Trajectories were normalized: the mean position before the cue was subtracted from trajectories and divided by the minimum value (thus, the downward movement of the tongue and jaw is upward in the plot). The onset of jaw movement in each trial is the first time point after the cue when the normalized movement trajectory exceeds 0.15. The onset of tongue movement is when DeepLabCut first detects the tongue after the cue.
Extracellular recording analysis
JRClust88 (https://github.com/JaneliaSciComp/JRCLUST) with manual curations was used for spike sorting. We used a combination of quality metrics to rigorously select single units for analysis (Extended Data Fig. 6). First, a false positive rate was estimated according to the inter-spike interval violation89, and units with a false positive rate < 0.15 were selected. Second, we extracted spike features (2 principal components of spike shape recorded in 3 neighboring recording sites) of all spikes recorded at the same or adjacent recording sites. Then, we calculated the Mahalanobis distance of spike features of each spike from the center of the spike cluster (unit) of interest. We performed the receiver operating characteristic (ROC) analysis of Mahalanobis distance to distinguish spikes within vs. outside the cluster of interest. A recording session was divided into time bins containing consecutive 1000 spikes of the unit of interest. AUC was calculated for every time bin. Units with a mean AUC (across time bins) > 0.9 and without any time bin with AUC<0.75 were selected. Third, units with low spike rates (less than 0.1 spikes per s) were excluded from the analysis. Units passing all these criteria were deemed single units.
We recorded 3689 neurons passing the quality metrics in ALM from 30 mice during learning. Putative pyramidal neurons (units with spike width > 0.5 ms90; 3203 among 3689 neurons) were analyzed. To define preparatory cells, we compared the spike rates in the baseline (0 to 0.2 s before the cue) vs. during the task (from cue to first lick) in trial 21–95 of the session (‘Early trials’ in Fig. 4a). Cells with a p-value lower than 0.05 (signed-rank test) were considered task-modulated cells and analyzed in Figs. 3 and 4 (See Extended Data Table 3 for details). Cells with positively and negatively task-modulated cells (cells with significant increase or decrease in spike rate during the task) were analyzed separately (except for Fig.3 c, d, g, and h) so that they do not cancel out. Since there were more positively modulated cells (Extended Data Fig. 7e), the main figures show the analysis of positively modulated cells.
For the peri-stimulus time histograms (PSTHs) in Fig. 3 and Extended Data Fig. 5, trials were pooled based on the first lick time. Analyzed time ranges were T = [0.05~0.20, 0.20~0.35, 0.35~0.50, 0.50~0.65, 0.65~0.80, 0.80~0.95, 0.95~1.1] second for recording during learning, and T = [0.95~1.1, 1.1~1.25, 1.25~1.4, 1.4~1.55, 1.55~1.7, 1.7~1.85, 1.85~2.0] second for recording in expert mice. Ten trials with the first lick within the time range were randomly selected, and the spike rate was averaged. If the number of trials within the range was less than 10, the range was not included in the analysis. PSTHs were smoothed with a 50 ms causal boxcar filter. For Extended Data Fig. 2h, PSTHs were smoothed with a 20 ms causal boxcar filter to detect fast changes in activity. SEM was based on hierarchical bootstrap: first, we randomly selected animals with replacement; second, we randomly selected sessions of each animal with replacement; and third, we randomly selected cells within each session with replacement (1000 iterations).
To temporally warp the PSTH (Fig. 3), we linearly scaled the spike timing in the time range Tcue > 0.1 by (LTtarget - 0.1)/(LTtrial to be warped - 0.1), where Tcue denotes time after the cue, and LT denotes the first lick time in each trial type (LTtarget was 1 for Fig.3a,b, and f). After the warping, we calculated PSTH and smoothed it with a 50 ms causal boxcar filter. We did not warp 0 <Tcue < 0.1 as the onset of cue response showed the same temporal profile regardless of the lick time (most likely determined by the latency of cue input to ALM48). Because of this, we did not warp the first trial type with a lick latency between 0.05~0.20 s during learning.
Cue response (Fig. 3 and 4, Extended Data Fig.2n) was normalized for the baseline spike rate: , where SRT denotes mean spike rate in the time range indicated in T. Similarly, pre-lick activity () was normalized by the baseline spike rate. To calculate ‘Time between 10–90% activity’ (Fig. 3 and 4), PSTH was normalized by the minimum and maximum spike rate between cue and lick. Then, the time from the first time point crossing 10% to the last time point crossing 90% was measured (in the case of negative modulated cells, Extended Data Fig. 7, activity was flipped). Mean speed (Extended Data Fig. 7) is the mean of absolute change in spike rate between cue to lick (here, spike rate was calculated in 50 ms time bin). We performed hierarchical bootstrap for statistics and SEM (1000 iterations).
For the correlation analysis (Fig. 3d and h, and Extended Data Fig. 7g), we looked for an n × 1 unit vector rT, trial type, representing the spike rate of all n neurons at time point T of a trial type of interest. Then, we calculated Pearson’s correlation of r between the two trial types indicated in the plot across time points (in the case of Extended Data Fig. 7g, autocorrelation was calculated).
For recording in the expert mice (Extended Data Fig. 2), we recorded 716 neurons that passed the quality metrics in ALM in 20 sessions from 4 expert mice. 647 putative pyramidal neurons were analyzed.
Ramping direction analysis (Extended Data Fig. 8)
To calculate ramping mode (RM) for a population of n recorded neurons, we looked for an n × 1 unit vector that maximally distinguished the mean activity before the trial onset (0 – 0.2 s before cue; rbefore cue) and the mean activity before the first lick (0 – 0.15 s before the first lick; rbefore lick) in the n-dimensional activity space. We defined a population ramping vector: w = rbefore lick – rbefore cue. RM is w normalized by its norm.
In each recording session, we randomly selected 24 cue trials with the first lick time above 0.25 s. We define RM based on the activity of these randomly selected trials, and projected activity in different sets of trials for the cross-validation. To calculate the “activity explained”, we calculated the squared sum of the spike rate after subtracting the baseline (mean spike rate 0 – 0.2 s before cue onset) across neurons. We calculated the squared sum of the activity along RM after subtracting the baseline.
Histology Analysis
For Extended Data Fig. 3e, cell counting and signal analysis were conducted using MATLAB. Cells were binary classified into GFP and/or RFP positive/negative based on the fluorescence signal intensity. The CaMKIIα signal intensity within the cell was normalized by the signal in the surrounding areas (median of areas within 12–60 pixels (0.6 μm/pixel) from the cell).
For Extended Data Fig. 4, imaged sections were processed with NeuroInfo software (MBF Bioscience, Williston, VT) to align the serial sections into a whole brain volume. Neurons throughout the ALM cortex were detected and marked using the automatic cell detection function in NeuroInfo software, which uses a modified Laplacian of Gaussian (LOG) algorithm that detects labeled neuron perikarya based on size and fluorescence intensity with a neural network that eliminates signal artifacts. The accuracy of cell counts compared to visual detection is approximately 95%.
Network Model
Using a dynamical systems approach91,92, we consider four variables representing the average membrane currents (h) and spike rates (r = f(h), where f(h) is the neural activation function) of neuronal populations in different regions of the brain. Specifically, we modeled two excitatory populations (pyramidal tract, hPT, and intratelencephalic, hIT) and one inhibitory population (hIn) in the premotor cortex, one excitatory population in the thalamic nuclei receiving PT input (hth). The average membrane current dynamics of population k are described by the following nonlinear differential equation:
Where τk is the membrane time constant of population k, Wkj are elements of the connectivity matrix between presynaptic population j and postsynaptic population k, is the baseline input current. Icue(t) is the external input current provided to ALM neurons elicited by the auditory cue via the synaptic weights bk, and Itonic is the non-contextual tonic input provided to the thalamus via the synaptic weights ck. We hypothesized the pathway providing cue input is different from thalamic nuclei maintaining preparatory activity according to previous work48. For all populations, we used a threshold-linear activation function:
The baseline input currents were chosen to be negative for all four populations so that the network dynamics displays a baseline stable fixed point (lower attractor) for hj(t) < 0 ∀ j. The connectivity matrix W respected the biological constraints found in the literature (see Extended Data Table 4), and was chosen so that a stable fixed point (higher attractor) existed for hj(t) < 0 ∀ j. The transition from the lower to the higher attractor was triggered by Icue(t) which took the form of a 100ms long boxcar function. Ramping activity emerged as the dynamics evolved towards the higher attractor following the cue. The lick onset was defined upon reaching a spike rate threshold ( spikes per second) motivated by the activity of ALM (Fig.3).
We imposed synaptic plasticity between the input relaying the auditory cue and PT neurons (bPT) to implement learning. To update bPT, we used a heavily simplified learning algorithm. We hypothesized that the external inputs to the network Icue(t) and Itonic were subject to fluctuations across trials. In particular, the peak value of the cue signal Icue and Itonic were each drawn from normal distributions with means μcue, μtonic and standard deviations σcue, σtonic, respectively(see Extended Data Table 4). Because of these fluctuations, the spike rate of PT neurons will reach the threshold at a different speed in each trial. The synaptic weight bPT was either exclusively potentiated (model shown in Fig.4), or depressed (model shown in Extended Data Fig. 10c–e), at the end of rewarded trials, i.e., trials in which the PT spike rate exceeded the hard threshold after the delay duration according to the update rule:
where for potentiation ( for depression), η being the learning rate. c is the recent reward rate (mean of the last five trials; we added this term to prevent the network from learning when the reward rate was 100%). As in the behavioral experiments with mice, when the reward rate in the last 100 trials reached 30%, the delay duration was increased by 100 ms.
To model the behavior and the neural dynamics in expert mice (Extended Data Fig. 10a, b, and e), we used the same network parameters that were found at the end of the learning process. To vary the lick time, we changed the non-contextual tonic input Itonic(t), which is compatible with a previous paper modeling dynamics in expert animals performing a timing task71. In the synaptic potentiation model (Extended Data Fig. 10a–b), stronger tonic inputs lead to slower dynamics, allowing the model to capture the behavior of expert mice with increasing delay durations. In the synaptic depression model (Extended Data Fig. 10e), weaker tonic inputs lead to slower dynamics.
Statistics
The sample sizes are similar to the sample sizes previously published in the field. No statistical methods were used to determine the sample size. During spike sorting, experimenters could not tell the trial type and therefore were blind to conditions. All signed rank and ranksum tests were two-sided. All bootstrapping was done at least over 1,000 iterations.
Reagent and data availability
The new plasmids reported in this paper will be posted to Addgene before publication. The recording data in NWB format and example codes will be shared on DANDI around the time of publication.
Extended Data
Supplementary Material
Acknowledgment
We thank N. Li, L. Colgan, T. Wang, D. Fitzpatrick, and Inagaki lab members for comments on the manuscript, M. Inagaki and L. Walendy for animal training, E.Wu, V. Grimaldi and R. DiCicco for histology, P. Scarpinato for DeepLabCut analysis, J. Yu for molecular biology, and H. Shearin and other MPFI ARC members for animal care. This work was funded by ZIA MH002497-34 (C.R.G.), Howard Hughes Medical Institute (S.R.), Max Planck Florida Institute for Neuroscience (H.K.I. and R.Y.), Max Planck Free Floater Program (H.K.I.), NIH New Innovator Award (NINDS and OD; 1DP2NS132108; H.K.I.), Searle Scholars Program (H.K.I.), Klingenstein-Simons Fellowship (H.K.I.), and McKnight Scholar Award (H.K.I.).
Footnotes
The authors declare no competing interests.
References
- 1.Vyas S., Golub M. D., Sussillo D. & Shenoy K. V. Computation Through Neural Population Dynamics. Annual Review of Neuroscience 43, 249–275 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Inagaki H. K. et al. Neural Algorithms and Circuits for Motor Planning. Annual Review of Neuroscience 45, 249–271 (2022). [DOI] [PubMed] [Google Scholar]
- 3.Laubach M., Wessberg J. & Nicolelis M. A. Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature 405, 567–571 (2000). [DOI] [PubMed] [Google Scholar]
- 4.Costa R. M., Cohen D. & Nicolelis M. A. L. Differential corticostriatal plasticity during fast and slow motor skill learning in mice. Curr Biol 14, 1124–1134 (2004). [DOI] [PubMed] [Google Scholar]
- 5.Komiyama T. et al. Learning-related fine-scale specificity imaged in motor cortex circuits of behaving mice. Nature 464, 1182–1186 (2010). [DOI] [PubMed] [Google Scholar]
- 6.Huber D. et al. Multiple dynamic representations in the motor cortex during sensorimotor learning. Nature 484, 473–478 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Peters A. J., Chen S. X. & Komiyama T. Emergence of reproducible spatiotemporal activity during motor learning. Nature 510, 263–267 (2014). [DOI] [PubMed] [Google Scholar]
- 8.Masamizu Y. et al. Two distinct layer-specific dynamics of cortical ensembles during learning of a motor task. Nat Neurosci 17, 987–994 (2014). [DOI] [PubMed] [Google Scholar]
- 9.Halverson H. E., Khilkevich A. & Mauk M. D. Relating Cerebellar Purkinje Cell Activity to the Timing and Amplitude of Conditioned Eyelid Responses. J Neurosci 35, 7813–7832 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Makino H. et al. Transformation of Cortex-wide Emergent Properties during Motor Learning. Neuron 94, 880–890.e8 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Adler A., Zhao R., Shin M. E., Yasuda R. & Gan W.-B. Somatostatin-Expressing Interneurons Enable and Maintain Learning-Dependent Sequential Activation of Pyramidal Neurons. Neuron 102, 202–216.e7 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Peters A. J., Liu H. & Komiyama T. Learning in the Rodent Motor Cortex. Annu Rev Neurosci 40, 77–97 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Peters A. J., Lee J., Hedrick N. G., O’Neil K. & Komiyama T. Reorganization of corticospinal output during motor learning. Nat Neurosci 20, 1133–1141 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Papale A. E. & Hooks B. M. Circuit Changes in Motor Cortex During Motor Skill Learning. Neuroscience 368, 283–297 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wagner M. J. et al. Shared Cortex-Cerebellum Dynamics in the Execution and Learning of a Motor Task. Cell 177, 669–682.e24 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Sun X. et al. Cortical preparatory activity indexes learned motor memories. Nature 602, 274–279 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Abbott L. F. & Dayan P. Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. (MIT Press, 2005). [Google Scholar]
- 18.Takeuchi T., Duszkiewicz A. J. & Morris R. G. M. The synaptic plasticity and memory hypothesis: encoding, storage and persistence. Philos Trans R Soc Lond B Biol Sci 369, 20130288 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Holtmaat A., Wilbrecht L., Knott G. W., Welker E. & Svoboda K. Experience-dependent and cell-type-specific spine growth in the neocortex. Nature 441, 979–983 (2006). [DOI] [PubMed] [Google Scholar]
- 20.Hofer S. B., Mrsic-Flogel T. D., Bonhoeffer T. & Hübener M. Experience leaves a lasting structural trace in cortical circuits. Nature 457, 313–317 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Xu T. et al. Rapid formation and selective stabilization of synapses for enduring motor memories. Nature 462, 915–919 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Yang G., Pan F. & Gan W.-B. Stably maintained dendritic spines are associated with lifelong memories. Nature 462, 920–924 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Yin H. H. et al. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci 12, 333–341 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Xiong Q., Znamenskiy P. & Zador A. M. Selective corticostriatal plasticity during acquisition of an auditory discrimination task. Nature 521, 348–351 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Biane J. S., Takashima Y., Conner J. M., Scanziani M. & Tuszynski M. H. Reorganization of Recurrent Layer 5 Corticospinal Networks Following Adult Motor Training. J. Neurosci. (2019) doi: 10.1523/JNEUROSCI.3442-17.2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Sanes J. N. & Donoghue J. P. Plasticity and primary motor cortex. Annu Rev Neurosci 23, 393–415 (2000). [DOI] [PubMed] [Google Scholar]
- 27.Wilbrecht L., Holtmaat A., Wright N., Fox K. & Svoboda K. Structural Plasticity Underlies Experience-Dependent Functional Plasticity of Cortical Circuits. J. Neurosci. 30, 4927–4932 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Malenka R. C. & Bear M. F. LTP and LTD: an embarrassment of riches. Neuron 44, 5–21 (2004). [DOI] [PubMed] [Google Scholar]
- 29.Lisman J., Yasuda R. & Raghavachari S. Mechanisms of CaMKII action in long-term potentiation. Nat. Rev. Neurosci. 13, 169–182 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Incontro S. et al. The CaMKII/NMDA receptor complex controls hippocampal synaptic transmission by kinase-dependent and independent mechanisms. Nat Commun 9, 2069 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Matsuzaki M., Honkura N., Ellis-Davies G. C. R. & Kasai H. Structural basis of long-term potentiation in single dendritic spines. Nature 429, 761–766 (2004). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Yasuda R., Hayashi Y. & Hell J. W. CaMKII: a central molecular organizer of synaptic plasticity, learning and memory. Nat Rev Neurosci 23, 666–682 (2022). [DOI] [PubMed] [Google Scholar]
- 33.Silva A. J., Paylor R., Wehner J. M. & Tonegawa S. Impaired spatial learning in alpha-calcium-calmodulin kinase II mutant mice. Science 257, 206–211 (1992). [DOI] [PubMed] [Google Scholar]
- 34.Silva A. J., Stevens C. F., Tonegawa S. & Wang Y. Deficient hippocampal long-term potentiation in alpha-calcium-calmodulin kinase II mutant mice. Science 257, 201–206 (1992). [DOI] [PubMed] [Google Scholar]
- 35.Zeeuw C. I. D. et al. Expression of a Protein Kinase C Inhibitor in Purkinje Cells Blocks Cerebellar LTD and Adaptation of the Vestibulo-Ocular Reflex. Neuron 20, 495–508 (1998). [DOI] [PubMed] [Google Scholar]
- 36.Nabavi S. et al. Engineering a memory with LTD and LTP. Nature 511, 348–352 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Murakoshi H. et al. Kinetics of endogenous CaMKII required for synaptic plasticity revealed by optogenetic kinase inhibitor. Neuron 94, 37–47.e5 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Goto A. et al. Stepwise synaptic plasticity events drive the early phase of memory consolidation. Science 374, 857–863 (2021). [DOI] [PubMed] [Google Scholar]
- 39.Luft A. R., Buitrago M. M., Ringer T., Dichgans J. & Schulz J. B. Motor skill learning depends on protein synthesis in motor cortex after training. J Neurosci 24, 6515–6520 (2004). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Hayashi-Takagi A. et al. Labelling and optical erasure of synaptic memory traces in the motor cortex. Nature 525, 333–338 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Widmer F. C., O’Toole S. M. & Keller G. B. NMDA receptors in visual cortex are necessary for normal visuomotor integration and skill learning. eLife 11, e71476 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Shepherd G. M. G. Corticostriatal connectivity and its role in disease. Nat Rev Neurosci 14, 278–291 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Tasic B. et al. Shared and distinct transcriptomic cell types across neocortical areas. Nature 563, 72–78 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Matho K. S. et al. Genetic dissection of the glutamatergic neuron system in cerebral cortex. Nature 598, 182–187 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Li N., Chen T.-W., Guo Z. V., Gerfen C. R. & Svoboda K. A motor cortex circuit for motor planning and movement. Nature 519, 51–56 (2015). [DOI] [PubMed] [Google Scholar]
- 46.Baker A. et al. Specialized subpopulations of deep-layer pyramidal neurons in the neocortex: bridging cellular properties to functional consequences. Journal of Neuroscience 38, 5441–5455 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Economo M. N. et al. Distinct descending motor cortex pathways and their roles in movement. Nature 563, 79–84 (2018). [DOI] [PubMed] [Google Scholar]
- 48.Inagaki H. K. et al. A midbrain-thalamus-cortex circuit reorganizes cortical dynamics to initiate movement. Cell S0092–8674(22)00146–5 (2022) doi: 10.1016/j.cell.2022.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Mauk M. D. & Buonomano D. V. The neural basis of temporal processing. Annu. Rev. Neurosci. 27, 307–340 (2004). [DOI] [PubMed] [Google Scholar]
- 50.Buhusi C. V. & Meck W. H. What makes us tick? Functional and neural mechanisms of interval timing. Nat. Rev. Neurosci. 6, 755–765 (2005). [DOI] [PubMed] [Google Scholar]
- 51.Murakami M., Vicente M. I., Costa G. M. & Mainen Z. F. Neural antecedents of self-initiated actions in secondary motor cortex. Nat. Neurosci. 17, 1574–1582 (2014). [DOI] [PubMed] [Google Scholar]
- 52.Wang J., Narain D., Hosseini E. A. & Jazayeri M. Flexible timing by temporal scaling of cortical responses. Nat Neurosci 21, 102–110 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Banerjee A., Chen F., Druckmann S. & Long M. A. Neural dynamics in the rodent motor cortex enables flexible control of vocal timing. 2023.01.23.525252 Preprint at 10.1101/2023.01.23.525252 (2023). [DOI] [Google Scholar]
- 54.Cao V. Y. et al. Motor Learning Consolidates Arc-Expressing Neuronal Ensembles in Secondary Motor Cortex. Neuron 86, 1385–1392 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Kantak S. S., Stinear J. W., Buch E. R. & Cohen L. G. Rewiring the brain: potential role of the premotor cortex in motor control, learning, and recovery of function following brain injury. Neurorehabil Neural Repair 26, 282–292 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Berlot E., Popp N. J. & Diedrichsen J. A critical re-evaluation of fMRI signatures of motor sequence learning. eLife 9, e55241 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Guo Z. V. et al. Flow of cortical activity underlying a tactile decision in mice. Neuron 81, 179–194 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Sutton R. S. & Barto A. G. Reinforcement Learning: An Introduction. (A Bradford Book, 2018). [Google Scholar]
- 59.Wayman G. A. et al. Calmodulin-kinases: modulators of neuronal development and plasticity. Neuron 59, 914–931 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Hinds H. L., Goussakov I., Nakazawa K., Tonegawa S. & Bolshakov V. Y. Essential function of alpha-calcium/calmodulin-dependent protein kinase II in neurotransmitter release at a glutamatergic central synapse. Proc Natl Acad Sci U S A 100, 4275–4280 (2003). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Gerfen C. R., Paletzki R. & Heintz N. GENSAT BAC cre-recombinase driver lines to study the functional organization of cerebral cortical and basal ganglia circuits. Neuron 80, 1368–1383 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Platt R. J. et al. CRISPR-Cas9 knockin mice for genome editing and cancer modeling. Cell 159, 440–455 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Maimon G. & Assad J. A. A cognitive signal for the proactive timing of action in macaque LIP. Nat. Neurosci. 9, 948–955 (2006). [DOI] [PubMed] [Google Scholar]
- 64.Inagaki H. K., Fontolan L., Romani S. & Svoboda K. Discrete attractor dynamics underlies persistent activity in the frontal cortex. Nature 566, 212–217 (2019). [DOI] [PubMed] [Google Scholar]
- 65.Hennig J. A. et al. How learning unfolds in the brain: toward an optimization view. Neuron 109, 3720–3735 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Kiritani T., Wickersham I. R., Seung H. S. & Shepherd G. M. G. Hierarchical connectivity and connection-specific dynamics in the corticospinal-corticostriatal microcircuit in mouse motor cortex. J Neurosci 32, 4992–5001 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Guo Z. V. et al. Maintenance of persistent activity in a frontal thalamocortical loop. Nature 545, 181–186 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Collins D. P., Anastasiades P. G., Marlin J. J. & Carter A. G. Reciprocal Circuits Linking the Prefrontal Cortex with Dorsal and Ventral Thalamic Nuclei. Neuron 98, 366–379.e4 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Loewenstein Y. & Seung H. S. Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity. Proc Natl Acad Sci U S A 103, 15224–15229 (2006). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Miller K. D. & Palmigiano A. Generalized paradoxical effects in excitatory/inhibitory networks. 2020.10.13.336727 Preprint at 10.1101/2020.10.13.336727 (2020). [DOI] [Google Scholar]
- 71.Wang J., Narain D., Hosseini E. A. & Jazayeri M. Flexible timing by temporal scaling of cortical responses. Nat. Neurosci. 21, 102–110 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Lisberger S. G. Cerebellar LTD: A Molecular Mechanism of Behavioral Learning? Cell 92, 701–704 (1998). [DOI] [PubMed] [Google Scholar]
- 73.Kawai R. et al. Motor cortex is required for learning but not for executing a motor skill. Neuron 86, 800–812 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Wang L., Conner J. M., Rickert J. & Tuszynski M. H. Structural plasticity within highly specific neuronal populations identifies a unique parcellation of motor learning in the adult brain. Proc Natl Acad Sci U S A 108, 2545–2550 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Jaeger H. & Haas H. Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science 304, 78–80 (2004). [DOI] [PubMed] [Google Scholar]
- 76.Masse N. Y., Rosen M. C., Tsao D. Y. & Freedman D. J. Rapid learning with highly localized synaptic plasticity. 2022.05.09.491102 Preprint at 10.1101/2022.05.09.491102 (2022). [DOI] [Google Scholar]
- 77.Boyden E. S., Katoh A. & Raymond J. L. Cerebellum-dependent learning: the role of multiple plasticity mechanisms. Annu Rev Neurosci 27, 581–609 (2004). [DOI] [PubMed] [Google Scholar]
- 78.Wolff S. B. E., Ko R. & Ölveczky B. P. Distinct roles for motor cortical and thalamic inputs to striatum during motor skill learning and execution. Science Advances 8, eabk0231 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Shmuelof L. & Krakauer J. W. Are We Ready for a Natural History of Motor Learning? Neuron 72, 469–476 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Bollu T. et al. Cortex-dependent corrections as the tongue reaches for and misses targets. Nature 594, 82–87 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Otchy T. M. et al. Acute off-target effects of neural circuit manipulations. Nature 528, 358–363 (2015). [DOI] [PubMed] [Google Scholar]
- 82.Kakegawa W. et al. Optogenetic Control of Synaptic AMPA Receptor Endocytosis Reveals Roles of LTD in Motor Learning. Neuron 99, 985–998.e6 (2018). [DOI] [PubMed] [Google Scholar]
- 83.Suzuki N. et al. The mouse C9ORF72 ortholog is enriched in neurons known to degenerate in ALS and FTD. Nat Neurosci 16, 1725–1727 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Zhao S. et al. Cell type–specific channelrhodopsin-2 transgenic mice for optogenetic dissection of neural circuitry function. Nat Methods 8, 745–752 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Guo Z. V. et al. Procedures for behavioral experiments in head-fixed mice. PLoS ONE 9, e88678 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Marshel J. H. et al. Cortical layer-specific critical dynamics triggering perception. Science 365, eaaw5202 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Mathis A. et al. DeepLabCut: markerless pose estimation of user-defined body parts with deep learning. Nat Neurosci 21, 1281–1289 (2018). [DOI] [PubMed] [Google Scholar]
- 88.Jun J. J. et al. Fully integrated silicon probes for high-density recording of neural activity. Nature 551, 232–236 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Hill D. N., Mehta S. B. & Kleinfeld D. Quality Metrics to Accompany Spike Sorting of Extracellular Signals. J. Neurosci. 31, 8699–8705 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Guo Z. V. et al. Flow of cortical activity underlying a tactile decision in mice. Neuron 81, 179–194 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Abarbanel H. D. & Rabinovich M. I. Neurodynamics: nonlinear dynamics and neurobiology. Curr Opin Neurobiol 11, 423–430 (2001). [DOI] [PubMed] [Google Scholar]
- 92.Sussillo D. Neural circuits as computational dynamical systems. Curr Opin Neurobiol 25, 156–163 (2014). [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.