Skip to main content
eLife logoLink to eLife
. 2021 Dec 9;10:e73046. doi: 10.7554/eLife.73046

Bidirectional synaptic plasticity rapidly modifies hippocampal representations

Aaron D Milstein 1,2, Yiding Li 3, Katie C Bittner 4, Christine Grienberger 3, Ivan Soltesz 1, Jeffrey C Magee 3,, Sandro Romani 4,
Editors: Katalin Toth5, Laura L Colgin6
PMCID: PMC8776257  PMID: 34882093

Abstract

Learning requires neural adaptations thought to be mediated by activity-dependent synaptic plasticity. A relatively non-standard form of synaptic plasticity driven by dendritic calcium spikes, or plateau potentials, has been reported to underlie place field formation in rodent hippocampal CA1 neurons. Here, we found that this behavioral timescale synaptic plasticity (BTSP) can also reshape existing place fields via bidirectional synaptic weight changes that depend on the temporal proximity of plateau potentials to pre-existing place fields. When evoked near an existing place field, plateau potentials induced less synaptic potentiation and more depression, suggesting BTSP might depend inversely on postsynaptic activation. However, manipulations of place cell membrane potential and computational modeling indicated that this anti-correlation actually results from a dependence on current synaptic weight such that weak inputs potentiate and strong inputs depress. A network model implementing this bidirectional synaptic learning rule suggested that BTSP enables population activity, rather than pairwise neuronal correlations, to drive neural adaptations to experience.

Research organism: Mouse

eLife digest

A new housing development in a familiar neighborhood, a wrong turn that ends up lengthening a Sunday stroll: our internal representation of the world requires constant updating, and we need to be able to associate events separated by long intervals of time to finetune future outcome. This often requires neural connections to be altered.

A brain region known as the hippocampus is involved in building and maintaining a map of our environment. However, signals from other brain areas can activate silent neurons in the hippocampus when the body is in a specific location by triggering cellular events called dendritic calcium spikes.

Milstein et al. explored whether dendritic calcium spikes in the hippocampus could also help the brain to update its map of the world by enabling neurons to stop being active at one location and to start responding at a new position. Experiments in mice showed that calcium spikes could change which features of the environment individual neurons respond to by strengthening or weaking connections between specific cells. Crucially, this mechanism allowed neurons to associate event sequences that unfold over a longer timescale that was more relevant to the ones encountered in day-to-day life.

A computational model was then put together, and it demonstrated that dendritic calcium spikes in the hippocampus could enable the brain to make better spatial decisions in future. Indeed, these spikes are driven by inputs from brain regions involved in complex cognitive processes, potentially enabling the delayed outcomes of navigational choices to guide changes in the activity and wiring of neurons. Overall, the work by Milstein et al. advances the understanding of learning and memory in the brain and may inform the design of better systems for artificial learning.

Introduction

Activity-dependent changes in synaptic strength can flexibly alter the selectivity of neuronal firing, providing a cellular substrate for learning and memory. In the hippocampus, synaptic plasticity plays an important role in various forms of spatial and episodic learning and memory (Nakazawa et al., 2004). The spatial firing rates of hippocampal place cells have been shown to be modified by experience and by changes in environmental context or the locations of salient features (O’Keefe and Conway, 1978; Mehta et al., 1997; Lever et al., 2002; Dupret et al., 2010; Zaremba et al., 2017; Turi et al., 2019; Ziv et al., 2013; Muller and Kubie, 1987; Bostock et al., 1991; Fyhn et al., 2007; Leutgeb et al., 2005). These modifications can occur rapidly, even within a single trial (Hill, 1978; Mehta, 2015; Monaco et al., 2014; Bittner et al., 2015; Bittner et al., 2017; Diamantaki et al., 2018; Jezek et al., 2011; Geiller et al., 2017; Bourboulou et al., 2019; Zhao et al., 2020). Here, we investigate the synaptic plasticity mechanisms underlying such rapid changes in the spatial selectivity of hippocampal place cells.

Various forms of Hebbian synaptic plasticity have been considered for decades to be the main, or even only, synaptic plasticity mechanisms present within most brain regions of a number of species (Magee and Grienberger, 2020). The core feature of such plasticity mechanisms is that they are autonomously driven by repeated synchronous activity between synaptically connected neurons, which results in either increases or decreases in synaptic strength depending on the exact temporal coincidence (Gerstner et al., 2018; Keck et al., 2017; Shouval et al., 2010; Song et al., 2000). This includes the so-called ‘three-factor’ plasticity rules that, in addition to pre- and postsynaptic activity, depend on a third factor that extends the time course over which plasticity can function (Magee and Grienberger, 2020; Gerstner et al., 2018; He et al., 2015; Yagishita et al., 2014). To implement these three-factor plasticity rules, it has been proposed that correlated pre- and postsynaptic activity drives the formation of a synaptic flag or eligibility trace (ET) that is then converted into changes in synaptic weights by the delayed third factor, usually a neuromodulatory signal (Gerstner et al., 2018; Sajikumar and Frey, 2004; Frey and Morris, 1997).

Recently, we reported a potent, rapid form of synaptic plasticity in hippocampal CA1 pyramidal neurons that enables a de novo place field to be generated in a single trial following a dendritic calcium spike (also called a plateau potential) (Bittner et al., 2015; Bittner et al., 2017; Diamantaki et al., 2018). This form of synaptic plasticity, termed behavioral timescale synaptic plasticity (BTSP), rapidly modifies synaptic inputs active within a seconds-long time window around the plateau potential. This relatively long time course suggests that BTSP may be similar to the above-mentioned three-factor forms of plasticity, with synaptic activity generating local signals marking synapses as eligible for plasticity (ETs), and plateau potentials acting as the delayed factor that converts synaptic ETs into changes in synaptic strength. However, BTSP was shown to strengthen many synaptic inputs whose activation did not coincide with any postsynaptic spiking or even subthreshold depolarization detected at the soma (Bittner et al., 2017), suggesting that changes in synaptic weight might be independent of correlated pre- and postsynaptic activity, and that BTSP may be fundamentally different than all variants of Hebbian synaptic plasticity (Gerstner et al., 2018; Keck et al., 2017; Shouval et al., 2010; Mehta, 2004; Golding et al., 2002). Such a non-standard plasticity rule could enable learning to be guided by delayed behavioral outcomes, rather than by short timescale associations of pre- and postsynaptic activity.

In this study, we tested the effect of dendritic plateau potentials on the spatial selectivity of CA1 neurons that already express pre-existing place fields, and therefore exhibit substantial postsynaptic depolarization and spiking prior to plasticity induction. We found that dendritic plateau potentials rapidly translocate the place field position of hippocampal place cells, both by strengthening inputs active near the plateau position and weakening inputs active within the original place field. In order to determine if the increased postsynaptic activity in place cells is causally related to the synaptic depression observed within the initial place field, we performed a series of voltage perturbation experiments, which indicated that the direction of plasticity induced by plateau potentials is independent of postsynaptic depolarization and spiking. Next, we inferred from the data a computational model of the synaptic learning rule underlying this bidirectional form of plasticity, which suggested that it is instead the current weight of each synaptic input that controls the direction of plasticity such that weak inputs potentiate and strong inputs depress. Finally, we implemented this weight-dependent learning rule in a network model to explore the capabilities of bidirectional BTSP to adapt network-level population representations to changes in the environment.

Results

Plateau potentials translocate existing place fields

We first examined how plasticity induced by dendritic plateau potentials changes the intracellular membrane potential (Vm) dynamics in neurons already exhibiting location-specific firing (i.e. place cells). Intracellular voltage recordings from CA1 pyramidal neurons were established in head-fixed mice trained to run for a water reward on a circular treadmill decorated with visual and tactile cues to distinguish spatial positions (~185 cm in length). Brief step currents (700 pA, 300 ms) were injected through the intracellular electrode for a small number (Nakazawa et al., 2004; O’Keefe and Conway, 1978; Mehta et al., 1997; Lever et al., 2002; Dupret et al., 2010; Zaremba et al., 2017; Turi et al., 2019; Ziv et al., 2013) of consecutive laps to evoke plateau potentials at a second location that was between 0 and 150 cm from the initial place field (labeled ‘Induction 2’ in Figure 1A and B; n = 26 plasticity inductions in 24 neurons). In 8/24 neurons a ‘natural’ pre-existing place field was expressed from the start of recording, while in 16/24 the initial place field was first experimentally induced by the same procedure (labeled ‘Induction 1’ in Figure 1A and B). In 2/24 neurons the induction procedure was repeated a third time with plateaus evoked at a different location, resulting in a total of 26 plasticity inductions in cells with pre-existing place fields (see Figure 1—figure supplement 1E and Materials and methods).

Figure 1. Dendritic plateau potentials translocate hippocampal place fields.

(A) Spatial firing of a CA1 pyramidal cell recorded intracellularly from a mouse running laps on a circular treadmill. Dendritic plateau potentials evoked by intracellular current injection first induce a place field at ~120 cm (Induction 1), then induce a second place field at ~10 cm and suppress the first place field (Induction 2). (B) Intracellular Vm traces from individual laps in (A). (C) Spatially binned Vm ramp depolarizations averaged across 10 laps before (gray) and after (black, blue, green, red) the second induction (100 spatial bins). Dashed lines and red triangles mark the average locations of evoked plateaus, black open triangles mark the location of the initial Vm ramp peak, and blue triangles indicate the position of the peak of the new place field. (D) Data from all cells were sorted by position of initial place field. Black line indicates location of initial peak, blue triangles indicate the position of the peak of the new place field, and red triangles the position of the plateau. Neurons in (C) are indicated by like colored arrows. (E) The distance between the new place field and the initial place field vs. the distance between the plateau and the initial place field (p = 0.000015; two-tailed null hypothesis test; explained variance [R2] computed by Pearson’s correlation). Red line is unity.

Figure 1.

Figure 1—figure supplement 1. Animal run behavior and behavioral timescale synaptic plasticity (BTSP) induction procedures (related to Figures 1 and 2).

Figure 1—figure supplement 1.

(A) Raw data for Vm (black), injected current (red), run velocity (green), and position (blue) for 12 laps, including eight plasticity induction laps, for the second induction in the example neuron shown in Figure 1A and B. (B) Animal running for all laps (76) with the stopping period included. (C) The current and preceding lap during the last five inductions from (A) shown in gray. The fastest route is shown in pink. Laps are aligned to induction position (red dashed line) and regions used for the plasticity time base in Figure 2F (−40 to +150 cm, ± ~3.5 s) indicated by dashed blue lines. (D) Top: Vm ramps before second induction (10 trials before first induction; black) and after (10 trials after last induction; red). Bottom: subtraction of before from after Vm traces (ΔVm) plotted against plasticity time base aligned to plateau onset (black line at 0 s). (E) Distribution of number of induction trials for 26 inductions shown in Figures 1 and 2. Black is first induction, red is second induction, blue is difference between the number of inductions during the second and first inductions in the same neurons. (F) All induction laps (gray traces) with the fastest route (colored traces) used as plasticity time base for the four example cells shown in Figures 1C and 2. Laps are aligned to induction position (red dashed line) and regions used for plasticity time base are indicated by dashed blue lines. Number of induction laps indicated.
Figure 1—figure supplement 2. Characterization of behavioral timescale synaptic plasticity (BTSP)-induced changes in Vm (related to Figure 1).

Figure 1—figure supplement 2.

(A) Raw Vm traces of three laps (6, 9, and 10) from a neuron that expressed a naturally occurring place field (on laps 1–8), a naturally occurring plateau potential (on lap 9), and a new place field on the subsequent laps (laps 10–35). (B – D) The action potentials are removed and the resulting traces are smoothed to generate Vm ramps (B) (see Materials and methods). The position of the mouse in time (C) is used to convert the Vm ramps from time to position (D). Red lines in (D) indicate position of plateau. Red lines in (C) indicate temporal (∆t) and spatial (∆x) distance from the plateau location to an example position. (E) Average spatially binned Vm ramp for trials before (laps 1–8, black) and after the plateau (laps 10–19, green) (100 spatial bins). Red line indicates plateau position, blue line indicates peak location of initial existing place field. (F–H) The difference between the before and after Vm ramps (F) is converted back to time (H) using the position of the animal in time during the plateau trial (G). Dashed black lines in (G) indicate time interval between the plateau position and the position of the initial place field. (I) Example Vm traces for laps before and after (black) a naturally occurring plateau potential (red) in a CA1 cell with a pre-existing place field. (J) Spatial firing rate heatmap shows naturally occurring plateau shifted pre-existing place field. (K) Expanded view of plateau in (I). (L) Spatially binned subthreshold Vm ramp depolarizations averaged across laps before (black) and after (dark red) a naturally occurring plateau (light red line). (M) Changes in Vm ramp vs. time to plateau for place cells in which a single naturally occurring plateau reshaped a pre-existing place field (n = 5). Naturally occurring plateaus induced both potentiation and depression that resulted in translocation of the place field.

In most cases the evoked dendritic plateaus shifted the location of the neuron’s pre-existing place field toward the position of the second induction site (Figure 1A and B). Place field firing is known to be driven by a slow, ramping depolarization of Vm from sub- to supra-threshold levels (Bittner et al., 2015; Harvey et al., 2009). Isolation of these low-pass filtered Vm ramps (Figure 1—figure supplement 2A-H; Materials and methods) revealed that plateau potentials likewise shifted the neuron’s Vm ramp toward the position of the plateau, such that the new Vm ramp peaked near the plateau position in most neurons (average distance = 19.5 ± 4.7 cm; n = 26; Figure 1C–E and Figure 1—figure supplement 2; example cells shown in Figure 1C are indicated with matching colored arrows in Figure 1D). We also observed similar shifts in place field position to be induced by spontaneous, naturally occurring plateau potentials in a separate set of recordings (n = 5; Figure 1—figure supplement 2I-M).

Spatial extent of Vm plasticity

The spatial profile of plateau-induced Vm changes (ΔVm) (Figure 2A) was obtained by subtracting the average Vm ramp for trials occurring before plateau initiation (Figure 1C; before) from the average Vm ramp for trials occurring after (Figure 1C; after). These data indicate that plateaus induced both positive and negative changes to Vm ramp amplitude (Figure 2A and B). In general, the increases in Vm depolarization peaked near the position of the plateau, while the negative changes peaked near the initial place field (Figure 2A and B, and Figure 2—figure supplement 1A and B). Although these changes varied considerably in magnitude across cells, the peak change in the positive direction was greater than the peak change in the negative direction (mean positive change± SEM vs. mean negative change± SEM: 6.73 ± 0.73 mV vs. 3.89 ± 0.32 mV, n = 26 inductions; p = 0.0001, paired two-way Student’s t-test; Figure 2—figure supplement 1A). Aligning each ΔVm trace to the position of the plateau (Figure 2A and B) demonstrates that the increases in Vm depolarization observed near the plateau position decay with distance, eventually becoming hyperpolarizing decreases in Vm. At even greater distances from a plateau, ΔVm decays back to zero (Figure 2B). To summarize the data presented thus far, dendritic plateau potentials change the location of place field firing by depolarizing Vm around the plateau position and hyperpolarizing Vm at positions within a pre-existing place field.

Figure 2. Spatial and temporal profiles of plateau-induced change in Vm.

(A) Difference between spatially binned Vm ramp depolarizations averaged across laps after the second induction and those averaged across laps before the second induction. Same example traces as shown in Figure 1C. Red triangles and dashed line indicate plateau location. Open triangles are locations of initial Vm ramp peaks. Traces have been smoothed using a five point boxcar average. (B) All change in Vm traces (ΔVm, not smoothed) from individual neurons (gray) and averaged across cells (black). (C) The running profile of the mice during the plateau induction trials plotted as time from plateau initiation vs. spatial location (100 bins). This indicates the temporal distance of the mouse from the plateau position at any given spatial position and is used as a time base in (E) and (F). (D) Spatial Vm ramp half-width, calculated as distance from plateau position to the final decay of ΔVm in a single direction, vs. the average running speed of the mouse during the induction trials calculated from traces shown in (C). Individual symbols for examples shown in (A) are correspondingly colored. Gray line is linear fit (p = 1.8e-06, two-tailed null hypothesis test; explained variance (R2) computed by Pearson’s correlation). (E) Change in Vm traces (ΔVm) using the time base shown in (C). Traces have been smoothed using a five-point boxcar average. (F) All change in Vm traces (ΔVm, not smoothed) from individual neurons (gray) and averaged across cells (red). Black crosses and circles indicate the 10% peak amplitude times used to calculate the asymmetry of positive changes (left/right potentiation ratio).

Figure 2.

Figure 2—figure supplement 1. Vm changes in space and time in place cells with pre-existing place fields (related to Figure 2).

Figure 2—figure supplement 1.

(A) Peak positive changes in Vm ramp (max, gray open circles) and peak negative changes (min, black open circles) for all cells. Mean and SEM are indicated with filled circles and bars. (B) Left: the distance from the plateau for the position with peak positive change (max, gray open circles) and for the position with peak negative change (min, black open circles). Mean and SEM are indicated with filled circles and bars. Right: the distance from the peak location of the initial place field position for the position with peak positive change (max, gray open circles) and for the position with peak negative change (min, black open circles). Mean and SEM are indicated with filled circles and bars. (C) Vm ramp before (gray) and after (black) plateau for neurons with large temporal separation between plateau and initial place field locations. (D) Change in Vm induced by plateau. (E) The running profile of the mice during the plateau induction trials plotted as time from plateau initiation vs. spatial location. (F) Change in Vm induced by plateau plotted using time base calculated from induction trials. (G) Changes in Vm ramp for two example cells from Figures 1 and 2. Distance and time from plateau (dashed line) to the end of plasticity (down pointing arrow) are shown. Note upper black trace does not return to zero before lap is complete. Lower green trace also shows the exponential fit of decay used to determine zero crossing location. (H) Animal-run velocity during induction trials is shown for the two example cells in (G). Average velocity values between plateau location and the zero-crossing location are indicated for each cell.

Time dependence of Vm plasticity

Previously we showed that location-specific increases in Vm depolarization induced by plateau potentials are the result of synapse-specific increases in the strength of spatially tuned excitatory inputs (Bittner et al., 2017). The above results suggest that, in addition to this synaptic potentiation, BTSP is also capable of inducing synaptic depression to cause location-specific decreases in Vm depolarization. In analyzing the spatial extent of the Vm changes induced by plateaus, we observed a strong linear relationship between the width of the resulting ΔVm and the running speed of the animal during plateau induction laps (Figure 2C and D), which had a slope on the order of seconds. This suggested that the run trajectory of the animal (Figure 2C) affected the spatial extent of the plasticity (Figure 2A and B) by determining which positions were traversed within a fixed seconds-long temporal window for plasticity, as we previously reported (Bittner et al., 2017). Therefore, we next analyzed the temporal relationship between plateau potentials and location-specific potentiation and depression. To do this, we used the running trajectory of the mice during plateau induction trials (Figure 2C) as a time base for ΔVm (Figure 2E; see also Figure 1—figure supplement 1, Figure 1—figure supplement 2A-H and Materials and methods). This analysis showed that the positive and negative changes to Vm induced in place cells occurred over a timescale of multiple seconds (Figure 2F), with the positive changes appearing to be asymmetric with respect to the onset time of the plateaus (ratio of potentiation duration before/after plateau onset: 2.2; black circles and crossmarks in Figure 2F mark the time points when ΔVm crosses zero). This asymmetry was similar to that observed for the positive Vm changes induced by BTSP in silent cells (Bittner et al., 2017). The negative changes (i.e. the hyperpolarizations indicative of synaptic depression) occurred within a time window between ±2 and ±6 s from the plateau in many neurons that expressed pre-existing place fields (Figure 2E and F). Notably, this hyperpolarization was greatly reduced, or even absent, in a set of place cells where the time delay between plateau onset and the initial place field Vm ramp was greater than 4–5 s (red traces in Figures 1C, 2A and E; see also Figure 2—figure supplement 1C-F), further indicating the time delimited aspect of the depression component. These data reinforce the idea that BTSP is a bidirectional form of synaptic plasticity with a seconds-long timescale that enables dendritic plateau potentials to shift the locations of hippocampal place fields by inducing both synaptic potentiation and depression.

Plasticity drives Vm towards a target shape with an apparent inverse dependence on initial Vm

We next sought to understand why dendritic plateaus induce both Vm depolarization and Vm hyperpolarization in cells expressing pre-existing place fields (Figures 1 and 2), but induce only Vm depolarization in spatially untuned silent cells (Figure 3—figure supplement 1; Bittner et al., 2017). Figure 3A shows that the initial temporal profile of Vm in place cells with pre-existing place fields was highly variable across neurons, as plateaus were experimentally induced at different temporal intervals from the existing place field in different neurons. In contrast, the change in VmVm) induced by plateaus showed a more consistent shape in time that appeared to depend on the initial level of Vm depolarization at each time point prior to plasticity (Figure 3B). Large positive changes occurred at time points with relatively hyperpolarized initial Vm, while time points with more depolarized initial Vm were associated with less positive and more negative ΔVm. These changes resulted in final Vm profiles that were highly similar across neurons, regardless of the initial Vm (Figure 3C). These results indicate that BTSP induces variable changes in synaptic strength that reshape the selectivity of neurons toward a common target shape – a place field centered near the location of evoked plateau potentials that decays toward baseline over many seconds in each direction.

Figure 3. Vm ramp plasticity varies with both time delay from plateau onset and initial Vm depolarization.

(A) Temporal profile of initial Vm before plasticity for inductions in neurons with pre-existing place fields (26 inductions from 24 place cells), aligned to the onset time of evoked plateau potentials. (B) Temporal profile of changes in VmVm) induced by plasticity in all place cells. Each ΔVm trace is color-coded by initial Vm. See inset color scale in (C). (C) Temporal profile of final Vm after plasticity in all place cells. Each Vm trace is color-coded by initial Vm (color scale inset). (D) The temporal profiles of initial Vm before plasticity are averaged across cells and three conditions are compared: silent cells without pre-existing place fields (black), place cells (dark red), and a subset of data from each place cell at time points when each cell was more depolarized than –56 mV within its place field (light red). Shading indicates SEM across cells. (E) The temporal profiles of changes in VmVm) induced by plasticity are averaged across cells and the three conditions from (D) are compared. Shading indicates SEM across cells. (F) The temporal profiles of final Vm after plasticity are averaged across cells and the three conditions from (D) are compared. Shading indicates SEM across cells. (G) Change in Vm ramp (ΔVm) plotted against initial Vm for all inductions in neurons with pre-existing place fields. Black line is linear fit and correlation coefficient shown (p < 0.00001, two-tailed null hypothesis test; explained variance (R2) computed by Pearson’s correlation). (H) Final Vm ramp after plasticity plotted against initial Vm before plasticity for all inductions in neurons with pre-existing place fields. Black line is linear fit and correlation coefficient shown (p < 0.014, two-tailed null hypothesis test; explained variance (R2) computed by Pearson’s correlation). (I) Heatmap of changes in Vm ramp (ΔVm) as a function of both time and initial Vm (see Materials and methods). Arrows indicate that the variable direction of plasticity serves to drive Vm toward the target equilibrium region (white). (J) Diagram depicts presynaptic spatial firing rates of a population of CA3 inputs to a postsynaptic CA1 neuron (top), the synaptic weights of those inputs before and after plasticity (middle), and the resulting postsynaptic Vm ramp, which reflects a weighted summation of the inputs. Traces are shown before (gray) and after (black) plasticity induction in a silent cell (Induction 1), and after a subsequent induction of plasticity (Induction 2, cyan) that translocates the position of the cell’s place field. (K) Table compares predicted outcomes of voltage perturbation experiments (depolarizing a silent cell, or hyperpolarizing a place cell), considering two possible forms of behavioral timescale synaptic plasticity (BTSP) (depends on initial Vm, or depends on initial synaptic weights).

Figure 3.

Figure 3—figure supplement 1. Vm changes in space and time in silent cells without pre-existing place fields (related to Figure 3).

Figure 3—figure supplement 1.

(A) Spatially binned initial Vm traces for silent cells that did not express pre-existing place fields (individual traces, gray; average across cells, black) (100 spatial bins). (B) Same as (A) but aligned to location of plateau. (C) Spatial profile of change in VmVm) for silent cells. (D) Temporal profile of ΔVm for silent cells.

In Figure 3D-F, we examined this further by comparing data from initially hyperpolarized silent cells (black; n = 29 inductions, see Figure 3—figure supplement 1 and Materials and methods) to data from place cells (dark red; n = 26 inductions). Place cells were on average more depolarized before plasticity than silent cells (Figure 3D), and more depression occurred in place cells compared to silent cells (Figure 3E). However, each place cell had both spatial positions where it was depolarized within its place field, and positions where it was hyperpolarized out-of-field. To determine if spatial positions that were initially depolarized were associated with larger depression, we grouped Vm ramp data from all place cells, considering only spatial bins where each cell was more depolarized than a threshold of –56 mV (light red traces labeled ‘PCs (within-field)’ in Figure 3D-F). Indeed, more depression and less potentiation was induced in place cells at those spatial positions that were initially most depolarized (Figure 3E). However, the final Vm ramps after plasticity were less sensitive to the initial state of depolarization across spatial bins of place cells (Figure 3F). This analysis further supported the findings that, while changes in Vm induced by plateaus were highly dependent on initial Vm, these changes drove the resulting final Vm ramp toward a common target shape (Figure 3F). Indeed, when all spatial bins from all place cells were analyzed, ΔVm showed a strong inverse correlation with initial Vm (m = –0.91; Figure 3G). In contrast, final Vm showed a very weak positive correlation with initial Vm (m = 0.04; Figure 3H), which reflects that some spatial bins show no change in Vm during plasticity, either because they were traversed outside the temporal window for plasticity or because the Vm at those positions had already reached a final Vm target value.

That BTSP induces variable changes in Vm that reshape the Vm ramp toward a particular target shape is further evident from a heatmap depicting the relationships of ΔVm to both initial Vm ramp depolarization and time from plateau onset (Figure 3I, positive ΔVm in red, and negative ΔVm in blue; see Materials and methods). The white regions of this plot trace out a temporal profile of Vm that corresponds to the final target place field shapes shown in Figure 3C and F. All initial deviations from this equilibrium Vm profile resulted in either positive or negative changes to approach this target place field shape (see dashed arrows). It should also be noted that the depression of Vm in place cells appeared to be weaker than the potentiation, leaving some residual depolarization at positions distant from the peak (Figure 3F). The functional significance of this is unclear, but may suggest that BTSP induces synaptic depression at a slower rate than potentiation (Cone and Shouval, 2021). To summarize, BTSP induces precise changes in synaptic strength that modify pre-existing place fields with any initial shape such that they approach a target shape that peaks near the location where dendritic plateaus were evoked.

Dependence on initial Vm vs. initial synaptic weights

Altogether these data revealed that, in general, the magnitude and direction of ΔVm depended on the time from the plateau potential, and correlated inversely with the initial Vm ramp amplitude prior to plasticity induction. Does this anti-correlation reflect a causal relationship between postsynaptic depolarization and changes in synaptic weight induced by BTSP? This possibility would require that small depolarizations induce synaptic potentiation and large depolarizations induce synaptic depression, which is actually opposite to what has been observed in CA1 pyramidal cells with a variety of other plasticity protocols (Shouval et al., 2010; Yang et al., 1999; Graupner and Brunel, 2012; Clopath et al., 2010; Clopath and Gerstner, 2010; Jedlicka et al., 2015). Furthermore, the increased Vm depolarization within a cell’s place field also reflects the activation of strongly weighted synaptic inputs, which have been potentiated by prior plasticity (Bittner et al., 2015; Bittner et al., 2017; Figure 3J). Thus, a causal dependency on either Vm or synaptic weight could explain the data so far.

To discriminate between these two possibilities, we next devised a set of voltage perturbation experiments. We reasoned that, if increased depolarization and spiking within a cell’s place field causes synaptic depression, then artificially increasing Vm and inducing spiking in otherwise silent cells would cause plateau potentials to induce negative ΔVm. Likewise, artificially decreasing Vm and preventing spiking in place cells would prevent plateau potentials from inducing negative ΔVm (Figure 3K). On the contrary, if the direction of plasticity depended instead on the initial strengths of synapses prior to plasticity, these voltage manipulations would have no effect on the balance between positive and negative ΔVm (Figure 3K). It is important to note that these somatic voltage manipulations are not expected to strictly control or even completely overwhelm Vm at the synaptic sites relevant to plasticity induction (Magee and Johnston, 1997; Koester and Sakmann, 1998; Froemke et al., 2005) due to attenuation of current and voltage along the dendritic cable (Magee, 1998; Golding et al., 2005), and compartmentalization of synaptic voltage in dendritic spines (Harnett et al., 2012). However, by either increasing or decreasing the generation of somatic action potentials, this manipulation will unequivocally alter the number of action potentials that back-propagate into dendrites, which will in turn influence the activation of voltage-gated channels in dendrites and spines (e.g. Na+ channels, Ca2+ channels, and NMDA-Rs) (Magee and Johnston, 1997; Takahashi and Magee, 2009). Expected changes to the mean Vm in active dendritic spines were supported by simulations of a biophysically and morphologically detailed CA1 place cell model expressing voltage-gated ion channels and receiving rhythmic excitation and inhibition to mimic the in vivo recording conditions (Figure 4—figure supplement 1; Grienberger et al., 2017). Moreover, manipulation of somatic Vm and spike timing is widely used to successfully influence plasticity induction in vitro and in vivo (Malinow and Miller, 1986; Jacob et al., 2007; Schulz et al., 2010).

According to the above scheme, we first recorded from spatially untuned silent cells, and injected current (~100 pA) through the intracellular pipette to depolarize the neurons’ Vm by ~10 mV and to increase spiking during plasticity induction trials (Figure 4A; baseline trials mean AP rate: 0.26 ± 0.25 Hz; first induction trial mean AP rate: 4.8 ± 1.4 Hz, n = 8; blue trace in Figure 4B). In all neurons tested, we observed plateau potentials to induce large positive ΔVm at spatial positions surrounding the plateau location, and no negative ΔVm at any spatial positions (Figure 4A; blue trace in Figure 4C). This result is inconsistent with a causal dependence on initial Vm (Figure 3K), which predicted a ΔVm profile similar to that of control place cells at their most depolarized positions within their pre-existing place fields (red traces, ‘control PCs (within-field)’ in Figure 4B and C repeated from Figure 3D and E for comparison).

Figure 4. Experimental perturbation of postsynaptic activation does not change the direction of plasticity induced by behavioral timescale synaptic plasticity (BTSP).

(A) Intracellular Vm traces from individual laps in which plasticity was induced by experimentally evoked plateau potentials in an otherwise silent CA1 cell (top trace). During plasticity induction laps (middle trace), the neuron was experimentally depolarized by ~10 mV. Experimentally evoked plateau potentials induced a place field (bottom). (B) Initial Vm before plasticity averaged across cells. Shading indicates SEM. Three conditions are compared: manipulated silent cells (silent + depolarization; blue), data from place cells at time points within their initial place fields (control PCs [within-field]; red), and control cells without pre-existing place fields (silent; black). (C) Changes in Vm ramp (ΔVm) for the same groups as in (B). Colored bars indicate statistical significance in specific time bins (p < 0.05; Student’s two-tailed t-test). Black compares manipulated silent cells to control silent cells, and red compares manipulated silent cells to control place cells (within-field). See Materials and methods for number of inductions in each time bin. (D) Intracellular Vm traces from individual laps in which plasticity was induced by experimentally evoked plateau potentials in a place cell with a pre-existing place field (top). During plasticity induction laps, the neuron was experimentally hyperpolarized by ~25 mV at spatial positions surrounding the initial place field (middle). Experimentally evoked plateau potentials translocated the place field (bottom). (E) Initial Vm before plasticity averaged across cells. Shading indicates SEM. Three conditions are compared: control place cells with pre-existing place fields (control PCs; red), control silent cells without pre-existing place fields (silent; black), and manipulated place cells with pre-existing place fields (PCs + hyperpolarization; green). (F) Changes in Vm ramp (ΔVm) for the same groups as in (E). Colored bars indicate statistical significance in specific time bins (p < 0.05; Student’s two-tailed t-test). Black compares manipulated place cells to control silent cells, and red compares manipulated place cells to control place cells. See Materials and methods for number of inductions in each time bin.

Figure 4.

Figure 4—figure supplement 1. Biophysically detailed simulations of depolarizing and hyperpolarizing somatic Vm perturbation experiments (related to Figure 4).

Figure 4—figure supplement 1.

(A) Simulation of a biophysically detailed CA1 pyramidal cell model with realistic morphology and dendritic ion channel distributions (Grienberger et al., 2017) to estimate the effect of somatic depolarization on distal dendritic Vm (Figure 4). Three conditions are compared: a silent cell with uniform input weights (black), a silent cell with ~10 mV of depolarization induced by somatic current injection (purple), and a place cell receiving potentiated inputs at the peak of its place field (blue). Simulated Vm traces were recorded from soma (left), distal apical oblique dendrite (center), and a distal apical dendritic spine (right). Under these conditions, a combination of attenuated depolarization and back-propagating action potentials invades dendrites and amplifies local synaptic input by activating dendritic voltage-gated ion channels, resulting in a level of dendritic depolarization comparable to the place field condition. (B) Simulations estimate the effect of somatic hyperpolarization on distal dendritic Vm. Three conditions are compared: a silent cell with uniform input weights (black), a place cell receiving potentiated inputs at the peak of its place field (blue), a place cell with ~25 mV of hyperpolarization induced by somatic current injection (red). Under these conditions, action potentials are prevented, and attenuated hyperpolarization invades dendrites, but local synaptic input continues to drive substantial intermittent local depolarization. (C) Mean low-pass filtered Vm at simulated dendritic recording sites at varying distances from the soma. (D) Same as (B) for simulated recordings from dendritic spines.
Figure 4—figure supplement 2. Hyperpolarization of silent cells during plasticity induction reduces synaptic potentiation (related to Figure 4).

Figure 4—figure supplement 2.

(A) Top black traces are Vm during laps before induction in a silent cell. During plasticity induction (thin green trace) somatic current injection (–500 pA, thick green trace) hyperpolarized Vm by ~40 mV for a duration of ~3 s ending 500 ms before the plateau induction location (+700 pA, thick green trace). Bottom black traces are Vm during laps after plasticity induction. (B) Spatially binned subthreshold Vm ramp depolarizations averaged across laps before (black) and after (green) plasticity induction. Red line indicates plateau location, green bar indicates locations of hyperpolarizing current injection. Note relatively small potentiation at locations with hyperpolarizing current. (C) Average Vm for control silent cells without pre-existing place fields (silent; black), and the manipulated neurons (silent + large hyperpolarization; green). (D) Average change in Vm ramp amplitude for the same groups as in (C). Black bar indicates time bins with statistically significant difference between manipulated and control groups (p < 0.05; Student’s two-tailed t-test). See Materials and methods for number of inductions in each time bin.

Next, we performed the inverse manipulation by recording from place cells and injecting current (~–150 pA) to hyperpolarize the neurons’ Vm by ~–15 mV and prevent spiking at spatial locations surrounding their pre-existing place fields while plasticity was induced at a second location (Figure 4D; baseline trials in-field mean AP rate 10.66 ± 0.93 Hz; first induction trial in-field mean AP rate 0.06 ± 0.06 Hz, n = 5; green trace in Figure 4E). This manipulation did not prevent negative ΔVm at positions within the original place field (Figure 4D; green trace in Figure 4F), again incompatible with synaptic depression requiring elevated postsynaptic depolarization and spiking (Figure 3K). In fact, full amplitude synaptic depression was observed at locations within the original place field despite the somatic Vm being more hyperpolarized than either the silent cell (black traces in Figure 4E and F) or control place cell groups (red traces, ‘control PCs’ in Figure 4E and F).

These data clearly show that the direction of plasticity induced by dendritic plateau potentials is not determined by the activation state of the postsynaptic neuron. Instead, the results of these voltage perturbation experiments support the alternative hypothesis that it is the initial strength of each synapse that controls whether an input will be potentiated or depressed by BTSP (Figure 3K). However, the magnitude of potentiation and depression was slightly affected by the voltage perturbations (e.g. potentiation was slightly but significantly increased in silent cells during artificial depolarization compared to control, Figure 4C). This is consistent with the previously reported finding that BTSP induction requires activation of voltage-dependent ion channels, including NMDA-type glutamate receptors (NMDA-Rs) and voltage-gated calcium channels (Bittner et al., 2017), which would have predicted BTSP to depend on postsynaptic depolarization. To examine this further, we performed an additional set of experiments in which silent cells were strongly hyperpolarized by somatic current injection (~–50 mV for ~3 s just before plateau initiation) during plasticity induction (Figure 4—figure supplement 2). This manipulation decreased synaptic potentiation (Figure 4—figure supplement 2), consistent with a requirement for activation of voltage-dependent NMDA-Rs. That such a large, non-physiological level of global Vm hyperpolarization was required to alter BTSP reinforces the finding that, operationally, the dependence is not on voltage signals associated with neuronal activation state (sustained somatodendritic Vm and action potentials), but rather on those associated with synaptic input (transient local spine depolarization) (Beaulieu-Laroche and Harnett, 2018). Finally, these experiments do not support a role for synaptic depolarization in determining the direction of changes in synaptic strengths.

Weight-dependent model of bidirectional BTSP

The above voltage perturbation experiments suggested that the form of synaptic plasticity underlying BTSP does not depend on the activation state of the postsynaptic neuron (Figure 4). This contrasts with Hebbian plasticity rules that typically depend on either the firing rate or depolarization of the postsynaptic cell to determine the amplitude and direction of changes in synaptic weight. Another difference is that BTSP appears to be inherently stable, converting synaptic potentiation into depression when input strengths exceed a particular range, whereas most models of Hebbian learning require additional homeostatic mechanisms to counteract synaptic potentiation in highly active neurons (Oja, 1982; Bienenstock et al., 1982; Abbott and Nelson, 2000; Zenke et al., 2013; Turrigiano and Nelson, 2004). To better understand the synaptic learning rule underlying BTSP and its functional consequences, we next sought a mathematical description of BTSP to account for the following features of the in vivo recording data:

  1. BTSP induces bidirectional changes in synaptic weight at inputs activated up to ~6 s before or after a dendritic plateau potential.

  2. The direction and magnitude of changes in synaptic weight depend on the initial state of each synapse such that weak inputs potentiate, and strong inputs depress.

  3. BTSP modifies synaptic weights such that the temporal profile of Vm in place cells approaches a stable target shape that peaks close in time to the plateau location and decays with distance.

As mentioned previously, ‘three-factor’ plasticity models propose a mechanism for the strengths of activated synapses to be modified after a time delay – a biochemical intermediate signal downstream of synaptic activation marks each recently activated synapse as ‘eligible’ to undergo a plastic change in synaptic weight. This ‘ET’ decays over a longer timescale than synaptic activation, and while it does not induce plasticity by itself, it enables plasticity to be induced upon the arrival of an additional modulatory biochemical signal. While ‘three-factor’ models consider synaptic ETs to be generated by a coincidence of presynaptic spikes (factor 1) and postsynaptic spikes or sustained depolarization (factor 2), the results of the above voltage perturbation experiments suggest that if BTSP involves the generation of synaptic ETs, these signals depend only on a single factor – local synaptic activation. In the context of BTSP, the modulatory or ‘instructive signal’ (IS) could be instantiated by a dendritic plateau potential. To model this, we assumed that the large magnitude dendritic depolarization associated with a plateau potential (~60 mV) effectively propagates to all synapses (Xu et al., 2012), activating an IS at each synapse and allowing a spatially and temporally local interaction between ET and IS to drive plasticity independently at each individual synapse (Figure 5A). To account for plasticity that occurs at inputs activated up to multiple seconds after a plateau, this IS would have to decay slowly enough to overlap in time with ETs generated after the end of the plateau (Figure 5A).

Figure 5. Weight-dependent model of behavioral timescale synaptic plasticity (BTSP) captures essential features of plateau-induced plasticity.

Figure 5.

(A – B) Traces schematize a model of bidirectional BTSP that depends on (1) presynaptic spike timing, (2) plateau potential timing and duration, and (3) the current synaptic weight of an input before an evoked plateau. (A) Presynaptic spikes (first row, black) result in local Vm depolarization of a postsynaptic spine (second row, gray), which generates a long duration plasticity ‘eligibility trace’ (ET) (third row, green) that marks the synapse as eligible for later synaptic potentiation or depression. The large Vm depolarization associated with the dendritic plateau potential (first row, brown) is assumed to effectively propagate to all synaptic sites (second row, gray), which generates a separate long duration ‘instructive signal’ (IS) (third row, yellow) that is also required for plasticity. Both potentiation and depression are saturable processes that depend on the temporal overlap (product) of ET and IS (fourth row, purple). (B) Equation defines the rate of change in synaptic weight dWdt in terms of a potentiation process q+ that decreases with increasing initial weight W, and a depression process q that increases with increasing initial weight W. Plot shows the relationship between dWdt and the signal overlap ET*IS under conditions of low (red), intermediate (purple), or high (blue) initial weight. (C – E) Heatmaps of changes in synaptic weight in terms of time delay between presynaptic spike and postsynaptic plateau, and initial synaptic weight for three variants of the weight-dependent model of BTSP. Dashed traces mark the equilibrium initial synaptic weight at each time delay where potentiation and depression are balanced and additional pairings of presynaptic spikes and postsynaptic plateaus result in zero further change in synaptic weight. (C) Model in which potentiation (q+) and depression (q) processes are nonlinear (sigmoidal) functions of signal overlap (ET*IS). (D) Model in which are potentiation (q+) and depression (q) processes are linear functions of signal overlap (ET*IS). (E) Model in which the durations of the ET and instructive signal (IS) are constrained to a short (100 ms) timescale, similar to intracellular calcium.

Accordingly, we modeled changes in synaptic weights as a function of the time-varying amplitudes of these two biochemical intermediate signals, ET and IS. For simplicity, we first considered how BTSP would change the weight W of a single synapse activated by a single presynaptic spike with precise timing relative to the onset of a plateau potential (Figure 5A). We modeled the synaptic ET as a signal that increases upon synaptic activation at time ts and decays exponentially with time course τET (see Figure 5A and Materials and methods). The IS was modeled as a signal that increases during a plateau potential with onset at time tp and duration d and decays exponentially with time course τIS (see Figure 5A and Materials and methods).

Next, we modeled bidirectional changes in synaptic weight dWdt as a function of the temporal overlap or product of these two signals, ET*IS. To account for the observation that BTSP favors synaptic potentiation at weak synapses and synaptic depression at strong synapses, we expressed dWdt in terms of two separate plasticity processes q+ and q with opposite dependencies on the current synaptic weight W:

dWdt=(WmaxW)k+q+(ETIS)Wkq(ETIS) (1)

where W is saturable up to a maximum weight of Wmax , and k+ and k are learning rate constants that control the magnitudes of synaptic potentiation and depression per plateau potential. This formula can be obtained from a two-state model of finite synaptic resources (see Materials and methods). When the current synaptic weight W is near Wmax , the potentiation rate becomes zero, and when W is near zero, the depression rate becomes zero. To calculate the net change in synaptic weight W after plasticity induction, dWdt was integrated in time for the duration of plasticity induction laps.

Experimental evidence suggests that synaptic potentiation and depression processes involve biochemical interactions between enzymes (e.g. phosphokinases-like CaMKII and phosphatases-like calcineurin) and synaptic protein substrates (e.g. AMPA-type glutamate receptors) (Herring and Nicoll, 2016; Mansuy, 2003). Such concentration-limited reactions are typically saturable and nonlinear (Graupner and Brunel, 2012). Accordingly, we defined the plasticity processes q+ and q as saturable (sigmoidal) functions of the signal overlap ET*IS (see Materials and methods). If the depression process q has a lower threshold for activation than the potentiation process q+ (Graupner and Brunel, 2007; Inglebert et al., 2020), the resulting change in synaptic weight dWdt is positive and increases monotonically when initial weights are low, but is negative and non-monotonic when initial weights are high (Figure 5B). At intermediate weights, dWdt transitions from negative (depression) to positive (potentiation) for values of signal overlap ET*IS that are beyond a threshold (Figure 5B). Thus, the largest negative changes in synaptic weight occur when inputs are initially large in weight and signal overlap ET*IS is intermediate in amplitude. This is consistent with the in vivo data, which showed that negative changes in place field ramp Vm were largest at intermediate delays from a plateau (Figure 3B and I).

We tested this weight-dependent model of bidirectional BTSP by varying both the timing of a single presynaptic spike relative to a plateau (Figure 5A) and the initial weight of the activated synapse (Figure 5B). Model parameters were calibrated (see Materials and methods) such that synapses with an initial weight less than a baseline weight of 1 undergo only potentiation, while synapses with higher weight undergo either potentiation or depression, depending on the timing of their activation relative to the plateau (Figure 5C). This produced a profile of changes in synaptic weight similar to the profile of changes in intracellular Vm measured in vivo (Figure 3I). This model also recapitulated the finding that the positive and negative changes in weight induced by BTSP appear to drive synaptic inputs toward a stable target weight, after which additional plateaus do not induce any further changes in strength (indicated in white, compare Figures 3I and 5C).

We next exploited the mathematical formulation of the model to analyze these equilibrium conditions in more detail. We defined Weq as the stable equilibrium value of W where potentiation and depression processes are exactly balanced, and the change in weight W is zero over the course of a trial from times t0 to t1 :

ΔW=0=(WmaxWeq)k+t0t1q+(ETIS)dtWeqkt0t1q(ETIS)dt (2)

If we abbreviate the integrated potentiation and depression terms as:

ΔQ+=t0t1q+(ETIS)dt (3)
ΔQ=t0t1q(ETIS)dt (4)

then Weq can be expressed as:

Weq=WmaxK+ΔQ+K+ΔQ++kΔQ (5)

Note that the quantities ΔQ+ and ΔQ , and therefore the value of Weq , will vary with the activation time of the input (ts), and the onset time (tp) and duration (d) of a plateau. For a plateau with fixed onset time and duration, this produces a distribution of target equilibrium weights that varies only with the timing of synaptic activation relative to plateau onset (dashed line in Figure 5C), and matches the asymmetric shape of place fields induced by BTSP. In contrast, an alternative version of the model in which the potentiation and depression processes were defined to be linear instead of sigmoidal, predicted a single value for Weq regardless of the timing of synaptic activation (Figure 5D), thus failing to account for the data. Finally, we verified that the model requires long timescales for ET and IS by testing the model with shorter values (100 ms) for the decay time constants τET and τIS (Figure 5E). This was unable to explain changes in synaptic weight at inputs activated at seconds-long time delays to a plateau.

Having demonstrated that this weight-dependent model of plasticity at single synapses captures the essential features of BTSP, we next tested if the model can account quantitatively for the in vivo place field translocation data (Figures 13). For this purpose, we assumed that the Vm ramp depolarization measured in a CA1 pyramidal cell during locomotion on the circular treadmill reflects a weighted sum of presynaptic inputs that are themselves place cells with firing rates that vary with spatial position (see Figure 3J and Materials and methods). As a population, the place fields of these inputs uniformly tiled the track, and the firing rate of an individual input depended on the recorded run trajectory of the animal (Figure 6A, first and second rows). In this case, presynaptic activity patterns were modeled as continuous firing rates rather than discrete spike times. For each cell in the experimental dataset (n = 26 inductions from 24 neurons, Figures 13), the initial weight Wi of each presynaptic input i was inferred from the recorded initial Vm, and the changes in weight Wi during plasticity induction laps containing evoked plateau potentials were computed as above (Equation 1; see Materials and methods). The relevant signals modeled for an example lap from a representative cell from the dataset are shown in Figure 6A. Note that, at inputs activated before the onset time of the plateau, changes in synaptic weight (bottom row) do not begin until after plateau onset when the instructive signal IS and the signal overlap ET*IS are nonzero. The parameters of the model were optimized to predict the final synaptic weights (Figure 6B) and reproduce the final Vm ramp (Figure 6C) after multiple plasticity induction laps (Figure 6—figure supplement 1, Materials and methods). Across all cells, these predictions quantitatively matched the corresponding experimental data (Figure 6D). Finally, the sensitivity of changes in Vm to initial Vm and time to plateau predicted by the model recapitulated that measured from the in vivo intracellular recordings (Figure 6E and Figure 6—figure supplement 2).

Figure 6. Weight-dependent model of behavioral timescale synaptic plasticity (BTSP) accounts for experimentally measured bidirectional changes in Vm.

(A) The weight-dependent model of BTSP shown in Figure 5 was used to reproduce plateau-induced changes in Vm in an experimentally recorded CA1 neuron given (1) the measured run trajectory of the animal during plateau induction trials (example lap shown in first row, animal position in gray), (2) the measured timing and duration of evoked plateau potentials (first row, example plateau onset marked in brown), and (3) the measured initial Vm before plasticity (shown in (C), gray). A population of 200 presynaptic CA3 place cells provided input to the model CA1 neuron. The firing rates of the presynaptic inputs were assumed to vary with spatial position and run velocity (second row, all presynaptic inputs are shown sorted by place field peak location, black). Synaptic activity at each input generated a distinct local eligibility trace (ET) (third row, green). The dendritic plateau potential generated a global instructive signal broadcast to all synapses (fourth row, yellow). The overlap between ET and IS varied at each input depending on the timing of presynaptic activity (fifth row, purple). The weight-dependent model predicted increases in synaptic weight (positive rate of change, red) at some synapses with low initial weight, and decreases in synaptic weight (negative rate of change, blue) at other synapses with high initial weight. (B) Synaptic weights of the 200 synaptic inputs shown in (A) before (gray) and after (black) plateau-induced plasticity. (C) Spatially binned Vm ramp before (gray) and after (black) plasticity was computed as a weighted sum of the input activity. (D) Changes in Vm ramp amplitude (ΔVm) at each spatial bin predicted by the weight-dependent model are compared to the experimental data (n = 26 inductions from 24 neurons with pre-existing place fields). Explained variance (R2) and statistical significance (p < 0.05) reflect Pearson’s correlation and two-tailed null hypothesis tests. (E) Heatmap of changes in Vm ramp (ΔVm) predicted by the model as a function of both time and initial Vm. Compare to experimental data in Figure 3I.

Figure 6.

Figure 6—figure supplement 1. Sensitivity of induced place field Vm ramps to repeated plateau potentials and run velocity in the weight-dependent model of behavioral timescale synaptic plasticity (BTSP) (related to Figures 2 and 6).

Figure 6—figure supplement 1.

(A–B) For the example cell shown in Figure 6A-C to illustrate the weight-dependent model of BTSP described in Figure 5, the values of synaptic weights (A) and Vm ramp amplitude (B) before and after each of four plasticity induction laps are shown. (C) Simulations of plasticity induction under conditions of constant run velocity reveals a positive relationship between run velocity and spatial width of the induced place field (compare to Figure 2D).
Figure 6—figure supplement 2. Comparison of alternative models of behavioral timescale synaptic plasticity (BTSP) (related to Figures 5 and 6).

Figure 6—figure supplement 2.

(A) Variants of the model of bidirectional BTSP described in Figures 5 and 6 were evaluated based on the accuracy of their predictions of experimentally measured changes in Vm ramp amplitude induced by dendritic plateau potentials. For each model variant, plots show change in model Vm ramp as a function of both time and initial Vm ramp amplitude (see Materials and methods). (B) The maximum change in Vm for each induction in the experimental dataset (Figures 13, n = 26 inductions) predicted by each model is compared to the experimental data. Differences between groups were first statistically evaluated with a Friedman test (p = 0.08926). No differences were detected, suggesting that all model variants accurately accounted for the potentiation component of BTSP. (C) The minimum change in Vm for each induction in the experimental dataset (Figures 13, n = 26 inductions) predicted by each model is compared to the experimental data. Differences between groups were first statistically evaluated with a Friedman test (p < 0.00001), and then model variants were compared to the experimental data with post hoc Wilcoxon signed rank tests. Asterisk indicates p < 0.05, after Bonferonni correction for multiple comparisons. See Materials and methods for formulation details of each model.
Figure 6—figure supplement 3. Bidirectional behavioral timescale synaptic plasticity (BTSP) schematic (related to Figures 3, 5 and 6).

Figure 6—figure supplement 3.

(A – C) (Step 1) Selecting synapses for weight adjustment. (A) Postsynaptic dendrite with spines and presynaptic inputs. Top spines receive inappropriately patterned or inactive inputs (black) while lower spines receive appropriately patterned inputs (red). (B) The electrical signals involved are (i) excitatory postsynaptic potentials (EPSPs; gray) that produce local synaptic depolarization and (ii) the plateau potential (brown) that produces global dendritic depolarization. Each of these two electrical signals produce a biochemical signal that prolongs their impact with EPSPs generating eligibility traces (ETs, green) and the plateau generating an instructive signal (IS, yellow). Only appropriately patterned inputs generate ETs (lower set of traces in (B) and spines shaded green in (A)). This sensitivity of ET generation to presynaptic activity pattern (i.e. input repetition, synchrony, and spatial clustering) may be a result of the voltage dependence of NMDA-type glutamate receptor (NMDA-R) activation. (C) Overlay of time courses of electrical (gray and brown) and biochemical signals (green and yellow) generated by inappropriate or inactive inputs. The lack of ET generation produces no overlap signal (ET * IS, purple). Synapses lacking significant overlapping ET and IS will not have their weights adjusted. (D) Same as (C) but for appropriately patterned inputs. Synapses that have overlapping ET and IS (ET * IS, purple) are selected to have their weights adjusted. (E – H) (Step 2) Determining the amplitude and direction of synaptic weight changes. Only spines selected in step 1 are shown. (E – F) Short intervals between synaptic inputs and plateau potentials (E) produce large magnitude overlap signals (F). Resulting weight changes are dominated by potentiation due to subsequent nonlinear potentiation and depression processes which are scaled by initial weights (see Figure 5 and Materials and methods). An interplay between the initial input weight and the time interval determines the exact magnitude of the change in weight. (G – H) Longer intervals (G) produce smaller overlap signals (H) and depression dominates, again due to the subsequent nonlinear processes (see Figure 5 and Materials and methods). The exact magnitude of synaptic depression is determined by an interplay between the interval and the initial weights.

The above modeling results help to clarify the differences between BTSP and previously characterized forms of associative synaptic plasticity based on input-output correlations over short timescales (Gerstner et al., 2018; He et al., 2015; Brzosko et al., 2015; Brzosko et al., 2017). First, the model supports the hypothesis that a dependence on initial synaptic weight is the actual source of the observed inverse relationship between initial Vm and plasticity-induced changes in Vm (Figure 3). Second, the scaling of both potentiation and depression by synaptic weight produces a balanced form of plasticity that rapidly stabilizes during repeated inductions (Figure 1, and Figure 6—figure supplement 1A and B; Shouval et al., 2010; Jedlicka et al., 2015; Bienenstock et al., 1982; Abraham, 2008; Cooper and Bear, 2012). Third, the time course of BTSP is determined by temporal overlap between slow eligibility signals associated with synaptic activity and slow IS associated with plateau potentials. This selects a subpopulation of synaptic inputs activated with appropriate timing to undergo a change in synaptic strength (Figure 6—figure supplement 3). Finally, IS are internal signals activated by dendritic plateau potentials, rather than by spiking output, arguing that BTSP is not simply a variant of Hebbian plasticity that depends on input-output correlations over a longer timescale.

Functional capabilities of BTSP

The above observations imply that BTSP could enable spatial representations to be shaped non-autonomously by delayed behavioral outcomes, if dendritic inputs carrying information about those outcomes are able to evoke plateau potentials (Muller et al., 2019). To evaluate the feasibility and implications of this theory, we next considered the conditions that are required for dendritic plateau potentials to be generated in the context of the hippocampal neural circuit. Previous work has shown that (1) plateau potentials are positively regulated by excitatory inputs from entorhinal cortex (Bittner et al., 2015; Takahashi and Magee, 2009; Milstein et al., 2015), (2) they are negatively regulated by dendrite-targeting inhibition (Grienberger et al., 2017; Milstein et al., 2015; Lovett-Barron et al., 2012; Royer et al., 2012; Palmer et al., 2012), (3) they occur more frequently in novel environments (Cohen et al., 2017) and precede the emergence of new place fields (Sheffield et al., 2017), and (4) introduction of a fixed reward site induces large shifts in the place field locations of many place cells in a population, as assayed by calcium imaging (Turi et al., 2019). In order to explore the consequences of these regulatory mechanisms on memory storage by BTSP at the network level, we next constructed a network model of the CA1 microcircuit that incorporates these critical elements to regulate plateau initiation (Figure 7A) and implements the above-described weight-dependent model of BTSP (Figures 5 and 6) at each input to the network.

Figure 7. Bidirectional behavioral timescale synaptic plasticity (BTSP) enables rapid adaptation of population representations in a network model.

(A) Diagram depicts components of a hippocampal network model. A population of CA1 pyramidal neurons receives spatially tuned excitatory input from a population of CA3 place cells and a long-range feedback input from entorhinal cortex (EC) that signals the presence of a behavioral goal. The output of CA1 pyramidal neurons recruits local feedback inhibition from a population of interneurons. (B) The probability that model CA1 neurons emit plateau potentials and induce bidirectional plasticity is negatively modulated by feedback inhibition. As the total number of active CA1 neurons increases (labeled ‘normalized population activity’), feedback inhibition increases, and plateau probability decreases until a target level of population activity is reached, after which no further plasticity can be induced (black). A long-range feedback input signaling the presence of a goal increases plateau probability, resulting in a higher target level of population activity inside the goal region (red). (C) Each row depicts the summed activity of the population of model CA1 pyramidal neurons across spatial positions during a lap of simulated running. Laps 1–10 reflect exploration of a previously unexplored circular track. During laps 11–20, a goal is added to the environment at a fixed location (90 cm). During laps 21–25, the goal is removed for additional exploration of the now familiar environment. (D – E) Activity of individual model CA1 pyramidal neurons during simulated exploration as described in (C). (D) The firing rates of model neurons are sorted by the peak location of their spatial activity following 10 laps of novel exploration. ~250 neurons have acquired place fields. A fraction of the population remains inactive and untuned. (E) Left: changes in firing rate of model neurons after 10 laps of goal-directed search shows place field acquisition and translocation. Right: the firing rates of model neurons are re-sorted by their new peak locations. An increased fraction of neurons express place fields near the goal position. The remaining silent ~200/500 neurons that did not acquire a place field are not shown.

Figure 7.

Figure 7—figure supplement 1. New place field acquisition and pre-existing place field translocation in a network model of goal-directed navigation (related to Figure 7).

Figure 7—figure supplement 1.

(A – C) Data shown are derived from the network model results from Figure 7. (A) Histogram depicts neurons recruited to express new place fields in each spatial bin (epochs: novel explore, blue; fixed goal, red; familiar explore, gray). (B) Histogram depicts absolute change in position of translocated place fields. (C) Histogram depicts change in position of translocated place fields relative to the goal location.

In a population of 500 firing rate model CA1 pyramidal neurons, plateaus were positively regulated by a long-range feedback input from entorhinal cortex and negatively regulated by local feedback inhibition (Figure 7A and B; Stefanelli et al., 2016). Generation of plateau potentials within the population of CA1 neurons in the model was stochastic, which would result from fluctuations in inputs from entorhinal cortex that occasionally cross a threshold for the generation of a plateau potential in different cells at different times. The presence of reward delivered at a fixed goal location was implemented as an increase in input from entorhinal cortex (Boccara et al., 2019; Butler et al., 2019), although an equivalent increase in plateau generation could result instead from neuromodulatory input that directly increased dendritic excitability or reduced dendritic inhibition (Sjöström et al., 2008; Pi et al., 2013; Tyan et al., 2014; Guerguiev et al., 2017).

During goal-directed navigation, hippocampal neurons have been shown to preferentially acquire new place fields near behaviorally relevant locations, and to translocate existing place fields toward those locations (Dupret et al., 2010; Zaremba et al., 2017; Turi et al., 2019; Hollup et al., 2001; Gauthier and Tank, 2018; Lee et al., 2020). We modeled this situation by simulating a virtual animal running on a circular treadmill for three separate phases of exploration (Figure 7C). At each time step (10 ms), instantaneous plateau probabilities were computed for each cell (Figure 7B), determining which neurons would initiate a dendritic plateau and undergo plasticity. During the first few laps of simulated exploration, CA1 pyramidal neurons rapidly acquired place fields that, as a population, uniformly tiled the track (Figure 7C and D). As neurons increased their activity over time, feedback inhibition increased proportionally and prevented further plasticity (Figure 7A–C). During the next phase a goal was presented at a fixed location, resulting in both acquisition of new place fields nearby the goal location in a population of initially silent neurons, and translocation of place fields toward the goal location in a separate population of cells with pre-existing fields (Figure 7E, left; Figure 7—figure supplement 1). Overall, this resulted in an increased proportion of place cells with fields near the goal position (Figure 7E, right), recapitulating experimentally observed modifications in CA1 network activity during goal-directed behavior (Zaremba et al., 2017). The asymmetric time course of BTSP caused the population representation of the goal in the model to peak before the goal location itself, producing a predictive memory representation of the path leading to the goal (Mehta et al., 1997; Stachenfeld et al., 2017). Simulated place cell activity remained stable in a final phase of exploration without reward (Figure 7C and Figure 7—figure supplement 1). These network modeling results demonstrate that plasticity regulated by local network activity and long-range feedback, rather than by pairwise correlations, can enable populations of place cells to rapidly adapt their spatial representations to changes in the environment without any compromise in selectivity.

Discussion

In summary, we observed translocation of hippocampal place fields by dendritic plateau potentials and characterized the underlying synaptic learning rule. We found that BTSP is bidirectional, inducing both synaptic potentiation and synaptic depression in neurons expressing pre-existing place fields. The direction of plasticity is determined by the synaptic weight of each excitatory input prior to a plateau potential, and the time interval between synaptic activity and a plateau. The large magnitude of synaptic weight changes enables BTSP to rapidly reshape place field activity in a small number of trials. These results corroborate recent work showing that changes in place field firing in CA1 could be induced by juxtacellular current injection, which was correlated with the occurrence of long duration complex spikes (Diamantaki et al., 2018). Here, we used intracellular stimulation and recording to reliably evoke dendritic calcium spikes with precise timing and duration, and to monitor subthreshold changes in Vm dynamics, which enabled inference of the underlying synaptic learning rule.

The time and synaptic weight dependence of BTSP suggests that it is driven by an input-specific process rather than nonselective heterosynaptic (Lynch et al., 1977) or homeostatic plasticity (Mendez et al., 2018; Hengen et al., 2016), or modulation of cellular excitability (Chandra and Barkai, 2018; Titley et al., 2017). A significant role for changes in inhibitory synaptic weights is unlikely given that (1) inhibitory neurons in CA1 exhibit low levels of spatial selectivity (Grienberger et al., 2017), (2) homosynaptic potentiation of excitatory inputs by dendritic plateau potentials can be induced with GABAergic inhibition blocked (Bittner et al., 2017), and (3) inhibitory input to CA1 neurons does not change following induction of synaptic potentiation by BTSP (Grienberger et al., 2017).

The voltage perturbation experiments we performed (Figure 4) showed that BTSP does not depend on the activation state of the postsynaptic neuron. These results point to a fundamental difference between BTSP and existing Hebbian models of plasticity. In most previous models, including the aforementioned ‘three-factor’ plasticity models, the firing rate (He et al., 2015; Brzosko et al., 2015; Markram et al., 1997; Bi and Poo, 1998), or sustained level of global depolarization (Clopath et al., 2010; Artola et al., 1990; Brandalise and Gerber, 2014) at the time of presynaptic spiking primarily determines whether a synaptic weight increases or decreases (Gerstner et al., 2018; Abbott and Nelson, 2000; Caporale and Dan, 2008). Our voltage perturbation experiments (Figure 4 and Figure 4—figure supplement 2) show that the direction of plasticity is not determined by either global depolarization or spiking.

This lack of dependence on the postsynaptic activity or output could enable plasticity to be robust to fluctuations in postsynaptic state due to noise or network oscillations (e.g. theta or gamma) (Buzsáki and Moser, 2013), and may allow the postsynaptic state to subserve other functions, such as temporal coding, without interfering with ongoing synaptic weight modifications. Furthermore, while in traditional Hebbian models of plasticity, short timescale synchrony between pre- and postsynaptic activity modifies weights to reinforce pre-existing correlations, BTSP instead provides a mechanism to either create new pairwise activity correlations ‘from scratch’, or remove pre-existing ones based on delayed outcomes. Our network model (Figure 7) highlights how this fundamental element of BTSP could shape spatial memory storage at the network level, allowing neuronal circuits to rapidly acquire population-level representations of previously unencountered environmental features, and to modify outdated representations. This model also demonstrated that, if plateau potentials are generated by a mismatch between local circuit output and target information relayed by long-range feedback, BTSP can implement objective-based learning (Richards et al., 2019b; Sacramento, 2018; Payeur et al., 2020).

Together our experimental and modeling results establish BTSP as a potent mechanism for rapid and reversible learning. In addition to providing insight into the fundamental mechanisms of spatial memory formation in the hippocampus, these findings suggest new directions for general theories of biological learning and the development of artificial learning systems (Guerguiev et al., 2017; Payeur et al., 2020; Bono and Clopath, 2017; Richards and Lillicrap, 2019a; Lillicrap et al., 2020).

Materials and methods

Animals and procedures

All experimental methods were approved by the Janelia or Baylor College of Medicine Institutional Animal Care and Use Committees (Protocols 12–84 and 15–126). All experimental procedures in this study, including animal surgeries, behavioral training, treadmill and rig configuration, and intracellular recordings, were performed identically to a previous detailed report (Bittner et al., 2017) in an overlapping set of experiments, and are briefly summarized here.

In vivo experiments were performed in 6- to 12-week-old mice of either sex. Craniotomies above the dorsal hippocampus for simultaneous whole-cell patch clamp and local field potential (LFP) recordings, as well as affixation of head bar implants were performed under deep anesthesia. Following a week of recovery, animals were prepared for behavioral training with water restriction, handling by the experimenter, and addition of running wheels to their home cages. Mice were trained to run on the cue-enriched linear treadmill for a dilute sucrose reward delivered through a licking port once per lap (~187 cm). A MATLAB GUI interfaced with a custom microprocessor-controlled system for position-dependent reward delivery and intracellular current injection. Animal-run velocity was measured by an encoder attached to one of the wheel axles.

Plasticity was induced in vivo by injecting current (700 pA, 300 ms) intracellularly into recorded CA1 neurons to evoke dendritic plateau potentials at the same position on the circular treadmill for multiple consecutive laps. In most cases, plateaus were evoked on five consecutive laps (Figure 1—figure supplement 1E, left). However, during some experiments, large changes in the spatial Vm ramp depolarization could be observed to develop after as few as one plateau (consistent with the observation that plasticity could be induced by a single spontaneously-occurring plateau), and so fewer induction laps were used. In other experiments, plateaus were induced on more than five consecutive laps if place field expression remained weak after the first five trials (Figure 1—figure supplement 1E, left). The source of this variability across cells/animals is not yet clear, and requires future investigation. Overall, this procedure induced changes in spatial Vm ramp depolarization in 100% of cells in which it was attempted by three investigators. In some cells, the initial place field was first induced by this procedure, and then the procedure was repeated a second or third time in the same cell with plateaus induced at different locations. In those cases, there was no systematic difference in the number of plateaus required to induce the first place field compared to subsequent fields (Figure 1—figure supplement 1E, right).

Since the time window for plasticity induction by BTSP extends for seconds around each plateau, and plateaus were typically evoked on multiple consecutive laps, the changes in synaptic weights induced by BTSP depended on the run behavior of the animals across all induction laps. We showed in Figure 3D that the spatial width of place fields induced by BTSP varied with the average velocity of animals across all plasticity induction laps. Another factor that contributed to the spatial width of induced fields is the proximity of the evoked plateaus to the reward site, as animals tended to stop running briefly to lick near the fixed reward site. Variability across laps in either the run velocity or the duration of pauses could pose a challenge in trying to relate spatial changes in Vm ramp depolarization to the time delay to the plateau (see below). Figure 1—figure supplement 1 shows the full run trajectories of animals during all plasticity induction laps for the five representative example cells shown in Figure 1. While some variability across induction laps was observed, each animal tended to run consistently at similar velocities across laps.

In vivo intracellular electrophysiology

To establish whole-cell recordings from CA1 pyramidal neurons, an extracellular LFP electrode was lowered into the dorsal hippocampus using a micromanipulator until prominent theta-modulated spiking and increased ripple amplitude was detected. Then a glass intracellular recording pipette was lowered to the same depth while applying positive pressure. The intracellular solution contained (in mM): 134 K-gluconate, 6 KCl, 10 HEPES, 4 NaCl, 0.3 MgGTP, 4 MgATP, 14 Tris-phosphocreatine, and in some recordings, 0.2% biocytin. Current-clamp recordings of intracellular membrane potential (Vm) were amplified and digitized at 20 kHz, without correction for liquid junction potential. The silent-cell population of neurons (n = 29) contained recordings from 17 neurons that have been previously reported (Bittner et al., 2017).

In a subset of experiments (Figure 4 and Figure 4—figure supplement 2), in addition to position-dependent step current to evoke plateau potentials, additional current was injected either to depolarize neurons beyond spike threshold or to hyperpolarize neurons below spike threshold, during plasticity induction laps. While these perturbations to Vm at the soma are expected to attenuate along the path to distal dendrites (Golding et al., 2005), the pairing of back-propagating action potentials with synaptic inputs has been shown to significantly amplify dendritic depolarization (Jarsky et al., 2005; Stuart and Häusser, 2001; Migliore et al., 1999; Schiller and Schiller, 2001). Simulations of a biophysically detailed CA1 place cell model with realistic morphology and distributions of dendritic ion channels (Grienberger et al., 2017) suggest that somatic depolarization of a silent CA1 cell increases distal dendritic depolarization, and that somatic hyperpolarization of a place cell substantially reduces distal dendritic depolarization at the peak of its place field (Figure 4—figure supplement 1).

Place field analysis

To analyze subthreshold Vm ramps, action potentials were first removed from raw Vm traces and linearly interpolated, then the resulting traces were low-pass filtered (<3 Hz). For each of 100 equally sized spatial bins (~1.85 cm), Vm ramp amplitudes were computed by averaging across 10 laps of running on the treadmill both before and after plasticity induction. The spatially binned ramp traces were then smoothed with a Savitzky-Golay filter with wrap-around. Ramp amplitude was quantified as the difference between the peak and the baseline (average of the 10% most hyperpolarized bins). For cells with a second place field induced, the same baseline Vm value determined from the period before the second induction was also used to quantify ramp amplitude after the second induction. Plateau duration was estimated as the duration of intracellular step current injections, or as the full width at half maximum Vm in the case of spontaneous naturally occurring plateaus.

Vm ramp half-width (Figure 2D and Figure 6—figure supplement 1C) was calculated from the ΔVm traces as the time (s) or distance (cm) between the plateau and the final return of ΔVm to zero (or at least to 25% of min; see Figure 2—figure supplement 1G). In most cases this only occurred on one side of the plateau, during either the running period before or after the plateau. In 5/26 inductions, the mouse ran so quickly that the ΔVm did not have time to reach 25% of min on either side of the plateau (Figure 2—figure supplement 1G), resulting in an underestimation of the ramp half-width. The average velocity was calculated as the mean velocity of the mouse from the plateau to the end of the plasticity (Figure 2—figure supplement 1).

In order to relate spatial changes in Vm ramp depolarization to the time delay to a plateau (e.g. Figures 2E, F4B, C, E, F6E), we assigned to each spatial position the shortest time delay to plateau that occurred across multiple induction laps (Figure 1—figure supplement 1). This is a conservative estimate, as the shortest delay between presynaptic activity and postsynaptic plateau will generate the largest overlap between ET and IS, and will result in the largest changes in synaptic weight. While this method is imperfect and did discard variability in running behavior across laps, it enabled direct comparison of the time course of BTSP across neurons. We also note that, to generate the modeling results shown in Figure 6, the full run trajectory of each animal during all induction laps, including pauses, was provided as input to the model (see details below). This resulted in good quantitative agreement between experimentally recorded and modeled spatial Vm ramps (Figure 6D). Since not all possible pairs of initial ramp amplitude and time delay relative to plateau onset were sampled in the experimental dataset, expected changes in ramp amplitude (e.g. Figure 3I) were predicted from the sampled experimental or model data points by a two-dimensional Gaussian process regression and interpolation procedure using a rational quadratic covariance function, implemented in the open-source Python package sklearn (Abraham et al., 2014; Rasmussen and Williams, 2006).

To statistically compare ΔVm vs. time plots among groups each individual induction trace was binned in time (average of values in 80, 100 ms, bins from –4 to +4 s). The number of points in each bin for each group is as follows: silent cells (−4, + 4 s): n = 19, 19, 19, 0, 20, 20, 21, 21, 25, 26, 26, 27, 27, 27, 27, 27, 28, 28, 28, 28, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 29, 27, 25, 25, 25, 24, 21, 20, 19, 17, 16, 14, 14, 10, 9, 9, 8, 8, 7, 7, 7, 7, 7, 6, 6, 6, 6, 6. Silent + depolarization (−4, + 4 s): n = 2, 2, 4, 5, 5, 6, 6, 6, 6, 6, 6, 7, 7, 7, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 6, 6, 6, 6, 5, 5, 5, 5, 3, 3. Depolarized PCs (–4 to +4 s): n = 6, 6, 6, 6, 6, 5, 5, 5, 4, 4, 5, 6, 6, 6, 7, 7, 6, 6, 6, 7, 7, 8, 7, 7, 7, 7, 6, 6, 5, 5, 5, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 5, 5, 5, 5, 5, 5, 5, 6, 7, 8, 8, 8, 9, 10, 14, 14, 15, 15, 15, 15, 15, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 14, 13, 12, 12, 10, 9, 9. All PCs (–1 to +4 s): n = 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 26, 25, 24, 24. PCs + hyperpolarization (–1 to +4 s): n = 5, 6, 6, 7, 7, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8. Silent+ large hyperpolarization (–4 to +4): n = 4, 4, 4, 4, 5, 5, 5, 6, 6, 6, 6, 6, 6, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6, 5, 5, 5, 5, 5, 4, 4, 4, 4, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2.

Quantification and statistical analysis

Statistical details of experiments can be found in the figure legends. Unless otherwise specified, measured values and ranges reflect mean ± SEM. Significance was defined as p < 0.05. Sample sizes were not determined by statistical methods, but efforts were made to collect as many samples as was technically feasible. No data or subjects were excluded from any analysis.

Computational modeling

Weight-dependent BTSP model

In Figures 5 and 6, we provide a mathematical model of the synaptic learning rule underlying bidirectional BTSP. In this ‘weight-dependent’ model, the direction and magnitude of plasticity at excitatory synapses from spatially tuned CA3 place cell inputs onto a CA1 pyramidal cell are determined by (1) the timing of presynaptic spiking relative to postsynaptic plateau potentials and (2) the current weight of each synapse just prior to a plateau. While in Figure 5, discrete spikes were provided as presynaptic inputs to the model, in Figure 6, presynaptic inputs were provided as continuous firing rates. This model contained nine free parameters (described in detail below), which were fit to the experimental data using an iterative, bounded, stochastic search procedure based on the simulated annealing algorithm (Milstein, 2021a; Milstein, 2021b). This optimization sought to minimize the difference between the experimentally recorded place cell Vm ramp depolarizations (Figures 13) and those predicted by the model (Figure 6D and E). Parameter optimization was considered to converge after sampling 30,000 distinct model configurations. Below we describe the model formulation in detail.

A CA1 place cell was modeled as receiving excitatory input from a population of 200 CA3 place cells with spatially tuned firing fields spaced uniformly across an ~185 cm circular track (Figure 3J). The firing rate Ri of an individual input i with place field at position yi depended on the recorded run trajectory of the animal xt (Figure 6A, first and second rows):

Ri(t)=Rmaxe12(yix(t)σ)2 (6)

where Rmax is a maximum firing rate of 40 Hz at the peak of a place field, and σ determines the width of the place field. σ was set such that CA3 place field inputs had a full floor width (6*σ) of 90 cm (half-width of ~34 cm) (Mizuseki et al., 2012), though models tuned with alternative values of σ generated quantitatively similar predictions (‘60 cm input field widths’ in Figure 6—figure supplement 2). The complete run trajectory of each animal during consecutive plasticity induction laps, including pauses in running between laps, was provided as a continuous input to the model. In accordance with experimental data (Bittner et al., 2015; Grienberger et al., 2017), the firing rates of model place cell inputs were set to zero during periods when the animal stopped running.

The Vm ramp depolarization of a CA1 place cell as a function of position, Vx, was modeled as a weighted sum of the spatial firing rates of the CA3 place cell inputs. We assumed that in silent cells prior to plasticity induction, all inputs had an initial synaptic weight of 1. This produced a background level of depolarization, Vb , which was subtracted from the total weighted sum to calculate the ramp amplitude (Figure 6C–E):

Vx=c*iWi*Rix-Vb (7)

The scaling factor c was calibrated such that if the synaptic weights of CA3 place cell inputs varied between 1 and 2.5 as a Gaussian function of their place field locations, the postsynaptic CA1 cell would express a Vm ramp with 108 cm width and 6 mV peak amplitude, consistent with previous measurements of place field properties and the degree of synaptic potentiation by BTSP (Bittner et al., 2017). For CA1 place cells already expressing a place field before plateaus were evoked at a second location, the initial synaptic weights were estimated by using least squares approximation to fit the experimentally recorded initial Vm ramp.

At each input i, a postsynaptic eligibility trace ETi was activated by presynaptic firing Ri and decayed with a seconds-long time course τET (Figure 6A, third row):

τETdETidt=ETi+λETRi (8)

The scaling factor λET was chosen such that the maximum amplitude of ET does not exceed 1. For single spike inputs, as shown in Figure 5, the firing rate Ri was replaced with a delta function δt-ts where ts is the time of the spike.

Postsynaptic dendritic plateau potentials during each induction lap µ with onset at time tp and duration d activated an instructive signal IS that was broadcast to all synapses and decayed exponentially with time course τIS (Figure 6A, fourth row):

τISdISdt=IS+λISP(tp,d) (9)

where P is a binary function that takes a value of 1 during a plateau and 0 otherwise. The scaling factor λIS was chosen such that the maximum amplitude of IS does not exceed 1. The duration of experimentally induced plateaus were typically 300 ms, but spontaneous plateaus were recorded with duration up to ~800 ms.

Next, temporal overlap of eligibility traces ETi and instructive signals IS (Figure 6A, fifth row) were considered to drive saturable potentiation and depression processes independently at each synapse. The sensitivity of these two processes q+ and q to the amplitude of plasticity signal overlap was defined by generalized sigmoid functions sx,α,β with a scale and offset to meet the following edge constraints: s=0 when x=0, s=1 when x=1:

s^(x,α,β)=11+e(β(xα)) (10)
s(x,α,β)=s^(x,α,β)s^(0,α,β)s^(1,α,β)s^(0,α,β) (11)
q+(ETiIS)=s(ETiIS,α+,β+) (12)
q(ETiIS)=s(ETiIS,α,β) (13)

where α± and β± control the threshold and slope of the sigmoidal gain functions for potentiation and depression.

Finally, to capture the dependency of changes in synaptic weight dWitdt on the current value of synaptic weight Wi at each input i during plasticity induction, we chose a two-state non-stationary kinetic model of the following form:

InactiveIk+q+(ETiIS)kq(ETiIS)ActiveA (14)

According to this formulation, independent and finite synaptic resources at each synapse occupied either an inactive state I or an active state A, and transitioned between states with rates controlled by the constants k± and the gain functions q± described above. The synaptic weight of each input Wi was defined as proportional to the occupancy of the active state A:

Wi=A*Wmax (15)

where 0A1, and Wmax is a free parameter controlling the maximum value of synaptic weight. Since the occupancy of each state in a kinetic model constrains the flow of finite resources between states, the net change in synaptic weight dWidt at each input i naturally depended on the current value of synaptic weight Wi :

dWidt=(WmaxWi)k+q+(ETiIS)Wik+q(ETiIS) (16)

Changes in synaptic weight Wi were calculated by integrating the net rate of change of synaptic weight dWidt over the duration of plasticity induction. In practice, for simplicity and efficiency of computation during parameter optimization, we numerically approximated Wi by holding the value of Wi constant for the duration of each induction lap, and updating Wi once at the end of each induction lap (Figure 6). Equivalent results were obtained by updating Wi continuously in 10 ms steps without requiring any change in parameters.

The weight-dependent model of the BTSP rule contained nine free parameters. The range of parameter values that fit the experimental data (n = 26 plasticity inductions in 24 neurons with pre-existing place fields) were as follows (mean ± SEM): (1) τET: 863.91 ± 113.93 ms, (2) τIS: 542.76 ± 95.47 ms, (3) α+: 0.24 ± 0.05, (4) β+: 30.32 ± 6.50, (5) α: 0.09 ± 0.04, (6) β: 2260.61 ± 1529.97, (7) k+: 2.27 ± 0.49/s, (8) k : 0.33 ± 0.11/s, (9) Wmax: 4.02 ± 0.17. The results of the model in response to simpler single-spike inputs in Figure 5A–C were obtained with the following parameter values: (1) τET: 2500 ms, (2) τIS: 1500 ms, (3) α+: 0.5, (4) β+: 4, (5) α: 0.01, (6) β: 44.44, (7) k+: 1.7/ s, (8) k: 0.204/s, (9) Wmax: 5.

Alternative formulations of the weight-dependent BTSP model

Given the complexity of the above model, we also tested a number of alternative formulations to determine if the experimental data could be accounted for by a simpler model. First, we tested whether the filter time constants ET and IS that control the duration of the ET and IS could be shorter by constraining their values during parameter optimization to be less than 50 ms. This model variant performed poorly in predicting the depression component of BTSP (‘short timescale ET and IS’ in Figure 5E and Figure 6—figure supplement 2A and B). This supports the notion that intermediate signals with durations longer than either voltage or calcium are required for the long timescale of BTSP. This also demonstrates that the nonlinear gain functions q± are not able to compensate for shorter duration ET or IS.

Next, we determined whether the nonlinear gain functions q± could instead be linear by replacing both the sigmoidal q+ and q with the identity function:

q+(ETiIS)=ETiIS (17)
q(ETiIS)=ETiIS (18)

This model variant also failed to account for synaptic depression by BTSP (‘linear q+ and q’ in Figure 5D and Figure 6—figure supplement 2A and B), suggesting that nonlinearity of bidirectional plasticity is an important feature of the weight-dependent BTSP model.

Goal-directed spatial learning model

To investigate the implications of bidirectional BTSP for spatial learning by a population of CA1 place cells (Figure 7), we constructed a network model comprised of 500 CA1 pyramidal cells each receiving input from a population of 200 CA3 place cells with place fields spaced at regular intervals spanning the ~185 cm circular track. The synaptic weights at inputs from model CA3 place cells to model CA1 cells were controlled by the weight-dependent model described above (Figures 5 and 6). For this purpose, the nine free parameters of the model were calibrated to match synthetic target Vm ramp data as follows: (1) lap running was simulated at a constant run velocity of 25 cm/s, (2) in an initially silent cell, plasticity was induced by three consecutive laps with one 300 ms long plateau per lap evoked at a fixed location, (3) after plasticity, the induced place field Vm ramp had an asymmetric shape (~75 cm rise, ~ 35 cm decay) and a peak amplitude of 8 mV, (4) three additional plasticity induction laps with plateaus evoked at a location 3 s behind the peak location of the initial place field resulted in a 5 mV decrease in ramp amplitude at the initial peak location, and an 8 mV peak ramp amplitude at the new translocated peak position.

Before simulated exploration, all synaptic weights were initialized to a value of 1, which resulted in zero ramp depolarization in all model CA1 cells. Under these baseline conditions, each model CA1 neuron k had a probability pkt=pbasal=0.0075 of emitting a single dendritic plateau potential in 1 s of running. During each 10 ms time step, this instantaneous probability pkt was used to weight biased coin flips to determine which cells would emit a plateau. This stochasticity can be thought of as reflecting fluctuations in the synaptic input arriving to each cell from the long-range cortical input pathway that occasionally drives the neuron to cross a threshold for generation of a dendritic calcium spike. If a cell emitted a plateau, it persisted for a fixed duration of 300 ms and was followed by a 500 ms refractory period during which pkt was transiently set to zero.

After the first lap, CA1 neurons that had emitted at least one plateau and had induced synaptic potentiation produced nonzero ramp depolarizations (Figure 7C). The output firing rates Rμ,kCA1 of each CA1 neuron k on lap µ were considered to be proportional to their ramp depolarizations Vμ,kt after subtracting a threshold depolarization of 2 mV. The activity RμINHt of a single inhibitory feedback element was set to be a normalized sum of the activity of the entire population of CA1 pyramidal neurons:

RμINH(t)=λkRμ,kCA1(t) (19)

where the normalization constant λ was chosen such that the activity of the inhibitory feedback neuron would be one if every CA1 pyramidal neuron expressed a single place field and as a population their place field peak locations uniformly tiled the track. Then, the probability that any CA1 neuron k would emit a plateau pkt was negatively regulated by the inhibitory feedback term RμINHt :

pk(t)={s(RμINH(t),αbasal,βbasal)RμINH(t)<αbasal0RμINH(t)αbasal (20)

where αbasal defined a target normalized population activity (set to 0.5) and βbasal defined the slope of a descending sigmoid function with a maximum value of 0.0075 (Figure 7B).

In some laps, a specific location was assigned as the target of a goal-directed search. To mimic an increase in the activity of the long-range input from entorhinal cortex signaling the presence of the goal, the probability that a CA1 neuron would emit a plateau potential pkt was transiently increased when the simulated animal crossed the goal location for a period of 500 ms. Within the goal region, the relationship between pkt and RμINHt was instead:

pk(t)={s(RμINH(t),αgoal,βgoal)RμINH(t)<αgoal0RμINH(t)αgoal (21)

where αgoal is an elevated target normalized population activity (set to 1.0) and βgoal defines the slope of a descending sigmoid function with a maximum value of 0.035, corresponding to an elevated peak plateau probability (Figure 7B).

Data and code availability

The complete dataset and Python code for data analysis and model simulation is available at https://github.com/neurosutras/BTSP (Milstein, 2021c copy archived at swh:1:rev:952cbb453ae80b2efe52f2936baa03e3a4689dc5).

Acknowledgements

We are grateful to Karel Svoboda and Wulfram Gerstner for discussions, Nicolas Brunel and Nelson Spruston for comments on the manuscript, Grace Ng for contributing to software development, Roy Phillips for behavioral device development, Ivan Raikov for technical assistance with high-performance computing, and Kristopher Bouchard at LBNL for sharing large-scale computing resources provided by the National Energy Research Scientific Computing Center, a Department of Energy Office of Science User Facility (DE-AC02-05CH11231). This work was also made possible by computing allotments from NSF (XSEDE Comet, NCSA Blue Waters, and TACC Frontera) and supported by NIH BRAIN grant U19NS104590 and NIMH grant R01MH121979. SR and JM are supported by the Howard Hughes Medical Institute.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Contributor Information

Jeffrey C Magee, Email: jcmagee@bcm.edu.

Sandro Romani, Email: romanis@janelia.hhmi.org.

Katalin Toth, University of Ottawa, Canada.

Laura L Colgin, University of Texas at Austin, United States.

Funding Information

This paper was supported by the following grants:

  • National Institutes of Health U19NS104590 to Aaron D Milstein, Ivan Soltesz.

  • National Institute of Mental Health R01MH121979 to Aaron D Milstein.

Additional information

Competing interests

No competing interests declared.

No competing interests declared.

Author contributions

Conceptualization, Formal analysis, Investigation, Methodology, Software, Visualization, Writing – original draft, Writing – review and editing.

Investigation, Methodology.

Conceptualization, Investigation, Methodology, Visualization.

Conceptualization, Investigation, Methodology, Visualization.

Funding acquisition, Supervision, Writing – review and editing.

Conceptualization, Funding acquisition, Investigation, Supervision, Visualization, Writing – original draft, Writing – review and editing.

Conceptualization, Funding acquisition, Investigation, Methodology, Supervision, Writing – original draft, Writing – review and editing.

Ethics

All experimental methods were approved by the Janelia or Baylor College of Medicine Institutional Animal Care and Use Committees (Protocol 12-84 & 15-126).

Additional files

Transparent reporting form

Data availability

The complete dataset, Python code for data analysis and model simulation, and additional MATLAB and Igor analysis scripts are available at https://github.com/neurosutras/BTSP (copy archived at swh:1:rev:952cbb453ae80b2efe52f2936baa03e3a4689dc5).

The following dataset was generated:

Milstein AD, Li Y, Bittner KC, Grienberger C, Soltesz I, Magee JC, Romani S. 2021. Bidirectional synaptic plasticity rapidly modifies hippocampal representations. Github. neurosutras/BTSP

References

  1. Abbott LF, Nelson SB. Synaptic plasticity: taming the beast. Nature Neuroscience. 2000;3:1178–1183. doi: 10.1038/81453. [DOI] [PubMed] [Google Scholar]
  2. Abraham WC. Metaplasticity: tuning synapses and networks for plasticity. Nature Reviews. Neuroscience. 2008;9:387. doi: 10.1038/nrn2356. [DOI] [PubMed] [Google Scholar]
  3. Abraham A, Pedregosa F, Eickenberg M, Gervais P, Mueller A, Kossaifi J, Gramfort A, Thirion B, Varoquaux G. Machine learning for neuroimaging with scikit-learn. Frontiers in Neuroinformatics. 2014;8:14. doi: 10.3389/fninf.2014.00014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Artola A, Bröcher S, Singer W. Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex. Nature. 1990;347:69–72. doi: 10.1038/347069a0. [DOI] [PubMed] [Google Scholar]
  5. Beaulieu-Laroche L, Harnett MT. Dendritic Spines Prevent Synaptic Voltage Clamp. Neuron. 2018;97:75–82. doi: 10.1016/j.neuron.2017.11.016. [DOI] [PubMed] [Google Scholar]
  6. Bi GQ, Poo MM. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of Neuroscience. 1998;18:10464–10472. doi: 10.1523/JNEUROSCI.18-24-10464.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Bienenstock EL, Cooper LN, Munro PW. Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. The Journal of Neuroscience. 1982;2:32–48. doi: 10.1523/JNEUROSCI.02-01-00032.1982. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bittner KC, Grienberger C, Vaidya SP, Milstein AD, Macklin JJ, Suh J, Tonegawa S, Magee JC. Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons. Nature Neuroscience. 2015;18:1133–1142. doi: 10.1038/nn.4062. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Bittner KC, Milstein AD, Grienberger C, Romani S, Magee JC. Behavioral time scale synaptic plasticity underlies CA1 place fields. Science. 2017;357:1033–1036. doi: 10.1126/science.aan3846. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Boccara CN, Nardin M, Stella F, O’Neill J, Csicsvari J. The entorhinal cognitive map is attracted to goals. Science. 2019;363:1443–1447. doi: 10.1126/science.aav4837. [DOI] [PubMed] [Google Scholar]
  11. Bono J, Clopath C. Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level. Nature Communications. 2017;8:706. doi: 10.1038/s41467-017-00740-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Bostock E, Muller RU, Kubie JL. Experience-dependent modifications of hippocampal place cell firing. Hippocampus. 1991;1:193–205. doi: 10.1002/hipo.450010207. [DOI] [PubMed] [Google Scholar]
  13. Bourboulou R, Marti G, Michon F-X, El Feghaly E, Nouguier M, Robbe D, Koenig J, Epsztein J. Dynamic control of hippocampal spatial coding resolution by local visual cues. eLife. 2019;8:e44487. doi: 10.7554/eLife.44487. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Brandalise F, Gerber U. Mossy fiber-evoked subthreshold responses induce timing-dependent plasticity at hippocampal CA3 recurrent synapses. PNAS. 2014;111:4303–4308. doi: 10.1073/pnas.1317667111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Brzosko Z, Schultz W, Paulsen O. Retroactive modulation of spike timing-dependent plasticity by dopamine. eLife. 2015;4:e09685. doi: 10.7554/eLife.09685. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Brzosko Z, Zannone S, Schultz W, Clopath C, Paulsen O. Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation. eLife. 2017;6:e27756. doi: 10.7554/eLife.27756. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Butler WN, Hardcastle K, Giocomo LM. Remembered reward locations restructure entorhinal spatial maps. Science. 2019;363:1447–1452. doi: 10.1126/science.aav5297. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Buzsáki G, Moser EI. Memory, navigation and theta rhythm in the hippocampal-entorhinal system. Nature Neuroscience. 2013;16:130–138. doi: 10.1038/nn.3304. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Caporale N, Dan Y. Spike timing-dependent plasticity: a Hebbian learning rule. Annual Review of Neuroscience. 2008;31:25–46. doi: 10.1146/annurev.neuro.31.060407.125639. [DOI] [PubMed] [Google Scholar]
  20. Chandra N, Barkai E. A non-synaptic mechanism of complex learning: Modulation of intrinsic neuronal excitability. Neurobiology of Learning and Memory. 2018;154:30–36. doi: 10.1016/j.nlm.2017.11.015. [DOI] [PubMed] [Google Scholar]
  21. Clopath C, Büsing L, Vasilaki E, Gerstner W. Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nature Neuroscience. 2010;13:344–352. doi: 10.1038/nn.2479. [DOI] [PubMed] [Google Scholar]
  22. Clopath C, Gerstner W. Voltage and Spike Timing Interact in STDP - A Unified Model. Frontiers in Synaptic Neuroscience. 2010;2:25. doi: 10.3389/fnsyn.2010.00025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Cohen JD, Bolstad M, Lee AK. Experience-dependent shaping of hippocampal CA1 intracellular activity in novel and familiar environments. eLife. 2017;6:e23040. doi: 10.7554/eLife.23040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Cone I, Shouval HZ. Behavioral Time Scale Plasticity of Place Fields: Mathematical Analysis. Frontiers in Computational Neuroscience. 2021;15:640235. doi: 10.3389/fncom.2021.640235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Cooper LN, Bear MF. The BCM theory of synapse modification at 30: interaction of theory with experiment. Nature Reviews. Neuroscience. 2012;13:798–810. doi: 10.1038/nrn3353. [DOI] [PubMed] [Google Scholar]
  26. Diamantaki M, Coletta S, Nasr K, Zeraati R, Laturnus S, Berens P, Preston-Ferrer P, Burgalossi A. Manipulating Hippocampal Place Cell Activity by Single-Cell Stimulation in Freely Moving Mice. Cell Reports. 2018;23:32–38. doi: 10.1016/j.celrep.2018.03.031. [DOI] [PubMed] [Google Scholar]
  27. Dupret D, O’Neill J, Pleydell-Bouverie B, Csicsvari J. The reorganization and reactivation of hippocampal maps predict spatial memory performance. Nature Neuroscience. 2010;13:995–1002. doi: 10.1038/nn.2599. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Frey U, Morris RG. Synaptic tagging and long-term potentiation. Nature. 1997;385:533–536. doi: 10.1038/385533a0. [DOI] [PubMed] [Google Scholar]
  29. Froemke RC, Poo MM, Dan Y. Spike-timing-dependent synaptic plasticity depends on dendritic location. Nature. 2005;434:221–225. doi: 10.1038/nature03366. [DOI] [PubMed] [Google Scholar]
  30. Fyhn M, Hafting T, Treves A, Moser MB, Moser EI. Hippocampal remapping and grid realignment in entorhinal cortex. Nature. 2007;446:190–194. doi: 10.1038/nature05601. [DOI] [PubMed] [Google Scholar]
  31. Gauthier JL, Tank DW. A Dedicated Population for Reward Coding in the Hippocampus. Neuron. 2018;99:179–193. doi: 10.1016/j.neuron.2018.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Geiller T, Fattahi M, Choi JS, Royer S. Place cells are more strongly tied to landmarks in deep than in superficial CA1. Nature Communications. 2017;8:14531. doi: 10.1038/ncomms14531. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Gerstner W, Lehmann M, Liakoni V, Corneil D, Brea J. Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules. Frontiers in Neural Circuits. 2018;12:53. doi: 10.3389/fncir.2018.00053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Golding NL, Staff NP, Spruston N. Dendritic spikes as a mechanism for cooperative long-term potentiation. Nature. 2002;418:326–331. doi: 10.1038/nature00854. [DOI] [PubMed] [Google Scholar]
  35. Golding NL, Mickus TJ, Katz Y, Kath WL, Spruston N. Factors mediating powerful voltage attenuation along CA1 pyramidal neuron dendrites. The Journal of Physiology. 2005;568:69–82. doi: 10.1113/jphysiol.2005.086793. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Graupner M, Brunel N. STDP in a bistable synapse model based on CaMKII and associated signaling pathways. PLOS Computational Biology. 2007;3:e221. doi: 10.1371/journal.pcbi.0030221. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Graupner M, Brunel N. Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location. PNAS. 2012;109:3991–3996. doi: 10.1073/pnas.1109359109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Grienberger C, Milstein AD, Bittner KC, Romani S, Magee JC. Inhibitory suppression of heterogeneously tuned excitation enhances spatial coding in CA1 place cells. Nature Neuroscience. 2017;20:417–426. doi: 10.1038/nn.4486. [DOI] [PubMed] [Google Scholar]
  39. Guerguiev J, Lillicrap TP, Richards BA. Towards deep learning with segregated dendrites. eLife. 2017;6:e22901. doi: 10.7554/eLife.22901. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Harnett MT, Makara JK, Spruston N, Kath WL, Magee JC. Synaptic amplification by dendritic spines enhances input cooperativity. Nature. 2012;491:599–602. doi: 10.1038/nature11554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Harvey CD, Collman F, Dombeck DA, Tank DW. Intracellular dynamics of hippocampal place cells during virtual navigation. Nature. 2009;461:941–946. doi: 10.1038/nature08499. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. He K, Huertas M, Hong SZ, Tie X, Hell JW, Shouval H, Kirkwood A. Distinct Eligibility Traces for LTP and LTD in Cortical Synapses. Neuron. 2015;88:528–538. doi: 10.1016/j.neuron.2015.09.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Hengen KB, Torrado Pacheco A, McGregor JN, Van Hooser SD, Turrigiano GG. Neuronal Firing Rate Homeostasis Is Inhibited by Sleep and Promoted by Wake. Cell. 2016;165:180–191. doi: 10.1016/j.cell.2016.01.046. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Herring BE, Nicoll RA. Long-Term Potentiation: From CaMKII to AMPA Receptor Trafficking. Annual Review of Physiology. 2016;78:351–365. doi: 10.1146/annurev-physiol-021014-071753. [DOI] [PubMed] [Google Scholar]
  45. Hill AJ. First occurrence of hippocampal spatial firing in a new environment. Experimental Neurology. 1978;62:282–297. doi: 10.1016/0014-4886(78)90058-4. [DOI] [PubMed] [Google Scholar]
  46. Hollup SA, Molden S, Donnett JG, Moser MB, Moser EI. Accumulation of hippocampal place fields at the goal location in an annular watermaze task. The Journal of Neuroscience. 2001;21:1635–1644. doi: 10.1523/JNEUROSCI.21-05-01635.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Inglebert Y, Aljadeff J, Brunel N, Debanne D. Synaptic plasticity rules with physiological calcium levels. PNAS. 2020;117:33639–33648. doi: 10.1073/pnas.2013663117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Jacob V, Brasier DJ, Erchova I, Feldman D, Shulz DE. Spike timing-dependent synaptic depression in the in vivo barrel cortex of the rat. The Journal of Neuroscience. 2007;27:1271–1284. doi: 10.1523/JNEUROSCI.4264-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Jarsky T, Roxin A, Kath WL, Spruston N. Conditional dendritic spike propagation following distal synaptic activation of hippocampal CA1 pyramidal neurons. Nature Neuroscience. 2005;8:1667–1676. doi: 10.1038/nn1599. [DOI] [PubMed] [Google Scholar]
  50. Jedlicka P, Benuskova L, Abraham WC. A Voltage-Based STDP Rule Combined with Fast BCM-Like Metaplasticity Accounts for LTP and Concurrent “Heterosynaptic” LTD in the Dentate Gyrus In Vivo. PLOS Computational Biology. 2015;11:e1004588. doi: 10.1371/journal.pcbi.1004588. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Jezek K, Henriksen EJ, Treves A, Moser EI, Moser MB. Theta-paced flickering between place-cell maps in the hippocampus. Nature. 2011;478:246–249. doi: 10.1038/nature10439. [DOI] [PubMed] [Google Scholar]
  52. Keck T, Toyoizumi T, Chen L, Doiron B, Feldman DE, Fox K, Gerstner W, Haydon PG, Hübener M, Lee H-K, Lisman JE, Rose T, Sengpiel F, Stellwagen D, Stryker MP, Turrigiano GG, van Rossum MC. Integrating Hebbian and homeostatic plasticity: the current state of the field and future research directions. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2017;372:20160158. doi: 10.1098/rstb.2016.0158. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Koester HJ, Sakmann B. Calcium dynamics in single spines during coincident pre- and postsynaptic activity depend on relative timing of back-propagating action potentials and subthreshold excitatory postsynaptic potentials. PNAS. 1998;95:9596–9601. doi: 10.1073/pnas.95.16.9596. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Lee JS, Briguglio JJ, Cohen JD, Romani S, Lee AK. The Statistical Structure of the Hippocampal Code for Space as a Function of Time, Context, and Value. Cell. 2020;183:620–635. doi: 10.1016/j.cell.2020.09.024. [DOI] [PubMed] [Google Scholar]
  55. Leutgeb S, Leutgeb JK, Barnes CA, Moser EI, McNaughton BL, Moser M-B. Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science. 2005;309:619–623. doi: 10.1126/science.1114037. [DOI] [PubMed] [Google Scholar]
  56. Lever C, Wills T, Cacucci F, Burgess N, O’Keefe J. Long-term plasticity in hippocampal place-cell representation of environmental geometry. Nature. 2002;416:90–94. doi: 10.1038/416090a. [DOI] [PubMed] [Google Scholar]
  57. Lillicrap TP, Santoro A, Marris L, Akerman CJ, Hinton G. Backpropagation and the brain. Nature Reviews. Neuroscience. 2020;21:335–346. doi: 10.1038/s41583-020-0277-3. [DOI] [PubMed] [Google Scholar]
  58. Lovett-Barron M, Turi GF, Kaifosh P, Lee PH, Bolze F, Sun X-H, Nicoud J-F, Zemelman BV, Sternson SM, Losonczy A. Regulation of neuronal input transformations by tunable dendritic inhibition. Nature Neuroscience. 2012;15:423–430. doi: 10.1038/nn.3024. [DOI] [PubMed] [Google Scholar]
  59. Lynch GS, Dunwiddie T, Gribkoff V. Heterosynaptic depression: a postsynaptic correlate of long-term potentiation. Nature. 1977;266:737–739. doi: 10.1038/266737a0. [DOI] [PubMed] [Google Scholar]
  60. Magee JC, Johnston D. A synaptically controlled, associative signal for Hebbian plasticity in hippocampal neurons. Science. 1997;275:209–213. doi: 10.1126/science.275.5297.209. [DOI] [PubMed] [Google Scholar]
  61. Magee JC. Dendritic hyperpolarization-activated currents modify the integrative properties of hippocampal CA1 pyramidal neurons. The Journal of Neuroscience. 1998;18:7613–7624. doi: 10.1523/JNEUROSCI.18-19-07613.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Magee JC, Grienberger C. Synaptic Plasticity Forms and Functions. Annual Review of Neuroscience. 2020;43:95–117. doi: 10.1146/annurev-neuro-090919-022842. [DOI] [PubMed] [Google Scholar]
  63. Malinow R, Miller JP. Postsynaptic hyperpolarization during conditioning reversibly blocks induction of long-term potentiation. Nature. 1986;320:529–530. doi: 10.1038/320529a0. [DOI] [PubMed] [Google Scholar]
  64. Mansuy IM. Calcineurin in memory and bidirectional plasticity. Biochemical and Biophysical Research Communications. 2003;311:1195–1208. doi: 10.1016/j.bbrc.2003.10.046. [DOI] [PubMed] [Google Scholar]
  65. Markram H, Lübke J, Frotscher M, Sakmann B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science. 1997;275:213–215. doi: 10.1126/science.275.5297.213. [DOI] [PubMed] [Google Scholar]
  66. Mehta MR, Barnes CA, McNaughton BL. Experience-dependent, asymmetric expansion of hippocampal place fields. PNAS. 1997;94:8918–8921. doi: 10.1073/pnas.94.16.8918. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Mehta MR. Cooperative LTP can map memory sequences on dendritic branches. Trends in Neurosciences. 2004;27:69–72. doi: 10.1016/j.tins.2003.12.004. [DOI] [PubMed] [Google Scholar]
  68. Mehta MR. From synaptic plasticity to spatial maps and sequence learning. Hippocampus. 2015;25:756–762. doi: 10.1002/hipo.22472. [DOI] [PubMed] [Google Scholar]
  69. Mendez P, Stefanelli T, Flores CE, Muller D, Lüscher C. Homeostatic Plasticity in the Hippocampus Facilitates Memory Extinction. Cell Reports. 2018;22:1451–1461. doi: 10.1016/j.celrep.2018.01.025. [DOI] [PubMed] [Google Scholar]
  70. Migliore M, Hoffman DA, Magee JC, Johnston D. Role of an A-type K+ conductance in the back-propagation of action potentials in the dendrites of hippocampal pyramidal neurons. Journal of Computational Neuroscience. 1999;7:5–15. doi: 10.1023/a:1008906225285. [DOI] [PubMed] [Google Scholar]
  71. Milstein AD, Bloss EB, Apostolides PF, Vaidya SP, Dilly GA, Zemelman BV, Magee JC. Inhibitory Gating of Input Comparison in the CA1 Microcircuit. Neuron. 2015;87:1274–1289. doi: 10.1016/j.neuron.2015.08.025. [DOI] [PubMed] [Google Scholar]
  72. Milstein AD. Code repository for computational model of bidirectional behavioral timescale plasticity in hippocampal CA1 place cells. 952cbb4Github. 2021a http://github.com/neurosutras/BTSP
  73. Milstein AD. Code repository for nested: parallel multi-objective optimization software. 509e16cGithub. 2021b https://github.com/neurosutras/nested
  74. Milstein AD. BTSP. swh1rev952cbb453ae80b2efe52f2936baa03e3a4689dc5Software Heritage. 2021c https://archive.softwareheritage.org/swh:1:dir:cda92d64e4759766b3860371e6bd87a13f302768;origin=https://github.com/neurosutras/BTSP;visit=swh:1:snp:93f4e56542da6f05ab3ed2f7419b6b3335be934c;anchor=swh:1:rev:952cbb453ae80b2efe52f2936baa03e3a4689dc5
  75. Mizuseki K, Royer S, Diba K, Buzsáki G. Activity dynamics and behavioral correlates of CA3 and CA1 hippocampal pyramidal neurons. Hippocampus. 2012;22:1659–1680. doi: 10.1002/hipo.22002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Monaco JD, Rao G, Roth ED, Knierim JJ. Attentive scanning behavior drives one-trial potentiation of hippocampal place fields. Nature Neuroscience. 2014;17:725–731. doi: 10.1038/nn.3687. [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Muller RU, Kubie JL. The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. The Journal of Neuroscience. 1987;7:1951–1968. doi: 10.1523/JNEUROSCI.07-07-01951.1987. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Muller SZ, Zadina AN, Abbott LF, Sawtell NB. Continual Learning in a Multi-Layer Network of an Electric Fish. Cell. 2019;179:1382–1392. doi: 10.1016/j.cell.2019.10.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Nakazawa K, McHugh TJ, Wilson MA, Tonegawa S. NMDA receptors, place cells and hippocampal spatial memory. Nature Reviews. Neuroscience. 2004;5:361–372. doi: 10.1038/nrn1385. [DOI] [PubMed] [Google Scholar]
  80. Oja E. A simplified neuron model as a principal component analyzer. Journal of Mathematical Biology. 1982;15:267–273. doi: 10.1007/BF00275687. [DOI] [PubMed] [Google Scholar]
  81. O’Keefe J, Conway DH. Hippocampal place units in the freely moving rat: why they fire where they fire. Experimental Brain Research. 1978;31:573–590. doi: 10.1007/BF00239813. [DOI] [PubMed] [Google Scholar]
  82. Palmer L, Murayama M, Larkum M. Inhibitory Regulation of Dendritic Activity in vivo. Frontiers in Neural Circuits. 2012;6:26. doi: 10.3389/fncir.2012.00026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  83. Payeur A, Guerguiev J, Zenke F, Richards B, Naud R. Burst-Dependent Synaptic Plasticity Can Coordinate Learning in Hierarchical Circuits. bioRxiv. 2020 doi: 10.1101/2020.03.30.015511. [DOI] [PubMed]
  84. Pi H-J, Hangya B, Kvitsiani D, Sanders JI, Huang ZJ, Kepecs A. Cortical interneurons that specialize in disinhibitory control. Nature. 2013;503:521–524. doi: 10.1038/nature12676. [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Rasmussen CE, Williams CKI. Gaussian Processes for Machine Learning. Adaptive Computation and Machine Learning. MIT Press; 2006. [Google Scholar]
  86. Richards BA, Lillicrap TP. Dendritic solutions to the credit assignment problem. Current Opinion in Neurobiology. 2019a;54:28–36. doi: 10.1016/j.conb.2018.08.003. [DOI] [PubMed] [Google Scholar]
  87. Richards BA, Lillicrap TP, Beaudoin P, Bengio Y, Bogacz R, Christensen A, Clopath C, Costa RP, de Berker A, Ganguli S, Gillon CJ, Hafner D, Kepecs A, Kriegeskorte N, Latham P, Lindsay GW, Miller KD, Naud R, Pack CC, Poirazi P, Roelfsema P, Sacramento J, Saxe A, Scellier B, Schapiro AC, Senn W, Wayne G, Yamins D, Zenke F, Zylberberg J, Therien D, Kording KP. A deep learning framework for neuroscience. Nature Neuroscience. 2019b;22:1761–1770. doi: 10.1038/s41593-019-0520-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  88. Royer S, Zemelman BV, Losonczy A, Kim J, Chance F, Magee JC, Buzsáki G. Control of timing, rate and bursts of hippocampal place cells by dendritic and somatic inhibition. Nature Neuroscience. 2012;15:769–775. doi: 10.1038/nn.3077. [DOI] [PMC free article] [PubMed] [Google Scholar]
  89. Sacramento J. Advances in Neural Information Processing Systems. MIT Press; 2018. [Google Scholar]
  90. Sajikumar S, Frey JU. Late-associativity, synaptic tagging, and the role of dopamine during LTP and LTD. Neurobiology of Learning and Memory. 2004;82:12–25. doi: 10.1016/j.nlm.2004.03.003. [DOI] [PubMed] [Google Scholar]
  91. Schiller J, Schiller Y. NMDA receptor-mediated dendritic spikes and coincident signal amplification. Current Opinion in Neurobiology. 2001;11:343–348. doi: 10.1016/s0959-4388(00)00217-8. [DOI] [PubMed] [Google Scholar]
  92. Schulz JM, Redgrave P, Reynolds JNJ. Cortico-striatal spike-timing dependent plasticity after activation of subcortical pathways. Frontiers in Synaptic Neuroscience. 2010;2:23. doi: 10.3389/fnsyn.2010.00023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  93. Sheffield MEJ, Adoff MD, Dombeck DA. Increased Prevalence of Calcium Transients across the Dendritic Arbor during Place Field Formation. Neuron. 2017;96:490–504. doi: 10.1016/j.neuron.2017.09.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  94. Shouval HZ, Wang SS-H, Wittenberg GM. Spike timing dependent plasticity: a consequence of more fundamental learning rules. Frontiers in Computational Neuroscience. 2010;4:19. doi: 10.3389/fncom.2010.00019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  95. Sjöström PJ, Rancz EA, Roth A, Häusser M. Dendritic excitability and synaptic plasticity. Physiological Reviews. 2008;88:769–840. doi: 10.1152/physrev.00016.2007. [DOI] [PubMed] [Google Scholar]
  96. Song S, Miller KD, Abbott LF. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neuroscience. 2000;3:919–926. doi: 10.1038/78829. [DOI] [PubMed] [Google Scholar]
  97. Stachenfeld KL, Botvinick MM, Gershman SJ. The hippocampus as a predictive map. Nature Neuroscience. 2017;20:1643–1653. doi: 10.1038/nn.4650. [DOI] [PubMed] [Google Scholar]
  98. Stefanelli T, Bertollini C, Lüscher C, Muller D, Mendez P. Hippocampal Somatostatin Interneurons Control the Size of Neuronal Memory Ensembles. Neuron. 2016;89:1074–1085. doi: 10.1016/j.neuron.2016.01.024. [DOI] [PubMed] [Google Scholar]
  99. Stuart GJ, Häusser M. Dendritic coincidence detection of EPSPs and action potentials. Nature Neuroscience. 2001;4:63–71. doi: 10.1038/82910. [DOI] [PubMed] [Google Scholar]
  100. Takahashi H, Magee JC. Pathway interactions and synaptic plasticity in the dendritic tuft regions of CA1 pyramidal neurons. Neuron. 2009;62:102–111. doi: 10.1016/j.neuron.2009.03.007. [DOI] [PubMed] [Google Scholar]
  101. Titley HK, Brunel N, Hansel C. Toward a Neurocentric View of Learning. Neuron. 2017;95:19–32. doi: 10.1016/j.neuron.2017.05.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  102. Turi GF, Li WK, Chavlis S, Pandi I, O’Hare J, Priestley JB, Grosmark AD, Liao Z, Ladow M, Zhang JF, Zemelman BV, Poirazi P, Losonczy A. Vasoactive Intestinal Polypeptide-Expressing Interneurons in the Hippocampus Support Goal-Oriented Spatial Learning. Neuron. 2019;101:1150–1165. doi: 10.1016/j.neuron.2019.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  103. Turrigiano GG, Nelson SB. Homeostatic plasticity in the developing nervous system. Nature Reviews. Neuroscience. 2004;5:97–107. doi: 10.1038/nrn1327. [DOI] [PubMed] [Google Scholar]
  104. Tyan L, Chamberland S, Magnin E, Camiré O, Francavilla R, David LS, Deisseroth K, Topolnik L. Dendritic inhibition provided by interneuron-specific cells controls the firing rate and timing of the hippocampal feedback inhibitory circuitry. The Journal of Neuroscience. 2014;34:4534–4547. doi: 10.1523/JNEUROSCI.3813-13.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  105. Xu N, Harnett MT, Williams SR, Huber D, O’Connor DH, Svoboda K, Magee JC. Nonlinear dendritic integration of sensory and motor input during an active sensing task. Nature. 2012;492:247–251. doi: 10.1038/nature11601. [DOI] [PubMed] [Google Scholar]
  106. Yagishita S, Hayashi-Takagi A, Ellis-Davies GCR, Urakubo H, Ishii S, Kasai H. A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science. 2014;345:1616–1620. doi: 10.1126/science.1255514. [DOI] [PMC free article] [PubMed] [Google Scholar]
  107. Yang SN, Tang YG, Zucker RS. Selective induction of LTP and LTD by postsynaptic [Ca2+]i elevation. Journal of Neurophysiology. 1999;81:781–787. doi: 10.1152/jn.1999.81.2.781. [DOI] [PubMed] [Google Scholar]
  108. Zaremba JD, Diamantopoulou A, Danielson NB, Grosmark AD, Kaifosh PW, Bowler JC, Liao Z, Sparks FT, Gogos JA, Losonczy A. Impaired hippocampal place cell dynamics in a mouse model of the 22q11.2 deletion. Nature Neuroscience. 2017;20:1612–1623. doi: 10.1038/nn.4634. [DOI] [PMC free article] [PubMed] [Google Scholar]
  109. Zenke F, Hennequin G, Gerstner W. Synaptic plasticity in neural networks needs homeostasis with a fast rate detector. PLOS Computational Biology. 2013;9:e1003330. doi: 10.1371/journal.pcbi.1003330. [DOI] [PMC free article] [PubMed] [Google Scholar]
  110. Zhao X, Wang Y, Spruston N, Magee JC. Membrane potential dynamics underlying context-dependent sensory responses in the hippocampus. Nature Neuroscience. 2020;23:881–891. doi: 10.1038/s41593-020-0646-2. [DOI] [PubMed] [Google Scholar]
  111. Ziv Y, Burns LD, Cocker ED, Hamel EO, Ghosh KK, Kitch LJ, El Gamal A, Schnitzer MJ. Long-term dynamics of CA1 hippocampal place codes. Nature Neuroscience. 2013;16:264–266. doi: 10.1038/nn.3329. [DOI] [PMC free article] [PubMed] [Google Scholar]

Editor's evaluation

Katalin Toth 1

This manuscript uses a combination of high-quality in vivo electrophysiology and modelling to demonstrate that Behavioural Time Scale Plasticity (BTSP) is bidirectional, and the amplitude and direction of this plasticity are dictated by the current weight of the inputs and not by the correlated activity of pairs of neurons. These findings challenge our current views on synaptic plasticity, which are primarily based on Hebb's concept. In addition, the network model used in this study demonstrates that this type of plasticity can rapidly reshape population activity to respond to environmental clues. This study will be of interest to the broad neuroscience audience and foster new ideas on biological and artificial learning.

Decision letter

Editor: Katalin Toth1
Reviewed by: Jerome Epsztein2, Richard Naud3

Our editorial process produces two outputs: (i) public reviews designed to be posted alongside the preprint for the benefit of readers; (ii) feedback on the manuscript for the authors, including requests for revisions, shown below. We also include an acceptance summary that explains what the editors found interesting or important about the work.

Decision letter after peer review:

Thank you for submitting your article "Bidirectional synaptic plasticity rapidly modifies hippocampal representations" for consideration by eLife. Your article has been reviewed by 3 peer reviewers, and the evaluation has been overseen by a Reviewing Editor and Laura Colgin as the Senior Editor. The following individuals involved in review of your submission have agreed to reveal their identity: Jerome Epsztein (Reviewer #1); Richard Naud (Reviewer #2); Larry F Abbott (Reviewer #3).

The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.

Essential revisions:

The reviewers unanimously expressed their support for this manuscript. Their comments will help the authors to improve the clarity of the manuscript. The changes suggested by the reviewers do not require the authors to do additional experiments.

Reviewers' comments detail the points of improvement.

1. Please provide more details of the BTSP procedures and the behaviour of the mice.

2. Please elaborate on the rationale behind experiments depicted on Figure 2E, 3 and 4.

3. Please improve the clarity of data depicted on Figure 3D and 6A.

4. Please consider Rev.#2's comments on the approach of the computational section.

5. Please address questions raised about W and Winit.

Reviewer #2 (Recommendations for the authors):

There are two parts to this article. One experimental part and one computational modelling part. My opinion of the experimental part is that it is very carefully done with impressive, compelling (and difficult!) experiments. The results are at first glance extremely perplexing, but the interpretation and follow-up experiments are clarifying a lot. In this respect, the manuscript is much improved over the biorxiv version I had read a year ago. My only note on the experimental part is that the p-value threshold for Figure 4 C and F used for denoting might have a bit of a higher rate of false positive because every time point would be considered as a comparison. This would be correctable by Bonferroni factors, but honestly, I don't think it is entirely necessary since there is a bit of ambiguity as to what hypothesis is being tested.

The computational part is compelling for the success of reproducing the data with a model that is intrinsically stable. I think the writing could be improved without too much work, focusing on two points.

The theory section was going deep in the implementation details. A level of depth that is uncommon for the main results part of a broad audience paper. I would suggest keeping the learning rule and maybe one or two crucial equations, but relegating many of the equations to the methods. For instance the linear ODE for the traces are so common that defining trace as a linear ODE or mono-exponential decay would be sufficient (if the equation remains in methods). Similar for the integration of the dW/dt over a trial. I want to stress that this is a stylistic point that I believe will help communicate the message, not something required for accepting the paper. Another stylistic point is the use of two-letter variables along with two conventions for multiplications (the Asterix and nothing as when tau multiples d λ /dt). I was also confused by the use of Winit in Equation 3, which in my view should be W (no init) all the time.

The results rely crucially less of the fact that q+ and q- are nonlinear than on the fact that the nonlinearities are different. This should be clear from the fixed point analysis: consider Equation 8 with q+=q- and you find that the fixed point is independent of timing even for nonlinear relationships. This can also be revealed when looking at the parameter values: the LTP term has a sigmoid with a small sensitivity (β+), a large threshold (α+) and a large saturating point (k+). The converse is true for the LTD term. Thus plotting the sigmoidal for each term should explain the Mexican hat: for a strong W, when the coincidence is very small, you only may only have a weak q+ effect (because the sensitivity difference). When the coincidence is medium, LTD dominates over LTP because q- sharp threshold has been met without having reached the saturation of q+. When coincidence is strong q+ dominates because k+ is larger than k- (and both sigmoids have saturated). All this depends on W of course. Personally, I would have liked to see q+ and q- plotted, and how they combine to give the Mexican hat (or not). As in Figure 5B but showing q+ and q- in addition. With respect to Figure 5B, the absence of potentiation at high coincidence IS*ET for the high W case is puzzling. Why is this not showing? W is not high enough? q+ should dominate in that regime.

Other notes. These are more comments which may or may not help rather than points to be addressed.

I would like to point that the plasticity model fits partially well with the model used in the recent paper by Payeur et al. 2021. In that paper, the bursts caused a potentiation that depended on previous potentiation (dependency on W). But that model had a very limited timing dependence and bursts would only lead to net LTD if they were not numerous enough relative to the number of spikes. Overall, a comparison with this model suggests that the BTSP model provided by Milstein et al. could be consistent with a coordination of plasticity, as acknowledged by the authors at the end of the discussion.

The model is also partially related with the model of Graupner,.… Brunel. Recently used to capture STDP phenomena by Aljadeff… Debanne. There, two threshold are present, one for LTP and one for LTD. So similar to the α+ and α- being different. But the dependence in that model is very limited.

I thought the description of how W was kept between 1 and Wmax was lacking. There are multiple ways of doing this. And the different types of implementation (hard threshold vs soft threshold) have been shown to lead to dramatically different functions in the STDP modelling literature.

I think there is a typo in the list of parameters given at the end as I don't find τIS and τET, but only τI and τE.

Reviewer #3 (Recommendations for the authors):

This paper is beautifully done and well written. I have just a few suggestions:

1) It seems a pity that after elegantly formulating a model of BTSP, the authors final formulation of the synaptic change in Equations 3 and 4 is ill-defined. This is because the relationship between W and Winit is not specified. Wouldn't a proper formulation state that Winit = W, equation 3 does not describe dW/dt but rather a factor that determines ΔW through Equation 4, and that this latter process only takes place after a delay?

Alternatively, could Winit in the equation for dW/dt just be set to W? This would have the nice property of keeping W bounded between 0 and Wmax. Does this not work?

eLife. 2021 Dec 9;10:e73046. doi: 10.7554/eLife.73046.sa2

Author response


Essential revisions:

The reviewers unanimously expressed their support for this manuscript. Their comments will help the authors to improve the clarity of the manuscript. The changes suggested by the reviewers do not require the authors to do additional experiments.

Reviewers' comments detail the points of improvement.

1. Please provide more details of the BTSP procedures and the behaviour of the mice.

2. Please elaborate on the rationale behind experiments depicted on Figure 2E, 3 and 4.

The Reviewers raised the following important questions (paraphrased):

1) How variable were the number of plasticity induction trials used across animals, and in particular were different numbers of plateaus used for each induction when multiple inductions were performed in the same neuron?

2) How consistent was the running behavior of the mice during plasticity induction by experimentally-evoked dendritic plateau potentials? How does this affect analysis of the timescale of plasticity?

We have now included additional details in a new Figure 1—figure supplement 1, and have revised the Materials and methods section accordingly.

3. Please improve the clarity of data depicted on Figure 3D and 6A.

Please find our responses in line with the comments from Reviewer #1 in the posted Public Review.

4. Please consider Rev.#2's comments on the approach of the computational section.

Please find our responses in line with the comments from Reviewer #2 below.

5. Please address questions raised about W and Winit.

Please find our responses in line with the comments from Reviewer #3 below.

Reviewer #2 (Recommendations for the authors):

There are two parts to this article. One experimental part and one computational modelling part. My opinion of the experimental part is that it is very carefully done with impressive, compelling (and difficult!) experiments. The results are at first glance extremely perplexing, but the interpretation and follow-up experiments are clarifying a lot. In this respect, the manuscript is much improved over the biorxiv version I had read a year ago. My only note on the experimental part is that the p-value threshold for Figure 4 C and F used for denoting might have a bit of a higher rate of false positive because every time point would be considered as a comparison. This would be correctable by Bonferroni factors, but honestly, I don't think it is entirely necessary since there is a bit of ambiguity as to what hypothesis is being tested.

We agree that a false discovery rate correction (FDR) could be used here to adjust for repeated comparisons across time bins and groups. However, the hypothesis was that voltage-perturbations would change the sign of plasticity. Overall, hyperpolarization did not convert depression into potentiation, and depolarization did not convert potentiation into depression. Here we label temporal bins that showed a significant change in the amplitude (but not the direction) of plasticity. A high discovery rate is actually conservative in this case. We prefer to leave this analysis as such.

The computational part is compelling for the success of reproducing the data with a model that is intrinsically stable. I think the writing could be improved without too much work, focusing on two points.

The theory section was going deep in the implementation details. A level of depth that is uncommon for the main results part of a broad audience paper. I would suggest keeping the learning rule and maybe one or two crucial equations, but relegating many of the equations to the methods. For instance the linear ODE for the traces are so common that defining trace as a linear ODE or mono-exponential decay would be sufficient (if the equation remains in methods). Similar for the integration of the dW/dt over a trial. I want to stress that this is a stylistic point that I believe will help communicate the message, not something required for accepting the paper.

The recommended changes have been made (P15 – P16).

Another stylistic point is the use of two-letter variables along with two conventions for multiplications (the Asterix and nothing as when tau multiples d λ /dt). I was also confused by the use of Winit in Equation 3, which in my view should be W (no init) all the time.

The recommended changes have been made (P16, L392). Please also see our response to the comments of Reviewer #3 below regarding the use of Winit.

The results rely crucially less of the fact that q+ and q- are nonlinear than on the fact that the nonlinearities are different. This should be clear from the fixed point analysis: consider Equation 8 with q+=q- and you find that the fixed point is independent of timing even for nonlinear relationships. This can also be revealed when looking at the parameter values: the LTP term has a sigmoid with a small sensitivity (β+), a large threshold (α+) and a large saturating point (k+). The converse is true for the LTD term. Thus plotting the sigmoidal for each term should explain the Mexican hat: for a strong W, when the coincidence is very small, you only may only have a weak q+ effect (because the sensitivity difference). When the coincidence is medium, LTD dominates over LTP because q- sharp threshold has been met without having reached the saturation of q+. When coincidence is strong q+ dominates because k+ is larger than k- (and both sigmoids have saturated). All this depends on W of course. Personally, I would have liked to see q+ and q- plotted, and how they combine to give the Mexican hat (or not).

To address this point, we have now added to Figure 5B a third example of dW/dt for intermediate synaptic weights which shows a Mexican hat sensitivity to signal overlap. We have now also added the following text to the Results section:

P16, L405: “If the depression process q- has a lower threshold for activation than the potentiation process q+ (61, 62), the resulting change in synaptic weight dW/dt is positive and increases monotonically when initial weights are low, but is negative and non-monotonic when initial weights are high (Figure 5B). […] This is consistent with the in vivo data, which showed that negative changes in place field ramp Vm were largest at intermediate delays from a plateau (Figures 3B and 3I).”

As in Figure 5B but showing q+ and q- in addition. With respect to Figure 5B, the absence of potentiation at high coincidence IS*ET for the high W case is puzzling. Why is this not showing? W is not high enough? q+ should dominate in that regime.

Consulting Equation 1 (P16, L392), when W is large and close to Wmax, the potentiation term vanishes, and there can be no potentiation, only depression, regardless of the amplitude of signal overlap. We now clarify this point with the following text:

P16, L394: “This formula can be obtained from a two-state model of finite synaptic resources (see Materials and methods). When the current synaptic weight W is near Wmax, the potentiation rate becomes zero, and when W is near zero, the depression rate becomes zero.”

Other notes. These are more comments which may or may not help rather than points to be addressed.

I would like to point that the plasticity model fits partially well with the model used in the recent paper by Payeur et al. 2021. In that paper, the bursts caused a potentiation that depended on previous potentiation (dependency on W). But that model had a very limited timing dependence and bursts would only lead to net LTD if they were not numerous enough relative to the number of spikes. Overall, a comparison with this model suggests that the BTSP model provided by Milstein et al. could be consistent with a coordination of plasticity, as acknowledged by the authors at the end of the discussion.

We had cited Payeur et al., in the context of implications for artificial learning systems. We have now added a citation in the context of objective-based learning through mismatch of local circuit output and target information relayed by long-range feedback (P24, L634). We agree that comparing and contrasting these models in detail would be very interesting, but perhaps a more appropriate place for this would be in a follow-up review article.

The model is also partially related with the model of Graupner,.… Brunel. Recently used to capture STDP phenomena by Aljadeff… Debanne. There, two threshold are present, one for LTP and one for LTD. So similar to the α+ and α- being different. But the dependence in that model is very limited.

We have now added the following citations in the context of the weight-dependent model and opposing plasticity processes (P16, L406):

Graupner M, Brunel N. STDP in a bistable synapse model based on CaMKII and associated signaling pathways. PLoS Comput Biol. Nov 2007;3(11):e221. doi:10.1371/journal.pcbi.0030221

Inglebert Y, Aljadeff J, Brunel N, Debanne D. Synaptic plasticity rules with physiological calcium levels. Proc Natl Acad Sci U S A. Dec 29 2020;117(52):33639-33648. doi:10.1073/pnas.2013663117

I thought the description of how W was kept between 1 and Wmax was lacking. There are multiple ways of doing this. And the different types of implementation (hard threshold vs soft threshold) have been shown to lead to dramatically different functions in the STDP modelling literature.

Please see our response to the comments of Reviewer #3 below.

I think there is a typo in the list of parameters given at the end as I don't find τIS and τET, but only τI and τE.

This oversight in the Materials and methods section has been fixed.

Reviewer #3 (Recommendations for the authors):

This paper is beautifully done and well written. I have just a few suggestions:

1) It seems a pity that after elegantly formulating a model of BTSP, the authors final formulation of the synaptic change in Equations 3 and 4 is ill-defined. This is because the relationship between W and Winit is not specified. Wouldn't a proper formulation state that Winit = W, Equation 3 does not describe dW/dt but rather a factor that determines ΔW through Equation 4, and that this latter process only takes place after a delay?

Alternatively, could Winit in the equation for dW/dt just be set to W? This would have the nice property of keeping W bounded between 0 and Wmax. Does this not work?

Indeed, in the two-state finite resource model that we had in mind, W is updated continuously in real-time, and is naturally bounded between 0 and Wmax. In practice, for simplicity and efficiency of computation during parameter optimization, we updated W only once per lap. We agree with the Reviewer that presenting the model in the context of this numerical approximation diluted the message. We have revised the Results section accordingly and have removed all instances of Winit. Figure 5 has been updated to show results obtained by updating W continuously. No change in parameters were necessary. We also regenerated Figure 6, keeping parameter values the same, but updating W continuously (Author response image 1). They are equivalent to those results obtained with the approximate method in the original Figure 6, which validates the original approach. As such, we have chosen not to regenerate or replace Figures 6, 7, Figure 6—figure supplements 1 and 2, or Figure 7—figure supplement 1.

Author response image 1.

Author response image 1.

We have also added the following text to the Materials and methods:P32, L862: “Changes in synaptic weight Wi were calculated by integrating the net rate of change of synaptic weight dWi/dt over the duration of plasticity induction. […] Equivalent results were obtained by updating Wi continuously in 10 ms steps without requiring any change in parameters.”

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Milstein AD, Li Y, Bittner KC, Grienberger C, Soltesz I, Magee JC, Romani S. 2021. Bidirectional synaptic plasticity rapidly modifies hippocampal representations. Github. neurosutras/BTSP [DOI] [PMC free article] [PubMed]

    Supplementary Materials

    Transparent reporting form

    Data Availability Statement

    The complete dataset and Python code for data analysis and model simulation is available at https://github.com/neurosutras/BTSP (Milstein, 2021c copy archived at swh:1:rev:952cbb453ae80b2efe52f2936baa03e3a4689dc5).

    The complete dataset, Python code for data analysis and model simulation, and additional MATLAB and Igor analysis scripts are available at https://github.com/neurosutras/BTSP (copy archived at swh:1:rev:952cbb453ae80b2efe52f2936baa03e3a4689dc5).

    The following dataset was generated:

    Milstein AD, Li Y, Bittner KC, Grienberger C, Soltesz I, Magee JC, Romani S. 2021. Bidirectional synaptic plasticity rapidly modifies hippocampal representations. Github. neurosutras/BTSP


    Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

    RESOURCES