Abstract
Fast learning designates the behavioral and neuronal mechanisms underlying the acquisition of a long-term memory trace after a unique and brief experience. As such it is opposed to incremental, slower reinforcement or procedural learning requiring repetitive training. This learning process, found in most animal species, exists in a large spectrum of natural behaviors, such as one-shot associative, spatial, or perceptual learning, and is a core principle of human episodic memory. We review here the neuronal and synaptic long-term changes associated with fast learning in mammals and discuss some hypotheses related to their underlying mechanisms. We first describe the variety of behavioral paradigms used to test fast learning memories: those preferentially involve a single and brief (from few hundred milliseconds to few minutes) exposures to salient stimuli, sufficient to trigger a long-lasting memory trace and new adaptive responses. We then focus on neuronal activity patterns observed during fast learning and the emergence of long-term selective responses, before documenting the physiological correlates of fast learning. In the search for the engrams of fast learning, a growing body of evidence highlights long-term changes in gene expression, structural, intrinsic, and synaptic plasticities. Finally, we discuss the potential role of the sparse and bursting nature of neuronal activity observed during the fast learning, especially in the induction plasticity mechanisms leading to the rapid establishment of long-term synaptic modifications. We conclude with more theoretical perspectives on network dynamics that could enable fast learning, with an overview of some theoretical approaches in cognitive neuroscience and artificial intelligence.
Keywords: fast learning, one-shot learning (OSL), memory engram, synaptic plasticity (LTP/LTD), neuromodulation, neurocomputational models, artificial intelligence
Fast Learning Behaviors
Fast learning mechanisms are best characterized in one-shot or single-trial learning paradigms which lead to memory formation after a single and brief (few hundred milliseconds to few minutes) exposure to relevant stimuli (Figures 1A–D). Indeed, what distinguishes fast learning are the features of the encoding stage (or learning experience): fast learning refers here to situations where memory traces are rapidly formed without requiring repetitions of the learning experience.
In animal models, a single exploration of a new place or novel objects can evoke long-lasting memories, as assessed in rodents using the delayed-matching-to-place task in a watermaze or novel object recognition (Ennaceur and Delacour, 1988; Steele and Morris, 1999; Nakazawa et al., 2003; Clarke et al., 2010). Paradigms using positive or negative reinforcement are also used to boost one-shot associative learning. Examples from rodents include odor-reward associations (Roullet et al., 1997; Armstrong et al., 2006), fear conditioning, and inhibitory avoidance tasks (Venable and Kelly, 1990; Izquierdo et al., 1997; Sacchetti et al., 2002; Vale et al., 2017) or conditioned taste aversion (CTA; Escobar et al., 2002). Positively reinforced one-shot learning of multiple visuomotor associations has also been reported in pigeons and baboons (Cook and Fagot, 2009).
In humans, episodic memory, referring to the formation and maintenance of memory traces of unique experiences, illustrates well fast learning. It should be noted that the existence of episodic memory in non-human mammals has remained controversial in the literature (Clayton et al., 2001; Fellini and Morellini, 2013). Behavioral tests in humans have focused on the familiarity and recollection components of episodic memory, using respectively forced recognition tasks (Standing et al., 1970; Rutishauser et al., 2006) and source memory tests (Jacoby, 1991; Harlow and Donaldson, 2013). One-shot associative learning can be used to test additional aspects of episodic memory, such as objects-place associations (Ison et al., 2015; Brodt et al., 2018). One-shot associative learning can also extend to more abstract representations and semantic memories, such as in learning new words (Carey and Bartlett, 1978), concepts, or object categories (Biederman, 1987).
Neuronal Activity During Fast Learning
In vivo recordings of spiking activity during a fast learning experience reveal sparse activity modulation and the occurrence of few bursting events (Figures 1E,F). During a ~1 s visual stimulation, few neurons from human or monkey anterior and medial temporal cortical lobes and basolateral amygdala (BLA) fire ~5–20 spikes (Messinger et al., 2001; Rutishauser et al., 2006; Ison et al., 2015). These brief presentations of a novel stimulation can however induce significant changes in neuronal activity lasting for at least 10 h (Fried et al., 1997; Xiang and Brown, 1998; Rutishauser et al., 2006) and even allow distinguishing between subjects having perceived the stimulus as a novel or familiar (Fried et al., 1997; Rutishauser et al., 2006). During active touch or passive sensing, sparse activity is also detected in the visual, somatosensory, and auditory cortices, with 0.5–5% of neurons increasing their firing rates in cats, ferrets, or rodents (Yao et al., 2007; Hromádka et al., 2008; Jadhav et al., 2009; O’Connor et al., 2010; Tang et al., 2018; Yoshida and Ohki, 2020; Figure 1E). Such sparse activity is accompanied by the emission of bursts in pyramidal cells, coupled to active dendritic events, in sensory cortices and in the hippocampus (Xu et al., 2012; Smith et al., 2013; Takahashi et al., 2016; Manita et al., 2017; Figure 1F). Moreover, a single presentation of a sensory stimulus induces short-term reverberatory patterns in spontaneous activity during at least a few minutes (Yao et al., 2007), and persistent changes in receptive fields, lasting for several hours (Fritz et al., 2003). Similarly, a single passage in a maze, inducing few bursting events (O’Keefe and Recce, 1993; Epsztein et al., 2011), leads to new stable place fields (Mehta et al., 2000; Bittner et al., 2017). After visuo- and odor-motor association fast learning tasks, long-lasting task-related responses emerge rapidly in the prefrontal cortex and striatum (Pasupathy and Miller, 2005; Cromer et al., 2011) and in the striatal olfactory tubercle (Millman and Murthy, 2020). Similar phenomena are observed in the auditory cortex during the very first fear conditioning trials (Edeline et al., 1993) or in the BLA-projecting neurons of the gustatory cortex after CTA (Lavi et al., 2018).
Altogether, despite the low number of spikes or bursting events, the induction of persistent selective responses can be initiated after a single or few stimulus presentations across the brain and thus serve as neural indicators of acquired memory traces.
Fast Learning-Induced Neuronal Long-Term Changes
Long-term changes have been reported subsequently to various fast learning tasks. In particular, some studies identified such long-term changes in cells activated during the learning experience, thus giving privileged access to understanding the nature of fast learning engrams, that are the set of “enduring physical and/or chemical changes elicited by learning and that underlie a newly formed memory” (Josselyn et al., 2015; Tonegawa et al., 2015; Josselyn and Tonegawa, 2020).
Fast Learning-Induced Structural, Synaptic, and Intrinsic Plasticity Changes
One-shot learning tasks can be sufficient to activate some immediate-early genes or cellular transcription factors in hippocampal, BLA, or cortical neurons (Radulovic et al., 1998; Sananbenesi et al., 2002; Miyashita et al., 2009; Liu et al., 2012; Fellini and Morellini, 2013; Tayler et al., 2013). Such markers, in conjunction with genetic manipulations, have been used to identify engram cells in fast learning tasks, by tracing active cells during memory encoding and reactivated cells during retrieval (Tayler et al., 2013; Denny et al., 2014; DeNardo et al., 2019), or by manipulating their activity (Han et al., 2009; Choi et al., 2011; Liu et al., 2012; Josselyn and Tonegawa, 2020).
Long-term structural and synaptic plasticity changes have been reported in subcortical areas after a fast learning experience and specifically linked to engram cells in fear conditioning protocols: in vivo measurements of field-EPSPs reveal long-term potentiation (LTP) in rat dentate gyrus during spatial exploration, and at CA3-CA1 synapses after novel object recognition or an inhibitory avoidance task in mice (Moser et al., 1993; Whitlock et al., 2006; Clarke et al., 2010). Pharmacological manipulations and ex vivo electrophysiology support these findings, through the observation of synaptic plasticity occlusion or the facilitation of plasticity induction under subthreshold stimulation protocols (Sacchetti et al., 2002; Nakazawa et al., 2003; Whitlock et al., 2006; Romberg et al., 2013). Furthermore, a single contextual fear conditioning induces a structural and functional potentiation between CA3 and CA1 engram cells, with increased spine size and number, and ex vivo LTP expression (Choi et al., 2018), as well as a presynaptic LTP between cortical inputs and BLA engram cells (Nonaka et al., 2014).
Long-term intrinsic plasticity changes are also evoked by a one-shot learning experience: hippocampal neurons activated by a single fear conditioning protocol become more excitable during several days, thus potentially facilitating subsequent learning (Crestani et al., 2018), and changes in membrane excitability correlate with freezing levels and can be reversed after a single extinction trial (McKay et al., 2009). Interestingly, the magnitude of the increase in membrane excitability is comparable to those reported after repeated trials of conditioning protocols (Moyer et al., 1996; Saar et al., 1998; Song et al., 2012; Sehgal et al., 2014).
Fast Learning Neocortical Engrams
While fast learning mechanisms have historically been associated to allocortical and subcortical areas (McClelland et al., 1995; Buschman and Miller, 2014), rapid formation of neocortical engrams have been uncovered in several fast learning tasks (Hofstetter et al., 2016; Kitamura et al., 2017; Brodt et al., 2018; Hebscher et al., 2019). First, the formation of neocortical engrams rapidly occurs in parallel to subcortical and allocortical changes and contributes to early system consolidation mechanisms: after a contextual fear conditioning, prefrontal neurons immediately engage in the formation of memory engrams, that progressively become functional with a maturation process requiring hippocampal and BLA inputs, and serve as long-lasting memory traces while hippocampal engram cells become silent during remote memory retrieval (Tayler et al., 2013; Kitamura et al., 2017; Matos et al., 2019). Furthermore, synaptic changes rapidly emerge in cortical-dependent one-shot learning tasks, such as after new word learning in human cortical areas involved in language and reading (Hofstetter et al., 2016), or in the perirhinal cortex during recognition memory (Brown and Banks, 2015). Also, after CTA, long-term actin rearrangements occur in gustatory and prelimbic cortices (Bi et al., 2010), and N-methyl-D-aspartate receptor (NMDAR)-mediated LTP at BLA-cortical synapses is occluded in vivo for at least 5 days (Escobar et al., 2002; Rodríguez-Durán et al., 2011).
These experiments suggest that the neural correlates of one-shot learning experience engage molecular machinery and cellular processes similar to those reported after repetitive training, such as the long-term activation of the same genetic markers, the establishment of long-term synaptic and structural changes, or the requirement for NMDA receptors. Yet, several questions remain to be elucidated, such as the modalities of induction and the extent (both in terms of magnitude and number of cells engaged) of fast learning-induced changes compared with repetitive training.
Deconstructing Fast Learning Synaptic Plasticity Mechanisms
In light of the aforementioned results and given the neuronal activity patterns observed during fast learning, we now present some hypotheses on the induction mechanisms of fast learning-induced synaptic changes. Two natural hypotheses ensue: fast learning could constitute a condensed version of synaptic events similar to those occurring during repetitive learning and/or fast learning could be enabled by intrinsically stronger synaptic events. In the former scenario, the difference between the two learning processes would lie in the sensitivity of plasticity induction, a factor that could be modulated by the initial state of the synapses (with for instance more or less available membrane voltage-gated channels) or the efficiency of neuromodulatory systems. In the latter scenario, fewer synaptic events may be needed to initiate long-term changes, such that a one-shot exposure may be sufficient to drive the formation of a memory trace. The excitability of the active cells and/or the activation of some specific membrane channels could promote the generation of larger events, such as amplificatory dendritic phenomena or larger post-synaptic responses leading to stronger calcium influx.
Due to the sparsity of direct links between neuronal activity and synaptic changes of engram cells, we mostly refer here to in vitro electrophysiological experiments using brief stimulation protocols, mimicking activity patterns observed during a fast learning experience, and capable of inducing long-term synaptic plasticity in randomly selected neurons (Figures 1G,H, 2). We also examine the impact of additional factors such as short-term intrinsic changes and neuromodulators. The following experiments provide first insights into the putative induction mechanisms, but further work is needed to apply similar protocols on to-be engram cells and link their artificially-induced long-term changes to learning, as well as to observe in vivo natural plasticity rules.
Induction of Long-Term Synaptic Plasticity Under Sparse and Burst Firing
Sparse Firing
Only a few spikes may be transmitted between neurons during a one-shot experience: this constraint could potentially conflict with the classic Hebbian framework requiring repetition or persistence of a given activity pattern to induce stable long-term synaptic plasticity (Hebb, 1949). Yet, in vitro studies demonstrate that few coincident activities can be sufficient to induce spike-timing-dependent plasticity (STDP) in several brain areas. No more than ~10–15 spike-EPSP pairings between L2/3 pyramidal cells of the visual cortex are sufficient to induce Hebbian LTP, while LTD induction requires ~30 spikes (Froemke et al., 2006), with classical induction STDP protocols relying on 75–150 pairings. Interestingly, LTP magnitude is not affected by adding more pairings, suggesting a potentially rapid memory acquisition through the induction of an abrupt all-or-none LTP in response to minimal stimulation, as observed at CA3-CA1 synapses (Petersen et al., 1998). Moreover, in striatal projecting neurons and in L5 pyramidal cells of the somatosensory cortex, in vitro STDP paradigms involving ~5–15 cortico-striatal pairings induce an endocannabinoid-mediated LTP (eCB-LTP; Cui et al., 2015, 2016, 2018a; Xu et al., 2018; Gangarossa et al., 2020; Figure 1G). This LTP disappears for 25–50 pairings, only to re-emerge at 75 pairings as an NMDAR-mediated LTP (NMDAR-LTP). Importantly, eCB-LTP is more robust to spike jittering compared to NMDAR-LTP, and can thus arise in a noisy environment (Cui et al., 2018b; Figure 1G). Such a phenomenon could be critical to fast learning since the reliability of spiking activity in response to sensory stimuli might not yet be fully established (Yao et al., 2007). Interestingly, a recent study establishes that transient (10 s to 5 min) neuronal activation as well as a 1-min presentation of flashing visual stimuli specifically activate the MAPK/ERK signaling, and are sufficient to induce the first wave of primary response genes (Tyssowski et al., 2018).
Burst and Active Dendritic Events
Since bursts are transmitted more efficiently than isolated spikes, they could increase the signal-to-noise ratio of the network information transmission, and therefore appear as a privileged signal for inducing long-term changes during fast learning (Lisman, 1997; Krahe and Gabbiani, 2004; Figure 2). Indeed, triggering a single synaptic stimulation of L5 pyramidal neurons of the visual cortex induces LTD in vitro, only if the paired excitatory postsynaptic potential (EPSP) produces an NMDAR-dependent dendritic spike (Holthoff et al., 2004; Figure 1H). Similarly, a single burst of activity in Schaffer collaterals induces LTP, under the condition of triggering a postsynaptic dendritic spike and activating NMDAR and L-type voltage-gated calcium channels in CA1 pyramidal cells (Pike et al., 1999; Wittenberg and Wang, 2006; Remy and Spruston, 2007). Importantly, a pioneer in vivo study by Bittner et al. (2017) shows that during spatial navigation, spatially tuned entorhinal and CA3 inputs arriving 2–3 s before or after a CA1 post-synaptic calcium plateau potential can induce NMDAR-LTP and new place fields in CA1 pyramidal cells, thus paving the way for behavioral time-scale plasticity. These findings, also replicated in vitro (Bittner et al., 2017), bridge the gap between the timescales of behavioral learning and synaptic changes, and offer an alternative mechanism to a purely Hebbian framework that may be at stake in episodic-like memories.
Factors Facilitating Long-Term Synaptic Plasticity Under Sparse and Burst Firing
Intrinsic Plasticity
Changes in neuronal excitability not only support synaptic changes as described above but can also act as a short-term priming mechanism (Figure 2). Indeed, intrinsic modulation of neuronal excitability generally has a lower induction threshold than synaptic plasticity and could contribute to induce early changes in neuronal activity (Titley et al., 2017) that will later favor the establishment of synaptic plasticity, even under sparse activity (Sah and Bekkers, 1996; Louise Faber et al., 2005). In this sense, artificially elevating neuron excitability selectively in vivo reveals place-cell activity in previously silent neurons (Lee et al., 2012) and turns these neurons into engram cells during a fear memory paradigm (Yiu et al., 2014). Interestingly, neurons of the piriform cortex are initially more excitable in fast learners compared to slow learners, with differences disappearing as their performance on the odor-discrimination task converges upon stimulus repetitions (Cohen-Matsliah et al., 2009).
Neuromodulation
Exposure to novel or salient stimuli releases neuromodulators necessary for spatial memory, context, and object recognition or one-shot emotional learning (Duszkiewicz et al., 2019; Likhtik and Johansen, 2019). Importantly, neuromodulators can favor the occurrence of specific synaptic events and neuronal activity patterns as well as lower the threshold for inducing long-term synaptic changes (Figure 2). Acetylcholine amplifies cue encoding at sensory cortical sites through inhibition, which allows the emission of larger bursts in presence of meaningful stimuli (Froemke et al., 2007; Letzkus et al., 2011). Also, under the presence of a cholinergic agonist, a single burst at the peak or trough of theta-rhythms induces in vitro LTP or depotentiation at CA3-CA1 synapses respectively (Huerta and Lisman, 1995). In the same vein, single burst-mediated LTP is more efficient with GABAergic transmission antagonists, suggesting that the excitation/inhibition balance, partly under neuromodulatory control, shapes the induction of fast learning plasticity (Remy and Spruston, 2007). Finally, dopamine expands the time window for NMDAR-LTP induction at CA3-CA1 synapses in vitro and decreases the threshold number of spike pairs (from 100 to 5–10) required for LTP (Zhang et al., 2009).
Reverberating Activity, as a Bypass to Sparse Firing
In addition to plasticity rules activated by small numbers of spikes, spontaneous replications of the associated neuronal activity may contribute to consolidating one-shot memories according to the classical Hebbian framework (Figure 2). Reverberating activity is observed especially during slow-wave sleep up to 48 h after a transient tactile exploration of novel objects (Ribeiro et al., 2004), and replay of past trajectories, in awake or asleep animals, is associated to memory consolidation in the hippocampus, ventral striatum and neocortex (Wilson and McNaughton, 1994; Hoffman and McNaughton, 2002; Pennartz et al., 2004; Ólafsdóttir et al., 2018). Interestingly, the awake replay is more prevalent and precise for trajectories in novel environments or associated with salient elements (e.g., a reward, Carr et al., 2011) and could thus particularly reinforce memory traces of unique salient experience.
Reconstructing Fast Learning in Neuronal Networks
Fast Learning and Slow-Fast Network Dynamics
If fast learning is best epitomized in one- or very few-shots learning tasks, it may also apply to the initial stages of repetitive and sustained training (Karni et al., 1998; Muellbacher et al., 2002; Costa et al., 2004; Qu et al., 2010; Law et al., 2014). As such, cortical engrams emerge in one-shot learning tasks as described above, but also in the initial phases of procedural learning (Karni et al., 1998; Muellbacher et al., 2002; Qu et al., 2010). Importantly, cortical representations acquired slowly over time are also essential in guiding future fast learning, which usually relies on prior knowledge and existing schemata such as when learning associations between known elements or novel words (Tse et al., 2007, 2011; Hebscher et al., 2019). Thus, one should keep in mind that fast and slow cortical dynamics are closely intertwined as exemplified in tasks necessitating high levels of cognitive flexibility (Pasupathy and Miller, 2005; Tse et al., 2007; Durstewitz et al., 2010; Siniscalchi et al., 2016; Perich et al., 2018; Remington et al., 2018; Rikhye et al., 2018).
How to Control Learning Speed?
If fast learning can confer strong advantages, e.g., in survival-threatening situations, this strategy is not always adapted and can potentially lead to detrimental responses, such as superstitious behaviors, when an outcome is too rapidly associated with the wrong cause. Typically, procedural learning based on trial-and-error, or reinforcement learning, in which a trade-off slowly balances exploration and exploitation, necessitates several sessions before reaching an optimal behavior. Hence, control of the learning speed or meta-learning should also be seen as a critical component of the learning process. Yet, little is known about how the brain is implementing and switching between different learning strategies. Recent studies highlight how an accurate tracking of feedback (Mao et al., 2019) or stimulus saliency (Ceballo et al., 2019), amplified by cortical ensembles, parallels with learning speed. The degree of uncertainty of stimulus-outcome associations also regulates the learning speed in humans and controls the coupling strength between the hippocampus and ventrolateral prefrontal cortex (Lee et al., 2015).
A Computational Perspective on a Fast Learning
Physiologically realistic models of fast learning have remained scarce and may require the development of new synaptic learning paradigms (Brea and Gerstner, 2016). Yet, phenomenological models of fast learning and machine learning algorithms have proposed various mechanisms providing a guide for the development of physiological models and offer testable hypotheses for experimentalists. Fast learning is affected with particular severity by two critical difficulties and exacerbates Hebb’s sensitivity-stability dilemma (Hebb, 1949): (i) small sample sizes hamper generalization capabilities and pattern inference; and (ii) catastrophic interference, the abrupt forgetting of previously learned information, can be easily encountered due to the high plasticity rates required by fast learning (McCloskey and Cohen, 1989; Ratcliff, 1990). To overcome these difficulties, various theories have been proposed. Synapses with hierarchical plasticity levels (Fusi et al., 2005) or selective consolidation of synapses (Leimer et al., 2019) allow fast acquisition and better retention of memories. In cognitive neurosciences, three key principles stand out as crucial for fast learning (Lake et al., 2017): the ability to compose simple primitives (and therefore use prior learning), identify causalities, and meta-learning (i.e., learning to learn). Combined in a generative hierarchical Bayesian framework, these mechanisms allowed the acquisition of new concepts after a single presentation, with performance comparable to human best one-shot learners (Lake et al., 2011, 2015).
In machine learning, various methods were developed to learn from few examples (Botvinick et al., 2019; Wang et al., 2020), with applications to an inference of situations with intrinsically limited samples (Shu et al., 2018) or for the prediction of rare events (Kaiser et al., 2017). In particular, data augmentation methods consist in adding to the dataset copies of the original data, modified according to specific rules, such as imposing invariances (Perez and Wang, 2017). Such repetitions of slightly modified stimuli could be akin to a sort of reverberating activity or replays. Concept (transfer, or multitask) learning consists in using and combining prior knowledge, potentially acquired from learning other tasks. These techniques integrate task-specific fast-learning modules and generic modules that learn from various tasks on generally slower timescales. These generic modules either transfer to the fast learning task a generic skill needed (Pan and Yang, 2009) or guide the task in the process of learning (Schaul and Schmidhuber, 2010; Finn et al., 2017). This typically echoes the aforementioned slow-fast plasticity interactions between brain areas. Recently, computational models of meta-learning have shown how a natural division of labor into functionally specialized clusters may arise in the prefrontal cortex, thus making it possible to compose multiple task elements for rapidly learning new tasks (Wang et al., 2018; Yang et al., 2019). Finally, adding external memories (Graves et al., 2014; Weston et al., 2014), storing past experiences (if not all, the most recent or most salient) allows few-shot learning and can further be combined with meta-learning algorithms to increase learning efficiency (Santoro et al., 2016; Ritter et al., 2018).
Conclusion
Fast learning is thus a crucial component in daily life memory acquisition that involves one-shot learning experiences. If fast learning can be characterized by the brevity and rarity (or even uniqueness) of the learning experience, the processes involved in memory acquisition and maintenance are embedded in multiple timescales, considering their interactions with meta-learning and consolidation systems. While current findings have lifted part of the veil on fast learning engrams, several mechanisms remain to be further elucidated. In particular, causal interactions between minimal activity patterns and the induction of long-term changes during one-shot learning task remain to be further explored in vivo, as well as the cellular and molecular determinants controlling the learning speed across brain areas and in different contexts. These elucidations could uncover additional components of cellular and synaptic-based learning rules and would allow the development of more physiological models of fast learning.
Author Contributions
CP wrote the “Fast Learning Behaviors, Neuronal Activity During Fast Learning, Fast Learning-Induced Neuronal Long-term Changes, Deconstructing Fast Learning Synaptic Plasticity Mechanisms, and Reconstructing Fast Learning in Neuronal Networks” sections and designed (Figures 1, 2). JT wrote the “A Computational Perspective on a Fast Learning” section and designed Figure 2. LV edited all versions of the manuscript and designed the Figures 1, 2. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Gaëtan Vignoud and Nicolas Gervasi for helpful suggestions and critical comments.
Glossary
Abbreviations
- BLA
basolateral amygdala
- CTA
conditioned taste aversion
- eCB
endocannabinoid
- EPSP
excitatory postsynaptic potential
- LTD
long-term depression
- LTP
long-term potentiation
- mPFC
medial prefrontal cortex
- NMDAR
N-methyl-D-aspartate receptor
- NMDAR-LTP
NMDAR-mediated LTP
- STDP
spike-timing-dependent plasticity.
Footnotes
Funding. CP was supported by Ecole Normale Supérieure PhD fellowship. This work was supported by grants from the Fondation du Collège de France and the CRCPEN.
References
- Armstrong C. M., DeVito L. M., Cleland T. A. (2006). One-trial associative odor learning in neonatal mice. Chem. Senses 31, 343–349. 10.1093/chemse/bjj038 [DOI] [PubMed] [Google Scholar]
- Bi A.-L., Wang Y., Li B.-Q., Wang Q.-Q., Ma L., Yu H., et al. (2010). Region-specific involvement of actin rearrangement-related synaptic structure alterations in conditioned taste aversion memory. Learn. Mem. 17, 420–427. 10.1101/lm.1772310 [DOI] [PubMed] [Google Scholar]
- Biederman I. (1987). Recognition-by-components: a theory of human image understanding. Psychol. Rev. 94, 115–147. 10.1037/0033-295X.94.2.115 [DOI] [PubMed] [Google Scholar]
- Bittner K. C., Milstein A. D., Grienberger C., Romani S., Magee J. C. (2017). Behavioral time scale synaptic plasticity underlies CA1 place fields. Science 357, 1033–1036. 10.1126/science.aan3846 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Botvinick M. B., Ritter S., Wang J. X., Kurth-Nelson Z., Blundell C., Hassabis D. (2019). Reinforcement learning, fast, and slow. Trends Cogn. Sci. 23, 408–422. 10.1016/j.tics.2019.02.006 [DOI] [PubMed] [Google Scholar]
- Brea J., Gerstner W. (2016). Does computational neuroscience need new synaptic learning paradigms? Curr. Opin. Behav. Sci. 11, 61–66. 10.1016/j.cobeha.2016.05.012 [DOI] [Google Scholar]
- Brodt S., Gais S., Beck J., Erb M., Scheffler K., Schönauer M. (2018). Fast track to the neocortex: a memory engram in the posterior parietal cortex. Science 362, 1045–1048. 10.1126/science.aau2528 [DOI] [PubMed] [Google Scholar]
- Brown M. W., Banks P. J. (2015). In search of a recognition memory engram. Neurosci. Biobehav. Rev. 50, 12–28. 10.1016/j.neubiorev.2014.09.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buschman T. J., Miller E. K. (2014). Goal-direction and top-down control. Philos. Trans. R. Soc. B. Biol. Sci. 369:20130471. 10.1098/rstb.2013.0471 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carey S., Bartlett E. (1978). Acquiring a single new word. Proc. Stanf. Child Lang. Conf. 15, 17–29. [Google Scholar]
- Carr M. F., Jadhav S. P., Frank L. M. (2011). Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat. Neurosci. 14, 147–153. 10.1038/nn.2732 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ceballo S., Bourg J., Kempf A., Piwkowska Z., Daret A., Pinson P., et al. (2019). Cortical recruitment determines learning dynamics and strategy. Nat. Commun. 10:1479. 10.1038/s41467-019-09450-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Choi J.-H., Sim S.-E., Kim J.-I., Choi D. I., Oh J., Ye S., et al. (2018). Interregional synaptic maps among engram cells underlie memory formation. Science 360, 430–435. 10.1126/science.aas9204 [DOI] [PubMed] [Google Scholar]
- Choi G. B., Stettler D. D., Kallman B. R., Bhaskar S. T., Fleischmann A., Axel R. (2011). Driving opposing behaviors with ensembles of piriform neurons. Cell 146, 1004–1015. 10.1016/j.cell.2011.07.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clarke J. R., Cammarota M., Gruart A., Izquierdo I., Delgado-Garcia J. M. (2010). Plastic modifications induced by object recognition memory processing. Proc. Natl. Acad. Sci. U S A 107, 2652–2657. 10.1073/pnas.0915059107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clayton N. S., Griffiths D. P., Emery N. J., Dickinson A. (2001). Elements of episodic-like memory in animals. Philos. Trans. R. Soc. B. Biol. Sci. 356, 1483–1491. 10.1098/rstb.2001.0947 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen-Matsliah S. I., Rosenblum K., Barkai E. (2009). Olfactory-learning abilities are correlated with the rate by which intrinsic neuronal excitability is modulated in the piriform cortex. Eur. J. Neurosci. 30, 1339–1348. 10.1111/j.1460-9568.2009.06894.x [DOI] [PubMed] [Google Scholar]
- Cook R., Fagot J. (2009). First trial rewards promote 1-trial learning and prolonged memory in pigeon and baboon. Proc. Natl. Acad. Sci. U S A 106, 9530–9533. 10.1073/pnas.0903378106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Costa R. M., Cohen D., Nicolelis M. A. L. (2004). Differential corticostriatal plasticity during fast and slow motor skill learning in mice. Curr. Biol. 14, 1124–1134. 10.1016/j.cub.2004.06.053 [DOI] [PubMed] [Google Scholar]
- Crestani A. P., Krueger J. N., Barragan E. V., Nakazawa Y., Nemes S. E., Quillfeldt J. A., et al. (2018). Metaplasticity contributes to memory formation in the hippocampus. Neuropsychopharmacology 44, 408–414. 10.1038/s41386-018-0096-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cromer J. A., Machon M., Miller E. K. (2011). Rapid association learning in the primate prefrontal cortex in the absence of behavioral reversals. J. Cogn. Neurosci. 23, 1823–1828. 10.1162/jocn.2010.21555 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cui Y., Paillé V., Xu H., Genet S., Delord B., Fino E., et al. (2015). Endocannabinoids mediate bidirectional striatal spike-timing-dependent plasticity. J. Physiol. 593, 2833–2849. 10.1113/JP270324 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cui Y., Perez S., Venance L. (2018a). Endocannabinoid-LTP mediated by CB1 and TRPV1 receptors encodes for limited occurrences of coincident activity in neocortex. Front. Cell. Neurosci. 12:182. 10.3389/fncel.2018.00182 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cui Y., Prokin I., Mendes A., Berry H., Venance L. (2018b). Robustness of STDP to spike timing jitter. Sci. Rep. 8:8139. 10.1038/s41598-018-26436-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cui Y., Prokin I., Xu H., Delord B., Genet S., Venance L., et al. (2016). Endocannabinoid dynamics gate spike-timing dependent depression and potentiation. eLife 5:e13185. 10.7554/eLife.13185 [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeNardo L. A., Liu C. D., Allen W. E., Adams E. L., Friedmann D., Fu L., et al. (2019). Temporal evolution of cortical ensembles promoting remote memory retrieval. Nat. Neurosci. 22, 460–469. 10.1038/s41593-018-0318-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Denny C. A., Kheirbek M. A., Alba E. L., Tanaka K. F., Brachman R. A., Laughman K. B., et al. (2014). Hippocampal memory traces are differentially modulated by experience, time, and adult neurogenesis. Neuron 83, 189–201. 10.1016/j.neuron.2014.05.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Durstewitz D., Vittoz N. M., Floresco S. B., Seamans J. K. (2010). Abrupt transitions between prefrontal neural ensemble states accompany behavioral transitions during rule learning. Neuron 66, 438–448. 10.1016/j.neuron.2010.03.029 [DOI] [PubMed] [Google Scholar]
- Duszkiewicz A. J., McNamara C. G., Takeuchi T., Genzel L. (2019). Novelty and dopaminergic modulation of memory persistence: a tale of two systems. Trends Neurosci. 42, 102–114. 10.1016/j.tins.2018.10.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Edeline J. M., Pham P., Weinberger N. M. (1993). Rapid development of learning-induced receptive field plasticity in the auditory cortex. Behav. Neurosci. 107, 539–551. 10.1037//0735-7044.107.4.539 [DOI] [PubMed] [Google Scholar]
- Ennaceur A., Delacour J. (1988). A new one-trial test for neurobiological studies of memory in rats. 1: behavioral data. Behav. Brain Res. 31, 47–59. 10.1016/0166-4328(88)90157-x [DOI] [PubMed] [Google Scholar]
- Epsztein J., Brecht M., Lee A. K. (2011). Intracellular determinants of hippocampal CA1 place and silent cell activity in a novel environment. Neuron 70, 109–120. 10.1016/j.neuron.2011.03.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Escobar M. L., Alcocer I., Bermúdez-Rattoni F. (2002). In vivo effects of intracortical administration of NMDA and metabotropic glutamate receptors antagonists on neocortical long-term potentiation and conditioned taste aversion. Behav. Brain Res. 129, 101–106. 10.1016/s0166-4328(01)00329-1 [DOI] [PubMed] [Google Scholar]
- Fellini L., Morellini F. (2013). Mice create what-where-when hippocampus-dependent memories of unique experiences. J. Neurosci. 33, 1038–1043. 10.1523/JNEUROSCI.2280-12.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Finn C., Abbeel P., Levine S. (2017). Model-agnostic meta-learning for fast adaptation of deep networks. arXiv:1703.03400 [Preprint]. [Google Scholar]
- Fried I., MacDonald K. A., Wilson C. L. (1997). Single neuron activity in human hippocampus and amygdala during recognition of faces and objects. Neuron 18, 753–765. 10.1016/s0896-6273(00)80315-3 [DOI] [PubMed] [Google Scholar]
- Fritz J., Shamma S., Elhilali M., Klein D. (2003). Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex. Nat. Neurosci. 6, 1216–1223. 10.1038/nn1141 [DOI] [PubMed] [Google Scholar]
- Froemke R. C., Merzenich M. M., Schreiner C. E. (2007). A synaptic memory trace for cortical receptive field plasticity. Nature 450, 425–429. 10.1038/nature06289 [DOI] [PubMed] [Google Scholar]
- Froemke R. C., Tsay I. A., Raad M., Long J. D., Dan Y. (2006). Contribution of individual spikes in burst-induced long-term synaptic modification. J. Neurophysiol. 95, 1620–1629. 10.1152/jn.00910.2005 [DOI] [PubMed] [Google Scholar]
- Fusi S., Drew P. J., Abbott L. F. (2005). Cascade models of synaptically stored memories. Neuron 45, 599–611. 10.1016/j.neuron.2005.02.001 [DOI] [PubMed] [Google Scholar]
- Gangarossa G., Perez S., Dembitskaya Y., Prokin I., Berry H., Venance L. (2020). BDNF controls bidirectional endocannabinoid plasticity at corticostriatal synapses. Cereb. Cortex 30, 197–214. 10.1093/cercor/bhz081 [DOI] [PubMed] [Google Scholar]
- Graves A., Wayne G., Danihelka I. (2014). Neural turing machines. arXiv:1410.5401 [Preprint]. [Google Scholar]
- Han J.-H., Kushner S. A., Yiu A. P., Hsiang H.-L. L., Buch T., Waisman A., et al. (2009). Selective erasure of a fear memory. Science 323, 1492–1496. 10.1126/science.1164139 [DOI] [PubMed] [Google Scholar]
- Harlow I. M., Donaldson D. I. (2013). Source accuracy data reveal the thresholded nature of human episodic memory. Psychon. Bull. Rev. 20, 318–325. 10.3758/s13423-012-0340-9 [DOI] [PubMed] [Google Scholar]
- Hebb D. (1949). The Organization of Behavior. New York, NY: Wiley. [Google Scholar]
- Hebscher M., Wing E., Ryan J., Gilboa A. (2019). Rapid cortical plasticity supports long-term memory formation. Trends Cogn. Sci. 23, 989–1002. 10.1016/j.tics.2019.09.009 [DOI] [PubMed] [Google Scholar]
- Hoffman K. L., McNaughton B. L. (2002). Coordinated reactivation of distributed memory traces in primate neocortex. Science 297, 2070–2073. 10.1126/science.1073538 [DOI] [PubMed] [Google Scholar]
- Hofstetter S., Friedmann N., Assaf Y. (2016). Rapid language-related plasticity: microstructural changes in the cortex after a short session of new word learning. Brain Struct. Funct. 222, 1231–1241. 10.1007/s00429-016-1273-2 [DOI] [PubMed] [Google Scholar]
- Holthoff K., Kovalchuk Y., Yuste R., Konnerth A. (2004). Single-shock LTD by local dendritic spikes in pyramidal neurons of mouse visual cortex. J. Physiol. 560, 27–36. 10.1113/jphysiol.2004.072678 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hromádka T., DeWeese M. R., Zador A. M. (2008). Sparse representation of sounds in the unanesthetized auditory cortex. PLoS Biol. 6:e16. 10.1371/journal.pbio.0060016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huerta P. T., Lisman J. E. (1995). Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron 15, 1053–1063. 10.1016/0896-6273(95)90094-2 [DOI] [PubMed] [Google Scholar]
- Ison M. J., Quian Quiroga R., Fried I. (2015). Rapid encoding of new memories by individual neurons in the human brain. Neuron 87, 220–230. 10.1016/j.neuron.2015.06.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Izquierdo I., Quillfeldt J. A., Zanatta M. S., Quevedo J., Schaeffer E., Schmitz P. K., et al. (1997). Sequential role of hippocampus and amygdala, entorhinal cortex and parietal cortex in formation and retrieval of memory for inhibitory avoidance in rats. Eur. J. Neurosci. 9, 786–793. 10.1111/j.1460-9568.1997.tb01427.x [DOI] [PubMed] [Google Scholar]
- Jacoby L. L. (1991). A process dissociation framework: separating automatic from intentional uses of memory. J. Mem. Lang. 30, 513–541. 10.1016/0749-596x(91)90025-f [DOI] [Google Scholar]
- Jadhav S. P., Wolfe J., Feldman D. E. (2009). Sparse temporal coding of elementary tactile features during active whisker sensation. Nat. Neurosci. 12, 792–800. 10.1038/nn.2328 [DOI] [PubMed] [Google Scholar]
- Josselyn S. A., Köhler S., Frankland P. W. (2015). Finding the engram. Nat. Rev. Neurosci. 16, 521–534. 10.1038/nrn4000 [DOI] [PubMed] [Google Scholar]
- Josselyn S. A., Tonegawa S. (2020). Memory engrams: recalling the past and imagining the future. Science 367:eaaw4325. 10.1126/science.aaw4325 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kaiser L., Nachum O., Roy A., Bengio S. (2017). Learning to remember rare events. arXiv:1703.03129 [Preprint]. [Google Scholar]
- Karni A., Meyer G., Rey-Hipolito C., Jezzard P., Adams M., Turner R., et al. (1998). The acquisition of skilled motor performance: fast and slow experience-driven changes in primary motor cortex. Proc. Natl. Acad. Sci. U S A 95, 861–868. 10.1073/pnas.95.3.861 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kitamura T., Ogawa S., Roy D., Okuyama T., Morrissey M., Smith L., et al. (2017). Engrams and circuits crucial for systems consolidation of a memory. Science 356, 73–78. 10.1126/science.aam6808 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krahe R., Gabbiani F. (2004). Burst firing in sensory systems. Nat. Rev. Neurosci. 5, 13–23. 10.1038/nrn1296 [DOI] [PubMed] [Google Scholar]
- Lake B., Salakhutdinov R., Gross J., Tenenbaum J. (2011). “One shot learning of simple visual concepts,” in Proceedings of the 33rd Annual Conference of the Cognitive Science Society, Phoenix, AZ, 172. [Google Scholar]
- Lake B., Salakhutdinov R., Tenenbaum J. (2015). Human-level concept learning through probabilistic program induction. Science 350, 1332–1338. 10.1126/science.aab3050 [DOI] [PubMed] [Google Scholar]
- Lake B., Ullman T., Tenenbaum J., Gershman S. (2017). Building machines that learn and think like people. Behav. Brain Sci. 40:e253. 10.1017/S0140525X16001837 [DOI] [PubMed] [Google Scholar]
- Lavi K., Jacobson G., Rosenblum K., Lüthi A. (2018). Encoding of conditioned taste aversion in cortico-amygdala circuits. Cell Rep. 24, 278–283. 10.1016/j.celrep.2018.06.053 [DOI] [PubMed] [Google Scholar]
- Law A., Rivlis G., Schieber M. (2014). Rapid acquisition of novel interface control by small ensembles of arbitrarily selected primary motor cortex neurons. J. Neurophysiol. 112, 1528–1548. 10.1152/jn.00373.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee D., Lin B., Lee A. (2012). Hippocampal place fields emerge upon single-cell manipulation of excitability during behavior. Science 337, 849–853. 10.1126/science.1221489 [DOI] [PubMed] [Google Scholar]
- Lee S., O’Doherty J., Shimojo S. (2015). Neural computations mediating one-shot learning in the human brain. PLoS Biol. 13:e1002137. 10.1371/journal.pbio.1002137 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leimer P., Herzog M., Senn W. (2019). Synaptic weight decay with selective consolidation enables fast learning without catastrophic forgetting. BioRxiv:613265 [Preprint]. [Google Scholar]
- Letzkus J., Wolff S., Meyer E., Tovote P., Courtin J., Herry C., et al. (2011). A disinhibitory microcircuit for associative fear learning in the auditory cortex. Nature 480, 331–335. 10.1038/nature10674 [DOI] [PubMed] [Google Scholar]
- Likhtik E., Johansen J. (2019). Neuromodulation in circuits of aversive emotional learning. Nat. Neurosci. 22, 1586–1597. 10.1038/s41593-019-0503-3 [DOI] [PubMed] [Google Scholar]
- Lisman J. (1997). Bursts as a unit of neural information: making unreliable synapses reliable. Trends Neurosci. 20, 38–43. 10.1016/S0166-2236(96)10070-9 [DOI] [PubMed] [Google Scholar]
- Liu X., Ramirez S., Pang P., Puryear C., Govindarajan A., Deisseroth K., et al. (2012). Optogenetic stimulation of a hippocampal engram activates fear memory recall. Nature 484, 381–385. 10.1038/nature11028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Louise Faber E. S., Delaney A. J., Sah P. (2005). SK channels regulate excitatory synaptic transmission and plasticity in the lateral amygdala. Nat. Neurosci. 8, 635–641. 10.1038/nn1450 [DOI] [PubMed] [Google Scholar]
- Manita S., Miyakawa H., Kitamura K., Murayama M. (2017). Dendritic spikes in sensory perception. Front. Cell. Neurosci. 11:29. 10.3389/fncel.2017.00029 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mao H., Yuan Y., Si J. (2019). Cortical neural modulation by previous trial outcome differentiates fast- from slow-learning rats on a visuomotor directional choice task. J. Neurophysiol. 121, 50–60. 10.1152/jn.00950.2016 [DOI] [PubMed] [Google Scholar]
- Matos M. R., Visser E., Kramvis I., van der Loo R., Gebuis T., Zalm R., et al. (2019). Memory strength gates the involvement of a CREB-dependent cortical fear engram in remote memory. Nat. Commun. 10:2315. 10.1038/s41467-019-10266-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McClelland J., McNaughton B., O’Reilly R. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev. 102, 419–457. 10.1037/0033-295X.102.3.419 [DOI] [PubMed] [Google Scholar]
- McCloskey M., Cohen N. (1989). Catastrophic interference in connectionist networks: the sequential learning problem. Psychol. Learn. Motiv. 24, 109–165. 10.1016/s0079-7421(08)60536-8 [DOI] [Google Scholar]
- McKay B., Matthews E., Oliveira F., Disterhoft J. (2009). Intrinsic neuronal excitability is reversibly altered by a single experience in fear conditioning. J. Neurophysiol. 102, 2763–2770. 10.1152/jn.00347.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mehta M., Quirk M., Wilson M. (2000). Experience-dependent asymmetric shape of hippocampal receptive fields. Neuron 25, 707–715. 10.1016/s0896-6273(00)81072-7 [DOI] [PubMed] [Google Scholar]
- Messinger A., Squire L., Zola S., Albright T. (2001). Neuronal representations of stimulus associations develop in the temporal lobe during learning. Proc. Natl. Acad. Sci. U S A 98, 12239–12244. 10.1073/pnas.211431098 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Millman D., Murthy V. (2020). Rapid learning of odor-value association in the olfactory striatum. J. Neurosci. 40, 4335–4347. 10.1523/JNEUROSCI.2604-19.2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miyashita T., Kubik S., Haghighi N., Steward O., Guzowski J. (2009). Rapid activation of plasticity-associated gene transcription in hippocampal neurons provides a mechanism for encoding of one-trial experience. J. Neurosci. 29, 898–906. 10.1523/JNEUROSCI.4588-08.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moser E., Moser M., Andersen P. (1993). Synaptic potentiation in the rat dentate gyrus during exploratory learning. Neuroreport 5, 317–320. 10.1097/00001756-199312000-00035 [DOI] [PubMed] [Google Scholar]
- Moyer J. R., Jr., Thompson L. T., Disterhoft J. F. (1996). Trace eyeblink conditioning increases CA1 excitability in a transient and learning-specific manner. J. Neurosci. 16, 5536–5546. 10.1523/JNEUROSCI.16-17-05536.1996 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muellbacher W., Ziemann U., Wissel J., Dang N., Kofler M., Facchini S., et al. (2002). Early consolidation in human primary motor cortex. Nature 415, 640–644. 10.1038/nature712 [DOI] [PubMed] [Google Scholar]
- Nakazawa K., Sun L., Quirk M., Rondi-Reig L., Wilson M., Tonegawa S. (2003). Hippocampal CA3 NMDA receptors are crucial for memory acquisition of one-time experience. Neuron 38, 305–315. 10.1016/s0896-6273(03)00165-x [DOI] [PubMed] [Google Scholar]
- Nonaka A., Toyoda T., Miura Y., Hitora-Imamura N., Naka M., Eguchi M., et al. (2014). Synaptic plasticity associated with a memory engram in the basolateral amygdala. J. Neurosci. 34, 9305–9309. 10.1523/JNEUROSCI.4233-13.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Connor D., Peron S., Huber D., Svoboda K. (2010). Neural activity in barrel cortex underlying vibrissa-based object localization in mice. Neuron 67, 1048–1061. 10.1016/j.neuron.2010.08.026 [DOI] [PubMed] [Google Scholar]
- O’Keefe J., Recce M. (1993). Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus 3, 317–330. 10.1002/hipo.450030307 [DOI] [PubMed] [Google Scholar]
- Ólafsdóttir H., Bush D., Barry C. (2018). The role of hippocampal replay in memory and planning. Curr. Biol. 28, R37–R50. 10.1016/j.cub.2017.10.073 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pan S., Yang Q. (2009). A survey on transfer learning. IEEE Trans. Knowledge Data Eng. 22, 1345–1359. 10.1109/TKDE.2009.191 [DOI] [Google Scholar]
- Pasupathy A., Miller E. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873–876. 10.1038/nature03287 [DOI] [PubMed] [Google Scholar]
- Pennartz C., Lee E., Verheul J., Lipa P., Barnes C., McNaughton B. (2004). The ventral striatum in off-line processing: ensemble reactivation during sleep and modulation by hippocampal ripples. J. Neurosci. 24, 6446–6456. 10.1523/JNEUROSCI.0575-04.2004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perez L., Wang J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv:1712.04621 [Preprint]. [Google Scholar]
- Perich M., Gallego J., Miller L. (2018). A neural population mechanism for rapid learning. Neuron 100, 964.e7–976.e7. 10.1016/j.neuron.2018.09.030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petersen C., Malenka R., Nicoll R., Hopfield J. (1998). All-or-none potentiation at CA3-CA1 synapses. Proc. Natl. Acad. Sci. U S A 95, 4732–4737. 10.1073/pnas.95.8.4732 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pike F., Meredith R., Olding A., Paulsen O. (1999). Postsynaptic bursting is essential for ‘Hebbian’ induction of associative long-term potentiation at excitatory synapses in rat hippocampus. J. Physiol. 518, 571–576. 10.1111/j.1469-7793.1999.0571p.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Qu Z., Song Y., Ding Y. (2010). ERP evidence for distinct mechanisms of fast and slow visual perceptual learning. Neuropsychologia 48, 1869–1874. 10.1016/j.neuropsychologia.2010.01.008 [DOI] [PubMed] [Google Scholar]
- Radulovic J., Kammermeier J., Spiess J. (1998). Relationship between Fos production and classical fear conditioning: effects of novelty, latent inhibition and unconditioned stimulus preexposure. J. Neurosci. 18, 7452–7461. 10.1523/JNEUROSCI.18-18-07452.1998 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ratcliff R. (1990). Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychol. Rev. 97, 285–308. 10.1037/0033-295x.97.2.285 [DOI] [PubMed] [Google Scholar]
- Remington E., Narain D., Hosseini E., Jazayeri M. (2018). Flexible sensorimotor computations through rapid reconfiguration of cortical dynamics. Neuron 98, 1005.e5–1019.e5. 10.1016/j.neuron.2018.05.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Remy S., Spruston N. (2007). Dendritic spikes induce single-burst long-term potentiation. Proc. Natl. Acad. Sci. U S A 104, 17192–17197. 10.1073/pnas.0707919104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ribeiro S., Gervasoni D., Soares E., Zhou Y., Lin S., Pantoja J., et al. (2004). Long-lasting novelty-induced neuronal reverberation during slow-wave sleep in multiple forebrain areas. PLoS Biol. 2:e24. 10.1371/journal.pbio.0020024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rikhye R., Gilra A., Halassa M. (2018). Thalamic regulation of switching between cortical representations enables cognitive flexibility. Nat. Neurosci. 21, 1753–1763. 10.1038/s41593-018-0269-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ritter S., Wang J., Kurth-Nelson Z., Jayakumar S., Blundell C., Pascanu R., et al. (2018). Been there, done that: meta-learning with episodic recall. Int. Conf. Mach. Learn., 4351–4360. [Google Scholar]
- Rodríguez-Durán L., Castillo D., Moguel-González M., Escobar M. (2011). Conditioned taste aversion modifies persistently the subsequent induction of neocortical long-term potentiation in vivo. Neurobiol. Learn. Mem. 95, 519–526. 10.1016/j.nlm.2011.03.003 [DOI] [PubMed] [Google Scholar]
- Romberg C., Yang S., Melani R., Andrews M. R., Horner A. E., Spillantini M. G., et al. (2013). Depletion of perineuronal nets enhances recognition memory and long-term depression in the perirhinal cortex. J. Neurosci. 33, 7057–7065. 10.1523/JNEUROSCI.6267-11.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roullet P., Mileusnic R., R. Rose S., Sara S. (1997). Neural cell adhesion molecules play a role in rat memory formation in appetitive as well as aversive tasks. Neuroreport 8, 1907–1911. 10.1097/00001756-199705260-00023 [DOI] [PubMed] [Google Scholar]
- Rutishauser U., Mamelak A., Schuman E. (2006). Single-trial learning of novel stimuli by individual neurons of the human hippocampus-amygdala complex. Neuron 49, 805–813. 10.1016/j.neuron.2006.02.015 [DOI] [PubMed] [Google Scholar]
- Saar D., Grossman Y., Barkai E. (1998). Reduced after-hyperpolarization in rat piriform cortex pyramidal neurons is associated with increased learning capability during operant conditioning. Eur. J. Neurosci. 10, 1518–1523. 10.1046/j.1460-9568.1998.00149.x [DOI] [PubMed] [Google Scholar]
- Sacchetti B., Lorenzini C., Baldi E., Bucherelli C., Roberto M., Tassoni G., et al. (2002). Time-dependent inhibition of hippocampal LTP in vitro following contextual fear conditioning in the rat. Eur. J. Neurosci. 15, 143–150. 10.1046/j.0953-816x.2001.01844.x [DOI] [PubMed] [Google Scholar]
- Sah P., Bekkers J. (1996). Apical dendritic location of slow after hyperpolarization current in hippocampal pyramidal neurons: implications for the integration of long-term potentiation. J. Neurosci. 16, 4537–4542. 10.1523/JNEUROSCI.16-15-04537.1996 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sananbenesi F., Fischer A., Schrick C., Spiess J., Radulovic J. (2002). Phosphorylation of hippocampal Erk-1/2, Elk-1 and p90-Rsk-1 during contextual fear conditioning: interactions between Erk-1/2 and Elk-1. Mol. Cell. Neurosci. 21, 463–476. 10.1006/mcne.2002.1188 [DOI] [PubMed] [Google Scholar]
- Santoro A., Bartunov S., Botvinick M., Wierstra D., Lillicrap T. (2016). Meta-learning with memory-augmented neural networks. Int. Conf. Mach. Learn., 1842–1850. [Google Scholar]
- Schaul T., Schmidhuber J. (2010). Metalearning. Scholarpedia 5:4650. [Google Scholar]
- Sehgal M., Ehlers V. L., Moyer J. R., Jr. (2014). Learning enhances intrinsic excitability in a subset of lateral amygdala neurons. Learn. Mem. 21, 161–170. 10.1101/lm.032730.113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shu J., Xu Z., Meng D. (2018). Small sample learning in big data era. arXiv:1808.04572 [Preprint]. [Google Scholar]
- Siniscalchi M., Phoumthipphavong V., Ali F., Lozano M., Kwan A. (2016). Fast and slow transitions in frontal ensemble activity during flexible sensorimotor behavior. Nat. Neurosci. 19, 1234–1242. 10.1038/nn.4342 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith S., Smith I., Branco T., Häusser M. (2013). Dendritic spikes enhance stimulus selectivity in cortical neurons in vivo. Nature 503, 115–120. 10.1038/nature12600 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Song C., Detert J. A., Sehgal M., Moyer J. R., Jr. (2012). Trace fear conditioning enhances synaptic and intrinsic plasticity in rat hippocampus. J. Neurophysiol. 107, 3397–3408. 10.1152/jn.00692.2011 [DOI] [PubMed] [Google Scholar]
- Standing L., Conezio J., Haber R. (1970). Perception and memory for pictures: single-trial learning of 2500 visual stimuli. Psychon. Sci. 19, 73–74. 10.3758/BF03337426 [DOI] [Google Scholar]
- Steele R. J., Morris R. G. (1999). Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP5. Hippocampus 9, 118–136. [DOI] [PubMed] [Google Scholar]
- Takahashi N., Oertner T., Hegemann P., Larkum M. (2016). Active cortical dendrites modulate perception. Science 354, 1587–1590. 10.1126/science.aah6066 [DOI] [PubMed] [Google Scholar]
- Tang S., Zhang Y., Li Z., Li M., Liu F., Jiang H., et al. (2018). Large-scale two-photon imaging revealed super-sparse population codes in the V1 superficial layer of awake monkeys. eLife 7:e33370. 10.7554/eLife.33370 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tayler K., Tanaka K., Reijmers L., Wiltgen B. (2013). Reactivation of neural ensembles during the retrieval of recent and remote memory. Curr. Biol. 23, 99–106. 10.1016/j.cub.2012.11.019 [DOI] [PubMed] [Google Scholar]
- Titley H., Brunel N., Hansel C. (2017). Toward a neurocentric view of learning. Neuron 95, 19–32. 10.1016/j.neuron.2017.05.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tonegawa S., Liu X., Ramirez S., Redondo R. (2015). Memory engram cells have come of age. Neuron 87, 918–931. 10.1016/j.neuron.2015.08.002 [DOI] [PubMed] [Google Scholar]
- Tse D., Langston R., Kakeyama M., Bethus I., Spooner P., Wood E., et al. (2007). Schemas and memory consolidation. Science 316, 76–82. 10.1126/science.1135935 [DOI] [PubMed] [Google Scholar]
- Tse D., Takeuchi T., Kakeyama M., Kajii Y., Okuno H., Tohyama C., et al. (2011). Schema-dependent gene activation and memory encoding in neocortex. Science 333, 891–895. 10.1126/science.1205274 [DOI] [PubMed] [Google Scholar]
- Tyssowski K. M., DeStefino N. R., Cho J. H., Dunn C. J., Poston R. G., Carty C. E., et al. (2018). Different neuronal activity patterns induce different gene expression programs. Neuron 98, 530.e11–546.e11. 10.1016/j.neuron.2018.04.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vale R., Evans D., Branco T. (2017). Rapid spatial learning controls instinctive defensive behavior in mice. Curr. Biol. 27, 1342–1349. 10.1016/j.cub.2017.03.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Venable N., Kelly P. (1990). Effects of NMDA receptor antagonists on passive avoidance learning and retrieval in rats and mice. Psychopharmacology 100, 215–221. 10.1007/BF02244409 [DOI] [PubMed] [Google Scholar]
- Wang J., Kurth-Nelson Z., Kumaran D., Tirumala D., Soyer H., Leibo J., et al. (2018). Prefrontal cortex as a meta-reinforcement learning system. Nat. Neurosci. 21, 860–868. 10.1038/s41593-018-0147-8 [DOI] [PubMed] [Google Scholar]
- Wang Y., Yao Q., Kwok J., Ni L. (2020). Generalizing from a few examples: a survey on few-shot learning. arXiv:1904.05046 [Preprint]. [Google Scholar]
- Weston J., Chopra S., Bordes A. (2014). Memory networks. arXiv:1410.3916 [Preprint]. [Google Scholar]
- Whitlock J. R., Heynen A. J., Shuler M. G., Bear M. F. (2006). Learning induces long-term potentiation in the hippocampus. Science 313, 1093–1097. 10.1126/science.1128134 [DOI] [PubMed] [Google Scholar]
- Wilson M. A., McNaughton B. L. (1994). Reactivation of hippocampal ensemble memories during sleep. Science 265, 676–679. 10.1126/science.8036517 [DOI] [PubMed] [Google Scholar]
- Wittenberg G., Wang S. (2006). Malleability of spike-timing-dependent plasticity at the CA3-CA1 synapse. J. Neurosci. 26, 6610–6617. 10.1523/JNEUROSCI.5388-05.2006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xiang J., Brown M. (1998). Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe. Neuropharmacology 37, 657–676. 10.1016/s0028-3908(98)00030-6 [DOI] [PubMed] [Google Scholar]
- Xu N., Harnett M. T., Williams S. R., Huber D., O’Connor D. H., Svoboda K., et al. (2012). Nonlinear dendritic integration of sensory and motor input during an active sensing task. Nature 492, 247–251. 10.1038/nature11601 [DOI] [PubMed] [Google Scholar]
- Xu H., Perez S., Cornil A., Detraux B., Prokin I., Cui Y., et al. (2018). Dopamine-endocannabinoid interactions mediate spike-timing-dependent potentiation in the striatum. Nat. Commun. 9:4118. 10.1038/s41467-018-06409-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yang G. R., Joglekar M. R., Song H. F., Newsome W. T., Wang X.-J. (2019). Task representations in neural networks trained to perform many cognitive tasks. Nat. Neurosci. 22, 297–306. 10.1038/s41593-018-0310-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yao H., Shi L. S., Han F., Gao H., Dan Y. (2007). Rapid learning in cortical coding of visual scenes. Nat. Neurosci. 10, 772–778. 10.1038/nn1895 [DOI] [PubMed] [Google Scholar]
- Yiu A. P., Mercaldo V., Yan C., Richards B., Rashid A., Hsiang H.-L. L., et al. (2014). Neurons are recruited to a memory trace based on relative neuronal excitability immediately before training. Neuron 83, 722–735. 10.1016/j.neuron.2014.07.017 [DOI] [PubMed] [Google Scholar]
- Yoshida T., Ohki K. (2020). Natural images are reliably represented by sparse and variable populations of neurons in visual cortex. Nat. Commun. 11:872. 10.1038/s41467-020-14645-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang J.-C., Lau P.-K., Bi G.-Q. (2009). Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc. Natl. Acad. Sci. U S A 106, 13028–13033. 10.1073/pnas.0900546106 [DOI] [PMC free article] [PubMed] [Google Scholar]