Abstract
The Multiple Memory Systems framework — that distinct types of memory are supported by distinct brain systems — has guided learning and memory research for decades. However, recent work challenges the one-to-one mapping between brain structures and memory types central to this taxonomy, with key memory-related structures supporting multiple functions across substructures. Here we integrate cross-species findings in the hippocampus, striatum, and amygdala to propose an updated framework of Multiple Memory Subsystems (MMSS). We provide evidence for two organizational principles of the MMSS theory: first, opposing memory representations are co-located in the same brain structures; second, parallel memory representations are supported by distinct structures. We discuss why this burgeoning framework has the potential to provide a useful revision of classic theories of long-term memory, what evidence is needed to further validate the framework, and how this novel perspective on memory organization may guide future research.
Keywords: hippocampus, striatum, amygdala, episodic memory, habits, conditioning
Any experience can be stored as multiple kinds of memories, varying in strength, richness, and imageability. Some memories are episodic in nature, involving vivid recollections of a specific event in space and time (e.g., your last birthday party). Other memories may be less detailed, or tied to specific cues (e.g., anticipating a cake when you hear the song “Happy Birthday” or blowing out lit candles placed in front of you). These differences in content also influence the way we use memories to guide future behavior (Biderman et al., 2020). We can call on specific experiences to flexibly guide behavior based on our current state, or we can rely on more general, rigid memories to drive behavior automatically (Tolman, 1948).
These varieties of remembering led to attempts to systematize long-term memory into an ontology or taxonomy. The theory of Multiple Memory Systems resulted from these efforts and has remained the dominant, guiding framework for memory research. This theory maps functionally distinct representations onto discrete brain structures (Squire, 1992; Henke, 2010). Research across species has identified key hubs for distinct types of associative memory, with the hippocampus involved in episodic memory (e.g., remembering your last birthday party), the striatum in stimulus-response learning (e.g., linking candles with blowing), and the amygdala in classical conditioning (e.g., linking the birthday song with cake).
However, recent work challenges this taxonomy by revealing that multiple — sometimes competing — memories can exist within each of these structures, and that similar mnemonic computations are supported across multiple structures. Namely, the hippocampus, striatum, and amygdala can each rapidly form separated representations and gradually form integrated representations. Here we synthesize these findings into a new theoretical framework of Multiple Memory Subsystems (MMSS). After characterizing these subsystems, we discuss why it may be adaptive to house competing representations within the same brain system, highlight commonalities in subsystems across regions, and discuss factors that modulate the use of subsystems. Together, MMSS provides a more nuanced and precise understanding of the relationship between brain structures and memory functions, unveils novel adaptive memory features, and presents a guide for future research on how these canonical brain regions support our multi-faceted memories.
Traditional Taxonomy of Multiple Memory Systems: One Memory, One Brain Region
There is a rich history of characterizing how the human mind and brain support multiple types of memory. Early behavioral theories distinguished memories by process, for example noting the distinction between stimulus-response and “cognitive map”-like episodic representations (Tolman, 1948). The majority of initial evidence for Multiple Memory Systems came from lesion studies in human patients and rodents, which localized different types of memories to particular brain regions (Fig 1, top). By linking anatomical damage to mnemonic deficits, this work pushed against prior “equipotentiality” theories that memory is distributed across the brain (Lashley, 1950).
Distinct memory representations in the hippocampus, amygdala, and striatum have been supported by double (Packard et al., 1989; Packard and McGaugh, 1996) and triple dissociations (McDonald and White, 1993) in rodents. For example, rodents with hippocampal damage had impaired episodic-like memory for places but intact stimulus-response memory for actions, whereas rodents with striatal damage showed the opposite (Packard et al., 1989; Packard and McGaugh, 1996). Such dissociations have been found in human lesion studies as well (Milner, 1962; LaBar et al., 1995; Knowlton et al., 1996).
The nature of multiple memory representations has been refined in important ways over time. Early theories emphasized the role of consciousness in delineating memory systems, with “declarative” forms of memory, like episodic memory, relying on the hippocampus and “non-declarative” forms of memory, like procedural memory and conditioned responses, relying on the striatum and amygdala, respectively (Squire, 1992). Subsequent theories moved away from strict consciousness-based distinctions, proposing instead that the recruitment of a brain region for a memory process can be explained by computations facilitated by the brain region, with the hippocampus supporting the rapid encoding of flexible associations and the striatum supporting the slower encoding of rigid associations (Henke, 2010). Such an appeal to the computational properties of a brain region can also help explain the role of the hippocampus in non-mnemonic tasks (Shohamy and Turk-Browne, 2013). Although this perspective based on “processing modes” provides greater explanatory power and accounts for a wider range of contemporary findings, existing theories largely continue to treat these memory-related regions as homogeneous, ignoring the functional heterogeneity of subregions (but see White, 2009).
Beyond characterizing the relationship between brain structure and memory function, Multiple Memory Systems theories delineate circumstances under which certain brain regions/memory systems are used preferentially. Segregating memory systems across structures allows for parallel representations to guide behavior through cooperation or compensation. For example, while you may be able to rely on “striatal” stimulus-response associations to get to work (e.g., turn left at the intersection), if there is a roadblock, more flexible “hippocampal” episodic memories could help efficiently circumvent the obstruction. Which memory system is used depends on factors including task demands. For example, reminders of past trials in a reinforcement learning task can bias participants towards acting based on specific episodic memories, rather than incrementally learned values (Bornstein et al., 2017; Duncan et al., 2019). Segregated memory systems can also compete. For example, rodents with hippocampal lesions can exhibit enhanced response-based striatal learning (Packard et al., 1989), which would have otherwise conflicted with place-based hippocampal learning (also Gardner et al., 2020). Similarly, in humans, hippocampal damage is associated with increased use of striatum-dependent strategies (Vikbladh et al., 2019).
This framework also promoted an appreciation of modulatory factors that bias the use of different memory systems. For example, across species, stress is associated with a bias towards striatal (stimulus-response associations) rather than hippocampal representations (episodic memories; Schwabe et al., 2022). Time also plays an important role in arbitrating between memory systems. For example, temporal gaps between conditioned and unconditioned stimuli in trace conditioning lead to a shift from the amygdala to the hippocampus (Clark and Squire, 1998), and delays between choice and feedback in reinforcement learning lead to a shift from the striatum to the hippocampus (Foerde et al., 2013).
Taxonomy of Memory Subsystems: Multiple Memories, One Brain Region
Although there is extensive evidence that different kinds of memory map onto different brain regions, recent work challenges this framework. Importantly, canonical memory-related brain regions are not functionally homogeneous. Instead, they contain subregions with different firing patterns and connectivity profiles, which may support distinct memory types. Here we review how subregions within the hippocampus, striatum, and amygdala support different, sometimes opposing memories. This led to our proposal of the MMSS theory, in which single brain regions can support multiple memory representations (Fig 1, bottom).
Hippocampus
The hippocampus is traditionally considered the seat of episodic memory. Episodic memory reflects the rapid encoding of a discrete experience, enabling rich recollection while minimizing interference from related experiences. This is attributed to at least two functions of the hippocampus: relational binding, linking elements of an experience over space and time into a detailed and integrated episode (Henke, 2010); and pattern separation, orthogonalizing the representation of the episode with respect to related memories (Yassa and Stark, 2011).
However, the hippocampus has also been assigned other mnemonic functions like generalization (Zeithamova and Bowman, 2020) and statistical learning (Sherman et al., 2020). Specifically, the hippocampus extracts spatial and/or temporal regularities across experiences (Schapiro et al., 2012; Covington et al., 2018; Henin et al., 2021) as well as links across related associations (Wimmer and Shohamy, 2012; Schlichting et al., 2014, 2017). In stark contrast to the computational requirements of episodic memory (sparse, orthogonalized code to rapidly form unique memories), these processes require that memories get formed more gradually, using an overlapping neural code to reinforce common aspects of related memories over time without suffering catastrophic interference.
From a traditional Multiple Memory Systems perspective, this is puzzling — how could the hippocampus support such different representations? A neural network model of the hippocampus (Schapiro et al., 2017) suggests that its ability to perform these computationally opposing learning functions depends on two hippocampal pathways (Amaral, 1993) (Fig 2, top). The trisynaptic pathway (TSP) — from entorhinal cortex (EC) to hippocampal subfield cornu ammonis 1 (CA1) via dentate gyrus (DG) and CA3 — has high inhibition and a fast learning rate, ideally suited to support the rapid, pattern separated codes of episodic memory (Leutgeb et al., 2007; Bakker et al., 2008). Pattern separation is often probed by examining hippocampal activity in response to two highly similar environments or images. For example, in monkeys, the firing rates across CA3/DG neurons discriminate between similar images (e.g., two images of the same breed of dog), such that the two similar images are represented by separate populations of neurons (Sakon and Suzuki, 2019). Additionally, a recent human fMRI study measuring multivoxel patterns in CA3/DG found that similar memories (e.g., highly similar object-scene pairs, such as lighthouse 1-guitar 1 and lighthouse 2-guitar 2) were represented in a non-overlapping way, such that they recruited distinct populations of voxels; such representational dissimilarity reduced interference and enhanced new behavioral learning (Wanjia et al., 2021). Beyond evidence of pattern separation in CA3/DG, TSP structural connectivity in humans has also been linked to behavioral evidence of mnemonic specificity in category learning (e.g., learning the exception to a category rule; Schlichting et al., 2021).
The monosynaptic pathway (MSP) — a direct recurrent EC/CA1 connection — has lower inhibition and a slower learning rate, leading to distributed and overlapping representations of related inputs in the service of an integrated code for statistical learning. Consistent with this model, human (Schlichting et al., 2014; Molitor et al., 2021) and rodent (Wood et al., 2000; McKenzie et al., 2013) studies find that subfield CA1 supports pattern integration (such that related experiences are represented in a more overlapping manner). For example, a rodent study found that common populations of CA1 neurons fired at both old and new goal locations in a familiar environment, indicating that CA1 may represent the shared content of similar memories across events (McKenzie et al., 2013). In a human study of associative inference, CA1 reinstated patterns of encoding activity for overlapping memories during retrieval, providing a mechanism to link distinct encoding experiences in the service of inference behavior (Schlichting et al., 2014).
Further supporting the distinct roles of CA3/DG (TSP) and CA1 (MSP) in differentiation and integration, respectively, rodent studies have found that CA3 can support the rapid acquisition of memories, whereas CA1 is required for integrating memories more gradually over time (Lee and Kesner, 2002; Lee et al., 2004; Nakashiba et al., 2008). Importantly, although CA1 is part of both the MSP and TSP circuits, we refer to it as an “MSP” region throughout the paper, given that it contains the necessary computational properties (i.e., pattern integration) to support MSP-dependent statistical learning, even in the absence of CA3/DG (Schapiro et al., 2017; Sucevic and Schapiro, 2022).
Striatum
The striatum has traditionally been associated with stimulus-response, or habit, memory (Knowlton et al., 1996). However, there is evidence that the striatum can also support flexible, goal-directed behavior (Balleine, 2019).
Both habit and goal-directed associations have three parts: a stimulus (e.g., birthday candles) indicates that an agent should make a response (e.g., blowing them out) in order to receive a desirable outcome (e.g., cake). Habit memory reflects rigid stimulus-response associations, marked by persistent stimulus-evoked responses even without a rewarding outcome. In contrast, goal-directed associations involve continued sensitivity to outcome value and the ability to flexibly update behavior based on current environment or goal states (Grospe et al., 2018; Lhost et al., 2021). Habit memories form slowly, as a result of extensive training, whereas goal-directed associations are formed rapidly (Balleine and O’Doherty, 2010).
As with the hippocampus, the existence of opposing associations within the striatum challenges the traditional Multiple Memory Systems taxonomy. And again, the solution may come from considering functional heterogeneity within the striatum (Fig 2, middle). Different subregions support distinct computations: the dorsolateral striatum (DLS; primate putamen, part of sensorimotor striatum) facilitates rigid, habitual behavior, whereas the dorsomedial striatum (DMS; primate caudate nucleus, part of associative striatum) supports flexible, goal-directed behavior (White, 2009; Turner et al., 2022). Although the majority of this evidence comes from rodents, human neuroimaging provides converging support for this dissociation (McNamee et al., 2015; Patterson and Knowlton, 2018).
The DLS and DMS exhibit distinct firing patterns that may support these different associations. For example, Thorn et al. (2010) designed a task in which rodents were placed in a T-maze. As the animal moved along the linear track (before the choice point), a cue indicated which of the two goal arms would be rewarded. DMS and DLS were active at distinct timepoints within a trial: DMS activity peaked during the middle portion of the trial, when the animal had to select a behavior based on the cue, whereas DLS primarily fired at the beginning and end of the trial, marking the “action boundaries”. This “task-bracketing” of DLS (Jog et al., 1999; Thorn et al., 2010; Smith and Graybiel, 2013) emphasizes boundaries between learned sequences, perhaps chunking them into unified habitual associations. Indeed, DLS bracketing activity is both insensitive to reward devaluation and linked to automaticity (Smith and Graybiel, 2013). In contrast, ramping DMS activity tracks the progression of a sequence, suggesting sensitivity to current states (Vandaele et al., 2021).
Amygdala
The amygdala has been linked to remembering salient associations with fear and reward, particularly in the context of classical conditioning. However, stimuli and outcomes can be associated at different levels of granularity, which can motivate different behaviors. Specifically, there is burgeoning evidence that the basolateral amygdala (BLA) supports specific associations between a stimulus and a particular outcome, whereas the central amygdala (CeA) supports general associations between a stimulus and an ensuing affective state or behavioral output (Fig 2, bottom).
Although there is less work on subsystem dissociations in the amygdala than in the hippocampal and striatal subsystems described above, there is compelling evidence for a BLA/CeA difference from the Pavlovian-to-Instrumental Transfer paradigm. Pavlovian-to-Instrumental Transfer is an experimental paradigm in which classically conditioned cues promote instrumentally learned actions. It can be general (presence of a conditioned cue results in a general motivational increase or response, regardless of the anticipated outcome) or specific (conditioned cue elicits a response associated with the outcome which the cue predicts). As an intuitive example, after a bout of food poisoning, you may show specific transfer by linking the aversive outcome with the dish you ate, and thus avoid ordering that meal in the future. In the case of general transfer, you may form a broader representation of that experience, resulting in a general motivation/response change, thus becoming wary of ordering takeout entirely (see Cartoni et al., 2016). Human and rodent studies have linked specific transfer to BLA and general transfer to CeA (Corbit and Balleine, 2005; Prévost et al., 2012; Cartoni et al., 2016). In one such experiment (Corbit and Balleine, 2005), a rodent formed Pavlovian tone/reward associations and instrumental lever press/reward associations. Transfer was measured when the Pavlovian tone was presented while the lever was available. The tone selectively increased lever pressing if the tone and lever were paired with the same reward (specific transfer), but broadly increased lever pressing if they were associated with distinct rewards (general transfer). These findings provide empirical support for theorized BLA/CeA distinctions in classic models of amygdala function (Holland and Gallagher, 1999; Balleine and Killcross, 2006).
This mapping also extends beyond Pavlovian-to-Instrumental Transfer, with BLA supporting specific responses (Wassum and Izquierdo, 2015) and CeA supporting general responses (Fadok et al., 2018) in rodents. The BLA represents sensory-specific stimulus/outcome associations, supporting prediction (Lichtenberg et al., 2017) and detailed memory formation (Sias et al., 2021). In contrast, the CeA has been linked more broadly to motivation and reward-seeking behavior (Warlow and Berridge, 2021), as well as more generalized forms of fear and anxiety (Ciocchi et al., 2010; Gilpin et al., 2015). Although studied less in humans, recent patient (van Honk et al., 2013; Rosenberger et al., 2019) and high-resolution fMRI (Sladky et al., 2021) findings provide converging evidence, with BLA (but not CeA) supporting specific stimulus/outcome representations in a trust game.
The computational and connectivity profiles of these subregions help them represent specific sensory information versus general motivational information, respectively. The BLA primarily receives sensory input and has been described as “cortex-like” (Wassum and Izquierdo, 2015). BLA neurons fire strongly to stimuli and outcomes during learning (Sias et al., 2021) and glutamatergic activity in BLA tracks learning (Malvaez et al., 2019). This may potentiate specific stimulus-outcome links (Kyriazi et al., 2018). In contrast, the CeA is directly connected to the hypothalamus and brainstem, facilitating motor and autonomic responses (LeDoux et al., 1988). Stimulating CeA neurons or projections broadly elicits motivational responses such as freezing (Li et al., 2013; Fadok et al., 2017) or feeding (Han et al., 2017; Douglass et al., 2017), even without a stimulus-outcome association. Although these motivation-related responses may support generalized memory behaviors (i.e., a link between cue and motivation), such findings also suggest that the CeA may play a broader role as an output structure supporting defensive or appetitive behaviors (Fadok et al., 2018; Moscarello and Penzo, 2022) beyond memory. Further, in contrast to the hippocampus and striatum, little work in the amygdala has simultaneously measured BLA and CeA computations in the same learning task in order to delineate their roles.
Interactions Between Subsystems Within a Region
Above we highlighted cross-species evidence that the hippocampus, striatum, and amygdala each contain at least two subsystems supporting distinct memories. These findings present a more precise brain/memory mapping and provide a framework for understanding behavioral consequences of co-located memory representations.
Nature of Interactions
Just as having multiple memory systems spread across the brain can promote cooperation or competition, housing memory subsystems within the same brain region provides opportunities for interactions. Co-locating may lead to competitive interactions due to shared anatomy and common input/output structures, or to parallel processing, akin to the division of labor between the dorsal and ventral visual streams (Nassi and Callaway, 2009). Another related possibility is that the two subsystems could regulate each other, such that one subsystem controls the expression of the other subsystem. Here, we explore these possibilities and illustrate support for interacting and/or parallel representations across subsystems. We also consider why such co-location may be adaptive for facilitating behavior.
Hippocampus
By being co-located in the hippocampus, episodic memory and statistical learning can function in parallel to support differentiated or integrated memory representations, respectively. For example, CA1 (MSP) shows increased pattern similarity for related items (evidence of integration), while CA2/3/DG (TSP) simultaneously exhibits pattern differentiation of related items (Dimsdale-Zucker et al., 2018; Molitor et al., 2021).
That said, co-location of these opposing representations could foment competition, especially as the hippocampus ultimately sends a single output representation to cortex (Schapiro et al., 2017). For example, a recent neural network model of category learning found a trade-off between MSP and TSP: lesioning the TSP (such that only MSP was intact) led to enhanced categorization and generalization relative to if both systems were intact (Sucevic and Schapiro, 2022), suggesting that the TSP (which represented specific exemplars) impeded the ability to optimally learn category structure. Empirically, a recent study by Sherman and Turk-Browne (2020) measured competition in a task that allowed for simultaneous encoding of statistical regularities and episodic memories. They found that statistical learning interfered with episodic memory: statistically predictive images were remembered worse than non-predictive images. Providing initial evidence that the hippocampus was the locus of this trade-off, patterns of hippocampal activity measured with fMRI represented statistical predictions, and the stronger the hippocampal prediction, the worse the average memory for predictive images across participants.
The presence of dual-coding strategies within the hippocampus, with CA1 (MSP) supporting integration and CA2/3/DG (TSP) supporting separation (Schapiro et al., 2017; Molitor et al., 2021), may facilitate adjusting behavior based on task demands. For example, when both integrated or separated encoding strategies are available (as in Sherman and Turk-Browne, 2020), it may be more efficient to focus on integration, thus enabling generalization and prediction, even at the cost of remembering specifics. Indeed, a recent neural network model demonstrated that forgetting is necessary to efficiently learn statistics, as encoding each individual experience may lead to overfitting and learning of unreliable statistical structures (Endress and Johnson, 2021). However, when the task is set up to clearly promote either a separation-based episodic strategy (Chanales et al., 2017) or an integration-based inference strategy (Molitor et al., 2021), then co-location may enable these subsystems to adaptively inhibit each other to support the optimal behavior.
Striatum
A similar push-and-pull relationship exists in the striatum for habits and goal-directed associations, with evidence that these two subsystems can directly regulate one another (rather than merely compete under certain circumstances, as in the hippocampus). In animals, habits are thought to emerge from extended practice, such that over time responses persist even if the outcome is devalued (Dickinson, 1985) (described in greater detail below; we note that it remains unclear whether such an “over-training” mechanism exists in humans; de Wit et al., 2018; Pool et al., 2022). Nevertheless, recent theories posit that habits and goals are intricately linked, with habits and goal-directed associations stored in parallel, working in concert to guide action (Cushman and Morris, 2015; Balleine and Dezfouli, 2019; Bouton, 2021). For example, a recent behavioral study of human motor sequencing by Hardwick et al. (2019) highlighted the importance of time in toggling between these representations: with time limits, habits automatically drove behavior, but given additional time, goal-directed associations replaced these responses. Attentional demands can also modulate the use of habits vs. goal-directed associations: If the link between a stimulus and reward is uncertain, goal-directed behavior is maintained over habits, presumably because more attention must be allocated to the outcome (Thrailkill et al., 2018).
After a habit is established, inactivation of the DLS renews expression of goal-directed associations (Zapata et al., 2010; Corbit et al., 2012), suggesting an inhibitory relationship between DLS and DMS. However, a key challenge in detecting competition is that many tasks rely on insensitivity to outcome devaluation. Outcome devaluation is an experimental manipulation in which a rewarding outcome is made less desirable (e.g., through satiation or pairing the outcome with something aversive). Persistence in performing the response that produces the outcome reflects insensitivity to devaluation, often interpreted as evidence for habitual representations. However, despite the fact that such devaluation is interpreted as evidence of habits, outcome devaluation could in fact emerge from impaired goal-directed associations and/or enhanced habit formation (de Wit et al., 2018). Critically, Turner et al. (2022) developed a novel action sequence task for rodents, in which optimal performance could be achieved through habitual behavior. By incentivizing the use of habits, their task provided a measure of habitual behavior without relying on outcome devaluation. In this paradigm, they also observed a double dissociation between DLS/DMS and habit/goal behavior, supporting the notion that these representations map onto striatal subregions and do indeed compete.
The co-location of habits and goals in the striatum might allow them to regulate each other based on task demands. For example, under time pressure (Hardwick et al., 2019) or cognitive load (Haith and Krakauer, 2018), the striatum can default to habitual behavior (via DLS). However, co-located circuitry (DMS) promoting goal-directed behavior may override habits in favor of specific task- or context-relevant behaviors.
Amygdala
The separable amygdala subregions supporting specific versus general processing may also interact. Time may play a role in arbitrating between BLA and CeA representations. Early theories posited that these amygdala subregions operate “serially” such that information is first learned in BLA and then transferred to CeA, which controls the expression of learning (LeDoux, 2000). Indeed, BLA tends to be important for acquiring stimulus-outcome relations, whereas over time CeA becomes responsible for expression of the learned association (Lázaro-Muñoz et al., 2010; Murray et al., 2015). However, these two systems can also operate in parallel (Balleine and Killcross, 2006). This parallel processing theory is supported by double dissociations, whereby lesions to the BLA result in decreased sensitivity to specific outcomes but lesions to the CeA result in general decreases in motivation or reward-seeking (Corbit and Balleine, 2005; see also Everitt et al., 2003). Such dissociations suggest that the two subregions can operate independently, rather than trading off in time. Human behavioral work also provides some indirect evidence for such parallel processing, with demonstrations of dissociable, complementary components of classical conditioning, a form of learning that critically depends on the amygdala (Zhang et al., 2016; Pool et al., 2019). Pool et al. (2019) measured eye movements and pupil size during classical conditioning of a stimulus-outcome association. After the outcome was devalued, the pupil no longer dilated to the conditioned stimulus (indicating specificity and updated outcome value). Surprisingly, participants continued to gaze toward the expected location of the outcome. These findings suggest two parallel Pavlovian conditioning systems: one supporting “consummatory” responses by linking specific properties of a stimulus and salient outcome, and one supporting more general “preparatory” or motivational orienting responses, which persist regardless of whether the outcome is desired. Although this behavioral evidence of parallel conditioning processes is intriguing, it is unclear whether or how these processes are instantiated in amygdala subregions. A possibility suggested by the MMSS framework is that these consummatory and preparatory forms of classical conditioning map onto the BLA and CeA, respectively.
There are also circumstances under which amygdala subsystems compete. A recent study examined the effect of BLA lesions in both humans and rodents on a threat avoidance task (Terburg et al., 2018). BLA lesions decreased selection of a “rapid escape” behavior and facilitated autonomic reactions (human startle potential and rodent freezing) associated with CeA (Li et al., 2013; Fadok et al., 2017). Indeed, BLA acts on CeA in an inhibitory manner: during active escape, BLA inhibits CeA (thus reducing freezing), but when BLA is damaged or inactivated, the CeA representation dominates (see also Rosenkranz et al., 2006; Tye et al., 2011).
The presence of general and specific associations in the amygdala may enable flexibility. In real-world settings, outcome values are likely to fluctuate (e.g., shifting satiety levels change the desirability of food rewards). Thus, tracking stimulus-outcome contingencies through parallel systems (i.e., Pool et al., 2019) would enable flexible and efficient adaptation across states without having to re-encode values as they subjectively fluctuate. However, in cases when only one representation should ultimately serve to guide behavior (as in the case of freezing or avoiding; Terburg et al., 2018), these representations can inhibit one another to guide behavior.
Factors Modulating Use of Subsystems
Above we provided examples of how co-locating memory subsystems within a canonical memory-related brain region can promote adaptive interactions or parallel functions to support behavior. What are the circumstances under which a subsystem is preferentially used? A number of contextual factors may contribute, many of which overlap with the modulatory factors that have been considered in the traditional Multiple Memory Systems framework (see “Traditional Taxonomy of Multiple Memory Systems: One Memory, One Brain Region”). For example, one modulatory factor may be time: in the hippocampus, episodic memories are formed after a single experience but statistical regularities require integration across multiple experiences (e.g., Schapiro et al., 2017); in the striatum, goal-directed learning can occur quickly but habits are formed gradually (e.g., Balleine and O’Doherty, 2010); and in the amygdala, memory for specific stimulus-outcome associations may drive behavior early in learning, but general approach behaviors come to be expressed over time (e.g., Murray et al., 2015). Another modulatory factor may be stress, which we consider in greater depth later (see “Implications of Multiple Memory Subsystems: Stress as a Case Study”). Here we consider neurobiological forms of modulation, namely how prefrontal cortex and neurochemical signaling may control the expression of different memory subsystems.
Prefrontal Cortical Modulation
Hippocampus
Medial prefrontal cortex (mPFC) is a key candidate for arbitrating between hippocampal subsystems. Hippocampal-mPFC interactions have been shown to support both gradual, integrated memory representations in humans (Schlichting and Preston, 2015) and rapid, separated memory representations in rodents (Eichenbaum, 2017). Such interactions may play a specialized role during memory consolidation, which has been associated with the gradual transformation of episodic memories into more generalized, statistical, and semantic memories (McClelland et al., 1995), in both humans (Tompary and Davachi, 2017; Graves et al., 2022) and rodents (Richards et al., 2014).
Striatum
mPFC is also a candidate for modulating striatal subsystems, with rodent studies showing that separable mPFC subregions support the gradual formation of habits (Smith and Graybiel, 2013) versus the rapid learning of goal-directed associations (Killcross and Coutureau, 2003; Hart et al., 2018). Orbitofrontal cortex (OFC) also plays an important role in shifting between habits and goals (Turner et al., 2022), with OFC activation promoting DMS-dependent goal-directed behavior (Gremel and Costa, 2013).
Amygdala
Similar prefrontal regions (OFC and mPFC) have extensive connectivity with BLA: BLA-OFC interactions support stimulus-specific reward memories (Lichtenberg et al., 2017; Malvaez et al., 2019; Sias et al., 2021), and mPFC-BLA interactions regulate fear memory expression (Marek et al., 2013). However, mPFC does not seem to be directly connected to CeA (Arruda-Carvalho and Clem, 2015); instead, BLA-CeA circuits may themselves provide a mechanism for flexibly switching between general and specific representations based on task demands (Kim et al., 2017b).
Neuromodulatory Influences
Hippocampus
Acetylcholine may play an important role in arbitrating between hippocampal subsystems. High levels of acetylcholine are associated with facilitated inputs from EC into the hippocampus, and reduced influence of CA3 on CA1 (for review, see Hasselmo, 2006), suggesting that acetylcholine could bias the hippocampus towards MSP-dependent statistical learning. There is also indirect evidence for the role of acetylcholine in toggling between memory states in humans from studies that capitalize on the fact that novelty is associated with acetylcholine release in the hippocampus (Giovannini et al., 2001). Namely, participants are biased toward encoding when the preceding trial contains a novel item and towards retrieval when the preceding trial contains a familiar item (Duncan et al., 2012). Novelty also biases decisions away from the use of individual episodes and toward the use of incrementally learned associations (Duncan et al., 2019), consistent with our proposal that acetylcholine may promote statistical learning.
Striatum
Multiple neuromodulatory systems may mediate the switching between habits and goals. Dopamine transmission plays a role in the transition from goal-directed to habitual behavior, with dopamine downregulation associated with reduced habit formation and dopamine upregulation associated with faster habit formation (for review, see Costa, 2007; Wickens et al., 2007). Such an effect may result from opposing effects of dopamine in DLS and DMS: systemic exposure to a dopamine agonist (methamphetamine) promotes dendritic spine growth in DLS but reduces spines in DMS (Jedynak et al., 2007). The endocannabinoid system has also been implicated in the shift from goal-directed to habit behavior: blocking endocannabinoid signaling (via mutations to endocannabinoid receptors, both systemically and locally in OFC-striatal circuits) results in reduced habit formation and a bias towards goal-directed behavior (Hilário et al., 2007; Gremel et al., 2016).
Amygdala
There are several neuromodulatory candidates for mediating the switching between specific and general representations in the amygdala. For example, dopamine modulates fear generalization within CeA, with higher dopamine levels associated with greater discriminability (less generalization; De Bundel et al., 2016; Jo et al., 2018). Noradrenaline is also associated with increased precision of memories in BLA (Bahtiyar et al., 2020), which may promote specific representations. However, although much work has examined the effect of neuromodulators within BLA or CeA independently, the MMSS framework highlights the need to investigate neuromodulatory mechanisms that mediate switching between these two subsystems and their representations.
Why co-locate opposing subsystems?
Throughout this section, we have explored modulatory factors and behavioral consequences arising from co-locating opposing subsystems. We propose that housing opposing memory representations within the same region may promote adaptive behavior. This is perhaps most evident in the hippocampus, in which the output subregion of the hippocampus to cortex (CA1) is part of both the MSP and TSP. CA1 may therefore serve as a computationally efficient “bottleneck”, ensuring that only one memory representation (episodic or statistical) is propagated forward to drive behavior, rather than relying on a separate brain region to arbitrate between the two competing memory representations. Similar principles may also be at play in the striatum, with DMS and DLS inhibiting one another to regulate the expression of habits vs goals, and in the amygdala, with BLA-CeA circuits arbitrating between specific and general responses (perhaps due to CeA being the output region of the amygdala). Future work aimed at precisely targeting the nature of these interactions at both the behavioral and neural level will be important for supporting these hypotheses.
Interactions Between Subsystems Across Regions
Thus far, we have outlined how the hippocampus, striatum, and amygdala each contain two subsystems supported by local circuitry and promoting distinct memories. Carefully examining these memory subsystems illuminates mnemonic features that are consistent across these three regions.
For example, episodic memories (TSP of hippocampus), goal-directed associations (DMS of striatum), and specific cue-outcome associations (BLA of amygdala) represent more “specific” associations. Episodic memories reflect the encoding of a single, unique experience; goal-directed associations reflect a link between a context- or goal-specific stimulus and an associated response/outcome; and specific conditioned associations reflect the link between a certain sensory cue and a given outcome. In this way, these representations may all be considered “separated”, in that they are acquired rapidly and held distinct from other, related memories in order to avoid interference (hippocampus: Wanjia et al., 2021; DMS: Bradfield et al., 2013; amygdala: Sias et al., 2021). This separation enables the flexible use of such memories; for example, storing multiple, separated goal-directed associations allows for the appropriate selection of an action based on a given context or goal.
In contrast, statistical learning (MSP of the hippocampus), habits (DLS of the striatum), and general cue-outcome associations (CeA of amygdala) represent more “general” associations that require the gradual integration of related experiences across time. Statistical learning reflects the abstraction over many idiosyncratic instances in order to uncover generalizable patterns; habits reflect persistent expression of stimulus-evoked responses acquired over many repetitions; and general conditioned associations reflect the link between a stimulus and a broad motivational outcome (rather than a stimulus-specific response). Such integrated learning may give rise to more rigid representations that guide behavior automatically or in a context-insensitive manner.
Distinguishing along these axes highlights shared computations across subsystems from different brain regions. By labeling these commonalities, we aim to highlight representational similarities that can clarify existing findings and generate novel hypotheses, rather than define a strict taxonomy. These also suggest key organizational principles, indicating broader categories of memory representations that may coordinate or be similarly modulated. In this section, we explore examples of how subsystems across regions coincide in the learning computations they recruit and the behaviors they support, and we discuss predictions arising from these commonalities.
Nature of Interactions
Consistent with our proposal of similar computations across memory-related brain regions, there is evidence for overlap in the kinds of memory representations supported by subsystems housed in the hippocampus, striatum, and amygdala. Here we consider how similarities in mnemonic processes may give rise to shared function and facilitation across subsystems.
Hippocampus and Striatum
Coordinated representations of flexible, specific, and distinct memories have been studied most thoroughly for the hippocampus and DMS. These are anatomically connected (Groenewegen et al., 1991) and jointly involved in spatial learning and memory (White, 2009; Goodroe et al., 2018), although they may play distinct roles (van der Meer et al., 2010). Hippocampal-DMS connectivity has been related to memory success (Delcasso et al., 2014; Nyberg et al., 2016; Ness et al., 2022) and spatial navigation ability (DeCoteau et al., 2007; Brown et al., 2012) across species. One prediction arising from the MMSS framework is that TSP (DG and CA3) would be most similar to and interactive with DMS, supporting rapidly acquired, separated representations. Future work examining functional connectivity among subregions of the hippocampus and striatum could directly test these hypotheses. For example, when goal-directed or single-shot learning is required, this may promote coupling between DMS and hippocampal area CA3/DG. The MMSS framework also raises hypotheses about the other subsystems within these regions: for example, there may be more coupling between DLS and CA1 when expressing more rigid, habit-like memories.
Hippocampus and Amygdala
Interactions between the hippocampus and the BLA subsystem in the amygdala also facilitate episodic (Inman et al., 2018) or episodic-like memory (Bass et al., 2014). Again, the MMSS framework predicts that the TSP hippocampal subsystem in particular would be most closely tied to BLA. Further, given the overlap between the CeA and MSP in supporting generalized forms of memory, we hypothesize that these regions facilitate each other. This would be consistent with behavioral work demonstrating that general (category-level) classical conditioning facilitates episodic memory generalization (Starita et al., 2019). After undergoing a threat conditioning paradigm in which shocks were paired with exemplars of one category (e.g., animals) but not another (e.g., tools), participants showed greater generalization of episodic memories from the threat-associated category (i.e., memories for animal exemplars were less precise). This work suggests that the general association between shock and a semantic category (perhaps supported by CeA) may bias the hippocampus towards a more generalized memory encoding strategy (perhaps supported by MSP).
Striatum and Amygdala
DMS and BLA both support learning specific stimulus-response-outcome associations (Corbit et al., 2013; Fisher et al., 2020) and updating temporal expectations during classical conditioning (Dallérac et al., 2017). This pairing is consistent with our MMSS framework, in that both DMS and BLA are argued to support rapidly acquired, separated representations. Coordination between the striatum and amygdala may extend to general, integrated subsystems as well, as DLS and CeA work together to support habit formation (Lingawi and Balleine, 2012; Murray et al., 2015) and classical conditioning (Han et al., 1997).
Just as housing multiple memory subsystems within a given brain region can give rise to competition, similarities in mnemonic processes (combined with subtle computational differences) across regions may promote antagonistic interactions. For example, despite playing cooperative roles as described above, lesions to hippocampus and DMS can have opposite effects in reversal learning paradigms. In a typical reversal learning paradigm, rodents learn cue/reward associations; eventually, these are “reversed”, requiring the rodent to re-learn which cue predicts reward. Notably, performance is worse if reversal occurs in the same context as learning (compared to in a new environment). Lesions to the hippocampus block this context-sensitivity (i.e., rodents perform equally well on the reversal task regardless of context), whereas DMS lesions exaggerate context sensitivity (even worse performance when reversal was encountered in the same environment as initial learning; McDonald et al., 2008), suggesting that these regions may support parallel representations when both are intact. However, evidence of direct competition is lacking, and further work is needed to assess how subsystems supporting similar mnemonic representations across regions might compete.
Factors Modulating Use of Subsystems
A central tenet of MMSS is the observation that similar mnemonic processes can be housed in different structures. Although above we have discussed many examples in which related subsystems may support similar behaviors, this raises questions about how and why they may support distinct aspects of behavior. Here, we consider how connectivity patterns and neuromodulatory influences may control the use (and facilitation) of computationally similar subsystems.
The connectivity patterns (and associated modality preferences) of a given brain region may bias the use of memory subsystems. For example, both the MSP (hippocampus) and DLS (striatum) support gradual learning of temporally predictable sequences. However, the MSP has been implicated in the passive extraction of stimulus regularities (Schapiro et al., 2016), whereas DLS has been implicated in the learning of motor sequences (Yin, 2010). The hippocampus receives input from many regions which process different sensory modalities (Turk-Browne, 2019) and thus may be well-suited to represent visual or auditory sequences, whereas the striatum is highly connected to the motor system (Hintiryan et al., 2016) and thus may be well-suited to represent action sequences. This raises the intriguing possibility that DLS and MSP may jointly enable the learning of visuomotor information, which may perhaps shed light on why the hippocampus is required for the consolidation of motor sequence memories (Schapiro et al., 2019).
Neuromodulators may also play a role in broadly promoting particular mnemonic processes, facilitating cooperation among related subsystems. For example, the noradrenergic system is thought to promote the formation of specific, vivid memories (particularly under arousal), whereas the dopaminergic system is thought to promote more integrated memory representations (particularly when engaging in exploration or novelty-seeking; Clewett and Murty, 2019). Although this model of neuromodulator function has largely been considered in the context of emotional memory, the MMSS framework presented here — which proposes the existence of similar mnemonic processes in different memory-related brain regions — makes novel and broader predictions about the roles of these neuromodulators in the formation of memory. We anticipate that the noradrenergic system will broadly facilitate subsystems across brain regions that are involved in rapidly-acquired, specific associations (including episodic, goal-directed, and specific conditioning representations; see also Atucha et al., 2017; Bahtiyar et al., 2020). In contrast, we predict that the dopaminergic system will broadly facilitate subsystems involved in more integrated, generalized associations (statistical learning, habits, and general conditioning; see also Shohamy and Wagner, 2008).
Other neuromodulators may also arbitrate between the use of similar subsystems across regions. Although existing work has so far focused on memory systems rather than subsystems, this literature suggests intriguing neuromodulator candidates. For example, acetylcholine modulates switching between hippocampal place and striatal response strategies (Chang and Gold, 2003; Pych et al., 2005), suggesting a role in modulating competition between memory systems (see Gold, 2003). Drawing closer to the MMSS model, acetylcholine may modulate related memory subsystems housed in the amygdala and hippocampus. Specifically, hippocampal acetylcholine levels modulate the acquisition of hippocampal-dependent context conditioning vs. amygdala-dependent tone conditioning in a dose-dependent manner (Calandreau et al., 2006). This suggests that acetylcholine may modulate competition between specific representations across the hippocampus and amygdala (i.e., specific context-shock vs specific tone-shock). To the extent that acetylcholine facilitates the preferential expression of related memories supported by different brain regions, it may also arbitrate between memory subsystems housed in these distinct structures.
Why distribute related memory processes across brain regions?
In “Why co-locate opposing subsystems?”, we considered why it may be adaptive to house opposing memory representations within the same brain region. Here, we have highlighted evidence for similar mnemonic processes across different brain regions. Rather than being fully redundant, we propose that similar computations across memory regions may function adaptively by supporting distinct aspects of behavior. For example, perhaps the hippocampus and DMS are both useful for spatial navigation because the hippocampus supports memory for the environment (e.g., a cognitive map) and DMS promotes the use of a specific goal-directed motor plan within that environment. On the other hand, overlapping computations across brain regions provides redundancy that may allow for compensation in the case of brain damage. Future work employing precise lesion techniques (i.e., to knock out specific subregions/circuits of these regions) is needed to adjudicate these hypotheses.
Implications of Multiple Memory Subsystems: Stress as a Case Study
In proposing the MMSS framework, our goal is to not only capture contemporary findings of memory organization in the brain, but also to drive future research and help to account for some findings that traditional Multiple Memory Systems theory fails to explain. Here, as a case study, we explore how the MMSS framework may guide future work on how stress impacts different forms of memory.
The Multiple Memory Systems framework has been highly influential in stress research. Rather than unilaterally enhancing or impairing all memories, stress is thought to modulate the relative engagement of memory systems (e.g., shifting from hippocampal-dependent to striatal-dependent memories; Goldfarb and Phelps, 2017; Schwabe et al., 2022). The MMSS framework proposed herein suggests novel perspectives on how stress alters memory. Specifically, we consider how the traditional Multiple Memory Systems framework does not account for some aspects of how stress influences memory and we consider how the MMSS framework may or may not account for such findings.
Hippocampus.
Consistent with traditional Multiple Memory Systems proposals that stress disrupts hippocampal-based memory processing (Goldfarb and Phelps, 2017), stress negatively affects the TSP subsystem in rodents (Chen et al., 2010a,b) and episodic memory retrieval in humans (Gagnon and Wagner, 2016). However, our framework raises the possibility that the other subsystem (MSP) may not be affected in the same way. Indeed, rodent CA1 (MSP) is largely spared from negative effects of stress (Yamada et al., 2003) and may even be enhanced by stress (Karst and Joëls, 2005; Vandael et al., 2021). In humans, stress promotes “gist”-like memories with less specificity (e.g., Qin et al., 2012) and integration across related episodes (Bierbrauer et al., 2021), as well as detection of probability-based regularities associated with statistical learning (Tóth-Fáber et al., 2021). The MMSS framework both helps to reconcile these apparently contradictory stress-induced enhancements and impairments of hippocampal function, and raises the novel possibility that other “general”, MSP-dependent hippocampal memory functions may be enhanced under stress.
Striatum.
In contrast to opposing effects across hippocampal subsystems, emerging evidence indicates that stress may enhance both striatal subsystems. In rodents, administration of the stress-related glucocorticoid hormone into DLS (Siller-Pérez et al., 2017) enhances stimulus-response memory, consistent with human findings that stress facilitates a shift towards stimulus-response memory (Schwabe et al., 2022) and habit formation (i.e., higher affective stress associated with early adoption of habitual behavior; Pool et al., 2022). Intriguingly, there is preliminary evidence in rodents that administration of glucocorticoids into DMS also enhances memory associated with this subsystem (Lozano et al., 2013), and in humans that glucocorticoid responses are associated with enhanced DMS-related updating in a cognitive flexibility task (Goldfarb et al., 2017). However, other recent work found that — when pitting stimulus-response and goal-directed strategies against one another in the same task — stress reduced reliance on goal-directed behavior (Meier et al., 2022). The MMSS framework underscores the need to consider the differential effects of stress on behaviors associated with subsystems, calling for more work in this area.
Amygdala.
It remains unclear how stress affects amygdala subsystems. Behaviorally, stress appears to promote general rather than specific representations. In rodents, systemic glucocorticoid agonists disrupt specific Pavlovian-to-Instrumental Transfer (Zorawski and Killcross, 2003). Systemic glucocorticoids and acute stressors also impair flexible updating of conditioned associations in humans (Merz et al., 2014; Raio et al., 2017), while promoting general transfer, or increased “wanting” (i.e., greater desire/increased effort to obtain a reward, despite no increases in the hedonic value of the reward; Pool et al., 2015). Work across species demonstrates that stress and glucocorticoids promote over-generalization of fear memories (Dunsmoor et al., 2017; dos Santos Corrêa et al., 2019). However, this behavioral evidence that stress biases the amygdala toward general representations needs neurobiological validation. Rodent research has yielded mixed findings, with evidence both that stress facilitates BLA (Roozendaal et al., 2009) and impairs BLA structure and function, with effects varying based on stressor type and BLA neuron connectivity profiles (Zhang et al., 2021). Further, effects of stress on CeA are understudied (Roozendaal and McGaugh, 1997); although there is some evidence that glucocorticoid administration in CeA leads to the enhanced retention of fear memories (Thompson et al., 2004), whether these memories are general or specific remains unclear. Finally, it is unclear how stress-induced BLA enhancements map onto behavioral expressions of memory. Here too, the MMSS framework indicates novel testable hypotheses regarding stress effects on these representations.
Summary.
Together, the MMSS framework may help to account for distinct effects of stress across memory subsystems within a canonical memory-related brain region. Indeed, claiming that stress impairs an entire brain region (e.g., “hippocampal memory”) may be misleading. The MMSS theory suggests the intriguing possibility that stress enhances “general” representations across brain structures (a proposal that would not have arisen from the traditional Multiple Memory Systems framework), though more work is needed to determine whether this occurs in the striatum (where there is some evidence indicating that both subsystems are enhanced) and how the neural correlates of stress actions on the amygdala map onto behavioral observations of more generalized conditioned associations. This framework also provides a roadmap for future work to gain a comprehensive understanding of how stress adaptively alters memory. For example, the majority of studies examining the effects of stress on multiple memory systems have designed tasks to pit episodic/cognitive map-dependent behavior (hippocampus) and stimulus-response-dependent behavior (striatum) against one another. However, to understand how stress influences memory subsystems, it will be important for future work to design tasks which pit the dual mnemonic functions of a given brain region against each other (i.e., examining whether stress promotes the learning of statistical regularities over episodic memories, or the formation of general over specific conditioned associations).
Avenues Forward and Concluding Remarks
In this review we present comprehensive behavioral and biological evidence for a novel framework of Multiple Memory Subsystems or MMSS. We identified that three traditional memory-related structures in the brain — the hippocampus, striatum, and amygdala — all support at least two distinct and seemingly incompatible mnemonic representations. Our goal in putting forth this framework is to (i) account for existing findings that cannot be accounted for by traditional Multiple Memory Systems theories and (ii) present novel avenues for future research. Here, we discuss several additional areas in which we think the MMSS framework holds promise, while identifying gaps to be filled by future research.
Assessing the strengths and weaknesses of evidence
In developing this framework, we integrated findings across nonhuman animal, human, and computational research (Table 1). Although synthesizing across multiple lines of evidence helped to build a comprehensive theory, we also identified gaps for future research across species. For example, whereas animal work allows for high resolution to measure and manipulate subsystems, human work is better suited to probe behavioral correlates of different subsystems. To test the predictions of the MMSS framework, there is a need to combine neural precision with sophisticated task design and behavioral phenotyping. For example, in nonhuman animal models, the quality of memory representations supported by distinct hippocampal subsystems are either understudied (e.g., statistical learning) or difficult to compare to human processes (e.g., recollection of episodic memories). In humans, on the other hand, many neuroimaging studies do not have the (anatomical and/or functional) resolution to distinguish hippocampal subfields and thus may be insensitive to subsystem representations. That said, differences in representation along the longitudinal axis of the hippocampus may be informative (Poppenk et al., 2013). Specifically, the distribution of hippocampal subfields differs across the longitudinal axis, such that MSP is over-represented in anterior hippocampus and the TSP is over-represented in posterior hippocampus (Malykhin et al., 2010; Schapiro et al., 2017). This proposed distinction converges with findings that anterior hippocampal activation relates to statistical learning (Turk-Browne et al., 2010; Ellis et al., 2021) and that representational differentiation in posterior hippocampus predicts episodic memory (Callaghan et al., 2021).
Table 1.
Claim | Region | Evidence Strength | Primary Evidence | Key Citations |
---|---|---|---|---|
The same memory structure can support opposing computations | Hippocampus | *** | CA3 (TSP) supports a pattern-separated code CA1 (MSP) supports an integrated code |
Lee et al (2004)1
Molitor et al (2021)2 |
Striatum | *** | DLS activity marks “boundaries” between action sequences DMS activity ramps up until decision is executed |
Thorn et al (2010)1
Vandaele et al (2021)1 |
|
Amygdala | ** | BLA facilitates learning of stimulus-outcome links CeA facilitates motivational responses/behavioral output |
Sias et al (2021)1
Fadok et al (2017)1 |
|
The same memory structure can support both “specific” and “general” memory representations | Hippocampus | *** | TSP can support episodic memory (specific)
MSP can support statistical learning (general) |
Schlichting et al (2014)2
Schapiro et al (2017)3 Schlichting et al (2021)2 |
Striatum | ** | DMS can support goal-directed behavior (specific)
DLS can support habits (general) |
McNamee et al (2015)2
Turner et al (2022)1 |
|
Amygdala | * | BLA supports specific Pavlovian-to-Instrumental Transfer (PIT) CeA supports general PIT |
Corbit & Balleine (2005)1
Prévost et al (2012)2 |
|
Similar mnemonic computations are supported by distinct structures | Hippocampus & Striatum | *** | Hippocampus (subregion unspecified) and DMS: jointly involved in learning specific associations in context of spatial learning |
DeCoteau et al (2007)1
Brown et al (2012)2 |
Hippocampus & Amygdala | *** | Hippocampus (subregion unspecified) and BLA: facilitate specific associations in context of episodic/episodic-like memory |
Bass et al (2014)1
Inman et al (2018)2 |
|
Striatum & Amygdala | *** | BLA and DMS: support learning specific stimulus-response-outcome associations CeA and DLS: support formation of general habit memories |
Corbit et al (2013)1
Lingawi & Balleine (2012)1 |
Evidence Type:
Rodent;
Human;
Neural network model
Combining across human and animal work is also necessary to derive a comprehensive understanding of how subsystems interact and ultimately give rise to behavior. Although animal work is well-suited to deeply characterize individual subsystems or regions, as well as neuromodulatory factors (perhaps enabling work on how subsystems within a region interact), human whole-brain imaging enables the interrogation of multiple subsystems at once (perhaps enabling work on how subsystems across regions interact). Neural network models of memory regions that incorporate subsystem representations may also be critical for advancing the MMSS theory: such models enable the selective “lesioning” of one subsystem (as has been done in the hippocampus; Schapiro et al., 2017; Sucevic and Schapiro, 2022) which may help delineate the circumstances under which a given subsystem representation will dominate and yield precise, testable empirical hypotheses.
Fortifying the MMSS framework
The MMSS framework was inspired by key observations that the hippocampus (e.g., Schapiro et al., 2017), striatum (e.g., Balleine and O’Doherty, 2010), and amygdala (e.g., Balleine and Killcross, 2006) each have opposing memory representations across subregions/circuits within these brain regions (see also Table 1). However, relative to the vast literature on these memory-related regions, there is relatively little work on their subsystems, requiring integration across disparate studies and fields designed to study a given subregion in isolation. A goal of our framework is to inspire future, targeted investigations of subsystems, which will not only provide important tests of our framework, but also have the potential to uncover novel, unexpected empirical findings.
There are open questions about the neurobiological and contextual tenets that govern the use of memory subsystems (also see “Implications of Multiple Memory Subsystems: Stress as a Case Study”). Such questions will benefit from more carefully considering the behavior — rather than merely the brain region — that a particular task solicits, and designing tasks suited to isolate a given subsystem(s). Further studies investigating multiple subsystems in tandem (as in Sherman and Turk-Browne, 2020) will be especially important for validating the MMSS model, particularly in cases where the evidence is limited, such as the amygdala.
Lastly, although we have focused on the hippocampus, striatum, and amygdala, it is possible that the principles identified here may apply to other memory-related regions. For example, the cerebellum has been implicated in some forms of conditioning, such as eyeblink conditioning, in which an auditory or visual cue becomes associated a puff of air to the eye, thus leading to a conditioned eyeblink response. Although more work is needed to understand whether the cerebellum supports multiple distinct types of conditioning, there are indications of functional dissociations within the cerebellum supporting distinct aspects of conditioning behavior (Medina et al., 2002; Thompson and Steinmetz, 2009). For example, separable subregions (cerebellar cortex vs. deep cerebellar nuclei) may support the initial learning vs. storage of conditioned responses (Medina et al., 2002). Intriguingly, there is evidence that cerebellar nuclei continue to represent the conditioned associations even after extinction (Medina et al., 2001), perhaps paralleling behavioral evidence for outcome-insensitive conditioned responses (Pool et al., 2019).
Promise of MMSS as a unifying theory of memory organization
In further validating MMSS, it is possible that the framework will provide a means of clarifying what might seem to be inconsistent findings in the literature. For example, some studies find that greater hippocampal pattern similarity relates to better episodic memory (see Brunec et al., 2020), contrary to the view that pattern separation supports episodic memory. However, many of these tasks only probed episodic memory; it is possible that increased pattern similarity reflects increased memory integration or statistical learning, processes that were not directly measured in behavior. Future work more carefully tailored to isolate the behaviors associated with given subsystems will clarify the link between neural representations and behavioral outcomes.
By observing that there may be common computations across subsystems housed in different regions (see “Interactions Between Subsystems Across Regions”), our framework also promotes the discovery of interventions that act similarly across these regions. As one example, prediction errors (or encountering something that deviates from what you expected) appear to act on these computations in a way that extends across brain regions. Interestingly, prediction error may support both specific and general representations. On the one hand, prediction error can support separation and maintenance of specific representations, in part by shielding memories from interference. In the TSP of the hippocampus, prediction errors promote differentiation of memories (Kim et al., 2017a); in the DMS of the striatum, prediction errors shield previously learned information from updated knowledge (Bradfield et al., 2013); and in classical conditioning (presumably supported by the amygdala), prediction error is thought to separate memories for conditioning vs. extinction (thus making fear memories return even after extinction; Gershman et al., 2013). On the other hand, prediction error can also support the gradual learning of integrated representations via the incremental updating of predictions. This process may contribute to statistical learning (Turk-Browne et al., 2010; Sherman and Turk-Browne, 2020), habit memory (Drummond and Niv, 2020), and general cue-outcome associations (Rescorla, 1972).
In other words, prediction error may play distinct roles in facilitating computations underlying separated vs. integrated representations, and appears to do so in a way that transcends canonical memory-related brain regions. This example holds promise not only for understanding shared computations across similar subsystems housed in different regions, but also for understanding potential mechanisms that govern the use of opposing subsystems within a region. Although untested, one possibility is that when the errors are large and deviate from existing knowledge, a separated representation is rapidly created; in contrast, smaller errors may trigger incremental updating of gradually formed, integrated representations.
In addition to accounting for empirical data and generating novel theoretical hypotheses, the MMSS framework also highlights two notable, yet underexplored patterns in the organization of memory in the brain: The co-location of competing memory representations within a given brain region, and the overlap in mnemonic computations supported by subsystems housed in different brain regions. Given that the traditional Multiple Memory Systems framework highlights the adaptive role of having discrete, anatomically distinct memory systems, the evidence for co-located competition and distal overlap presented here may be puzzling. We argue that both of these organizational principles are adaptive: First, housing competing memory representations within a brain region allows for self-regulation of memory-guided behavior, for example, allowing the goal-directed subsystem to suppress habit memory under disadvantageous circumstances. Second, overlapping computations across canonical memory regions may serve complementary functions. With specific connectivity patterns and computational properties, certain regions may be better suited to support distinct dimensions of memory-guided behavior, and some degree of redundancy across brain regions may be a critical mechanism for shielding complex memories.
Acknowledgments
This article was supported by a National Science Foundation Graduate Research Fellowship (BES); the Canadian Institute for Advanced Research (NBT-B); and National Institutes of Health grants R01 MH069456 (NBT-B), K01 AA027832 (EVG), and R21 MH128740 (EVG).
References
- Amaral DG (1993). Emerging principles of intrinsic hippocampal organization. Current Opinion in Neurobiology, 3(2):225–229. [DOI] [PubMed] [Google Scholar]
- Arruda-Carvalho M and Clem RL (2015). Prefrontal-amygdala fear networks come into focus. Frontiers in Systems Neuroscience, 9:145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Atucha E, Vukojevic V, Fornari RV, Ronzoni G, Demougin P, Peter F, Atsak P, Coolen MW, Papassotiropoulos A, McGaugh JL, et al. (2017). Noradrenergic activation of the basolateral amygdala maintains hippocampus-dependent accuracy of remote memory. Proceedings of the National Academy of Sciences, 114(34):9176–9181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bahtiyar S, Karaca KG, Henckens MJ, and Roozendaal B (2020). Norepinephrine and glucocorticoid effects on the brain mechanisms underlying memory accuracy and generalization. Molecular and Cellular Neuroscience, 108:103537. [DOI] [PubMed] [Google Scholar]
- Bakker A, Kirwan CB, Miller M, and Stark CE (2008). Pattern separation in the human hippocampal CA3 and dentate gyrus. Science, 319(5870):1640–1642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW (2019). The meaning of behavior: discriminating reflex and volition in the brain. Neuron, 104(1):47–62. [DOI] [PubMed] [Google Scholar]
- Balleine BW and Dezfouli A (2019). Hierarchical action control: Adaptive collaboration between actions and habits. Frontiers in Psychology, page 2735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balleine BW and Killcross S (2006). Parallel incentive processing: an integrated view of amygdala function. Trends in Neurosciences, 29(5):272–279. [DOI] [PubMed] [Google Scholar]
- Balleine BW and O’Doherty JP (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology, 35(1):48–69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bass DI, Nizam ZG, Partain KN, Wang A, and Manns JR (2014). Amygdala-mediated enhancement of memory for specific events depends on the hippocampus. Neurobiology of Learning and Memory, 107:37–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Biderman N, Bakkour A, and Shohamy D (2020). What are memories for? the hippocampus bridges past experience with future decisions. Trends in Cognitive Sciences, 24(7):542–556. [DOI] [PubMed] [Google Scholar]
- Bierbrauer A, Fellner M-C, Heinen R, Wolf OT, and Axmacher N (2021). The memory trace of a stressful episode. Current Biology, 31(23):5204–5213. [DOI] [PubMed] [Google Scholar]
- Bornstein AM, Khaw MW, Shohamy D, and Daw ND (2017). Reminders of past choices bias decisions for reward in humans. Nature Communications, 8(1):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME (2021). Context, attention, and the switch between habit and goal-direction in behavior. Learning & Behavior, 49(4):349–362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bradfield LA, Bertran-Gonzalez J, Chieng B, and Balleine BW (2013). The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. Neuron, 79(1):153–166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown TI, Ross RS, Tobyne SM, and Stern CE (2012). Cooperative interactions between hippocampal and striatal systems support flexible navigation. NeuroImage, 60(2):1316–1330. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brunec IK, Robin J, Olsen RK, Moscovitch M, and Barense MD (2020). Integration and differentiation of hippocampal memory traces. Neuroscience & Biobehavioral Reviews, 118:196–208. [DOI] [PubMed] [Google Scholar]
- Calandreau L, Trifilieff P, Mons N, Costes L, Marien M, Marighetto A, Micheau J, Jaffard R, and Desmedt A (2006). Extracellular hippocampal acetylcholine level controls amygdala function and promotes adaptive conditioned emotional response. Journal of Neuroscience, 26(52):13556–13566. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Callaghan B, Gasser C, Silvers JA, VanTieghem M, Choy T, O’Sullivan K, Tompary A, Davachi L, and Tottenham N (2021). Age-related increases in posterior hippocampal granularity are associated with remote detailed episodic memory in development. Journal of Neuroscience, 41(8):1738–1754. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cartoni E, Balleine B, and Baldassarre G (2016). Appetitive pavlovian-instrumental transfer: a review. Neuroscience & Biobehavioral Reviews, 71:829–848. [DOI] [PubMed] [Google Scholar]
- Chanales AJ, Oza A, Favila SE, and Kuhl BA (2017). Overlap among spatial memories triggers repulsion of hippocampal representations. Current Biology, 27(15):2307–2317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chang Q and Gold PE (2003). Switching memory systems during learning: changes in patterns of brain acetylcholine release in the hippocampus and striatum in rats. Journal of Neuroscience, 23(7):3001–3005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen C-C, Yang C-H, Huang C-C, and Hsu K-S (2010a). Acute stress impairs hippocampal mossy fiber-CA3 long-term potentiation by enhancing cAMP-specific phosphodiesterase 4 activity. Neuropsychopharmacology, 35(7):1605–1617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen Y, Rex CS, Rice CJ, Dubé CM, Gall CM, Lynch G, and Baram TZ (2010b). Correlated memory defects and hippocampal dendritic spine loss after acute stress involve corticotropin-releasing hormone signaling. Proceedings of the National Academy of Sciences, 107(29):13123–13128. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ciocchi S, Herry C, Grenier F, Wolff SB, Letzkus JJ, Vlachos I, Ehrlich I, Sprengel R, Deisseroth K, Stadler MB, et al. (2010). Encoding of conditioned fear in central amygdala inhibitory circuits. Nature, 468(7321):277–282. [DOI] [PubMed] [Google Scholar]
- Clark RE and Squire LR (1998). Classical conditioning and brain systems: the role of awareness. Science, 280(5360):77–81. [DOI] [PubMed] [Google Scholar]
- Clewett D and Murty VP (2019). Echoes of emotions past: How neuromodulators determine what we recollect. eNeuro, 6(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbit LH and Balleine BW (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. Journal of Neuroscience, 25(4):962–970. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbit LH, Leung BK, and Balleine BW (2013). The role of the amygdala-striatal pathway in the acquisition and performance of goal-directed instrumental actions. Journal of Neuroscience, 33(45):17682–17690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Corbit LH, Nie H, and Janak PH (2012). Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biological Psychiatry, 72(5):389–395. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Costa RM (2007). Plastic corticostriatal circuits for action learning: what’s dopamine got to do with it? [DOI] [PubMed] [Google Scholar]
- Covington NV, Brown-Schmidt S, and Duff MC (2018). The necessity of the hippocampus for statistical learning. Journal of Cognitive Neuroscience, 30(5):680–697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cushman F and Morris A (2015). Habitual control of goal selection in humans. Proceedings of the National Academy of Sciences, 112(45):13817–13822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dallérac G, Graupner M, Knippenberg J, Martinez RCR, Tavares TF, Tallot L, El Massioui N, Verschueren A, Höhn S, Bertolus JB, et al. (2017). Updating temporal expectancy of an aversive event engages striatal plasticity under amygdala control. Nature Communications, 8(1):1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Bundel D, Zussy C, Espallergues J, Gerfen CR, Girault J-A, and Valjent E (2016). Dopamine D2 receptors gate generalization of conditioned threat responses through mtorc1 signaling in the extended amygdala. Molecular Psychiatry, 21(11):1545–1553. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Wit S, Kindt M, Knot SL, Verhoeven AA, Robbins TW, Gasull-Camos J, Evans M, Mirza H, and Gillan CM (2018). Shifting the balance between goals and habits: Five failures in experimental habit induction. Journal of Experimental Psychology: General, 147(7):1043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeCoteau WE, Thorn C, Gibson DJ, Courtemanche R, Mitra P, Kubota Y, and Graybiel AM (2007). Learning-related coordination of striatal and hippocampal theta rhythms during acquisition of a procedural maze task. Proceedings of the National Academy of Sciences, 104(13):5644–5649. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Delcasso S, Huh N, Byeon JS, Lee J, Jung MW, and Lee I (2014). Functional relationships between the hippocampus and dorsomedial striatum in learning a visual scene-based memory task in rats. Journal of Neuroscience, 34(47):15534–15547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dickinson A (1985). Actions and habits: the development of behavioural autonomy. Philosophical Transactions of the Royal Society of London. B, Biological Sciences, 308(1135):67–78. [Google Scholar]
- Dimsdale-Zucker HR, Ritchey M, Ekstrom AD, Yonelinas AP, and Ranganath C (2018). CA1 and CA3 differentially support spontaneous retrieval of episodic contexts within human hippocampal subfields. Nature Communications, 9(1):1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- dos Santos Corrêa M, dos Santos Vaz B, Grisanti GDV, de Paiva JPQ, Tiba PA, and Fornari RV (2019). Relationship between footshock intensity, post-training corticosterone release and contextual fear memory specificity over time. Psychoneuroendocrinology, 110:104447. [DOI] [PubMed] [Google Scholar]
- Douglass AM, Kucukdereli H, Ponserre M, Markovic M, Gründemann J, Strobel C, Morales PLA, Conzelmann K-K, Lüthi A, and Klein R (2017). Central amygdala circuits modulate food consumption through a positive-valence mechanism. Nature Neuroscience, 20(10):1384–1394. [DOI] [PubMed] [Google Scholar]
- Drummond N and Niv Y (2020). Model-based decision making and model-free learning. Current Biology, 30(15):R860–R865. [DOI] [PubMed] [Google Scholar]
- Duncan K, Sadanand A, and Davachi L (2012). Memory’s penumbra: episodic memory decisions induce lingering mnemonic biases. Science, 337(6093):485–487. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duncan K, Semmler A, and Shohamy D (2019). Modulating the use of multiple memory systems in value-based decisions with contextual novelty. Journal of Cognitive Neuroscience, 31(10):1455–1467. [DOI] [PubMed] [Google Scholar]
- Dunsmoor JE, Otto AR, and Phelps EA (2017). Stress promotes generalization of older but not recent threat memories. Proceedings of the National Academy of Sciences, 114(34):9218–9223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eichenbaum H (2017). Prefrontal–hippocampal interactions in episodic memory. Nature Reviews Neuroscience, 18(9):547–558. [DOI] [PubMed] [Google Scholar]
- Ellis CT, Skalaban LJ, Yates TS, Bejjanki VR, Córdova NI, and Turk-Browne NB (2021). Evidence of hippocampal learning in human infants. Current Biology, 31(15):3358–3364. [DOI] [PubMed] [Google Scholar]
- Endress AD and Johnson SP (2021). When forgetting fosters learning: A neural network model for statistical learning. Cognition, 213:104621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Everitt BJ, Cardinal RN, Parkinson JA, and Robbins TW (2003). Appetitive behavior: impact of amygdala-dependent mechanisms of emotional learning. Annals of the new York Academy of Sciences, 985(1):233–250. [PubMed] [Google Scholar]
- Fadok JP, Krabbe S, Markovic M, Courtin J, Xu C, Massi L, Botta P, Bylund K, Müller C, Kovacevic A, et al. (2017). A competitive inhibitory circuit for selection of active and passive fear responses. Nature, 542(7639):96–100. [DOI] [PubMed] [Google Scholar]
- Fadok JP, Markovic M, Tovote P, and Lüthi A (2018). New perspectives on central amygdala function. Current Opinion in Neurobiology, 49:141–147. [DOI] [PubMed] [Google Scholar]
- Fisher SD, Ferguson LA, Bertran-Gonzalez J, and Balleine BW (2020). Amygdala-cortical control of striatal plasticity drives the acquisition of goal-directed action. Current Biology, 30(22):4541–4546. [DOI] [PubMed] [Google Scholar]
- Foerde K, Race E, Verfaellie M, and Shohamy D (2013). A role for the medial temporal lobe in feedback-driven learning: evidence from amnesia. Journal of Neuroscience, 33(13):5698–5704. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gagnon SA and Wagner AD (2016). Acute stress and episodic memory retrieval: neurobiological mechanisms and behavioral consequences. Annals of the New York Academy of Sciences, 1369(1):55–75. [DOI] [PubMed] [Google Scholar]
- Gardner RS, Gold PE, and Korol DL (2020). Inactivation of the striatum in aged rats rescues their ability to learn a hippocampus-sensitive spatial navigation task. Neurobiology of Learning and Memory, 172:107231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gershman SJ, Jones CE, Norman KA, Monfils M-H, and Niv Y (2013). Gradual extinction prevents the return of fear: implications for the discovery of state. Frontiers in Behavioral Neuroscience, 7:164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gilpin NW, Herman MA, and Roberto M (2015). The central amygdala as an integrative hub for anxiety and alcohol use disorders. Biological Psychiatry, 77(10):859–869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Giovannini M, Rakovska A, Benton R, Pazzagli M, Bianchi L, and Pepeu G (2001). Effects of novelty and habituation on acetylcholine, GABA, and glutamate release from the frontal cortex and hippocampus of freely moving rats. Neuroscience, 106(1):43–53. [DOI] [PubMed] [Google Scholar]
- Gold PE (2003). Acetylcholine modulation of neural systems involved in learning and memory. Neurobiology of Learning and Memory, 80(3):194–210. [DOI] [PubMed] [Google Scholar]
- Goldfarb EV, Froböse MI, Cools R, and Phelps EA (2017). Stress and cognitive flexibility: cortisol increases are associated with enhanced updating but impaired switching. Journal of Cognitive Neuroscience, 29(1):14–24. [DOI] [PubMed] [Google Scholar]
- Goldfarb EV and Phelps EA (2017). Stress and the trade-off between hippocampal and striatal memory. Current Opinion in Behavioral Sciences, 14:47–53. [Google Scholar]
- Goodroe SC, Starnes J, and Brown TI (2018). The complex nature of hippocampal-striatal interactions in spatial navigation. Frontiers in Human Neuroscience, 12:250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Graves KN, Sherman BE, Huberdeau D, Damisah E, Quraishi IH, and Turk-Browne NB (2022). Remembering the pattern: A longitudinal case study on statistical learning in spatial navigation and memory consolidation. Neuropsychologia, 174:108341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gremel CM, Chancey JH, Atwood BK, Luo G, Neve R, Ramakrishnan C, Deisseroth K, Lovinger DM, and Costa RM (2016). Endocannabinoid modulation of orbitostriatal circuits gates habit formation. Neuron, 90(6):1312–1324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gremel CM and Costa RM (2013). Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nature Communications, 4(1):1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Groenewegen HJ, Berendse HW, Wolters JG, and Lohman AH (1991). The anatomical relationship of the prefrontal cortex with the striatopallidal system, the thalamus and the amygdala: evidence for a parallel organization. Progress in Brain Research, 85:95–118. [DOI] [PubMed] [Google Scholar]
- Grospe GM, Baker PM, and Ragozzino ME (2018). Cognitive flexibility deficits following 6-OHDA lesions of the rat dorsomedial striatum. Neuroscience, 374:80–90. [DOI] [PubMed] [Google Scholar]
- Haith AM and Krakauer JW (2018). The multiple effects of practice: skill, habit and reduced cognitive load. Current Opinion in Behavioral Sciences, 20:196–201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Han J-S, McMahan RW, Holland P, and Gallagher M (1997). The role of an amygdalo-nigrostriatal pathway in associative learning. Journal of Neuroscience, 17(10):3913–3919. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Han W, Tellez LA, Rangel MJ Jr, Motta SC, Zhang X, Perez IO, Canteras NS, Shammah-Lagnado SJ, van den Pol AN, and de Araujo IE (2017). Integrated control of predatory hunting by the central nucleus of the amygdala. Cell, 168(1–2):311–324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hardwick RM, Forrence AD, Krakauer JW, and Haith AM (2019). Time-dependent competition between goal-directed and habitual response preparation. Nature Human Behaviour, 3(12):1252–1262. [DOI] [PubMed] [Google Scholar]
- Hart G, Bradfield LA, Fok SY, Chieng B, and Balleine BW (2018). The bilateral prefronto-striatal pathway is necessary for learning new goal-directed actions. Current Biology, 28(14):2218–2229. [DOI] [PubMed] [Google Scholar]
- Hasselmo ME (2006). The role of acetylcholine in learning and memory. Current Opinion in Neurobiology, 16(6):710–715. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henin S, Turk-Browne NB, Friedman D, Liu A, Dugan P, Flinker A, Doyle W, Devinsky O, and Melloni L (2021). Learning hierarchical sequence representations across human cortex and hippocampus. Science Advances, 7(8):eabc4530. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henke K (2010). A model for memory systems based on processing modes rather than consciousness. Nature Reviews Neuroscience, 11(7):523–532. [DOI] [PubMed] [Google Scholar]
- Hilário MR, Clouse E, Yin HH, and Costa RM (2007). Endocannabinoid signaling is critical for habit formation. Frontiers in Integrative Neuroscience, 1:6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hintiryan H, Foster NN, Bowman I, Bay M, Song MY, Gou L, Yamashita S, Bienkowski MS, Zingg B, Zhu M, et al. (2016). The mouse cortico-striatal projectome. Nature Neuroscience, 19(8):1100–1114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holland PC and Gallagher M (1999). Amygdala circuitry in attentional and representational processes. Trends in Cognitive Sciences, 3(2):65–73. [DOI] [PubMed] [Google Scholar]
- Inman CS, Manns JR, Bijanki KR, Bass DI, Hamann S, Drane DL, Fasano RE, Kovach CK, Gross RE, and Willie JT (2018). Direct electrical stimulation of the amygdala enhances declarative memory in humans. Proceedings of the National Academy of Sciences, 115(1):98–103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jedynak JP, Uslaner JM, Esteban JA, and Robinson TE (2007). Methamphetamine-induced structural plasticity in the dorsal striatum. European Journal of Neuroscience, 25(3):847–853. [DOI] [PubMed] [Google Scholar]
- Jo YS, Heymann G, and Zweifel LS (2018). Dopamine neurons reflect the uncertainty in fear generalization. Neuron, 100(4):916–925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jog MS, Kubota Y, Connolly CI, Hillegaart V, and Graybiel AM (1999). Building neural representations of habits. Science, 286(5445):1745–1749. [DOI] [PubMed] [Google Scholar]
- Karst H and Joëls M (2005). Corticosterone slowly enhances miniature excitatory postsynaptic current amplitude in mice CA1 hippocampal cells. Journal of Neurophysiology, 94(5):3479–3486. [DOI] [PubMed] [Google Scholar]
- Killcross S and Coutureau E (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cerebral Cortex, 13(4):400–408. [DOI] [PubMed] [Google Scholar]
- Kim G, Norman KA, and Turk-Browne NB (2017a). Neural differentiation of incorrectly predicted memories. Journal of Neuroscience, 37(8):2022–2031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim J, Zhang X, Muralidhar S, LeBlanc SA, and Tonegawa S (2017b). Basolateral to central amygdala neural circuits for appetitive behaviors. Neuron, 93(6):1464–1479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knowlton BJ, Mangels JA, and Squire LR (1996). A neostriatal habit learning system in humans. Science, 273(5280):1399–1402. [DOI] [PubMed] [Google Scholar]
- Kyriazi P, Headley DB, and Pare D (2018). Multi-dimensional coding by basolateral amygdala neurons. Neuron, 99(6):1315–1328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LaBar KS, LeDoux JE, Spencer DD, and Phelps EA (1995). Impaired fear conditioning following unilateral temporal lobectomy in humans. Journal of Neuroscience, 15(10):6846–6855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lashley K (1950). In search of the engram (vol. 4). In Symp Soc Exp Biol, pages 454–482. [Google Scholar]
- Lázaro-Muñoz G, LeDoux JE, and Cain CK (2010). Sidman instrumental avoidance initially depends on lateral and basal amygdala and is constrained by central amygdala-mediated pavlovian processes. Biological Psychiatry, 67(12):1120–1127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LeDoux JE (2000). The amygdala and emotion: a view through fear. The amygdala: a functional analysis, pages 289–310. [Google Scholar]
- LeDoux JE, Iwata J, Cicchetti P, and Reis DJ (1988). Different projections of the central amygdaloid nucleus mediate autonomic and behavioral correlates of conditioned fear. Journal of Neuroscience, 8(7):2517–2529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee I and Kesner RP (2002). Differential contribution of NMDA receptors in hippocampal subregions to spatial working memory. Nature Neuroscience, 5(2):162–168. [DOI] [PubMed] [Google Scholar]
- Lee I, Rao G, and Knierim JJ (2004). A double dissociation between hippocampal subfields: differential time course of CA3 and CA1 place cells for processing changed environments. Neuron, 42(5):803–815. [DOI] [PubMed] [Google Scholar]
- Leutgeb JK, Leutgeb S, Moser M-B, and Moser EI (2007). Pattern separation in the dentate gyrus and CA3 of the hippocampus. Science, 315(5814):961–966. [DOI] [PubMed] [Google Scholar]
- Lhost J, More S, Watabe I, Louber D, Ouagazzal A-M, Liberge M, and Amalric M (2021). Interplay between inhibitory control and behavioural flexibility: Impact of dorsomedial striatal dopamine denervation in mice. Neuroscience, 477:25–39. [DOI] [PubMed] [Google Scholar]
- Li H, Penzo MA, Taniguchi H, Kopec CD, Huang ZJ, and Li B (2013). Experience-dependent modification of a central amygdala fear circuit. Nature Neuroscience, 16(3):332–339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lichtenberg NT, Pennington ZT, Holley SM, Greenfield VY, Cepeda C, Levine MS, and Wassum KM (2017). Basolateral amygdala to orbitofrontal cortex projections enable cue-triggered reward expectations. Journal of Neuroscience, 37(35):8374–8384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lingawi NW and Balleine BW (2012). Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. Journal of Neuroscience, 32(3):1073–1081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lozano YR, Serafín N, Prado-Alcalá RA, Roozendaal B, and Quirarte GL (2013). Glucocorticoids in the dorsomedial striatum modulate the consolidation of spatial but not procedural memory. Neurobiology of Learning and Memory, 101:55–64. [DOI] [PubMed] [Google Scholar]
- Malvaez M, Shieh C, Murphy MD, Greenfield VY, and Wassum KM (2019). Distinct cortical–amygdala projections drive reward value encoding and retrieval. Nature Neuroscience, 22(5):762–769. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Malykhin NV, Lebel RM, Coupland NJ, Wilman AH, and Carter R (2010). In vivo quantification of hippocampal subfields using 4.7 t fast spin echo imaging. NeuroImage, 49(2):1224–1230. [DOI] [PubMed] [Google Scholar]
- Marek R, Strobel C, Bredy TW, and Sah P (2013). The amygdala and medial prefrontal cortex: partners in the fear circuit. The Journal of Physiology, 591(10):2381–2391. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McClelland JL, McNaughton BL, and O’Reilly RC (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102(3):419. [DOI] [PubMed] [Google Scholar]
- McDonald RJ, King AL, and Hong NS (2008). Neurotoxic damage to the dorsomedial striatum exaggerates the behavioral influence of a context-specific inhibitory association mediated by the ventral hippocampus. Behavioral Neuroscience, 122(1):27. [DOI] [PubMed] [Google Scholar]
- McDonald RJ and White NM (1993). A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behavioral Neuroscience, 107(1):3–22. [DOI] [PubMed] [Google Scholar]
- McKenzie S, Robinson NT, Herrera L, Churchill JC, and Eichenbaum H (2013). Learning causes reorganization of neuronal firing patterns to represent related experiences within a hippocampal schema. Journal of Neuroscience, 33(25):10243–10256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McNamee D, Liljeholm M, Zika O, and O’Doherty JP (2015). Characterizing the associative content of brain structures involved in habitual and goal-directed actions in humans: a multivariate fmri study. Journal of Neuroscience, 35(9):3764–3771. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Medina JF, Christopher Repa J, Mauk MD, and LeDoux JE (2002). Parallels between cerebellum-and amygdala-dependent conditioning. Nature Reviews Neuroscience, 3(2):122–131. [DOI] [PubMed] [Google Scholar]
- Medina JF, Garcia KS, and Mauk MD (2001). A mechanism for savings in the cerebellum. Journal of Neuroscience, 21(11):4081–4089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meier JK, Staresina BP, and Schwabe L (2022). Stress diminishes outcome but enhances response representations during instrumental learning. eLife, 11:e67517. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merz CJ, Hermann A, Stark R, and Wolf OT (2014). Cortisol modifies extinction learning of recently acquired fear in men. Social Cognitive and Affective Neuroscience, 9(9):1426–1434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Milner B (1962). Les troubles de la memoire accompagnant des lesions hippocampiques bilaterales. Physiologie de l’hippocampe, 107:257–272. [Google Scholar]
- Molitor RJ, Sherrill KR, Morton NW, Miller AA, and Preston AR (2021). Memory reactivation during learning simultaneously promotes dentate gyrus/CA2, 3 pattern differentiation and CA1 memory integration. Journal of Neuroscience, 41(4):726–738. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moscarello JM and Penzo MA (2022). The central nucleus of the amygdala and the construction of defensive modes across the threat-imminence continuum. Nature Neuroscience, 25:999–1008. [DOI] [PubMed] [Google Scholar]
- Murray JE, Belin-Rauscent A, Simon M, Giuliano C, Benoit-Marand M, Everitt BJ, and Belin D (2015). Basolateral and central amygdala differentially recruit and maintain dorsolateral striatum-dependent cocaine-seeking habits. Nature Communications, 6(1):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nakashiba T, Young JZ, McHugh TJ, Buhl DL, and Tonegawa S (2008). Transgenic inhibition of synaptic transmission reveals role of CA3 output in hippocampal learning. Science, 319(5867):1260–1264. [DOI] [PubMed] [Google Scholar]
- Nassi JJ and Callaway EM (2009). Parallel processing strategies of the primate visual system. Nature Reviews Neuroscience, 10(5):360–372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ness HT, Folvik L, Sneve MH, Vidal-Piñeiro D, Raud L, Geier OM, Nyberg L, Walhovd KB, and Fjell AM (2022). Reduced hippocampal-striatal interactions during formation of durable episodic memories in aging. Cerebral Cortex, 32(11):2358–2372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nyberg L, Karalija N, Salami A, Andersson M, Wåhlin A, Kaboovand N, Köhncke Y, Axelsson J, Rieckmann A, Papenberg G, et al. (2016). Dopamine D2 receptor availability is linked to hippocampal–caudate functional connectivity and episodic memory. Proceedings of the National Academy of Sciences, 113(28):7918–7923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Packard MG, Hirsh R, and White NM (1989). Differential effects of fornix and caudate nucleus lesions on two radial maze tasks: evidence for multiple memory systems. Journal of Neuroscience, 9(5):1465–1472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Packard MG and McGaugh JL (1996). Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiology of Learning and Memory, 65(1):65–72. [DOI] [PubMed] [Google Scholar]
- Patterson TK and Knowlton BJ (2018). Subregional specificity in human striatal habit learning: a meta-analytic review of the fmri literature. Current Opinion in Behavioral Sciences, 20:75–82. [Google Scholar]
- Pool E, Brosch T, Delplanque S, and Sander D (2015). Stress increases cue-triggered “wanting” for sweet reward in humans. Journal of Experimental Psychology: Animal Learning and Cognition, 41(2):128. [DOI] [PubMed] [Google Scholar]
- Pool ER, Gera R, Fransen A, Perez OD, Cremer A, Aleksic M, Tanwisuth S, Quail S, Ceceli AO, Manfredi DA, et al. (2022). Determining the effects of training duration on the behavioral expression of habitual control in humans: a multilaboratory investigation. Learning & Memory, 29(1):16–28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pool ER, Pauli WM, Kress CS, and O’Doherty JP (2019). Behavioural evidence for parallel outcome-sensitive and outcome-insensitive pavlovian learning systems in humans. Nature Human Behaviour, 3(3):284–296. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Poppenk J, Evensmoen HR, Moscovitch M, and Nadel L (2013). Long-axis specialization of the human hippocampus. Trends in Cognitive Sciences, 17(5):230–240. [DOI] [PubMed] [Google Scholar]
- Prévost C, Liljeholm M, Tyszka JM, and O’Doherty JP (2012). Neural correlates of specific and general pavlovian-to-instrumental transfer within human amygdalar subregions: a high-resolution fmri study. Journal of Neuroscience, 32(24):8383–8390. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pych JC, Chang Q, Colon-Rivera C, Haag R, and Gold PE (2005). Acetylcholine release in the hippocampus and striatum during place and response training. Learning & Memory, 12(6):564–572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Qin S, Hermans EJ, Van Marle HJ, and Fernández G (2012). Understanding low reliability of memories for neutral information encoded under stress: alterations in memory-related activation in the hippocampus and midbrain. Journal of Neuroscience, 32(12):4032–4041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raio CM, Hartley CA, Orederu TA, Li J, and Phelps EA (2017). Stress attenuates the flexible updating of aversive value. Proceedings of the National Academy of Sciences, 114(42):11241–11246. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rescorla RA (1972). A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Current research and theory, pages 64–99. [Google Scholar]
- Richards BA, Xia F, Santoro A, Husse J, Woodin MA, Josselyn SA, and Frankland PW (2014). Patterns across multiple memories are identified over time. Nature Neuroscience, 17(7):981–986. [DOI] [PubMed] [Google Scholar]
- Roozendaal B, McEwen BS, and Chattarji S (2009). Stress, memory and the amygdala. Nature Reviews Neuroscience, 10(6):423–433. [DOI] [PubMed] [Google Scholar]
- Roozendaal B and McGaugh JL (1997). Glucocorticoid receptor agonist and antagonist administration into the basolateral but not central amygdala modulates memory storage. Neurobiology of Learning and Memory, 67(2):176–179. [DOI] [PubMed] [Google Scholar]
- Rosenberger LA, Eisenegger C, Naef M, Terburg D, Fourie J, Stein DJ, and van Honk J (2019). The human basolateral amygdala is indispensable for social experiential learning. Current Biology, 29(20):3532–3537. [DOI] [PubMed] [Google Scholar]
- Rosenkranz JA, Buffalari DM, and Grace AA (2006). Opposing influence of basolateral amygdala and footshock stimulation on neurons of the central amygdala. Biological Psychiatry, 59(9):801–811. [DOI] [PubMed] [Google Scholar]
- Sakon JJ and Suzuki WA (2019). A neural signature of pattern separation in the monkey hippocampus. Proceedings of the National Academy of Sciences, 116(19):9634–9643. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schapiro AC, Kustner LV, and Turk-Browne NB (2012). Shaping of object representations in the human medial temporal lobe based on temporal regularities. Current Biology, 22(17):1622–1627. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schapiro AC, Reid AG, Morgan A, Manoach DS, Verfaellie M, and Stickgold R (2019). The hippocampus is necessary for the consolidation of a task that does not require the hippocampus for initial learning. Hippocampus, 29(11):1091–1100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schapiro AC, Turk-Browne NB, Botvinick MM, and Norman KA (2017). Complementary learning systems within the hippocampus: a neural network modelling approach to reconciling episodic memory with statistical learning. Philosophical Transactions of the Royal Society B: Biological Sciences, 372(1711):20160049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schapiro AC, Turk-Browne NB, Norman KA, and Botvinick MM (2016). Statistical learning of temporal community structure in the hippocampus. Hippocampus, 26(1):3–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schlichting ML, Guarino KF, Schapiro AC, Turk-Browne NB, and Preston AR (2017). Hippocampal structure predicts statistical learning and associative inference abilities during development. Journal of Cognitive Neuroscience, 29(1):37–51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schlichting ML, Gumus M, Zhu T, and Mack ML (2021). The structure of hippocampal circuitry relates to rapid category learning in humans. Hippocampus, 31:1179–1190. [DOI] [PubMed] [Google Scholar]
- Schlichting ML and Preston AR (2015). Memory integration: neural mechanisms and implications for behavior. Current Opinion in Behavioral Sciences, 1:1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schlichting ML, Zeithamova D, and Preston AR (2014). CA1 subfield contributions to memory integration and inference. Hippocampus, 24(10):1248–1260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schwabe L, Hermans EJ, Joëls M, and Roozendaal B (2022). Mechanisms of memory under stress. Neuron, 110(9):1450–1467. [DOI] [PubMed] [Google Scholar]
- Sherman BE, Graves KN, and Turk-Browne NB (2020). The prevalence and importance of statistical learning in human cognition and behavior. Current Opinion in Behavioral Sciences, 32:15–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sherman BE and Turk-Browne NB (2020). Statistical prediction of the future impairs episodic encoding of the present. Proceedings of the National Academy of Sciences, 117(37):22760–22770. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shohamy D and Turk-Browne NB (2013). Mechanisms for widespread hippocampal involvement in cognition. Journal of Experimental Psychology: General, 142(4):1159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shohamy D and Wagner AD (2008). Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron, 60(2):378–389. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sias AC, Morse AK, Wang S, Greenfield VY, Goodpaster CM, Wrenn TM, Wikenheiser A, Holley SM, Cepeda C, Levine MS, et al. (2021). A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories. eLife, 10:e68617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Siller-Pérez C, Serafín N, Prado-Alcalá RA, Roozendaal B, and Quirarte GL (2017). Glucocorticoid administration into the dorsolateral but not dorsomedial striatum accelerates the shift from a spatial toward procedural memory. Neurobiology of Learning and Memory, 141:124–133. [DOI] [PubMed] [Google Scholar]
- Sladky R, Riva F, Rosenberger LA, van Honk J, and Lamm C (2021). Basolateral and central amygdala orchestrate how we learn whom to trust. Communications Biology, 4(1):1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith KS and Graybiel AM (2013). A dual operator view of habitual behavior reflecting cortical and striatal dynamics. Neuron, 79(2):361–374. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Squire LR (1992). Declarative and nondeclarative memory: Multiple brain systems supporting learning and memory. Journal of Cognitive Neuroscience, 4(3):232–243. [DOI] [PubMed] [Google Scholar]
- Starita F, Kroes MC, Davachi L, Phelps EA, and Dunsmoor JE (2019). Threat learning promotes generalization of episodic memory. Journal of Experimental Psychology: General, 148(8):1426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sucevic J and Schapiro AC (2022). A neural network model of hippocampal contributions to category learning. bioRxiv. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Terburg D, Scheggia D, Del Rio RT, Klumpers F, Ciobanu AC, Morgan B, Montoya ER, Bos PA, Giobellina G, van den Burg EH, et al. (2018). The basolateral amygdala is essential for rapid escape: a human and rodent study. Cell, 175(3):723–735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thompson BL, Erickson K, Schulkin J, and Rosen JB (2004). Corticosterone facilitates retention of contextually conditioned fear and increases CRH mRNA expression in the amygdala. Behavioural Brain Research, 149(2):209–215. [DOI] [PubMed] [Google Scholar]
- Thompson R and Steinmetz J (2009). The role of the cerebellum in classical conditioning of discrete behavioral responses. Neuroscience, 162(3):732–755. [DOI] [PubMed] [Google Scholar]
- Thorn CA, Atallah H, Howe M, and Graybiel AM (2010). Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron, 66(5):781–795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thrailkill EA, Trask S, Vidal P, Alcalá JA, and Bouton ME (2018). Stimulus control of actions and habits: A role for reinforcer predictability and attention in the development of habitual behavior. Journal of Experimental Psychology: Animal Learning and Cognition, 44(4):370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tolman EC (1948). Cognitive maps in rats and men. Psychological Review, 55(4):189. [DOI] [PubMed] [Google Scholar]
- Tompary A and Davachi L (2017). Consolidation promotes the emergence of representational overlap in the hippocampus and medial prefrontal cortex. Neuron, 96(1):228–241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tóth-Fáber E, Janacsek K, Szőllősi Á, Kéri S, and Nemeth D (2021). Regularity detection under stress: Faster extraction of probability-based regularities. PLOS ONE, 16(6):e0253123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turk-Browne NB (2019). The hippocampus as a visual area organized by space and time: A spatiotemporal similarity hypothesis. Vision Research, 165:123–130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turk-Browne NB, Scholl BJ, Johnson MK, and Chun MM (2010). Implicit perceptual anticipation triggered by statistical learning. Journal of Neuroscience, 30(33):11177–11187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Turner KM, Svegborn A, Langguth M, McKenzie C, and Robbins TW (2022). Opposing roles of the dorsolateral and dorsomedial striatum in the acquisition of skilled action sequencing in rats. Journal of Neuroscience, 42(10):2039–2051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tye KM, Prakash R, Kim S-Y, Fenno LE, Grosenick L, Zarabi H, Thompson KR, Gradinaru V, Ramakrishnan C, and Deisseroth K (2011). Amygdala circuitry mediating reversible and bidirectional control of anxiety. Nature, 471(7338):358–362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van der Meer MA, Johnson A, Schmitzer-Torbert NC, and Redish AD (2010). Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron, 67(1):25–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Honk J, Eisenegger C, Terburg D, Stein DJ, and Morgan B (2013). Generous economic investments after basolateral amygdala damage. Proceedings of the National Academy of Sciences, 110(7):2506–2510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vandael D, Wierda K, Vints K, Baatsen P, De Groef L, Moons L, Rybakin V, and Gounko NV (2021). Corticotropin-releasing factor induces functional and structural synaptic remodelling in acute stress. Translational Psychiatry, 11(1):1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vandaele Y, Ottenheimer DJ, and Janak PH (2021). Dorsomedial striatal activity tracks completion of behavioral sequences in rats. eNeuro, 8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vikbladh OM, Meager MR, King J, Blackmon K, Devinsky O, Shohamy D, Burgess N, and Daw ND (2019). Hippocampal contributions to model-based planning and spatial memory. Neuron, 102(3):683–693. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wanjia G, Favila SE, Kim G, Molitor RJ, and Kuhl BA (2021). Abrupt hippocampal remapping signals resolution of memory interference. Nature Communications, 12(1):1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Warlow SM and Berridge KC (2021). Incentive motivation: ‘wanting’ roles of central amygdala circuitry. Behavioural Brain Research, 411:113376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wassum KM and Izquierdo A (2015). The basolateral amygdala in reward learning and addiction. Neuroscience & Biobehavioral Reviews, 57:271–283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- White NM (2009). Some highlights of research on the effects of caudate nucleus lesions over the past 200 years. Behavioural Brain Research, 199(1):3–23. [DOI] [PubMed] [Google Scholar]
- Wickens JR, Horvitz JC, Costa RM, and Killcross S (2007). Dopaminergic mechanisms in actions and habits. Journal of Neuroscience, 27(31):8181–8183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wimmer GE and Shohamy D (2012). Preference by association: how memory mechanisms in the hippocampus bias decisions. Science, 338(6104):270–273. [DOI] [PubMed] [Google Scholar]
- Wood ER, Dudchenko PA, Robitsek RJ, and Eichenbaum H (2000). Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron, 27(3):623–633. [DOI] [PubMed] [Google Scholar]
- Yamada K, McEwen BS, and Pavlides C (2003). Site and time dependent effects of acute stress on hippocampal long-term potentiation in freely behaving rats. Experimental Brain Research, 152(1):52–59. [DOI] [PubMed] [Google Scholar]
- Yassa MA and Stark CE (2011). Pattern separation in the hippocampus. Trends in Neurosciences, 34(10):515–525. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yin HH (2010). The sensorimotor striatum is necessary for serial order learning. Journal of Neuroscience, 30(44):14719–14723. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zapata A, Minney VL, and Shippenberg TS (2010). Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. Journal of Neuroscience, 30(46):15457–15463. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zeithamova D and Bowman CR (2020). Generalization and the hippocampus: More than one story? Neurobiology of Learning and Memory, 175:107317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang S, Mano H, Ganesh G, Robbins T, and Seymour B (2016). Dissociable learning processes underlie human pain conditioning. Current Biology, 26(1):52–58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang W-H, Zhang J-Y, Holmes A, and Pan B-X (2021). Amygdala circuit substrates for stress adaptation and adversity. Biological Psychiatry, 89(9):847–856. [DOI] [PubMed] [Google Scholar]
- Zorawski M and Killcross S (2003). Glucocorticoid receptor agonist enhances pavlovian appetitive conditioning but disrupts outcome-specific associations. Behavioral Neuroscience, 117(6):1453. [DOI] [PubMed] [Google Scholar]