Abstract
How the memory systems centered on the hippocampus and dorsal striatum interact to support behavior remains controversial. We used functional MRI while people learned the locations of objects by collecting and replacing them over multiple trials within a virtual environment comprising a landmark, a circular boundary, and distant cues for orientation. The relative location of landmark and boundary was occasionally changed, with specific objects paired with one or other cue, allowing dissociation of learning and performance relative to either cue. Right posterior hippocampal activation reflected learning and remembering of boundary-related locations, whereas right dorsal striatal activation reflected learning and remembering of landmark-related locations. Within the right hippocampus, anterior processing of environmental change (spatial novelty) was dissociated from posterior processing of location. Behavioral studies show that landmark-related learning obeys associative reinforcement, whereas boundary-related learning is incidental [Doeller CF, Burgess N (2008) Proc Natl Acad Sci USA 105:5909–5914]. The distinct incidental hippocampal processing of boundaries is suggestive of a “geometric module” or “cognitive map” and may explain the hippocampal support of incidental/observational learning in “declarative” or “episodic” memory versus the striatal support of trial-and-error learning in “procedural” memory. Finally, the hippocampal and striatal systems appear to combine “bottom-up,” simply influencing behavior proportional to their activations, without direct interaction, with “top-down” ventromedial prefrontal involvement when both are similarly active.
Keywords: cognitive map, functional MRI, incidental, learning, procedural
Memory is not a unitary process but rather consists of different systems relying on separate brain structures. Evidence for parallel “declarative,” “relational,” or “episodic” systems centered on the hippocampus and “procedural” systems centered on the dorsal striatum has been obtained in animals and humans (1–9). These systems are proposed to serve different functions: rapid acquisition of experience (supporting “episodic memory”) and slower cumulative trial-and-error acquisition of skills and habits, respectively (5, 9–12). Distinct processing by either system is seen particularly clearly in studies of spatial memory, with hippocampal-dependent learning of environmental layout (“place” or “locale” learning), and striatal-dependent learning of responses to individual stimuli (“response” or “taxon” learning) (2, 4, 13–15).
How these two systems act and interact to support learned behavior poses several important questions.
Do both systems simply learn over different time courses or is each biased to process specific types of stimuli? In the spatial domain, the rodent hippocampus has been identified with environment-centered representations of location, whereas the dorsal striatum has been associated with approach responses to a single landmark (2, 8, 13, 16–18). Consistent with this idea, the firing of hippocampal place cells is determined by the environmental boundary (19, 20) to a much greater extent than by discrete intramaze objects (21), whereas neuronal firing in the striatum reflects egocentric responses (22) and the stage of task (10).
How do the systems interact during learning? The hippocampal and striatal systems are often differentially involved in different tasks (e.g., refs. 6 and 7), in different stages of the same task (initially hippocampal dependent, becoming striatal dependent with practice) (e.g., refs. 13 and 14), or in individuals with different strategies (e.g., refs. 15, 23, and 24). However, direct within-subjects investigation of the development and interaction of learning within both systems is not possible across different tasks or different subjects and is confounded by variation in novelty across different stages of the same task [e.g., hippocampal activation can result from novelty per se (25)].
Here, we seek to answer some of these questions in the context of human spatial memory. We designed a naturalistic task during which both memory systems are recruited in parallel, with similar time courses and task contingencies, and in which their relative involvement can be read out from behavior. This task allows fair, trial-by-trial, evaluation of: (i) differential involvement of neural systems, (ii) differences in the characteristics of learning in each system, and (iii) interactions between the two systems during learning or performance of a single task.
Our task was inspired by rat experiments in the Morris watermaze (17, 26), in which learning to find the submerged platform is hippocampal dependent (26), with the distance from the wall of the tank being a strong cue (27). However, if the platform is located at a constant distance and direction from an intramaze landmark and both landmark and platform are moved together within the tank between sessions, rats with hippocampal lesions outperform control rats at the beginning of each session (17). These results suggest that hippocampal processing concerns environmental geometry rather than intramaze landmarks, consistent with the place cell responses discussed above: control rats are biased toward the (incorrect) location predicted by the boundary in the previous session, whereas rats with hippocampal lesions follow the landmark alone. Finally, the definition of locations relative to the wall of the tank, or to the intramaze landmark, also requires orientational information that was provided by distal cues and presumably mediated by the head-direction system (ref. 28 and see ref. 29).
We created an object-location memory task, in which some objects maintained a fixed location relative to the environmental boundary, whereas others maintained a fixed location relative to a single intramaze landmark. Functional MRI (fMRI) was used to examine the neural bases of learning and remembering the locations of the objects. Participants explored a first-person perspective virtual reality arena, navigating through it by pressing buttons to move the viewpoint. The arena was bounded by a circular wall, contained a single landmark, and was surrounded by distant cues for orientation. During initial exploration participants encountered four objects in different locations. On each subsequent trial they saw a picture of an object on a blank background (the cue phase) and indicated its location within the arena by navigating to it from a variable start location and making a button-press response (the replace phase), the object then appeared in its correct location and was collected (the feedback phase; see Fig. 1 A and B). The replace phase reflects memory retrieval, whereas spatial learning occurs during the feedback phase. Each set of 16 trials (four per experimental object) comprised a block, with four blocks in total. Critically, the landmark and boundary were moved relative to each other between blocks, with two objects maintaining their location relative to the boundary and two relative to the landmark (Fig. 1C).
Fig. 1.
Virtual reality task and behavior. (A) Trial structure (after initial collection of objects). Participants replace the cued object after a short delay phase and received feedback (object appears in correct location immediately after the response and is collected). (B) Virtual arena from the participant's perspective [replace phase (i) and feedback phase (ii); different viewpoints] showing the intramaze landmark (traffic cone), the boundary (circular wall), the extramaze orientation cues (mountains, which were projected at infinity), and one object (vase). (C) Participants learned four object-locations over four blocks, the landmark (orange +) and boundary (green circle) moving relative to each other at the start of each block (columns). Two objects were paired with the landmark (orange dots), and two objects were paired with the boundary (green dots). (D) Participants learned the associations to landmark and boundary within and across blocks 2–4 at similar rates. Neither learning nor performance differed significantly between landmark-related and boundary-related objects. Bars show the “distance error” of the response location from the correct location for each trial, averaged over the two objects paired with each cue, in virtual meters (vm). Error bars show SEM; ITI, intertrial interval.
Within each block, participants gradually learned the relationships between object locations and landmark or boundary by using the feedback provided. Performance was measured as the proximity of the response location to the correct location, whereas learning during the feedback phase was measured as the improvement in performance on the next trial with the same object. The relative influence of boundary versus landmark on responding in blocks 2–4 was measured as the relative proximity of the response location to the locations predicted by either cue. Both cues played functionally equivalent roles in the task and were not distinguished in the instructions. The distant orientation cues were projected at infinity so that they could be used for orientation but not location. In separate behavioral studies we formally tested the associative characteristics of learning of locations relative to the landmark or boundary within this paradigm (30).
Results
Behavioral Results.
Performance in block 1, in which both cues indicate the same location for each object, was noticeably better than in blocks 2–4, in which the relative movement of landmark and boundary causes the two cues to indicate different locations. In blocks 2–4, participants' responses were influenced by both cues when replacing objects formally paired with either, with performance corresponding closely to the relative influence of the correct cue (explaining 83.3% of the variance, in blocks 2–4, P < 0.001) [see Fig. 1D and supporting information (SI) Fig. S1]. Improving performance indicated that participants learned the associations to landmark or boundary within (F3,45 = 84.85, P < 0.001) and across (F2,30 = 8.07, P < 0.01) blocks 2–4. Neither performance levels (overall: F1,15 = 3.51; P > 0.08; block 1: F1,15 < 1) or their rate of improvement (within-block: F3,45 = 2.12, P > 0.1; across-block: F2,30 < 1) differed significantly between boundary-related and landmark-related objects. Debriefing after the experiment indicated that the majority of subjects were aware of the association of each object to either cue (see SI Text).
Imaging Results.
fMRI data were fitted by a general linear model containing separate regressors for the cue phase, the replace phase, and the feedback phases of boundary-related and landmark-related objects (one regressor for each object type in the feedback phase). To model variations in activation across boundary-related feedback phases that might reflect learning about the boundary, we included a copy of the boundary-related feedback-phase regressor whose amplitudes were parametrically modulated by the amount learned in each trial. A similar parametric modulation of the landmark-related feedback-phase regressor was included to capture landmark-related learning. To model variations in activation across replace phases according to the relative influence of boundary versus landmark on behavior in that trial, we included a parametric modulation of the replace-phase regressor by the relative influence of boundary versus landmark on the replacement location (see Fig. S2). Finally, we included parametric modulations of the feedback-phase and replace-phase regressors by time-within-block (exponential decay across trials 1–4 for each object) to capture any effects of novelty-within-block that might otherwise confound apparent effects of learning or the influence of either cue. The resulting coefficients were analyzed across participants using SPM2, with regions showing significant effects (threshold P = 0.001, uncorrected) being referred to as activations below. See Methods and SI Text for details.
During the feedback phase of blocks 2–4, learning of landmark-related locations corresponded to increased activation of the right dorsal striatum (peaked in the caudate head), whereas learning of boundary-related locations corresponded to activation of the right posterior hippocampus. Higher activation corresponded to greater performance increase in the next trial with the same object, as indicated by significant positive coefficients for the respective parametric modulations in the two brain regions. See Fig. 2A and Table S1 for details, including activations in nonhypothesized areas. Thus boundary-related learning and landmark-related learning appear to be supported by distinct neural systems in the right posterior hippocampus and dorsal striatum, respectively.
Fig. 2.
Distinct neural bases support learning relative to landmark or boundary in right dorsal striatum and right posterior hippocampus, respectively, and independent of a right anterior hippocampal response to spatial novelty. (A) Extent of learning during the feedback phase (performance increase in next trial with that object in blocks 2–4) corresponds to activation of right dorsal striatum for landmark-related objects [peaked in head of caudate: Montreal Neurological Institute (MNI) coordinates 12/12/3] (i) and right posterior hippocampus for boundary-related objects (27/−30/−3) (ii). (B) After relative movement of landmark and boundary (i.e., in blocks 2–4), we measured the relative influence of boundary versus landmark on replacement location as dL/(dL + dB), where dL is the distance of the response from the location predicted by the landmark and dB is the distance from the location predicted by the boundary (see iii). (i) Replacement of objects relative to the landmark corresponds to activation of right dorsal striatum (peaked in head of caudate: 18/15/9). (ii) Activity in the right hippocampus (33/−21/−9) reflected the influence of the boundary combined with an effect of trial-within block. (iv) Dissociation of novelty and boundary processing along the long axis of right hippocampus. An object-type (landmark-related vs. boundary-related) × trial-within-block (1–2 vs. 3–4) ANOVA revealed independent main effects of trial anteriorly [36/−9/−21 (Upper)] and object-type posteriorly [30/−39/3 (Lower)]. Both images are shown at x = 30. (Left) Plots show fMRI activation on aligned SPM structural template (coronal sections; sagittal sections in Biv). (Right) Bar plots show mean percentage fMRI signal change (+/− SEM) in feedback or replace phase (y axis), binned by the measure of learning, influence of cue, or trial (x axis). (C) (Left) Activity in right posterior hippocampus (33/−36/−6) in block 1 predicts each participant's bias toward using the boundary in the first trial of block 2. (Right) Percentage signal change in block 1 versus the influence of the boundary in trial 1 of block 2, averaged over the four objects. Each dot represents one participant. This activation reflects overshadowing of the landmark by the boundary in block 1 (see ref. 30). For display purposes, images are thresholded at P < 0.005 in A–C or P < 0.00025 in Biv, uncorrected.
During the replace phases in blocks 2–4, the influence of the landmark on response locations corresponded to activity in the right dorsal striatum (peaked in the caudate head), as indicated by a significant coefficient for the replace-phase regressor parametrically modulated by the influence of the landmark versus the boundary (Fig. 2Bi). We did not observe a response in the hippocampus simply reflecting the influence of the boundary. Rather, activity in the right hippocampus reflected the influence of the boundary combined with an effect of trial-within block (Fig. 2Bii, as indicated by an F test assessing the joint effect of the influence of the boundary and the decay of activation across trial-within-block, see Methods and Fig. S2 for details). A follow-up object-type (landmark-related vs. boundary-related) × trial-within-block (trials 1–2 vs. 3–4) ANOVA revealed a posterior–anterior dissociation within the right hippocampus during the replace phase: a posterior response to boundary-related relative to landmark-related objects and an anterior response to spatial novelty (decaying within blocks after a new landmark/boundary configuration had been introduced; Fig. 2Biv). Additional parametric analyses showed that this within-block anterior right hippocampal response to novelty was independent of the object's association to landmark or boundary, specific to the replace phase and specific to spatial change, not occurring in block 1 (before any change) or across blocks (see SI Text for details).
In addition to concurrent effects of boundary-related learning or memory, an individual's bias toward using the boundary to replace objects when boundary and landmark are first moved relative to each other (i.e., at the start of block 2) was predicted by their right posterior hippocampal activation during the replace phase of block 1 (Fig. 2C), as indicated by a significant across-subject correlation between bias and hippocampal activity. This finding corresponds to overshadowing of learning to the landmark by learning to the boundary in block 1: the higher the posterior hippocampal activity during block 1, the greater the influence of the boundary on responding at the start of block 2 (see ref. 30 for the corresponding behavioral experiment).
How do the hippocampal and striatal systems interact to control behavior? Do they compete via mutual inhibition, or does activation in each independently signal suitability for behavioral control? We used dynamic causal modeling (31) to test for direct interaction between hippocampal and caudate activity during the feedback and replacement phases of blocks 2–4. In model 1, activation in hippocampus or caudate simply reflects learning relative to (during the feedback phase) or influence of (during the replace phase) boundary or landmark respectively. Model 2 allows, in addition, direct interaction between activity in the two regions. Bayesian model selection favored the simpler, independent, model in all participants during both phases (Bayes factor 6.94 during replacement, 7.17 during feedback; see SI Text and Fig. 3A). Thus the two systems appear to operate independently in parallel. However, ventromedial prefrontal activity correlated with temporary fluctuations in the covariance of hippocampal and caudate activation during the replace phase. Prefrontal activity increased when hippocampus and caudate were similarly activated or deactivated (positive covariance), whereas prefrontal activity decreased whenever hippocampal and caudate activity had negative covariance. Thus ventromedial prefrontal cortex may mediate between the conflicting behavioral responses indicated by both systems when similarly active (see Fig. 3B and SI Text). No such correlation was found during the feedback phase, when learning can occur in parallel.
Fig. 3.
Dorsal striatum and hippocampus independently influence behavior according to their activation, with ventromedial prefrontal involvement when both are similarly active. (A) Alternative models of the activity in caudate and hippocampus during replacement and feedback phases. (Left) Model 1: inputs solely reflecting behavior (influence of boundary versus landmark during replacement; learning about boundary versus landmark during feedback). (Right) Model 2: additional inputs reflecting the influence of activity in the other structure. Bayesian model selection favors model 1, indicating that caudate and hippocampal activity reflect the influence of landmark and boundary on replacement location and learning, but do not interact directly. (B) (Left) Activity in ventromedial prefrontal cortex [12/33/−6; shown on sagittal section; (Inset) axial section] correlates with fluctuations in covariance between hippocampal and caudate activity, increasing whenever they are similarly activated or deactivated. (Center and Right) Mean-corrected prefrontal activity during object-replacements plotted as color against mean-corrected hippocampal and caudate activity for two representative subjects. au, arbitrary units. For display purposes, the statistical image is thresholded at P < 0.005, uncorrected.
Discussion
Our findings strongly support the idea of parallel memory systems centered on the hippocampus and dorsal striatum (1–9). Our paradigm provides a sensitive means of detecting the relative involvement of the two systems on a trial-by-trial basis and allows their distinct functional characteristics to be examined. Differential activity in the hippocampus and caudate corresponded to the acquisition and expression of information about locations derived from environmental boundaries or landmarks, respectively.
Our behavioral experiments (30) indicate that the striatal landmark-related learning obeys associative reinforcement with a single prediction-error signal (32, 33), whereas the hippocampal boundary-related learning appears to be incidental, occurring independent of error. Thus the two systems' distinct roles may result from differences in the learning rule implemented by each and not necessarily differences in learning rate. Our results provide well controlled confirmation of some previous theories of hippocampal function (1–3) and are consistent with studies in animals (34–36) and humans (37–39) showing that striatal activity follows the predictions of reinforcement learning, and with observations that striatal dysfunction impairs feedback-based learning (compared to observational learning) (6, 40).
The apparent specialization of the right posterior hippocampus in memory for spatial locations is consistent with a specifically spatial role for this region in humans (41) and with spatial specialization of the dorsal portion of the rat hippocampus (corresponding to the posterior human hippocampus) where a higher precision coding of spatial location (42) is found and where lesions have a greater impact on spatial memory (43). The additional specialization for representations of location relative to environmental boundaries is consistent with the dependence of place cell firing on boundaries (19, 20) and with apparent specialization of the human hippocampus for processing environmental geometry rather than other aspects of visual scenes (44).
The processing of environmental boundaries by a specific neural system with a specific type of learning rule is reminiscent of the idea of a dedicated geometric module (45, 46) for processing the surface geometry of the local environment, albeit for determining location rather than orientation. It also supports a specific role for the hippocampus in incidental learning of spatial layout (2) and emphasizes the importance of boundaries in this process. Consequently, environmental boundaries may have a privileged role in the hippocampal contribution of spatial context to episodic memory (2). More generally, the different types of learning may explain the two systems' differential roles in memory. Striatal-dependent learning controlled by a single error signal may underlie procedural memory and other forms of learning by trial and error (5, 10), whereas incidental hippocampal-dependent learning may be more appropriate for maintenance of a flexible mental model (9), mediating representation (47) or cognitive map (2, 48), and for efficient encoding of experience into episodic memory (5, 49) (see also ref. 30).
The anterior hippocampal response to spatial novelty agrees with findings in rodents that hippocampal lesions disrupt the exploration of changes to spatial layout (e.g., ref. 50) and that place cell activity is modulated by spatial, but not nonspatial, novelty (51). Our results suggest that, in the rat, the ventral hippocampus might be the primary source of this novelty signal. In humans, a recent fMRI study (52) found anterior hippocampal activity to correlate with the formation of a survey representation of a new virtual reality (VR) environment, possibly reflecting incorporation of new landmark information into a boundary-based representation. Our results are also consistent with numerous fMRI studies showing an anterior hippocampal novelty response (e.g., ref. 25). Interestingly, the posterior parahippocampal cortex responded to both spatial novelty and processing of the boundary, consistent with its role in representing spatial scenes (53).
What distinguishes a landmark from a boundary in terms of ability to activate the two systems? We cannot be sure, but place cell firing appears to reflect a matching of distances to the nearest obstacle in all directions around the rat (19, 20). Thus, the influence of a given object on the hippocampal representation of location might be simply proportional to the horizontal angle subtended by it at the participant, with extended obstacles having a greater influence than discrete ones. However, our results are not explained by previous findings of striatal versus hippocampal processing of proximal versus distal cues (4, 8, 16). We used a variety of object locations so as to include boundary-related objects initially nearer to the landmark and landmark-related objects initially nearer to the boundary. Conversely, the proximal–distal dissociation may reflect differences in the type of processing required rather than the distance of the cue from the goal per se. Distal cues are important for orientation [via the head-direction system (28)], and tasks that test memory for location relative to a boundary often also require orientation, whereas tasks involving a proximal cue actually at the goal location can be solved by a simple association (cue approach) and do not require orientation. In our task, navigation relative to landmark or boundary both require orientation and neither can be solved by cue approach.
How did the two systems interact to support behavior within a single task? When put into conflict, each system's influence on behavior corresponded to its activation level, without direct activation-based competition between systems. Thus a system's suitability to control behavior may be signaled bottom-up by its activation. This interpretation would be consistent with effects of locally injected anesthetic in biasing behavior to follow a hippocampal place strategy when injected into the striatum and to follow a striatal response strategy when injected into the hippocampus (13). In addition, top-down ventromedial prefrontal mediation may be required when both systems are similarly active (54, 55). More generally, the effect of having two independent systems may appear competitive or cooperative according to the situation (7, 8, 13, 24, 56). Overall, our paradigm appears to be highly sensitive to the relative activation of the two systems, and so may provide a useful indicator of damage, e.g., in Huntington's (24) or Alzheimer's (23) diseases.
In conclusion, our findings, together with behavioral experiments using the same paradigm (30), indicate that learning locations relative to an intramaze landmark is supported by the dorsal striatum and obeys associative reinforcement, whereas learning locations relative to a boundary is supported by the right posterior hippocampus and is incidental. Both types of learning occur in parallel within the same task and do not reflect differences in the time course of learning, performance levels, instructions, or in the proximity, salience, or novelty of stimuli that would otherwise confound identification of the characteristics of the two systems. Indeed, spatial novelty produced anterior hippocampal activation unrelated to the boundary-related learning in posterior hippocampus. Finally, the two systems appear to influence behavior proportionally to their activation, with ventromedial prefrontal involvement when both are similarly active.
Methods
Participants.
Sixteen male participants (aged 20–31, mean age 23.8 years) gave written consent and were paid for participating, as approved by the local Research Ethics Committee. All were right-handed with normal or corrected-to-normal vision and reported to be in good health with no history of neurological disease. All had experience of playing first-person perspective video games.
Virtual Reality Environment.
We used UnrealEngine2 Runtime software (Epic Games) to present a first-person perspective view of a grassy plane surrounded by a circular cliff with a background of mountains, clouds, and the sun (created by using Terragen; Planetside Software) projected at infinity, to provide orientation but not location within the arena. A traffic cone was used as an intramaze landmark. Both the boundary (cliff) and landmark (cone) were rotationally symmetric, leaving the distal cues as the main source of orientation. Participants moved the viewpoint by using their right hand to operate keys to move forward and turn left or right. The viewpoint is ≈2 virtual meters above ground, the boundary is ≈180 virtual meters in diameter, and the virtual heading and location were recorded every 100 ms. Participants practiced in an unrelated virtual environment before performing the experiment (see SI Text).
Stimuli, Task, and Trial Structure.
Participants initially familiarized themselves with the arena by exploring for 2–3 min. Next, everyday objects were presented sequentially (once each) within the arena; participants collected the objects by running over them and were instructed to remember their locations. At the beginning of each subsequent trial, a picture of an object was presented on a blank background for 2 s (the cue phase), followed by a variable delay period (fixation cross; 2–6 s; mean 4 s). Participants then started at a random position within the arena and had to move to where they thought the cued object had been (the replace phase; mean duration 8.32 s). After participants had indicated their response by a button press, feedback was provided, i.e., the object appeared in its correct position and participants collected it by running over it (the feedback phase; mean duration 6.59 s). Participants could use the feedback phase to (re)learn the object positions. A fixation cross was then presented for a variable intertrial interval (2–10 s; mean 6 s), before the start of the next trial.
Details of Procedure and Design.
Participants performed four blocks. Each block comprised 16 trials with the four experimental objects (four trials each) in pseudorandom order. Trials with one control object were interspersed with regular trials (see SI Text). The landmark and boundary were moved relative to each other between blocks, with two experimental objects maintaining a fixed position relative to the landmark and two relative to the boundary (see Fig. 1C). There were four arena configurations, with the landmark roughly in the middle of the northeast, southeast, southwest, and northwest sectors of the arena, as defined by the distal cues. Arena configuration to block assignment was counterbalanced across participants. There were four initial object positions in block 1, which were assigned to landmark- or boundary-related objects, counterbalanced across participants, such that one object of each type was close to the landmark in block 1 (and one of each type distant from it).
Characterizing the Relative Influence of Either Cue on Replace Location.
For blocks 2–4, we attempted to quantify the relative influence of either cue on each response location. In a pilot study, we noticed that incorrect responses tended to be clustered around locations previously associated with the incorrect cue: either during block 1 or during the immediately preceding block. Accordingly, we calculated the relative influence of boundary versus landmark in blocks 2–4 as dL/(dL + dB), where dL is the distance of the response from the location predicted by the landmark and dB is the distance from the location predicted by the boundary. This measure varies between 0 (using the landmark) and 1 (using the boundary). On the basis of our pilot data the incorrect cue potentially predicts two different locations in blocks 3 and 4 (reflecting the object's positions relative to it in the preceding block and in block 1): we used whichever was closest to the response location. This measure was used to create a parametric regressor for analysis of fMRI data in the replace phase (see Fig. S2).
Acquisition and Analysis of fMRI Time Series.
Functional images were acquired on a 3T scanner and analyzed by using SPM2, including standard preprocessing procedures. fMRI time series were modeled by a general linear model including regressors for the cue, replace, and feedback phases, and parametric modulations of these regressors reflecting trial-by-trial behavioral measures and time of trial within block. We also modeled effects related to VR movements by including parametric modulations of the replace- and feedback-phase regressors by speed and signed and unsigned rotation following ref. 14. All regressors were convolved with the SPM hemodynamic response function. Data were high-pass filtered (cut-off period = 128 s). Coefficients for each regressor were estimated for each participant by a least-mean-squares fit of the model to the time series. Linear contrasts of coefficients for each participant were entered into a second-level random-effects analysis. Based on our strong a priori hypotheses with respect to the hippocampus and striatum we have chosen an uncorrected statistical threshold of P = 0.001. Nonhypothesized activations outside of the hippocampus and striatum are reported in Table S1. Coordinates of brain regions are reported in MNI space. See SI Text for details.
Supplementary Material
Acknowledgments.
We thank N. Weiskopf for MR sequence development; E. Featherstone, C. Hutton, and T. Hartley for technical help; R. Spiers for help during scanning; P. Dayan, J. Driver, C. Frith, U. Frith, M. Lengyel, E. Maguire, M. Mishkin, and J. O'Keefe for useful discussions; and M. Mishkin for carefully reading this manuscript. This work was funded by the Biotechnology and Biological Sciences Research Council and the Medical Research Council U.K.
Footnotes
The authors declare no conflict of interest.
This article contains supporting information online at www.pnas.org/cgi/content/full/0801489105/DCSupplemental.
References
- 1.Hirsh R. The hippocampus and contextual retrieval of information from memory: A theory. Behav Biol. 1974;12:421–444. doi: 10.1016/s0091-6773(74)92231-7. [DOI] [PubMed] [Google Scholar]
- 2.O'Keefe J, Nadel L. The Hippocampus as a Cognitive Map. Oxford: Oxford Univ Press; 1978. [Google Scholar]
- 3.Mishkin M, Malamut B, Bachevalier J. Memories and habits: Two neural systems. In: Lynch G, McGaugh JL, Weinberger M, editors. Neurobiology of Learning and Memory. New York: Guilford; 1984. pp. 65–77. [Google Scholar]
- 4.Packard MG, Hirsh R, White NM. Differential effects of fornix and caudate nucleus lesions on two radial maze tasksEvidence for multiple memory systems. J Neurosci. 1989;9:1465–1472. doi: 10.1523/JNEUROSCI.09-05-01465.1989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Squire LR, Zola SM. Structure and function of declarative and nondeclarative memory systems. Proc Natl Acad Sci USA. 1996;93:13515–13522. doi: 10.1073/pnas.93.24.13515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Knowlton BJ, Mangels JA, Squire LR. A neostriatal habit learning system in humans. Science. 1996;273:1399–1402. doi: 10.1126/science.273.5280.1399. [DOI] [PubMed] [Google Scholar]
- 7.Poldrack RA, et al. Interactive memory systems in the human brain. Nature. 2001;414:546–550. doi: 10.1038/35107080. [DOI] [PubMed] [Google Scholar]
- 8.McDonald RJ, White NM. Parallel information processing in the water maze: Evidence for independent memory systems involving dorsal striatum and hippocampus. Behav Neural Biol. 1994;61:260–270. doi: 10.1016/s0163-1047(05)80009-3. [DOI] [PubMed] [Google Scholar]
- 9.Eichenbaum H, Cohen NJ. From Conditioning to Conscious Recollection: Memory Systems of the Brain. Oxford: Oxford Univ Press; 2001. [Google Scholar]
- 10.Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature. 2005;437:1158–1161. doi: 10.1038/nature04053. [DOI] [PubMed] [Google Scholar]
- 11.Packard MG, Knowlton BJ. Learning and memory functions of the basal ganglia. Annu Rev Neurosci. 2002;25:563–593. doi: 10.1146/annurev.neuro.25.112701.142937. [DOI] [PubMed] [Google Scholar]
- 12.Yin HH, Knowlton BJ. The role of the basal ganglia in habit formation. Nat Rev Neurosci. 2006;7:464–476. doi: 10.1038/nrn1919. [DOI] [PubMed] [Google Scholar]
- 13.Packard MG, McGaugh JL. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol Learn Mem. 1996;65:65–72. doi: 10.1006/nlme.1996.0007. [DOI] [PubMed] [Google Scholar]
- 14.Hartley T, Maguire EA, Spiers HJ, Burgess N. The well-worn route and the path less traveled: Distinct neural bases of route following and wayfinding in humans. Neuron. 2003;37:877–888. doi: 10.1016/s0896-6273(03)00095-3. [DOI] [PubMed] [Google Scholar]
- 15.Iaria G, Petrides M, Dagher A, Pike B, Bohbot VD. Cognitive strategies dependent on the hippocampus and caudate nucleus in human navigation: Variability and change with practice. J Neurosci. 2003;23:5945–5952. doi: 10.1523/JNEUROSCI.23-13-05945.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Packard MG, McGaugh JL. Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: Further evidence for multiple memory systems. Behav Neurosci. 1992;106:439–446. doi: 10.1037//0735-7044.106.3.439. [DOI] [PubMed] [Google Scholar]
- 17.Pearce JM, Roberts AD, Good M. Hippocampal lesions disrupt navigation based on cognitive maps but not heading vectors. Nature. 1998;396:75–77. doi: 10.1038/23941. [DOI] [PubMed] [Google Scholar]
- 18.McGregor A, Hayward AJ, Pearce JM, Good MA. Hippocampal lesions disrupt navigation based on the shape of the environment. Behav Neurosci. 2004;118:1011–1021. doi: 10.1037/0735-7044.118.5.1011. [DOI] [PubMed] [Google Scholar]
- 19.O'Keefe J, Burgess N. Geometric determinants of the place fields of hippocampal neurons. Nature. 1996;381:425–428. doi: 10.1038/381425a0. [DOI] [PubMed] [Google Scholar]
- 20.Hartley T, Burgess N, Lever C, Cacucci F, O'Keefe J. Modeling place fields in terms of the cortical inputs to the hippocampus. Hippocampus. 2000;10:369–379. doi: 10.1002/1098-1063(2000)10:4<369::AID-HIPO3>3.0.CO;2-0. [DOI] [PubMed] [Google Scholar]
- 21.Cressant A, Muller RU, Poucet B. Failure of centrally placed objects to control the firing fields of hippocampal place cells. J Neurosci. 1997;17:2531–2542. doi: 10.1523/JNEUROSCI.17-07-02531.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Berke JD, Breck JT, Eichenbaum H. Distinct striatal and hippocampal single-unit representations during win-stay maze task performance. Soc Neurosci Abstr. 2007 doi: 10.1152/jn.91106.2008. 840.8/TT31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Middei S, Geracitano R, Caprioli A, Mercuri N, Ammassari-Teule M. Preserved fronto-striatal plasticity and enhanced procedural learning in a transgenic mouse model of Alzheimer's disease overexpressing mutant hAPPswe. Learn Mem. 2004;11:447–452. doi: 10.1101/lm.80604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Voermans NC, et al. Interaction between the human hippocampus and the caudate nucleus during route recognition. Neuron. 2004;43:427–435. doi: 10.1016/j.neuron.2004.07.009. [DOI] [PubMed] [Google Scholar]
- 25.Strange BA, Fletcher PC, Henson RN, Friston KJ, Dolan RJ. Segregating the functions of human hippocampus. Proc Natl Acad Sci USA. 1999;96:4034–4039. doi: 10.1073/pnas.96.7.4034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Morris RGM, Garrud P, Rawlins JN, O'Keefe J. Place navigation impaired in rats with hippocampal lesions. Nature. 1982;297:681–683. doi: 10.1038/297681a0. [DOI] [PubMed] [Google Scholar]
- 27.Maurer R, Derivaz V. Rats in a transparent Morris water maze use elemental and configural geometry of landmarks as well as distance to the pool wall. Spatial Cognit Comput. 2000;2:135–156. [Google Scholar]
- 28.Taube JS. Head direction cells and the neuropsychological basis for a sense of direction. Prog Neurobiol. 1998;55:225–256. doi: 10.1016/s0301-0082(98)00004-5. [DOI] [PubMed] [Google Scholar]
- 29.Wilton LA, Baird AL, Muir JL, Honey RC, Aggleton JP. Loss of the thalamic nuclei for “head direction” impairs performance on spatial memory tasks in rats. Behav Neurosci. 2001;115:861–869. [PubMed] [Google Scholar]
- 30.Doeller CF, Burgess N. Distinct error-correcting and incidental learning of location relative to landmarks and boundaries. Proc Natl Acad Sci USA. 2008;105:5909–5914. doi: 10.1073/pnas.0711433105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Friston KJ, Harrison L, Penny W. Dynamic causal modelling. NeuroImage. 2003;19:1273–1302. doi: 10.1016/s1053-8119(03)00202-7. [DOI] [PubMed] [Google Scholar]
- 32.Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, editors. Current Research and Theory. New York: Appleton-Century-Crofts; 1972. pp. 64–99. [Google Scholar]
- 33.Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press; 1988. [Google Scholar]
- 34.Balleine BW, Delgado MR, Hikosaka O. The role of the dorsal striatum in reward and decision-making. J Neurosci. 2007;27:8161–8165. doi: 10.1523/JNEUROSCI.1554-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Williams ZM, Eskandar EN. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat Neurosci. 2006;9:562–568. doi: 10.1038/nn1662. [DOI] [PubMed] [Google Scholar]
- 36.Schultz W. Getting formal with dopamine and reward. Neuron. 2002;36:241–263. doi: 10.1016/s0896-6273(02)00967-4. [DOI] [PubMed] [Google Scholar]
- 37.O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal difference models and reward-related learning in the human brain. Neuron. 2003;38:329–337. doi: 10.1016/s0896-6273(03)00169-7. [DOI] [PubMed] [Google Scholar]
- 38.McClure SM, Berns GS, Montague PR. Temporal prediction errors in a passive learning task activate human striatum. Neuron. 2003;38:339–346. doi: 10.1016/s0896-6273(03)00154-5. [DOI] [PubMed] [Google Scholar]
- 39.Corlett PR, et al. Prediction error during retrospective revaluation of causal associations in humans: fMRI evidence in favor of an associative model of learning. Neuron. 2004;44:877–888. doi: 10.1016/j.neuron.2004.11.022. [DOI] [PubMed] [Google Scholar]
- 40.Shohamy D, et al. Cortico-striatal contributions to feedback-based learning: Converging data from neuroimaging and neuropsychology. Brain. 2004;127:851–859. doi: 10.1093/brain/awh100. [DOI] [PubMed] [Google Scholar]
- 41.Burgess N, Maguire EA, O'Keefe J. The human hippocampus and spatial and episodic memory. Neuron. 2002;35:625–641. doi: 10.1016/s0896-6273(02)00830-9. [DOI] [PubMed] [Google Scholar]
- 42.Jung MW, Wiener SI, McNaughton BL. Comparison of spatial firing characteristics of units in dorsal and ventral hippocampus of the rat. J Neurosci. 1994;14:7347–7356. doi: 10.1523/JNEUROSCI.14-12-07347.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Moser MB, Moser EI, Forrest E, Andersen P, Morris RGM. Spatial learning with a minislab in the dorsal hippocampus. Proc Natl Acad Sci USA. 1995;92:9697–9701. doi: 10.1073/pnas.92.21.9697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Hartley T, et al. The hippocampus is required for short-term topographical memory in humans. Hippocampus. 2007;17:34–48. doi: 10.1002/hipo.20240. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Gallistel R. The Organization of Learning. Cambridge, MA: MIT Press; 1990. [Google Scholar]
- 46.Cheng K, Newcombe NS. Is there a geometric module for spatial orientation? Squaring theory and evidence. Psychon Bull Rev. 2005;12:1–23. doi: 10.3758/bf03196346. [DOI] [PubMed] [Google Scholar]
- 47.Gluck MA, Meeter M, Myers CE. Computational models of the hippocampal region: Linking incremental learning and episodic memory. Trends Cogn Sci. 2003;7:269–276. doi: 10.1016/s1364-6613(03)00105-0. [DOI] [PubMed] [Google Scholar]
- 48.Tolman EC. Cognitive maps in rats and men. Psychol Rev. 1948;55:189–208. doi: 10.1037/h0061626. [DOI] [PubMed] [Google Scholar]
- 49.Morris RGM, Frey U. Hippocampal synaptic plasticity: Role in spatial learning or the automatic recording of attended experience? Philos Trans R Soc London Ser B. 1997;352:1489–1503. doi: 10.1098/rstb.1997.0136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Save E, Poucet B, Foreman N, Buhot MC. Object exploration and reactions to spatial and nonspatial changes in hooded rats following damage to parietal cortex or hippocampal formation. Behav Neurosci. 1992;106:447–456. [PubMed] [Google Scholar]
- 51.Lenck-Santini PP, Rivard B, Muller RU, Poucet B. Study of CA1 place cell activity and exploratory behavior following spatial and nonspatial changes in the environment. Hippocampus. 2005;15:356–369. doi: 10.1002/hipo.20060. [DOI] [PubMed] [Google Scholar]
- 52.Wolbers T, Buchel C. Dissociable retrosplenial and hippocampal contributions to successful formation of survey representations. J Neurosci. 2005;25:3333–3340. doi: 10.1523/JNEUROSCI.4705-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Epstein R, Kanwisher N. A cortical representation of the local visual environment. Nature. 1998;392:598–601. doi: 10.1038/33402. [DOI] [PubMed] [Google Scholar]
- 54.Miller EK, Cohen JD. An integrative theory of prefrontal cortex function. Annu Rev Neurosci. 2001;24:167–202. doi: 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- 55.Killcross S, Coutureau E. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex. 2003;13:400–408. doi: 10.1093/cercor/13.4.400. [DOI] [PubMed] [Google Scholar]
- 56.Foerde K, Knowlton BJ, Poldrack RA. Modulation of competing memory systems by distraction. Proc Natl Acad Sci USA. 2006;103:11778–11783. doi: 10.1073/pnas.0602659103. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.



