Abstract
Three experiments investigated the role in memory processing of dopamine (DA) afferents to the hippocampus (HPC) that arise from the ventral tegmental area. One hypothesis is that D1/D5 receptor activation in HPC is necessary for the encoding of novel, episodic-like information; the other is that DA activation ensures the greater temporal persistence of transient hippocampal memory traces. Rats (n = 35) were trained, in separate experiments using an episodic-like memory task, to learn six paired associates (PAs) in an “event arena” involving a repeated association between specific flavors of food and locations in space. After 6 weeks of training, rats had learned a “schema” such that two new paired associates could be acquired in a single trial in one session (episodic-like memory). We show that encoding of novel PAs is sensitive to intrahippocampal microinfusion of the NMDA antagonist d-AP-5. Experiment 1 established that intrahippocampal infusion of the D1/D5 dopaminergic antagonist SCH23390 [R(+)-7-chloro-8-hydroxy-3-methyl-1-phenyl-2,3,4,5-tetrahydro-1H-3-benzazepine hydrochloride] before encoding of new PAs caused impaired memory 24 h later but that SCH23390 had no effect on the later memory of previously established PAs. Experiment 2 established that SCH23390 modulated the persistence of new memories over time (30 min vs 24 h) rather than affecting initial encoding. Experiment 3 revealed that the impact of SCH23390 was not mediated by state dependence nor had an effect on memory retrieval. These findings support the second hypothesis and establish that persistent, long-term memory of rapid, hippocampal-mediated acquisition of new paired associates requires activation of D1/D5 receptors in HPC at or around the time of encoding.
Introduction
What function(s) does dopamine serve in the hippocampus (HPC) during learning? The aim of these experiments was to contrast two alternatives: (1) it is critical for encoding, or (2) it is critical for the persistence of memory traces at or around the time of memory encoding. Both possibilities are consistent with the hypothesis of Lisman and Grace (2005) of novelty modulation of hippocampal memory processing.
The dopaminergic mesocorticolimbic pathway arises from the ventral tegmental area (VTA) and is activated by novelty (Steinfels et al., 1983), but the functional impact of this dopamine (DA) neurotransmission may depend on the neural system to which it is afferent. For example, although triggered in common by novelty, its impact in the HPC may differ from the error-detection role that DA serves in the striatum (Schultz et al., 1992; Schultz and Dickinson, 2000). Anatomical, cell-biological, and neuropharmacological data have indicated a VTA projection to the HPC, the presence of DA in the dorsal HPC, and the presence of metabotropic D1 receptors whose activation can lead to transcriptional regulation of plasticity-related genes such as the cAMP response element-binding protein CREB (Dahlström and Fuxe, 1964; Swanson, 1982; Gasbarri et al., 1994, 1997; Lazarov et al., 1998; Jay, 2003). Electrophysiological studies in vivo and in vitro point to a specific role for DA in the temporal persistence of long-term potentiation (LTP) (Frey et al., 1990, 1991; Huang and Kandel, 1995; Swanson-Park et al., 1999; O'Carroll and Morris, 2004).
If the impact of novelty within HPC is, via VTA activation, to extend the “persistence” of synaptic potentiation (Morris, 2006), it follows that a memory task that requires activity-dependent synaptic plasticity within HPC at encoding should also show delay-dependent sensitivity to local D1 receptor blockade. Memory traces may be successfully encoded and stored as a spatial distribution of changes in synaptic weights (Martin et al., 2000), but such changes may not persist. Previous work has examined the DA dependence of learning for step-down inhibitory avoidance, the radial maze, and water maze (Packard and White, 1991; Gasbarri et al., 1996; Bernabeu et al., 1997; O'Carroll et al., 2006) but not yet the memory delay dependency of such tasks. We therefore used a new task in which rats learn flavor–place paired associates (PAs) (Day et al., 2003) in a protocol that begins with the “schema” training of six of these PAs across several weeks (Tse et al., 2007). We then introduced novel PAs for a single trial of training and tested memory for these after short or long delays. Using this hippocampal-dependent associative recall paradigm, which enables rapid learning against the background of a learned schema, we examined the impact of intrahippocampal (iHPC) infusion of the D1/D5 receptor antagonist SCH23390 [R(+)-7-chloro-8- hydroxy-3-methyl-1-phenyl-2,3,4,5-tetrahydro-1H-3-benzazepine hydrochloride]. We also checked that the recall of memory acquired in the presence of SCH23390 is not state dependent (i.e., only effective if the drug is also present during recall). A novel within-subjects protocol enabled successive, single-trial encoding experiences of novel PAs across days (episodic-like memory) and thus the possibility of a definitive comparison of the performance of individual subjects in each of three separate experiments.
Materials and Methods
The detailed methods sufficient for independent replication are described in the supplemental data (available at www.jneurosci.org as supplemental material), with information given here sufficient for understanding the training protocols and their rationale.
Animals and surgery.
The subjects (experiment 1, n = 11; experiment 2, n = 12; experiment 3, n = 12) were group-housed adult male Lister-hooded rats (Charles River), maintained at 85% of their free-feeding weight. Standard surgical procedures, under isoflurane anesthesia, were used to implant 26 gauge cannulae for drug infusions targeted at the dorsal hippocampus bilaterally. The rats had a 7 d recovery period before the start of behavioral procedures.
Apparatus.
The “event arena” (Fig. 1A) was made of clear Plexiglas (1.6 × 1.6 m), with the floor containing a 7 × 7 grid of 49 circular holes (6 cm diameter, 20 cm spacing, with plastic lids level to the floor) and covered by 3 cm of sawdust. Two distinctive intra-arena landmarks, a glued stack of golf balls and a pyramid, were placed in two locations: row 4, column 2 and row 4, column 6 of the 7 × 7 grid. Access to the arena was from any of four Plexiglas start boxes (25 × 25 × 25 cm), covered with black paper to make them dark inside, that were located centrally in each sidewall. These had computer-controlled sliding doors for arena access. Plastic sand wells could be inserted into the circular holes in the floors of the arena, and food rewards (0.5 g pellets manufactured in various flavors, all with equal nutritional value) could be placed inside them (Fig. 1B). The sand was mixed with ground-up food pellets of all flavors used in an ∼90:10 ratio. A key design feature of these sand wells was a false floor with a lower compartment containing masking odors and flavors (Fig. 1B, contrast top and bottom pictures), these being obscured by the added sand mixture.
Drugs and drug infusions.
The D1/D5 antagonist SCH23390 was used at concentrations of 5 μg/μl (15.4 mm) and 1 μg/μl (3 mm) and was made up as described in supplemental Methods (available at www.jneurosci.org as supplemental material). The competitive NMDA antagonist d-AP-5 was used at a concentration of 5.9 μg/μl (30 mm). The pH of the drug solutions was adjusted to 7.2 by the addition of 1 m NaOH solution. Standard procedures were used for intracerebral drug infusions at a rate of 0.2 μl/min over 5 min, after which the infusion cannulae were left in place for an additional 2 min to avoid backflow and stylets were replaced into the guide cannulae.
Behavioral training.
Within-subjects, repeated-measures designs were used in three experiments that each consisted of a series of initial training sessions (Fig. 1C). The original arrangement of flavors (F1–F6) is shown in supplemental Figure S1, A and B (available at www.jneurosci.org as supplemental material). New PAs (F7–F14) (supplemental Fig. S1A, available at www.jneurosci.org as supplemental material) were trained later, with and without drug infusions, followed by interposed memory probe tests (PTs). The primary focus of these additional tests was to examine the impact of blockade of hippocampal D1/D5 receptors on short-term and long-term (LTM) memory and state dependence. We also scheduled various essential control conditions. Sessions were numbered from the first paired-associate training session (experiment 1) (Fig. 1C). During the main part of each experiment, the animals were trained on alternate days in two cohorts of up to six rats with each cohort receiving three training sessions per week (cohort 1: Monday, Wednesday, and Friday; cohort 2: Tuesday, Thursday, and Saturday).
The initial training sessions consisted of the following: (1) habituation (sessions −8 −3); (2) acquisition of original schema of six flavor paired associates (sessions 1–17); and (3) nonrewarded PTs (sessions 2, 9, 16).
For performance measures, several parameters were measured during training trials: (1) the number of incorrect sand wells at which digging occurred before choosing the correct sand well [primary error measure: chance, 2.5 errors; conversion to a performance index = 100 − 100 * (errors/5)]; (2) latency to dig at the correct sand well (seconds); (3) a “choice” was recorded only when a rat placed its front paw on or into a sand well. Rats running past or sniffing around one were not considered as making a choice, because running around a nonchosen well was an inevitable feature of the arena design. In rare cases, it was difficult to tell from the video monitors whether or not the rats had made a choice as so defined. In this case, when the experimenters entered the room at the end of a trial, they checked carefully whether there were any traces of digging, i.e., whether the sand had been displaced around the sand well(s).
To calculate the primary measure of memory recall, in probe tests, the time spent digging at each of the six sand wells over the 120 s test (none of which contained reward during a probe test). The primary measure of memory recall, calculated as the proportion of time spent at the cued location relative to the average time at the noncued locations, including the noncued location of the other of each of two novel flavors introduced during a training day. Although not rewarded during the 120 s probe test time, the rats were given three half pellets (correct flavor) in the correct location at the end of probe tests to limit extinction.
Experiment 1: does D1/D5 receptor activation in HPC contribute to the memory of novel paired associates?
The primary focus of experiment 1 was to investigate the impact of blocking D1 receptors in the hippocampus on new and old paired associates. After this, we conducted an important control test and checked the hippocampal dependence of the learning of new paired associates by investigating its sensitivity to intrahippocampal NMDA receptor blockade: (1) training and probe tests (Fig. 1C, sessions 18–29), impact of SCH23390 on new learning; (2) training and probe tests (Fig. 1C, sessions 30–36), impact of SCH23390 on previously trained flavors; (3) noncued control test; and (4) training and probe tests (Fig. 1C, sessions 41–42), impact of d-AP-5 during learning.
Experiment 2: does D1/D5 receptor activation play a role in memory encoding or the long-term persistence of novel paired associates?
The purpose of the second experiment was to investigate the effect of blocking D1/D5 receptors in HPC on the short-term or long-term memory of the new paired associates. The aim was to establish whether SCH23390 affected memory encoding or the temporal persistence of newly formed memories. Sessions 25 onward focused on short-term versus long-term memory (design in supplemental Fig. S2, available at www.jneurosci.org as supplemental material). A new batch of animals was used (n = 12).
Experiment 3: can the impact of a D1/D5 antagonist memory be explained in terms of state dependency, memory retrieval, or the persistence of newly encoded information?
The aim of the third experiment was to test whether (1) the results of experiment 2 could be interpreted in terms of state dependency and (2) whether intra-HPC SCH23390 affects memory retrieval. State-dependent learning is a phenomenon in which information learned in one state of the organism is retrieved best if a similar state is reinstated at the time of the testing (Dudai, 2002). Sessions 18 onward focused on specific manipulations to investigate state dependency and retrieval (design in Fig. S3, available at www.jneurosci.org as supplemental material). A new batch of animals was trained (n = 12).
Perfusion and histology.
All rats were terminally anesthetized with Euthatal (Rhône Mérieux) and then perfused intracardially with 0.9% saline, followed by 4% Formalin. The brains were removed and stored in 4% Formalin for a minimum of 24 h. Coronal 30 μm sections were cut using a cryostat with one in every five sections recovered for histological analysis. These sections were mounted on slides, stained with cresyl violet, and coverslipped using DPX (mixture of distyrene, tricresyl phosphate, and xylene). The sections were examined with a light microscope under 20-fold magnification to verify cannulae placements. For each brain, the infusion site was plotted by determining the deepest point at which tissue damage was evident and marking this location on the appropriate coronal section taken from the atlas of Paxinos and Watson (1998) (see Fig. 3C).
Statistical analyses.
All numerical data are presented as mean ± SEM. For all experiments, the number of errors was assessed in the main training sessions and time spent digging in each sand well during the probe tests. The latency to dig at the correct well was also routinely analyzed, but these data never showed significant differences but are presented for experiment 1 only in the supplemental data (available at www.jneurosci.org as supplemental material). Statistical significance was determined by repeated-measures ANOVAs and, when appropriate, one-sample t tests. The Greenhouse–Geisser correction for repeated measures was applied (with appropriate alteration of degrees of freedom). In experiments 1 and 2, after the ANOVA, pairwise comparisons were conducted with a Bonferroni's correction for multiple comparisons. In experiment 3, a set of appropriate orthogonal comparisons was created to analyze the impact of SCH23390 on persistence, state dependency, and/or memory retrieval.
Results
Before turning to the main results, it is important to convey qualitatively how event-arena experiments of this kind proceed. After habituation and pretraining, the animals readily eat the “cue” food in the start box and then, after exploratory head movements at the entrance to the arena (Johnson and Redish, 2007), enter it and run between the sand wells in search of the available reward of the same flavor. They dig through the sand at these wells and, at the correct one, soon find the 0.5 g food pellets that they then carry (one by one) back to the start boxes to eat. This natural carrying behavior is typical of rats (Maaswinkel and Whishaw, 1999), and we made no attempt to prevent it; in fact, unpublished observations in our laboratory indicate that having the animals eat the retrieved food in the start box adds to their ability to use this flavor as a recall cue on later sessions, presumably because this cue is given at a start-box location.
Experiment 1: gradual acquisition of paired-associate memory, a schema, and then rapid drug-dependent acquisition of new paired associates (SCH23390 and d-AP-5)
As shown in Figure 2A, the animals are initially at chance on the baseline task, but they improve across 15 sessions to a performance index (PI) score of between 70 and 80%. This is lower than the 90 or 95% demanded in standard discrimination-learning experiments; however, these typically consist of only two choices, whereas there are six choices here. The z-scores for the PI relative to chance were, at asymptote, around or greater than z = 5, and this is indicative of highly significant choice performance. Once this level is reached, the main part of each study commences with the within-subjects introduction of new PAs in the presence or absence of drugs.
After the training phase (Fig. 2A, sessions 1–17, white background) in which the animals were trained on alternate days to learn concurrently six paired associates (each flavor associated to a distinct location; see supplemental data, available at www.jneurosci.org as supplemental material), we tested the effect of SCH23390 on (1) the rapid acquisition of the new PAs (intra-HPC infusions given bilaterally 20 min before new PAs exposure) and (2) the memory of the previously acquired six PAs.
During the training phase, three initial nonrewarded probe tests (PT1–PT3) were scheduled as shown in Figure 1C (top row) to examine acquisition of paired-associate memory. Figure 2B represents percentage of dig time at the cued location (black bars) relative to that at the noncued locations (white bars). These probe tests revealed, as expected, a graded learning of the original PAs from sessions 1–16 (F = 23.16, df = 1.75/17.51, p < 0.001). t tests comparing the proportion of digging for the cued PA were above chance in PT3 (t = 7.76, df = 10, p < 0.001).
At the end of the study (sessions 41–42), we sought to extend our finding of the hippocampal dependence of PA acquisition that had been established using lesions (Tse et al., 2007). A next step was to examine the possible role of hippocampal plasticity, via iHPC infusion of the NMDA antagonist d-AP-5 at the time of novel PA encoding. Because the primary focus of this experiment was on the impact of SCH23390 on the memory of novel and familiar PAs, collection of the d-AP-5 data was not until PT9 (Fig. 1C, bottom row). Figure 2C presents dig time data of this probe test in session 42. Because the drug was given on session 41, 20 min before the trials for each of two new PAs that were trained in one session, the graph includes the relative digging during the probe test 24 h later at both the new cued PA and the new noncued PA, as well as the average of the four original PAs. Of the 10 animals that completed training to this stage of the study (from an initial n = 11), half were give d-AP-5 and the others vehicle. The ANOVA revealed an interaction between drug (a between-subjects factor) and paired associates (F = 10.04, df = 1.14/9.15, p < 0.01). The pairwise comparisons analysis with Bonferroni's corrections for multiple comparisons showed a significant difference between the control group [artificial CSF (aCSF)] and the d-AP-5 group only on digging at the location of new cued paired associates (Fig. 2C, black bars) (p < 0.05). Additional t tests compared the proportion of digging for the new cued PA relative to chance, revealing that digging was above chance for the control group (aCSF, t = 3.14, p < 0.035) but not for the d-AP-5 group (d-AP-5, t <1, NS). This finding confirms the HPC dependence of novel PA acquisition and indicates that it involves local NMDA receptor activation.
Revealing the hippocampal dependency of the task sets the stage for a focused analysis of the impact of iHPC SCH23390 on memory for PAs. Figure 3 shows a decline in memory at 24 h associated with SCH23390 present at new encoding.
SCH23390 and new encoding
The ANOVA revealed an interaction between drug and digging locations (F = 8.5, df = 2.49/24.9, p < 0.001) (Fig. 3A). Pairwise comparisons, with Bonferroni's corrections for multiple comparisons and focusing exclusively on digging at the new cued location across drug conditions (i.e., black bars), showed significantly less digging when the animals were treated with SCH23390 (1 μg, p < 0.05; 5 μg, p < 0.01) than with saline. Similarly, t tests that compared the proportion of digging at the cued location indicated above chance performance in the control condition (t = 3.42, df = 10, p < 0.01) but not for the SCH22390 1 μg condition (t = 1.02, df = 10, NS). Unexpectedly, there was less digging than expected by chance in the SCH23390 5 μg condition (t = 9.80, df 10, p < 0.05). Given this, and considering that our lower concentration of SCH23390 was sufficient to impair memory at 24 h, we used only the lower concentration in later experiments.
SCH23390 and previously trained memories
Figure 3B shows the lack of an effect of SCH23390 on memory of previously trained PAs. An overall ANOVA revealed a difference in dig time at the cued and noncued locations (F = 44.80, df = 1/10, p < 0.001) but no significant interaction between drug and cued location (F < 1). t tests comparing the proportion of digging for the cued PA relative to chance were significant for both conditions (NaCl: t = 4.12, df = 10, p < 0.002; SCH23390 at 1 μg: t = 9.88, df = 10, p < 0.001).
It should be noted that the mean time spent digging at the cued location for the original trained PAs (57.5 s in Fig. 3B) was higher than that for the new PAs in the NaCl group (43.5 s in Fig. 3A). This difference is to be expected given that the original PAs had, by this point, 21 training trials (sessions 1–32), whereas new PAs only ever have a single training trial. Nonetheless, it is striking that the probe test score for a new PA trained in the presence of saline is as good as it is and well above chance. That is, against the background of a trained schema, new PA learning can occur in one trial.
Latency to dig at correct sand well on the day of drug infusions
We also examined whether SCH23390 had any impact on the latency with which the animals completed a trial (on sessions 18, 23, 28 and sessions 32, 35). On the first three of these, we could make a within-session comparison of new PA trials (in the presence or absence of the drug) with the latency on the remaining original PA trials without the drug. Latencies on the new PA trials averaged 38.5 s and varied between 15 and 50 s depending, in part, on the proximity of the sand well to the start box and the number of errors made (supplemental Fig. S4A, available at www.jneurosci.org as supplemental material). An ANOVA of these latency scores revealed no overall interaction between drug and trial (F = 2.5, df = 1.72/17.2, p > 0.1), although the graph showed a nonsignificant increase in latency for new PA trials in the presence of SCH23390. These data are discussed in the supplemental data (available at www.jneurosci.org as supplemental material). In the last two sessions examined (sessions 32 and 35), we could make a within-session comparison of the impact of the drug on the latency to complete original PA trials (supplemental Fig. S4B, available at www.jneurosci.org as supplemental material). The animals were typically faster, taking between 15 and 22 s to complete a trial, with the ANOVA also revealing no interaction between drug and trial (F = 3.8, df 1/10, p > 0.05). These findings indicate that, 20 min after an SCH23390 injection, there was no significant locomotor impairment that might have affected memory encoding in an indirect manner.
Cannula placement
Inspection of the location of the tips of the cannulae in coronal sections of the brain of all tested animals revealed these to be located in dorsal hippocampus, in the CA1 region of the HPC (Fig. 3C).
Experiment 2: D1/D5 receptors are critical for the memory persistence but not the encoding of new paired associates
The aim of experiment 2 was to compare the impact of SCH23390 on short- and long-term memory. To test this hypothesis, a new batch of animals (n = 12) were trained to learn the six paired-associates schema, followed by the introduction and training new PAs preceded 20 min before by intra-HPC drug or vehicle infusions. The memory probe tests proceeded after a short (30 min) or a long (24 h) memory delay.
Impact on short-term versus long-term memory
Figure 4 shows the percentage dig time in the series of four counterbalanced probe tests conducted 30 min or 24 h after the encoding of new paired associates. An overall ANOVA revealed a triple interaction between memory delay, drug, and paired associate (F = 18.16, df = 1.94/21.38, p < 0.001). Pairwise comparisons, again with Bonferroni's corrections for multiple comparisons, focused on digging at the new cued paired associates (black bars). This showed no significant difference between the NaCl and SCH22390 conditions at a 30 min delay (F = 2.1, p > 0.18) but a significant decline in memory in the SCH23390 condition at 24 h (F = 5.6, p < 0.04). Separate comparisons across time intervals revealed no difference between the two probe tests at 30 min and 24 h with NaCl (F < 1) but a highly significant delay-dependent decrease across the two SCH23390 tests (F = 16.9, p < 0.002). Additional t tests compared the proportion of digging for the cued paired associates relative to chance. As shown in Figure 4, this revealed that digging was above chance at 30 min in both conditions (NaCl: t = 2.67, p < 0.025; SCH23390: t = 4.78, p < 0.001) but only for the NaCl condition at 24 h (NaCl: t = 2.85, p < 0.02; SCH23390: t = 0.5, NS). Thus, these data reveal a delay-dependent effect of a D1/D5 antagonist on the memory of novel PAs. These receptors must be activated at encoding for memory to persist.
Experiment 3: the state dependency hypothesis does not explain results obtained in experiments 1 and 2, and D1/D5 receptor blockade in HPC does not affect retrieval
The aim of experiment 3 was to check that the apparent delay dependency of experiment 2 is not an artifact or consequence of state dependency. The phenomenon of “state-dependent” memory, in which information learned in one state (e.g., presence of a drug) is retrieved best if a similar state is reinstated at the time of testing, could explain the apparent impairment of memory of new PAs at 24 h but not 30 min with SCH23390 because testing of the former but not the latter is in a different drug “state.”
This possibility can be tested by performing memory retrieval probe tests similar or different drug conditions to those of exposure to new PAs. A full 2 × 2 design was deployed, enabling both an examination of an impact of the drug on memory retrieval and a replication of our findings with respect to memory persistence.
Figure 5 presents the percentage dig time across the four counterbalanced probe tests (PT4–PT7). The ANOVA comparing performance across drug conditions (SCH22390–SCH23390, NaCl–SCH23390, SCH23390–NaCl, and NaCl–NaCl) and all dig locations revealed an interaction (F = 5.42, df = 2.93/32.26, p < 0.005).
Inspection of the data suggests that memory for new PAs trained under NaCl are above chance at retrieval without regard to drug condition, whereas new cued PAs trained in the presence of SCH23390 are at chance. A second ANOVA, focusing on the new cued locations only (Fig. 5, black bars), also showed an interaction between drug and digging location (F = 5.93, df = 2.1/23.37, p < 0.01). This overall F value was partialed out using a set of three orthogonal comparisons that compare groups on the basis of a memory persistence, a state dependency, or a retrieval hypothesis of the impact of SCH23390. The first orthogonal comparison (persistence hypothesis) revealed a significant difference between drug conditions (NaCl–NaCl + NaCl–SCH23390 vs SCH23390–NaCl + SCH23390–SCH23390; F = 10.9, df = 1/23.4, p < 0.005), indicating that the drug impaired the memory persistence of new PAs if present at the time of encoding. The state-dependency hypothesis H2 (NaCl–NaCl + SCH23390–SCH23390 vs NaCl–SCH23390 + SCH23390–NaCl) was not significant (F <1), and, similarly, the retrieval hypothesis was also nonsignificant (F = 1.59, NS). Additional t tests compared the time of digging at the new cued PA relative to chance, revealing that digging was above chance in the probe test for drug conditions NaCl–NaCl (t = 3.27, p < 0.007) and NaCl–SCH23390 (t = 5.69, p < 0.001) but not for drug conditions SCH23390–NaCl (t < 1, NS) or SCH23390–SCH23390 (t = 1.37, NS).
Discussion
The main findings are as follows. (1) Intrahippocampal infusion of the D1/D5 antagonist SCH23390 impaired memory for new PAs in an episodic-like memory task in which rats had previously acquired a flavor-place schema; the drug had no effect on the memory of previously established PAs. (2) SCH23390 modulated the persistence of new memories over time rather than affecting encoding per se. (3) This impact of SCH23390 was neither mediated by state dependence nor affected retrieval. We also established (4) the hippocampal dependency of this cued-recall task using intrahippocampal infusions of the selective NMDA receptor antagonist d-AP-5. These findings have implications for the role of D1/D5 receptors in HPC on the neuromodulation of memory processing.
The hippocampal dependence of the PA task
Our use of this relatively new paired-associate schema task makes it possible, for the first time, to examine the neurobiology of one-trial PA encoding of new information on a within-subjects basis. The task is sensitive to hippocampal lesions (Tse et al., 2007), and our new data establish further that bilateral iHPC infusions of d-AP-5 before the encoding of new PAs results in memory loss when tested 24 h later. Previous autoradiographic work has established that drug diffusion with this iHPC protocol is primarily restricted to the dorsal HPC (Steele and Morris, 1999). Thus, the task is not only “hippocampal dependent” in the classical sense of being impaired by lesions but is also dependent on NMDA receptor-dependent mechanisms within HPC at the time of encoding, presumably involving associative synaptic potentiation (Bliss and Collingridge, 1993). In passing, the previous lesion study was subject to the criticism that ibotenic acid lesions might result in aberrant neocortical activity after the lesion (Rudy and Sutherland, 2008; Tse et al., 2008). The present data renders this concern even less likely because iHPC infusion of d-AP-5 is not known to have such an effect on neocortical activity. Thus, although the memory traces of multiple PAs are probably in neocortex (Bontempi et al., 1999; Maviel et al., 2004; Tse et al., 2007), the encoding of new PAs critically involves an NMDA receptor-dependent mechanism in HPC, followed by cellular and then rapid systems consolidation.
Functional role of D1/D5 receptors in the dorsal hippocampus
The key new finding is that activation of D1/D5 receptors in HPC is critical for the persistence of memory that depends on hippocampal processing at or around the time of encoding. Our new results point to a delay-dependent effect of blocking D1/D5 receptors on LTM.
A possible alternative account of the apparent delay-dependent memory impairment could be that of state dependency. According to this, poor memory at 24 h might be explained by the animal being in a different physiological state during memory retrieval in the absence of the drug than it had been at encoding in its presence (Overton, 1964). Good memory at 30 min could be because the animals are still under the effects of the drug. Experiment 3 tested this by comparing SCH23390 in three conditions: before encoding, before retrieval (24 h later), or before both encoding and retrieval. The results are inconsistent with state dependency because the animals had a similar impairment of memory when SCH23390 was infused only before encoding as when infused before both encoding and retrieval. They also exclude a potential role of HPC D1/D5 receptors at or around the time of retrieval, because their iHPC blockade 20 min before the recall test had no effect.
Although we cannot exclude the possibility that SCH23390 has agonist actions at 5-HT2A and 5-HT2C receptors at the concentration used (Millan et al., 2001), such actions should have resulted in a facilitation of hippocampus-dependent memory rather than an impairment (Buhot et al., 2000; Harvey, 2003). In addition, the lack of memory impairment in the recall test 30 min after encoding (50 min after drug infusion) and the absence of difference in latency to dig in the correct sand well between drug and nondrug trials rules out interpretations of our results in terms of hypokinesia (Fink and Smith, 1980; Taghzouti et al., 1985), a reduction of motivation, or an impairment of motor-skill learning, such as pellet retrieval (Smith-Roe and Kelley, 2000; Willuhn and Steiner, 2006).
After a long time during which many studies have focused on the role of DA in error-correcting reward processing in the striatum (Schultz, 2007), attention is now being focused on the role of mesohippocampal DA projections to HPC (Lisman and Grace, 2005). Previous studies have implicated DA in both learning and memory by blocking or activating hippocampal DA receptors before (Umegaki et al., 2001) or immediately after (Packard and White, 1991) training or via lesions of mesohippocampal DA projections before training (Gasbarri et al., 1996). However, these studies did not contrast encoding versus persistence. In keeping with the LTP data described in Introduction, O'Carroll et al. (2006) observed an impairment of the persistence of water-maze spatial memory with intra-HPC infusion of SCH23390 at the time of encoding that the present data support.
Recently, an elegant series of experiments (Rossato et al., 2009) has shown a contribution of DA to the maintenance of LTM storage through a mechanism involving D1 receptor signaling in dorsal CA1 that occurs quite a long time (12 h) after acquisition. Previous findings of Bernabeu et al. (1997) are consistent with this new idea about DA involvement in memory consolidation, as is recent work by McNaughton's group (Valdes et al., 2008) who have shown that VTA cells can fire during periods of memory “replay.” The possibility that there are actions of DA on memory consolidation at or around the time of encoding (our findings) and separately at later time points are not mutually exclusive. Indeed, the synaptic tagging and capture hypothesis of protein synthesis LTP (Frey and Morris, 1997, 1998) raises the possibility of novelty-associated upregulation of plasticity proteins at a time separate from encoding. These could help stabilize learning-associated synaptic change provided local synaptic tags are set at the time of learning. Data consistent with a role for such a mechanism in memory consolidation have been reported by Moncada and Viola (2007).
Toward better “episodic-like” memory tasks and the impact of novelty on memory persistence
We used a new PA learning task in which, in the same paradigm and with the same animals, the relative impact of a drug on well trained PAs across days can be distinguished from that on the encoding, storage, and/or retrieval of new PAs. These dissociations are not possible using inhibitory avoidance (Rossato et al., 2009) nor using the free-recall delayed matching-to-place water-maze task (O'Carroll et al., 2006) because, in the latter case, a change in the location of the escape platform entails both acquisition of a new location and extinction of a previous location. The use here of distinct recall cues (different foods) supersedes this limitation. Our new paradigm also confirms that new PAs can be integrated into a preexisting schema after a single training trial (Tse et al., 2007). Such encoding is “episodic-like” in that encoding of both object information (what food) and place information (where in the arena) occurs in a single trial, but it falls short of a “pure” definition of episodic-like memory that involves the triad of “what–where–when,” i.e., memory of time as well (Clayton and Dickinson, 1998).
Some recent human imaging studies have also shown that midbrain DA neurons may also play a critical role in modulating HPC-dependent episodic memory (Lisman and Otmakhova, 2001; Schott et al., 2004; Wittmann et al., 2005; Adcock et al., 2006; Shohamy and Wagner, 2008). Shohamy and Wagner (2008) suggest that an HPC–midbrain network may not only provide a mechanism for the enhancement of LTM for individual episodes but also for cross-episode integration by enabling rapid behavioral generalization in the future. Integrating new episodes with past experiences is a key feature of our schema paradigm.
Our findings of a role for DA in modulating memory persistence are in line with the HPC–VTA loop model of Lisman and Grace (2005). When novelty is detected in the HPC, a neural signal is thought to pass first via the subiculum to the nucleus accumbens (NAcc). There, together with information from the prefrontal cortex, NAcc neurons stimulate the firing of the VTA. In keeping with this, Kentros et al. (2004) demonstrated that increased place field stability in CA1 is subject to neuromodulation by hippocampal DA released from terminals emanating from VTA neurons. They suggest that a higher-order cognitive process, such as attention, is mediated by one or more neuromodulatory inputs that switch short-term into long-term plasticity. In the presence of novelty, DA is released in the HPC, and early LTP is transformed into late LTP. Cellular consolidation of the memory representation of new PAs in our training paradigm would favor their integration into the schema via systems consolidation. Additional examination of this distinctive role of DA in HPC, compared with its error-correcting role in the striatum, would be to conduct tract-tracing studies of VTA projections to striatum and HPC and to test whether lesions specific to DA cells from the VTA projecting to the HPC have a selective impact on the persistence of memory but are without effect on initial encoding.
Footnotes
This work was supported by a Medical Research Council programme grant (held by R.G.M.M.) and fellowships from Fondation pour la Recherche Médicale, Fondation Lavoisier, and Singer et Polignac. We are grateful to Patrick A. Spooner and Jane Tulloch for technical assistance and to Roger Redondo and Iain Wilson for discussion.
References
- Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron. 2006;50:507–517. doi: 10.1016/j.neuron.2006.03.036. [DOI] [PubMed] [Google Scholar]
- Bernabeu R, Bevilaqua L, Ardenghi P, Bromberg E, Schmitz P, Bianchin M, Izquierdo I, Medina JH. Involvement of hippocampal cAMP/cAMP-dependent protein kinase signaling pathways in a late memory consolidation phase of aversively motivated learning in rats. Proc Natl Acad Sci U S A. 1997;94:7041–7046. doi: 10.1073/pnas.94.13.7041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bliss TV, Collingridge GL. A synaptic model of memory: long-term potentiation in the hippocampus. Nature. 1993;361:31–39. doi: 10.1038/361031a0. [DOI] [PubMed] [Google Scholar]
- Bontempi B, Laurent-Demir C, Destrade C, Jaffard R. Time-dependent reorganization of brain circuitry underlying long-term memory storage. Nature. 1999;400:671–675. doi: 10.1038/23270. [DOI] [PubMed] [Google Scholar]
- Buhot MC, Martin S, Segu L. Role of serotonin in memory impairment. Ann Med. 2000;32:210–221. doi: 10.3109/07853890008998828. [DOI] [PubMed] [Google Scholar]
- Clayton NS, Dickinson A. Episodic-like memory during cache recovery by scrub jays. Nature. 1998;395:272–274. doi: 10.1038/26216. [DOI] [PubMed] [Google Scholar]
- Dahlström A, Fuxe K. Localization of monoamines in the lower brain stem. Experientia. 1964;20:398–399. doi: 10.1007/BF02147990. [DOI] [PubMed] [Google Scholar]
- Day M, Langston R, Morris RGM. Glutamate-receptor-mediated encoding and retrieval of paired-associate learning. Nature. 2003;424:205–209. doi: 10.1038/nature01769. [DOI] [PubMed] [Google Scholar]
- Dudai Y. Oxford: Oxford UP; 2002. Memory from A to Z. Keywords, concepts and beyond. [Google Scholar]
- Fink JS, Smith GP. Mesolimbicocortical dopamine terminal fields are necessary for normal locomotor and investigatory exploration in rats. Brain Res. 1980;199:359–384. doi: 10.1016/0006-8993(80)90695-2. [DOI] [PubMed] [Google Scholar]
- Frey U, Morris RGM. Synaptic tagging and long-term potentiation. Nature. 1997;385:533–536. doi: 10.1038/385533a0. [DOI] [PubMed] [Google Scholar]
- Frey U, Morris RGM. Synaptic tagging: implications for late maintenance of hippocampal long-term potentiation. Trends Neurosci. 1998;21:181–188. doi: 10.1016/s0166-2236(97)01189-2. [DOI] [PubMed] [Google Scholar]
- Frey U, Schroeder H, Matthies H. Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices. Brain Res. 1990;522:69–75. doi: 10.1016/0006-8993(90)91578-5. [DOI] [PubMed] [Google Scholar]
- Frey U, Matthies H, Reymann KG, Matthies H. The effect of dopaminergic D1 receptor blockade during tetanization on the expression of long-term potentiation in the rat CA1 region in vitro. Neurosci Lett. 1991;129:111–114. doi: 10.1016/0304-3940(91)90732-9. [DOI] [PubMed] [Google Scholar]
- Gasbarri A, Verney C, Innocenzi R, Campana E, Pacitti C. Mesolimbic dopaminergic neurons innervating the hippocampal formation in the rat: a combined retrograde tracing and immunohistochemical study. Brain Res. 1994;668:71–79. doi: 10.1016/0006-8993(94)90512-6. [DOI] [PubMed] [Google Scholar]
- Gasbarri A, Sulli A, Innocenzi R, Pacitti C, Brioni JD. Spatial memory impairment induced by lesion of the mesohippocampal dopaminergic system in the rat. Neuroscience. 1996;74:1037–1044. doi: 10.1016/0306-4522(96)00202-3. [DOI] [PubMed] [Google Scholar]
- Gasbarri A, Sulli A, Packard MG. The dopaminergic mesencephalic projections to the hippocampal formation in the rat. Prog Neuropsychopharmacol Biol Psychiatry. 1997;21:1–22. doi: 10.1016/s0278-5846(96)00157-1. [DOI] [PubMed] [Google Scholar]
- Harvey JA. Role of the serotonin 5-HT2A receptor in learning. Learn Mem. 2003;10:355–362. doi: 10.1101/lm.60803. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huang YY, Kandel ER. D1/D5 receptor agonists induce a protein synthesis-dependent late potentiation in the CA1 region of the hippocampus. Proc Natl Acad Sci U S A. 1995;92:2446–2450. doi: 10.1073/pnas.92.7.2446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jay TM. Dopamine: a potential substrate for synaptic plasticity and memory mechanisms. Prog Neurobiol. 2003;69:375–390. doi: 10.1016/s0301-0082(03)00085-6. [DOI] [PubMed] [Google Scholar]
- Johnson A, Redish AD. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J Neurosci. 2007;27:12176–12189. doi: 10.1523/JNEUROSCI.3761-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kentros CG, Agnihotri NT, Streater S, Hawkins RD, Kandel ER. Increased attention to spatial context increases both place field stability and spatial memory. Neuron. 2004;42:283–295. doi: 10.1016/s0896-6273(04)00192-8. [DOI] [PubMed] [Google Scholar]
- Lazarov NE, Schmidt U, Wanner I, Pilgrim C. Mapping of D1 dopamine receptor mRNA by non-radioactive in situ hybridization. Histochem Cell Biol. 1998;109:271–279. doi: 10.1007/s004180050227. [DOI] [PubMed] [Google Scholar]
- Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 2005;46:703–713. doi: 10.1016/j.neuron.2005.05.002. [DOI] [PubMed] [Google Scholar]
- Lisman JE, Otmakhova NA. Storage, recall, and novelty detection of sequences by the hippocampus: elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamine. Hippocampus. 2001;11:551–568. doi: 10.1002/hipo.1071. [DOI] [PubMed] [Google Scholar]
- Maaswinkel H, Whishaw IQ. Homing with locale, taxon, and dead reckoning strategies by foraging rats: sensory hierarchy in spatial navigation. Behav Brain Res. 1999;99:143–152. doi: 10.1016/s0166-4328(98)00100-4. [DOI] [PubMed] [Google Scholar]
- Martin SJ, Grimwood PD, Morris RGM. Synaptic plasticity and memory: an evaluation of the hypothesis. Annu Rev Neurosci. 2000;23:649–711. doi: 10.1146/annurev.neuro.23.1.649. [DOI] [PubMed] [Google Scholar]
- Maviel T, Durkin TP, Menzaghi F, Bontempi B. Sites of neocortical reorganization critical for remote spatial memory. Science. 2004;305:96–99. doi: 10.1126/science.1098180. [DOI] [PubMed] [Google Scholar]
- Millan MJ, Newman-Tancredi A, Quentric Y, Cussac D. The “selective” dopamine D1 receptor antagonist, SCH23390, is a potent and high efficacy agonist at cloned human serotonin2C receptors. Psychopharmacology (Berl) 2001;156:58–62. doi: 10.1007/s002130100742. [DOI] [PubMed] [Google Scholar]
- Moncada D, Viola H. Induction of long-term memory by exposure to novelty requires protein synthesis: evidence for a behavioral tagging. J Neurosci. 2007;27:7476–7481. doi: 10.1523/JNEUROSCI.1083-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris RGM. Elements of a neurobiological theory of hippocampal function: the role of synaptic plasticity, synaptic tagging and schemas. Eur J Neurosci. 2006;23:2829–2846. doi: 10.1111/j.1460-9568.2006.04888.x. [DOI] [PubMed] [Google Scholar]
- O'Carroll CM, Morris RGM. Heterosynaptic co-activation of glutamatergic and dopaminergic afferents is required to induce persistent long-term potentiation. Neuropharmacology. 2004;47:324–332. doi: 10.1016/j.neuropharm.2004.04.005. [DOI] [PubMed] [Google Scholar]
- O'Carroll CM, Martin SJ, Sandin J, Frenguelli B, Morris RGM. Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory. Learn Mem. 2006;13:760–769. doi: 10.1101/lm.321006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Overton DA. State-dependent or “dissociated” learning produced with pentobarbital. J Comp Physiol Psychol. 1964;57:3–12. doi: 10.1037/h0048023. [DOI] [PubMed] [Google Scholar]
- Packard MG, White NM. Dissociation of hippocampus and caudate nucleus memory systems by posttraining intracerebral injection of dopamine agonists. Behav Neurosci. 1991;105:295–306. doi: 10.1037//0735-7044.105.2.295. [DOI] [PubMed] [Google Scholar]
- Paxinos G, Watson C. San Diego: Academic; 1998. The rat brain in stereotaxic coordinates. [DOI] [PubMed] [Google Scholar]
- Rossato JI, Bevilaqua LR, Izquierdo I, Medina JH, Cammarota M. Dopamine controls persistence of long-term memory storage. Science. 2009;325:1017–1020. doi: 10.1126/science.1172545. [DOI] [PubMed] [Google Scholar]
- Rudy JW, Sutherland RJ. Is it systems or cellular consolidation? Time will tell. An alternative interpretation of the Morris group's recent science paper. Neurobiol Learn Mem. 2008;89:366–369. doi: 10.1016/j.nlm.2007.07.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schott BH, Sellner DB, Lauer CJ, Habib R, Frey JU, Guderian S, Heinze HJ, Düzel E. Activation of midbrain structures by associative novelty and the formation of explicit memory in humans. Learn Mem. 2004;11:383–387. doi: 10.1101/lm.75004. [DOI] [PubMed] [Google Scholar]
- Schultz W. Behavioral dopamine signals. Trends Neurosci. 2007;30:203–210. doi: 10.1016/j.tins.2007.03.007. [DOI] [PubMed] [Google Scholar]
- Schultz W, Dickinson A. Neuronal coding of prediction errors. Annu Rev Neurosci. 2000;23:473–500. doi: 10.1146/annurev.neuro.23.1.473. [DOI] [PubMed] [Google Scholar]
- Schultz W, Apicella P, Scarnati E, Ljungberg T. Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci. 1992;12:4595–4610. doi: 10.1523/JNEUROSCI.12-12-04595.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shohamy D, Wagner AD. Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron. 2008;60:378–389. doi: 10.1016/j.neuron.2008.09.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith-Roe SL, Kelley AE. Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning. J Neurosci. 2000;20:7737–7742. doi: 10.1523/JNEUROSCI.20-20-07737.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Steele RJ, Morris RGM. Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP5. Hippocampus. 1999;9:118–136. doi: 10.1002/(SICI)1098-1063(1999)9:2<118::AID-HIPO4>3.0.CO;2-8. [DOI] [PubMed] [Google Scholar]
- Steinfels GF, Heym J, Strecker RE, Jacobs BL. Behavioral correlates of dopaminergic unit activity in freely moving cats. Brain Res. 1983;258:217–228. doi: 10.1016/0006-8993(83)91145-9. [DOI] [PubMed] [Google Scholar]
- Swanson LW. The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res Bull. 1982;9:321–353. doi: 10.1016/0361-9230(82)90145-9. [DOI] [PubMed] [Google Scholar]
- Swanson-Park JL, Coussens CM, Mason-Parker SE, Raymond CR, Hargreaves EL, Dragunow M, Cohen AS, Abraham WC. A double dissociation within the hippocampus of dopamine D1/D5 receptor and beta-adrenergic receptor contributions to the persistence of long-term potentiation. Neuroscience. 1999;92:485–497. doi: 10.1016/s0306-4522(99)00010-x. [DOI] [PubMed] [Google Scholar]
- Taghzouti K, Simon H, Louilot A, Herman JP, Le Moal M. Behavioral study after local injection of 6-hydroxydopamine into the nucleus accumbens in the rat. Brain Res. 1985;344:9–20. doi: 10.1016/0006-8993(85)91184-9. [DOI] [PubMed] [Google Scholar]
- Tse D, Langston RF, Kakeyama M, Bethus I, Spooner PA, Wood ER, Witter MP, Morris RGM. Schemas and memory consolidation. Science. 2007;316:76–82. doi: 10.1126/science.1135935. [DOI] [PubMed] [Google Scholar]
- Tse D, Langston RF, Bethus I, Wood ER, Witter MP, Morris RGM. Does assimilation into schemas involve systems or cellular consolidation? It's not just time. Neurobiol Learn Mem. 2008;89:361–365. doi: 10.1016/j.nlm.2007.09.007. [DOI] [PubMed] [Google Scholar]
- Umegaki H, Munoz J, Meyer RC, Spangler EL, Yoshimura J, Ikari H, Iguchi A, Ingram DK. Involvement of dopamine D2 receptors in complex maze learning and acetylcholine release in ventral hippocampus of rats. Neuroscience. 2001;103:27–33. doi: 10.1016/s0306-4522(00)00542-x. [DOI] [PubMed] [Google Scholar]
- Valdes JL, McNaughton BL, Fellous JM. Reactivation of populations of ventral tegmental area neurons in the rat. Soc Neurosci Abstr. 2008;34:687.19. [Google Scholar]
- Willuhn I, Steiner H. Motor-skill learning-associated gene regulation in the striatum: effects of cocaine. Neuropsychopharmacology. 2006;31:2669–2682. doi: 10.1038/sj.npp.1300995. [DOI] [PubMed] [Google Scholar]
- Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Düzel E. Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron. 2005;45:459–467. doi: 10.1016/j.neuron.2005.01.010. [DOI] [PubMed] [Google Scholar]