Abstract
The environmental context associated with previous drug consumption is a potent trigger for drug relapse. However, the mechanism by which neural representations of context are modified to incorporate information associated with drugs of abuse remains unknown. Using longitudinal calcium imaging in freely behaving mice, we find that unlike the associative learning of natural reward, drug-context associations for psychostimulants and opioids are encoded in a specific subset of hippocampal neurons. After drug conditioning, these neurons weakened their spatial coding for the non-drug paired context, resulting in an orthogonal representation for the drug versus non-drug context that was predictive of drug-seeking behavior. Furthermore, these neurons were selected based on drug-spatial experience and were exclusively tuned to animals’ allocentric position. Together, this work reveals how drugs of abuse alter the hippocampal circuit to encode drug-context associations and points to the possibility of targeting drug-associated memory in the hippocampus.
Subject terms: Hippocampus, Neural circuits
Drug-associated contexts are a strong trigger for relapse to substance use. Here, the authors report that a subpopulation of neurons in the hippocampus of mice specifically encode drug-associated contextual information.
Introduction
A core challenge of long-term recovery from drug addiction is the associated high relapse rate, in which a person returns to drug use after a period of abstinence1. One of the strongest triggers for relapse in both humans and animal models is re-exposure to a drug-associated environmental context2–6. During repeated drug use, a given environmental context is passively associated with the rewarding effects of the drug, such that a previously neutral context may become a conditioned stimulus that can reliably reinstate drug-seeking behavior7,8. While mesolimbic dopamine broadcasts a general reward signal that likely supports this process, converging evidence also suggests that reward associative learning relies on multiple memory systems, including the nucleus accumbens (NAc), amygdala, and hippocampus, working in parallel to integrate the necessary sensorimotor information5,9–15. In particular, the hippocampus may play a critical role in drug associative learning and the reinstatement of drug seeking behavior, by providing a neural representation of the spatial or contextual information associated with previous drug use16–23.
The hippocampus contains place cells that fire in one or few restricted spatial locations in a given environment24,25. As a population, place cells construct a map-like representation for the environmental space25,26. Across different spatial environments, or contexts, place cells can show uncorrelated activity, with place fields turning on, off, or firing in a new spatial position. These changes in place field activity are collectively referred to as place cell ‘remapping’, which encompasses two phenomena: a change in the firing rate of a place field (rate remapping) and a change in the spatial location of the place field (global remapping)26–39. Importantly, place cell representations also track the presence of reward, such as food or water, by clustering their place fields near reward-associated locations, resulting in an over-representation of reward locations36,40–46. These observations of place cell remapping have lent significant support to the theory that the hippocampus contains the neural representations needed to encode the combination of sensory cues and internal states that define a given spatial context38,47. However, it is unknown whether and how hippocampal place cell representations remap in a maladaptive manner to encode or maintain drug-context associations.
As drug-context associations require repeated drug exposures over an extended period of time, following the activity of the same individual neurons across days is critical for investigating how neurons change their firing patterns over the course of drug-context learning. Here, we used miniscopes to image calcium activity in freely moving mice48–50 to examine the representation change of hippocampal place cells over the course of conditioned place preference (CPP)51,52. We identified a subset of CA1 place cells that switched off their activity in the saline-paired context after drug conditioning. This form of remapping in a subset of place cells generalized across addictive drugs (methamphetamine, morphine) but was not seen under natural reward conditions. By focusing on the effects of methamphetamine (MA), a psychostimulant that alters catecholaminergic signaling53, we found this subset of place cells showed orthogonal activity patterns between the two CPP contexts after drug conditioning, with the resulting remapped pattern predictive of CPP behavior. Our work reveals a potential mechanism in the hippocampus for encoding associations between spatial contexts and addictive drugs via a sub-population of hippocampal neurons.
Results
Imaging of CA1 cells in a conditioned place preference (CPP) paradigm
To examine the effects of drug-context associations on the activity of CA1 neurons, we performed in vivo single photon (1P) miniscope calcium imaging in mice during a conditioned place preference (CPP) paradigm (Fig. 1). The CPP apparatus consisted of two compartments, with distinct contexts defined by different colors and visual cues (Fig. 1a, b). After two days of habituation, mice were allowed access to both CPP contexts for the pre-baseline and baseline sessions (day 1 = pre-baseline; day 2 = baseline) (Fig. 1b). An animal’s natural context preference was determined on day 2 (baseline session) (Fig. 1b). For conditioning (n = 3 sessions), saline injections were paired with the naturally preferred context, while methamphetamine (MA) injections were paired with the naturally non-preferred context (Fig. 1b). One and six days after the conditioning, two test sessions (test 1 and test 2, respectively) were performed to assess post-conditioning place preference (Fig. 1b). Control (Ctrl) mice (n = 7 mice) underwent the same protocol but saline injections were paired with both contexts during the conditioning (Fig. 1b). In MA mice (n = 10 mice), we observed significant place preference for the MA-paired context in the test sessions (mean ± SEM, test 1: Ctrl vs. MA, −5.62 ± 43.28 vs. 147.80 ± 37.21 s; test 2: Ctrl vs. MA, 6.89 ± 28.67 vs. 204.10 ± 29.74 s, n = 7 and 10, respectively; Fig. 1c, “Methods”).
We used Ai94; Camk2a-tTA; Camk2a-Cre transgenic mice (Fig. 1d) to enable stable GCaMP6s expression in CA1 pyramidal neurons and single cell tracking across multiple days, as demonstrated in the maximum projected images and the colocalization analysis from different imaging sessions after alignment (Fig. 1e, Supplementary Fig. 1a–d, Supplementary Movies 1–3). We extracted calcium signals, using a CNMF-based method54, from aligned and temporally concatenated image data for each animal. This method has shown improved cell registration from calcium signals48,55 (Fig. 1e, Supplementary Fig. 1a). Calcium signals were then binarized into deconvolved spikes56, which we treated as calcium events (Supplementary Fig. 1e).
In both Ctrl and MA animals, we observed stable spatial representations of CA1 place cells in both CPP contexts across days (median correlation, Ctrl: preferred context, baseline (bsl) vs. test 1 = 0.57, bsl vs. test 2 = 0.58; non-preferred context, bsl vs. test 1 = 0.56, bsl vs. test 2 = 0.51; n = 1680 place cells from 7 mice; MA: preferred context, bsl vs. test 1 = 0.58, bsl vs. test 2 = 0.50; non-preferred context, bsl vs. test 1 = 0.54, bsl vs. test 2 = 0.52; n = 2882 place cells from 9 mice), with place cells defined by their activity in the baseline session (Fig. 1b, f). Across the two CPP contexts within the baseline session, we observed signatures of both rate and global remapping for place cells (Fig. 1b). For both Ctrl and MA mice, place cells showed similar inter-compartment (between the left and right CPP contexts) spatial correlations in the baseline session, with ~55% place cells showing signatures of rate remapping (spatial correlation > 0.4) (Fig. 1g). For rate remapped place cells, we observed a ~43% change in peak calcium event rates between place fields across the two contexts (Fig. 1h). Previous work has reported that when animals are exposed to different novel environments, place cell representations become increasingly orthogonal between the environments as a function of experience37. However, in Ctrl mice, inter-compartment spatial correlations of place cells remained constant over baseline and test session (median correlation: 0.43, 0.49, and 0.46, for baseline, test 1, and test 2 in Ctrl mice, respectively), suggesting the observed rate remapping in the baseline session is not due to insufficient experience in the CPP environment. Together these data demonstrate that in baseline sessions, CA1 place cells in both Ctrl and MA mice remap between the two contexts of a CPP paradigm.
MA-conditioning results in a context-specific decrease in place cell number
We next considered whether MA-conditioning induced changes in CA1 place cells at the population level. We calculated the proportion of place cells over time for each animal in a context-specific manner. In Ctrl mice, the number of place cells remained the same across sessions in both contexts (Fig. 2a). However, in MA mice, we found a significant decrease in the number of place cells specifically in the saline-paired context in the test sessions compared to baseline (mean ± SEM, baseline: 0.53 ± 0.03, test 1: 0.39 ± 0.03, test 2: 0.40 ± 0.02, n = 9; Fig. 2b). As the activity of place cells changes over time49, this decrease in place cell number in MA mice could either reflect the loss of existing place cells or the absence of the addition of new place cells. To examine these possibilities, we defined four functional cell types based on how their context-specific activity changed between baseline and test sessions (Fig. 2c). Namely, cells with place fields in the preferred context in baseline that lost their spatial tuning in the same context in both test sessions were defined as disPCp (disappeared place cells in the preferred context; note the preferred context is equivalent to the saline-paired context in MA mice). A similar definition was applied to disPCnp for the non-preferred context (disappeared place cells in the non-preferred context; note the non-preferred context is equivalent to the MA-paired context in MA mice). Cells with no spatial tuning in baseline but a place field in the preferred or non-preferred context for both test sessions were defined as aPCp (appeared place cells in the preferred context) and aPCnp (appeared place cells in the non-preferred context), respectively (Fig. 2c). Quantifying the proportion of these four cell types revealed that Ctrl mice showed a stable turnover rate of place cells across the two contexts (mean ± SEM, disPCp vs. disPCnp: 0.11 ± 0.01 vs. 0.11 ± 0.01; aPCp vs. aPCnp: 0.09 ± 0.01 vs. 0.09 ± 0.01, n = 7; Fig. 2d). However, in MA mice, the proportion of disPCp was greater than disPCnp, while the proportion of aPCp was lower than aPCnp (mean ± SEM, disPCp vs. disPCnp: 0.18 ± 0.01 vs. 0.12 ± 0.01; aPCp vs. aPCnp: 0.066 ± 0.007 vs. 0.10 ± 0.01, n = 9; Fig. 2d). This result indicates that, in MA mice, more place cells disappeared and fewer place cells appeared in the originally preferred (saline-paired) context compared to the non-preferred (MA-paired) context. This effect did not result from a change in the animals’ spatial coverage across the two CPP contexts, or a running speed and head direction sampling difference between baseline and test sessions (Supplementary Fig. 2a–f). These results thus suggest that MA conditioning induced an overall loss of place fields specifically in the saline-paired context.
Context-specific loss of place cells was specific to drug rewards
To compare the MA-induced place cell changes to what occurs during natural reward learning, we performed sucrose conditioned place preference (Sucrose CPP) while imaging hippocampal activity in a separate cohort of mice (n = 8 mice) (Supplementary Fig. 3a). Pairing sucrose with the naturally non-preferred context induced a significant place preference shift in test sessions (Supplementary Fig. 3b) without affecting the animals’ speed and head direction sampling (Supplementary Fig. 2g). The degree of place preference shift in sucrose mice was comparable to that observed in MA mice (Supplementary Fig. 3c). However, for sucrose mice, the number of place cells across sessions remained stable in both contexts and the rate of place cell turnover did not differ between the two contexts (mean ± SEM, disPCp vs. disPCnp: 0.12 ± 0.009 vs. 0.11 ± 0.01; aPCp vs. aPCnp: 0.11 ± 0.007 vs. 0.13 ± 0.02, n = 8; Fig. 2e, g).
We next considered whether the changes we observed in place cells in MA mice occurred in response to other addictive drugs. In a separate cohort of mice, we performed morphine conditioned place preference (MO CPP) while imaging hippocampal activity (n = 12 mice) (Supplementary Fig. 3d, e). In MO mice, between baseline and test sessions, we observed a decrease in the number of place cells for the saline-paired context (mean ± SEM, baseline: 0.48 ± 0.04, test 1: 0.40 ± 0.03, test 2: 0.39 ± 0.04, n = 10) as well as an unbalanced rate of place cell turnover between the two contexts (mean ± SEM, disPCp vs. disPCnp: 0.15 ± 0.01 vs. 0.12 ± 0.01; aPCp vs. aPCnp: 0.073 ± 0.009 vs. 0.11 ± 0.01, n = 10; Fig. 2f, h). These place cell changes were consistent with those observed in MA mice. In addition, experiments using a conditioned place aversion protocol showed a distinct effect on place cells compared to the CPP experiments, supporting the idea that drug-induced place cell changes reflect the rewarding effects of the drug, rather than drug withdrawal, a preference shift or the stereotyped behavior observed during conditioning sessions (Supplementary Figs. 2h–j, 3f–j). Together, these results indicate that the changes in place cell activity observed in drug CPP are due to an association between the rewarding effects of the drug and the corresponding spatial context.
The activity of disPCp encodes the drug-context association
To further consider the relationship between changes in place cell activity and drug-context associations, we focused on MA CPP. First, to examine whether the unbalanced rate of place cell turnover impacts the accuracy of spatial coding, we trained a Naive Bayes classifier using baseline data and examined the accuracy of position decoding using test session data (Supplementary Fig. 4a, “Methods”). We found that despite the context-specific loss of place cells in MA mice, Ctrl and MA mice showed comparable overall decoding performance, and MA mice showed comparable decoding accuracy between the preferred and non-preferred contexts (Supplementary Fig. 4b–h).
We next considered whether the activity of the four functional cell types (disPCp, disPCnp, aPCp, aPCnp) correlated with the CPP behavior. We quantified an inter-compartment spatial correlation for baseline and test sessions using each of the four functional cell types (Fig. 3a). Strikingly, the spatial correlation difference of disPCp (CorrDiff, baseline – test; Fig. 3a) was significantly positively correlated with the behavioral CPP score in MA mice (Fig. 3b). This correlation with behavior was not observed in Ctrl mice or for any other functional cell type (Fig. 3b). Interestingly, the CorrDiff value for disPCp was significantly higher than zero in MA mice (Fig. 3b), suggesting that drug conditioning resulted in disPCp exhibiting more uncorrelated inter-compartment representations for the two CPP contexts in test sessions. To further characterize the correlation of disPCp with CPP behavior, we quantified the type of activity change that disPCp exhibited. First, in MA mice, 34 ± 3% of place cells with place fields in the MA-paired context were disPCp. Furthermore, ~50% of disPCp showed significant spatial tuning in the MA-paired context and this percentage remained similar between baseline and test sessions (Fig. 3c). Next, we split disPCp into two groups based on their activity in the baseline session; Group 1 (48 ± 2%, n = 9): disPCp with significant place fields in both contexts in baseline (Fig. 3d); Group 2 (52 ± 2%): disPCp with a significant place field only in the preferred (i.e., saline-paired) context in baseline (Fig. 3e). Within Group 1, 76 ± 4% of disPCp maintained their spatial tuning in the MA-paired context in at least one of the test sessions, while the remaining 24 ± 4% lost their spatial tuning (Fig. 3d). Within Group 2, 54 ± 5% of disPCp gained a new place field in the MA-paired context in at least one of the test sessions, while the remaining 46 ± 5% did not gain a new place field (Fig. 3e). These quantifications indicate that the correlation between the CorrDiff value for disPCp and CPP behavior likely reflects the cumulative result of heterogeneous remapping patterns in disPCp. Finally, the spatial stability (as measured within the baseline or test sessions) of MA disPCp in the drug-paired context was not affected by drug-conditioning (Fig. 3f). Together, these data suggest that drug-context associations differentiate the spatial representations of disPCp across the two CPP contexts, resulting in a cumulative remapping pattern predictive of CPP behavior.
disPCp contribute to the encoding of MA-paired context after conditioning
To assess the degree to which disPCp contribute to the encoding of drug-context associations we applied a computational knockout (KO) decoding analysis based on the aforementioned naive Bayes classifier (Fig. 4a, Supplementary Fig. 4, “Methods”). In the KO decoding analyses, we computationally removed either disPCp or a random group of neurons (sample-size matched) from the data set before feeding them into the trained classifier for making predictions (Fig. 4a). We performed two sets of computational KO decoding analyses to investigate the contribution of disPCp to encoding the CPP contexts before and after drug conditioning. First, we trained the decoder on one of the baseline sessions and then used the decoder to make the predictions on the other baseline session. Second, we trained the decoder on one of the test sessions and then used the decoder to make predictions regarding the time spent in each CPP compartment on the other test session. To directly visualize the contribution of disPCp to CPP behavior (i.e., the time spent in each CPP compartment), we plotted the reconstructed CPP time generated by the decoder for each individual mouse as heatmaps for each CPP context (Fig. 4b–d). In Ctrl mice, there was no significant difference in the reconstructed CPP time for random versus disPCp KO in either the baseline (proportion of total time in the non-preferred context, mean ± SEM, disPCp KO: 0.47 ± 0.01; random KO: 0.47 ± 0.01, n = 7) or the test analysis (mean ± SEM, disPCp KO: 0.50 ± 0.02; random KO: 0.51 ± 0.02, n = 7; Fig. 4c). Note, given the high decoding accuracy in both contexts (Supplementary Fig. 4), the results from the random KO condition largely recapitulated the true behavioral CPP time (Supplementary Fig. 4i), with more reconstructed time shown in the naturally preferred context in baseline (left column of Fig. 4c, d). In MA mice, there was no significant difference in the reconstructed CPP time for random versus disPCp KO in the baseline analysis (proportion of total time in the MA context, mean ± SEM, disPCp KO: 0.46 ± 0.02; random KO: 0.44 ± 0.02, n = 9; Fig. 4d, left). Notably, however, in the test analysis, the reconstructed CPP time captured the MA-induced place preference for the random KO, but this place preference was disrupted for the disPCp KO (mean ± SEM, disPCp KO: 0.50 ± 0.01; random KO: 0.55 ± 0.01, n = 9; Fig. 4d, right). This result was not due to the larger proportion of disPCp in MA compared to Ctrl mice, as matching the proportion of disPCp between MA and Ctrl mice by down-sampling replicated this result (Supplementary Fig. 4j). Together, these results suggest that disPCp in MA mice biased their encoding towards representing the drug-paired context after drug conditioning.
The down-sampling result (Supplementary Fig. 4j) raises the possibility that other factors may contribute to the biased encoding of disPCp, besides the loss of spatial tuning in the saline-paired context. Indeed, the biased encoding of the drug-paired context by disPCp was also reflected in the place cell metrics for disPCp in the MA-paired context. In MA mice, disPCp place fields in the MA-paired context had a decreased peak calcium event rate, increased spatial information and a smaller field size between the baseline and test sessions (Fig. 4e–g, orange plots). These effects were not seen in Ctrl mice (Fig. 4e–g, blue plots). These results suggest that in addition to losing their spatial tuning in the saline-paired context after MA conditioning, disPCp may contribute to the encoding of drug-context associations by sharpening their place fields in the MA-paired context.
We next considered how much disPCp contributed to the encoding of drug-context associations compared to other functionally defined place cell types. We identified a fifth functional cell type that retained spatial tuning in the saline-paired context for at least one test session (termed rtPCp: retained place cells on the preferred side. Note disPCp and rtPCp are mutually exclusive; Fig. 4h). We then compared the contribution of disPCp versus rtPCp to the spatial coding of MA-paired context after conditioning (Fig. 4h, i). We again trained the naive Bayes decoder using data from the baseline session and examined the accuracy of position decoding in the MA-paired context using data from the test sessions (Fig. 4i). In Ctrl mice, rtPCp and disPCp KO showed comparable decoding errors (mean ± SEM: rtPCp KO, 9.95 ± 0.95 cm; disPCp KO, 10.09 ± 0.94 cm, n = 14; Fig. 4j). However, in MA mice, disPCp KO resulted in significantly larger decoding errors than rtPCp KO, suggesting that disPCp contributed more to the spatial coding of the MA-paired context than rtPCp in test sessions (mean ± SEM: rtPCp KO, 9.12 ± 0.54 cm; disPCp KO, 9.72 ± 0.62 cm, n = 18; Fig. 4j). Together, compared to place cells similarly defined by their activity in the saline-paired context in baseline (rtPCp), disPCp contributed significantly more to the encoding of the drug-associated context after drug conditioning.
disPCp in MA mice emerge in an experience-dependent manner
We next hypothesized that the recruitment of disPCp cells to represent the MA-paired context depended on where those cells fired during the baseline session. Specifically, if a cell fired at a location in baseline that was subsequently visited during drug conditioning, we hypothesized that this cell was more likely to be recruited as disPCp. As the center of the CPP junction was not accessible during conditioning, we used center-firing cells in the test session as a comparison group to test this hypothesis (Fig. 5a, b). In baseline sessions, we observed a subset of place cells that were selectively active in the junction between the two CPP compartments (‘center-firing’ neurons) (Fig. 5b). As visiting the junction location was not possible during the conditioning sessions, in which the drug-context association took place, we hypothesized that ‘center-firing’ neurons in baseline would have a minimal contribution to the encoding of drug-context associations, which could manifest as a lower proportion of ‘center-firing’ neurons classified as disPCp in MA mice. To test this hypothesis, we used a k-means method to group neurons into temporally synchronized clusters using their calcium signals in the baseline session (Fig. 5c, Supplementary Fig. 5, “Methods”). This clustering approach identified a ‘center cluster’ (i.e., center-firing neurons), as well as four clusters with peak ensemble activity at different spatial positions across the CPP compartments (Northeast [NE], Northwest [NW], Southeast [SE], and Southwest [SW]) (Supplementary Fig. 6a–c).
The proportion of neurons assigned to each cluster was roughly equal across animals (Fig. 5d). While disPCp were equally distributed across the five clusters in Ctrl mice, they were not equally distributed in MA mice (Fig. 5e, f). In MA mice, this unequal distribution was visualized by plotting the summed disPCp rate maps according to their cluster assignment (Fig. 5e), which revealed a smaller proportion of disPCp in the center cluster (mean ± SEM, 0.12 ± 0.01) compared to all other clusters (NW: 0.19 ± 0.01, SW: 0.19 ± 0.03, NE: 0.18 ± 0.02, SE: 0.22 ± 0.02) (Fig. 5f). This effect was not due to insufficient neural activity during the conditioning sessions in MA mice (Supplementary Fig. 6d), as during conditioning, center cluster neurons often remapped such that they were maximally active in another spatial location (Fig. 5b). We also did not observe any differences in the number of traversals across the junction between baseline and test sessions (Supplementary Fig. 6e) nor the running speed (Supplementary Fig. 2d). As further validation of this result, we quantified the spatial correlation of place cells in each cluster between spatial maps in baseline and test sessions, as a higher proportion of disPCp decreases this correlation value. As expected, in MA mice, center-clustered neurons showed a higher spatial map correlation compared to all other clusters, consistent with a lower proportion for disPCp in the center cluster compared to all other clusters (Fig. 5g). Interestingly, in MA mice, the anatomical distribution across CA1 of each disPCp cluster was intermingled (Fig. 5h), as demonstrated by the quantification of the pair-wise intra- vs. inter-cluster distances within disPCp (Supplementary Fig. 6f). Together, these results suggest that disPCp depend, in part, on the spatial locations experienced during drug conditioning.
Drug-context associations primarily affect place cells that are exclusively tuned to position
Previous studies have shown that neurons in the hippocampus and medial entorhinal cortex can conjunctively respond to an animal’s spatial position, head direction, and speed (i.e., exhibit mixed selectivity)57–59 and that task learning impacts mixed-selective hippocampal place cells more than position coding only place cells58. To examine whether drug-context associations influenced mixed-selective versus position coding only place cells, we used a linear-non-linear Poisson (LN) model57 (Fig. 6a). This approach has the additional benefit of accounting for potential correlations between spatial variables and behavioral variables such as running speed or head direction57,58. Using the LN model, we then classified place cells as those that exclusively encoded position versus those that encoded position (P) with speed (S) and/or head direction (HD) (i.e., showed mixed selectivity, Fig. 6b, c)58. Consistent with previous studies58–61, we identified position coding only (P) and mixed-selective CA1 place cells (PS, PH, PHS), with very few CA1 cells tuned only to speed or head direction (H, S, HS) (Fig. 6b–d and Supplementary Fig. 7). Consistent with our previous analyses, we observed a decreased number of place cells specifically in the saline-paired context in MA mice (Fig. 6d). Interestingly, drug-context associative learning primarily decreased the number of position coding only place cells (P) in the saline-paired context, while the number of mixed-selective place cells (PS, PH, PHS) did not change after drug conditioning (Fig. 6d). These effects were not observed in either Ctrl or sucrose mice (Supplementary Fig. 7). However, in sucrose mice, we observed an increase in the number of position coding only place cells specifically in the sucrose-paired context, which is consistent with previous works that observe place cell over-representation of food reward44,46,62,63. This increase in the number of position coding-only place cells in the sucrose-paired context differed from our prior result that considered both position coding only and mixed selective place cells together (Fig. 3e). Nevertheless, in both sets of analyses (Fig. 2e and Supplementary Fig. 7b), MA and sucrose conditioning showed distinct impacts on place cells, with only MA conditioning decreasing the number of place cells in the saline-paired context. Thus together, the LN model-based approach confirmed the different effects that drug versus sucrose conditioning have on place cell coding. Moreover, the model revealed that both drug-context and natural reward associative learning impacted place cells dedicated to encoding the position of the animal more than mixed selective place cells.
Discussion
Addiction is often viewed as a process of pathological learning. Here, we investigated whether addictive substances could leverage neural circuits of natural learning and memory to achieve maladaptive learning, which may play a role in later drug-seeking behavior. We report that a subset of CA1 place cells (disPCp) correspond to associative learning between drug rewards and environmental context. The emergence of disPCp was consistent across addictive drugs (i.e., methamphetamine and morphine) and not observed in response to natural reward learning nor drug withdrawal. This functionally defined cell class represented the drug-paired context by switching off their activity in the saline-paired context and sharpening their place coding in the drug-paired context. These changes in disPCp activity resulted in a more orthogonalized representation for the two CPP contexts, with the degree to which disPCp remapped between the two contexts correlated with CPP behavior. Further, drug conditioning primarily impacted place cells tuned only to position, and not mixed selective place cells. Together, this work reveals a sub-population of hippocampal CA1 place cells that encode drug-associated contextual information, raising the possibility that future work may be able to target the specific subset of neurons that encode memories of drug use64–66.
Previous works have shown that place cell activity can be modulated by spatial locations with a high behavioral significance, such as goal locations associated with rewards (e.g., food or water; for review, see ref. 67). Several phenomena have been observed regarding reward-driven changes to hippocampal place cell coding features. First, place cell firing fields often accumulate near locations associated with reward44,46,62,63. The over-representation of reward locations by place cells typically develops through experience, with the firing fields of place cells gradually shifting closer to the reward or goal location over behavioral trials or sessions35,36,68–70. This over-representation of reward locations also reflects the activity of a small population of hippocampal neurons dedicated to coding reward62. Second, studies have reported elevated activity in existing place cells (i.e., out-of-field firing activity) around reward or goal locations, which is not accompanied by an accumulation of place fields71–73. Consistent with previous observations of reward-associated changes in place cells, disPCp developed with experience, and ultimately increased the relative representation of the drug-paired context. Moreover, in the sucrose CPP experiment, we observed an over-representation in the sucrose-paired context in position coding only place cells. Of note, however, in our work, the effect of drug conditioning on place cells (a decreased number of place cells specifically in the saline-paired context) clearly differed from the effect of natural reward conditioning on place cells. Thus, our observations reflect place cell changes specific to learned associations between the reward of a drug and an environmental context, raising the possibility that addictive drugs may usurp the normal hippocampal machinery for learning reward or goal associated locations within an environment8,74,75.
Our observation of a large number of place cells that exhibited rate remapping across the two CPP contexts in baseline is consistent with previous works that have shown that place cells can exhibit similar place field locations across geometrically identical contexts or segments of linear tracks76–79. Under such conditions, place cells often show homotopic place tuning (i.e., have place fields in similar locations between contexts) with rate remapping, which could support firing rate-based discrimination of different contexts. Interestingly, in the current work, the representation of the two CPP contexts by disPCp became more orthogonal after drug conditioning. One possibility is that this orthogonalization could amplify the differences between the two contexts and facilitate pattern separation, which could support memory encoding and recall of the pairing between the drug and corresponding spatial context. It will be of interest for future work to consider to what degree this orthogonalization in the disPCp representation reflects the distinctness or similarity between the two CPP contexts. An alternative interpretation is that disPCp represent a value-based signal that facilitates a comparison between drug- and saline-paired contexts. However, previous works have found little evidence for the influence of value on hippocampal neural coding72,80–82. Thus a more likely interpretation is that the disPCp provide a mechanism for encoding drug-associated contextual information, which then goes on to inform value coding in other brain regions and drive drug-seeking behavior83,84.
Of note, while we observed different forms of remapping with drug and saline-paired CPP, our measurements of long-term stability of place cells remained relatively high (median stability values from all conditions >0.5). This differs from previous studies using calcium imaging in freely moving animals, which have reported more dynamic and unstable place cell representations across days (stability values ~ 0.2)49,85. One possibility is that the increased long-term place cell stability we observed reflects the geometry or sensory complexity of the CPP environment. Previous works have primarily investigated long-term place cell stability using 1D linear tracks or 1D sensory treadmills, while our mice were running freely in a two chamber 2D environment, which could provide more sensory or landmark input to support stable place maps over longer time periods.
Our observations of drug-driven changes to hippocampal place cell representations almost certainly interface with other brain regions to encode drug-associated contexts and drive drug-seeking behavior. Given the biochemical nature of MA and MO, direct monoamine inputs from locus coeruleus44,86,87, VTA88–90, and raphe nuclei91,92 could all play a role in the emergence of disPCp. Hippocampal representations of drug-associated contexts then likely interface with regions like the nucleus accumbens (NAc), one of the major efferent targets of the hippocampal formation, with hippocampal-NAc circuit interactions playing a key role in spatial context conditioning9,21,93. Notably, recent work revealed that cocaine place conditioning increases the functional drive from hippocampal CA1 neurons that encode cocaine-paired locations to NAc medium spiny neurons17. Thus, one possibility is that the disPCp route information directly to the NAc to encode drug-associated spatial contexts, with this circuit then potentially provoking future drug-seeking behavior94. Another possible long-range target of disPCp are neurons in the lateral septum, a region that plays a critical role in context-induced reinstatement of drug-seeking behaviors16,23. Within the hippocampal formation, disPCp may route information to the subiculum95, where electrical stimulation has been shown to increase dopamine levels in NAc and trigger cocaine relapse that resembles context-induced drug reinstatement20,90. Another potential local efferent target is the medial entorhinal cortex, which innervates the NAc96,97 and contains neurons that both encode the position and orientation of an animal that are modulated by reward locations98,99. Given the intermingled anatomical distribution of disPCp and collateralization of CA1 neurons, it is likely that drug-associated information encoded by disPCp is broadcast to multiple downstream targets. Nevertheless, further investigation will be needed to identify the full circuit mechanisms by which disPCp interact with known reward circuitry to drive drug-seeking behavior.
Methods
Subjects
All procedures were conducted according to the National Institutes of Health guidelines for animal care and use and approved by the Institutional Animal Care and Use Committee at Stanford University School of Medicine. For imaging experiments, Ai94;Camk2a-tTA;Camk2a-Cre (JAX id: 024115 and 005359) mice were used (n = 54 total mice in the study). We did not observe obvious epileptiform events in calcium activity or gross abnormal behavior in these mice100. Male and female (Ctrl: 3 male and 4 female; MA: 6 male and 4 female; Sucrose: 4 male and 4 female; Sucrose (ctrl): 1 male and 2 female; MO: 8 male and 4 female; CPA MO + saline: 3 male and 3 female; CPA MO + naloxone: 5 male and 3 female) mice were group housed with same-sex littermates until the time of surgery. At the time of surgery, mice were 8–12 weeks old (19–28 g). After surgery mice were singly housed. Mice were kept on a 12-h light/dark cycle and had ad libitum access to food and water in their home cages at all times. All experiments were carried out during the light phase. Due to a limited number of miniscopes and the availability of transgenic mice, up to six mice were used as a cohort for each batch of experiments.
GRIN lens implantation and baseplate placement
Mice were anesthetized with continuous 1–1.5% isoflurane and head fixed in a rodent stereotax. A three-axis digitally controlled micromanipulator guided by a digital atlas was used to determine bregma and lambda coordinates. To implant the gradient refractive index (GRIN) lens above the CA1 regions of the hippocampus, a 1.8 mm-diameter circular craniotomy was made over the posterior cortex (centered at −2.30 mm anterior/posterior and +1.75 mm medial/lateral, relative to bregma). The dura was then gently removed and the cortex directly below the craniotomy aspirated using a 27- or 30-gauge blunt syringe needle attached to a vacuum pump under constant irrigation with sterile saline. The aspiration removed the corpus callosum above the hippocampal imaging window but left the alveus intact. Excessive bleeding was controlled using a hemostatic sponge that had been torn into small pieces and soaked in sterile saline. As determined using the Allen Brain Atlas (www.brain-map.org/), the unilateral cortical aspiration impacted part of the anteromedial visual area but the procedure left the primary visual area intact. The GRIN lens (0.25 pitch, 0.55 NA, 1.8 mm diameter and 4.31 mm in length, Edmund Optics) was then slowly lowered with a stereotaxic arm to CA1 to a depth of −1.53 mm relative to the measurement of the skull surface at bregma. A skull screw was placed on the contralateral side of the skull surface. Both the GRIN lens and skull screw were then fixed with cyanoacrylate and dental cement. Kwik-Sil (World Precision Instruments) was used to cover the lens at the end of surgery. Two weeks after the implantation of the GRIN lens, a small aluminum baseplate was cemented to the animal’s head on top of the existing dental cement. Specifically, Kwik-Sil was removed to expose the GRIN lens. A miniscope was then fitted into the baseplate and locked in position so that GCaMP6s expressing neurons and visible landmarks, such as blood vessels were in focus in the field of view. After the installation of the baseplate, the imaging window was fixed for the long-term in respect to the miniscope used during installation. Thus, for all imaging experiments, each mouse had a dedicated miniscope. When not imaging, a plastic cap was placed in the baseplate to protect the GRIN lens from dust and dirt.
Methamphetamine and morphine conditioned place preference (MA or MO CPP)
After mice had fully recovered from the baseplate surgery, they were handled and allowed to habituate to wearing the head-mounted miniscope by freely exploring an open arena for 20 min every day for 1 week. If the animal still showed muscle weakness (as indicated by the difficulty in holding their heads up towards the end of each session) at the end of the first week, they underwent an extra week of habituation. In parallel, animals were also habituated to mock intraperitoneal injections (needle poking) once a day for 4 days.
Conditioned place preference (CPP) sessions took place in a different room from the habituation sessions described in the previous paragraph. This dedicated CPP room contained salient distal visual cues, which were kept constant over the course of the entire experiment. The CPP apparatus consisted of two 25 × 25 cm compartments with distinct colors and visual cues (Fig. 1a). The two compartments could be connected by a sliding door in the middle. The door opening was 6.5 cm wide, so that the mouse could easily run between the two compartments during miniscope recordings. The floors of the CPP compartments were covered with ~500 ml of bedding to facilitate exploration. Mice were first habituated for two days (20 min/day) to the CPP apparatus with the door between the CPP compartments open and the miniscope mounted. Each mouse had its own dedicated miniscope for the entire duration of the CPP experiment, which ensured stable longitudinal recordings and facilitated image alignment across different sessions. Before any experiments started, the image quality for each animal was verified by adjusting the power of the excitation light and the focal plane. These scope parameters then remained fixed on the dedicated miniscope over the course of the entire CPP experiment.
After the 2-day habituation, the pre-baseline session occurred on day 1, in which mice could run freely between the two connected CPP compartments for 20 min (with imaging). On day 2, the baseline session, the same experiment was repeated and the behavioral data used to assess the animals’ naturally preferred context (i.e., the compartment where the animal spent more time). Prior to the experiments, we defined an exclusion threshold, in which we would exclude any mouse that spent more than 75% of their total time in one compartment in the baseline session; however, no mice reached this threshold. The subsequent conditioning sessions (3 sets, 6 days of pairings) were performed by confining the animal in one of the CPP compartments for 45 min immediately after a saline or drug administration. During the 45 min, we only imaged from the 15th–30th minute in each mouse. For each set of conditioning sessions, saline was paired in the preferred context on the first conditioning day and the drug paired (MA at 2 mg/kg or MO at 20 mg/kg, injected intraperitoneally) in the non-preferred context on the second conditioning day. This conditioning design was trying to align drug pairings with animals’ internal state and avoid potential ceiling effects for the exploration time17,19,51,101–105. In addition, this design maximumly balanced animals’ spatial coverage between the two CPP contexts, which is critical for place cell analyses (Supplementary Fig. 2a). This conditioning process was repeated 3 times in total such that each animal received 3 saline pairings and 3 drug pairings. Similarly, in control (Ctrl) mice, saline was paired in both CPP contexts, starting with the preferred context. Note that for MA and MO mice, the naturally preferred context was equivalent to the saline-paired context and the non-preferred context was equivalent to the drug-paired context. Twenty-four hours after the last conditioning session, animals were put back into the CPP environment with the two compartments connected again for 20 min with imaging to assess their post-conditioning preferences (defined as test 1). To assess whether any drug-induced preference was long-lasting, we performed a 2nd post-conditioning test (defined as test 2) 5 days after test 1. The behavioral CPP score was defined as the time that the animal spent in the drug-paired context of the CPP apparatus in a test session minus the time it spent in the same context in the baseline session.
Sucrose conditioned place preference (Sucrose CPP)
Sucrose CPP was performed as previously described106, with modifications. In brief, mice were mildly food restricted to ~90–95% of their body weight. Baseline sessions were performed similar to baseline sessions in MA CPP. To minimize the total length of food deprivation, for animal welfare reasons, we accelerated our CPP protocol for the conditioning by using two pairings per day (AM and PM) for 4 days (we only imaged on the first three days). On each day, mice explored their preferred context with drops of water for 20 min (20 μl per min at random locations). Next, mice explored the non-preferred context with drops of 20% sucrose solution for 20 min (20 μl per min at random locations). Sucrose Ctrl mice received water in both contexts during conditioning. One and three days after the conditioning, two test sessions were performed to assess an animal’s preference change.
Morphine conditioned place aversion (CPA)
Morphine CPA was performed as previously described107. Baseline sessions were performed similar to baseline sessions in MA CPP. To establish morphine dependence, mice received a daily intraperitoneal injection of morphine in their home cage for 5 consecutive days. Doses escalated from 10, 20, 30, 40, and 50 mg/kg. On the conditioning day, mice received another 50 mg/kg of morphine first. Two hours after this injection, mice received a single dose of naloxone (5 mg/kg, i.p.) and were put immediately into their naturally preferred context for 20 min (MO + naloxone). For the control condition, mice received a saline injection instead of naloxone (MO + saline). Somatic withdraw signs (jump and rearing) were manually quantified offline. One and three days after the conditioning, two test sessions were performed to assess an animal’s preference change.
Histology
After the imaging experiment was concluded, mice were deeply anesthetized with isoflurane and transcardially perfused with 5 ml of phosphate-buffered saline (PBS), followed by 25 ml of 4% paraformaldehyde-containing phosphate buffer. The brain was removed and left in 4% paraformaldehyde overnight. The next day, samples were transferred to 30% sucrose in PBS. At least 24 h later, the brain was sectioned coronally into 40-µm-thick samples using a cryostat. Sections were mounted and cover-slipped with antifade mounting media with DAPI (Vectashield). Brain slice images were acquired using a ZEISS Axio Imager 2 fluorescence microscope under ×10 or ×20 magnification for both DAPI and GFP channels.
Miniscope imaging data acquisition and initial batch processing
Technical details for the custom-constructed miniscopes and general processing analyses are described in refs. 48, 50 and at miniscope.org. Briefly, this head-mounted scope had a mass of about 3 g and a single, flexible coaxial cable to carried power, control signals, and imaging data to custom open source Data Acquisition (DAQ) hardware and software. In our experiments, we used Miniscope V3, which had a 700 μm × 450 μm field of view with a resolution of 752 pixels × 480 pixels (~1 μm per pixel). Acquired data was packaged by the electronics to comply with the USB video class (UVC) protocol. The data was then transmitted via a Super Speed USB to a PC running custom DAQ software. The DAQ software was written in C++ and used Open Computer Vision (OpenCV) libraries for image acquisition. Images were acquired at ~30 frames per second (fps) and recorded to uncompressed.avi files. The DAQ software also recorded the simultaneous behavior of the mouse through a high-definition webcam (Logitech) at ~30 fps, with time stamps applied to both video streams for offline alignment.
Miniscope videos of individual sessions were first concatenated and down-sampled by a factor of 2 using custom MATLAB scripts, then motion corrected using the NoRMCorre MATLAB package108. To align miniscope videos across different sessions for the entire CPP experiment, we applied an automatic 2D image registration method (github.com/fordanic/image-registration) with rigid x–y translations according to the maximum intensity projection images for each session. The registered videos for each animal were then concatenated together in chronological order to generate a combined data set for extracting calcium activity. To extract the calcium activity from the large combined data set (>10 GB), we used the Sherlock HPC cluster hosted by Stanford University to process the data across 8–12 cores and 600–700 GB of RAM. While processing this combined data set required significant computing resources, it enhanced our ability to track cells across sessions from different days (Fig. 1). This process made it unnecessary to perform individual footprint alignment or cell registration across sessions.
To extract an individual neuron’s calcium activity, we adopted a method of extended constrained non-negative matrix factorization for endoscopic data (CNMF-E)54. CNMF-E is based on the CNMF framework109, which enables simultaneous denoising, deconvolving and demixing of calcium imaging data. A key feature includes modeling the large, rapidly fluctuating background, allowing good separation of single-neuron signals from background, and separation of partially overlapping neurons by taking a neuron’s spatial and temporal information into account (see ref. 54 for details). After iteratively solving a constrained matrix factorization problem, CNMF-E extracted the spatial footprints of neurons and their associated temporal calcium activity. Specifically, the first step of estimating a given neuron’s temporal activity (a scaled version of dF/F, an oft-used metric in calcium imaging studies) was to compute the weighted average of fluorescence intensities after subtracting the temporal activity of other neurons in the given neuron’s region of interest. A deconvolution algorithm called OASIS56 was then applied to obtain the denoised neural activity and deconvolved spiking activity, as illustrated in Supplementary Fig. 1. These extracted calcium signals for the combined data set were then split back into each session according to their individual frame numbers.
The position and speed of the animal were determined by applying a custom MATLAB script to the animal’s behavioral tracking video. Time points at which the speed of the animal was lower than 2 cm/s were identified and excluded them from further analysis. We then used linear interpolation to temporally align the position data to the calcium imaging data.
To further validate the quality of cross-session alignment using the image registration, we analyzed the maximum projected images from each session after the registration with the colocalization analysis available via NIH ImageJ and the JACoP plugin110 (Supplementary Fig. 1). In brief, the two images were background subtracted and a threshold automatically applied based on the Coste’s approach. A cytofluorogram was then plotted for each pixel pair based on their intensity. A Pearson’s coefficient can then be derived by calculating the best-fitting regression line on the cytofluorogram. To test the statistical significance of the colocalization analysis, we used the Coste’s approach to randomly shuffle pixel blocks for one of the images 1000 times and obtained a distribution of concomitantly calculated shuffled coefficients. The 95th percentile of the shuffled distribution were then determined as the significant threshold (Supplementary Fig. 1).
Position-matching for comparisons of cell activity across sessions and CPP compartments
Analyses that compared hippocampal neuronal activity across different sessions (longitudinal comparisons) or across the two CPP compartments within the same session (transverse comparisons) could be influenced by biases in the animal’s spatial occupancy, particularly due to the CPP-related shift in spatial preference. First, we assessed the spatial coverage of animals in baseline and test sessions. Spatial coverage was quantified as the percentage of spatial bins (bin size = 1.8 × 1.8 cm) that an animal physically visited within each session. We found most animals had stable spatial coverage (>90%) across sessions and between the two CPP contexts, despite the place preference change (Supplementary Fig. 3a). To further circumvent the effect of differences in occupancy on our analyses, we implemented a position-matched down-sampling protocol99 when performing longitudinal or transverse comparisons of place cell activity. For down-sampling, we first binned the spatial arena into 1.8 × 1.8 cm non-overlapping bins. We then computed the number of position samples (frames) observed in each spatial bin for the to-be-matched sessions. Finally, the number of samples in each corresponding spatial bin was down-sampled by randomly removing position samples, and the corresponding neural activity, from the session with greater occupancy (Supplementary Fig. 2b, c). Due to the stochastic nature of the down-sampling process, we repeated this procedure 50 times (unless otherwise specified) for each cell, and the final value for each cell was calculated as the average of all 50 iterations. This final value was then used to obtain the reported means or perform statistic comparisons. This protocol was applied to our analyses for all the within-subject comparisons (both longitudinal and transverse). Specific details for each analysis are described in the corresponding methods and figure legends.
Place cell analyses
Calculation of spatial rate maps
After we obtained the deconvolved spiking activity of neurons, we extracted and binarized the effective neuronal calcium events from the deconvolved spiking activity by applying a threshold (3 × standard deviation of all the deconvolved spiking activity for each neuron). The position data was sorted into 1.8 × 1.8 cm non-overlapping spatial bins. The spatial rate map for each neuron was constructed by dividing the total number of calcium events by the animal’s total occupancy in a given spatial bin. The rate maps were smoothed using a 2D convolution with a Gaussian filter that had a standard deviation of 2.
Spatial information and identification of place cells
To quantify the information content of a given neuron’s activity, we calculated spatial information scores in bits/spike (each calcium event is treated as a spike here) for each neuron according to the following formula111,
1 |
where is the probability of the mouse occupying the i-th bin for the neuron, is the neuron’s unsmoothed event rate in the i-th bin, while is the mean rate of the neuron across the entire session. Bins with total occupancy time of <0.1 s were excluded from the calculation. To identify place cells, the timing of calcium events for each neuron was circularly shuffled 1000 times and spatial information (bits/spike) recalculated for each shuffle. This generated a distribution of shuffled information scores for each individual neuron. The value at the 95th % of each shuffled distribution was used as the threshold for classifying a given neuron as a place cell, and we excluded cells with an overall mean calcium event rate <0.1 Hz. This threshold was roughly equal to the 5th % of the mean event rate distribution for all neurons.
To avoid the potential influence of drug-induced change in occupancy on identifying place cells, we classified place cells by applying the position-matching protocol (described in the previous section) in addition to the above shuffling procedure. Namely, the full shuffling procedure was repeated for 20 times, each time on down-sampled neural activity obtained to match the position occupancy of the animal across the two CPP compartments. From these 20 repetitions, we calculated a place cell agreement index (PCI) for each neuron as
2 |
where indicator() is a function that returns 1 when the equation inside the parentheses holds, and 0 otherwise; i is the number of iterations (iter). We chose PCI ≥ 0.3 as the threshold for classifying a neuron as a place cell, based on both the visual inspection of place fields and the resulting proportion of place cells (~70% of total neurons, union of the place cells from both CPP compartments), which was similar to conventional tetrode recordings from CA1112,113. Note that compared with the regular shuffling method that does not perform position matching, the current approach results in slightly fewer cells classified as place cells. Although the place cells classified and used in the current study were all obtained through this position matching method, the general findings regarding the number of place cells described in the results (e.g., Fig. 2) are robust and remain the same even without position matching.
Rate map spatial correlation, cross-session stability, mean, and peak Ca2+ event rate
We applied the position matching protocol in our measures of rate map spatial correlation, cross-session stability, mean and peak Ca2+ event rate of place cells. For each matching iteration, we first computed occupancy-matched rate maps across different sessions or contexts (Supplementary Fig. 2b, c). Spatial correlation or cross-session stability was calculated as the Pearson’s correlation coefficient between the occupancy-matched rate maps. Mean Ca2+ event rate was measured as the number of spikes in the occupancy-matched rate maps divided by the summed matched-occupancy time. Peak Ca2+ event rate was measured as the maximum of the occupancy-matched rate map. Final values for these metrics were obtained by averaging all the 50 matching iterations.
Quantification of place field size
We only measured place fields in neurons classified as place cells in a given environment. To measure the size of a given place field, the occupancy-matched rate map was first binarized by applying a threshold of 50% of the peak event rate for the rate map. The place fields were then identified and extracted as connected objects from the binarized rate map. For place cells with more than one place field, we used the largest place field as the measurement. Similarly, final values were obtained by averaging all the 50 matching iterations.
Reconstructing the mouse’s position using a naive Bayes classifier
We used a naive Bayes classifier to estimate the probability of animal’s location given the activity of all the recorded neurons. Speed filtered (>2 cm/s), thresholded (3 × standard deviation of all the deconvolved spiking activity for each neuron), and binarized deconvolved spike activity (neuron.S in CNMF-E) from all neurons were first binned into non-overlapping time bins of 0.8 s. This time bin width was selected based on the overall decoding performance among all the bin width tested ranging from 0.2 to 1.6 s. The M × N spike data matrix, where M is the number of time bins and N is the number of neurons, was then used to train the decoder with an M × 1 vectorized location labels. The posterior probability of observing the animal’s position Y given neural activity X can then be inferred from the Bayes rule as:
3 |
where X = (X1, X2, … XN) is the activity of all neurons, y is one of the spatial bins that the animal visited at a given time, and P(Y = y) is the prior probability of the animal being in spatial bin y. We used an empirical prior as it showed slightly better performance than a flat prior. P(X1, X2, …, XN) is the overall firing probability for all neurons, which can be considered as a constant and does not need to be estimated directly. Thus, the relationship can be simplified to
4 |
5 |
where is the animal’s predicted location, based on which spatial bin has the maximum probability across all the spatial bins for a given time. To estimate P(Xi | Y = y), we applied the built-in function of MATLAB fitcnb() to fit a multinomial distribution using the bag-of-tokens model with Laplace smoothing, which gave an estimation of distribution parameter for each neuron Xi at the given spatial bin y as:
6 |
where, regardless of the Laplace smoothing, the numerator is the total number of spikes of neuron Xi for the time bins that the animal is at location y, and the denominator is the total number of spikes of all the neurons for the time bins that the animals is at location y. In addition, the above equation was weighted such that the normalized weights within a location bin sum to the prior probability for that location bin. This multinomial-based model offers high decoding accuracy, which is important as we are investigating the function of a small population of neurons.
In addition, to reduce occasional erratic jumps in position estimates, we implemented a 2-step Bayesian method by introducing a continuity constraint114, which incorporated information regarding the decoded position in the previous time step and the animal’s running speed to calculate the probability of the current location y. The continuity constraint for all the spatial bins Y at time t followed a 2D gaussian distribution centered at position yt-1, which can be written as:
7 |
8 |
where c is a scaling factor and vt is the instantaneous speed of the animal between time t−1 and t. vt is scaled by , which is empirically selected as 2.5. The final reconstructed position with 2-step Bayesian method can be further written as:
9 |
Decoded vectorized positions were then mapped back onto 2D space. The decoding error was calculated as the mean Euclidean distance between the decoded position and the animal’s true position, across all time bins. The overall improvement gained by implementing the 2-step Bayesian method was only ~5–10%, which indicated that the method did not introduce any direct information regarding the animal’s current location to the decoder.
To compare position decoding performance across mice, we randomly down-sampled the number of neurons such that they matched across all mice (n = 150). We performed this down-sampling 50 times and trained the decoder and generated position predictions for each iteration. The final result for a given mouse was then calculated as the average decoding performance across the 50 iterations. To examine the decoder’s performance using shuffled data, we circularly shuffled the neural data 100 times, shifting the spike times by 5–95% of the total data length randomly (i.e., 60–1140 s for a 20-min recording). The final result was then calculated as the average decoding performance across the 100 shuffles. To compare position decoding performance between the two CPP compartments, data for both training and predicting were matched for occupancy 50 times. The final result for a given compartment was then calculated as the average decoding performance across the 50 iterations.
For the knock-out (KO) decoding analyses, we replaced the neural activity of cells that were ‘knocked out’ with vectors of zeroes. This knock-out procedure was only applied to the data we used for predicting position locations, not for training, as ablating neurons directly from the training data will result in the model learning to compensate for the missing information115. In addition, for the KO decoding analyses, the training data set was subject to the position matching protocol. The final result for each mouse was then calculated as the averaged decoding performance across all of the position matching iterations. For the random KO condition, we randomly selected the same number of neurons as in the KO condition for each iteration. For conditions in which the training and prediction data were both from the baseline or test sessions, we used the session with a lower time bias between the two compartments as the training data, which allowed us to use the session with the maximum amount of training data after position matching between the two CPP compartments. As in the regular decoding analysis, the KO decoding analysis provided reconstructed/predicted positions for an animal based on the neural activity; the CPP time could then be reconstructed from this position result. For KO analyses in Fig. 4h–j, the decoder was trained using the baseline data, and rtPCp (retained place cells on the preferred side) were randomly selected for KO to match the number of disPCp from the test sessions data before making predictions. Both training and prediction data were occupancy matched between the two compartments. We then calculated the final decoding error for the predicted position by averaging the decoding errors from all the position matching iterations for each compartment.
Temporal clustering with k-means
Identification of temporal clusters
To cluster neurons according to the temporal information of their calcium signals, we employed a consensus k-means clustering method and calculated a consensus matrix that measured how frequently two samples were clustered together in multiple clustering runs with randomly sub-sampled data. We used the denoised calcium trace (neuron.C in CNMF-E, Supplementary Fig. 1e, blue trace) as a measure of neural activity and filtered the signal with a noise level threshold of 2 x (neuron.C_raw – neuron.C) for each neuron. We then computed the consensus matrix using sub-sampled data from the baseline session for 100 iterations. For each iteration, the calcium data from all the neurons was randomly sub-sampled at 90% of the total frame length, and neurons were partitioned into 5 groups (see determining optimal K below) using k-means clustering by calculating the pair-wise Pearson’s correlation coefficient from the sub-sampled calcium data. In each k-means run, there were 10 repeated clustering (replicates) using new initial cluster centroid positions. A consensus matrix was then obtained upon the completion of all the iterations by calculating the frequency with which two neurons were grouped together. Neuron pairs that showed the same cluster assignment across the highest number of iterations had a high consensus index value. On the other hand, neuron pairs that rarely clustered together had a low consensus index value. The final cluster was then determined using a hierarchical clustering method with complete linkage on the consensus matrix.
Determining the optimal number of clusters (K)
To estimate the optimal K value, we chose to search from 3 to 9 clusters. As we estimated the optimal K using either the local minima or maxima from the measurements described below, we expanded our K value search to range from 2 to 10 clusters for calculating the optimal K value. To determine the optimal K, we examined the performance of the K-clustered consensus matrix by visualizing the heatmap reorganized by linkage (Supplementary Fig. 5). The consensus matrix can also be visualized by plotting it as a cumulative distribution function (CDF), as shown in Supplementary Fig. 5b. In the case of perfect clustering, the value of the consensus matrix will be either 0 or 1. Thus, the corresponding CDF would follow a Bernoulli distribution and the curve would be flat for intermediate values. Based on this principle, we employed a metric called the Proportion of Ambiguous Clustering (PAC) to estimate the optimal K116. PAC is defined as the fraction of sample pairs with a consensus index value between [0.1, 0.9]. A low PAC value indicates the CDF curve is flat in the middle, thus allowing inference of the optimal K by identifying the lowest PAC (Supplementary Fig. 5c). In addition to PAC, we also implemented a cophenetic correlation based measurement to infer the optimal K117. This measurement computes the Pearson’s correlation between the distance of neuron pairs in the consensus matrix and the cophenetic distance of neuron pairs obtained from the dendrogram tree used to reorder the consensus matrix by linkage. Thus, the cophenetic correlation measures how faithfully the dendrogram tree represents the distance between neuron pairs. A cophenetic correlation equal to 1 indicates a perfect consensus matrix. We plotted the cophenetic correlation as a function of K, with a range from 2 to 10, and selected the local maxima of cophenetic correlation as the optimal K (Supplementary Fig. 5d). As shown in Supplementary Fig. 5e, f, measurements from both methods gave similar inferences, pointing to the optimal K = 5.
Template matching method for sorting temporally defined clusters according to their spatial firing patterns
To compare temporally defined clusters across different animals, we took advantage of the ensemble spatial firing patterns for each temporally defined cluster and sorted them in into the following five groups: SW, southwest; SE, southeast; NW, northwest; NE, northeast, and center. These directions denoted the location of the peak in the ensemble activity in respect to the CPP environment. For each cluster, the peak of the ensemble activity in the two CPP compartments were always at a similar location (Supplementary Fig. 6) except for the center cluster, which only has a single peak at the junction between the two compartments. To perform unbiased and automated sorting, we developed a template matching method and computed the Pearson’s correlation between the ensemble spatial firing maps for each cluster and standard gaussian templates for each direction (Supplementary Fig. 6). Each standard template contains two simulated Gaussian fields at homotopic positions across the two compartments (Supplementary Fig. 6a). The field akin to the CPP midline had a variance of 12.5 cm while the field away from the midline had a variance of 25 cm. To avoid aberrant matching performance, the center group, which can be unambiguously identified, was held out during this matching process. The final matching result gave a 4 × 4 correlation matrix (Supplementary Fig. 6c), which we used to sort the ensemble activity of each cluster by assigning it to the group with the highest correlation. In most animals, temporal clusters fell into one of these non-overlapping groups with an unambiguous ordering. Occasionally, group ordering with maximum summed correlation was used if there was ambiguity in the group assignment.
Measuring paired-wise anatomical distances
To measure the paired-wise anatomical distance for all disPCp in each mouse, we calculated the Euclidian distance between the centroid locations of each disPCp pair under the imaging window for each mouse. The centroid location of the neuron was obtained from the CNMF-E framework (neuron.centroid), denoting the center coordinates for each ROI contour. For each disPCp, we quantified an averaged intra- vs. inter-cluster distances based on the cluster assignment for all disPCp. The final result for each cluster was averaged across all disPCp that belonged to the same cluster. We expected that the inter-cluster distance would be larger than the intra-cluster distance, if functionally-defined disPCp clusters are anatomically clustered.
Linear-non-linear Poisson (LN) model
The LN model is a generalized linear model (GLM) framework which allows unbiased identification of functional cell types encoding multiplexed navigational variables. This framework was described in a previous publication57 and here, we applied the same method to our calcium imaging data in the hippocampus. Briefly, seven models were built in the LN framework, including position (P), head direction (H), speed (S), position & head direction (PH), position & speed (PS), head direction & speed (HS), and position & head direction & speed (PHS). For each model, the dependence of spiking on the corresponding variable(s) was quantified by estimating the spike rate (rt) of a neuron during time bin t as an exponential function of the sum of variable values (for example, the animal’s position at time bin t, indicated through an ‘animal-state’ vector) projected onto a corresponding set of parameters (Fig. 6a). This can be mathematically expressed as
10 |
where r is a vector of firing rates for one neuron over T time points, i indexes the variable (i ∈ [P, H, S]), Xi is the design matrix in which each column is an animal-state vector xi for variable i at one time bin, wi is a column vector of learned parameters that converts animal-state vectors into a firing rate contribution, and dt is the time-bin width.
We used thresholded deconvolved spikes (neuron.S in CNMFe) as the neuron spiking data with a time-bin width equal to 500 ms. To achieve sufficient training data for modeling, we concatenated the data from two baseline sessions as a single session and the two test sessions as a single session. The design matrix contained the animal’s behavioral state, in which we binned position into 1.8 cm2 bins, head direction into 20-degree bins, and speed into 2 cm/s bins. Each vector in the design matrix denotes a binned variable value. All elements of this vector are 0, except for a single element that corresponds to the bin of the current animal-state. To learn the variable parameters wi, we used the built-in fminunc function in MATLAB to maximize the Poisson log-likelihood of the observed spike train (n) given the model spike number (r × dt) and under the prior knowledge that the parameters should be smooth. Model performance for each cell is computed as the increase in Pearson’s correlation (between the predicted and the true firing rates) of the model compared to the 95th % of shuffled correlations (true firing rate was circularly shuffled for 500 times). Performance was quantified through tenfold cross-validation, where each fold is a random selection of 10% of the data. To determine the best-fitted model for a given neuron, we used a heuristic forward-search method that determines whether adding variables significantly improves model performance (p < 0.05 for a one-sided sign-rank test, n = 10 cross-validation folds).
Statistical analysis
All the analyses and statistical tests were performed using MATLAB (2017b and 2020a). Data are presented as mean ± SEM or median ± interquartile range (IQR), as indicated. Parametric tests were used for datasets with a normal distribution, as determined by the Shapiro–Wilk test, which included an animal’s CPP score, running speed, center time, and the proportions of cells. For statistical comparisons between groups, an unpaired t-test was used to compare two groups for normally distributed results; otherwise, a Wilcoxon rank-sum test was used. For statistical comparisons across more than two groups, one-way ANOVA and related multiple comparison tests were used. For paired statistical comparisons, a paired t-test was used if the data followed a normal distribution; otherwise, a Wilcoxon sign-rank test was used. All tests were two-tailed unless otherwise specified. All the statistical tests were performed based on each animal or each session, as indicated in the corresponding figure legend. In all experiments, the level of statistical significance was defined as p ≤ 0.05.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Supplementary information
Acknowledgements
This work was supported by funding from NIDA DA042012, Office of Naval Research N000141812690, Simons Collaboration on the Global Brain 542987SPI, the Vallee Foundation and the James S McDonnell Foundation awarded to L.M.G. We thank A. Diaz for animal husbandry assistance, B. Heifets and M.B. Pomrenze for assistance and discussion of methamphetamine and morphine CPP, X. Chen for discussion of morphine conditioned place aversion, X. Xu for miniscope assistance, K. Hardcastle, L. Chen, and S. Jin for discussion regarding code implementation, and M. Sosa and A. Attinger for comments on the manuscript.
Source data
Author contributions
Y.S. and L.M.G. conceptualized the experiments and analyses. Y.S. collected and analyzed the data. Y.S. and L.M.G. wrote the manuscript. L.M.G. oversaw the project.
Peer review
Peer review information
Nature Communications thanks Lucas Sjulson and the other, anonymous, reviewers for their contribution to the peer review of this work.
Data availability
The datasets generated in the current study are available on Mendeley Data: 10.17632/p8gh7wk9z3.1 Source data are provided with this paper.
Code availability
Custom MATLAB code generated in this study is available at: https://github.com/yanjuns/Sun_Giocomo_2022_NComms.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Yanjun Sun, Email: yanjuns@stanford.edu.
Lisa M. Giocomo, Email: giocomo@stanford.edu
Supplementary information
The online version contains supplementary material available at 10.1038/s41467-022-34114-x.
References
- 1.Hunt WA, Barnett LW, Branch LG. Relapse rates in addiction programs. J. Clin. Psychol. 1971;27:455–456. doi: 10.1002/1097-4679(197110)27:4<455::aid-jclp2270270412>3.0.co;2-r. [DOI] [PubMed] [Google Scholar]
- 2.Wikler A. Dynamics of drug dependence. Implications of a conditioning theory for research and treatment. Arch. Gen. Psychiatry. 1973;28:611–616. doi: 10.1001/archpsyc.1973.01750350005001. [DOI] [PubMed] [Google Scholar]
- 3.O’Brien CP, Childress AR, McLellan AT, Ehrman R. Classical conditioning in drug-dependent humans. Ann. N. Y Acad. Sci. 1992;654:400–415. doi: 10.1111/j.1749-6632.1992.tb25984.x. [DOI] [PubMed] [Google Scholar]
- 4.Crombag HS, Shaham Y. Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behav. Neurosci. 2002;116:169–173. doi: 10.1037//0735-7044.116.1.169. [DOI] [PubMed] [Google Scholar]
- 5.Fuchs RA, et al. The role of the dorsomedial prefrontal cortex, basolateral amygdala, and dorsal hippocampus in contextual reinstatement of cocaine seeking in rats. Neuropsychopharmacology. 2005;30:296–309. doi: 10.1038/sj.npp.1300579. [DOI] [PubMed] [Google Scholar]
- 6.Rubio FJ, et al. Context-induced reinstatement of methamphetamine seeking is associated with unique molecular alterations in Fos-expressing dorsolateral striatum neurons. J. Neurosci. 2015;35:5625–5639. doi: 10.1523/JNEUROSCI.4997-14.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Crombag HS, Bossert JM, Koya E, Shaham Y. Review. Context-induced relapse to drug seeking: a review. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2008;363:3233–3243. doi: 10.1098/rstb.2008.0090. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hyman SE. Addiction: a disease of learning and memory. Am. J. Psychiatry. 2005;162:1414–1422. doi: 10.1176/appi.ajp.162.8.1414. [DOI] [PubMed] [Google Scholar]
- 9.Ito R, Robbins TW, Pennartz CM, Everitt BJ. Functional interaction between the hippocampus and nucleus accumbens shell is necessary for the acquisition of appetitive spatial context conditioning. J. Neurosci. 2008;28:6950–6959. doi: 10.1523/JNEUROSCI.1615-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ito R, Robbins TW, McNaughton BL, Everitt BJ. Selective excitotoxic lesions of the hippocampus and basolateral amygdala have dissociable effects on appetitive cue and place conditioning based on path integration in a novel Y-maze procedure. Eur. J. Neurosci. 2006;23:3071–3080. doi: 10.1111/j.1460-9568.2006.04883.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Fuchs RA, Eaddy JL, Su Z-I, Bell GH. Interactions of the basolateral amygdala with the dorsal hippocampus and dorsomedial prefrontal cortex regulate drug context-induced reinstatement of cocaine-seeking in rats. Eur. J. Neurosci. 2007;26:487–498. doi: 10.1111/j.1460-9568.2007.05674.x. [DOI] [PubMed] [Google Scholar]
- 12.White NM, Chai SC, Hamdani S. Learning the morphine conditioned cue preference: Cue configuration determines effects of lesions. Pharmacol. Biochem. Behav. 2005;81:786–796. doi: 10.1016/j.pbb.2005.06.002. [DOI] [PubMed] [Google Scholar]
- 13.White NM. Addictive drugs as reinforcers: multiple partial actions on memory systems. Addiction. 1996;91:921–949. [PubMed] [Google Scholar]
- 14.McDonald RJ, White NM. A triple dissociation of memory systems: hippocampus, amygdala, and dorsal striatum. Behav. Neurosci. 1993;107:3–22. doi: 10.1037//0735-7044.107.1.3. [DOI] [PubMed] [Google Scholar]
- 15.Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 2005;8:1481–1489. doi: 10.1038/nn1579. [DOI] [PubMed] [Google Scholar]
- 16.Luo AH, Tahsili-Fahadan P, Wise RA, Lupica CR, Aston-Jones G. Linking context with reward: a functional circuit from hippocampal CA3 to ventral tegmental area. Science. 2011;333:353–357. doi: 10.1126/science.1204622. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Sjulson L, Peyrache A, Cumpelik A, Cassataro D, Buzsaki G. Cocaine place conditioning strengthens location-specific hippocampal coupling to the nucleus accumbens. Neuron. 2018;98:926–934 e925. doi: 10.1016/j.neuron.2018.04.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Xia L, Nygard SK, Sobczak GG, Hourguettes NJ, Bruchas MR. Dorsal-CA1 hippocampal neuronal ensembles encode nicotine-reward contextual associations. Cell Rep. 2017;19:2143–2156. doi: 10.1016/j.celrep.2017.05.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Trouche S, et al. Recoding a cocaine-place memory engram to a neutral engram in the hippocampus. Nat. Neurosci. 2016;19:564–567. doi: 10.1038/nn.4250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Vorel SR, Liu X, Hayes RJ, Spector JA, Gardner EL. Relapse to cocaine-seeking after hippocampal theta burst stimulation. Science. 2001;292:1175–1178. doi: 10.1126/science.1058043. [DOI] [PubMed] [Google Scholar]
- 21.Zhou Y, et al. A ventral CA1 to nucleus accumbens core engram circuit mediates conditioned place preference for cocaine. Nat. Neurosci. 2019;22:1986–1999. doi: 10.1038/s41593-019-0524-y. [DOI] [PubMed] [Google Scholar]
- 22.Ge F, et al. Glutamatergic projections from the entorhinal cortex to dorsal dentate gyrus mediate context-induced reinstatement of heroin seeking. Neuropsychopharmacology. 2017;42:1860–1870. doi: 10.1038/npp.2017.14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.McGlinchey EM, Aston-Jones G. Dorsal hippocampus drives context-induced cocaine seeking via inputs to lateral septum. Neuropsychopharmacology. 2017;43:987–1000. doi: 10.1038/npp.2017.144. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.O’Keefe J, Dostrovsky J. The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 1971;34:171–175. doi: 10.1016/0006-8993(71)90358-1. [DOI] [PubMed] [Google Scholar]
- 25.O’Keefe, J. & Nadel, L. The Hippocampus as a Cognitive Map (Clarendon Press, 1978).
- 26.Muller RU, Kubie JL. The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells. J. Neurosci. 1987;7:1951–1968. doi: 10.1523/JNEUROSCI.07-07-01951.1987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Knierim JJ, Kudrimoti HS, McNaughton BL. Interactions between idiothetic cues and external landmarks in the control of place cells and head direction cells. J. Neurophysiol. 1998;80:425–446. doi: 10.1152/jn.1998.80.1.425. [DOI] [PubMed] [Google Scholar]
- 28.O’Keefe J, Conway DH. Hippocampal place units in the freely moving rat: why they fire where they fire. Exp. Brain Res. 1978;31:573–590. doi: 10.1007/BF00239813. [DOI] [PubMed] [Google Scholar]
- 29.Leutgeb S, Leutgeb JK, Treves A, Moser MB, Moser EI. Distinct ensemble codes in hippocampal areas CA3 and CA1. Science. 2004;305:1295–1298. doi: 10.1126/science.1100265. [DOI] [PubMed] [Google Scholar]
- 30.Leutgeb JK, et al. Progressive transformation of hippocampal neuronal representations in “morphed” environments. Neuron. 2005;48:345–358. doi: 10.1016/j.neuron.2005.09.007. [DOI] [PubMed] [Google Scholar]
- 31.Colgin LL, et al. Attractor-map versus autoassociation based attractor dynamics in the hippocampal network. J. Neurophysiol. 2010;104:35–50. doi: 10.1152/jn.00202.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Bostock E, Muller RU, Kubie JL. Experience-dependent modifications of hippocampal place cell firing. Hippocampus. 1991;1:193–205. doi: 10.1002/hipo.450010207. [DOI] [PubMed] [Google Scholar]
- 33.Frank LM, Brown EN, Wilson M. Trajectory encoding in the hippocampus and entorhinal cortex. Neuron. 2000;27:169–178. doi: 10.1016/s0896-6273(00)00018-0. [DOI] [PubMed] [Google Scholar]
- 34.Wood ER, Dudchenko PA, Robitsek RJ, Eichenbaum H. Hippocampal neurons encode information about different types of memory episodes occurring in the same location. Neuron. 2000;27:623–633. doi: 10.1016/s0896-6273(00)00071-4. [DOI] [PubMed] [Google Scholar]
- 35.Xu H, Baracskay P, O’Neill J, Csicsvari J. Assembly responses of hippocampal CA1 place cells predict learned behavior in goal-directed spatial tasks on the radial eight-arm maze. Neuron. 2019;101:119–132 e114. doi: 10.1016/j.neuron.2018.11.015. [DOI] [PubMed] [Google Scholar]
- 36.Dupret D, O’Neill J, Pleydell-Bouverie B, Csicsvari J. The reorganization and reactivation of hippocampal maps predict spatial memory performance. Nat. Neurosci. 2010;13:995–1002. doi: 10.1038/nn.2599. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Lever C, Wills T, Cacucci F, Burgess N, O’Keefe J. Long-term plasticity in hippocampal place-cell representation of environmental geometry. Nature. 2002;416:90–94. doi: 10.1038/416090a. [DOI] [PubMed] [Google Scholar]
- 38.Colgin LL, Moser EI, Moser MB. Understanding memory through hippocampal remapping. Trends Neurosci. 2008;31:469–477. doi: 10.1016/j.tins.2008.06.008. [DOI] [PubMed] [Google Scholar]
- 39.Leutgeb S, et al. Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science. 2005;309:619–623. doi: 10.1126/science.1114037. [DOI] [PubMed] [Google Scholar]
- 40.Mamad O, et al. Place field assembly distribution encodes preferred locations. PLoS Biol. 2017;15:e2002365. doi: 10.1371/journal.pbio.2002365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Xiao Z, Lin K, Fellous JM. Conjunctive reward-place coding properties of dorsal distal CA1 hippocampus cells. Biol. Cyber. 2020;114:285–301. doi: 10.1007/s00422-020-00830-0. [DOI] [PubMed] [Google Scholar]
- 42.Danielson NB, et al. Sublayer-specific coding dynamics during spatial navigation and learning in hippocampal area CA1. Neuron. 2016;91:652–665. doi: 10.1016/j.neuron.2016.06.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Turi GF, et al. Vasoactive intestinal polypeptide-expressing interneurons in the hippocampus support goal-oriented spatial learning. Neuron. 2019;101:1150–1165.e1158. doi: 10.1016/j.neuron.2019.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Kaufman AM, Geiller T, Losonczy A. A role for the locus coeruleus in hippocampal CA1 place cell reorganization during spatial reward learning. Neuron. 2020;105:1018–1026.e1014. doi: 10.1016/j.neuron.2019.12.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Zaremba JD, et al. Impaired hippocampal place cell dynamics in a mouse model of the 22q11.2 deletion. Nat. Neurosci. 2017;20:1612–1623. doi: 10.1038/nn.4634. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Hollup SA, Molden S, Donnett JG, Moser MB, Moser EI. Accumulation of hippocampal place fields at the goal location in an annular watermaze task. J. Neurosci. 2001;21:1635–1644. doi: 10.1523/JNEUROSCI.21-05-01635.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Sanders, H., Wilson, M. A. & Gershman, S. J. Hippocampal remapping as hidden state inference. eLife9, 10.7554/eLife.51140 (2020). [DOI] [PMC free article] [PubMed]
- 48.Sun Y, et al. CA1-projecting subiculum neurons facilitate object-place learning. Nat. Neurosci. 2019;22:1857–1870. doi: 10.1038/s41593-019-0496-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Ziv Y, et al. Long-term dynamics of CA1 hippocampal place codes. Nat. Neurosci. 2013;16:264–266. doi: 10.1038/nn.3329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Cai DJ, et al. A shared neural ensemble links distinct contextual memories encoded close in time. Nature. 2016;534:115–118. doi: 10.1038/nature17955. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Tzschentke TM. Measuring reward with the conditioned place preference paradigm: a comprehensive review of drug effects, recent progress and new issues. Prog. Neurobiol. 1998;56:613–672. doi: 10.1016/s0301-0082(98)00060-4. [DOI] [PubMed] [Google Scholar]
- 52.Tzschentke TM. Measuring reward with the conditioned place preference (CPP) paradigm: update of the last decade. Addiction Biol. 2007;12:227–462. doi: 10.1111/j.1369-1600.2007.00070.x. [DOI] [PubMed] [Google Scholar]
- 53.Sulzer D. How addictive drugs disrupt presynaptic dopamine neurotransmission. Neuron. 2011;69:628–649. doi: 10.1016/j.neuron.2011.02.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Zhou, P. et al. Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data. Elife7, 10.7554/eLife.28728 (2018). [DOI] [PMC free article] [PubMed]
- 55.Gonzalez WG, Zhang H, Harutyunyan A, Lois C. Persistence of neuronal representations through time and damage in the hippocampus. Science. 2019;365:821–825. doi: 10.1126/science.aav9199. [DOI] [PubMed] [Google Scholar]
- 56.Friedrich J, Zhou P, Paninski L. Fast online deconvolution of calcium imaging data. PLoS Comput. Biol. 2017;13:e1005423. doi: 10.1371/journal.pcbi.1005423. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Hardcastle K, Maheswaranathan N, Ganguli S, Giocomo LM. A multiplexed, heterogeneous, and adaptive code for navigation in medial entorhinal cortex. Neuron. 2017;94:375–387.e377. doi: 10.1016/j.neuron.2017.03.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Ledergerber D, et al. Task-dependent mixed selectivity in the subiculum. Cell Rep. 2021;35:109175. doi: 10.1016/j.celrep.2021.109175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Mao D, et al. Spatial modulation of hippocampal activity in freely moving macaques. Neuron. 2021;109:3521–3534.e3526. doi: 10.1016/j.neuron.2021.09.032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Góis ZHTD, Tort ABL. Characterizing speed cells in the rat hippocampus. Cell Rep. 2018;25:1872–1884.e1874. doi: 10.1016/j.celrep.2018.10.054. [DOI] [PubMed] [Google Scholar]
- 61.Muller RU, Bostock E, Taube JS, Kubie JL. On the directional firing properties of hippocampal place cells. J. Neurosci. 1994;14:7235–7251. doi: 10.1523/JNEUROSCI.14-12-07235.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Gauthier JL, Tank DW. A dedicated population for reward coding in the hippocampus. Neuron. 2018;99:179–193.e177. doi: 10.1016/j.neuron.2018.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Fyhn M, Molden S, Hollup S, Moser M-B, Moser EI. Hippocampal neurons responding to first-time dislocation of a target object. Neuron. 2002;35:555–566. doi: 10.1016/s0896-6273(02)00784-5. [DOI] [PubMed] [Google Scholar]
- 64.Marshel, J. H. et al. Cortical layer-specific critical dynamics triggering perception. Science365, 10.1126/science.aaw5202 (2019). [DOI] [PMC free article] [PubMed]
- 65.Carrillo-Reid L, Han S, Yang W, Akrouh A, Yuste R. Controlling visually guided behavior by holographic recalling of cortical ensembles. Cell. 2019;178:447–457.e445. doi: 10.1016/j.cell.2019.05.045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Robinson NTM, et al. Targeted activation of hippocampal place cells drives memory-guided spatial behavior. Cell. 2020 doi: 10.1016/j.cell.2020.09.061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Sosa M, Giocomo LM. Navigating for reward. Nat. Rev. Neurosci. 2021;22:472–487. doi: 10.1038/s41583-021-00479-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Breese CR, Hampson RE, Deadwyler SA. Hippocampal place cells: stereotypy and plasticity. J. Neurosci. 1989;9:1097–1111. doi: 10.1523/JNEUROSCI.09-04-01097.1989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Lee I, Griffin AL, Zilli EA, Eichenbaum H, Hasselmo ME. Gradual translocation of spatial correlates of neuronal firing in the hippocampus toward prospective reward locations. Neuron. 2006;51:639–650. doi: 10.1016/j.neuron.2006.06.033. [DOI] [PubMed] [Google Scholar]
- 70.Kobayashi T, Tran AH, Nishijo H, Ono T, Matsumoto G. Contribution of hippocampal place cell activity to learning and formation of goal-directed navigation in rats. Neuroscience. 2003;117:1025–1035. doi: 10.1016/s0306-4522(02)00700-5. [DOI] [PubMed] [Google Scholar]
- 71.Hok V, et al. Goal-related activity in hippocampal place cells. J. Neurosci. 2007;27:472–482. doi: 10.1523/JNEUROSCI.2864-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Duvelle, É. et al. Insensitivity of place cells to the value of spatial goals in a two-choice flexible navigation task. J. Neurosci. 1578–1518, 10.1523/jneurosci.1578-18.2018 (2019). [DOI] [PMC free article] [PubMed]
- 73.Hölscher C, Jacob W, Mallot HA. Reward modulates neuronal activity in the hippocampus of the rat. Behavioural Brain Res. 2003;142:181–191. doi: 10.1016/s0166-4328(02)00422-9. [DOI] [PubMed] [Google Scholar]
- 74.Carmack, S. A., Koob, G. F. & Anagnostaras, S. G. Learning and Memory in Addiction 523–538, 10.1016/b978-0-12-809324-5.21101-2 (2017).
- 75.Hyman SE, Malenka RC, Nestler EJ. Neural mechanisms of addiction: the role of reward-related learning and memory. Annu. Rev. Neurosci. 2006;29:565–598. doi: 10.1146/annurev.neuro.29.051605.113009. [DOI] [PubMed] [Google Scholar]
- 76.Skaggs WE, McNaughton BL. Spatial firing properties of hippocampal CA1 populations in an environment containing two visually identical regions. J. Neurosci. 1998;18:8455–8466. doi: 10.1523/JNEUROSCI.18-20-08455.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Spiers HJ, Hayman RM, Jovalekic A, Marozzi E, Jeffery KJ. Place field repetition and purely local remapping in a multicompartment environment. Cereb. Cortex. 2015;25:10–25. doi: 10.1093/cercor/bht198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Derdikman D, et al. Fragmentation of grid cell maps in a multicompartment environment. Nat. Neurosci. 2009;12:1325–1332. doi: 10.1038/nn.2396. [DOI] [PubMed] [Google Scholar]
- 79.Singer AC, Karlsson MP, Nathe AR, Carr MF, Frank LM. Experience-dependent development of coordinated hippocampal spatial activity representing the similarity of related locations. J. Neurosci. 2010;30:11586–11604. doi: 10.1523/JNEUROSCI.0926-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Tabuchi E, Mulder AB, Wiener SI. Reward value invariant place responses and reward site associated activity in hippocampal neurons of behaving rats. Hippocampus. 2003;13:117–132. doi: 10.1002/hipo.10056. [DOI] [PubMed] [Google Scholar]
- 81.Tryon VL, et al. Hippocampal neural activity reflects the economy of choices during goal-directed navigation. Hippocampus. 2017;27:743–758. doi: 10.1002/hipo.22720. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Lee H, Ghim JW, Kim H, Lee D, Jung M. Hippocampal neural correlates for values of experienced events. J. Neurosci. 2012;32:15053–15065. doi: 10.1523/JNEUROSCI.2806-12.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.van der Meer, M. A. A., Ito, R., Lansink, C. S. & Pennartz, C. M. A. Hippocampal Projections to the Ventral Striatum: from Spatial Memory to Motivated Behavior 497–516, 10.1007/978-3-7091-1292-2_18 (2014).
- 84.Lansink, C. S. & Pennartz, C. M. A. Associative reactivation of place–reward information in the hippocampal–ventral striatal circuitry. In Analysis and Modeling of Coordinated Multi-neuronal Activity. (ed. Tatsuno, M.) vol 12. 81–104 (Springer Series in Computational Neuroscience, 2015).
- 85.Grosmark AD, Sparks FT, Davis MJ, Losonczy A. Reactivation predicts the consolidation of unbiased long-term cognitive maps. Nat. Neurosci. 2021;24:1574–1585. doi: 10.1038/s41593-021-00920-7. [DOI] [PubMed] [Google Scholar]
- 86.Kempadoo KA, Mosharov EV, Choi SJ, Sulzer D, Kandel ER. Dopamine release from the locus coeruleus to the dorsal hippocampus promotes spatial learning and memory. Proc. Natl Acad. Sci. USA. 2016;113:14835–14840. doi: 10.1073/pnas.1616515114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Takeuchi T, et al. Locus coeruleus and dopaminergic consolidation of everyday memory. Nature. 2016;537:357–362. doi: 10.1038/nature19325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.McNamara CG, Tejero-Cantero Á, Trouche S, Campo-Urriza N, Dupret D. Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence. Nat. Neurosci. 2014;17:1658–1660. doi: 10.1038/nn.3843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Rosen ZB, Cheung S, Siegelbaum SA. Midbrain dopamine neurons bidirectionally regulate CA3-CA1 synaptic drive. Nat. Neurosci. 2015;18:1763–1771. doi: 10.1038/nn.4152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. 2005;46:703–713. doi: 10.1016/j.neuron.2005.05.002. [DOI] [PubMed] [Google Scholar]
- 91.Teixeira CM, et al. Hippocampal 5-HT input regulates memory formation and schaffer collateral excitation. Neuron. 2018;98:992–1004.e1004. doi: 10.1016/j.neuron.2018.04.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Varga V, et al. Fast synaptic subcortical control of hippocampal circuits. Science. 2009;326:449–453. doi: 10.1126/science.1178307. [DOI] [PubMed] [Google Scholar]
- 93.Brog JS, Salyapongse A, Deutch AY, Zahm DS. The patterns of afferent innervation of the core and shell in the “Accumbens” part of the rat ventral striatum: Immunohistochemical detection of retrogradely transported fluoro-gold. J. Comp. Neurol. 1993;338:255–278. doi: 10.1002/cne.903380209. [DOI] [PubMed] [Google Scholar]
- 94.Trouche S, et al. A hippocampus-accumbens tripartite neuronal motif guides appetitive memory in space. Cell. 2019;176:1393–1406.e1316. doi: 10.1016/j.cell.2018.12.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Groenewegen HJ, der Zee EV-V, te Kortschot A, Witter MP. Organization of the projections from the subiculum to the ventral striatum in the rat. A study using anterograde transport of Phaseolus vulgaris leucoagglutinin. Neuroscience. 1987;23:103–120. doi: 10.1016/0306-4522(87)90275-2. [DOI] [PubMed] [Google Scholar]
- 96.Ohara S, et al. Intrinsic projections of layer Vb neurons to layers Va, III, and II in the lateral and medial entorhinal cortex of the rat. Cell Rep. 2018;24:107–116. doi: 10.1016/j.celrep.2018.06.014. [DOI] [PubMed] [Google Scholar]
- 97.Sürmeli G, et al. Molecularly defined circuitry reveals input-output segregation in deep layers of the medial entorhinal cortex. Neuron. 2015;88:1040–1053. doi: 10.1016/j.neuron.2015.10.041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Boccara CN, Nardin M, Stella F, O’Neill J, Csicsvari J. The entorhinal cognitive map is attracted to goals. Science. 2019;363:1443–1447. doi: 10.1126/science.aav4837. [DOI] [PubMed] [Google Scholar]
- 99.Butler WN, Hardcastle K, Giocomo LM. Remembered reward locations restructure entorhinal spatial maps. Science. 2019;363:1447–1452. doi: 10.1126/science.aav5297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Steinmetz, N. A. et al. Aberrant cortical activity in multiple GCaMP6-expressing transgenic mouse lines. eNeuro4, 10.1523/ENEURO.0207-17.2017 (2017). [DOI] [PMC free article] [PubMed]
- 101.Bardo MT, Bevins RA. Conditioned place preference: what does it add to our preclinical understanding of drug reward? Psychopharmacology. 2000;153:31–43. doi: 10.1007/s002130000569. [DOI] [PubMed] [Google Scholar]
- 102.Cunningham CL, Ferree NK, Howard MA. Apparatus bias and place conditioning with ethanol in mice. Psychopharmacology. 2003;170:409–422. doi: 10.1007/s00213-003-1559-y. [DOI] [PubMed] [Google Scholar]
- 103.Sambo, D. O. et al. The sigma-1 receptor modulates methamphetamine dysregulation of dopamine neurotransmission. Nat. Commun.8, 10.1038/s41467-017-02087-x (2017). [DOI] [PMC free article] [PubMed]
- 104.Spiteri T, Le Pape G, Ågmo A. What is learned during place preference conditioning? A comparison of food- and morphine-induced reward. Psychobiology. 2000;28:367–382. [Google Scholar]
- 105.Lin R, et al. The raphe dopamine system controls the expression of incentive memory. Neuron. 2020;106:498–514.e498. doi: 10.1016/j.neuron.2020.02.009. [DOI] [PubMed] [Google Scholar]
- 106.Gava GP, et al. Integrating new memories into the hippocampal network activity space. Nat. Neurosci. 2021;24:326–330. doi: 10.1038/s41593-021-00804-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Zhu Y, Wienecke CFR, Nachtrab G, Chen X. A thalamic input to the nucleus accumbens mediates opiate dependence. Nature. 2016;530:219–222. doi: 10.1038/nature16954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Pnevmatikakis EA, Giovannucci A. NoRMCorre: an online algorithm for piecewise rigid motion correction of calcium imaging data. J. Neurosci. Methods. 2017;291:83–94. doi: 10.1016/j.jneumeth.2017.07.031. [DOI] [PubMed] [Google Scholar]
- 109.Pnevmatikakis EA, et al. Simultaneous denoising, deconvolution, and demixing of calcium imaging data. Neuron. 2016;89:285–299. doi: 10.1016/j.neuron.2015.11.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110.Bolte S, Cordelieres FP. A guided tour into subcellular colocalization analysis in light microscopy. J. Microsc. 2006;224:213–232. doi: 10.1111/j.1365-2818.2006.01706.x. [DOI] [PubMed] [Google Scholar]
- 111.Skaggs WE, McNaughton BL, Wilson MA, Barnes CA. Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences. Hippocampus. 1996;6:149–172. doi: 10.1002/(SICI)1098-1063(1996)6:2<149::AID-HIPO6>3.0.CO;2-K. [DOI] [PubMed] [Google Scholar]
- 112.Hussaini SA, Kempadoo KA, Thuault SJ, Siegelbaum SA, Kandel ER. Increased size and stability of CA1 and CA3 place fields in HCN1 knockout mice. Neuron. 2011;72:643–653. doi: 10.1016/j.neuron.2011.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113.Fenton AA, et al. Unmasking the CA1 ensemble place code by exposures to small and large environments: more place cells and multiple, irregularly arranged, and expanded place fields in the larger space. J. Neurosci. 2008;28:11250–11262. doi: 10.1523/JNEUROSCI.2862-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Zhang K, Ginzburg I, McNaughton BL, Sejnowski TJ. Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J. Neurophysiol. 1998;79:1017–1044. doi: 10.1152/jn.1998.79.2.1017. [DOI] [PubMed] [Google Scholar]
- 115.Tampuu A, Matiisen T, Olafsdottir HF, Barry C, Vicente R. Efficient neural decoding of self-location with a deep recurrent network. PLoS Comput. Biol. 2019;15:e1006822. doi: 10.1371/journal.pcbi.1006822. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 116.Senbabaoglu Y, Michailidis G, Li JZ. Critical limitations of consensus clustering in class discovery. Sci. Rep. 2014;4:6207. doi: 10.1038/srep06207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 117.Brunet JP, Tamayo P, Golub TR, Mesirov JP. Metagenes and molecular pattern discovery using matrix factorization. Proc. Natl Acad. Sci. USA. 2004;101:4164–4169. doi: 10.1073/pnas.0308531101. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets generated in the current study are available on Mendeley Data: 10.17632/p8gh7wk9z3.1 Source data are provided with this paper.
Custom MATLAB code generated in this study is available at: https://github.com/yanjuns/Sun_Giocomo_2022_NComms.