Abstract
Recalling a salient experience provokes specific behaviors and changes in the physiology or internal state. Relatively little is known about how physiological memories are encoded. We examined the neural substrates of physiological memory by probing CRHPVN neurons of mice, which control the endocrine response to stress. Here we show these cells exhibit contextual memory following exposure to a stimulus with negative or positive valence. Specifically, a negative stimulus invokes a two-factor learning rule that favors an increase in the activity of weak cells during recall. In contrast, the contextual memory of positive valence relies on a one-factor rule to decrease activity of CRHPVN neurons. Finally, the aversive memory in CRHPVN neurons outlasts the behavioral response. These observations provide information about how specific physiological memories of aversive and appetitive experience are represented and demonstrate that behavioral readouts may not accurately reflect physiological changes invoked by the memory of salient experiences.
Subject terms: Stress and resilience, Habituation, Neurophysiology
How physiological memories are encoded is not fully understood. Here the authors show how physiological memories of aversive and appetitive experience are represented by corticotropin-releasing hormone synthesizing neurons in the paraventricular nucleus of the hypothalamus and demonstrate that behavioral readouts may not accurately reflect physiological changes invoked by the memory of salient experiences.
Introduction
Behaviors generated in response to specific stimuli are often matched by changes in the physiology or internal state of the organism. Behavioral adjustments and shifts in internal state also occur during the recall of prior salient experience1–3. There has been considerable work on identifying key brain cell populations, circuits, and mechanisms that give rise to explicit, behaviorally detectable forms of memory, but surprisingly, little is known about how the brain remembers prior experience to generate the requisite physiological changes.
A widely held but largely untested assumption is that external and internal responses rely on the same neural architecture for memory. In part, this is due to limitations imposed by the slow kinetics of hormonal release and difficulties in accurately sampling peripheral signals in parallel with behavioral observations. To explore the substrates of a physiological memory, we examined corticotropin-releasing hormone-synthesizing neurons in the paraventricular nucleus of the hypothalamus (CRHPVN). These cells control the hypothalamic–pituitary–adrenal (HPA) axis4 and, by extension, the circulating levels of corticosterone (CORT)4–6, the classical stress hormone. CRHPVN neurons show bi-directional changes in activity to aversive (increase activity) and rewarding (decrease activity) stimuli7,8, detect predatory threats to gate specific defensive behaviors9,10, and are required for the generation of anxiety states11,12. Repeated optogenetic manipulation of CRHPVN activity is sufficient to form contextual memory7, positioning these cells as potential nodes for storing information about salient experiences.
In rodents, associative memory of threat requires the recruitment of engrams, specific subsets of neurons that are reliably activated during learning and retrieval, described in the cortex, amygdala, and hippocampus13–16. However, species with nervous systems containing only rudimentary counterparts or no equivalent structures to these brain regions are still capable of employing associated memory cues17. Indeed, oxytocin neurons in the hypothalamus show all the necessary features of a context-dependent fear memory engram18.
Since CRHPVN neurons are both necessary5 and sufficient11 for the endocrine response to stress, we used in vivo population and single-cell calcium imaging of CRHPVN activity to provide detailed, real-time tracking of neurons that control endocrine state over multiple days. We show that CRHPVN neurons exhibit contextual memory of both negative and positive stimuli. The negative cellular memories persist for days, indicating that CRHPVN neurons track contextual valence in an enduring fashion. Finally, we provide distinct learning rules for positive and negative memories in CRHPVN neurons.
Results
Sustained anticipatory activity of CRHPVN neurons
In order to explore whether CRHPVN neurons are affected by the recall of an event with high salience, we first evaluated their activity in response to neutral stimuli. We expressed GCaMP6 in CRHPVN neurons and used single fiber photometry and miniature endoscopes (miniscopes) (Fig. 1a–c; Supplementary Fig. 1). Mice were exposed to a novel context that contained no overt threat cues or appetitive stimuli (neutral valence). CRHPVN population activity increased upon exposure to the neutral context, and this increase persisted for the duration of the exposure (Fig. 1d, e). Miniscope recordings also confirmed the activity increase at the level of individual CRHPVN neurons during neutral context exposure (Fig. 1f, g). A Principal Component Analysis (PCA) showed both an expansion and a shift in the activity state space in comparison to home cage (Fig. 1h). To determine whether the persistence of the activity increase was due to sustained context exposure and not a prolonged response to the handling during the transfer, mice were handled similarly, but placed back in the home cage. This resulted in an increase in activity during handling, but the activity returned to baseline levels following the return to the home cage (Supplementary Fig. 2). These observations indicate that exposure to context with neutral valence triggers a sustained activity in CRHPVN neurons. We labeled this activity anticipatory, since it occurs even in the absence of an overt threat.
Aversive memory encoded by CRHPVN neurons
To determine whether CRHPVN neurons make a contextual association with intense stress, we exposed mice to ten foot shocks (FS) in a novel environment (Pre) and returned them to this context 24 h later (Post). During the test day, CRHPVN neurons exhibited a more robust increase in activity in comparison to the increase observed prior to FS (photometry: Fig. 2a, b; miniscopes: Fig. 2c, d; Supplementary Fig. 3a). This activity increase was not apparent immediately after foot shock (Supplementary Fig. 3b, c). The increased neural response was accompanied by an increase in CORT that was greater than that observed after re-exposure to the neutral context (Supplementary Fig. 3d). In contrast, re-exposure of mice to a neutral context that was not associated with foot shock triggered the same level of CRHPVN activity, both at the population level (Fig. 2e, f) and at individual neurons (Fig. 2g, h). These data demonstrate that CRHPVN neurons show contextual recall of negative valence.
In order to address how contextual memory is encoded in the hypothalamus, we compared the activity of individual CRHPVN neurons in the context prior to FS (Pre), and in the context the day after FS (Post). There was no correlation between the activity of individual cells in the Pre and Post groups (Fig. 2i). This suggests that a subpopulation of cells, but not the entire population, contributed disproportionately to the increase in activity. To test whether the subpopulation was assigned randomly or was rule-driven, we clustered CRHPVN neurons using a non-arbitrary data-driven approach to identify an underlying subpopulation structure (Fig. 2j). Three groups were identified based on activity prior to FS; cells that showed little increase in activity were classified as Weak. Cells with the highest activity prior to FS were classified as Strong. The remainder of the population was intermediate. Weak cells showed a dramatic increase in activity in the context on the day after FS; in contrast, the response of Strong cells was similar on both days (Fig. 2k). In fact, during recall, the activities of cells classified as Weak and Strong based on activity prior to FS, were indistinguishable (Fig. 2k). On the other hand, re-exposure to neutral context revealed a high correlation between Pre and Post (Fig. 2l). Furthermore, Weak and Strong clusters identified based on the initial neutral context exposure remained significantly different on neutral context re-exposure (Fig. 2m, n). Additional differences were observed between the Weak and Strong cells in the foot shock experiment: Weak cells had a stronger response to the shocks (Fig. 2o). Importantly, the level of FS response was a strong predictor of the activity increase during context retrieval in Weak cells (Fig. 2p). On the other hand, Strong cells showed no change in activity that could be explained by their FS response (Fig. 2q). These findings were corroborated if we identified Weak and Strong cells based on activity profiles that are more than one standard deviation removed from the mean (Supplementary Fig. 4). These analyses reveal that FS predicts the activity increase best for cells that were the weakest responders prior to FS (Supplementary Fig. 5).
Learning rule in CRHPVN neurons
These results imply that two factors are critical to induce a context-dependent change in the threat anticipation of CRHPVN neurons: the relative weakness of cell activity during context exposure prior to FS and the relative strength of the response to the FS itself. We considered if these two factors alone could explain the update in the CRHPVN response by simulating networks of plastic, leaky-integrate-and-fire neurons which display a synthetic calcium-like indicator (Fig. 3a; Table 1). These neurons received inputs that represented context weighted by a vector for each simulated CRHPVN neuron. The weight was plastic, with its changes dictated by a simple learning rule (Fig. 3b) where the weights are updated according to two terms:
1 |
Table 1.
Parameter | Value |
---|---|
10 ms | |
Neurons | |
Context inputs | |
20 ms | |
2 ms | |
(Nutella) | |
1 s | |
100 ms | |
400 s |
The first term models the recruitment of cells. Neurons with lower sums of weights are recruited more strongly to reach the weight ceiling . The second term acts as a plasticity gate, which is opened by strong foot shock responses over a plasticity threshold (for additional details, see methods). We found that these two terms could reproduce the increase in the anticipatory response of CRHPVN neurons (Fig. 3c, d). This included the ceiling level recruitment from the Strong anticipatory pool (Fig. 3e) and the population level response in the low-dimensional PCA space (Fig. 3f). Collectively, these results demonstrate that the activity of CRHPVN neurons is updated following intense stress using a local memory mechanism.
Uncoupled internal and external representations of stress
Next, we examined the relationship between this CRHPVN response and behavior. When returned to the context one day after FS, mice exhibited canonical fear behavior (freezing) (Fig. 4a, b). Consistent with previous reports, repeated exposure to the FS context resulted in the extinction of freezing behavior13–15 (Fig. 4a, b). In contrast, the CORT response was similar following each context exposure after FS (Fig. 4c, d). Consistent with the CORT response, the CRHPVN population response to FS context was invariant for the repeated exposures (Fig. 4e) and showed no sign of extinction. Next, we examined the activity profiles of individual cells over multiple days in the FS context. We observed that once individual CRHPVN cells were recruited to the strong pool, they remained in this pool for multiple days (Fig. 4f). Additionally, the activity of a given cell on one day of FS context re-exposure was a strong predictor of its activity on subsequent days (Fig. 4g, h; Supplementary Fig. 6). PCA further confirmed that the shift in state space occupied by CRHPVN activity is preserved upon repeated recalls (Fig. 4i). These data demonstrate CRHPVN neurons track negative valence for many days after an aversive experience. The contextual memory of the aversive experience increases the number of Strong cells by recruiting cells that were Weak.
Appetitive memory encoded by CRHPVN neurons
CRHPVN neurons show decreases in activity in response to appetitive stimuli7,8. Here we asked whether CRHPVN neurons show evidence for recall of an appetitive stimulus. Following a 5-minute exposure to a novel context, (Pre) a small sample of hazelnut spread was placed in one corner. Consistent with previous results for other appetitive stimuli, access to the hazelnut spread decreased CRHPVN activity (Supplementary Fig. 7). When mice were returned to the context 24 h later (Post), CRHPVN activity was significantly lower than recorded in the context before exposure to the hazelnut spread (Fig. 5a–d). In contrast with the effect of foot shock, re-exposure to the hazelnut spread-associated context triggered a CRHPVN response that was highly correlated with the activity prior to the spread presentation (Fig. 5e). However, data-driven clustering of CRHPVN neurons showed that Weak cells responded similarly upon contextual recall, while Strong cells showed a dramatic drop in activity (Fig. 5f, g). This blunted CRHPVN response was evident on 2 additional days of context exposure (Fig. 5h, i). Furthermore, the activity of individual CRHPVN neurons was similar and predictable throughout the repeated recalls (Fig. 5i, j). The stability of this response was confirmed with PCA (Fig. 5k). Data simulation confirmed that a simpler, 1-factor learning rule that only depends on Pre activity adequately describes the attenuated CRHPVN response (see “Methods”; Supplementary Fig. 8).
Our data demonstrate that CRHPVN cells show scaled responses to stimuli of negative, neutral, and positive valence. Furthermore, they faithfully recall positive and negative valence upon re-exposure to context over multiple days (Fig. 5h).
Discussion
Our findings demonstrate that hypothalamic CRHPVN neurons show associative learning to form enduring contextual memories of positive and negative experiences. This learning is local and independent of learning in other brain regions that guide behavioral responses. Negative experience invokes a two-factor learning rule in which additional cells are recruited into a contextual response pool based on their activity prior to the aversive stimulus and the magnitude of their response to the stimulus itself. The spectrum of CRHPVN neuronal responses to context exposures highlights the diversity of these neurons. This is consistent with recent observations that this population is heterogeneous19–22. Unlike other forms of associative learning in which the most active cells are selectively recruited into a memory trace, here, it is the least active cells that are preferentially targeted. Positive or appetitive experience invokes a simpler, 1-factor learning rule in which there is a scaled decrease in the activity of the CRHPVN neurons upon exposure to the appetitive context.
The anticipation of threat activates a defensive organismic state to recruit specific circuits that elicit appropriate defensive behaviors23–29. Threats or dangers, however, are not always predictable. This unpredictability means specific brain systems must also anticipate and prepare for potential danger1–3. We propose that the anticipatory activity of CRHPVN neurons in response to a decrease in safety is a cellular-level, precautionary activity signature. This is consistent with a theoretical security motivation that prepares the organism for the immediate utilization of available resources without necessarily consuming them1. We theorize that precautionary activity in CRHPVN functions as an early permissive signal, informing key decision-making centers about the organismal state.
The fact that changes in the activity of CRHPVN neurons outlast contextual behaviors suggests this hypothalamic memory center likely functions independently of the cortex, amygdala, and hippocampus, all brain regions that are reliably activated during learning and retrieval13–16. The concept of a hypothalamic memory center is consistent with previous work showing the existence of fear memory in hypothalamic oxytocin neurons18. Even more broadly, species with a phylogenetically older nervous system are still capable of forming associative memories17.
For negative valence, we propose a two-factor learning rule that adds a new dimension to classical Hebbian learning rules that link immediate activity increases to a stimulus to learning16,30. It is also distinct from previous observations that take neuronal activity into account; for example, in the amygdala, cells with higher activity before training are preferentially recruited into a memory trace following an aversive experience31. For positive valence, the rule is simpler, with a scaling down of activity across the entire population during re-exposure to context that is not dependent on changes in neural activity during the presentation of the inducing stimulus.
Finally, our observations reveal a disconnect between behavioral responses and CRHPVN neurons (and CORT response) during repeated exposure to negative contexts. While the behavioral response shows extinction with repeated context exposure, the activity of CRHPVN neurons, which we interpret as reflective of an internal state process, remains fixed. Since these internal states are only directly accessible to the individual, others must make behavioral-based inferences in order to deduce an individual’s emotions32. Our data showing a disconnect between a physiological memory and a behavioral memory suggests that the emotional state of the animal may not necessarily be reported faithfully by behavioral readouts. Authoritative voices like Charles Darwin33,34 and William James35 have posited that behaviors can be used to deduce these introspective states. Consistent with these ideas, using specific behaviors as proxies for emotional states has advanced our understanding of the neural basis of anxiety and fear28. However, our results showing that CRHPVN activity and behavior do not always match suggest that externally visible behaviors may not always reliably report internal states such as stress.
Methods
Mice
All animal protocols were approved by the University of Calgary Animal Care and Use Committee (AC21-0067). For fiber photometry and behavioral tracking experiments Crh-IRES-Cre (B6(Cg)-Crhtm1(cre)Zjh/J; stock number 012704) and Ai14 (B6.Cg-Gt(ROSA)26Sortm14(CAG-TdTomato)Hze/J; stock number 007914) mice in which CRH neurons express tdTomato fluorophore were used36. For some fiber photometry and all of the miniature microscopy experiments, the offsprings of Crh-IRES-Cre mice crossed with Ai148 (Ai148(TIT2L-GC6f-ICL-tTA2)-D; stock number 030328) animals were utilized. Mice were obtained from Jackson Laboratories.
Mice were housed on a 12-h:12-h light:dark cycle (lights on at 7:00 a.m.) with ad libitum access to food and water in whole litters until 1–2 d before use, then were individually housed during the experimental phase. All subjects were randomly assigned to different experimental conditions used in this study. Mice were 6–8 weeks old at the time of surgery and virus injection.
Stereotaxic injection and optical fiber/GRIN lens implantation
Toally, 6–8 weeks old Crh-IRES-Cre;Ai14 mice were maintained under isoflurane anesthesia in the stereotaxic apparatus. For fiber photometry experiments, a glass capillary containing a Cre-dependent AAV construct with GCaMP6s (AAV9-CAG.Flex.GCaMP6s; Penn Vector Core) was lowered into the brain (anteroposterior (AP), −0.7 mm; lateral (L), −0.3 mm from the bregma; dorsoventral (DV), −4.5 mm from the dura. The virus was pressure injected with a Nanoject II apparatus (Drummond Scientific Company) in a total volume of 210 nl. Two weeks were allowed for recovery; subsequently, a 400 µm diameter mono fiber optic cannula (Doric Lenses, MFC_400/430/0.48_5mm_MF2.5_FLT) was implanted dorsal to the PVN. For the miniature microscopy experiments, the GRIN lens (6.1 mm length; Inscopix) was lowered dorsal to the PVN of Crh-IRES-Cre;Ai148 mice at a 100 µm/min speed using a motorized stereotaxic apparatus. Both implantations were targeted to a similar position (AP, −0.7 mm; L, −0.2 mm from the bregma; DV, −4.2 mm from the dura) and were affixed to the skull with METABOND® and dental cement. For photometry, mice were given 2 weeks to recover prior to the start of the experiment. For miniature microscopy, at least one month after lens implantation, a baseplate was installed on the head. For experiments with the hazelnut spread, lenses with integrated baseplates were implanted. Experiments started after an additional two weeks of recovery and handling.
Histology
To verify GCaMP expression and ferrule location, following the experiments, mice were anesthetized with sodium pentobarbital (30 mg/kg) and transcardially perfused with phosphate-buffered saline (PBS), followed by 4% paraformaldehyde (PFA) in phosphate buffer (PB, 4 °C). Brains were placed in PFA 24 h followed by 20% sucrose PB. In total, 30 µM coronal brain sections were obtained via cryostat. Slide-mounted and coverslipped sections were imaged using a confocal microscope (Olympus BX50 Fluoview). Images were prepared by ImageJ.
Fiber photometry recording
Fiber photometry was used to record calcium transients from CRH neurons in the PVN of freely moving mice. After the recovery period, animals were handled for 5 min a day for 3 successive days and then habituated to the optic fiber in their homecage (15 min a day) for 3 additional days. We recorded 10 min of CRHPVN neuron activity in the homecage immediately before and after each test for better bleaching correction and the first and last 5 min of recording were excluded from further analysis. The data obtained from injected GCaMP6s (Crh-IRES-Cre;Ai14) vs GCaMP6f (Crh-IRES-Cre;Ai148) expressing mice were indistinguishable (Supplementary Fig. 9a).
Two different fiber photometry systems were used. TDT system: Briefly, two excitation LEDs (470 nm M470F3 and 405 nm M405F1 from THORLABS) were controlled by a RZ5P (Tucker-Davis Technology) processor running Synapse software (Tucker-Davis Technology). The LEDs were modulated at 211 Hz (470 nm) and 531 Hz (405 nm) to avoid contamination from room lighting. Both LEDs were connected to a DORIC Mini Cube filter set (FMC4_AE(405)_E(460-490)_F(500-550)_S) and the excitation light was directed to the animal via a mono fiber optic patch cord (Doric MFP_400/460/900-0.48_2m_FC/MF2.5). The power of the LEDs was adjusted to provide 30 µW at the end of the patch cord. The resulting signal was detected with a photoreceiver (Newport model 2151) and demodulated by an RZ5P processor. Doric fiber photometry system: Consisting of two excitation LEDs (465 nm and 405 nm from Doric) controlled by an LED driver and console, running Doric Studio software (Doric Lenses). The LEDs were modulated at 208.616 Hz (465 nm) and 572.205 Hz (405 nm), and the resulting signal was demodulated using lock-in amplification. Both LEDs were connected to a Doric Mini Cube filter set (FMC5_E1(405)_E2(460-490)_F1(500-550)_S) and the excitation light was directed to the animal via a mono fiber optic patch cord (DORIC MFP_400/460/900-0.48_2m_FC/MF2.5). The power of the LEDs was adjusted to be 30 µW at the end of the patch cord. The resulting signal was detected with a photoreceiver (Newport model 2151).
Fiber photometry data analysis
Fluorescent signal data was acquired at a sampling rate of 1 kHz (TDT system) and 100 Hz (Doric system). Data were then exported to MATLAB (Mathworks) for offline analysis using custom-written scripts. Briefly, the 465/470 nm and 405 nm data were first individually fit with a second-order curve which was then subtracted to remove any artifacts due to bleaching. Next, a least-squares linear fit was applied to the 405 nm to align it with the 470 nm channel and then the change in fluorescence (ΔF) was calculated by subtracting the 405 nm Ca2+ independent baseline signal from the 470 nm Ca2+ dependent signal at each time point. This approach mitigated the differences arising from the lowering recorded voltage due to the continuous bleaching of the light path (Supplementary Fig. 9b, c). In case the motion artifact was too large and could not be eliminated by the subtraction of the 405 signal, the entire recording was discarded. To minimize the impact of the handing and the upstate on the bleaching correction, the first and the last 5 min of fiber photometry recording were used for curve fitting (Supplementary Fig. 9b). For analysis, the z-score calculation was performed using the following equation z = (F − F0)/σF. Where F is the test signal, F0 and σF are the mean and standard deviation of the baseline signal, respectively. For recordings from the same animals on consecutive days, in order to minimize the distortions arising from different baseline activities on different days, we calculated the z-score using the standard deviation from the baseline period of the first day of the experiment (Supplementary Fig. 10a). On each day a 3-min baseline period in the home cage prior placing the animal to a different context was used to calculate relative change triggered by context exposure. To exclude the possibility that slow changes in GCaMP expression or basal CRHPVN activity that affect both baseline and context exposure recording caused the observed changes during repeated exposures, we performed the fiber photometry analyses using methods that are insensitive to the baseline and used relative differences exclusively. Photometry dF/F was calculated by using least-squares second-order polynomial fit. We fitted the 405 nm channel to the 465 nm channel. Then performed the following calculation37: dF/F = (F465 − Ffitted 405)/Ffitted 405. Additionally, we performed the formerly described z-score analysis using the standard deviation calculated from the home cage baseline activity. All analyses led to the same conclusions (Supplementary Fig. 10b–i).
Miniature microscopy data analysis
The activity of CRHPVN neurons was recorded continuously for at least 15 min at 20 FPS, 40% LED power, and 2.5 gain with an nVista or nVoke miniature microscope (Inscopix) using the nVista Acquisition Software (Inscopix). The video files were cropped with ImageJ and the data analysis was performed by the MIN1PIPE script38 in MATLAB using 0.25 spatial and 0.5 temporal downsampling ratio and manual selection of ROIs. idF/F was calculated by averaging the dF/F results sampled at 0.1 s over a 3-min long period and multiplied by 100.
Calcium imaging alignment via MIN1PIPE
The maximal projection image from MIN1PIPE, along with the assigned and curated putative cells, are used to determine the alignment across all days. A stochastic descent algorithm is applied to both images to maximally align the images across recording days. In short, the images are randomly rotated, translated, and re-scaled to minimize the average pairwise Frobenius distance between all possible pairs:
2 |
The random translations, rotations, and re-scaling transformations are applied to pairs of images within all recording days, randomly selected. The Global alignment metric, GA is computed for both the cluster assignments (where cells exist in the imaging plane) and the raw images. A weighted linear combination of the two is then used as an optimization criterion with weights of 0.3 (clusters) and 0.7 (raw). If this weighted sum decreases with an image transform, the image transform is preserved. New image transforms are then randomly created, perturbing off this image in subsequent steps. This stochastic algorithm is performed for 10,000 iterations, with the perturbation size halved every 500 iterations and the pair of recording days within the set swapped every 400 step sizes. Several iterations of this stochastic approach were performed with different initial conditions to ensure both the stability and quality of the cell-to-cell mapping across days (Supplementary Fig. 9d, e).
Behavioral tests
Following fiber or GRIN lens implantation, mice were individually housed for at least 2 weeks before behavioral testing. Prior to any behavioral manipulation, mice were handled for 5 min each day for 3 successive days and habituated to the experimental room 1 h prior to testing. The apparatus was cleaned with a 70% ethanol solution to eliminate odor from other mice. All behaviors were recorded and scored offline by an experimenter blind to the treatment. Behavioral annotations were performed with a custom-written Excel macro11. Freezing behavior was noted if the animal showed no movement for at least 3 s except for respiratory movements.
Neutral context exposure
Following the baseline recording in the home cage, mice were placed in a 41 cm × 19 cm × 20.5 cm clean and transparent plastic arena for 5 min. The second exposure was on a consecutive day.
Different context exposures
Following the baseline recording in the home cage, mice were placed either in a 45 cm × 45 cm, semi-transparent walled hole-board or a 53 cm × 53 cm opaque open field.
Footshock stress
Following 5 minutes of initial exposure to the footshock chamber, a series of foot shocks were delivered to the mouse (0.5 mA, 2 s shocks delivered every 30 s in a period of 5 min; SMSCK, Kinder Scientific). Mice were re-introduced to the footshock chamber for 5 min on 3 subsequent days.
Hazelnut spread
In order to familiarize the animals with the object, the mice received a stick in their homecage a day before the experiment. After 5 min of initial exposure to a context, a small amount of Nutella on a stick was placed into the context. Mice were re-introduced to the same chamber for 5 min on 3 subsequent days.
Corticosterone measurement
Immediately before and 15 min after the onset of stress exposure, blood from the tail vein was collected into ice-cold EDTA capillary tubes (Stardest) and centrifuged (Eppendorf centrifuge 5430 R,7335 g, 4 °C, 20 min). Aliquots of plasma were stored at −20 °C until assayed using a DetectX Corticosterone Immunoassay kit (Arbor Assay). Plasma samples were run in triplicates on the same day.
Statistics
GraphPad Prism 10.0 software was used for statistical analysis. When comparing means from two dependent groups, different time points paired t-test (two-tailed) were used. When comparing the means of two independent groups, unpaired t-test (two-tailed) were used. When comparing the means of multiple groups, parametric repeated measures, mixed effects model, and one-way or two-way ANOVA were used, followed by Bonferroni corrections for multiple comparisons. For further statistical details regarding each analysis, see Supplementary Table 1.
To identify subpopulations of neurons based on activity, affinity propagation clustering was used39,40. The first step consisted of affinity propagation to reveal data-point exemplars contained in the data using the Euclidean distance metric and an input preference set for the minimum of input similarities (q = 0)39,40. The second step used exemplar-based agglomerative clustering on the affinity propagation result. This provides an additional tool for finding the most likely underlying cluster structure as it is geared toward the identification of meaningful data partitions39.
Dimension reduction/PCA
To perform the principal component analysis (PCA), the data vector was constructed by taking the time-aligned intervals of either the neutral context (across days), the foot shock condition (across days), and the Nutella condition (across days). The activity of the neurons was tracked across days (see below), with the data matrix corresponding to
3 |
Which corresponds to recorded calcium from neuron at time . As the neurons are aligned across days, and aligned in time intervals, the data was pooled across animals. The time indices correspond to the Calcium recordings with a sample rate of 0.1 s and cover multiple acquisition days (the home cage/neutral context, home cage/foot shock chamber, and home cage/Nutella application chamber were pooled in time). PCA was then applied to the matrix directly via the singular value decomposition.
Spiking neural network simulations
A network of 100 leaky integrate-and-fire neurons with spike frequency adaptation was used as the model for the individual CRHPVN neurons (Table 1):
4 |
5 |
A neuron with index is said to fire a spike when the voltage reaches a threshold potential (), after which the neuron is reset to . The adaptation variable, for each neuron, , is incremented by the variable each time that neuron fires a spike with denoting the kth spike fired by the ith neuron. The membrane time constant, controls the ability of a neuron to filter/remember its inputs while the bias current, sets the baseline firing rate for a neuron. Each neuron receives a white noise current with mean 0 and standard deviation . The dynamically varying current, decomposes as follows:
6 |
The weights are vectors that multiply a vector of inputs, the context vector rcontext(t). This vector is generated as a filtered spike train. The spike train is generated from a Poisson process with mean Hz when the simulated animal is in a novel environment, and Hz when the simulated animal is in its home cage. The context spike train is filtered with a 20 ms decay time and 2 ms rise time with a double exponential filter.
7 |
where is the kth spike fired by the ith context input.
The scalar is a random weight for an input that mimics the impacts of a footshock:
8 |
where is the ith foot shock time. The weights are each generated from a normal distribution with a mean of and a standard deviation of 1. Note that all weights in this work are unitless, as the filtered spike trains have units of .
The scalar is a random weight for an input that mimics the application of the hazelnut spread.
9 |
The parameter was used while the weight was drawn from a uniform distribution on the interval [−0.09,0.01], thereby mimicking the observed inhibitory impacts of the hazelnut spread on Calcium.
All spikes are filtered with an auxiliary variable, which is used to implement the two-factor learning rule below. The filter is a double exponential filter:
10 |
where and are the rise and decay times of the double exponential filter.
All equations are integrated with a forward Euler method with a 1 ms time step. The total simulation time is 2190 s, with the initial exposure to the novel environment occurring on the interval s, with 10 foot shocks applied on the interval , with 30 s pauses between foot shocks. The context is changed back to the home cage at s, with a second exposure to the novel context at 1790 s.
Two-factor learning rule
The context weights, are updated according to a two-factor, delayed learning rule:
11 |
12 |
The first term implements the plasticity rule whenever the auxiliary rate-like variable in the variables. These phenomenologically implement a delay in the plasticity, as the molecular biology behind synaptic weight changes take time. A similar, albeit simpler 1-factor delayed learning rule was sufficient to model the activity changes when Nutella was applied:
13 |
14 |
Calcium imaging alignment via MIN1PIPE
The maximal projection image from MIN1PIPE, along with the assigned and curated putative cells are merged into a two-channel image. A stochastic descent algorithm is applied to the merged images to maximally align the images across recording days. In short, the images are randomly rotated, translated, and re-scaled to minimize the distance.
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Supplementary information
Acknowledgements
We thank Mrs. Cheryl Breiteneder, Ms. Mio Tsutsui, Mr. Carlos Martinez, and Mr. Rodney Barasi for their expert technical support. We also thank Dr. Jinghao Lu for their support with MIN1PIPE. We are grateful for the support of the Cumming School of Medicine Optogenetics Core Facility. This work was supported by an operating grant to J.S.B. from the Canadian Institutes for Health Research (FDN-148440) and the Brain Canada Neurophotonics Platform. ND received support from Alberta Innovates-Health Solutions and the Brain and Behavior Research Foundation.
Author contributions
T.F. designed and conducted the experiments, analyzed the data, and wrote the paper. N.P.R., M.R.C., D.G.R., N.D. and T.S. conducted experiments, analyzed data, and contributed to paper preparation. K.S., L.A.M, and T.C. contributed to data analysis. W.N. performed the computational modeling and contributed to paper preparation. J.S.B. designed experiments, prepared the paper, and supervised the project.
Peer review
Peer review information
Nature Communications thanks the anonymous reviewers for their contribution to the peer review of this work. A peer review file is available.
Data availability
The raw data that support the findings of this study are available from the corresponding author upon request. The data generated in this study are provided in the Source Data file.
Code availability
Scripts used to analyze fiber photometry are deposited here: https://github.com/leomol/FPA; 10.5281/zenodo.5708470. The code for simulating the spiking neurons under the foot shock and the hazelnut spread conditions can be found on ModelDB41, under accession number 2015420 (https://modeldb.science/2015420). Scripts used to align miniscope recordings are available upon request.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
The online version contains supplementary material available at 10.1038/s41467-023-44163-5.
References
- 1.Woody EZ, Szechtman H. Adaptation to potential threat: the evolution, neurobiology, and psychopathology of the security motivation system. Neurosci. Biobehav. Rev. 2011;35:1019–1033. doi: 10.1016/j.neubiorev.2010.08.003. [DOI] [PubMed] [Google Scholar]
- 2.Wagner A. Risk management in biological evolution. J. Theor. Biol. 2003;225:45–57. doi: 10.1016/S0022-5193(03)00219-4. [DOI] [PubMed] [Google Scholar]
- 3.Brown JS, Laundre JW, Gurung M. The ecology of fear: optimal foraging, game theory, and trophic interactions. J. Mammal. 1999;80:15. doi: 10.2307/1383287. [DOI] [Google Scholar]
- 4.Herman JP, et al. Central mechanisms of stress integration: hierarchical circuitry controlling hypothalamo-pituitary-adrenocortical responsiveness. Front. Neuroendocrinol. 2003;24:151–180. doi: 10.1016/j.yfrne.2003.07.001. [DOI] [PubMed] [Google Scholar]
- 5.Ulrich-Lai YM, Herman JP. Neural regulation of endocrine and autonomic stress responses. Nat. Rev. Neurosci. 2009;10:397–409. doi: 10.1038/nrn2647. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Schulkin J. Evolutionary conservation of glucocorticoids and corticotropin releasing hormone: behavioral and physiological adaptations. Brain Res. 2011;1392:27–46. doi: 10.1016/j.brainres.2011.03.055. [DOI] [PubMed] [Google Scholar]
- 7.Kim J, et al. Rapid, biphasic CRF neuronal responses encode positive and negative valence. Nat. Neurosci. 2019;22:576–585. doi: 10.1038/s41593-019-0342-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Yuan Y, et al. Reward inhibits paraventricular CRH neurons to relieve stress. Curr. Biol. 2019;29:1243–1251.e4. doi: 10.1016/j.cub.2019.02.048. [DOI] [PubMed] [Google Scholar]
- 9.Daviu N, et al. Paraventricular nucleus CRH neurons encode stress controllability and regulate defensive behavior selection. Nat. Neurosci. 2020;23:398–410. doi: 10.1038/s41593-020-0591-0. [DOI] [PubMed] [Google Scholar]
- 10.Sterley T-L, et al. Social transmission and buffering of synaptic changes after stress. Nat. Neurosci. 2018;21:393–403. doi: 10.1038/s41593-017-0044-6. [DOI] [PubMed] [Google Scholar]
- 11.Füzesi T, Daviu N, Wamsteeker Cusulin JI, Bonin RP, Bains JS. Hypothalamic CRH neurons orchestrate complex behaviours after stress. Nat. Commun. 2016;7:11937. doi: 10.1038/ncomms11937. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Zhang R, et al. Loss of hypothalamic corticotropin-releasing hormone markedly reduces anxiety behaviors in mice. Mol. Psychiatry. 2017;22:733–744. doi: 10.1038/mp.2016.136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Tovote P, Fadok JP, Lüthi A. Neuronal circuits for fear and anxiety. Nat. Rev. Neurosci. 2015;16:317–331. doi: 10.1038/nrn3945. [DOI] [PubMed] [Google Scholar]
- 14.Myers KM, Davis M. Mechanisms of fear extinction. Mol. Psychiatry. 2007;12:120–150. doi: 10.1038/sj.mp.4001939. [DOI] [PubMed] [Google Scholar]
- 15.Fendt M, Fanselow MS. The neuroanatomical and neurochemical basis of conditioned fear. Neurosci. Biobehav. Rev. 1999;23:743–760. doi: 10.1016/S0149-7634(99)00016-0. [DOI] [PubMed] [Google Scholar]
- 16.Liu X, et al. Optogenetic stimulation of a hippocampal engram activates fear memory recall. Nature. 2012;484:381–385. doi: 10.1038/nature11028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Lukowiak K, et al. A molluscan model system in the search for the engram. J. Physiol. Paris. 2003;97:69–76. doi: 10.1016/j.jphysparis.2003.10.008. [DOI] [PubMed] [Google Scholar]
- 18.Hasan MT, et al. A fear memory engram and its plasticity in the hypothalamic oxytocin system. Neuron. 2019;103:133–146.e8. doi: 10.1016/j.neuron.2019.04.029. [DOI] [PubMed] [Google Scholar]
- 19.Ramot A, et al. Hypothalamic CRFR1 is essential for HPA axis regulation following chronic stress. Nat. Neurosci. 2017;20:385–388. doi: 10.1038/nn.4491. [DOI] [PubMed] [Google Scholar]
- 20.Romanov RA, Alpár A, Hökfelt T, Harkany T. Molecular diversity of corticotropin-releasing hormone mRNA-containing neurons in the hypothalamus. J. Endocrinol. 2017;232:R161–R172. doi: 10.1530/JOE-16-0256. [DOI] [PubMed] [Google Scholar]
- 21.Xu S, et al. Behavioral state coding by molecularly defined paraventricular hypothalamic cell type ensembles. Science. 2020;370:eabb2494. doi: 10.1126/science.abb2494. [DOI] [PubMed] [Google Scholar]
- 22.Romanov RA, Alpár A, Hökfelt T, Harkany T. Unified classification of molecular, network, and endocrine features of hypothalamic neurons. Annu. Rev. Neurosci. 2019;42:1–26. doi: 10.1146/annurev-neuro-070918-050414. [DOI] [PubMed] [Google Scholar]
- 23.LeDoux JE. Coming to terms with fear. Proc. Natl Acad. Sci. USA. 2014;111:2871–2878. doi: 10.1073/pnas.1400335111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mobbs D, Hagan CC, Dalgleish T, Silston B, Prévost C. The ecology of human fear: survival optimization and the nervous system. Front. Neurosci. 2015;9:55. doi: 10.3389/fnins.2015.00055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Calhoon GG, Tye KM. Resolving the neural circuits of anxiety. Nat. Neurosci. 2015;18:1394–1404. doi: 10.1038/nn.4101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Fadok JP, et al. A competitive inhibitory circuit for selection of active and passive fear responses. Nature. 2017;542:96–100. doi: 10.1038/nature21047. [DOI] [PubMed] [Google Scholar]
- 27.Fanselow MS. The role of learning in threat imminence and defensive behaviors. Curr. Opin. Behav. Sci. 2018;24:44–49. doi: 10.1016/j.cobeha.2018.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Anderson DJ, Adolphs R. A framework for studying emotions across species. Cell. 2014;157:187–200. doi: 10.1016/j.cell.2014.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Kennedy A, et al. Stimulus-specific hypothalamic encoding of a persistent defensive state. Nature. 2020;586:730–734. doi: 10.1038/s41586-020-2728-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Han J-H, et al. Neuronal competition and selection during memory formation. Science. 2007;316:457–460. doi: 10.1126/science.1139438. [DOI] [PubMed] [Google Scholar]
- 31.Yiu AP, et al. Neurons are recruited to a memory trace based on relative neuronal excitability immediately before training. Neuron. 2014;83:722–735. doi: 10.1016/j.neuron.2014.07.017. [DOI] [PubMed] [Google Scholar]
- 32.Tinbergen, N. The Study of Instinct. XII, 237 (Clarendon Press/Oxford University Press, 1951).
- 33.Darwin, C. The Expression of the Emotions in Man and Animals. VI, 374 (John Murray, 1872).
- 34.Ekman P. Darwin’s contributions to our understanding of emotional expressions. Philos. Trans. R. Soc. B Biol. Sci. 2009;364:3449–3451. doi: 10.1098/rstb.2009.0189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.James W. What is an emotion? Mind. 1884;9:188–205. doi: 10.1093/mind/os-IX.34.188. [DOI] [Google Scholar]
- 36.Wamsteeker Cusulin JI, Füzesi T, Watts AG, Bains JS. Characterization of corticotropin-releasing hormone neurons in the paraventricular nucleus of the hypothalamus of Crh-IRES-Cre mutant mice. PloS ONE. 2013;8:e64943. doi: 10.1371/journal.pone.0064943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Kim JS, Han SY, Iremonger KJ. Stress experience and hormone feedback tune distinct components of hypothalamic CRH neuron activity. Nat. Commun. 2019;10:5696. doi: 10.1038/s41467-019-13639-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lu J, et al. MIN1PIPE: a miniscope 1-photon-based calcium imaging signal extraction pipeline. Cell Rep. 2018;23:3673–3684. doi: 10.1016/j.celrep.2018.05.062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Bodenhofer U, Kothmeier A, Hochreiter S. APCluster: an R package for affinity propagation clustering. Bioinformatics. 2011;27:2463–2464. doi: 10.1093/bioinformatics/btr406. [DOI] [PubMed] [Google Scholar]
- 40.Frey BJ, Dueck D. Clustering by passing messages between data points. Science. 2007;315:972–976. doi: 10.1126/science.1136800. [DOI] [PubMed] [Google Scholar]
- 41.McDougal RA, et al. Twenty years of ModelDB and beyond: building essential modeling tools for the future of neuroscience. J. Comput. Neurosci. 2017;42:1–10. doi: 10.1007/s10827-016-0623-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data that support the findings of this study are available from the corresponding author upon request. The data generated in this study are provided in the Source Data file.
Scripts used to analyze fiber photometry are deposited here: https://github.com/leomol/FPA; 10.5281/zenodo.5708470. The code for simulating the spiking neurons under the foot shock and the hazelnut spread conditions can be found on ModelDB41, under accession number 2015420 (https://modeldb.science/2015420). Scripts used to align miniscope recordings are available upon request.