Skip to main content
eLife logoLink to eLife
. 2016 Sep 27;5:e12669. doi: 10.7554/eLife.12669

Amygdala-ventral striatum circuit activation decreases long-term fear

Susana S Correia 1,2,*, Anna G McGrath 1,2, Allison Lee 1,2, Ann M Graybiel 1,2, Ki A Goosens 1,2,*
Editor: Naoshige Uchida3
PMCID: PMC5039029  PMID: 27671733

Abstract

In humans, activation of the ventral striatum, a region associated with reward processing, is associated with the extinction of fear, a goal in the treatment of fear-related disorders. This evidence suggests that extinction of aversive memories engages reward-related circuits, but a causal relationship between activity in a reward circuit and fear extinction has not been demonstrated. Here, we identify a basolateral amygdala (BLA)-ventral striatum (NAc) pathway that is activated by extinction training. Enhanced recruitment of this circuit during extinction learning, either by pairing reward with fear extinction training or by optogenetic stimulation of this circuit during fear extinction, reduces the return of fear that normally follows extinction training. Our findings thus identify a specific BLA-NAc reward circuit that can regulate the persistence of fear extinction and point toward a potential therapeutic target for disorders in which the return of fear following extinction therapy is an obstacle to treatment.

DOI: http://dx.doi.org/10.7554/eLife.12669.001

Research Organism: Rat

Introduction

Anxiety, trauma, and stress-related disorders have a high lifetime prevalence rate (Kessler et al., 2005) and can be debilitating. The most common treatment for these disorders is exposure therapy, in which trauma-associated or anxiety-provoking cues are presented in a safe environment in order to decrease gradually, or to extinguish, cue-evoked recollection (Rothbaum and Davis, 2003; Felmingham et al., 2013). A challenge in treating these disorders, however, is the re-emergence of symptoms following therapy, a phenomenon called spontaneous recovery (Pavlov, 1927; Rescorla, 2004). The existence of spontaneous recovery suggests that aversive memories associated with the traumatic incident are temporarily inhibited, but not erased, by exposure therapy and that extinction memories are weakened by the passage of time. Understanding how to strengthen extinction memories so that fear return is lessened is thus critical in designing improved treatment of many fear-related and anxiety disorders.

In the laboratory, traumatic events and exposure therapy are modeled using Pavlovian fear conditioning and extinction training. During fear conditioning, neutral cues (conditional stimuli, CSs) are paired with aversive cues (unconditional stimuli, USs), to induce learned fear. During extinction training, the CSs are presented in the absence of aversive stimuli in order to decrease CS-elicited fear. Associative fear memories that result from fear conditioning can be extinguished, but they exhibit spontaneous recovery (Quirk, 2002), providing a powerful behavioral model by which to identify and study the neural circuits that support these phenomena.

The nucleus accumbens (NAc), a striatal region classically linked to rewarding experiences (Ambroggi et al., 2008; Ghitza et al., 2003; Wan and Peoples, 2006), is thought also to participate in aversive memory (Cassaday et al., 2005; Haralambous and Westbrook, 1999; Jongen-Rêlo et al., 2003; Riedel et al., 1997; Schwienbacher et al., 2004; Reynolds and Berridge, 2008). Numerous studies have shown that activity in the NAc is correlated with several measures of learned aversive behaviors (Reynolds and Berridge, 2008; Delgado et al., 2009; Kim et al., 2006a). Moreover, the NAc receives strong glutamatergic inputs from the basolateral amygdala (BLA) (Ambroggi et al., 2008; Brog et al., 1993; Christie et al., 1987; Floresco et al., 2001; O'Donnell and Grace, 1995; Wright et al., 1996), a brain region necessary for the acquisition and consolidation of fear extinction (Herry et al., 2008; Laurent et al., 2008) but not for retrieval or expression of the fear extinction memory (Herry et al., 2008). It has been suggested, accordingly, that activity in the NAc is important for fear extinction (Holtzman-Assif et al., 2010; Whittle et al., 2013; Rodriguez-Romaguera et al., 2012). The mechanisms underlying such a function of the NAc remain unclear, however, and it is not known whether the NAc is implicated in the persistence of extinction memory, a critical therapeutic question. Based on evidence that the BLA is essential for many forms of motivated learning, including fear extinction and reward learning (Holtzman-Assif et al., 2010; LeDoux et al., 1990; Falls et al., 1992; Herry et al., 2006; Sotres-Bayon et al., 2007; Schoenbaum et al., 1998; Sugase-Miyamoto and Richmond, 2007; Kim et al., 2006b; Quirk et al., 1995; Bouton, 2002; Kelley et al., 2009; Gold et al., 2012; Belova et al., 2007; Paton et al., 2006; Uwano et al., 1995; Tye et al., 2008; Britt et al., 2012; Stuber et al., 2011), and that connections between the BLA and the NAc are important for generating goal-directed behavior in response to reward-predictive cues (Ambroggi et al., 2008; Wright et al., 1996; Britt et al., 2012; Stuber et al., 2011; Setlow et al., 2002; McDonald, 1991a; Di Ciano and Everitt, 2004; Johnson et al., 1994), we here asked whether fear extinction itself engages a BLA-NAc circuit in rodents and, if so, whether enhancing activity in this circuit during extinction training could reduce the return of fear at a remote time point.

Results

A BLA-NAc circuit is recruited by fear extinction

To test whether a BLA-NAc circuit is engaged by fear extinction, we first used a double-labeling strategy to search for NAc-projecting BLA neurons that could be activated by extinction training after fear conditioning. We labeled BLA neurons projecting to the NAc by infusing a fluorescent retrograde tracer, cholera toxin B (CTB) conjugated to Alexa fluor 488 (Conte et al., 2009), into the NAc to allow subsequent detection of labeled BLA-NAc projecting neurons (Figure 1). Approximately two weeks after surgery, rats were subjected to auditory fear conditioning followed by either (1) a brief auditory fear recall session (Fear recall group; Figure 1A) or (2) two sessions of auditory fear extinction training (Long ext group; Figure 1A), which promoted significant extinction learning and retention (Figure 1—figure supplement 1A–B). Three control groups were prepared as follows. In a Naïve group, rats were kept in their home cage (Figure 1A). In a Context group, rats were given standard auditory fear conditioning followed by two sessions of exposure to a novel context (Figure 1A). In a Tone group, rats were exposed to the same number of tones and context exposure as the Long ext group, but without experiencing the footshock US on Day 1 (Figure 1A).

Figure 1. The BLA-NAc circuitry is recruited during extinction of fear.

(A) Experimental design. (B) Coronal slices encompassing the BLA were stained for cFos protein and imaged, and the numbers of CTB+ cells (right panel in green), cFos+ nuclei (right panel in red) and double-labeled cells (right panel, white arrows indicate a subset of this population) were counted (Fear recall group: n = 21 from 3 rats; Long ext group: n = 23 from 4 rats; Context group: n = 12 from 4 rats; Tone group, n = 10 from 4 rats; Naïve group, n = 14 from 3 rats). The right side panel depicts an overlapping image of a Z-projection for each imaged channel. Scale bar on right panel indicates 10 µm; all other scale bars indicate 1 mm. (C) Number of cFos+ cells per µm3 in the BLA (main effect of group, p<0.0001). (D) BLA cells double-labeled for CTB and cFos, normalized to the total number of CTB+ cells (main effect of group, p<0.0001). 'n' represents the number of images analyzed. Statistical significance was calculated with Kruskal-Wallis followed by unpaired planned comparisons. All data are mean ± s.e.m. *p<0.05, ***p<0.001.

DOI: http://dx.doi.org/10.7554/eLife.12669.002

Figure 1.

Figure 1—figure supplement 1. Freezing behavior and retrograde labeling in the BLA.

Figure 1—figure supplement 1.

(A) Freezing behavior for the groups described in Figure 1. Fear to the tone was measured as the percent of time spent freezing during the first five trials of Tone 1 presentations on each behavioral session (main effect of group, p=0.0002). (B) Fear to the tone was measured as the percent of time spent freezing per trial for rats in the Ext recall group for the first 10 trials of each extinction session on Days 2 and 3 (main effect of day, p<0.0001). (C) Coronal slices encompassing the amygdala were imaged and numbers of CTB+ cells were counted. Number of CTB+ cells per µm3, in the BLA was calculated (main effect of group, p=n.s.). 'n' represents the number of animals. (D) An additional set of rats was trained as for the Long ext group, but sacrificed 1.5 hr after the end of the last behavior session. Coronal slices encompassing the BLA were stained for cFos protein and imaged, and the numbers of cFos+ nuclei were counted and plotted as the number of cFos+ cells per µm3 (main effect of group, p=0.0008. Statistical significance was determined by Kruskal-Wallis and paired planned comparisons (A), Wilcoxon test (B), Kruskal-Wallis (C), or the two-tail Mann-Whitney test (D). All data are mean ± s.e.m. **p<0.01, ***p<0.001.
Figure 1—figure supplement 2. The BLA-NAc circuitry is recruited during fear conditioning and extinction of fear.

Figure 1—figure supplement 2.

(A) Experimental design. (B) Fear to the tone was measured as the percent of time spent freezing during the first five trials of Tone 1 presentations in each behavioral session (one session per day, as indicated, main effect of day, p=0.04). (C–E) Coronal slices encompassing the BLA were stained for cFos protein and imaged, and the numbers of CTB+ cells, cFos+ nuclei, and double-labeled cells were counted. Fear cond group, n = 18 images from 3 rats; Short ext group, n = 26 sections from 4 rats; Long ext group, n = 10 from 3 rats; Naïve group, n = 15 sections from 4 rats. For the Fear cond group, additional coronal brain slices containing the BLA were taken from the rats described in Figure 1. These slices were stained and imaged with slices from the additional groups depicted here. (C) Number of cFos+ cells per µm3, in the BLA (main effect of group, p<0.0001). (D) BLA cells double-labeled for CTB and cFos, normalized to the total number of CTB+ cells (main effect of group, p<0.0001). (E) Number of CTB+ cells per µm3, in the BLA was calculated (main effect of group, p=0.003). (F) For rats in the Short ext and Long ext groups, sacrificed after identical behavioral sessions, a significant inverse correlation was found between the percent of BLA cells double-labeled for CTB and cFos and the percent of time spent freezing during the extinction session prior to sacrifice (p=0.02, each data point represents one rat). Statistical significance was calculated with Kruskal-Wallis followed by paired planned comparisons (A) or Kruskal-Wallis followed by unpaired planned comparisons (C–E) or (G, H). All data are mean ± s.e.m. *p<0.05, ***p<0.001.

Comparisons of the behavior of the rats on Day 2 (Figure 1—figure supplement 1A) showed that rats in the Fear recall and Long ext groups showed significantly higher levels of freezing than rats in the Context and Tone groups. Further, the Long ext group displayed substantial across-session extinction memory on the second session of extinction training (Figure 1—figure supplement 1B). The rats from all groups were perfused one hour after the final behavioral session, a time point corresponding to heightened cFos expression (Figure 1CFigure 1—figure supplement 1D), and immunohistochemistry for cFos was used to identify active BLA neurons (cFos+, Figure 1B). In the Fear recall group, this labeled the BLA neurons activated by fear memory recall, whereas in the Long ext group, this labeled the BLA neurons activated by fear memory recall, extinction memory recall, and additional fear extinction learning.

The rats subjected to fear conditioning and a fear recall test (Fear recall group) or fear conditioning and extinction training (Long ext group) exhibited far greater numbers of cFos+ BLA neurons than the control rats (Figure 1C). Furthermore, significantly greater numbers of cFos+ neurons were observed in the BLA after fear extinction training (Ext recall group) than in the Fear recall group after auditory recall test (Figure 1C).

A subpopulation of the cFos+ neurons were also retrogradely labeled from the NAc, identifying them as BLA neurons projecting to the NAc (CTB+) and activated by training (cFos+; Figure 1B right image; white arrows indicate double-labeled neurons). This population of double-labeled BLA neurons, as a percentage of all CTB+ neurons, was highly enriched in the rats that experienced extinction training (Figure 1D) relative to the numbers in all other experimental groups, in which we found only low levels of double-labeled neurons despite comparable densities of retrogradely labeled (CTB+) BLA neurons (Figure 1—figure supplement 1C). The double-labeled population of cells, although small relative to the total population of NAc-projecting BLA neurons (~5%), represented a substantial portion (31%) of the total cFos+ population in the BLA following extinction training. Consistent with previous studies showing that the BLA-NAc projection is heavy (McDonald, 1991a), in the BLA sections that we analyzed, 26.68 ± 1.81% of all BLA cells projected to the NAc. Thus, 5% of this significant projection is a large number of individual cells.

These data suggest that fear extinction produces stronger activation of the BLA, including NAc-projecting neurons, than fear expression. However, it is also possible that the lower cFos+ numbers found in the Fear recall group compared to the Long ext group were related to the length of the behavior session (7.8 min versus 31.1 min). To examine this, we tested an additional group of rats in which CTB was infused into the NAc; the rats were later subjected to auditory fear conditioning followed by only one session of fear extinction (Short ext group, 31.1 min; Figure 1—figure supplement 2A). The levels of freezing during the first extinction session (Figure 1—figure supplement 2B) and the density of cFos+ nuclei in the BLA (Figure 1—figure supplement 2C) were similar between rats in the Short ext and Long ext groups. However, the number of double-labeled cells was significantly higher after two extinction sessions (Long ext group) compared to one extinction session (Short ext group) (Figure 1—figure supplement 2D).

To determine whether the activation of the BLA-NAc pathway was specific to fear extinction, we ran an additional group of rats in which CTB was infused into the NAc. The rats were later exposed to auditory fear conditioning only (Fear cond group; Figure 1—figure supplement 2A). The rats in the Fear cond group displayed significantly higher numbers of cFos+ BLA neurons (Figure 1—figure supplement 2C) than rats in the Short ext and Long ext groups. Interestingly, the level of double-labeled cFos+ and CTB+ cells was not significantly different between the Fear cond and the Long ext groups (Figure 1—figure supplement 2D), despite the higher numbers of cFos+ BLA cells in the Fear cond group (Figure 1—figure supplement 2C).

This result raises the possibility that the BLA-NAc projection might contain a specialized circuit by which the ventral striatum can become activated during both fear conditioning and fear extinction learning. This possibility is supported by a strong negative correlation between activation of the BLA-NAc pathway and the strength of freezing during the extinction session (Figure 1—figure supplement 2F): greater recruitment of this pathway was associated with weaker fear memories.

Reward conditioning during fear extinction reduces the return of fear

Our finding that a BLA-NAc circuit is recruited by fear extinction (Figure 1), together with evidence that a BLA-NAc circuit is involved in reward-seeking (Britt et al., 2012; Stuber et al., 2011), suggested that reward-related activity in the NAc during fear extinction could reinforce extinction learning. We therefore tested whether reward conditioning, a manipulation that activates NAc neurons (Wan and Peoples, 2006; Day et al., 2006), would produce stronger extinction memory than fear extinction training alone (Figure 2A).

Figure 2. Tone-reward pairing during auditory fear extinction impedes the return of fear.

(A) Experimental design (Ext-Ext group, n = 18; Ext-RC group, n = 16). (B) Fear to the tone was measured as the percent of time spent freezing during Tone 1 trials within the first five trials of each behavioral session (one session per day, as indicated; main effect of group, p=n.s.; for Days 2 to 5: main effect of day, p<0.0001). (C) Reward learning was assessed by the latency to respond at the reward port after Tone 1 (reward paired tone for group Ext-RC, n = 16) and Tone 2 (neutral tone), for rats in the Ext-RC group (p<0.001) and rats in the Ext-Ext group (n = 18, p=n.s.). (D) Return of fear on Day 55 was calculated as the percent of time spent freezing in the first five trials of Tone 1 presentations of Day 55 normalized (per rat) to the percent of time spent freezing during the first five trials of Tone 1 presentations of Day 2 (p<0.01). (E) Plasma corticosterone levels from rats in the Ext-Ext and Ext-RC groups on Day 55 (n = 12 for Ext-Ext, n = 9 for Ext-RC; p<0.05). 'n' represents the number of animals. Statistical significance was calculated using the Wilcoxon paired test (C) or two-tail Mann-Whitney test (B,D,E) followed by planned paired comparisons (B). All data are mean ± s.e.m. *p<0.05, **p<0.01, ***p<0.001.

DOI: http://dx.doi.org/10.7554/eLife.12669.005

Figure 2.

Figure 2—figure supplement 1. Tone-reward pairing during auditory fear extinction impairs return of fear.

Figure 2—figure supplement 1.

(A) Normalized reward port entries during the first 5 tones of each type are depicted (main effect of group, p<0.01; due to equipment malfunction, n = 15 for Ext-Ext group on Day 4; for all other groups, n is as indicated in Figure 1). (B) Trial-by-trial fear to the tone on Day 55 is shown (main effect of group, p<0.001) for the first 10 trials. (C) The raw percent of time spent freezing during all Tone 1 presentations on Day 55 is shown (p<0.05). (D) The % fear memory for the last four trials of the fear extinction session to Tone 1 on Day 5 and all Tone 1 trials within the first five trials of the fear test with on Day 55 is plotted (main effect of group on Day 55, p<0.01; inset represents the difference between the % fear memory on Day 55 versus Day 5 for each group, p<0.05). (E) Normalized (p<0.001) reward port entries during tone presentations in the Day 55 fear recall test are shown for a subset of rats (Ext-Ext group: n = 16; Ext-RC group: n = 15). (F) For periods of lower fear (freezing values below 75%) the percent of time spent freezing for rats whose fear expression data is represented in Figure 2D was calculated for each 5 s interval during the first three trials of the fear memory test on Day 55 and plotted as cumulative distributions. For the Ext-RC group, the percent of time spent freezing within intervals where a reward port entry occurred was plotted separately from intervals without a reward port entry (no significant difference between the distribution of % freezing intervals with port entries or without port entries for Ext-RC). For the Ext-Ext group the percent of time spent freezing for intervals without a reward port entry was plotted (p<0.001 for comparison between the % freezing distributions for the Ext-Ext and Ext-RC groups for intervals without port entries). (G) For rats in the Ext-RC group, average freezing levels and total number of reward port entries during 30 sec intervals of the first three trials of the fear memory test on Day 55 were calculated. For the majority of intervals in which no port entries were displayed on Day 55, freezing levels were extremely high. This results in an overall negative correlation between reward port entries and freezing (p<0.0001). However, for intervals in which reward port entries were displayed, there was no relationship with the level of freezing behavior observed (p=0.57). 'n' represents number of animals. Statistical significance was calculated with the two-tail Mann-Whitney test (A–D), two-tail t-test for unpaired data (E), Kolmogorov-Smirnov test (F), or correlation analysis (G). All data are mean ± s.e.m. *p<0.05, ***p<0.001.
Figure 2—figure supplement 2. Fear expression is inhibited when reward is delivered during the recovery test.

Figure 2—figure supplement 2.

(A) Experimental design (Ext-Ext group: n = 18; Ext-RC group: n = 12). Rats were trained as in Figure 2, but the fear recall session was conducted with sucrose delivery following Tone 1 presentations. (B) Fear to the tone was measured as the percent of time spent freezing during the first five trials of Tone 1 presentation within each behavioral session (one session per day, as indicated; main effect of group p=n.s.; for Days 2 and 3: main effect of day, p<0.05). (C) Reward learning was calculated as the latency to respond at the reward port after Tone 1 (paired with the reward for Ext-RC group) or Tone 2 (never paired with reward). Left panel, p<0.01; Right panel, p=n.s. (D) Normalized (main effect of group, p<0.0001) reward port entries to Tones 1 and 2 on Days 4 and 5. Note that reward-seeking behavior occurred during both reward sessions on Days 4 and 5 but discriminative tone-induced nose-pokes occurred only during the second reward session on Day 5. (E) The % fear memory recall on Day 55 was calculated (per rat) as the % freezing on all Tone 1 trials within the first five trials of Day 55 normalized to the % freezing on the first five trials of Tone 1 presentation during Day 2 (p<0.0001). (F) Trial-by-trial freezing behavior (percent of time spent freezing) on Day 55 is shown (main effect of group, p<0.0001) for the first 10 trials (a mix of Tone 1 and Tone 2 presentations). (G) Fear to the tone was measured as the average percent of time spent freezing during all Tone 1 trials within the first five trials on Day 55 (p<0.0001). (H) The persistence of reward learning assessed on Day 55. Normalized (main effect of group, p<0.0001) nose-pokes are shown. 'n' represents number of animals. Statistical significance was calculated with two-tail Mann-Whitney test (B,D–H) followed by paired planned comparisons (B) or Wilcoxon paired test (C). All data are mean ± s.e.m. *p<0.05, **p<0.01, ***p<0.001.
Figure 2—figure supplement 3. Fear return is not affected by reward conditioning when the fear-associated and reward-associated tones are different.

Figure 2—figure supplement 3.

(A) Experimental design (Ext-RC Diff group, n = 3). (B) Reward learning was calculated as the latency to respond at the reward port after Tone 1 (neutral tone) and Tone 2 (reward paired tone for group Ext-RC tone 2) for rats in the Ext-RC Diff group (p<0.05). (C) Fear recall on Day 55 was calculated as the percent of time spent freezing on the first five trials on Day 55 normalized to the percent of time spent freezing on the first five trials on Day 2 (p=n.s.). Data for the Ext-Ext group is the same as presented in Figure 2D; data for the two groups was collected at the same time. 'n' represents number of animals. Statistical significance was calculated with the two-tail t-test for paired data (B) or two-tail Mann-Whitney test (C). All data are mean ± s.e.m. *p<0.05.

This procedure, in which a predictive cue becomes associated with an outcome of opposing valence, is termed counterconditioning. In patients with fear and anxiety disorders, exposure therapy is regularly administered by exposing patients to aversive cues in the absence of aversive outcomes and in limited instances, counterconditioning has been used to treat post-traumatic stress disorder (PTSD) by pairing fear-eliciting stimuli with the recollection of positive memories during exposure therapy (Paunović, 2003; Wolpe, 1958; Paunović, 2011). However the mechanism by which counterconditioning achieves therapeutic efficacy is completely unknown. We therefore tested the effects of counterconditioning not only on immediate fear recall but also on fear recall after a delay of nearly two months.

We trained rats with auditory fear conditioning and then followed the initial training either with exposure to four sessions of auditory fear extinction (Ext-Ext group), or with exposure to two sessions of auditory fear extinction followed by two sessions of fear extinction and discriminative reward conditioning (Ext-RC group). The two sessions of auditory fear extinction that preceded the two sessions of discriminative reward conditioning in the Ext-RC group allowed for the reduction of fear expression and initiation of exploratory behavior necessary for the acquisition of reward conditioning. During the discriminative reward conditioning, the tone that was originally paired with footshock was paired with sucrose delivery at a port on the chamber wall (Figure 2A), and, as a control, a second novel tone was presented without sucrose delivery. We assessed tone-elicited freezing behavior and reward-seeking behavior (nose-pokes in the reward port) both during reward conditioning and also 55 days after fear conditioning. This paradigm enabled us to determine the effect of reward conditioning during fear extinction on the persistence of long-term extinction memory, a critical yet unexplored assessment when considering the translational significance of counterconditioning in humans with anxiety and trauma-related disorders.

Rats in the two groups displayed comparable levels of tone-elicited freezing during fear conditioning and auditory fear extinction training (Figure 2B). On Days 4 and 5, only the rats that received reward conditioning (Ext-RC group) displayed discriminative tone-elicited reward responses (Figure 2C, Figure 2—figure supplement 1A). Long-term fear memory, measured 55 days after fear conditioning, was significantly lower in the Ext-RC group compared to the Ext-Ext group (Figure 2D, Figure 2—figure supplement 1B–D), despite the low overall number of reward port entries during the fear recall test on Day 55 (Figure 2—figure supplement 1E). Plasma corticosterone levels were also lower in the Ext-RC group, as compared to the Ext-Ext group, on Day 55 (Figure 2E), suggesting that the reduced fear recall on Day 55 in the Ext-RC group was accompanied by lower stress levels (Kelley et al., 2009).

The lower freezing observed in the Ext-RC group did not simply reflect reward-seeking behavior that masked conditional freezing. During the fear recall test on Day 55, freezing in the time bins during which a port entry occurred was not significantly different from freezing during time bins without port entries (Figure 2—figure supplement 1F). There was also no correlation between the number of reward port entries and the amount of freezing displayed (Figure 2—figure supplement 1G).

The lower freezing observed in the Ext-RC group also could not be attributed to consumption of sucrose (Figure 2—figure supplement 2). We ran an additional experiment to determine whether the tone-reward association formed during fear extinction (counterconditioning) would be preserved after several weeks and whether having sucrose present during the remote fear recall test would promote a greater decrease in fear (Ext-RC Group; Figure 2—figure supplement 2A). We assessed tone-elicited freezing behavior and reward-seeking behavior (nose-pokes in the reward port) during reward conditioning and also 55 days after fear conditioning (Figure 2—figure supplement 2A). During this remote test, the extinguished tone was paired with sucrose delivery for both groups, and the return of the original fearful memory was measured.

Rats in the two groups displayed comparable levels of tone-elicited freezing during fear conditioning and auditory fear extinction training (Figure 2—figure supplement 2B; Days 1–3). Similar freezing levels across the two groups were also observed on Days 4 and 5 (data not shown). On Days 4 and 5, only rats that received reward conditioning (Ext-RC group) displayed discriminative tone-elicited nose-pokes (Figure 2—figure supplement 2C–D). Rats that received only auditory fear extinction showed significant fear memory on Day 55 (in blue, Figure 2—figure supplement 2E–G), but rats that received fear extinction followed by reward conditioning, surprisingly, exhibited virtually no conditional freezing (in magenta, Figure 2—figure supplement 2E–G). Notably, for rats in the Ext-RC group, the discriminative responding on the reward task on Day 55 was as robust as on Day 5 (Figure 2—figure supplement 2H).

The lower freezing observed in the Ext-RC group also could not be attributed to the acquisition of a new rewarding association per se (Figure 2—figure supplement 3). To test whether it is specifically the reversal of the valence associated with the predictive tone that is critical for enhancing the persistence of auditory extinction memory, we performed an additional control experiment in which rats were trained with auditory fear conditioning followed by two sessions of auditory fear extinction and two sessions of reward conditioning, similar to the training regimen for the Ext-RC group. However, in contrast to the procedure for the Ext-RC group, during reward conditioning, the tone that was originally paired with footshock was presented in the absence of footshock, and a second, novel tone was paired with sucrose delivery (Figure 2—figure supplement 3A). Despite the successful discriminative reward learning in this group of rats (Figure 2—figure supplement 3B), the reward conditioning during extinction did not significantly change the return of fear when compared to rats that received only extinction training (Figure 2—figure supplement 3C). Thus simply consuming sucrose or forming a new reward association with a novel cue during fear extinction was not sufficient to enhance fear extinction memory.

These findings demonstrate (1) that shifting the associative value of a tone cue during extinction from aversive to rewarding is possible, and that the positive value can be preserved for many weeks, (2) that reward conditioning during fear extinction does not alter across-session acquisition of fear extinction, although it is possible that a potential enhancement of extinction learning could have been masked in our experiments by the overall low levels of freezing observed on Days 4 and 5 and (3) that enhancing activation of reward circuits during fear extinction via a behavioral counterconditioning manipulation leads to more persistent weakening of the original fear memory than fear extinction alone.

Reward conditioning during fear extinction promotes recruitment of a BLA-NAc circuit

We next tested whether the persistent reduction of fear return that we observed in the Ext-RC rats could reflect enhanced recruitment of the BLA-NAc circuit resulting from the reward training during fear extinction. We infused CTB conjugated to Alexa fluor 488 into the NAc of rats to retrogradely label BLA neurons projecting to the NAc (Figure 3A), and, after 11 to 14 days of recovery, we administered auditory fear conditioning followed either by three sessions of auditory fear extinction (Ext-Ext group) or by two sessions of auditory fear extinction and one session of reward conditioning combined with fear extinction (Ext-RC group). We also tested a control group trained on one session of reward conditioning without any aversive conditioning (RC group). Brains were taken for cFos immunolabeling of the BLA one hour after the final training session, and the proportion of BLA neurons projecting to the NAc (CTB+) that were activated during extinction training (cFos+) was determined by fluorescence confocal microscopy.

Figure 3. Recruitment of a BLA-NAc circuit is greater following fear extinction with reward conditioning than fear extinction alone.

(A) Experimental design. Coronal slices encompassing the amygdala were stained for cFos protein and imaged, and numbers of CTB+ cells, cFos+ nuclei and double-labeled cells were counted (Ext-Ext group, B and C: n = 22 from 3 rats, E: n = 15 from 4 rats; Ext-RC group, B and C: n = 21 from 5 rats, E: n = 11 from 3 rats; RC group, B and C: n = 24 images from 3 rats, E: n = 19 images from 5 rats). (B) BLA cells double-labeled for CTB and cFos, normalized to the total of CTB+ cells (p<0.05; inset p=n.s.). (C) Number of cFos+ cells per µm3 in the BLA (top panel, p=0.07; inset p=n.s.). Representative images for data shown on panels B and C (bottom panel). (D) Coronal slices encompassing the NAc were stained for Nr4a3 protein and for nuclei (DAPI) and imaged, and numbers of Nr4a3+ nuclei were counted. A Z-projection of each imaged channel is represented. Scale bar represents 10 μm. (E) Number of Nr4a3+ cells per µm3, in the NAc (p<0.001; inset p=n.s). 'n' represents the number of images analyzed. Statistical significance was calculated with two-tail t-test for unpaired data (B, C inset) or two-tail Mann-Whitney test (B inset, C, E, E inset). All data are mean ± s.e.m. *p<0.05, ***p<0.001.

DOI: http://dx.doi.org/10.7554/eLife.12669.009

Figure 3.

Figure 3—figure supplement 1. Freezing and reward behavior and labeling densities in the BLA.

Figure 3—figure supplement 1.

(A) Fear to the tone was measured as the percent of time spent freezing during the first five trials of Tone 1 presentations in each behavioral session (one session per day, as indicated, main effect of group, p=n.s.; for Days 2 to 4: main effect of day within each group, p<0.05) (Ext-Ext group: n = 7; Ext-RC group: n = 8). (B, C and D) Reward learning was calculated as the latency to respond at the reward port after Tone 1 (Tone 1 was the reward-paired tone for panels C and D; Tone 1 was presented in the absence of reward for panel B) and Tone 2 (neutral tone) for the Ext-Ext group (B, n = 7), Ext-RC group (C, n = 8) and RC group (D, n = 8). Groups Ext-RC and RC displayed reward-seeking behavior without discriminative reward learning (main effect of tone, p=n.s.). (E) Coronal slices encompassing the amygdala were imaged and number of CTB+ cells per µm3 of the BLA was calculated (Ext-Ext group, n = 22 images from 3 rats; Ext-RC group, n = 21 images from 5 rats; RC group n = 24 from 3 rats; main effect of group, p=n.s.). (F) Rats were infused with AAV-ChETA-eYFP in the amygdala. Anesthetized rats were subjected to 25 trials of stimulation of amygdala terminals within the NAc with 473 nm laser light for five second periods, per trial (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). Coronal slices encompassing the NAc were stained for Nr4a3 protein, imaged, and counts of Nr4a3+ nuclei were performed. The number of Nr4a3+ cells per µm3 in the NAc was calculated and compared to Nr4a3 expression in the two groups from Figure 3E (AAV-ChETA-eYFP, n = 8 from 3 rats; main effect of group, p<0.0001). 'n' represents the number of animals (A–D) or the number of images analyzed (E). Statistical significance was determined by Wilcoxon paired test (B,C), two-tail t-test for paired data (D), two-tail t-test for unpaired data (E), two-tail Mann-Whitney test followed by paired planned comparisons (A, inset E) and Kruskal-Wallis test (F) followed by planned comparisons. All data are mean ± s.e.m. *p<0.05, **p<0.01.
Figure 3—figure supplement 2. Microarray analysis of the NAc after reward conditioning in rats.

Figure 3—figure supplement 2.

(A) Experimental design (RC group: n = 18; Naïve group, n = 18). One hour after the end of the second behavioral session, NAc tissue was collected and used to extract total mRNA. mRNA was combined to generate three independent pooled samples (n = 6 per pooled sample) and used for gene array analysis. (B) Reward learning was calculated as the latency to respond at the reward port after Tone 1 (reward paired tone) and Tone 2 (neutral tone) (p<0.001). (C) Average Nr4a3 mRNA fold change in the NAc (top panel, p<0.05) and Nr4a3 mRNA probe fluorescence intensity value (bottom panel) for Naïve (n = 3) and RC (n = 3) groups. (D) Average cFos mRNA fold change in the NAc (p=n.s.). 'n' represents the number of animals (B) or the number of pooled mRNA samples (C and D). Statistical significance was determined by Wilcoxon paired test (B) or two-tail t-test for unpaired data (C), two-tail Mann-Whitney test (D). All data are mean ± s.e.m. *p<0.05, ***p<0.001.
Figure 3—figure supplement 3. Density of Nr4a3 labeling in the NAc after behavioral training.

Figure 3—figure supplement 3.

In addition to the groups shown in Figure 3, some rats were used as home cage controls (Naïve group). Immunostaining of coronal brain sections containing the NAc (Ext-Ext group: n = 16 sections from 4 rats; Ext-RC group, n = 12 sections from 3 rats; Naïve group: n = 16 sections from 4 rats) was performed. Number of Nr4a3+ cells per µm3, in the NAc is shown (main effect of group, p<0.0001). Statistical significance was determined by Kruskal-Wallis test followed by planned comparisons. All data are mean ± s.e.m.

Extinction during the days following fear conditioning (Days 2–4) was again similar between the Ext-Ext and Ext-RC groups (Figure 3—figure supplement 1A). Also as expected, rats in both the Ext-RC and RC groups, which were trained on reward conditioning, displayed reward-seeking behavior, but such behavior was not observed in the Ext-Ext group (Figure 3—figure supplement 1B–D). We found significantly more BLA neurons that project to the NAc [neurons double-labeled for cFos and CTB (as a percentage of CTB+ neurons)] in the Ext-RC group (Figure 3B) as compared to the Ext-Ext group, despite similar densities of CTB+ cells in the BLA in the two groups (Figure 3—figure supplement 1E). Notably, the proportion of BLA neurons double-labeled for cFos and CTB (Figure 3B, inset) were similar in the Ext-RC and the RC group that only received reward conditioning. Also, there was a strong trend for higher numbers of cFos+ neurons in the BLA in the Ext-RC group as compared to the Ext-Ext group (Figure 3C), but this did not reach statistical significance.

These results demonstrate that the activity of the BLA and the BLA-NAc circuit is increased by reward conditioning during fear extinction, and that this activity is comparable to the levels observed following reward conditioning alone. Moreover, our results also show that reward conditioning combined with fear extinction increases the proportion of activated BLA neurons that project to the NAc, relative to the levels observed following fear extinction training alone. These findings enhance previous findings showing that the BLA itself participates in the acquisition and consolidation of fear extinction (Herry et al., 2008; Laurent et al., 2008) by demonstrating that the activity of a BLA-NAc circuit is increased by reward conditioning during fear extinction acquisition.

To compare the levels of recruitment of NAc neurons during fear extinction combined with reward conditioning to recruitment levels during fear extinction alone, we performed immunostaining for the transcription factor, Nr4a3, to assess activity of neurons in the NAc (Figure 3D) (Hawk and Abel, 2011; Werme et al., 2000). Using microarray analysis, we found that Nr4a3, but not cFos, was rapidly induced in the NAc by tone-reward association (Figure 3—figure supplement 2). Additionally, cFos immunolabeling in the NAc of rats that experienced fear extinction and/or reward conditioning did not yield detectable immunostaining (not shown), in contrast with the consistent immunostaining of cFos in other brain regions (Figures 1, 3, and 6). Immunostaining (Figure 3E) showed significantly higher numbers of Nr4a3+ cells in the NAc of rats in the Ext-RC group than in the NAc of rats in the Ext-Ext group. Furthermore, both the Ext-Ext and the Ext-RC groups showed significantly higher density of Nr4a3+ cells in the NAc as compared to the Naïve group (Figure 3—figure supplement 3). Notably, reward conditioning combined with fear extinction and reward conditioning alone produced similar densities of Nr4a3+ nuclei (Figure 3E, inset). These results suggest that reward conditioning during fear extinction recruited the NAc more effectively than fear extinction training alone.

Anatomically-selective activation of a BLA-NAc circuit during extinction learning reduces the return of fear

Our evidence that a BLA-NAc circuit is activated by fear extinction raised the possibility that this circuit plays a causal role in facilitating the acquisition of long-term fear extinction memory. We addressed this issue directly by pairing optogenetic stimulation of BLA terminals in the NAc with tone presentations during extinction training (Figure 5B). To establish the feasibility of this approach, we first infused either an adeno-associated virus (AAV; serotype 9) expressing channelrhodopsin fused to enhanced yellow fluorescent protein (eYFP; ChETA-eYFP) or, as a control, a similar AAV expressing eYFP alone into the amygdala. After one month to allow anterograde expression of the virus, we used confocal imaging to analyze the distribution of the ChETA-eYFP or eYFP proteins in the BLA and NAc. We found eYFP expressed broadly in both brain regions, indicating successful expression and transport of the protein (Figure 4A). To test whether ChETA-eYFP was expressed in the presynaptic terminals of BLA neurons projecting to the NAc, we double-labeled NAc sections for eYFP (Figure 4B, in green) and synaptophysin, a marker for presynaptic terminals (Figure 4B, in red). ChETA-eYFP expression exhibited overlap with synaptophysin staining (Figure 4B, white arrows). This result confirmed that BLA axons projecting to the NAc form direct synaptic connections with NAc neurons, and that the ChETA-eYFP protein was appropriately located to enable us to activate selectively in the NAc the terminals of axons originating in the BLA.

Figure 4. Optogenetic stimulation of amygdala presynaptic terminals projecting to NAc.

Figure 4.

(A) Expression of ChETA-eYFP (left) and DAPI (right) in the BLA and NAc of rats infused with AAV-ChETA-eYFP in the amygdala. Scale bar represents 1 mm. (B) Expression of ChETA-eYFP in presynaptic terminals in the NAc was confirmed by immunolabeling of ChETA-eYFP and synaptophysin, as indicated. White arrows indicate overlapping staining. Scale bars represent 1 μm. (C) Schematic representation of the light stimulation parameters used for in vivo recordings. (D, E) In vivo recordings from the NAc of anesthetized rats infused with AAV-ChETA-eYFP or AAV-eYFP in the amygdala and implanted with fiber optics above the NAc. Optic fibers delivered 473 nm light stimulation for 5 s periods (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). Multiunit activity (MUA) was recorded during the 5 s of stimulation and was compared with the 5 s that preceded and followed the laser stimulation. (D) Example MUA at recording sites expressing ChETA-eYFP. (E) Average firing rate over multiple recording sites in the NAc expressing ChETA-eYFP (green, n = 20; 3 rats) or eYFP (blue, n = 16; 3 rats). Firing rate was normalized to pre-stimulation activity for each recording site (main effect of group, p<0.0001). 'n' represents the number of recording sites sampled. Statistical significance was calculated with Kruskal-Wallis followed by paired planned comparisons. All data are mean ± s.e.m. ***p<0.001.

DOI: http://dx.doi.org/10.7554/eLife.12669.013

To determine whether stimulation of these presynaptic BLA terminals could activate NAc neurons, we implanted optical fibers above the NAc of rats expressing AAV-ChETA-eYFP or control AAV-eYFP virus in the amygdala. We recorded multiunit activity in the BLA and the NAc of anesthetized rats during 5 s periods before, during and after the laser stimulation period (473 nm light stimulation with 10–20 mW, 20 Hz, 5 ms pulses at 1 min intertrial intervals; Figure 4C).

In agreement with previous observations (Britt et al., 2012), this pattern of stimulation was sufficient to elicit an increase in neuronal activation in the NAc when AAV-ChETA-eYFP was expressed (Figures 4D–E), but not when the control AAV-eYFP, lacking opsin, was expressed (Figure 4E). This stimulation also increased the number of Nr4a3+ cells in the NAc, as compared to the numbers in rats that underwent fear extinction without stimulation (AAV-ChETA-eYFP vs. Ext-Ext, Figure 3—figure supplement 1F). This increase of Nr4a3+ cells in the NAc indicates that stimulation of the BLA terminals in the NAc resulted in increased activity of NAc neurons.

To determine whether the optogenetic stimulation of this BLA-NAc circuit could enhance fear extinction memories, we then paired the optogenetic stimulation with fear extinction, following the same timeline in which reward conditioning enhanced the effects of fear extinction (Figure 5A). We bilaterally infused into the amygdala an AAV (serotype 9) expressing either ChETA-eYFP or eYFP alone, and implanted two optic fibers bilaterally targeting the NAc of these rats (Figure 5A, Figure 5—figure supplement 1B). One month later, the rats received auditory fear conditioning followed by two sessions of auditory fear extinction training, and two additional auditory fear extinction sessions in which we administered light stimulation for 5 s after the termination of each tone (10–20 mW, 473 nm, 20 Hz, 5 ms pulses, 65 s interstimulation interval; Figure 5A–B). This pattern of stimulation, previously shown to promote self-stimulation in mice (Stuber et al., 2011), did not enhance place preference in our rats (Figure 5—figure supplement 1A–B), suggesting that it was not inherently rewarding in our experimental setting. However, we found that the stimulation protocol did promote reward-seeking (Figure 5—figure supplement 1C–E).

Figure 5. Optogenetic stimulation of the amygdala-NAc circuit during extinction of fear impairs the return of fear.

(A) Experimental design (eYFP, n = 9; ChETA-eYFP, n = 4). (B) The timing of each pulse of light delivery is depicted. (C) Fear to the tone was measured as the percent of time spent freezing during the first five tone presentation trials of each behavioral session (main effect of group, p=n.s.; for Days 2 to 5: main effect of day, p<0.05). (D) Fear return on Day 60 was calculated as the percent of time spent freezing on the first five tone presentation trials on Day 60 normalized (per rat) to the percent of time spent freezing on the first five tone presentations on Day 2 (p<0.05). 'n' represents the number of animals. Statistical significance was determined by two-tail t-test for unpaired data (C) and two-tail Mann-Whitney test (B). All data are mean ± s.e.m. *p<0.05.

DOI: http://dx.doi.org/10.7554/eLife.12669.014

Figure 5.

Figure 5—figure supplement 1. Optogenetic stimulation of amygdala-NAc circuitry can promote reward seeking.

Figure 5—figure supplement 1.

(A) Rats were allowed to freely explore a two-chamber box on Day 1. On Day 2, rats were placed in one side of the chamber while receiving BLA-NAc optogenetic stimulation (5 ms pulses, 20 Hz for 5 s every 20–30 s). Immediately following this, each rat was placed on the other side of the box in the absence of stimulation. On Day 3, rats were again permitted to freely explore the two-chamber box. Average place preference score for each group is shown (AAV-eYFP, n = 5; AAV-ChETA-eYFP, n = 3; group effect, p=n.s.). (B) Location of fiber optic tips in the NAc of rats used for the experiment depicted in panel A (circles and squares represent AAV-eYFP and AAV-eYFP-ChETA infection, respectively). (C and D) Rats were trained to nose-poke for delivery of a reward solution at either an active port (nose-poke produced BLA-NAc optogenetic stimulation for 5 ms pulses, 20 Hz for 5 s) or an inactive port (nose-poke did not lead to laser stimulation). (C) Average cumulative reward port entries made during the behavioral session (AAV-eYFP, n = 4; AAV-ChETA-eYFP, n = 3). (D) Left, Reward port entries for rats infused with AAV-eYFP (n = 4) (main effect of stimulation, p=n.s.). Right, Reward port entries for rats infused with AAV-ChETA-eYFP (n = 3); main effect of stimulation, p<0.05). (E) Location of fiber optic tips in the NAc of rats used in experiment depicted in panels C and D (circles and squares represent AAV-eYFP and AAV-eYFP-ChETA infection, respectively). 'n' represents the number of animals. Coronal brain images from Figures 13–18 and 20 in Paxinos and Watson (2005). Statistical significance was determined by two-tail t-test for unpaired (A) or paired (C,D) data. All data are mean ± s.e.m. *p<0.05.
Figure 5—figure supplement 2. Optogenetic stimulation of amygdala-NAc circuitry during extinction of fear impairs later fear recall.

Figure 5—figure supplement 2.

(A) Location of fiber optic tips in the NAc [circles and squares represent AAV-eYFP (n = 9) and AAV-eYFP-ChETA (n = 4) groups, respectively]. (B) Average percent of time spent freezing during the 6 s before tone presentation (no laser stimulation) and the 6 s after tone presentation (including the laser stimulation period; main effect of stimulation and Group x Stimulation interaction, p=n.s.). (C) Average percent of time spent freezing during the first five tone presentations of the fear recall test on Day 60 is shown (p<0.05). Coronal brain images adapted from Figures 13–15, 17–18 and 20 in Paxinos and Watson (2005). 'n' represents the number of animals. Statistical significance was determined by two-tail t-test for unpaired data (B) or ANOVA (A). All data are mean ± s.e.m. *p<0.05.

While there were many potential time points at which we could have investigated the impact of stimulation on fear extinction and its persistence, several factors led us to select the time point described. We chose the time for laser stimulation to be immediately after the tone offset in order to match the timing of sucrose consumption by the rats in the Ext-RC group (Figure 2A). We chose to apply the laser stimulation during the last two of the four extinction sessions because this late stage corresponded to the time points at which we found that reward counterconditioning reduced the subsequent return of fear (Figure 2D, Figure 2—figure supplement 1B–C and Figure 2—figure supplement 2E–G). Finally, we tested fear memory recall 60 days after fear conditioning in order to determine whether enhancing activity in the BLA-NAc circuit during fear extinction acquisition could alter the persistence of extinction memory over weeks.

The ChETA-eYFP and eYFP-only groups acquired equivalent levels of fear conditioning and extinction learning (Figure 5C; Days 1–5). We observed no immediate effects of the laser treatment during the two sessions of training when light stimulation followed tone presentation (Figure 5—figure supplement 2A–B). Strikingly, when we tested the rats again, without further experimental intervention 60 days after fear conditioning, the rats that had received optogenetic stimulation of the ChETA-eYFP-expressing BLA terminals in the NAc exhibited significantly reduced freezing behavior relative to control rats expressing eYFP alone (Figure 5D and Figure 5—figure supplement 2C). These results demonstrate that activation of the BLA-NAc circuit during fear extinction can significantly reduce the return of fear at a remote time point without affecting the acquisition of fear extinction, thus providing causal evidence that activity in the specialized BLA-NAc circuit promotes the persistence of fear extinction memory.

Activation of a BLA-NAc circuit increases activity in the infralimbic cortex but not in the BLA

The prelimbic (PL) and infralimbic (IL) areas of the medial prefrontal cortex (mPFC) are known to modulate fear, with the PL promoting fear learning and the IL promoting fear extinction (Sotres-Bayon and Quirk, 2010; Senn et al., 2014). If BLA-induced activation of the NAc led to circuit-level effects, these cortical regions might themselves be affected by terminal stimulation of BLA-NAc afferents. To test for such potential effects, we used cFos immunolabeling to estimate potential activation of these cortical regions (Figure 6A). Because the projections from the BLA to the NAc are predominantly ipsilateral (Christie et al., 1985), we stimulated the BLA terminals in the NAc of one hemisphere in anesthetized rats [10–20 mW, 473 nm, 20 Hz, 5 ms pulses, 65 s interstimulation interval, matching the parameters of the prior experiment in which optogenetic stimulation was administered during fear extinction (Figure 5)] (Figure 6—figure supplement 1) but visualized immunolabeling bilaterally to compare the effects of stimulation on the ipsilateral and contralateral mPFC. The IL ipsilateral and contralateral to the stimulation site had significantly higher numbers of cFos+ cells than found in naïve rats (Figure 6C). This cFos activation was especially pronounced in the ipsilateral IL (Figure 6C). In the PL, the number of cFos+ cells was significantly greater ipsilateral, but not contralateral, to the side of stimulation, relative to the naïve controls, (Figure 6D) though the overall magnitude of activation was much lower than that observed in the IL. These results suggested that BLA-NAc stimulation can result in activation of the medial wall cortex, especially the IL, and, to a lesser extent, the adjoining PL.

Figure 6. Optogenetic stimulation of an amygdala-NAc circuit or reward conditioning during fear extinction increases activity in IL.

(A–D,G,H) Rats were infused with AAV-ChETA-eYFP in the amygdala. Anesthetized rats were subjected to 25 trials of stimulation of amygdala terminals within the NAc with 473 nm laser light for five-second periods, per trial (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). (A, C, D) Coronal slices encompassing the infralimbic (IL) and prelimbic (PL) cortex were stained for cFos protein. (A) Representative image of cFos staining in the IL and PL. (B) Some rats also received infusion of muscimol-bodipy into the NAc. Representative image of muscimol-bodipy infusion in the NAc. (C, D) Numbers of cFos+ cells (Naïve, C: n = 14, D: n = 18, from the same 3 rats presented in Figure 1C; AAV-ChETA-eYFP contralateral to the stimulation site, C: n = 9, D: n = 10 from 5 rats; AAV-ChETA-eYFP ipsilateral to the stimulation site, C: n = 10, D: n = 10, from 5–6 rats; AAV-ChETA-eYFP + Muscimol, ipsilateral to the stimulation site, C: n = 15 from 3 rats) were counted and plotted per µm3. (E, F) Coronal slices encompassing the IL and PL from animals trained as indicated in Figure 3A, were stained for cFos protein and numbers of cFos+ cells were counted and plotted per µm3 (Ext-RC group, E: n = 14 from 5 rats, F: n = 12 from 5 rats; Ext-Ext, E: n = 11 from 3 rats, F: n = 9 from 3 rats). (G, H) Coronal slices encompassing the amygdala were stained for cFos protein (Naïve, n = 34 different slices from the same 3 rats presented in Figure 1C; AAV-ChETA-eYFP contralateral to the stimulation site, n = 18 from 4 rats; AAV-ChETA-eYFP ipsilateral to the stimulation site, n = 21 from 4 rats). Numbers of cFos+ cells (G), cFos+ and eYFP+ (H), and cFos+ and eYFP− cells (H) were counted in the BLA ipsilateral (n = 21 from 4 rats) and contralateral to the NAc stimulation site (H: n = 18 from 4 rats) and plotted per µm3, in the BLA. 'n' represents the number of images analyzed (C–H). Scale bar represents 10 µm (A) or 1 mm (B). Statistical significance was calculated with two-tail Mann-Whitney test (E, F, H), Kruskal-Wallis test followed by the Mann-Whitney test (C, F, G). All data are mean ± s.e.m.

DOI: http://dx.doi.org/10.7554/eLife.12669.017

Figure 6.

Figure 6—figure supplement 1. Location of fiber optic tips in rats receiving BLA-NAc optogenetic stimulation while anesthetized.

Figure 6—figure supplement 1.

Rats (in experiments depicted in Figure 6, Figure 3—figure supplement 1F and Figure 6—figure supplement 2C) were infused with AAV-ChETA-eYFP in the amygdala and implanted with fiber optics above the NAc. They were subsequently anesthetized and the optic fibers delivered 473 nm light stimulation for 5 s periods (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). Coronal brain images were adapted from Figures 14–17 and 20 in Paxinos and Watson (2005).
Figure 6—figure supplement 2. Optogenetic stimulation of BLA presynaptic terminals projecting to NAc in anesthetized rats.

Figure 6—figure supplement 2.

(A) Location of fiber optic tips and recording sites in the NAc and recording sites in the BLA (open and filled circles represent AAV-eYFP and AAV-eYFP-ChETA infection, respectively). Coronal brain sections were adapted from Figures 13–14, 18, 53–54, and 58–60 in Paxinos and Watson (2005). (B) In vivo recordings from the BLA of anesthetized rats infused with AAV-ChETA-eYFP or AAV-eYFP in the amygdala and implanted with fiber optics above the NAc. Optic fibers delivered 473 nm light stimulation for 5 s periods (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). Multiunit activity was assessed during the 5 s of stimulation and compared with the 5 s that preceded and followed the laser stimulation. Average firing rate over multiple recording sites in the BLA expressing ChETA-eYFP (n = 11; 3 rats), as indicated. Firing rate in each location was normalized to pre-stimulation activity (main effect of time, p=n.s.). (c) Rats were infused with AAV-ChETA-eYFP in the amygdala. Anesthetized rats were subjected to 25 trials of stimulation of amygdala terminals within the nucleus accumbens with 473 nm laser light for 5 s periods, per trial (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). Coronal slices encompassing the amygdala were stained for cFos protein and numbers of cFos+ cells in BLA were counted. Number of cFos+ cells per µm3 in the BLA is shown (AAV-ChETA-eYFP, n = 15 from 3 rats). Data for the Naïve group is the same as presented in Figure 1C (main effect of group, p=n.s.). 'n' represents the number of recording sites sampled (B) or the number of images analyzed (C). Statistical significance was calculated with the Friedman test (B) or two-tail Mann-Whitney test (C). All data are mean ± s.e.m.

To determine whether activity in the NAc is necessary for the BLA-NAc stimulation-induced activation of the IL, we temporarily inactivated the NAc prior to optogenetic stimulation. Anesthetized rats received bilateral intra-NAc infusion of muscimol-bodipy (Figure 6B) 20–40 min before bilateral stimulation of the BLA-NAc (10–20 mW, 473 nm, 20 Hz, 5 ms pulses, 65 s interstimulation interval). Muscimol infusion significantly reduced the number of cFos+ cells in the IL, as compared to the number observed following stimulation in the absence of muscimol (Figure 6C). Altogether, these results indicated that BLA-NAc stimulation results in activation of the IL, which is mediated, at least in part, by activity within the NAc.

Given our evidence that the BLA-NAc circuit is especially activated when reward conditioning was paired with extinction training, we next asked whether reward conditioning during fear extinction could also result in increased activity in the IL. We performed cFos immunolabeling of sections containing the mPFC from rats in the Ext-Ext and Ext-RC groups from Figure 3A. We found significantly higher numbers of cFos+ neurons in the IL in the Ext-RC group than in the Ext-Ext group (Figure 6E), and we did not observe a difference in the PL (Figure 6F).

These results suggest that activation of the BLA-NAc circuit results in activation of the IL, a brain region widely implicated in fear extinction learning (Sotres-Bayon and Quirk, 2010), and that this BLA-NAc circuit activation affected the PL, implicated in fear learning, to a lesser degree. These findings raise the possibility that activation of the NAc during fear extinction may facilitate the recruitment of a cortical brain circuit that promotes the decrease of long-term fear expression.

Targeting terminals of BLA neurons in the NAc could also lead to antidromic activation of the BLA itself. We tested for this possibility by performing in vivo recordings and cFos immunostaining in the BLA of anesthetized rats in which we optogenetically stimulated BLA terminals in the NAc expressing ChETA-eYFP (Figure 6—figure supplement 2A). This stimulation did not alter multiunit activity in the BLA ipsilateral to the stimulation site in the NAc (Figure 6—figure supplement 2B). Since the projections from the BLA to the NAc are predominantly ipsilateral (Christie et al., 1985), we stimulated the terminals from the BLA to the NAc unilaterally and imaged bilaterally to compare the effects of stimulation in the ipsilateral and contralateral BLA. The number of cFos+ cells in the BLA ipsilateral to the BLA-NAc optogenetic stimulation site was not significantly different from the BLA in naïve rats (Figure 6—figure supplement 2C), nor was it significantly different in the BLA contralateral to the stimulation site (Figure 6G). This result indicates that the stimulation we used does not significantly activate BLA neurons. However, it is possible that this stimulation results in selective antidromic activation of BLA neurons that express ChETA-eYFP.

To test this hypothesis, we used a double-labeling strategy to search for BLA neurons that were active (cFos+) and that express ChETA-eYFP (eYFP+). The number of cells double-positive for cFos and eYFP in the BLA was similarly low in the BLA ipsilateral to the stimulation site as compared to the BLA contralateral to the stimulation site (Figure 6H). Also, we did not observe selective activation of BLA cells that express ChETA-eYFP (eYFP+): the number of cFos+ and eYFP+ double-positive cells was not higher than the cells that were both cFos+ and eYFP- in the BLA (Figure 6H).

In summary, we found no change in the firing rates of BLA neurons, nor changes of cFos labeling in the BLA during optogenetic stimulation of a BLA-NAc circuit. These results indicate that we likely achieved activation of the BLA-NAc projection terminals without major alterations of spike activity in the BLA.

Discussion

We found that a BLA-NAc pathway is activated by fear conditioning and fear extinction training. The enhanced recruitment of this circuit during extinction learning, achieved either by pairing reward with fear extinction training or by optogenetic stimulation of this circuit during fear extinction, increases the activation of the IL and reduces the return of fear months after fear extinction.

While activation of this pathway by extinction training scales proportionally with activation of the BLA by extinction training (Figure 1), additional findings also bolster the claim that extinction training recruits the BLA-NAc circuit. The recruitment of this pathway by extinction is strongly related to the degree of extinction (Figure 1—figure supplement 2) and activation of the BLA-NAc projection deepens long-term extinction memory (Figure 5). If activation of the BLA-NAc pathway was simply the result of chance, then one would not expect to observe a relationship between the magnitude of extinction learning and activation within this pathway.

This evidence provides support for the proposal that fear extinction may engage an opponent-process reward system (Luo et al., 2015), as suggested by studies in human subjects in which ventral striatum activations were observed on trials on which the aversive stimulus (shock) was omitted in fear extinction sessions (Raczka et al., 2011). Exposure therapy combined with recall of pleasant memories has been successfully used to treat PTSD (Hawk and Abel, 2011), but the mechanism by which this method achieves therapeutic efficacy and the relative efficacy of this treatment as compared to exposure therapy are not known. Previous rodent studies have tested the effect of reward conditioning on avoidance behavior shortly after fear extinction (24 hr), but these studies have yielded conflicting results (Nelson, 1966; Richardson et al., 1982) and did not address long-term fear recall at remote time points. We found here that long-term spontaneous recovery of fear was significantly reduced when rats received reward conditioning combined with fear extinction, as compared to rats that received only extinction training following fear conditioning.

It may seem counterintuitive that the BLA-NAc pathway is similarly activated by the opposing behaviors induced by fear conditioning and fear extinction (Figure 1—figure supplement 2D). One possibility is that fear conditioning and fear extinction activate valence-segregated populations of NAc-projecting cells within the BLA (Correia and Goosens, 2016). However, our observations that indiscriminate optogenetic stimulation of BLA terminals in the NAc promotes reward-seeking (Figure 5—figure supplement 1D) and the weakening of fear memory (Figure 5D) suggests that if such valence segregation exists, appetitive subcircuits dominate, consistent with previous studies (Namburi et al., 2015). An alternative possibility is suggested by the observation that cFos expression is induced by both synaptic strengthening and synaptic weakening (Lindecke et al., 2006; Kemp et al., 2013). By this logic, cFos-related activation of the BLA-NAc pathway by fear conditioning may indicate synaptic weakening within the BLA-NAc circuit. Although activation of the BLA-NAc pathway is not selective for fear extinction, our data nonetheless support an important and novel role for this pathway in the long-term reduction of fear memory.

Neither reward conditioning during fear extinction nor optogenetic activation of the BLA-NAc circuit during fear extinction led to changes in across-session acquisition of fear extinction on Days 4 and 5, although it is possible that the overall low levels of freezing observed on Days 4 and 5 could make such a difference difficult to detect. However, both manipulations result in a significant reduction of fear expression two months after fear conditioning. Little is known about how fear recovers across time after extinction; future studies aimed at understanding this complex process and the BLA-NAc circuit effects on limbic networks could help to understand the efficacy of fear extinction-based treatments in humans.

The magnitude of the effects reported here are similar to those observed following manipulations of the IL region highlighted by our findings and known to regulate fear extinction memory (Sotres-Bayon and Quirk, 2010). The decrease in fear recall observed in rats that experience fear extinction with reward conditioning is comparable to the decrease of fear recall in animals subjected to microstimulation of the IL during fear extinction: in previous studies, IL activity was positively correlated with fear extinction recall (Milad and Quirk, 2002). We found here that optogenetic stimulation of the BLA-NAc circuit and also reward conditioning in combination with fear extinction lead to increases in activity, measured by cFos expression, in IL as well as in NAc itself, suggesting that these two brain regions may cooperate to decrease fear expression through mechanisms yet to be fully understood.

We did not find the optogenetic stimulation of BLA terminals in the NAc to be inherently rewarding (Figure 5—figure supplement 1A), as shown in previous experiments in mice (Britt et al., 2012; Stuber et al., 2011). One possibility is that the optogenetic stimulation we applied targeted a smaller or specialized part of the NAc: the estimated volume of NAc in the rat is more than double that of the mouse, and the NAc is a heterogeneous structure. We did find, however, that stimulation of the BLA-NAc projection can increase reward-seeking (Figure 5—figure supplement 1C–D), which is consistent with the idea that the BLA-NAc circuit exerts a reward-related modulatory effect upon emotional learning.

Our findings demonstrate that the administration of reward conditioning during fear extinction training also reduces the return of fear memory approximately two months after fear conditioning. We show that such enhancement of the enduring reduction of fear could be induced by the engagement of the BLA-NAc circuit during fear extinction training. Connections from the BLA to the NAc have already been recognized as important for generating goal-directed behavior in response to appetitive cues (Ambroggi et al., 2008; Ghitza et al., 2003; Wan and Peoples, 2006; Day et al., 2006; Nicola et al., 2004a, 2004b). For example, by using a cue discrimination task similar to the one used in our reward conditioning paradigm, it has been shown that the BLA drives NAc neurons to encode the value of a reward-predictive cue (Ambroggi et al., 2008). It is possible that such cue-related plasticity is involved in the BLA-NAc circuit effects that we demonstrate here. Testing this idea by pharmacological inhibition of the BLA or temporally specific inhibition of the BLA-NAc circuit using cue-paired optogenetic silencing during fear extinction with reward conditioning is a natural further step, but these manipulations would produce ambiguous results because they would interfere with the successful acquisition of the rewarding conditioning by reducing or eliminating responding to the reward predictive cue (Ambroggi et al., 2008; Stuber et al., 2011). Thus, determining the cellular and molecular mechanisms underlying the contribution of the BLA-NAc circuit activity during fear extinction with reward conditioning to the persistent reduction of fear remains to be determined.

We did not determine whether different populations of neurons are recruited by fear extinction with reward conditioning versus reward conditioning alone. An interesting possibility raised by our findings is that fear extinction and fear extinction combined with reward conditioning activate substantially overlapping populations of cells in the NAc, at least if the predictive cue is shared between the two experiences. In our experiments, fear extinction with reward conditioning was only effective when the tone paired with sucrose reward was the same as that previously paired with footshock (Figure 2,Figure 2—figure supplements 1 and Figure 2—figure supplement 2 versus Figure 2—figure supplement 3). Even lacking a full understanding of NAc single neuron encoding of aversion, reward, or the absence of expected reinforcement, our findings suggest that fear extinction in which no explicit reward was present activates a BLA-NAc circuit, as does reward conditioning, but less effectively.

The NAc, the target of the BLA-NAc circuit identified here, regulates both aversive and appetitive behaviors, and evidence suggests that the NAc regions modulating these opposing behaviors are partially segregated along a rostro-caudal axis (Basso and Kelley, 1999). The rostral-caudal border separating reward-related and aversive-related processing within the NAc is dynamic and altered by experience; for instance, stressful environments cause caudal fear-generating zones to expand rostrally (Reynolds and Berridge, 2008). Because emotional experience changes across the fear extinction training, it is difficult to assess systematically whether recruitment of a BLA-NAc circuit by extinction varies along the rostral-caudal axis of the NAc, but our findings do indicate that the NAc can exert a modulatory role during fear extinction through activity of a BLA-NAc circuit. Of note, high frequency stimulation of the BLA produces synaptic depression in rostral NAc, but synaptic potentiation in caudal NAc (Gill and Grace, 2011), and these synaptic changes are thought, respectively, to reduce fearful behaviors and to promote appetitive states (Reynolds and Berridge, 2008). Because the presynaptic terminals originating in the BLA are broadly distributed across the NAc, it is possible that the BLA-NAc circuit biases the appetitive-aversive balance towards an appetitive state (Britt et al., 2012; Stuber et al., 2011). Our observation that BLA-NAc optogenetic stimulation promotes reward-seeking (Figure 5—figure supplement 1C–D) is consistent with this interpretation.

The reduction of long-term fear memory that we found by adding reward conditioning to extinction training could be due to increased exploratory behavior or elevated blood glucose levels, but our findings do not favor these possibilities. Optogenetic stimulation of the BLA-NAc pathway produced a reduction of long-term fear memory similar in size to the reduction of long-term fear memory that we found by adding reward conditioning to extinction training. These results suggest that reward conditioning during fear extinction did not enhance extinction learning simply by promoting exploration, as there was no reward port in the optogenetic experiment to induce behaviors that could compete with freezing responses. Our optogenetic findings also suggest that reward conditioning during fear extinction did not enhance extinction learning by increasing blood glucose levels (Gold et al., 2012). Rats receiving optogenetic stimulation did not receive reward (sucrose), and rats that did receive reward (sucrose) conditioning with a novel tone never paired with shock did not exhibit decreased fear recall. Our results instead favor the novel view that activation of the BLA-NAc circuit during extinction of fear reduces fear recall by strengthening extinction memory per se.

Potential confounds of the projection optogenetics strategy that we used include back-propagation of ChETA-induced action potentials or activation of fibers of passage running through the NAc region targeted by the laser illumination. We used optogenetic stimulation of the BLA-NAc circuit in anesthetized rats to examine the effect of this stimulation on different brain areas in the absence of behavioral confounds (Figure 6; Figure 6—figure supplement 2). Our results suggest that back-propagation was unlikely to be responsible for the effects of stimulation on behavior because the laser stimulation in the NAc did not alter multiunit activity in the BLA ipsilateral to the stimulation site or the number of cFos+ nuclei in the BLA. Also, muscimol infusion in the NAc reduced IL activation mediated by BLA-NAc stimulation. These results indicate that optogenetic stimulation-induced activity in the NAc, contributes, at least in part, to the increased activity in the IL, a region known to modulate fear extinction. These results in anesthetized animals parallel our findings in awake, behaving rats: reward conditioning combined with fear extinction produced activation of the IL and, to a lesser extent, the PL (Figure 6). In addition, other studies have shown that stimulation of the NAc in awake animals activates the IL (Vassoler et al., 2013), as we report here in anesthetized rats. However, the level of neuronal activation measured in the anesthetized rats does not reflect the level of neuronal activation in awake, behaving rats.

While anesthesia eliminates variability in cFos expression attributable to behavior, it suffers from a different set of caveats. Anesthesia alters the balance of neuronal excitation and inhibition (Hentschke et al., 2005), which could result in either false positive cFos signal (due to disinhibition) or a reduction in cFos signal (due to anesthesia-induced inhibition). Our data (Figure 6G) show that anesthetized and naïve, awake rats express similar levels of cFos protein in the BLA, suggesting that it is unlikely that isoflurane anesthesia induces false positive cFos signal in the BLA. Nonetheless, it is possible that anesthesia could increase activity of inhibitory interneurons in the BLA and therefore mask potential antidromic activation of BLA neurons. Therefore, we must acknowledge that in the experiments where optogenetic stimulation was delivered to anesthetized rats, the level of neuronal activation reported in the BLA, NAc, IL and PL is likely to be different from what would be measured in awake animals.

In addition, we cannot rule out a contribution by fibers of passage or collateral fibers stimulated by laser treatment of the BLA-NAc circuit. The ventral striatum contains fiber bundles from the ventral mPFC (a homolog of IL) and the dorsal anterior cingulate cortex (a homolog to PL) to the amygdala and thalamus (Lehman et al., 2011). Additionally, some BLA neurons projecting to the NAc have axon collaterals within the mPFC (McDonald, 1991b; Shinonaga et al., 1994). Therefore, it is possible that activation of these collateral projections or fibers of passage could partially account for the increased activation of the IL as a result of optogenetic stimulation of the BLA-NAc circuit or of reward conditioning in combination with fear extinction. However our results clearly show that NAc activation itself contributes to the activation of the IL following stimulation of the BLA-NAc circuit.

An additional problem of our optogenetic strategy is that we undoubtedly activated a greater proportion of the BLA-NAc pathway with stimulation than is activated by fear conditioning or fear extinction. This is supported by the observation that the NAc shows greater expression of Nr4a3 after stimulation than is observed after extinction training alone (Figure 3—figure supplement 1F). However, the degree to which our stimulation produced greater activation of this pathway than natural extinction training is difficult to quantify for several reasons, including: 1) Viral expression of the opsin targeted only a portion of the BLA, and light delivery targeted only a portion of the NAc, thus only a fraction of the BLA terminals within the NAc could be stimulated, and 2) Our CTB infusions targeted only a small portion of the NAc, and thus identified only a subset of the BLA cells that project to this area. By using activity-dependent expression of channelrhodopsin, as has been used in other experimental contexts (Redondo et al., 2014; Gore et al., 2015), we could more precisely enhance activation of the extinction-related portion of the BLA-NAc circuit. In the absence of such a strategy, optogenetic stimulation may induce supra- or non-physiological changes. For example, the degree of activation that we observed in IL after optogenetic stimulation (Figure 6C) might be much greater than is achieved by any behavior. Also, our non-specific strategy may not only have activated BLA-NAc circuits that underlie fear extinction, but also those that may be activated by fear conditioning (Figure 1—figure supplement 2). Nevertheless, the fact that optogenetic stimulation produces a similar enhancement to the persistence of fear extinction memory (Figure 5D) as reward conditioning (Figure 2D) supports our claim that reward conditioning deepens the persistence of fear extinction memory via more effective recruitment of the BLA-NAc circuit than extinction alone.

Some of our experiments characterizing the impact of BLA terminal stimulation in the NAc were conducted in animals anesthetized with isoflurane (Figures 4, 6). While some studies have shown that isoflurane anesthesia has no impact on reward-related induction of cFos in the NAc (Kufahl et al., 2015) and that it does not induce cFos expression in either the NAc or IL (Smith et al., 2016), many studies clearly show that anesthesia does alter neuronal properties (Chen et al., 2011; Purtell et al., 2015; Joksovic and Todorovic, 2010; Ogawa et al., 1992). Therefore, we must acknowledge the possibility that the magnitude of the stimulation-induced changes that we report are different from what occurs in an awake, behaving animal.

Deep brain stimulation (DBS) in the NAc region has been found to reduce fear recall (Whittle et al., 2013; Rodriguez-Romaguera et al., 2012). It is still unclear if DBS therapeutic effects are due to increases or decreases in neuronal activity (Nauczyciel et al., 2013). Using optogenetics, we found that stimulating BLA terminals within the NAc increased spike activity in the NAc (Figures 4D–E). Such activation accords with other optogenetic studies of BLA projection activation of BLA-NAc connections (Britt et al., 2012; Stuber et al., 2011), in which the optical stimulation of the BLA-NAc circuit results in local glutamate receptor-mediated excitatory postsynaptic currents in NAc neurons. Since local glutamate antagonism within the NAc elicits appetitive or aversive behaviors on its own (Reynolds and Berridge, 2008), the role of NAc glutamate receptors during optogenetic stimulation of the BLA-NAc circuit is difficult to assess.

Our findings raise the possibility that recruitment of a selective BLA-NAc circuit contributes to the mechanism by which counterconditioning achieves therapeutic efficacy. It may also explain a recent finding that replacing expected threat with a neutral, unexpected outcome also enhanced the short-term persistence of extinction (Dunsmoor et al., 2015). These results raise the possibility that the BLA-NAc circuit could be a valuable target for therapeutic intervention across a range of disorders in which extinction-based therapies are applied.

Materials and methods

Subjects

All experiments used adult male Long-Evans rats (250–350 g, Taconic, Germantown, NY or Harlan, Indianapolis, IN), housed individually (20–22.2°C; 12-hr light-dark cycle, lights on from 6:45 am to 6:45 pm). Food and water was provided ad libitum until 11 days before the start of the behavioral experiment; subsequently, food was limited to 4 g per 100 g of body weight daily for each rat. All procedures were in accordance with the US National Institutes of Health (NIH) Guide for the Care and Use of Laboratory Animals and were approved by the MIT Institutional Animal Care and Use Committee (protocol 0313-018-16) and the Animal Care and Use Review Office of the USAMRMC (proposal 58076-LS-DRP.01).

Viral infusions and fiber optic implants

Rats were anesthetized with 1.5% isoflurane vaporized in oxygen and mounted into a dual arm stereotaxic frame (Kopf Instruments). AAV-eYFP or AAV-ChETA-eYFP viruses (both at 1.3 x 10^13 vg/ml) were bilaterally infused (1 µl/side) in the amygdala (A/P −2.3, M/L ± 4.9, D/V −7.3) using 31-gauge needles attached to Hamilton syringes. The infusion was carried out at a rate of 0.1 µl/min, and the needle was slowly removed 20 min after the end of infusion. Bilateral fiber optic implants aimed at the nucleus accumbens (A/P +1.8, M/L ± 1.2, D/V −5.7) were secured by the placement of three jeweler screws in the skull and dental acrylic. Rats were allowed to recover for one month after surgery before being subjected to auditory fear conditioning and extinction experiments.

CTB-Alexa fluor 488 infusions

Rats were anesthetized with 1.5% isoflurane vaporized in oxygen and mounted into a dual arm stereotaxic frame (Kopf Instruments). CTB-Alexa 488 retrograde tracer (1 µl/side, Invitrogen) was bilaterally infused in the nucleus accumbens (A/P +1.8, M/L ± 1.2, D/V −6.4) using 31-gauge needles attached to Hamilton syringes. The infusion was carried out at a rate of 0.1 µl/min, and the needle was slowly removed 20 min after the end of infusion. Rats were allowed to recover for 11 days after surgery before being subjected to auditory fear conditioning and extinction experiments.

Pavlovian fear conditioning

Fear conditioning experiments were conducted in a modified chamber (Med Associates) housed in a sound-attenuated cubicle. The animals were placed in individual chambers and video of each session was recorded. Each experiment used auditory fear conditioning wherein rats received 5 pairings of tone (2 KHz, 8 KHz or white noise, 85dB, 10 s) and footshock (1 s, 0.6 mA) in a unique context (context A: metal shock grid floors, chamber fan on, 1% acetic acid odor, house and room lights off). Animals were allowed 3 min to habituate to the chamber before tone-footshock pairings (5 pairings total) were given at intervals of 1 min (tone exposure groups were subjected to the same context and tone but no footshock was administered). Thus, each fear conditioning session lasted a total of 8 min 50 s.

Fear extinction was conducted 1, 2, 3, 4 and 55 (or 60) days after fear conditioning by placing the animals in a novel context (context B: white Plexiglas plastic floors, curved Plexiglas wall inserts, fans off, 0.3% Pine-Sol odor, house and room lights on or context C: white Plexiglas box, 0.3% Pine-Sol odor and room lights on). Two minutes after placement in context B or C, fear to the tone was assessed by presenting multiple discrete tones (10 for plasma corticosterone measurement experiments and 25 for all other experiments), with a 10 s duration and 1 min inter-stimulus interval. In some cases, extinction sessions consisted of presentation of two different tones (as indicated in the figures; one of the tones was the same as used during the fear conditioning session and the other was a second novel tone). During the fear extinction sessions with two tones, the two tones were presented in a pseudorandom order (25 presentations of each tone). For tone or context exposure sessions, rats were subjected to the same tone and context or context only, respectively. Thus, for extinction sessions in which only one tone was presented, the total length of the session was 31 min, 16 s. For extinction sessions in which two tones were presented, the total length of the session was 73 min, 30 s. For extinction sessions in which plasma corticosterone was measured, the total length of the session was 13 min, 10 s.

For some experiments, reward conditioning was used during the fear extinction sessions in Context B (Figure 2, Figure 2—figure supplement 2, Figure 3). In these experiments, the reward port was available to all animals in all groups during all sessions conducted in Context B, however sucrose was delivered through this port only to a subset of these groups in a subset of these sessions (as indicated in the respective experimental design panels). The reward port was never available during the fear conditioning in Context A.

Freezing was measured using commercial software (VideoFreeze, Med Associates), automated video analysis (MATLAB) or human scoring (performed by people blind to the experimental conditions). Raw freezing levels, computed as the percent of the relevant time period spent freezing, is depicted in panels labeled '% Freezing'. The '% fear memory' measure was calculated to assess the spontaneous recovery of fear at remote time points (Day 55 or Day 60) following extinction training. The% fear memory recovered on Day 55 or 60 was expressed as a percentage of the original fear memory acquired according to the following formula: (% freezing on Day 55 or 60 × 100) ÷ (% freezing of Day 2). The % freezing on Day 55 or 60 was calculated as % freezing during all Tone 1 trials on the first 5 trials on Day 55 or 60; the % freezing on Day 2 was calculated as the% freezing on the first 5 trials of Tone 1 presentations on Day 2 (thus reflecting the maximum fear memory acquired). Due to lack of equipment, video recordings (and thus freezing measures) on Days 4 and 5 were not captured for a subset of the animals whose data is illustrated in Figure 2—figure supplement 2B. Due to the variability in fear learning behavior for the dataset depicted in Figure 2 and Figure 2—figure supplement 1, we excluded animals from both experimental groups (Ext-Ext, n = 16 rats, Ext-RC n = 6 rats with freezing levels below 80% during the first five trials with Tone 1 presentation of the fear extinction session on Day 2.

Reward conditioning

Reward conditioning experiments were conducted in a modified chamber (Med Associates) housed in a sound-attenuated cubicle. The animals were placed in individual chambers and each experimental session used auditory reward conditioning wherein rats received 25 pairings of auditory stimuli (8 KHz or white noise, 85dB, 10 s) and reward (0.2 ml of 30% sucrose solution) and 25 presentations neutral auditory stimuli (8 KHz or white noise, 85dB, 10 s) in a unique context. The reward paired and neutral auditory stimuli (50 presentations in total) were presented in a pseudo-random order at intervals of 1 min. The total length of each session was 73 min, 30 s. Video was recorded throughout the session, and nose-pokes in the reward port were also recorded by the software.

Statistically significant decreases in the latency to approach the reward port, or increased reward port entries following the reward paired auditory stimuli as compared to the neutral stimuli, was used to identify rats that acquired reward conditioning. Rats that never displayed reward-seeking (failure to nose-poke) or discriminative reward conditioning (failure to nose-poke significantly more or faster to the CS paired with reward than to the neutral CS) were excluded from all analyses. This resulted in the following numbers for exclusion: Figure 2 and Figure 2—figure supplement 1, n = 6. It is important to note that these excluded animals did not display different levels of fear either during conditioning or during the first two days of extinction training (data not shown). For data depicted in Figure 2—figure supplement 1E, we only included data from animals where the reward port was clearly visible on the video recordings and the experimenter was able to confidently score reward port entries.

Nose-poke latencies were computed by Med-PC software as the time elapsed between the onset of each tone and the first subsequent nose poke. Reward port entries were calculated by recording beam breaks at the reward port during the 10 s tones and during the 10 s that preceded each tone. Normalized reward port entries were computed according to the following formula: [average port entries during the 25 tones – average port entries during the 25 pre-tone periods (10 s before each tone)]. Freezing behavior and% fear memory was measured as described above in Pavlovian Fear Conditioning.

Optogenetic stimulation during fear extinction

Fear conditioning and extinction experiments were performed as described above. During the extinction training sessions on Days 4 and 5, tone. Tone presentations were paired with 473 nm light stimulation in the NAc for 5 s periods (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval).

Optogenetic stimulation in anesthetized rats

Anesthetized rats expressing AAV-ChETA-eYFP in the amygdala (see ‘Viral infusions and fiber optic implants’ section for details) received 25 trials of 473 nm light stimulation in the NAc, either unilaterally or bilaterally. Each trial consisted of 5 s periods of light stimulation (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval) to match the previous experiment in which optogenetic stimulation was administered during fear extinction. A subset of rats received bilateral infusions of muscimol-bodipy (5 mM, 0.7 µl/side; Molecular Probes), in the NAc (A/P +1.8, M/L ± 1.2, D/V −6.4) using 35-gauge needles attached to Nanofil syringes, 20–40 min prior to the start of the optogenetic stimulation. One hour after the end of optogenetic stimulation, animals were anesthetized with an overdose of isoflurane and their brains were processed for immunohistochemistry (see Immunohistochemistry for details).

Optogenetic stimulation during nose-poke-induced reward delivery

Rats were placed in an individual modified operant chambers (Med Associates) equipped with active and inactive nose-poke ports. Each active nose-poke performed by the animal resulted in delivery of 0.2 ml of a 30% sucrose solution and 5 ms pulses of 473 nm laser light delivered 100 times at 20 Hz. Each inactive nose-poke performed by the animal resulted in delivery of 0.2 ml of a 30% sucrose solution only. Both active and inactive nose-pokes triggered an audible tone (2 KHz, 2 s). Nose-pokes made within 3 s of an active nose-poke did not activate the laser. Active and inactive nose-poke timestamp data were recorded using MED-PC software.

Optogenetic stimulation during place preference task

On Day 1, each rat was placed in the middle of a two chamber behavior box for 10 or 12 min. The two sides were differentiated by visual patterns on the walls. On Day 2, a divider was placed in the box to prevent rats from freely crossing between the chambers. Rats were placed in the least-preferred side of the box (determined by the amount of time spent on each side of the box on Day 1) while receiving BLA-NAc optogenetic stimulation (5 ms pulses, 20 Hz for 5 s every 20–30 s). The rats were then placed in the most-preferred side of the box for the same amount of time in the absence of stimulation. On Day 3, rats were again allowed to freely explore the two chamber behavioral box for the same amount of time as on Day 1. The place preference score was calculated as the difference between the percent of time spent (from total session time) in the side of the box paired with optogenetic stimulation on Day 3 and the percent of time spent in the same side on Day 1.

Immunohistochemistry

Following completion of the experiments or 1h after the end of behavioral testing (for cFos and Nr4a3 staining in the BLA, medial NAc shell and mPFC) animals were anesthetized with an overdose of isoflurane and intracardially perfused with phosphate buffer solution (PBS, pH 7.4) followed by 4% paraformaldehyde solution in PBS. Brains were harvested and placed in 4% paraformaldehyde solution in PBS for 24 hr at 4°C. The brains were then transferred to a 30% sucrose solution for 3 days at 4°C. Coronal sections (40 µm) were mounted with Vectashield mounting media containing DAPI and imaged by either fluorescence or confocal microscopy or stored in cryoprotectant solution at −20°C until further processed for immunolabeling. Primary antibodies were rabbit anti-cFos (Calbiochem, PC38T for Figure 1, Santa Cruz sc-52 for Figures 3, 6 and Figure 1—figure supplement 2), and chicken anti-GFP (Invitrogen, A10262), rabbit anti-Nr4a3 (Santa Cruz, SC 30154) and mouse anti-synaptophysin (Sigma, S5768). Secondary antibodies were anti-rabbit conjugated to Alexa 594 or Alexa 405, anti-chicken conjugated to Alexa 488 and anti-mouse conjugated to Alexa 594. Images were obtained with a Zeiss confocal microscope (Figures 1B right panel, 3D and 6A were acquired with a 40x oil immersion lens, 0.7x zoom and Z-resolution of 2.5 μm; Figure 4B was acquired a 60x oil immersion lens, 4x zoom and Z-resolution of 0.2 μm; Figure 6B was acquired with 10x objective, 1x zoom and Z-resolution of 40 μm). Digital images were acquired using the LSM 510 software and were reconstructed and analyzed using Image J software. Other images were acquired with a Zeiss fluorescence with a 2.5x or 5x objective.

In vivo electrophysiology

Rats infused with AAV-ChETA-eYFP or AAV-eYFP in the amygdala (as indicated above), were anesthetized with 1.5% isoflurane vaporized in oxygen and mounted into a dual arm stereotaxic frame (Kopf Instruments). Tungsten tetrodes were lowered into the BLA (A/P −2.3, M/L ± 4.9, D/V −6.5 to −7.4) while a fiber optic implant attached to tungsten tetrodes were lowered into the NAc (A/P +1.8, M/L ± 1.2, D/V −6 to −7.5). Electrical signals were amplified at 100–10000, sampled at 16 kHz, band-pass filtered for 600–6000 Hz, and recorded by a Cheetah data acquisition system (Neuralynx) while the optic fibers delivered 473 nm light stimulation for 5 s periods (10–20 mW, 20 Hz, 5 ms pulses; 65 s interstimulation interval). Firing rates preceding, during and following laser stimulation were calculated using MATLAB scripts.

Corticosterone assay

Perimortem blood was collected from the trunk after decapitation in a tube which contained 1:100 v/v 0.5 M EDTA and 1:100 v/v HALT (Pierce). Immediately after collection, plasma was extracted by centrifugation (2100 g at 4°C for 10 min). The plasma layer was collected and stored at −80°C. Corticosterone levels were determined using a commercial ELISA (Enzo Life Sciences). Plasma was diluted 1:50 in assay buffer 15 and processed according to the manufacturer’s protocol. Samples were excluded from analysis if they displayed signs of hemolysis or lipemia.

RNA extraction and microarray processing

Total RNA was extracted from the NAc using Qiagen's miRNeasy Mini kit, and purified with on-column digestion of DNA using Qiagen's RNase-free DNase. Pooled samples were created by combining equal amounts of mRNA from six rats. The quantity and integrity of the extracted RNA was assessed using the Agilent 2100 Bioanalyzer, which confirmed that all RNA samples were of high quality (RNA Integrity Number ≥9.0). Gene expression profiling was accomplished by Affymetrix microarray Rat Gene 1.0 ST. All microarray processing was performed at the Whitehead Institute Genome Technology Core at MIT and analysis was done using Genespring software.

Statistical methods

Statistical comparisons were calculated using Statview, MATLAB, or Excel. All data is expressed ± standard error of the mean. All group data were considered statistically significant if p<0.05.

Subjects were randomly assigned to experimental groups prior to experimentation. No statistical methods were used to pre-determine sample sizes but our sample sizes are similar to those generally employed in the field. Animals with viral or tracer injections off target or fiber optic misplacement or damage during the experiment were excluded from the experiments. A small number of animals died from natural causes during the incubation time between the fear behavior on Days 1–5 and the remote fear test on Day 55 or 60. No data from any excluded animals was included in any analysis.

Data collection was not performed blind to the conditions of the experiments. However, imaging data analysis was largely performed using automated ImageJ routines; scoring of freezing behavior was mostly automated and in experiments where experimenters manually scored the data, the experimenters were unaware of animal group assignments.

Acknowledgements

We thank Lindsay Johnson, Lindsay Kinney, Fangheng Zhou, Thomas Moulia, Norah Nguyen, Warren Slocum, Junmei Yao, Jordan Cruz, Cassandra Buzby, Connor Kirschbaum, Idil Ozturk, Dr. Ulf Knoblich, Dr. Geoff Schoenbaum and Dr. Donna Calu for technical support and Drs. Tyler Brown, Retsina Meyer, Kartik Ramamoorthi and Yasuo Kubota for discussions. We thank Dr. Li-Huei Tsai and Matt Dobbin for providing a confocal microscope and Dr. Alan Jasanoff for providing an ELISA plate reader. This research was funded by NIMH (R01 MH084966), and the US Army Research Office and the Defense Advanced Research Projects Agency (grant W911NF-10-1-0059) to AMG and KAG.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Funding Information

This paper was supported by the following grants:

  • Defense Advanced Research Projects Agency W911NF-10-1-0059 to Ann M Graybiel, Ki A Goosens.

  • Army Research Office to Ann M Graybiel, Ki A Goosens.

  • National Institute of Mental Health R01 MH084966 to Ki A Goosens.

Additional information

Competing interests

The authors declare that no competing interests exist.

Author contributions

SSC, Designed the experiments, Involved in all data collection and analysis, Interpreted data, Wrote the manuscript.

AGM, Collected data and performed analysis of a subset of the imaging and behavioral experiments, Interpreted data.

AL, Collected behavioral data and performed analysis of a subset of the imaging and behavioral experiments, Interpreted data.

AMG, Interpreted data, Wrote the manuscript.

KAG, Designed the experiments, Conducted behavioral analysis, Interpreted data, Wrote the manuscript.

Ethics

Animal experimentation: All procedures were in accordance with the US National Institutes of Health (NIH) Guide for the Care and Use of Laboratory Animals and were approved by the MIT Institutional Animal Care and Use Committee (protocol 0313-018-16) and the Animal Care and Use Review Office of the USAMRMC (proposal 58076-LS-DRP.01).

References

  1. Ambroggi F, Ishikawa A, Fields HL, Nicola SM. Basolateral amygdala neurons facilitate reward-seeking behavior by exciting nucleus accumbens neurons. Neuron. 2008;59:648–661. doi: 10.1016/j.neuron.2008.07.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Basso AM, Kelley AE. Feeding induced by GABA(A) receptor stimulation within the nucleus accumbens shell: regional mapping and characterization of macronutrient and taste preference. Behavioral Neuroscience. 1999;113:324–336. doi: 10.1037/0735-7044.113.2.324. [DOI] [PubMed] [Google Scholar]
  3. Belova MA, Paton JJ, Morrison SE, Salzman CD. Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron. 2007;55:970–984. doi: 10.1016/j.neuron.2007.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bouton ME. Context, ambiguity, and unlearning: sources of relapse after behavioral extinction. Biological Psychiatry. 2002;52:976–986. doi: 10.1016/S0006-3223(02)01546-9. [DOI] [PubMed] [Google Scholar]
  5. Britt JP, Benaliouad F, McDevitt RA, Stuber GD, Wise RA, Bonci A. Synaptic and behavioral profile of multiple glutamatergic inputs to the nucleus accumbens. Neuron. 2012;76:790–803. doi: 10.1016/j.neuron.2012.09.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Brog JS, Salyapongse A, Deutch AY, Zahm DS. The patterns of afferent innervation of the core and shell in the "accumbens" part of the rat ventral striatum: immunohistochemical detection of retrogradely transported fluoro-gold. Journal of Comparative Neurology. 1993;338:255–278. doi: 10.1002/cne.903380209. [DOI] [PubMed] [Google Scholar]
  7. Cassaday HJ, Horsley RR, Norman C. Electrolytic lesions to nucleus accumbens core and shell have dissociable effects on conditioning to discrete and contextual cues in aversive and appetitive procedures respectively. Behavioural Brain Research. 2005;160:222–235. doi: 10.1016/j.bbr.2004.12.012. [DOI] [PubMed] [Google Scholar]
  8. Chen Z, Vijayan S, Ching S, Hale G, Flores FJ, Wilson MA, Brown EN. Assessing neuronal interactions of cell assemblies during general anesthesia. Conference Proceedings Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2011;2011:4175–4178. doi: 10.1109/IEMBS.2011.6091036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Christie MJ, James LB, Beart PM. An excitant amino acid projection from the medial prefrontal cortex to the anterior part of nucleus accumbens in the rat. Journal of Neurochemistry. 1985;45:477–482. doi: 10.1111/j.1471-4159.1985.tb04013.x. [DOI] [PubMed] [Google Scholar]
  10. Christie MJ, Summers RJ, Stephenson JA, Cook CJ, Beart PM. Excitatory amino acid projections to the nucleus accumbens septi in the rat: a retrograde transport study utilizing D[3H]aspartate and [3H]GABA. Neuroscience. 1987;22:425–439. doi: 10.1016/0306-4522(87)90345-9. [DOI] [PubMed] [Google Scholar]
  11. Conte WL, Kamishina H, Reep RL. The efficacy of the fluorescent conjugates of cholera toxin subunit B for multiple retrograde tract tracing in the central nervous system. Brain Structure and Function. 2009;213:367–373. doi: 10.1007/s00429-009-0212-x. [DOI] [PubMed] [Google Scholar]
  12. Correia S, Goosens KA. Input-specific contributions to valence processing in the amygdala. Learning & Memory. 2016 doi: 10.1101/lm.037887.114. In press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Day JJ, Wheeler RA, Roitman MF, Carelli RM. Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm. European Journal of Neuroscience. 2006;23:1341–1351. doi: 10.1111/j.1460-9568.2006.04654.x. [DOI] [PubMed] [Google Scholar]
  14. Delgado MR, Jou RL, Ledoux JE, Phelps EA. Avoiding negative outcomes: tracking the mechanisms of avoidance learning in humans during fear conditioning. Frontiers in Behavioral Neuroscience. 2009;3:e12669. doi: 10.3389/neuro.08.033.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Di Ciano P, Everitt BJ. Direct interactions between the basolateral amygdala and nucleus accumbens core underlie cocaine-seeking behavior by rats. Journal of Neuroscience. 2004;24:7167–7173. doi: 10.1523/JNEUROSCI.1581-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Dunsmoor JE, Campese VD, Ceceli AO, LeDoux JE, Phelps EA. Novelty-facilitated extinction: providing a novel outcome in place of an expected threat diminishes recovery of defensive responses. Biological Psychiatry. 2015;78:203–209. doi: 10.1016/j.biopsych.2014.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Falls WA, Miserendino MJ, Davis M. Extinction of fear-potentiated startle: blockade by infusion of an NMDA antagonist into the amygdala. Journal of Neuroscience. 1992;12:854–863. doi: 10.1523/JNEUROSCI.12-03-00854.1992. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Felmingham KL, Dobson-Stone C, Schofield PR, Quirk GJ, Bryant RA. The brain-derived neurotrophic factor Val66Met polymorphism predicts response to exposure therapy in posttraumatic stress disorder. Biological Psychiatry. 2013;73:1059–1063. doi: 10.1016/j.biopsych.2012.10.033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Floresco SB, Blaha CD, Yang CR, Phillips AG. Dopamine D1 and NMDA receptors mediate potentiation of basolateral amygdala-evoked firing of nucleus accumbens neurons. Journal of Neuroscience. 2001;21:6370–6376. doi: 10.1523/JNEUROSCI.21-16-06370.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Ghitza UE, Fabbricatore AT, Prokopenko V, Pawlak AP, West MO. Persistent cue-evoked activity of accumbens neurons after prolonged abstinence from self-administered cocaine. Journal of Neuroscience. 2003;23:7239–7245. doi: 10.1523/JNEUROSCI.23-19-07239.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Gill KM, Grace AA. Heterogeneous processing of amygdala and hippocampal inputs in the rostral and caudal subregions of the nucleus accumbens. The International Journal of Neuropsychopharmacology. 2011;14:1301–1314. doi: 10.1017/S1461145710001586. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Gold PE, Korol DL. Making memories matter. Frontiers in Integrative Neuroscience. 2012;6:e12669. doi: 10.3389/fnint.2012.00116. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Gore F, Schwartz EC, Brangers BC, Aladi S, Stujenske JM, Likhtik E, Russo MJ, Gordon JA, Salzman CD, Axel R. Neural representations of unconditioned stimuli in basolateral amygdala mediate innate and learned responses. Cell. 2015;162:134–145. doi: 10.1016/j.cell.2015.06.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Haralambous T, Westbrook RF. An infusion of bupivacaine into the nucleus accumbens disrupts the acquisition but not the expression of contextual fear conditioning. Behavioral Neuroscience. 1999;113:925–940. doi: 10.1037/0735-7044.113.5.925. [DOI] [PubMed] [Google Scholar]
  25. Hawk JD, Abel T. The role of NR4A transcription factors in memory formation. Brain Research Bulletin. 2011;85:21–29. doi: 10.1016/j.brainresbull.2011.02.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Hentschke H, Schwarz C, Antkowiak B. Neocortex is the major target of sedative concentrations of volatile anaesthetics: strong depression of firing rates and increase of GABAA receptor-mediated inhibition. European Journal of Neuroscience. 2005;21:93–102. doi: 10.1111/j.1460-9568.2004.03843.x. [DOI] [PubMed] [Google Scholar]
  27. Herry C, Trifilieff P, Micheau J, Lüthi A, Mons N. Extinction of auditory fear conditioning requires MAPK/ERK activation in the basolateral amygdala. European Journal of Neuroscience. 2006;24:261–269. doi: 10.1111/j.1460-9568.2006.04893.x. [DOI] [PubMed] [Google Scholar]
  28. Herry C, Ciocchi S, Senn V, Demmou L, Müller C, Lüthi A. Switching on and off fear by distinct neuronal circuits. Nature. 2008;454:600–606. doi: 10.1038/nature07166. [DOI] [PubMed] [Google Scholar]
  29. Holtzman-Assif O, Laurent V, Westbrook RF. Blockade of dopamine activity in the nucleus accumbens impairs learning extinction of conditioned fear. Learning & Memory. 2010;17:71–75. doi: 10.1101/lm.1668310. [DOI] [PubMed] [Google Scholar]
  30. Johnson LR, Aylward RL, Hussain Z, Totterdell S. Input from the amygdala to the rat nucleus accumbens: its relationship with tyrosine hydroxylase immunoreactivity and identified neurons. Neuroscience. 1994;61:851–865. doi: 10.1016/0306-4522(94)90408-1. [DOI] [PubMed] [Google Scholar]
  31. Joksovic PM, Todorovic SM. Isoflurane modulates neuronal excitability of the nucleus reticularis thalami in vitro. Annals of the New York Academy of Sciences. 2010;1199:36–42. doi: 10.1111/j.1749-6632.2009.05172.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Jongen-Rêlo AL, Kaufmann S, Feldon J. A differential involvement of the shell and core subterritories of the nucleus accumbens of rats in memory processes. Behavioral Neuroscience. 2003;117:150–168. doi: 10.1037/0735-7044.117.1.150. [DOI] [PubMed] [Google Scholar]
  33. Kelley JB, Balda MA, Anderson KL, Itzhak Y. Impairments in fear conditioning in mice lacking the nNOS gene. Learning & Memory. 2009;16:371–378. doi: 10.1101/lm.1329209. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Kemp A, Tischmeyer W, Manahan-Vaughan D. Learning-facilitated long-term depression requires activation of the immediate early gene, c-fos, and is transcription dependent. Behavioural Brain Research. 2013;254:83–91. doi: 10.1016/j.bbr.2013.04.036. [DOI] [PubMed] [Google Scholar]
  35. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2005;62:593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
  36. Kim JJ, Song EY, Kosten TA. Stress effects in the hippocampus: synaptic plasticity and memory. Stress. 2006a;9:1–11. doi: 10.1080/10253890600678004. [DOI] [PubMed] [Google Scholar]
  37. Kim H, Shimojo S, O'Doherty JP. Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biology. 2006b;4:e12669. doi: 10.1371/journal.pbio.0040233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Kufahl PR, Peartree NA, Heintzelman KL, Chung M, Neisewander JL. Region-specific effects of isoflurane anesthesia on Fos immunoreactivity in response to intravenous cocaine challenge in rats with a history of repeated cocaine administration. Brain Research. 2015;1594:256–266. doi: 10.1016/j.brainres.2014.10.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Laurent V, Marchand AR, Westbrook RF. The basolateral amygdala is necessary for learning but not relearning extinction of context conditioned fear. Learning & Memory. 2008;15:304–314. doi: 10.1101/lm.928208. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. LeDoux JE, Cicchetti P, Xagoraris A, Romanski LM. The lateral amygdaloid nucleus: sensory interface of the amygdala in fear conditioning. Journal of Neuroscience. 1990;10:1062–1069. doi: 10.1523/JNEUROSCI.10-04-01062.1990. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Lehman JF, Greenberg BD, McIntyre CC, Rasmussen SA, Haber SN. Rules ventral prefrontal cortical axons use to reach their targets: implications for diffusion tensor imaging tractography and deep brain stimulation for psychiatric illness. Journal of Neuroscience. 2011;31:10392–10402. doi: 10.1523/JNEUROSCI.0595-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Lindecke A, Korte M, Zagrebelsky M, Horejschi V, Elvers M, Widera D, Prüllage M, Pfeiffer J, Kaltschmidt B, Kaltschmidt C. Long-term depression activates transcription of immediate early transcription factor genes: involvement of serum response factor/Elk-1. European Journal of Neuroscience. 2006;24:555–563. doi: 10.1111/j.1460-9568.2006.04909.x. [DOI] [PubMed] [Google Scholar]
  43. Luo R, Tao Y, Preston L, Koivumaa J, Johansen JA. Ventral tegmental area dopamine neurons trigger fear extinction learning. Society for Neuroscience; 2015. p. Program No. 254.20/W20. [Google Scholar]
  44. McDonald AJ. Topographical organization of amygdaloid projections to the caudatoputamen, nucleus accumbens, and related striatal-like areas of the rat brain. Neuroscience. 1991a;44:15–33. doi: 10.1016/0306-4522(91)90248-M. [DOI] [PubMed] [Google Scholar]
  45. McDonald AJ. Organization of amygdaloid projections to the prefrontal cortex and associated striatum in the rat. Neuroscience. 1991b;44:1–14. doi: 10.1016/0306-4522(91)90247-L. [DOI] [PubMed] [Google Scholar]
  46. Milad MR, Quirk GJ. Neurons in medial prefrontal cortex signal memory for fear extinction. Nature. 2002;420:70–74. doi: 10.1038/nature01138. [DOI] [PubMed] [Google Scholar]
  47. Namburi P, Beyeler A, Yorozu S, Calhoon GG, Halbert SA, Wichmann R, Holden SS, Mertens KL, Anahtar M, Felix-Ortiz AC, Wickersham IR, Gray JM, Tye KM. A circuit mechanism for differentiating positive and negative associations. Nature. 2015;520:675–678. doi: 10.1038/nature14366. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Nauczyciel C, Robic S, Dondaine T, Verin M, Robert G, Drapier D, Naudet F, Millet B. The nucleus accumbens: a target for deep brain stimulation in resistant major depressive disorder. Journal of Molecular Psychiatry. 2013;1:17–12. doi: 10.1186/2049-9256-1-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Nelson F. Effects of two counterconditioning procedures on the extinction of fear. Journal of Comparative and Physiological Psychology. 1966;62:208–213. doi: 10.1037/h0023672. [DOI] [PubMed] [Google Scholar]
  50. Nicola SM, Yun IA, Wakabayashi KT, Fields HL. Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues. Journal of Neurophysiology. 2004a;91:1866–1882. doi: 10.1152/jn.00658.2003. [DOI] [PubMed] [Google Scholar]
  51. Nicola SM, Yun IA, Wakabayashi KT, Fields HL. Cue-evoked firing of nucleus accumbens neurons encodes motivational significance during a discriminative stimulus task. Journal of Neurophysiology. 2004b;91:1840–1865. doi: 10.1152/jn.00657.2003. [DOI] [PubMed] [Google Scholar]
  52. O'Donnell P, Grace AA. Synaptic interactions among excitatory afferents to nucleus accumbens neurons: hippocampal gating of prefrontal cortical input. Journal of Neuroscience. 1995;15:3622–3639. doi: 10.1523/JNEUROSCI.15-05-03622.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Ogawa T, Shingu K, Shibata M, Osawa M, Mori K. The divergent actions of volatile anaesthetics on background neuronal activity and reactive capability in the central nervous system in cats. Canadian Journal of Anaesthesia. 1992;39:862–872. doi: 10.1007/BF03008298. [DOI] [PubMed] [Google Scholar]
  54. Paton JJ, Belova MA, Morrison SE, Salzman CD. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature. 2006;439:865–870. doi: 10.1038/nature04490. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Paunović N. Prolonged exposure counterconditioning as a treatment for chronic posttraumatic stress disorder. Journal of Anxiety Disorders. 2003;17:479–499. doi: 10.1016/S0887-6185(02)00233-5. [DOI] [PubMed] [Google Scholar]
  56. Paunović N. Exposure inhibition therapy as a treatment for chronic posttraumatic stress disorder: A controlled pilot study. Psychology. 2011;02:605–614. doi: 10.4236/psych.2011.26093. [DOI] [Google Scholar]
  57. Pavlov IP. Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex. London: Oxford University Press; 1927. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Paxinos G, Watson C. The Rat Brain in Stereotaxic Coordinates - the New Coronal Set. (5th ed) San Diego: Elsevier Academic Press; 2005. [Google Scholar]
  59. Purtell K, Gingrich KJ, Ouyang W, Herold KF, Hemmings HC. Activity-dependent depression of neuronal sodium channels by the general anaesthetic isoflurane. British Journal of Anaesthesia. 2015;115:112–121. doi: 10.1093/bja/aev203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Quirk GJ, Repa C, LeDoux JE. Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: parallel recordings in the freely behaving rat. Neuron. 1995;15:1029–1039. doi: 10.1016/0896-6273(95)90092-6. [DOI] [PubMed] [Google Scholar]
  61. Quirk GJ. Memory for extinction of conditioned fear is long-lasting and persists following spontaneous recovery. Learning & Memory. 2002;9:402–407. doi: 10.1101/lm.49602. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Raczka KA, Mechias ML, Gartmann N, Reif A, Deckert J, Pessiglione M, Kalisch R. Empirical support for an involvement of the mesostriatal dopamine system in human fear extinction. Translational Psychiatry. 2011;1:e12. doi: 10.1038/tp.2011.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Redondo RL, Kim J, Arons AL, Ramirez S, Liu X, Tonegawa S. Bidirectional switch of the valence associated with a hippocampal contextual memory engram. Nature. 2014;513:426–430. doi: 10.1038/nature13725. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Rescorla RA. Spontaneous recovery. Learning & Memory. 2004;11:501–509. doi: 10.1101/lm.77504. [DOI] [PubMed] [Google Scholar]
  65. Reynolds SM, Berridge KC. Emotional environments retune the valence of appetitive versus fearful functions in nucleus accumbens. Nature Neuroscience. 2008;11:423–425. doi: 10.1038/nn2061. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Richardson R, Riccio DC, Jamis M, Cabosky J, Skoczen T. Modification of reactivated memory through "counterconditioning". The American Journal of Psychology. 1982;95:67–84. doi: 10.2307/1422660. [DOI] [PubMed] [Google Scholar]
  67. Riedel G, Harrington NR, Hall G, Macphail EM. Nucleus accumbens lesions impair context, but not cue, conditioning in rats. NeuroReport. 1997;8:2477–2481. doi: 10.1097/00001756-199707280-00013. [DOI] [PubMed] [Google Scholar]
  68. Rodriguez-Romaguera J, Do Monte FHM, Quirk GJ. Deep brain stimulation of the ventral striatum enhances extinction of conditioned fear. PNAS. 2012;109:8764–8769. doi: 10.1073/pnas.1200782109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Rothbaum BO, Davis M. Applying learning principles to the treatment of post-trauma reactions. Annals of the New York Academy of Sciences. 2003;1008:112–121. doi: 10.1196/annals.1301.012. [DOI] [PubMed] [Google Scholar]
  70. Schoenbaum G, Chiba AA, Gallagher M. Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nature Neuroscience. 1998;1:155–159. doi: 10.1038/407. [DOI] [PubMed] [Google Scholar]
  71. Schwienbacher I, Fendt M, Richardson R, Schnitzler HU. Temporary inactivation of the nucleus accumbens disrupts acquisition and expression of fear-potentiated startle in rats. Brain Research. 2004;1027:87–93. doi: 10.1016/j.brainres.2004.08.037. [DOI] [PubMed] [Google Scholar]
  72. Senn V, Wolff SB, Herry C, Grenier F, Ehrlich I, Gründemann J, Fadok JP, Müller C, Letzkus JJ, Lüthi A. Long-range connectivity defines behavioral specificity of amygdala neurons. Neuron. 2014;81:428–437. doi: 10.1016/j.neuron.2013.11.006. [DOI] [PubMed] [Google Scholar]
  73. Setlow B, Holland PC, Gallagher M. Disconnection of the basolateral amygdala complex and nucleus accumbens impairs appetitive pavlovian second-order conditioned responses. Behavioral Neuroscience. 2002;116:267–275. doi: 10.1037/0735-7044.116.2.267. [DOI] [PubMed] [Google Scholar]
  74. Shinonaga Y, Takada M, Mizuno N. Topographic organization of collateral projections from the basolateral amygdaloid nucleus to both the prefrontal cortex and nucleus accumbens in the rat. Neuroscience. 1994;58:389–397. doi: 10.1016/0306-4522(94)90045-0. [DOI] [PubMed] [Google Scholar]
  75. Smith ML, Li J, Cote DM, Ryabinin AE. Effects of isoflurane and ethanol administration on c-Fos immunoreactivity in mice. Neuroscience. 2016;316:337–343. doi: 10.1016/j.neuroscience.2015.12.047. [DOI] [PMC free article] [PubMed] [Google Scholar]
  76. Sotres-Bayon F, Bush DE, LeDoux JE. Acquisition of fear extinction requires activation of NR2B-containing NMDA receptors in the lateral amygdala. Neuropsychopharmacology. 2007;32:1929–1940. doi: 10.1038/sj.npp.1301316. [DOI] [PubMed] [Google Scholar]
  77. Sotres-Bayon F, Quirk GJ. Prefrontal control of fear: more than just extinction. Current Opinion in Neurobiology. 2010;20:231–235. doi: 10.1016/j.conb.2010.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Stuber GD, Sparta DR, Stamatakis AM, van Leeuwen WA, Hardjoprajitno JE, Cho S, Tye KM, Kempadoo KA, Zhang F, Deisseroth K, Bonci A. Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking. Nature. 2011;475:377–380. doi: 10.1038/nature10194. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Sugase-Miyamoto Y, Richmond BJ. Cue and reward signals carried by monkey entorhinal cortex neurons during reward schedules. Experimental Brain Research. 2007;181:267–276. doi: 10.1007/s00221-007-0926-z. [DOI] [PubMed] [Google Scholar]
  80. Tye KM, Stuber GD, de Ridder B, Bonci A, Janak PH. Rapid strengthening of thalamo-amygdala synapses mediates cue-reward learning. Nature. 2008;453:1253–1257. doi: 10.1038/nature06963. [DOI] [PMC free article] [PubMed] [Google Scholar]
  81. Uwano T, Nishijo H, Ono T, Tamura R. Neuronal responsiveness to various sensory stimuli, and associative learning in the rat amygdala. Neuroscience. 1995;68:339–361. doi: 10.1016/0306-4522(95)00125-3. [DOI] [PubMed] [Google Scholar]
  82. Vassoler FM, White SL, Hopkins TJ, Guercio LA, Espallergues J, Berton O, Schmidt HD, Pierce RC. Deep brain stimulation of the nucleus accumbens shell attenuates cocaine reinstatement through local and antidromic activation. Journal of Neuroscience. 2013;33:14446–14454. doi: 10.1523/JNEUROSCI.4804-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  83. Wan X, Peoples LL. Firing patterns of accumbal neurons during a pavlovian-conditioned approach task. Journal of Neurophysiology. 2006;96:652–660. doi: 10.1152/jn.00068.2006. [DOI] [PubMed] [Google Scholar]
  84. Werme M, Olson L, Brené S. NGFI-B and nor1 mRNAs are upregulated in brain reward pathways by drugs of abuse: different effects in Fischer and Lewis rats. Molecular Brain Research. 2000;76:18–24. doi: 10.1016/S0169-328X(99)00327-7. [DOI] [PubMed] [Google Scholar]
  85. Whittle N, Schmuckermair C, Gunduz Cinar O, Hauschild M, Ferraguti F, Holmes A, Singewald N. Deep brain stimulation, histone deacetylase inhibitors and glutamatergic drugs rescue resistance to fear extinction in a genetic mouse model. Neuropharmacology. 2013;64:414–423. doi: 10.1016/j.neuropharm.2012.06.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Wolpe J. Psychotherapy by Reciprocal Inhibition. Stanford: Stanford University Press; 1958. [Google Scholar]
  87. Wright CI, Beijer AV, Groenewegen HJ. Basal amygdaloid complex afferents to the rat nucleus accumbens are compartmentally organized. Journal of Neuroscience. 1996;16:1877–1893. doi: 10.1523/JNEUROSCI.16-05-01877.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]
eLife. 2016 Sep 27;5:e12669. doi: 10.7554/eLife.12669.024

Decision letter

Editor: Naoshige Uchida1

In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.

Thank you for submitting your work entitled "Amygdala-ventral striatum circuit activation decreases long-term fear" for consideration by eLife. Your article has been reviewed by three peer reviewers, and the evaluation has been overseen by Naoshige Uchida as the Reviewing Editor and a Senior Editor. C. Daniel Salzman (peer reviewer) has agreed to reveal his identity.

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

Summary:

This study examined the mechanism by which the extinction of fear memory could be facilitated. The authors show that counterconditioning, in which animals receive appetitive outcomes during fear extinction, enhances the retention of extinction memories, while having no effect on the initial extinction learning. They then show that the BLA-NAc circuit is recruited by extinction and that this recruitment is enhanced when extinction is done in combination with reward (counterconditioning). Furthermore, they demonstrate that direct stimulation of the BLA-NAc circuit enhances the retention of extinction memories.

Essential revisions:

All the reviewers felt that these results are very interesting and important. However, the reviewers also raised several substantive concerns. The main points to which authors need to address are summarized below:

1) Specificity of the recruitment of the BLA-NAc circuit during extinction and/or reward conditioning. It is not clear whether the increase in c-fos labeled BLA cells occurs preferentially in the NAc projecting cells or generally in the BLA. If this is occurring by chance, then the evidence for specific recruitment of the BLA-NAc pathway would not be provided. This point needs to be explicitly analyzed.

2) Data exclusions. It was noted that the authors excluded some samples/data, which might have biased some of the data analyses. The authors need to clarify this.

3) Potential non-physiological effects of optogenetic manipulation. The data suggests that 95% of the neurons activated by optogenetic manipulation were not activated by fear conditioning and extinction. The authors need to consider whether the effects they observe are non-physiological effects.

4) One of the reviewers raised various concerns in the experimental design and data analysis regarding the conclusion that the BLA-NAc circuit is recruited by fear extinction. See below for the details.

Reviewer #1:

This is an interesting paper on the role of a basolateral(BLA)-nucleus accumbens (NAc) circuit in fear extinction learning and counterconditioning in which animals undergo extinction in combination with appetitive learning. They show behaviorally that counterconditioning enhances the retention of extinction memories, while having no effect on the initial extinction learning. They then show that this pathway is recruited by extinction and that this recruitment is enhanced when extinction is done in combination with reward (counterconditioning). Furthermore, they demonstrate that direct stimulation of the BLA-NAc circuit enhances the retention of extinction memories. While the results are intriguing I have a number of substantive concerns which should be addressed:

1) For Figure 1, it is not clear whether the increase in cfos labeled BLA cells occurs preferentially in the NAc projecting cells or generally in the BLA. While the authors mention in the fifth paragraph of the subsection A BLA-NAc circuit is recruited by fear extinction that the a third of the cfos labeled cells are NAc projecting, they need to use a more rigorous statistical test to demonstrate that recruitment of this pathway is actually selective.

2) Related to the counterconditioning data presented in Figure 2, the authors mention in the Methods that "Rats that never displayed reward-seeking (failure to nose-poke) or discriminative reward conditioning (failure to nose-poke significantly more or faster to the CS paired with reward than to the neutral CS) were excluded from all analyses." This is potentially a major issue as they are selectively removing animals from one group. This could bias their results in the counterconditioning group such that the animals in this group have reduced fear specifically because these animals were removed and not because the counterconditioning enhanced extinction memory retention. For example, it is possible that animals that couldn't learn reward seeking had higher fear levels or more spontaneous recovery of extinction. The authors need to do something to address this problem. One possibility is to identify animals that would be excluded and then do extinction training and compare these animals that would have been excluded to a normal group of extinction animals to see if there are differences in spontaneous recovery. If not, then there is not a problem with the exclusion criteria.

Related to the above comment, they should state somewhere how many animals were excluded. Also, for the data in Figure 2B, the authors should clarify whether this does or does not include excluded animals.

3) The authors should clarify in the Methods section whether the exact same box was used (including the availability of all apparatuses in box except reward) for both ext-ext and ext-RC groups? This is important as differences in the box could produce differences in extinction.

4) There are a number of issues with data presented in Figure 3:

A) It is not clear why there is an inset to compare Ext-RC and RC groups. Ext-Ext, Ext-RC and RC groups should be in a single graph with appropriate statistical comparisons.

B) A negative control group should be included here to determine whether there is an increase above baseline in fos activation. One of the control groups used in Figure 1 would be sufficient.

C) For the BLA data in 3B and C, representative images should be shown somewhere.

D) One possibility is that extinction (or reward) preferentially activates NAc projectors early in learning and that the differences you see between extinction and reward learning are due to that and not because the extinction and reward are summating to activate more cells. It would ideal to run another group where tissue is collected after 1 day of extinction to match the single day of reward learning.

E) Also need negative control for the NAc Nr4a3 data in Figure 3E as it is not clear whether there is a significant Nr4a3 activation above baseline in the ext-ext group.

5) For the data presented in Figure 5, they should show supplemental data with raw% freezing levels on day 2 and day 60 in supplement as they do for the data in Figure 2.

6) Though not absolutely necessary, inhibition of BLA-NAc terminals during extinction would be ideal to directly test whether the BLA-NAc projection participates causally in generating extinction. As it stands they present correlative evidence that the circuit is engaged, but the paper would much more compelling if they could make a causal link.

Reviewer #2:

This paper explores the role of the amygdala to ventral striatum (BLA to NAc) circuit in decreasing long-term fear. The paper makes a nice series of observations that emphasize the potential importance of this circuit -long recognized as mediating reward-related behavior in potentially modifying neural circuitry responsible for modulating fear responses on a long-term basis. Thus overall, I am supportive of publication of the paper. However, I have a number of issues that I think the authors should address to improve the paper.

1) Specificity of the recruitment of the BLA-NAc circuit during extinction and/or reward conditioning.

The authors' data largely rely on an observed increase following extinction or reward conditioning in double labeled cells in BLA using c-fos and CTB+ to mark activated cells that project to NAc. However, the authors do not address whether this increase in double labeling could be occurring by chance as a result of simply increasing the number of c-fos positive cells in BLA. In other words, increased double labeling would be expected simply by virtue of increasing the number of c-fos positive cells. If this is occurring by chance, then the evidence for specific recruitment of the BLA-NAc pathway would not be provided. Moreover, the statement that the proportion of activated BLA neurons that project to NAc increases with reward conditioning can't be supported without such statistical testing.

2) Potential non-physiological effects of optogenetic manipulation.

The authors report that only 5% of the NAc-projecting BLA neurons were double-labeled by c-fos and CTB+. This implies that 95% of the neurons activated by optogenetic manipulation were not activated by fear conditioning and extinction. The authors need to consider whether the effects they observe are non-physiological effects (essentially activating neurons not normally activated during the relevant behavior) given that they don't know much about the response properties of most of the neurons they are activating optogenetically. This type of issue applies to many (if not most) studies employing optogenetic methodology, but it is one that I think we all need to worry about more. A missing link in this paper is the specific activation only of those BLA cells that are activated by either extinction or reward conditioning. Approaches for accomplishing this type of manipulation are being developed, but it is not clear whether such approaches will work in these experimental paradigms. Nonetheless, recent work from Redondo et al. and Gore et al. both accomplished this type of manipulation in BLA, and these papers probably should have been discussed in the paper, as well as the recent paper from Namburi et al., which, though not using the type of manipulation used by Redondo and Gore, is also highly relevant.

3) Evaluation of physiological effects of optogenetic stimulation in anaesthetized rats.

I was disappointed that the examination of modulation in neural activity that could result from activation by optogenetic stimulation was done in anaesthetized rats. I understand why the authors may have done this for c-fos assays, but electrophysiology could have been performed in awake animals and short latency changes in activity could be observed in the absence of behavioral confound issues. Further, the authors could also inactivate the BLA while photoactivating terminals in NAc to test whether antidromic activation is playing a role. While I would not insist that the authors re-do all of these experiments, appropriate text needs to be added to the Discussion given that the findings may not hold in the absence of anaesthesia.

4) Accessibility of the manuscript.

I found the manuscript a difficult read. There is a lot of data, and it is often densely presented. Some of the figure legends are a page long, and many readers just won't engage them. Transitions between paragraphs often lack conceptual links. The Discussion reads in a somewhat rambling way, and parts of it are quite repetitive with the results. It takes many paragraphs for the authors to summarize their data rather having 1 or at most 2 succinct paragraphs followed by focused discussion. Again, I will not insist on changes here, but I think the authors would be well-served to revise the manuscript with these issues in mind; readers will find the work more accessible if they do so.

Reviewer #3:

This is an interesting and innovative report that shows that the activation of BLA-NAc circuit may underlie the facilitation effect on fear extinction caused by reward pairing. The data are important, and may provide a neural circuit mechanism for the counterconditioning therapy used to treat fear-related disorders. The topic has significant clinical relevance and is of great general interest. It is potentially suitable for publication in eLife. However, several issues need to be addressed or clarified before the full impact of these results can be determined.

In a first series of experiments, the authors performed double labeling experiments with retrograde tracer and cFos staining to show that the BLA-NAc circuit is recruited by fear extinction. However, I'm not fully convinced by the authors' implication that fear extinction activated extra NAc-projection neurons in BLA compared with the Fear group (Figure 1C and 1D). This is an unfair comparison for the following reasons. First, the authors chose to perfuse the animals 1 hr after the final behavior session. cFos signals usually peaks at 1.5~2hr after the behavior onset. As fear recall session perhaps lasts much shorter than fear extinction (I could not find details for the behavior protocol. How long is the extinction session? How many trials does it consist? Such essential information is missing from the Methods.), it is likely that less cFos signals in the Fear group was simply due to a shorter expression time from the stimulus onset. Second, the fear extinction session consists many more trials than the fear recall session, so should naturally induce more signals. It will be useful to compare the percentage of double-labeled neurons relative to cFos+ neurons following fear recall and fear extinction. The authors showed 31% for the extinction group. Is the percentage lower for the recall group?

To rule out the antidromic effect on behavior, a standard way would be inactivating the upstream BLA region while optogenetically activating the terminals in NAc. If the effect still lasted, it would be much more convincing than recording or cfos counting in anesthetized animals. This is technically feasible, as demonstrated by the NAc inactivation experiment in this manuscript.

Anesthetized animals are not the most ideal if awake behaving animals can be used. For measuring of IL cFos after BLA-NAc stimulation, the authors should use awake animals, since that's the physiological condition under which behaviors are measured.

Have the authors analyzed the correlation between the level of extinction and that of reward conditioning at the individual level?

[Editors' note: further revisions were requested prior to acceptance, as described below.]

Thank you for submitting your article "Amygdala-ventral striatum circuit activation decreases long-term fear" for consideration by eLife. Your article has been reviewed by three peer reviewers, and the evaluation has been overseen by a Reviewing Editor and a Senior Editor. C Daniel Salzman (Reviewer #2) has agreed to reveal his identity.

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

All the reviewers thought that the authors have addressed many of the previous concerns by adding new data and revising the manuscript (please see below for individual comments). However, during discussion, the reviewers found that there are some concerns that need to be addressed before publication. Specifically, although reviewers 1 and 2 initially found the revisions satisfactory, after discussion with reviewer 3 and the reviewing editor, all of us concurred that the request for additional experiments was reasonable.

In the previous review, the reviewers were concerned that there is no evidence supporting the specificity of the BLA-NAc circuit recruitment during fear extinction and/or reward conditioning. The authors have addressed this concern by removing "specific" from the texts. In addition, it was pointed out, in the previous review, that only 5% of the BLA-NAc circuit was labeled by c-fos while this pathway was activated optogenetically without further specificity. Although the authors point out that ChR2 is expressed in only a fraction of BLA-NAc projections, this does not solve the issue that ~95% of stimulated neurons are not c-fos positive. Furthermore, in response to the reviewer #3's comments regarding c-fos experiments in anesthetized animals (which was not "essential" in the decision letter), the authors state that "it is unclear to us what additional information could be provided by the experiment suggested". We believe that performing c-fos experiments in awake animals is necessary to remedy the concern that the neuronal activity in anesthetized animals might not be normal.

Overall, the authors' responses to the above points were judged unsatisfactory. Whether the recruitment of BLA-NAc circuit has any predominant role in fear extinction remains unclear, and it is unclear whether optogenetic stimulation mimics physiological activities. The reviewers thought that these points are central to the present work and it is unlikely that these issues can be addressed simply by removing "specific". Ideally, the specificity of BLA-NAc circuit recruitment should be tested experimentally by showing that there is less c-fos activation of another projection after late extinction (which we believe can be done in 1 month). In addition, performing c-fos experiments in awake animals is necessary to support the authors' claims that ontogenetic stimulation did not cause activation of collaterals and that the c-fos expressions observed after optogenetic stimulation reflect normal circuit effects.

Overall, we strongly prefer that you perform the above experiments. Even if the authors decide not to perform these experiments, the above issues must be discussed more carefully and thoroughly so that the readers can appreciate the major potential caveats of the experiments and interpretations.

Reviewer #1:

The authors have adequately addressed my concerns.

Reviewer #2:

I think the authors have fully taken into account my previous concerns, and I now support publication.

Reviewer #3:

The authors have addressed many of the comments and the manuscript has been improved with a good amount of data. However, I 'm surprised that the authors insisted on using c-fos data in anesthetized animals as critical evidence for specific circuit activation.

It is well known that anesthesia strongly alters the excitation/inhibition balance in the brain. Some neurons which are activated under normal physiological conditions could be silenced by unnaturally strong inhibition under anesthetized state, and appear c-fos negative. On the other hand, if the anesthesia hits more heavily on a group of GABAergic neurons that disinhibits other neurons, the latter neurons may appear falsely c-fos positive. Therefore, interpretation of c-fos data from anesthetized animals could be very misleading.

As the author was not able to show that BLA-NAc is selectively activated by extinction, the NAc terminal stimulation experiment became critical in addressing the specific role of the pathway in extinction. The authors took the absence of c-fos signals in YFP+ BLA neurons in anesthetized animals as the only evidence to rule out antidromic effect by the terminal stimulation. While I understand there might be technical issues involved in inactivating upstream BLA region, I do not see why the authors should not perform the c-fos experiment in awake animals, which is much more physiologically-relevant.

Similarly, activation of IL is an important mechanism the authors proposed to explain why BLA-NAc stimulation facilitates extinction. I am disappointed that this was again only supported by results in anesthetized animals. c-fos experiments in awake animals are totally feasible and not much more tedious than in anesthetized animals. The authors should repeat these two sets of experiments in awake animals.

eLife. 2016 Sep 27;5:e12669. doi: 10.7554/eLife.12669.025

Author response


Essential revisions:

1) Specificity of the recruitment of the BLA-NAc circuit during extinction and/or reward conditioning. It is not clear whether the increase in c-fos labeled BLA cells occurs preferentially in the NAc projecting cells or generally in the BLA. If this is occurring by chance, then the evidence for specific recruitment of the BLA-NAc pathway would not be provided. This point needs to be explicitly analyzed.

We did not intend to claim that the activation of the BLA-NAc pathway is selective to extinction. We believe this issue may have arisen because we used the term specific to describe the anatomical and temporal specificity of our manipulations. It is clear that the double-labeling of cFos and CTB (Figure 1D), indicating activation of the BLA-NAc pathway, strongly parallels the elevated levels of cFos observed in all cells of the BLA (Figure 1C). We have modified the language of the text in our manuscript to clarify what we mean by specific each time it is used, and we also have almost eliminated our use of this term.

To directly address the issue of behavioral specificity, we conducted an additional experiment (Figure 1—figure supplement 2). We examined the activation of this pathway by fear conditioning (Fear Cond group) and the activation of this pathway by lower levels of extinction training (Short ext group). We found that the BLA-NAc pathway was activated by fear learning. However, more importantly, and more relevant to our claims, we found that one session of extinction training recruited this pathway to a lesser degree than two sessions of extinction training. Critically, we also found that there is a strong, negative association between the extent to which the BLA-NAc pathway is activated and the fear expressed (Figure 1—figure supplement 2F). We have added a paragraph to the Discussion to consider why both fear conditioning and fear extinction may activate the same BLA-NAc circuit.

2) Data exclusions. It was noted that the authors excluded some samples/data, which might have biased some of the data analyses. The authors need to clarify this.

We have modified the Methods to explicitly disclose the number of rats excluded for these behavioral exclusion criteria. Of particular concern, Reviewer 1 noted that we excluded rats from the Ext-RC and RC groups that failed to display any indication of learning (either a failure to discriminate between the tone paired with sucrose and the tone never paired with sucrose, or a failure to nose-poke). The number of rats excluded for these reasons was very low (n=6). As requested by the Reviewer, we show that their behavior during fear conditioning and the first two extinction sessions did not differ from the other groups (see below). Thus, there is no data to support the claim that the data analysis is biased by the exclusions.

3) Potential non-physiological effects of optogenetic manipulation. The data suggests that 95% of the neurons activated by optogenetic manipulation were not activated by fear conditioning and extinction. The authors need to consider whether the effects they observe are non-physiological effects.

We have added a paragraph to our Discussion to thoughtfully consider this point. While we acknowledge that optogenetic stimulation may produce supraphysiological effects, it is unlikely that the effects we observe are nonphysiological. The criticism that 95% of the neurons activated by optogenetic manipulation were not activated by fear conditioning+extinction rests on a faulty assumption that optogenetic stimulation activates 100% of the BLA-NAc circuit. However, it should be noted that viral expression of opsins in the BLA targeted only a subset of BLA cells, and thus only a portion of the BLA cells that project to the NAc. It is also important to note that our CTB infusions targeted only a small portion of the NAc, and thus identified only a subset of the BLA cells that project to this area. It is likely that our optogenetic manipulation likely targeted a portion of cells not activated by fear conditioning and extinction, but not nearly to the dramatic degree indicated here (95%). In addition, the magnitude of enhanced extinction persistence seen with stimulation (Figure 5D) is highly similar to the magnitude of enhanced extinction persistence seen with reward conditioning (Figure 2D), and these conditions that lead to greater persistence of extinction memory are associated with stronger activation of the IL but not PL (Figure 6C-F). Thus, the effects of optogenetic stimulation strongly parallel the effects induced by natural behavior.

As suggested by Reviewer 2, we have added text to the Discussion to consider how behavior-specific expression of opsins could be used to better restrict stimulation to the portion of the BLA-NAc circuit that is relevant to extinction. We greatly appreciate this suggestion.

4) One of the reviewers raised various concerns in the experimental design and data analysis regarding the conclusion that the BLA-NAc circuit is recruited by fear extinction. See below for the details.

It is unclear whether this is a reference to Reviewer 1, point 3, or Reviewer 2, point 1. We have made extensive revisions in response to both comments. Please see below for the details.

Reviewer #1:

1) For Figure 1, it is not clear whether the increase in cfos labeled BLA cells occurs preferentially in the NAc projecting cells or generally in the BLA. While the authors mention in the fifth paragraph of the subsection A BLA-NAc circuit is recruited by fear extinction that the a third of the cfos labeled cells are NAc projecting, they need to use a more rigorous statistical test to demonstrate that recruitment of this pathway is actually selective.

This is an important point, and we appreciate the Reviewer asking us to provide additional clarification. It was never our intention to claim that the activation of the BLA-NAc pathway is selective to extinction. While we did use the term specific to describe the recruitment of the BLA-NAc pathway during this behavior, we were using this to describe the anatomical and temporal specificity of our manipulations. Indeed, it is clear that the double-labeling of cFos and CTB (Figure 1D), showing activation of the BLA-NAc pathway, strongly parallels the elevated levels of cFos observed in all cells of the BLA (Figure 1C). We have modified the language of the text in our manuscript to clarify what we mean by specific, and we also greatly reduced our use of this term.

To better address this issue, we conducted an additional experiment (Figure 1—figure supplement 2). We examined the activation of this pathway by fear conditioning (Fear Cond group), and the activation of this pathway by lower levels of extinction training (Short ext group). We found that the BLA-NAc pathway was activated by fear learning. However, more importantly, and more relevant to our claims, we found that one session of extinction training recruited this pathway to a lesser degree than two sessions of extinction training. Critically, we also found that there is a strong, negative association between the extent to which the BLA-NAc pathway is activated and the fear expressed (Figure 1—figure supplement 2F).

It is important to note that brain circuits are rarely, if ever, behaviorally specific. Thus, the finding that the BLA-NAc pathway is recruited by fear conditioning does not detract from its role in fear extinction. Our data demonstrate clearly that optogenetic activation of this pathway enhances the persistence of extinction memory.

We have added a paragraph to the Discussion (third paragraph) to consider the surprising observation that the BLA-NAc pathway is activated by fear conditioning. In this paragraph, we explicitly state that the BLA-NAc circuit is not selective for fear extinction and we offer two possible explanations for why this circuit may be activated by both behaviors.

2) Related to the counterconditioning data presented in Figure 2, the authors mention in the Methods that "Rats that never displayed reward-seeking (failure to nose-poke) or discriminative reward conditioning (failure to nose-poke significantly more or faster to the CS paired with reward than to the neutral CS) were excluded from all analyses." This is potentially a major issue as they are selectively removing animals from one group. This could bias their results in the counterconditioning group such that the animals in this group have reduced fear specifically because these animals were removed and not because the counterconditioning enhanced extinction memory retention. For example, it is possible that animals that couldn't learn reward seeking had higher fear levels or more spontaneous recovery of extinction. The authors need to do something to address this problem. One possibility is to identify animals that would be excluded and then do extinction training and compare these animals that would have been excluded to a normal group of extinction animals to see if there are differences in spontaneous recovery. If not, then there is not a problem with the exclusion criteria.

This is an important issue to address. We now report the numbers of these rats excluded for the three experiments affected by this criterion (subsection Reward conditioning, second paragraph). As suggested by the Reviewer, we examined their freezing behavior on Days 1-3 of the experiment, and did not observe any difference in fear acquisition or extinction during this period. These data are shown in Author response image 1. It is clear that the freezing behavior on Days 1-3 does not differ between the excluded rats (Ext-RC and did not learn RC) and the included rats (Ext-RC and Learned RC) (Mann-Whitney, p = 0.46).

Author response image 1.

Author response image 1.

DOI: http://dx.doi.org/10.7554/eLife.12669.020

A) Related to the above comment, they should state somewhere how many animals were excluded. Also, for the data in Figure 2B, the authors should clarify whether this does or does not include excluded animals.

The numbers of rats excluded and the reasons for exclusion are now specified in the second paragraph of the subsection Reward conditioning. We now clarify in the Methods (subsection Statistical methods, second paragraph) that no data from excluded animals were included in any graph or analysis.

3) The authors should clarify in the Methods section whether the exact same box was used (including the availability of all apparatuses in box except reward) for both ext-ext and ext-RC groups? This is important as differences in the box could produce differences in extinction.

This information is now provided in the Methods. To summarize, the reward port was present as an environmental cue for all Context B sessions for all groups in experiments where reward counterconditioning was used. The only difference was whether reward was delivered through the port during the session.

4) There are a number of issues with data presented in Figure 3:

A) It is not clear why there is an inset to compare Ext-RC and RC groups. Ext-Ext, Ext-RC and RC groups should be in a single graph with appropriate statistical comparisons.

We used insets simply to highlight the relevant comparisons, and also draw attention to the critical comparison of interest (Ext-Ext vs. Ext-RC). The appropriate statistical comparisons are reported in the Results and figure caption.

B) A negative control group should be included here to determine whether there is an increase above baseline in fos activation. One of the control groups used in Figure 1 would be sufficient.

The Reviewer is questioning whether the cFos activation in the Ext-Ext group is above baseline (the Nave group). This comparison was previously included in Figure 1, but has also been examined in Figure 1—figure supplement 2 of the revised manuscript. The expression of cFos in the BLA of Nave rats is extremely low and the expression of cFos cells in the Ext-Ext group is well above baseline.

C) For the BLA data in 3B and C, representative images should be shown somewhere.

We have added representative images as Figure 3C (bottom panel).

D) One possibility is that extinction (or reward) preferentially activates NAc projectors early in learning and that the differences you see between extinction and reward learning are due to that and not because the extinction and reward are summating to activate more cells. It would ideal to run another group where tissue is collected after 1 day of extinction to match the single day of reward learning.

Whether NAc-projecting BLA cells are preferentially activated by early or late learning is an important question. As requested, we have added a new experiment presented in Figure 1—figure supplement 2 to address this point. It is clear from this new data that NAc-projecting BLA cells are activated to a greater extent in late extinction as compared to early extinction. Thus, it is highly unlikely that the greater activation of the BLA-NAc pathway in the Ext-RC or RC groups arises because these groups were sacrificed after the first day of learning the reward task.

E) Also need negative control for the NAc Nr4a3 data in Figure 3E as it is not clear whether there is a significant Nr4a3 activation above baseline in the ext-ext group.

This data has been added as Figure 3—figure supplement 3. The software that we used for imaging in Figure 3 was replaced with an updated version with substantial differences. Because we could not image using the same parameters in Figure 3, we could not add data from a Nave group to Figure 3. We performed new labeling of tissue from Nave, Ext-Ext and Ext-RC groups.

5) For the data presented in Figure 5, they should show supplemental data with raw% freezing levels on day 2 and day 60 in supplement as they do for the data in Figure 2.

We apologize for the omission of some of the raw data. The raw % freezing for Day 2 was depicted in Figure 5C of our original submission and it is also depicted in this panel in the revised manuscript. The raw % freezing for Day 60 is now shown in Figure 5—figure supplement 2C. In addition, we have confirmed that all raw freezing levels are depicted in graphs labeled as % Freezing, whereas our measure of spontaneous recovery at remote time points after extinction training is shown in graphs labeled % Fear memory. We have revised our Methods (subsection Pavlovian fear conditioning, last paragraph) to clearly indicate this distinction.

6) Though not absolutely necessary, inhibition of BLA-NAc terminals during extinction would be ideal to directly test whether the BLA-NAc projection participates causally in generating extinction. As it stands they present correlative evidence that the circuit is engaged, but the paper would much more compelling if they could make a causal link.

We fully agree that a causal link would be compelling. We present evidence that the enhanced recruitment of the BLA-NAc pathway during extinction facilitates long term fear extinction. However, we do not claim the necessity of this pathway for fear extinction learning.

Reviewer #2:

1) Specificity of the recruitment of the BLA-NAc circuit during extinction and/or reward conditioning.

The authors' data largely rely on an observed increase following extinction or reward conditioning in double labeled cells in BLA using c-fos and CTB+ to mark activated cells that project to NAc. However, the authors do not address whether this increase in double labeling could be occurring by chance as a result of simply increasing the number of c-fos positive cells in BLA. In other words, increased double labeling would be expected simply by virtue of increasing the number of c-fos positive cells. If this is occurring by chance, then the evidence for specific recruitment of the BLA-NAc pathway would not be provided. Moreover, the statement that the proportion of activated BLA neurons that project to NAc increases with reward conditioning can't be supported without such statistical testing.

This is an important point also noted by Reviewer 1. It was never our intention to claim that the activation of the BLA-NAc pathway is selective to extinction. While we did use the term specific to describe the recruitment of the BLA-NAc pathway during this behavior, we were using this to describe the anatomical and temporal specificity of our manipulations. Indeed, it is clear that the double-labeling of cFos and CTB (Figure 1D), showing activation of the BLA-NAc pathway, strongly parallels the elevated levels of cFos observed in all cells of the BLA (Figure 1C). We have modified the language of the text in our manuscript to clarify what we mean by specific, and we also almost eliminated our use of this term.

To better address this issue, we conducted an additional experiment (Figure 1—figure supplement 2). We examined the activation of this pathway by fear conditioning (Fear Cond group), and the activation of this pathway by lower levels of extinction training (Short-term ext group). We found that the BLA-NAc pathway was activated by fear learning. However, more importantly, and more relevant to our claims, we found that one session of extinction training recruited this pathway to a lesser degree than two sessions of extinction training. Critically, we also found that there is a strong, negative association between the extent to which the BLA-NAc pathway is activated and the fear expressed (Figure 1—figure supplement 2F).

It is important to note that brain circuits are rarely, if ever, behaviorally specific. Thus, the finding that the BLA-NAc pathway is recruited by fear conditioning does not detract from its role in fear extinction. Our data demonstrate clearly that optogenetic activation of this pathway enhances the persistence of extinction memory.

2) Potential non-physiological effects of optogenetic manipulation.

The authors report that only 5% of the NAc-projecting BLA neurons were double-labeled by c-fos and CTB+. This implies that 95% of the neurons activated by optogenetic manipulation were not activated by fear conditioning and extinction.

This is not an accurate statement. While it is true that we found that 5% of the NAc-projecting BLA cells were double-labeled, this is an underestimate of this population. The CTB infusions target only a small portion of the NAc, and thus identify only a small subset of the BLA cells that project to this area. In addition, viral expression of the opsin in the BLA targets only a portion of the BLA, and thus only a portion of the BLA cells that project to the NAc. It is correct that our optogenetic manipulation likely targeted a substantial portion of cells not activated by fear conditioning and extinction, but not nearly to the dramatic degree indicated here (95%).

The authors need to consider whether the effects they observe are non-physiological effects (essentially activating neurons not normally activated during the relevant behavior) given that they don't know much about the response properties of most of the neurons they are activating optogenetically. This type of issue applies to many (if not most) studies employing optogenetic methodology, but it is one that I think we all need to worry about more.

We fully agree with these statements and have added a new paragraph to the Discussion to acknowledge this shortcoming (twelfth).

A missing link in this paper is the specific activation only of those BLA cells that are activated by either extinction or reward conditioning. Approaches for accomplishing this type of manipulation are being developed, but it is not clear whether such approaches will work in these experimental paradigms. Nonetheless, recent work from Redondo et al. and Gore et al. both accomplished this type of manipulation in BLA, and these papers probably should have been discussed in the paper, as well as the recent paper from Namburi et al., which, though not using the type of manipulation used by Redondo and Gore, is also highly relevant.

We agree with the Reviewer and have added citations for these three references in the Discussion. In addition, we now acknowledge that activity-dependent expression of opsins is an appealing approach for overcoming the non-physiological effects of stimulation.

3) Evaluation of physiological effects of optogenetic stimulation in anaesthetized rats.

I was disappointed that the examination of modulation in neural activity that could result from activation by optogenetic stimulation was done in anaesthetized rats. I understand why the authors may have done this for c-fos assays, but electrophysiology could have been performed in awake animals and short latency changes in activity could be observed in the absence of behavioral confound issues. Further, the authors could also inactivate the BLA while photoactivating terminals in NAc to test whether antidromic activation is playing a role. While I would not insist that the authors re-do all of these experiments, appropriate text needs to be added to the Discussion given that the findings may not hold in the absence of anaesthesia.

We have now added a paragraph to the Discussion (thirteenth paragraph) to explicitly acknowledge that quantitative findings may not hold in the absence of anesthesia. We also provide citations showing that cFos in the NAc and IL is not impacted by isoflurane anesthesia in other studies.

4) Accessibility of the manuscript.

I found the manuscript a difficult read. There is a lot of data, and it is often densely presented. Some of the figure legends are a page long, and many readers just won't engage them. Transitions between paragraphs often lack conceptual links. The Discussion reads in a somewhat rambling way, and parts of it are quite repetitive with the results. It takes many paragraphs for the authors to summarize their data rather having 1 or at most 2 succinct paragraphs followed by focused discussion. Again, I will not insist on changes here, but I think the authors would be well-served to revise the manuscript with these issues in mind; readers will find the work more accessible if they do so.

We thank the Reviewer for these comments; we appreciate the difficulty of presenting substantial quantities of data in an approachable manner. We have thoroughly edited our figure captions to shorten them by removing all redundant details. We have revised both our Results and Discussion sections to be more concise, while also adding in the new data and discussion points requested by all three Reviewers. We have added a brief summary at the start of the Discussion and removed redundant summary statements from the remainder of the Discussion.

Reviewer #3:

In a first series of experiments, the authors performed double labeling experiments with retrograde tracer and cFos staining to show that the BLA-NAc circuit is recruited by fear extinction. However, I'm not fully convinced by the authors' implication that fear extinction activated extra NAc-projection neurons in BLA compared with the Fear group (Figure 1C and D). This is an unfair comparison for the following reasons. First, the authors chose to perfuse the animals 1 hr after the final behavior session. cFos signals usually peaks at 1.5~2hr after the behavior onset.

We performed an additional experiment to test this. We trained additional rats with two extinction sessions (as per Figure 1A) and harvested the brains either 1 or 1.5 hr following the last extinction session. As shown in Figure 1—figure supplement 1D, cFos protein expression in the BLA was significantly lower at 1.5 hr post-extinction than at 1 hr post-extinction.

It should also be noted that while reward-induced cFos mRNA expression in the BLA peaks 1.5 hr after behavioral onset and declines thereafter, cFos protein expression in the BLA reaches its peak at 1.5 hr after behavioral onset and remains at its asymptotic level for at least 30 min beyond this (see Xiu et al., Nat. Neurosci., 2014). Because our extinction sessions last approximately one hour and we sacrificed the rats one hour following this, we examined cFos expression at roughly two hours after behavioral onset, a time point consistent with the expected peak of cFos protein expression in the BLA.

(I could not find details for the behavior protocol. How long is the extinction session? How many trials does it consist? Such essential information is missing from the Methods.),

We apologize that this information was not included in the Methods. We have revised the text to explicitly state the length and the total number of trials in the fear conditioning, extinction, and recall sessions (subsection Pavlovian fear conditioning, last paragraph).

As fear recall session perhaps lasts much shorter than fear extinction, it is likely that less cFos signals in the Fear group was simply due to a shorter expression time from the stimulus onset.

The Reviewer has made an astute observation, noting that the lower levels of activation of the BLA-NAc pathway in the Fear recall group compared to the Long ext group (formerly the Ext group) could be because these groups spend different amounts of time in the chamber. To address this, we added a new experiment (Figure 1—figure supplement 2) in which we compared activation of the BLA-NAc pathway in a group of rats that received one day of extinction training (Short ext group) to activation of this pathway in a group of rats that received two days of extinction training (Long ext group). Importantly, the brains from both groups of animals were collected after the same behavioral experience (extinction lasting roughly 30 min); they differed only in whether they also experienced an extinction session the day before. We found that one session of extinction training recruited the BLA-NAc pathway to a lesser degree than two sessions of extinction training. Critically, we also found that there is a strong, negative association between the extent to which the BLA-NAc pathway is activated and the fear expressed (Figure 1—figure supplement 2F).

Second, the fear extinction session consists many more trials than the fear recall session, so should naturally induce more signals. It will be useful to compare the percentage of double-labeled neurons relative to cFos+ neurons following fear recall and fear extinction. The authors showed 31% for the extinction group. Is the percentage lower for the recall group?

As we note above, our new data show that session length does not determine the degree of activation of the BLA-NAc pathway. The Reviewer suggests that we could compare the percentage of the BLA-NAc pathway that is activated under different conditions. It is 31% for the Long ext group and 37% for the Fear recall group. In general, we find that any condition that activates the BLA-NAc pathway activates ~1/3 of the pathway. We do not understand why this occurs. It may be related to the fact that CTB infused into the NAc only labels a portion of the pathway. Alternatively, it may be that the number of cells activated by learning in the BLA is the result of a conserved, competitive process (Han et al., Science, 2007), and that the downstream impact in the NAc reflects this conserved process.

To rule out the antidromic effect on behavior, a standard way would be inactivating the upstream BLA region while optogenetically activating the terminals in NAc. If the effect still lasted, it would be much more convincing than recording or cfos counting in anesthetized animals. This is technically feasible, as demonstrated by the NAc inactivation experiment in this manuscript.

We agree that this is technically feasible, but we believe that this labor-intensive experiment is unlikely to yield interpretable results. We show that optogenetic activation of BLA terminals in NAc deepens the persistence of fear extinction learning. Temporary inactivation of the BLA strongly impairs extinction learning and long-term extinction memory (Sierra-Mercado et al., Neuropsychopharmacology, 2011). If inactivation of the BLA during extinction learning without optogenetic stimulation impairs long-term extinction memory, then one cannot use this manipulation to determine whether the modulatory effect of optogenetic stimulation is eliminated. It is for this reason that we performed the experiment to characterize the impact of BLA terminal stimulation in the NAc in anesthetized animals. If substantial antidromic activation of the BLA occurred, it should have induced cFos expression in the BLA cells expressing the opsin (eYFP+), but we did not observe this (Figure 6H). This provides strong evidence that there was minimal antidromic activation of the BLA when stimulating BLA terminals in the NAc.

Anesthetized animals are not the most ideal if awake behaving animals can be used. For measuring of IL cFos after BLA-NAc stimulation, the authors should use awake animals, since that's the physiological condition under which behaviors are measured.

It is unclear to use what additional information could be provided by the experiment suggested. We show clearly, in anesthetized rats, that optogenetic stimulation of BLA terminals in the NAc leads to activation of the IL (Figure 6C). We make no claims that this is a quantitative representation of what occurs in awake, behaving rats. We also show, in awake, behaving rats, that the IL is more strongly recruited by extinction training followed by reward conditioning than extinction training alone (Figure 6E). It is this latter point which is the most important and relevant to our claims.

Have the authors analyzed the correlation between the level of extinction and that of reward conditioning at the individual level?

We have performed this analysis, correlating the% Freezing on Day 55 with the latency to nose-poke on Day 5 (after the second day of reward conditioning), across individual animals. As can be seen in Author response image 2, there is no significant correlation (R2 = 0.035). This may be because most rats respond to the CS+ with similar nose-poke latencies when the task is acquired.

Author response image 2.

Author response image 2.

DOI: http://dx.doi.org/10.7554/eLife.12669.021

[Editors' note: further revisions were requested prior to acceptance, as described below.]

In the previous review, the reviewers were concerned that there is no evidence supporting the specificity of the BLA-NAc circuit recruitment during fear extinction and/or reward conditioning. The authors have addressed this concern by removing "specific" from the texts.

Overall, the authors' responses to the above points were judged unsatisfactory. Whether the recruitment of BLA-NAc circuit has any predominant role in fear extinction remains unclear, and it is unclear whether optogenetic stimulation mimics physiological activities. The reviewers thought that these points are central to the present work and it is unlikely that these issues can be addressed simply by removing "specific". Ideally, the specificity of BLA-NAc circuit recruitment should be tested experimentally by showing that there is less c-fos activation of another projection after late extinction.

This criticism pertains to a fundamental issue of whether the BLA-NAc recruitment by extinction is specific. There are several definitions of specificity, and it is incorrect to characterize our response to this criticism as simply removing the word specific from the text.

Specificity may refer to behavioral specificity. We previously performed an additional experiment to show that activation of the BLA-NAc circuit was notspecific to fear extinction; fear conditioning produced a similar activation of this circuit.

Specificity may also refer to anatomical specificity, meaning that only certain outputs of any given brain region are recruited by behavior. It has been argued by the Reviewers that the activation of the BLA-NAc pathway that we reported is not anatomically specific because it simply mirrors overall activation [measured by immediate early gene (IEG) expression] within BLA after extinction learning. However, to argue that activation measured by IEG expression is not related to behavior requires that IEG expression be expressed randomly. However, IEG expression during memory encoding and retrieval forms the basis for tag and manipulate strategies to identify engrams, and is thus a reliable marker for cells that participate in memory formation or retrieval (Josselyn, Keler, Frankland, Nat. Neurosci. Rev., 2015). Our claim is that lengthy extinction training activates a greater proportion of the BLA than is observed in nave rats or rats in the early stages of extinction, including BLA cells that project to the NAc.

It was argued that anatomical specificity should be shown by demonstrating that at least one other BLA projection is not activated by extinction learning. While we agree that the proposed experiment is an interesting idea, this is not a simple experiment. It is not obvious what BLA projection would exhibit little to no cFos activity after fear extinction (particularly because cFos may mark both synaptic strengthening and synaptic weakening), and thus multiple projections would need to be tested. This systematic analysis of different projections from the BLA would be very informative for the field and would, on its own, provide data for a single publication.

The Reviewing Editor suggested that a promising pathway to show the absence of activation by extinction learning might be the BLA-CeM because Namburi et al. (2015) have argued that this pathway is specifically activated by fear learning, not reward learning. It is important to acknowledge two specific considerations regarding this point. First, fear extinction sessions involve both the expression of previously acquired fear as well as the acquisition of extinction. Thus, it is highly likely that the BLA-CeM pathway is activated during fear extinction. Second, although the Namburi et al. paper is often cited as a demonstration of anatomical specificity, this is a mis-interpretation of the findings. The authors delivered retrobeads to either the CeM or the NAc to visualize BLA cells that projected to these brain regions. The findings reported by Namburi et al. hinge on the argument that BLA cells project to exclusively to the NAc or the CeM. However, the mutual exclusivity of these BLA projections was not quantified or demonstrated. It is apparent from Author response image 3 (modified from Figure 1B in Namburi et al.) that a substantial portion of BLA cells project to both the CeM and NAc (shown by orange arrows which indicate cell bodies which contain retrobeads from both CeM and NAc). In this regard, for all of the experiments in Namburi et al., a substantial proportion of NAc projectors or CeM projectors actually projected to both targets. Thus, this paper should not be used to support claims of anatomical specificity.

Author response image 3.

Author response image 3.

DOI: http://dx.doi.org/10.7554/eLife.12669.022

It is essential to recognize that our claim that extinction learning recruits a BLA-NAc circuit is supported by multiple findings. For example, the recruitment of this pathway by extinction is strongly related to the degree of extinction (greater pathway activation = less fear; Figure 1—figure supplement 2) and we had already shown that selective activation of the BLA-NAc projection deepens extinction learning (Figure 5). We also observe that activation of the NAc by extinction training (measured via Nr4a3 expression in NAc) is strongly related to the degree of extinction (Author response image 4; greater NAc activation = less fear). If activation of the BLA-NAc pathway was truly the result of chance, then one would not expect to observe a relationship between the magnitude of extinction learning and activation within this pathway. We have added text to consider this point in the Discussion (second paragraph).

Author response image 4.

Author response image 4.

DOI: http://dx.doi.org/10.7554/eLife.12669.023

In addition, it was pointed out, in the previous review, that only 5% of the BLA-NAc circuit was labeled by c-fos while this pathway was activated optogenetically without further specificity. Although the authors point out that ChR2 is expressed in only a fraction of BLA-NAc projections, this does not solve the issue that ~95% of stimulated neurons are not c-fos positive.

An additional concern was raised because we report that extinction learning produces activation of only 5% of the BLA-NAc pathway. However, there are several additional points which are not being considered when making this assertion. First, as we noted in the text, nearly one third of all cFos induced by extinction training is expressed in BLA cells that project to the NAc. This is a large proportion of the cFos induced by extinction training. Second, the projection from the BLA to the NAc is substantial. We have added a new analysis showing that ~27% of the cells in the BLA regions we analyzed have projections to the NAc, a finding consistent with previous studies (McDonald, 1991). We have modified the text of the Results (subsection A BLA-NAc circuit is recruited by fear extinction, fourth paragraph) to include this information.

Regardless, we do agree that optogenetic stimulation cannot precisely model physiological activities under the experimental conditions used, as we are randomly infecting and stimulating BLA neurons with terminals in the NAc. We have provided additional text to more deeply consider this caveat in the Discussion of the paper (fourteenth paragraph).

Furthermore, in response to the reviewer #3's comments regarding c-fos experiments in anesthetized animals (which was not "essential" in the decision letter), the authors state that "it is unclear to us what additional information could be provided by the experiment suggested". We believe that performing c-fos experiments in awake animals is necessary to remedy the concern that the neuronal activity in anesthetized animals might not be normal.

We agree that doing stimulations in awake and anesthetized animals is very different, but both approaches are hampered by different caveats:

In the case of anesthetized recordings, we agree with Reviewer 3 that the isoflurane anesthesia may alter the balance of excitation and inhibition, which could result in false positive cFos (due to disinhibition) or lack of normally activated cFos neurons (due to extra inhibition). However, previous studies looking at cFos expression in the amygdala, infralimbic cortex, nucleus accumbens and other brain areas have not found a significant difference between animals exposed to a room versus animals that undergo isoflurane anesthesia (Smith et al., Neurosci., 2016). Additionally, Figure 6G shows that anesthesia does not alter cFos numbers in the BLA as compared to Nave awake rats, indicating that, in the absence of stimuli, false positive cFos (due to disinhibition) is highly unlikely. It remains possible that anesthesia could increase activity of inhibitory interneurons in the BLA and therefore mask potential antidromic activation of BLA neurons. We have modified our Discussion to acknowledge the important caveats in experiments with anesthetized preparations (twelfth and fifteenth paragraphs).

It is also important to note that other studies have shown that stimulation of the nucleus accumbens in awake animals activates the IL (Vassoler et al., J. Neurosci., 2013), just as we report here in anesthetized animals. Thus, this provides further evidence that our stimulation paradigm produces physiologically relevant effects in circuits known to regulate fear extinction. It is also important to note that our stimulation produced activation of IL only in the IL contralateral to the hemisphere of stimulation, consistent with the finding that the dominant projection of the NAc to the IL is contralateral. It is also important to note that stimulation produced a much smaller activation within PL, consistent with previous findings that the NAc projections to the IL are much greater than to the PL. Finally, we also reported that extinction training activated the IL, but not the PL. We also agree with the comments of Reviewer 3 and now we consider these as potential caveats in the interpretation of the results from the optogenetic stimulation experiments in anesthetized rats. But we also note that there were strong parallels between what we observed in anesthetized rats and what we observed in awake, behaving rats.

Reviewer #3:

The authors have addressed many of the comments and the manuscript has been improved with a good amount of data. However, I 'm surprised that the authors insisted on using c-fos data in anesthetized animals as critical evidence for specific circuit activation.

It is well known that anesthesia strongly alters the excitation/inhibition balance in the brain. Some neurons which are activated under normal physiological conditions could be silenced by unnaturally strong inhibition under anesthetized state, and appear c-fos negative. On the other hand, if the anesthesia hits more heavily on a group of GABAergic neurons that disinhibits other neurons, the latter neurons may appear falsely c-fos positive. Therefore, interpretation of c-fos data from anesthetized animals could be very misleading.

As the author was not able to show that BLA-NAc is selectively activated by extinction, the NAc terminal stimulation experiment became critical in addressing the specific role of the pathway in extinction. The authors took the absence of c-fos signals in YFP+ BLA neurons in anesthetized animals as the only evidence to rule out antidromic effect by the terminal stimulation. While I understand there might be technical issues involved in inactivating upstream BLA region, I do not see why the authors should not perform the c-fos experiment in awake animals, which is much more physiologically-relevant.

As the editor noted above, this experiment (BLA inactivation during stimulation) was not "essential" in the previous decision letter; because it was a non-essential revision and because of the lengthy nature of these experiments, we decided not to pursue this experiment after the first review. We performed the experiments in anesthetized animals because we believed that the anesthesia was likely to interfere less with the cFos induced by optogenetic stimulation in different brain areas than behavior, which itself induces cFos expression in multiple brain circuits. We fully agree with the Reviewer that these are important concerns. We have thoroughly revised the Discussion to provide a fuller and more balanced perspective on the caveats of anesthetized preparations (twelfth and fifteenth paragraphs).

Similarly, activation of IL is an important mechanism the authors proposed to explain why BLA-NAc stimulation facilitates extinction. I am disappointed that this was again only supported by results in anesthetized animals. c-fos experiments in awake animals are totally feasible and not much more tedious than in anesthetized animals. The authors should repeat these two sets of experiments in awake animals.

We fully understand the reviewers concerns. However, again we would like to point out that studies looking at cFos expression in the amygdala, infralimbic cortex and nucleus accumbens have not found a significant difference between animals exposed to the anesthesia room versus animals that undergo isoflurane anesthesia (Smith et al., Neurosci., 2016). Therefore, while we consider the possibility that the increase in cFos+ cells in the IL after BLA-NAc stimulation could be due to false positive cFos (due to disinhibition), we also note that 1) other studies have shown that stimulation of the nucleus accumbens in awake animals activates the IL (Vassoler et al., J. Neurosci., 2013), just as we report here in anesthetized animals, 2) our stimulation produced activation of IL only in the IL contralateral to the hemisphere of stimulation, consistent with the finding that the dominant projection of the NAc to the IL is contralateral, 3) stimulation produced a much smaller activation within PL, consistent with previous findings that the NAc projections to the IL are much greater than to the PL, and 4) extinction training activated the IL, but not the PL. Thus, there were strong parallels between what we observed in anesthetized rats and what we observed in awake, behaving rats. Nonetheless, we have revised the Discussion to fully acknowledge the shortcomings of using anesthesia (twelfth and fifteenth paragraphs).


Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

RESOURCES