Visual Abstract
Keywords: conflict, decision-making, emotion, fear, habenula, motivation
Abstract
Survival depends on the ability to adaptively react or execute actions based on previous aversive salient experiences. Although lateral habenula (LHb) activity has been broadly implicated in the regulation of aversively motivated responses, it is not clear under which conditions this brain structure is necessary to regulate defensive responses to a threat. To address this issue, we combined pharmacological inactivations with behavioral tasks that involve aversive and appetitive events and evaluated defensive responses in rats. We found that LHb pharmacological inactivation did not affect cued threat conditioning (fear) and extinction (safety) learning and memory, anxiety-like or reward-seeking behaviors. Surprisingly, we found that LHb inactivation abolished reactive defensive responses (tone-elicited freezing) only when threat (conditioning) and safety memories (extinction and latent inhibition) compete during retrieval. Consistently, we found that LHb inactivation impaired active defensive responses [platform-mediated avoidance (PMA)], thereby biasing choice behavior (between avoiding a threat or approaching food) toward reward-seeking responses. Together, our findings suggest that LHb activity mediates defensive responses only when guided by competing threat and safety memories, consequently revealing a previously uncharacterized role for LHb in experience-dependent emotional conflict.
Significance Statement
Using emotional memories with opposing valence (negative or positive) to select the appropriate behavior is most valuable for survival when individuals are challenged to retrieve them simultaneously, during conflict. Although the lateral habenula (LHb) processes information about negative and positive events and is involved in guiding emotional behaviors, its contribution during conflict has not been characterized. By combining pharmacological inactivations with behavioral paradigms in rats, including tasks involving retrieval of competing threat and safety memories, our study reveals a previously unknown role for the LHb in driving defensive responses during experience-dependent emotional conflict. Identifying brain regions required for conflict-mediated behavioral responses may be key for understanding how the brain balances information about competing salient experiences to regulate emotional behaviors.
Introduction
In nature, survival in a dynamic environment requires animals to adaptively react or execute actions based on previous salient experiences (Elliot, 2008; Rangel et al., 2008; Namburi et al., 2016; Bravo-Rivera and Sotres-Bayon, 2020). In the laboratory, the regulation of reactive and active behaviors guided by stimuli that signal threat or safety and reward have been studied by using animal model combinations of aversive classical (Pavlovian) and appetitive instrumental conditioning (LeDoux, 2000; Cardinal et al., 2002). Auditory threat (fear) conditioning, in combination with lever pressing to obtain food, has been used to reliably evaluate defensive responses elicited after learning and memory of threat associations (tones paired with shocks) and its extinction (tones paired with omission of expected shocks; Quirk et al., 2000; Sotres-Bayon et al., 2012). After extinction, the conditioned memory of threat and extinction memory of safety, coexist in the brain and compete for control of behavior (Quirk, 2007; Sotres-Bayon and Quirk, 2010; Lacagnina et al., 2019). Other experimental conditions that can be used to study the conflict between threat and safety memories is conditioned latent inhibition, which involves threat association of a tone that was previously associated with safety (Lingawi et al., 2017), as well as more recently developed tasks that involve the use of conflict choice behavior (Bravo-Rivera and Sotres-Bayon, 2020), such as platform-mediated avoidance (PMA; Diehl et al., 2019). The use of these behavioral paradigms can help us characterize how the brain retrieves emotional memories to adaptively choose a defensive behavioral strategy.
The lateral habenula (LHb) has recently attracted much attention for its involvement in the regulation of a variety of behavioral responses triggered by aversive events (Hikosaka, 2010; Lammel et al., 2014; Proulx et al., 2014; Baker et al., 2016), including threat avoidance (Stamatakis and Stuber, 2012; Amo et al., 2014; Vincenz et al., 2017; Trusel et al., 2019; Stephenson-Jones et al., 2020), freezing (Martínez-Canabal et al., 2019), and choice behavior bias (Stopper and Floresco, 2014; Baker et al., 2017). The broad involvement of LHb in processing of aversive events is partly explained by its widely documented increase of activity in response to a variety of adverse stimuli, including those that were initially neutral but that have been conditioned to predict threatening events (Matsumoto and Hikosaka, 2009; Trusel et al., 2019). However, it is not clear whether LHb is necessary to control threat-related behavioral responses ubiquitously. LHb lesions or pharmacological inactivations facilitated (Song et al., 2017), impaired (Thornton and Bradbury, 1989), or had no effect (Vale-Martínez et al., 1997; Shumake et al., 2010; Ilango et al., 2013) on threat avoidance. In addition, LHb contribution to another commonly evaluated defensive response, such as freezing, have been scarcely explored (Heldt and Ressler, 2006). Importantly, although LHb is predominantly involved with learning from negative events (Matsumoto and Hikosaka, 2009; Tian and Uchida, 2015), it has also been shown to signal positive value information (Stamatakis and Stuber, 2012). LHb neurons decrease their activity to positive stimuli, including those stimuli that have been conditioned to predict reward (Matsumoto and Hikosaka, 2009) and events that may signal safety through omission of threat (Li et al., 2019). Thus, given that LHb appears to simultaneously processes information about negative and positive events to guide motivated behaviors, it is possible that this brain region is critically involved under conditions that challenge individuals to convey information about opposing acquired values to adaptably control defensive responses.
To fully characterize LHb requirement in the control of defensive responses, we combined pharmacological inactivations with behavioral paradigms that involve threat stimuli, appetitive events and their competition. Surprisingly, we found that LHb activity is critical to promote reactive (freezing to a tone) and active (avoidance to a tone) defensive response only when threat (conditioning) and safety (extinction and latent inhibition) memories are in conflict.
Materials and Methods
Subjects
A total of 144 adult male Wistar rats (Cell Physiology Institute breeding colony) and weighing 260–280 g were housed in polyethylene cages and maintained on a standard 12/12 h light/dark cycle. Rats were housed individually, handled daily to diminish stress responses and received water ad libitum during all experiments. Rats were kept on a restricted diet (12 g/d) of standard laboratory rat chow to facilitate pressing a lever for sucrose pellets (Bio-Serv). All manipulations and behavioral procedures were performed during the light phase between 7 A.M. and 7 P.M. All procedures were approved by the Institutional Animal Care and Use Committee of the National Autonomous University of Mexico (UNAM) in compliance with the National Ministry of Health guidelines for the care of laboratory animals.
Surgery
Rats were anesthetized with isoflurane inhalant gas and implanted with 23-gauge stainless steel guide cannulas (AM Systems) targeting the lateral region of the habenula (−3.6 mm, AP, ±0.8 mm, −4.2 mm DV with respect to bregma from skull). Cannulas were fixed with dental acrylic cement and anchored with two surgical screws placed on the skull. Stainless steel obturators were inserted into the guide cannulas to prevent clogging until infusions were made. The tips of the cannulas were aimed 0.8 mm above the target structure. After surgery, animals received food and water ad libitum for 7 d to allow full recovery before experiments.
Behavior
Rats were trained to press a lever for sucrose pellets (Bio-Serv) on a variable interval (VI) reinforcement schedule [VI-60 for conditioning tasks as in Sierra-Mercado et al. (2011) and VI-30 for the avoidance task as in Bravo-Rivera et al. (2014)]. All rats received six lever-press training sessions until they reached a minimum rate of 12 presses per minute in their final session. Pressing to obtain food maintains a constant level of activity against which freezing, and avoidance can be reliably measured.
Threat conditioning and extinction
Threat conditioning and extinction tasks were performed as previously described (Martínez-Canabal et al., 2019). Briefly, auditory threat conditioning and extinction was performed in standard operant chambers (Coulbourn Instruments) located inside sound-attenuating boxes (Med Associates) in an isolated testing room. The floor of the operant chambers consisted of stainless-steel bars that could deliver electric foot-shocks. Between experiments shock grids, floor trays and walls were cleaned with soap and water. On day 1, rats were subjected to threat conditioning consisting of five tone presentations (30 s, 4 kHz, 75 dB) that co-terminated each one with a foot-shock (0.5 s, 0.6 mA). On day 2, after conditioning, rats received extinction training consisting of fifteen presentations of unreinforced tones. On day 3, rats were tested for memory retrieval with two tone-alone presentations. In all sessions, the interval between tones was variable with an averaged 2 min.
Conditioned latent inhibition
On day 1, rats received latent inhibition training consisting of fifteen tone-alone presentations (30 s, 4 kHz, 75 dB). On day 2, rats were subjected to threat conditioning, consisting of five tones (30 s, 4 Hz, 75 dB) that co-terminated with a foot-shock (0.5 s, 0.6 mA). On day 3, rats were tested for memory retrieval with two tone-alone presentations. In all sessions, the interval between tones was variable with an average of 2 min.
PMA task
PMA task was performed as previously described (Bravo-Rivera et al., 2014) using standard operant chambers (Coulbourn Instruments) located inside sound-attenuating boxes (Med Associates) in an isolated testing room. The floor of the operant chambers consisted of stainless-steel bars that could deliver electric foot-shocks. Between experiments shock grids, floor trays and walls were cleaned with soap and water. Rats were conditioned to a tone (30 s, 4 kHz, 75 dB) co-terminating with a shock delivered through a grid floor (2 s, 0.4 mA). Rats received nine tone–shock pairings each day for 10 d, with a VI between tones averaging 3 min. A safety square platform (14.0 cm per side) was located in the opposite corner of the lever to allow rats to avoid the shocks. The availability of food on the side opposite of the platform motivated rats to leave the platform during the inter-trial interval, facilitating trial-by-trial assessment of avoidance. On day 11, rats received two tones to test for memory retrieval.
Open field task
Rat locomotor activity in the open field (90 × 90 cm) was assessed by calculating distance traveled in the periphery and center (30 × 30 cm within) of the arena during 10 min. The overall distance traveled and number of entries to the center of the arena were used to assess locomotion and anxiety-like behavior, respectively.
Lever pressing test
Rats were trained to press a lever to receive food pellets on a VI-60 schedule (as described above). Spontaneous presses per minute were calculated to assess reward-seeking behavior during 5 min. We analyzed presses per minute before conditioning (during pretone baseline) taken from rats in the first experiment.
Drug infusion
We used GABA-A and GABA-B receptors agonists, muscimol and baclofen (M&B; Sigma-Aldrich) respectively, to enhance neuronal inhibition, thereby temporarily and reversibly inactivating the target structure. The inactivating drug cocktail was prepared on the day of the infusion using a filtered, physiological saline solution (SAL) as vehicle and infused 10 min before behavioral testing. M&B (50 ng of each drug/0.2 μl per side) or SAL was infused at a rate of 0.2 μl delivered over 45 s into the target structure. Cannulas were connected via polyethylene tubing to 10-μl syringes (Hamilton) driven by a programmable microinfusion pump (KD Scientific). After infusions, injectors were left in place for 2 min to allow the drug to diffuse. Dosages and volumes of GABAergic agonists were based on a previous inactivation study targeting the same brain structure which limited spread to LHb without affecting neighboring areas (Stopper and Floresco, 2014), and a pilot experiment in our laboratory (combining habenula infusions and c-Fos expression) showing that local inactivation of the habenula silenced LHb recruited activity.
Histology
After all behavioral experiments, rats were deeply anesthetized with pentobarbital sodium (150 mg/kg, i.p.) to transcardially perfused with 0.9% SAL. Brains were then harvested and stored in a 10% formalin solution (Sigma-Aldrich) for at least 2 d. Then we switched the brains to a 30% sucrose solution for cryoprotection. Brains were cut in 45-μm-thick coronal sections using a cryostat (Leica CM1520 Cryostat, RRID:SCR_017543) and stained for Nissl bodies with cresyl violet and examined under a bright field microscope (Nikon, H550S) to verify cannula tip placements. Only animals with localized injector tips within LHb were included in statistical analysis; except for one experiment (LHb inactivation after extinction), in which analysis of data included animals where injector tips were localized within or outside the LHb (hit M&B and miss M&B groups, respectively).
Data collection and analysis
All behavioral responses were recorded with digital video cameras (Logitech) and automatically analyzed with a commercial software (ANY-maze, RRID:SCR_014289). Two measures of defensive responses were assessed throughout all experiments: (1) % of time spent freezing and (2) suppression ratio. Freezing was defined as the absence of all movement, except respiration. The amount of time freezing to the tone was expressed as the percentage of the tone duration. We also measured time spent freezing before tone presentations (5 min), during context exposure (pretone freezing). There were little contextual-elicited defensive responses across all experiments (SAL and M&B groups), as evidenced by low levels of pretone freezing (all group averages < 12.03%). In all experiments pretone freezing percentages were not significantly different between experimental and control groups (all p values > 0.05). Matching of animal groups (experimental and controls) for similar levels of freezing responses before local drug infusions were done in all experiments (p = 0.95). A suppression ratio comparing pretone press rates with tone press rates was calculated as follows: (pretone – tone)/(pretone + tone). A value of 0 represents no suppression (low defensive response levels), whereas a value of +1 represents complete suppression of lever pressing (high defensive response levels). Avoidance responses were assessed by calculating the percentage of rats that avoided the footshock by moving on to the platform during the last two seconds of tone presentations and time spent on platform before and after tone presentation. Groups were compared by using, when appropriate, unpaired Student’s two-tailed t tests, one-way or repeated-measures ANOVA followed by post hoc Fisher’s least significant difference test (STATISTICA; StatSoft; RRID:SCR_014213 and Prism; GraphPad Prism RRID:SCR_002798). Alpha was set at p = 0.05.
Results
Although LHb activity has been broadly implicated in the regulation of aversively motivated behaviors (Thornton and Bradbury, 1989; Matsumoto and Hikosaka, 2009; Stamatakis and Stuber, 2012; Amo et al., 2014; Lecca et al., 2017; Song et al., 2017; Vincenz et al., 2017; Martínez-Canabal et al., 2019; Trusel et al., 2019), it is not always necessary for regulating defensive responses to a threat (Vale-Martínez et al., 1997; Heldt and Ressler, 2006; Shumake et al., 2010; Ilango et al., 2013; Song et al., 2017). To systematically evaluate the necessity of LHb under different aversive conditions, we combined pharmacological inactivations with behavioral tasks that involve aversive and appetitive motivations and evaluated defensive behavioral responses in rats.
LHb inactivation does not affect threat or extinction learning and memory
To evaluate the requirement of LHb on threat learning and memory, we pharmacologically inactivated the LHb before auditory threat conditioning on day 1 (Fig. 1A1). We found that inactivation of LHb before threat conditioning did not affect threat acquisition or its retrieval (Fig. 1A2), as indicated by similar levels of defensive responses across groups (day 1, freezing: F(1,10) = 0.71, p = 0.41; lever-press suppression ratio: SAL: t(10) = −0.25, p = 0.80) and the first two-tone trial block of extinction training (day 2, freezing: t(10) = 0.03, p = 0.96; lever-press suppression ratio: t(10) = 0.26, p = 0.79), respectively. Also, LHb inactivation before threat conditioning did not affect extinction acquisition 1 d later or its retrieval 2 d later, as indicated by similar levels of defensive responses across groups in extinction training (day 2, freezing: F(6,60) = 0.61, p = 0.71; lever-press suppression ratio: F(6,60) = 0.52, p = 0.78) and in the memory test (day 3, freezing: t(10) = −0.22, p = 0.82; lever-press suppression ratio: t(10) = 1.12, p = 0.28). Thus, consistent with previous reports (Heldt and Ressler, 2006; Song et al., 2017), our findings suggest that LHb is not necessary for threat learning and memory.
We next investigated the necessity of LHb on threat memory retrieval as well as on extinction learning and memory by pharmacologically inactivating the LHb before auditory threat extinction training (Fig. 1B1). Rats were infused with either SAL or M&B into the LHb on day 2, before threat extinction training. One day later (day 3), rats were tested for retrieval of emotional memory to the tone. We found that inactivation of LHb before threat extinction did not affect retrieval of threat memory or extinction acquisition (Fig. 1B2), as indicated by similar levels of defensive responses across groups in the first block of two-tone trials of extinction training (day 2, freezing: t(18) = −0.35, p = 0.72; lever-press suppression ratio: t(18) = −0.02, p = 0.97) and overall during extinction training (day 2, freezing: F(6,108) = 0.92, p = 0.47; lever-press suppression ratio: F(6,108) = 1.90, p = 0.08), respectively. Additionally, consistent with a previous report (Song et al., 2017), we found that LHb inactivation before extinction training, did not affect retrieval of extinction-mediated safety memory 1 d later, as indicated by similar levels of defensive responses across groups during memory test (day 3, freezing: t(18) = 0.31, p = 0.75; lever-press suppression ratio: t(18) = 0.18, p = 0.85). Thus, these results suggest that LHb is not necessary for threat memory retrieval as well as not necessary for extinction learning and memory. Together our findings indicate that LHb is not necessary for threat and extinction learning and memory.
LHb inactivation impairs defensive responses during extinction-dependent retrieval
To evaluate the necessity of LHb in retrieval events after extinction learning, involving the competition of coexisting conditioned-mediated threat memory and extinction-mediated safety memory, we pharmacologically inactivated the LHb before retrieval memory test on day 3 (Fig. 2A1). Surprisingly, we found that LHb inactivation before memory test, after extinction, abolished defensive responses (freezing and suppressed pressing) to preconditioning levels of the experimental group as compared with control group during memory test (day 3, freezing: SAL: 35.59%: M&B: 8.39%; t(14) = −3.06, p = 0.008; lever-press suppression ratio: SAL: 0.41; M&B: −0.04; t(14) = −3.22, p = 0.006). Based on a previous LHb inactivation study (Stopper and Floresco, 2014) and to further examine the neuroanatomical specificity of the inactivation effect, after histology, data were separated into three groups: one SAL-infused group and two M&B-infused groups. One group represents, a neuroanatomical control, in which placements missed (miss M&B) the targeted brain region (placements included dorsal hippocampus and third ventricle) and another group represents rats where placements directly hit (hit M&B) only in the LHb (day 3, freezing: SAL: 35.59%, miss M&B: 37.64%, hit M&B: 8.39%; F(2,21) = 3.54, p = 0.04; post hoc comparisons: SAL and hit M&B: p = 0.04, miss M&B and hit M&B: p = 0.02, and SAL and miss M&B: p = 0.87; lever-press suppression ratio: SAL: 0.41, miss M&B: 0.39, hit M&B: −0.04; F(2,21) = 5.28, p = 0.01; post hoc comparisons: SAL and hit M&B: p = 0.01, miss M&B and hit M&B: p = 0.01, and SAL and miss M&B: p = 0.94; Fig. 2A2). Results after comparison between experimental (hit M&B) and control groups (SAL and miss M&B) reveal that the effects of inactivation on memory retrieval after extinction were circumscribed to the LHb, but not nearby regions. That LHb inactivation before the retrieval test decreased defensive responses could be interpreted as an impairment in the expression of defensive responses. However, this is unlikely given that LHb inactivation did not impair defensive response expression when performed before conditioning or before extinction training (see day 1 in Fig. 1A2 and day 2 in Fig. 1B2). Another possible interpretation to this result is that LHb inactivation before testing impaired threat memory retrieval. However, this is also unlikely given that LHb inactivation did not impair threat memory retrieval when performed before extinction training (see first two-tone trial block in day 2 in Fig. 1B2). Yet another possibility is that LHb inactivation before the retrieval test facilitated extinction memory thereby biasing the expression of the extinction memory over threat memory. This last interpretation suggests that LHb may be necessary to regulate competing threat and safety memories by promoting defensive responses. But before testing this idea further, we decided to test whether the observed LHb inactivation effect was dependent or not on extinction triggered by the tone (rather than the mere passing of time or context exposure) and also evaluate whether LHb inactivation causes unspecific effects on basic locomotor activity or independent motivated behaviors.
To evaluate the necessity of LHb to memory retrieval without tone-associated extinction, we inactivated LHb before memory tests in rats that were not exposed to the tone during extinction (No-Ext; Fig. 3A1). Similar to the experiment above, on day 1, rats were threat conditioned to a tone. The next day (day 2), rats were put back in the conditioned chamber without tone exposure. Finally, on day 3, rats were infused with either SAL or M&B into the LHb and tested for memory retrieval to the tone. We found that LHb inactivation before memory test without tone extinction, did not affect retrieval of conditioned tone threat memory (Fig. 3A2), as indicated by similar levels of defensive responses across groups during retrieval test (day 3, freezing: t(12) = −0.76, p = 0.45; lever-press suppression ratio: t(12) = −1.51, p = 0.15). This result is consistent with the interpretation that LHb inactivation effect during retrieval test are not because of impairment on the expression of defensive responses or threat memory retrieval to the conditioned tone and that such effect is extinction-dependent to the tone and not the mere passage of time.
Next, in a different group of animals, we tested the effect of LHb inactivation on basic locomotion activity, an innate aversively motivated behavior (exploration in an open field) and an appetitively motivated behavior. We tested this by infusing SAL or M&B into the LHb before an open field task and before a lever pressing test. We found that LHb inactivation does not affect locomotion, anxiety-related (Fig. 3B1,B2) or reward-seeking behaviors (Fig. 3C1,C2), as indicated by similar levels of total distance traveled (t(21) = −0.25, p = 0.80) and entries to the center of the open field (t(21) = 0.49, p = 0.62), as well as similar levels of presses per minute to obtain food (t(10) = 0.04, p = 0.96), respectively. These control experiments suggest that LHb inactivation (on its own) does not affect general movement, hunger, motivation to explore related to anxiety-like behavior or reward-seeking behavior.
LHb inactivation impairs defensive responses during latent inhibition retrieval
Together, our above results are consistent with the idea that rather than being necessary for simple task performance (freezing or not to the tone), LHb-mediated activity is crucial for flexible and adaptive behaviors during more complex situations in mammals (Baker et al., 2017). Threat and extinction learning and memory as well as expression of defensive responses by themselves may represent relatively simple situations as compared with flexibly selecting the adaptive emotional memory (threat or safety) to control (promote or suppress) the expression of defensive behaviors. Such a situation occurs when coexisting threat and safety memories compete for control of behavior after extinction training. To further test the idea that LHb is necessary in conditions where coexisting threat and safety memories compete for control of behavior, we switched the order of opposing emotional learning experiences (safety learning followed by threat learning rather than threat learning followed by safety learning) by using latent inhibition (Fig. 4A1). To do this, on day 1, rats were either trained to acquire a latent inhibition-mediated safety memory by presenting tones without foot-shocks (latent inhibition group: LI) or simply placed in the conditioning chamber (no tones or foot-shocks; no latent inhibition group: No-LI). On day 2, both group of rats were threat conditioned to the tone. One day later (day 3), rats were tested for memory retrieval to the tone. As expected, we found that preexposure to a tone, weakened subsequent threat conditioning to tones (Fig. 4A2), as indicated by lower defensive response levels of the LI group with respect to No-LI group at the beginning of conditioning (first two-tone trial block; freezing: No-LI: 22.30%; LI: 9.03%; t(21) = −2.16, p = 0.04; lever-press suppression ratio: No-LI: 0.32; LI: −0.15; t(21) = −2.64, p = 0.01). On day 3, both groups showed similar defensive response levels (freezing: t(21) = −0.33, p = 0.74; lever-press suppression ratio: t(21) = −0.98, p = 0.33). This result suggests that cued-mediated latent inhibition leads to the formation of a safety memory that retards conditioning learning to the tone. Next, to evaluate the necessity of LHb during the competition of coexisting latent inhibition-mediated safety memory and conditioned-mediated threat memory, we pharmacologically inactivated the LHb before a postconditioning memory test (Fig. 4B1). On day 1, rats were preexposed to the tone. The next day (day 2), rats were conditioned to the tone by paring tones with foot-shocks. Finally, on day 3, rats were infused with either SAL or M&B into the LHb and tested for memory retrieval to the tone. Similar to infusion during retrieval after extinction, we found that LHb inactivation before memory test, after conditioning, decreased defensive response levels of the experimental group as compared with control group during memory test (day 3, freezing: SAL: 61.00%, M&B: 26.09%; t(11) = −2.80, p = 0.01; lever-press suppression ratio: SAL: 0.65, M&B: 0.22; t(11) = −2.25, p = 0.04; Fig. 4B2). Since we ruled out above that LHb inactivation impairs the expression of defensive responses and threat memory retrieval, this finding supports the idea that LHb inactivation before the retrieval test biased toward facilitated the expression of the latent inhibition-mediated safety memory over the conditioned-mediated threat memory. This last interpretation suggests that, independently of when those opposing emotional memories are formed (safety before threat memory or threat before safety memory), LHb is necessary to regulate competing and coexisting threat and safety memories by promoting defensive responses to ultimately exert control over adaptive behaviors.
LHb inactivation switches choice behavior bias from avoidance to reward-seeking
Besides influencing adaptive defensive responses triggered by threats like freezing (this study and Martínez-Canabal et al., 2019) and avoidance (Thornton and Bradbury, 1989; Tomaiuolo et al., 2014; Trusel et al., 2019), LHb activity has been recently implicated in biasing choice behavior (Stopper and Floresco, 2014; Baker et al., 2017; Mathis et al., 2017). Therefore, using PMA task (Bravo-Rivera et al., 2014; Diehl et al., 2019; Bravo-Rivera and Sotres-Bayon, 2020), we tested the effect of LHb inactivation when rats are challenged to choose between taking action to avoid a threat or taking action to approach food guided by competing coexisting threat and safety memories. After being trained to press a lever to obtain food, rats were trained for 10 d to learn to avoid a threat (foot-shock) signaled by a tone, by stepping into the safe platform (Fig. 5A). During early PMA training (day 2), rats acquired classical conditioning (tone-shock threat association), but barely any instrumental learning (tone-platform safety association), as indicated by moderate levels of freezing and relatively low levels of avoidance responses (t(28) = 0.42, p = 0.67; Fig. 5B), respectively. In contrast, by late PMA (day 10), freezing responses remained similar to early PMA (34.49% on day 2 vs 44.71% on day 10; t(28) = −1.56, p = 0.12), but avoidance responses dramatically increased (30.00% on day 2 vs 83.33% on day 10; t(28) = −4.67, p < 0.00006), as indicated by moderate levels of freezing and high levels of avoidance responses (freezing: 44.71% and avoidance: 83.333%; t(28) = −4.95, p < 0.000006). These results suggest the formation of a tone threat memory occurs during early PMA, whereas the establishment of a tone safety memory during late PMA. Finally, the next day (day 11), rats were infused with either SAL or M&B into the LHb and tested for choice behavior (avoid or approach to obtain food) guided by competing threat and safety memories. Notably, we found that LHb inactivation before PMA retrieval test, impaired defensive responses, as indicated by decreased freezing and avoidance responses of the experimental group as compared with control group during PMA test [freezing: SAL: 29.85%, M&B: 5.22%; t(13) = −2.73, p = 0.01 (Fig. 5C); avoidance SAL: 59.26%, M&B: 15.39%; t(13) = −3.00, p = 0.01 (Fig. 5D1)]. Although showing a similar decrease trend, averaged lever press suppression ratio during test was not significantly different after inactivation (SAL: 0.63, M&B: 0.25; t(13) = 1.85, p = 0.08; Fig. 5C, inset). However, analyzing the percent time spent on the platform during the tone and the suppression ratio in 6-s bins, revealed that LHb inactivation blocked both avoidance and suppression ratios (i.e., inactivation facilitated lever press suppressing during tone compared with pretone) compared with animals in the control group [time in platform: F(1,13) = 7.50, p = 0.01; post hoc comparisons: −6 to −1 s, p = 0.71; 0–6 s, p = 0.23; 7–12 s, p = 0.0048; 13–18 s, p = 0.0008; 19–24 s, p = 0.007; 25–30 s, p = 0.02 (Fig. 5D2); suppression ratio: F(1,13) = 6.55, p = 0.02; post hoc comparisons: 0–6 s, p = 0.32; 7–12 s, p = 0.11; 13–18 s, p = 0.0042, 19–24 s, p = 0.03; 25–30 s, p = 0.44 (Fig. 5D, inset)]. In sum, LHb inactivation biased the ability to actively choose between avoiding a threat or approaching food, toward driving reward-seeking behavior, suggesting that LHb is necessary to bias choice toward the promotion of defensive responses when competing threat and safety memories guide motivated behavior.
Discussion
We investigated the conditions under which LHb is necessary to regulate defensive responses to a threat. By combining pharmacological inactivations with various behavioral paradigms in rats, including tasks that involve simultaneous retrieval of competing threat and safety memories, our study reveals a previously unknown role for the LHb in defensively responding to a cue that predicts outcomes with opposing emotional valences (threat and safety) during conflict. These findings add to a growing body of evidence showing that LHb is involved in the regulation of aversively motivated behaviors and highlight emotional conflict as a condition under which this brain region is critical to promote defensive responses.
LHb promotes defensive strategies during threat/safety memory conflict
Even after successful extinction learning to threat, conditioned defensive responses often return with the simple passage of time (Rescorla, 2004; Sotres-Bayon et al., 2006), even after a single day (Quirk, 2002). By using c-Fos as neural activity marker, a previous study identified that high LHb activity is positively correlated with high threat recovery after extinction (Martínez-Canabal et al., 2019). Consistently, in this study, we found that LHb inactivation prevents the recovery of extinguished defensive responses. Together, these findings indicate that LHb is not only recruited but is necessary to prevent the expression of the extinction memory thereby allowing defensive responses to return after extinction.
LHb activity may normally prevent the retrieval of safety memories in the service of driving defensive responses by suppressing downstream structures involved in appetitive motivated behaviors. A recent study found that optogenetic stimulation of dopaminergic activity in the ventral tegmental area (VTA), a prominent LHb projection site, facilitates extinction memory (Salinas-Hernández et al., 2018). Another recent study showed that chemogenetic inhibition of serotonergic activity of dorsal raphe receiving LHb input provides animals with resilience during aversive conditions (Varga et al., 2003; Andalman et al., 2019). Because LHb is known to potently inhibit brainstem dopaminergic and serotoninergic activity (Varga et al., 2003; Matsumoto and Hikosaka, 2007; Lammel et al., 2012; Andalman et al., 2019), it is possible that suppressing LHb activity disinhibits these monoaminergic pathways thereby facilitating retrieval of safety memories (extinction and latent inhibition) and resilience in aversive conditions. In line with these findings, we suggest that LHb activity normally prevents expression of the extinction memory possibly by inhibiting VTA dopaminergic activity in the service of signaling the prevailing threat memory during recovery. This interpretation is further consistent with recent findings that indicate that LHb activity increases under aversive conditions, leading individuals toward negative expectations (Shabel et al., 2019). Furthermore, blockade of LHb activity with ketamine results in antidepressant effects (Yang et al., 2018; Cui et al., 2019) and decreased LHb activity mediated by enhanced neurogenesis prevents threat recovery (Martínez-Canabal et al., 2019). Thus, we suggest that when LHb is suppressed (with pharmacological inactivation, ketamine or enhanced neurogenesis), the negative expectation signal (worse than expected or “pessimism”) is blocked (likely by disinhibiting monoaminergic pathways involved in motivation), thereby allowing individuals to be able to explore other options such as approaching food when available.
Extinction allows to evaluate how coexisting threat and extinction memories compete for the control of defensive responses (Rescorla, 2001; Myers and Davis, 2002; Quirk, 2002; Quirk and Mueller, 2008; Herry et al., 2010; Martínez-Canabal et al., 2019), and our findings suggest that the LHb is a critical brain region necessary to promote defensive responses during retrieval of conflicting threat and extinction memory. This interpretation is consistent with the idea that LHb activity is shaped by previous aversive and appetitive emotional associations (Wang et al., 2017) and that experience-dependent modifications in this brain region are necessary for the selection of defensive responses (Amo et al., 2014). Together, these findings suggest the possibility that LHb is involved in promoting defensive responses in conditions where memory retrieval is guided by coexisting previous aversive and appetite experiences. Another condition that allows us to evaluate the competition of threat and safety memories, although in the inverse order, is following latent inhibition. We found that independently of the order of acquisition of threat and safety learning, LHb is necessary to guide defensive responses mediated by the competition of coexisting emotional experiences (threat vs safety or safety vs threat). Thus, together these results indicate that, LHb may not mediate recovery of extinguished defensive responses per se but rather the promotion of threat-related behaviors in retrieval events involving competition of threat and safety memories. Further support for this conclusion, could include experiments that involve testing cued memory retrieval after extinguishing in a different context, as well as assessing threat/safety conflict retrieval using two separately trained cues (e.g., tone for threat and light for safety), rather than one (same tone for threat and safety).
In future studies, it will be important to characterize how information about threat and safety memories are integrated at the LHb to regulate defensive responses during conflict. LHb receives strong projections from regions of the medial prefrontal cortex that are involved in dual control of defensive responses (Kim and Lee, 2012). The prelimbic prefrontal region promotes conditioned defensive responses, whereas the infralimbic prefrontal region suppresses them (for review, see Sotres-Bayon and Quirk, 2010). Further, recent studies showed that prefrontal connectivity with LHb is crucial for flexibly responding to learned information (Mathis et al., 2017; Mathis and Lecourtier, 2017). This raises the possibility that a prefrontal-habenular circuit may flexibly control defensive responses when threat and safety memories are in conflict.
LHB promotes defensive responses during conflict-mediated choice behavior
Our finding that LHb is necessary for retrieval of PMA is consistent with previous studies that show that LHb is necessary for avoidance learning (Wilcox et al., 1986; Thornton and Bradbury, 1989). However, PMA differs from traditional avoidance tasks in that it uses choice behavior to evaluate competing emotional memories during conflict (Bravo-Rivera et al., 2014; Diehl et al., 2019; Bravo-Rivera and Sotres-Bayon, 2020). During PMA training, a platform acquires a positive motivational value (safety) while the grid acquires a negative value (threat). Then rats are challenged, during PMA retrieval (no shock delivered), to decide, guided by competing emotional memories signaled by a tone, whether to step onto the safe platform or press a lever to obtain food. Normally, rats choose to avoid the shock by stepping into the platform, however LHb inactivated rats pressed the lever to obtain food despite the threat. This finding suggests that LHb is necessary to promote defensive responses over reward-seeking behavior during conflict choice guided by memories with opposing motivational valences (threat and safety memories).
A previous study reported increase activity of dopaminergic neurons that allow successful avoidance responses (Oleson et al., 2012). The LHb inhibits dopaminergic VTA activity, through GABAergic neurons in the tail of this brain structure (the rostromedial tegmental nucleus), promoting defensive responses, thereby putting a “break” on reward-seeking (Jhou et al., 2009; Quirk and Sotres-Bayon, 2009; Proulx et al., 2018). Our pharmacological inhibition of the LHb may allow disinhibition of VTA dopaminergic activity leading to a facilitation of reward-seeking thereby making the individual more prone to risky behaviors. This is consistent with a previous study showing that LHb inactivation increased hesitation to make a choice between risky reward options associated with different subjective values (Stopper and Floresco, 2014) and the notion that LHb is involved in guiding survival decisions based on stimuli with learned motivation value (Hikosaka, 2010; Baker et al., 2016). Thus, our PMA findings support the notion that LHb is critical for biasing choice behavior mediated by value-based decision-making and highlight its fundamental role in promoting defensive behavioral strategies during conflict-mediated choice behavior.
LHb as a critical node in emotional conflict
Overall, our study reveals that emotional memory conflict is a fundamental survival condition under which LHb is required to promote defensive strategies. This conclusion is consistent with the emerging notion that LHb acts as a critical node in the control of emotional behaviors guided by aversive events in health and disease, at least in part, mediated by regulating downstream midbrain dopaminergic and serotoninergic structures (Hu et al., 2020). We propose that during emotional conflict, LHb activity is required to bias experience-dependent emotional behavior toward defensive behavioral responses and away from reward-seeking behavior, likely by suppressing downstream structures involved in appetitive motivated behaviors. Accordingly, a lack of activity in LHb during emotional conflict results in a shift toward reward-seeking behavior and away from defensive responding, likely through disinhibition of downstream structures involved in appetitive motivated behaviors. Identifying the brain regions embedded in a complex network that are required for conflict-mediated behavioral responses, may be key for understanding how the brain balances information about competing emotional memories to adaptatively regulate emotional behaviors in health and disease.
Acknowledgments
Acknowledgements: We thank Ana Peñas-Rincón for technical assistance in avoidance experiments and Gregory J. Quirk, Christian Bravo-Rivera, and Leticia Ramirez-Lugo for helpful discussions and comments on this manuscript.
Synthesis
Reviewing Editor: Quentin Pittman, University of Calgary
Decisions are customarily a result of the Reviewing Editor and the peer reviewers coming together and discussing their recommendations until a consensus is reached. When revisions are invited, a fact-based synthesis statement explaining their decision and outlining what is needed to prepare a revision will be listed below. The following reviewer(s) agreed to reveal their identity: Sheri Mizumori. Note: If this manuscript was transferred from JNeurosci and a decision was made to accept the manuscript without peer review, a brief statement to this effect will instead be what is listed below.
While it has been previously shown that the LHb drives fear in most, but not all, paradigms, exploring its role in fear inhibition memories has not been systematically tested, as it is here. While it is generally thought that the lateral habenula serves as an aversion signal, its contribution to behaviors such as threat is not clear. Here it is shown that the lateral habenula becomes involved only in certain threatening (i.e. aversive) situations, and that is when there are competing memories (e.g. threat vs safety).
Both reviewers agree that your conclusions are solid and your paper makes a useful contribution to the field without the need for additional experiments. Thus, it is potentially acceptable pending attention to a number of the critical suggestions for improvement that involve elaboration on some of the themes in the intro/discussion, increasing the clarity of the graphs and visual abstract, correcting the typographical errors and providing missing information. The two reviews that follow clarify these deficiencies:
Reviewer 1.
The lateral habenula (LHb) has long been implicated in negative signaling and guiding behavioral responses following aversive events. However, the role of the LHb in the regulation of defensive responses is not clear. Given that the LHb also has important roles in positive signaling, the authors aimed to characterize the LHb’s role in influencing defensive responses during competing threat and safety memories. An elegant series of experiments combined pharmacological inactivation with strategic behavioral paradigms that involved threatening stimuli and appetitive motivation. The first experiment showed that LHb inactivation prior to auditory threat conditioning did not impair threat learning and memory. The second experiment showed that LHb inactivation prior to extinction training following threat conditioning did not impair threat memory retrieval or extinction learning and memory. A third experiment showed that LHb inactivation prior to retrieval memory and following extinction training facilitated extinction memory, more so than controls. The fourth experiment showed that inactivating the LHb prior to the memory test in rats that were not exposed to the tone during extinction did not affect retrieval of conditioned tone threat memory. In the fifth experiment, LHb inactivation prior to an open field task and lever pressing test did not affect locomotion or motivation. The sixth experiment used a latent inhibition paradigm to assess whether or not the LHb is necessary in conditions where threat and safety memories are in competition. Inactivating the LHb prior to the post-conditioning memory test revealed a decrease in defensive response levels. Lastly, the seventh experiment used a platform-mediated avoidance (PMA) paradigm to test choice behavior in the face of competing threat and safety memories. LHb inactivation prior to the PMA retrieval test resulted in impaired defensive responses. The authors concluded that the LHb mediates defensive responses but only when threat and safety memories compete to bias choice outcomes.
General comments: The traditional view that the LHb primarily serves to signal aversive cues is inadequate. In this study, the results of the specific combination of behavioral assessments generated compelling evidence that there are specific task conditions that require the LHb to guide memory-driven behaviors: critical for LHb engagement is the presence of competing threat and safety memories. This novel insight can help to explain the otherwise seemingly disparate LHb behavioral results, and it can be used to guide future LHb analyses, especially those relevant to clinical conditions such as depression.
Specific comments:
1. To provide the reader with a more complete model of LHb function, it is suggested that the authors provide a short description of how task-relevant information arrives in the LHb in order to influence down-stream monoamine systems for behavior (Mathis et al., 2017).
2. A total of 144 rats were used for the entire study, but it was not clear how many rats were used (reused?) for each experiment.
3. For clarity in figure 1a2, add a legend for the X, denoting it as baseline.
4. In figure 1b2, the M&B baseline freezing percentage is 10% greater than the control group. There was no explanation for this phenomenon in the text.
5. It would be helpful to provide a supplementary histological image to illustrate the localization of lateral habenula inactivation with M&B.
6. The miss M&B group shows that hippocampal inactivation had no effects. Is there evidence that the medial habenula similarly plays no role? The M&B injections could have diffused to the neighboring medial habenula.
7. Line 418: what does ’emotional conflict’ refer to in the context of this study?
There are many typos. For example:
8. Line 100: Is the D/V coordinate from top of brain or skull?
9. Line 145: change ’allowed’ to allow
10. Line 187: change ’absent’ to absence
11. Line 198: change ’the percent of rat’s to the percentage of rats
12. Line 199: change ’into’ to on
13. Line 295: change ’test’ to tests
14. Line 304: change ’effect during retrieval test is’ to effects during retrieval tests are
15. Line 313: change ’LHb does’ to LHb inactivation does
16. Line 318: change ’anxiety like-’ to anxiety-like
17. Line 360: change ’test biased toward facilitating’ to test facilitated
18. Line 376: change ’After trained’ to After being trained
19. Line 378: change ’acquire’ to acquired
20. Line 387: change ’memory during’ to memory occurs during
21. Line 398: change ’spent in’ to spent on the
22. Line 399: change ’suppression’ to the suppression
23. Line 400: change ’ratio’ to ratios
24. Lines 461-462, 466-468, 473-474, 476-477: within a single paragraph, the statement “the LHb is necessary to guide behaviors during competition of existing fear/safety memories” is restated four times.
25. Line 703: change “grayed” to shaded
Reviewer 2:
This study used pharmacological inactivation to assess the role of the LHb in 3 different fear regulation tasks: extinction, latent inhibition, and platform-mediated avoidance. The authors systematically inactivated the LHb across the learning and memory timeline, with inactivations happening either before fear training, extinction training or memory retrieval. All of the effects were during memory retrieval sessions when the LHb was inactivated. Collectively, the data are compelling in showing that LHb inactivation results in downregulated fear, indicating the LHb drives cued fear responses when undisturbed.
Most interesting was that these effects were consistent across multiple types of fear regulation tasks. This suggests that the LHb must be a critical node in the network controlling fear output. The discussion could be strengthened by elaborating more on how the LHb is achieving this (there was some discussion on disinhibition of VTA, but I think the authors could do more).
The usage of ’safety’ to describe some of their tasks is confusing at times. For example, in the abstract text the authors do not call extinction ’safety’ but in the graphical abstract it is focused on ’safety’. Moreover, in the graphical abstract it looks like distinct, separate cues are serving as threat and safety (i.e. CS+ vs CS-) cues. Further, the authors oftentimes refer to the memory test as having the fear and safety memories in conflict or competing. Even though extinction is widely considered to produce a separate memory for a CS/no threat association, describing that memories for the threat conditioning and extinction conditioning are in conflict may be misleading because there is no direct way to show the 2 memories are in fact active and in conflict. A simpler approach to assessing threat/safety conflict would have been to train 2 separate cues (e.g. tone for threat, light for safety) and then present them in compound, in direct conflict, during the test session. Based on the results presented the prediction would be LHb inactivation would show significantly less fear to a threat/safety cue versus saline. Another way to have created more direct conflict would have been to extinguish in a different context than threat conditioning, and then completed the memory retrieval with the extinguished cue in the threat context. This reliably induces rebound of fear in most experiments; if the authors could have blocked this rebound with LHb inactivation, this would have been stronger support for their conclusions. These considerations should be discussed in the discussion.
LINE 259: “...abolished defensive responses (freezing and pressing)....” Should this be ’suppressed pressing?
LINE 328-329: grammatical typo “Such situation occurs....”
Author Response
POINT BY POINT REPLY TO REVIEWERS
Comments on the Visual Abstract for Author (Required):
Needs attention as indicated in the review
As suggested by Reviewer #2, we modified the Visual abstract to denote that the
same sensory auditory stimulus (tone) served as both threat and safety cue.
Reviewer 1.
Specific comments:
1. To provide the reader with a more complete model of LHb function, it is suggested
that the authors provide a short description of how task-relevant information arrives
in the LHb in order to influence down-stream monoamine systems for behavior
(Mathis et al., 2017).
As suggested by the Reviewer, we added a short discussion of how task-relevant
input to LHb may influence defensive behaviors (lines 482-491).
2. A total of 144 rats were used for the entire study, but it was not clear how many
rats were used (reused?) for each experiment.
We used different groups of rats for each experiment (total of 144 rats: Fig. 1A, n =
12; Fig. 1B, n = 20; Fig. 2A, n = 24; Fig. 3A, n = 14; Fig. 3B, n = 23; Fig. 4A, n = 23;
Fig. 4B, n = 13; Fig. 5, n = 15), except for the lever pressing test (Fig. 3C). For this
test, we analyzed presses per minute before conditioning (pretone lever pressing)
taken from rats in the first experiment (Fig. 1A). We now include this information in
the Methods. We thank the Reviewer for noticing the missing information.
Additionally, we replaced Figure 3C1 after noticing misplacements in the brain
illustration.
3. For clarity in figure 1a2, add a legend for the X, denoting it as baseline.
To maintain figure simplicity without adding more legends, we opted to describe in
the appropriate figure legends (Figs. 1,2,3 and 4) that “x” in graphs represent
baseline (pretone) freezing levels.
4. In figure 1b2, the M&B baseline freezing percentage is 10% greater than the
control group. There was no explanation for this phenomenon in the text.
The Reviewer is correct that baseline pretone freezing percentages during drug-free
memory test on day 3 (Figure 1B2) appear to be higher in the M&B group as
compared to the SAL group. We re-inspected the individual data points from Figure
1B2 (see Author response image 1 below, with individual data points from Figure
1B2) and found that the mentioned trend appears to be explained by a rat in the
experimental group (circled in red) that showed unusually high freezing (97%)
compared to the rest of the animals in the experiment. The apparent trend, however,
is not significantly different (t(18) = 1.36, p = 0.18). Consistently, we found that lever
pressing at this point was not significantly different between groups either (t(18) = -
0.28, p = 0.78). These results indicate that LHb inactivation before extinction learning
did not affect retrieval of contextual extinction memory. For clarity, we modified the
Methods noticing that in all experiments pretone freezing percentages were not
significantly different between experimental and control groups (all p values > 0.05).
2
5. It would be helpful to provide a supplementary histological image to illustrate the
localization of lateral habenula inactivation with M&B.
At eNeuro submitting supplementary material is not an option. As suggested by the
Reviewer, below we provide a histological image to illustrate localization of lateral
habenula infusions (Author response image 2). The figure below shows a
representative rat brain coronal section with cannula placement localized in the
lateral habenula (LHb). Left, Representative photomicrograph of Nissl-stained
coronal section (45 μm) from a brain of a rat with cannula placement localized in the
LHb. Right, Rat brain atlas coronal section (-3.6 mm relative to bregma; adapted
from Paxinos and Watson, 1998) illustrating localization and boundaries of the LHb.
6. The miss M&B group shows that hippocampal inactivation had no effects. Is there
evidence that the medial habenula similarly plays no role? The M&B injections could
have diffused to the neighboring medial habenula.
Because we did not have rats with bilateral medial habenula (MHb) misplacements
in the miss M&B group we cannot exclude (using this experimental strategy) that
inactivations did not diffuse to MHb. However, using a different strategy (evaluating
c-Fos expression in a subset of rats from this experiment (one SAL and one M&Btreated rat)), we found that after SAL infusion, the LHb is heavily recruited during
extinction memory retrieval, whereas MHb is not (see Author response image 3
below, with behavioral data from Fig 2A2). This result is consistent with a previous
study showing recruitment of LHb during recovery of an extinguished threat memory
(Martinez-Canabal et al., 2019), and suggests that MHb does not play a role in
extinction memory retrieval. Accordingly, we found that inactivation silenced
recruitment of LHb, while c-Fos expression in MHb did not change. Thus, even
though we cannot directly rule out the spread of infusions to MHb, results from our
3
pilot experiment suggest that inactivations specifically silenced extinction retrievalmediated activity of LHb. This also further supports the conclusion that the dosage
and volume used in this report and a previous study (Stopper and Floresco 2014)
effectively inactivated LHb. We now include this information in the Methods.
7. Line 418: what does ’emotional conflict’ refer to in the context of this study?
We modified this line to clarify what we refer to as “emotional conflict” in the context
of our study.
There are many typos. For example:
8. Line 100: Is the D/V coordinate from top of brain or skull?
D/V coordinates were taken from the skull. We modified the text in the manuscript
accordingly.
9. Line 145: change ’allowed’ to allow
10. Line 187: change ’absent’ to absence
11. Line 198: change ’the percent of rat’s to the percentage of rats
12. Line 199: change ’into’ to on
13. Line 295: change ’test’ to tests
14. Line 304: change ’effect during retrieval test is’ to effects during retrieval tests are
15. Line 313: change ’LHb does’ to LHb inactivation does
16. Line 318: change ’anxiety like-’ to anxiety-like
17. Line 360: change ’test biased toward facilitating’ to test facilitated
18. Line 376: change ’After trained’ to After being trained
19. Line 378: change ’acquire’ to acquired
20. Line 387: change ’memory during’ to memory occurs during
21. Line 398: change ’spent in’ to spent on the
22. Line 399: change ’suppression’ to the suppression
23. Line 400: change ’ratio’ to ratios
We corrected these typos. We thank the Reviewer for careful revision of the
manuscript text.
4
24. Lines 461-462, 466-468, 473-474, 476-477: within a single paragraph, the
statement “the LHb is necessary to guide behaviors during competition of existing
fear/safety memories” is restated four times.
The Reviewer is correct in that repeating this statement in the same paragraph was
unnecessary. We modified the Discussion accordingly.
25. Line 703: change “grayed” to shaded
As suggested by the Reviewer, we made this change in all figure legends.
Reviewer 2:
Most interesting was that these effects were consistent across multiple types of fear
regulation tasks. This suggests that the LHb must be a critical node in the network
controlling fear output. The discussion could be strengthened by elaborating more on
how the LHb is achieving this (there was some discussion on disinhibition of VTA,
but I think the authors could do more).
As suggested by the Reviewer, we extended the discussion on how LHb may
mediate defensive behaviors (lines 482-491).
The usage of ’safety’ to describe some of their tasks is confusing at times. For
example, in the abstract text the authors do not call extinction ’safety’ but in the
graphical abstract it is focused on ’safety’.
We modified the Abstract to clarify the usage of the term “safety” by referring to
threat conditioning as fear and threat extinction as safety, and in the next sentence
referring to both extinction and latent inhibition as safety memories.
Moreover, in the graphical abstract it looks like distinct, separate cues are serving as
threat and safety (i.e. CS+ vs CS-) cues.
We modified the Graphical Abstract to denote that the same sensory auditory
stimulus (tone) served as threat and safety cue.
Further, the authors oftentimes refer to the memory test as having the fear and
safety memories in conflict or competing. Even though extinction is widely
considered to produce a separate memory for a CS/no threat association, describing
that memories for the threat conditioning and extinction conditioning are in conflict
may be misleading because there is no direct way to show the 2 memories are in
fact active and in conflict. A simpler approach to assessing threat/safety conflict
would have been to train 2 separate cues (e.g. tone for threat, light for safety) and
then present them in compound, in direct conflict, during the test session. Based on
the results presented the prediction would be LHb inactivation would show
significantly less fear to a threat/safety cue versus saline. Another way to have
created more direct conflict would have been to extinguish in a different context than
threat conditioning, and then completed the memory retrieval with the extinguished
cue in the threat context. This reliably induces rebound of fear in most experiments;
if the authors could have blocked this rebound with LHb inactivation, this would have
been stronger support for their conclusions. These considerations should be
discussed in the discussion.
We agree that the experiments suggested by the Reviewer would provide further
support to our conclusions. We include these considerations in the discussion (lines
477-481).
5
LINE 259: “...abolished defensive responses (freezing and pressing)....” Should this
be ’suppressed pressing?
We corrected omission of the word “suppressed” in this sentence.
LINE 328-329: grammatical typo “Such situation occurs....”
We corrected the grammatical typo in this sentence.
References
- Amo R, Fredes F, Kinoshita M, Aoki R, Aizawa H, Agetsuma M, Aoki T, Shiraki T, Kakinuma H, Matsuda M, Yamazaki M, Takahoko M, Tsuboi T, Higashijima S, Miyasaka N, Koide T, Yabuki Y, Yoshihara Y, Fukai T, Okamoto H (2014) The habenulo-raphe serotonergic circuit encodes an aversive expectation value essential for adaptive active avoidance of danger. Neuron 84:1034–1048. 10.1016/j.neuron.2014.10.035 [DOI] [PubMed] [Google Scholar]
- Andalman AS, Burns VM, Lovett-Barron M, Broxton M, Poole B, Yang SJ, Grosenick L, Lerner TN, Chen R, Benster T, Mourrain P, Levoy M, Rajan K, Deisseroth K (2019) Neuronal dynamics regulating brain and behavioral state transitions. Cell 177:970–985.e20. 10.1016/j.cell.2019.02.037 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baker PM, Jhou T, Li B, Matsumoto M, Mizumori SJ, Stephenson-Jones M, Vicentic A (2016) The lateral habenula circuitry: reward processing and cognitive control. J Neurosci 36:11482–11488. 10.1523/JNEUROSCI.2350-16.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baker PM, Raynor SA, Francis NT, Mizumori SJ (2017) Lateral habenula integration of proactive and retroactive information mediates behavioral flexibility. Neuroscience 345:89–98. 10.1016/j.neuroscience.2016.02.010 [DOI] [PubMed] [Google Scholar]
- Bravo-Rivera C, Sotres-Bayon F (2020) From isolated emotional memories to their competition during conflict. Front Behav Neurosci 14:36. 10.3389/fnbeh.2020.00036 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bravo-Rivera C, Roman-Ortiz C, Brignoni-Perez E, Sotres-Bayon F, Quirk GJ (2014) Neural structures mediating expression and extinction of platform-mediated avoidance. J Neurosci 34:9736–9742. 10.1523/JNEUROSCI.0191-14.2014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26:321–352. 10.1016/s0149-7634(02)00007-6 [DOI] [PubMed] [Google Scholar]
- Cui Y, Hu S, Hu H (2019) Lateral habenular burst firing as a target of the rapid antidepressant effects of ketamine. Trends Neurosci 42:179–191. 10.1016/j.tins.2018.12.002 [DOI] [PubMed] [Google Scholar]
- Diehl MM, Bravo-Rivera C, Quirk GJ (2019) The study of active avoidance: a platform for discussion. Neurosci Biobehav Rev 107:229–237. 10.1016/j.neubiorev.2019.09.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elliot AJ (2008) Handbook of approach and avoidance motivation. New York: Psychology Press. [Google Scholar]
- Heldt SA, Ressler KJ (2006) Lesions of the habenula produce stress- and dopamine-dependent alterations in prepulse inhibition and locomotion. Brain Res 1073–1074:229–239. 10.1016/j.brainres.2005.12.053 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herry C, Ferraguti F, Singewald N, Letzkus JJ, Ehrlich I, Lüthi A (2010) Neuronal circuits of fear extinction. Eur J Neurosci 31:599–612. 10.1111/j.1460-9568.2010.07101.x [DOI] [PubMed] [Google Scholar]
- Hikosaka O (2010) The habenula: from stress evasion to value-based decision-making. Nat Rev Neurosci 11:503–513. 10.1038/nrn2866 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hu H, Cui Y, Yang Y (2020) Circuits and functions of the lateral habenula in health and in disease. Nat Rev Neurosci 21:277–295. 10.1038/s41583-020-0292-4 [DOI] [PubMed] [Google Scholar]
- Ilango A, Shumake J, Wetzel W, Scheich H, Ohl FW (2013) Electrical stimulation of lateral habenula during learning: frequency-dependent effects on acquisition but not retrieval of a two-way active avoidance response. PLoS One 8:e65684. 10.1371/journal.pone.0065684 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jhou TC, Fields HL, Baxter MG, Saper CB, Holland PC (2009) The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61:786–800. 10.1016/j.neuron.2009.02.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim U, Lee T (2012) Topography of descending projections from anterior insular and medial prefrontal regions to the lateral habenula of the epithalamus in the rat. Eur J Neurosci 35:1253–1269. 10.1111/j.1460-9568.2012.08030.x [DOI] [PubMed] [Google Scholar]
- Lacagnina AF, Brockway ET, Crovetti CR, Shue F, McCarty MJ, Sattler KP, Lim SC, Santos SL, Denny CA, Drew MR (2019) Distinct hippocampal engrams control extinction and relapse of fear memory. Nat Neurosci 22:753–761. 10.1038/s41593-019-0361-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lammel S, Lim BK, Ran C, Huang KW, Betley MJ, Tye KM, Deisseroth K, Malenka RC (2012) Input-specific control of reward and aversion in the ventral tegmental area. Nature 491:212–217. 10.1038/nature11527 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lammel S, Lim BK, Malenka RC (2014) Reward and aversion in a heterogeneous midbrain dopamine system. Neuropharmacology 76:351–359. 10.1016/j.neuropharm.2013.03.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lecca S, Meye FJ, Trusel M, Tchenio A, Harris J, Schwarz MK, Burdakov D, Georges F, Mameli M (2017) Aversive stimuli drive hypothalamus-to-habenula excitation to promote escape behavior. Elife 6:e30697. 10.7554/eLife.30697 [DOI] [PMC free article] [PubMed] [Google Scholar]
- LeDoux JE (2000) Emotion circuits in the brain. Annu Rev Neurosci 23:155–184. 10.1146/annurev.neuro.23.1.155 [DOI] [PubMed] [Google Scholar]
- Li H, Pullmann D, Jhou TC (2019) Valence-encoding in the lateral habenula arises from the entopeduncular region. Elife 8:e41223. 10.7554/eLife.41223 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lingawi NW, Westbrook RF, Laurent V (2017) Extinction and latent inhibition involve a similar form of inhibitory learning that is stored in and retrieved from the infralimbic cortex. Cereb Cortex 27:5547–5556. 10.1093/cercor/bhw322 [DOI] [PubMed] [Google Scholar]
- Martínez-Canabal A, López-Oropeza G, Gaona-Gamboa A, Ballesteros-Zebadua P, de la Cruz OG, Moreno-Jimenez S, Sotres-Bayon F (2019) Hippocampal neurogenesis regulates recovery of defensive responses by recruiting threat- and extinction-signalling brain networks. Sci Rep 9:2939. 10.1038/s41598-019-39136-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mathis V, Lecourtier L (2017) Role of the lateral habenula in memory through online processing of information. Pharmacol Biochem Behav 162:69–78. 10.1016/j.pbb.2017.07.004 [DOI] [PubMed] [Google Scholar]
- Mathis V, Barbelivien A, Majchrzak M, Mathis C, Cassel JC, Lecourtier L (2017) The lateral habenula as a relay of cortical information to process working memory. Cereb Cortex 27:5485–5495. 10.1093/cercor/bhw316 [DOI] [PubMed] [Google Scholar]
- Matsumoto M, Hikosaka O (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447:1111–1115. 10.1038/nature05860 [DOI] [PubMed] [Google Scholar]
- Matsumoto M, Hikosaka O (2009) Representation of negative motivational value in the primate lateral habenula. Nat Neurosci 12:77–84. 10.1038/nn.2233 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Myers KM, Davis M (2002) Behavioral and neural analysis of extinction. Neuron 36:567–584. 10.1016/s0896-6273(02)01064-4 [DOI] [PubMed] [Google Scholar]
- Namburi P, Al-Hasani R, Calhoon GG, Bruchas MR, Tye KM (2016) Architectural representation of valence in the limbic system. Neuropsychopharmacology 41:1697–1715. 10.1038/npp.2015.358 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Oleson EB, Gentry RN, Chioma VC, Cheer JF (2012) Subsecond dopamine release in the nucleus accumbens predicts conditioned punishment and its successful avoidance. J Neurosci 32:14804–14808. 10.1523/JNEUROSCI.3087-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Proulx CD, Hikosaka O, Malinow R (2014) Reward processing by the lateral habenula in normal and depressive behaviors. Nat Neurosci 17:1146–1152. 10.1038/nn.3779 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Proulx CD, Aronson S, Milivojevic D, Molina C, Loi A, Monk B, Shabel SJ, Malinow R (2018) A neural pathway controlling motivation to exert effort. Proc Natl Acad Sci USA 115:5792–5797. 10.1073/pnas.1801837115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quirk GJ (2002) Memory for extinction of conditioned fear is long-lasting and persists following spontaneous recovery. Learn Mem 9:402–407. 10.1101/lm.49602 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quirk GJ (2007) Handbook of emotion regulation. New York: Guilford Press. [Google Scholar]
- Quirk GJ, Mueller D (2008) Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology 33:56–72. 10.1038/sj.npp.1301555 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quirk GJ, Sotres-Bayon F (2009) Signaling aversive events in the midbrain: worse than expected. Neuron 61:655–656. 10.1016/j.neuron.2009.02.016 [DOI] [PubMed] [Google Scholar]
- Quirk GJ, Russo GK, Barron JL, Lebron K (2000) The role of ventromedial prefrontal cortex in the recovery of extinguished fear. J Neurosci 20:6225–6231. 10.1523/JNEUROSCI.20-16-06225.2000 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545–556. 10.1038/nrn2357 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rescorla RA (2001) Retraining of extinguished Pavlovian stimuli. J Exp Psychol Anim Behav Process 27:115–124. [PubMed] [Google Scholar]
- Rescorla RA (2004) Spontaneous recovery. Learn Mem 11:501–509. 10.1101/lm.77504 [DOI] [PubMed] [Google Scholar]
- Salinas-Hernández XI, Vogel P, Betz S, Kalisch R, Sigurdsson T, Duvarci S (2018) Dopamine neurons drive fear extinction learning by signaling the omission of expected aversive outcomes. Elife 7:e38818. 10.7554/eLife.38818 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shabel SJ, Wang C, Monk B, Aronson S, Malinow R (2019) Stress transforms lateral habenula reward responses into punishment signals. Proc Natl Acad Sci USA 116:12488–12493. 10.1073/pnas.1903334116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shumake J, Ilango A, Scheich H, Wetzel W, Ohl FW (2010) Differential neuromodulation of acquisition and retrieval of avoidance learning by the lateral habenula and ventral tegmental area. J Neurosci 30:5876–5883. 10.1523/JNEUROSCI.3604-09.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sierra-Mercado D, Padilla-Coreano N, Quirk GJ (2011) Dissociable roles of prelimbic and infralimbic cortices, ventral hippocampus, and basolateral amygdala in the expression and extinction of conditioned fear. Neuropsychopharmacology 36:529–538. 10.1038/npp.2010.184 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Song M, Jo YS, Lee YK, Choi JS (2017) Lesions of the lateral habenula facilitate active avoidance learning and threat extinction. Behav Brain Res 318:12–17. 10.1016/j.bbr.2016.10.013 [DOI] [PubMed] [Google Scholar]
- Sotres-Bayon F, Quirk GJ (2010) Prefrontal control of fear: more than just extinction. Curr Opin Neurobiol 20:231–235. 10.1016/j.conb.2010.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sotres-Bayon F, Cain CK, LeDoux JE (2006) Brain mechanisms of fear extinction: historical perspectives on the contribution of prefrontal cortex. Biol Psychiatry 60:329–336. 10.1016/j.biopsych.2005.10.012 [DOI] [PubMed] [Google Scholar]
- Sotres-Bayon F, Sierra-Mercado D, Pardilla-Delgado E, Quirk GJ (2012) Gating of fear in prelimbic cortex by hippocampal and amygdala inputs. Neuron 76:804–812. 10.1016/j.neuron.2012.09.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stamatakis AM, Stuber GD (2012) Activation of lateral habenula inputs to the ventral midbrain promotes behavioral avoidance. Nat Neurosci 15:1105–1107. 10.1038/nn.3145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stephenson-Jones M, Bravo-Rivera C, Ahrens S, Furlan A, Xiao X, Fernandes-Henriques C, Li B (2020) Opposing contributions of GABAergic and glutamatergic ventral pallidal neurons to motivational behaviors. Neuron 105:921–933.e5. 10.1016/j.neuron.2019.12.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stopper CM, Floresco SB (2014) What’s better for me? Fundamental role for lateral habenula in promoting subjective decision biases. Nat Neurosci 17:33–35. 10.1038/nn.3587 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thornton EW, Bradbury GE (1989) Effort and stress influence the effect of lesion of the habenula complex in one-way active avoidance learning. Physiol Behav 45:929–935. 10.1016/0031-9384(89)90217-5 [DOI] [PubMed] [Google Scholar]
- Tian J, Uchida N (2015) Habenula lesions reveal that multiple mechanisms underlie dopamine prediction errors. Neuron 87:1304–1316. 10.1016/j.neuron.2015.08.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tomaiuolo M, Gonzalez C, Medina JH, Piriz J (2014) Lateral Habenula determines long-term storage of aversive memories. Front Behav Neurosci 8:170. 10.3389/fnbeh.2014.00170 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trusel M, Nuno-Perez A, Lecca S, Harada H, Lalive AL, Congiu M, Takemoto K, Takahashi T, Ferraguti F, Mameli M (2019) Punishment-predictive cues guide avoidance through potentiation of hypothalamus-to-habenula synapses. Neuron 102:120–127.e4. 10.1016/j.neuron.2019.01.025 [DOI] [PubMed] [Google Scholar]
- Vale-Martínez A, Martí-Nicolovius M, Guillazo-Blanch G, Coll-Andreu M, Morgado-Bernal I (1997) Effects of habenular lesions upon two-way active avoidance conditioning in rats. Neurobiol Learn Mem 68:68–74. 10.1006/nlme.1997.3777 [DOI] [PubMed] [Google Scholar]
- Varga V, Kocsis B, Sharp T (2003) Electrophysiological evidence for convergence of inputs from the medial prefrontal cortex and lateral habenula on single neurons in the dorsal raphe nucleus. Eur J Neurosci 17:280–286. 10.1046/j.1460-9568.2003.02465.x [DOI] [PubMed] [Google Scholar]
- Vincenz D, Wernecke KEA, Fendt M, Goldschmidt J (2017) Habenula and interpeduncular nucleus differentially modulate predator odor-induced innate fear behavior in rats. Behav Brain Res 332:164–171. 10.1016/j.bbr.2017.05.053 [DOI] [PubMed] [Google Scholar]
- Wang D, Li Y, Feng Q, Guo Q, Zhou J, Luo M (2017) Learning shapes the aversion and reward responses of lateral habenula neurons. Elife 6:e23045. 10.7554/eLife.23045 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wilcox KS, Christoph GR, Double BA, Leonzio RJ (1986) Kainate and electrolytic lesions of the lateral habenula: effect on avoidance responses. Physiol Behav 36:413–417. 10.1016/0031-9384(86)90307-0 [DOI] [PubMed] [Google Scholar]
- Yang Y, Cui Y, Sang K, Dong Y, Ni Z, Ma S, Hu H (2018) Ketamine blocks bursting in the lateral habenula to rapidly relieve depression. Nature 554:317–322. 10.1038/nature25509 [DOI] [PubMed] [Google Scholar]