Abstract
BLA neurons serve a well-accepted role in fear conditioning and fear extinction. However, the specific learning processes related to their activity at different times during learning remain poorly understood. We addressed this using behavioral tasks isolating distinct aspects of fear learning in male rats. We show that brief optogenetic inhibition of BLA neurons around moments of aversive reinforcement or nonreinforcement causes reductions in the salience of conditioned stimuli, rendering these stimuli less able to be learned about and less able to control fear or safety behaviors. This salience reduction was stimulus-specific, long-lasting, and specific to learning about, or responding to, the same aversive outcome, precisely the goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition. They show that a primary function of the unconditioned stimulus-evoked activity of BLA neurons is to maintain the salience of conditioned stimuli that precede it. This maintenance of salience is a necessary precursor for these stimuli to gain and maintain control over fear and safety behavior.
SIGNIFICANCE STATEMENT The amygdala is essential for learning to fear and learning to reduce fear. However, the specific roles served by activity of different amygdala neurons at different times during learning is poorly understood. We used behavioral tasks isolating distinct aspects of learning in rats to show that brief optogenetic inhibition of BLA neurons around moments of reinforcement or nonreinforcement disrupts maintenance of conditioned stimulus salience. This causes a stimulus-specific and long-lasting deficit in the ability of the conditioned stimulus to be learned about or control fear responses. These consequences are the precisely goals of therapeutic interventions in human anxiety disorders. Our findings identify a core learning process disrupted by brief BLA optogenetic inhibition.
Keywords: amygdala, conditioning, fear, salience
Introduction
The capacity to learn about and respond to sources of danger in the environment is essential to survival. Within the laboratory, Pavlovian fear conditioning is most commonly used to model this learning. In conditioning, subjects, typically rats or mice, receive pairings of an initial neutral conditioned stimulus (CS) with an aversive unconditioned stimulus (US), such as footshock. A large body of work shows that the amygdala is essential for Pavlovian fear learning.
The amygdala contributes to both acquisition and expression of Pavlovian fear learning (Davis, 1992; Schafe et al., 2001; Maren and Quirk, 2004; Paré et al., 2004; Lüthi and Luscher, 2014). Within amygdala, CaMKIIα principal neurons of the basolateral amygdala are especially important (Sah et al., 2003). These BLA neurons show plasticity during fear conditioning (McKernan and Shinnick-Gallagher, 1997; Maren and Quirk, 2004; Marek et al., 2013), are subject to complex regulation by multiple families of GABAergic interneurons (Ehrlich et al., 2009; Wolff et al., 2014; Tovote et al., 2015), and are robustly excited by aversive US, such as footshock (Wolff et al., 2014). This US-evoked activity is essential to causing fear learning. For example, brief optogenetic inhibition of BLA principal neurons during the shock US impairs fear learning (Wolff et al., 2014; Namburi et al., 2015). Moreover, excitation of BLA principal neurons during the US can augment fear learning (Johansen et al., 2014) and can serve as a US in its own right, supporting modest responding to a CS that signals such excitation (Johansen et al., 2010a; Gore et al., 2015).
However, the specific learning processes related to this US-evoked activity and that are affected by optogenetic manipulation of BLA principal neurons during fear conditioning remain unknown. Fear learning involves multiple processes, and even the simple delivery or omission of a footshock US has many effects on learning. The primary learning-related functions of the shock US (i.e., reinforcement) or its absence (i.e., nonreinforcement) in fear conditioning are maintenance of CS salience enabling the CS to be learned about and responded to, contribution to a prediction error computation, and updating as well as storing the most recent aversive value of the CS (for review, see Hall and Rodríguez, 2017). BLA principal neurons may contribute to many of these functions. However, which functions are linked to their activity during aversive reinforcement and nonreinforcement remains poorly understood.
We addressed this by using adeno-associated viral vectors (AAVs) to express the inhibitory opsin eNpHR3.0 in BLA neurons and manipulating their activity during aversive reinforcement and nonreinforcement in Pavlovian fear conditioning. We examined the impact of optogenetic inhibition on fear learning, extinction learning, appetitive learning, safety learning, simple discrimination learning, and CS preexposure learning. We show that brief optogenetic inhibition during moments of aversive reinforcement or nonreinforcement renders a CS less able to be learned about and less able to control fear or safety behaviors. This salience reduction is stimulus-specific, long-lasting, and specific to learning about or responding to aversive outcomes.
Materials and Methods
Experimentally naive male Sprague Dawley rats (260–350 g), 8–9 weeks of age at the start of the experiments, were obtained from Animal Resources Centre (Murdoch, Western Australia). Animals were housed in groups of 4 in plastic cages in ventilated racks in a colony room maintained on a 12:12 light dark cycle (lights on 07:00). All experiments were conducted daily between 10:00 and 13:00 h. Food and water were freely available until 3 d before the start of behavioral training when rats were maintained on 65 g of standard laboratory chow (Gordon's Rat and Mouse Food) per day (in addition to any pellets earned) and continuous access to water.
Apparatus
All behavioral procedures were conducted in eight identical operant chambers with dimensions 24 cm (length) × 30 cm (width) × 21 cm (height). The top, rear wall, and hinged door of the chamber were constructed of Perspex. The sidewalls of the chamber were constructed of stainless-steel panels. All chambers had a grid floor constructed of stainless-steel rods, 4 mm in diameter spaced 15 mm apart. The grid floor was connected to a constant current generator. An external magazine hopper (measuring 5 × 5 cm) was built in to the left side panel and was attached to a pellet delivery system that delivered 45 g grain pellets (Able Scientific). A lever was mounted 4 cm to the right of the magazine hopper. Each chamber was placed in a larger sound-attenuating box with dimensions 59.5 cm (length) × 59 cm (width) × 48 cm (height). A fan was attached to the wall of the sound-attenuating box to provide ventilation during behavioral testing and a 28 V house light mounted on the rear wall of the operant chambers. An LED driver with integrated rotary joint (625 nm wavelength; Doric Instruments) was suspended above the operant chamber. The auditory CS were an 85 dB 10 Hz clicker and 1800 Hz, 85 dB tone delivered through a speaker attached to rear wall of the chamber. The visual CS were a 2 Hz flashing LED mounted outside the conditioning box on the roof of the sound-attenuating chambers and 28 V house light turning off. The US was a 0.6 mA 0.5 s scrambled footshock delivered to the grid floor. All behavioral protocols were controlled through Med-PC software (Med Associates).
Viral vectors
AAV vectors encoding eNpHR3.0 (AAV5-CaMKIIα-eNpHR3.0-WPRE-eYFP, 6 × 1012 vp/ml) or eYFP (AAV5-CaMKIIα-eYFP, 4 × 1012 vp/ml) were obtained from UNC Vector Core (University of North Carolina, Chapel Hill, NC), whereas AAVs encoding AAV5-CaMKIIα-GCaMP6f-WPRE-SV40 (4.25 × 1013 vp/ml) were obtained from Penn Vector Core (University of Pennsylvania, Philadelphia).
Stereotaxic surgery
Before surgery, rats received an intraperitoneal injection of a mixture of 100 mg/ml ketamine (Ketapex, Apex Laboratories) and 0.3 ml/kg xylazine (Rompun; Bayer). Once anesthetized, rats were placed in a stereotaxic apparatus (Model 942, David Kopf Instruments) and shaved to expose the skin surface of the head. Before incision, rats received a subcutaneous injection of carprofen (5 mg/kg) and an injection of 0.5% bupivacaine (Cenvet) just under the surface of the incision site. Following incision, metal screws were positioned around the craniotomies and attached to the skull. A hand drill was then used to make two craniotomies above the BLA, and a 5 μl, 30-gauge conical tipped microinfusion syringe (Hamilton) was used to infuse 0.75 μl of AAV vectors into BLA (from bregma, anteroposterior −3.00 mm; mediolateral ±5.00 mm; dorsoventral −8.60 mm) (Paxinos and Watson, 2007) over a 3 min period at a rate of 0.25 μl/min (UMP3 with SYS4 Microcontroller; World Precision Instruments). The syringe was left in place for 5–7 min to permit diffusion of the injected vectors. After viral infusion, fiber optic cannulae were lowered into the BLA (from bregma, anteroposterior −3.00 mm; mediolateral ±5.00 mm; dorsoventral −7.50 mm for eNpHR3.0, −8.31 mm for gCaMP6f) (Paxinos and Watson, 2007). These cannulae were held in place by dental cement anchored to the screws and the skull. After surgery, rats were injected intraperitoneally with 0.3 ml of 300 mg/ml solution of procaine penicillin (Benicillin; Illium) and subcutaneously with 0.3 ml of a 100 mg/ml solution of cephazolin (Hospira). Daily postoperative and recovery procedures, including weight and infection management, were conducted for the remainder of the experiment. All procedures commenced a minimum of 3 weeks after surgery.
Electrophysiology
Rats were deeply anesthetized with isoflurane (5%), decapitated, and their brain rapidly removed and submerged in ice-cold oxygenated (95% O2, 5% CO2) sucrose-modified ACSF, with the following composition (in mm): 124 sucrose, 62.5 NaCl, 2.5 KCl, 26 NaHCO3, 1.2 NaH2PO4, 10 glucose, 0.5 CaCl2, and 3.3 MgCl2. After 2–3 min, the brain was then mounted to a platform using cyanoacrylate adhesive and submerged in sucrose ACSF. Coronal slices (300 μm) were prepared using a vibratome (model VT1200, Leica) and then maintained in a holding chamber containing standard ACSF (119 mm NaCl, 2.5 mm KCl, 1.3 mm MgCl2, 2.5 mm CaCl2, 1.0 mm Na2H2PO4, 26.2 mm NaHCO3, 11 mm glucose, equilibrated with 95% CO2, 5% O2) in a Braincubator (PAYO Scientific). Slices were incubated at 32°C for 30 min then maintained at 18°C until recording.
For electrophysiological recordings, brain slices were transferred to a recording chamber and continuously superfused with ACSF (2 ml/min) at 30°C. Whole-cell patch-clamp recordings were made from visually identified neurons using a microscope (Zeiss Axio Examiner D1) equipped with a 20× water-immersion objective (1.0 NA). Patch pipettes (2–5 mΩ) were filled with an internal solution containing the following (in mm): 135 KMeSO4, 8 NaCl, 10 HEPES, 2 Mg2-ATP, 0.3 Na3-GTP, 0.3 EGTA, 0.05 Alexa-594, pH 7.3, with KOH, 280–290 mOsm. Voltage recordings were amplified using a Multiclamp 700B amplifier (Molecular Devices), filtered at 6 kHz, digitized at 20 kHz with a Digidata1440A (Molecular Devices) interface, and controlled using AxoGraph (Axograph). eNpHR was activated by 535 nm light using an LED fluorescence illumination system (pE-2, CoolLED). EPSPs were evoked via a monopolar stimulator fabricated from a patch pipette filled with ACSF positioned within the BLA. Stimuli were supplied by a constant voltage isolated stimulator (DS2A, Digitimer). Only cells that had resting potentials more negative than −55 mV, action potential amplitudes >100 mV, and input resistances >60 mΩ were considered healthy and included in the dataset. Projection neurons were distinguished from local circuit interneurons based on their action potential half-width (>0.7 ms), their relatively small fast afterhyperpolarization (<15 mV), and their frequency-dependent spike broadening. Data were not corrected for liquid junction potentials.
Baseline lever pressing
We used conditioned suppression of lever pressing as our measure of learned fear (Yau and McNally, 2015; Sengupta et al., 2016). Rats were trained to lever press to establish a stable baseline lever pressing response. On days 1 and 2, rats received magazine training in which every lever press was rewarded with the delivery of a pellet. In addition, during magazine training sessions only, rats also received free pellet deliveries on a fixed interval 300 s schedule, in which a pellet was delivered on average every 300 s. These “free” pellets were used to aid learning about the location of food delivery. Magazine training sessions were terminated after 60 min, or if the rat reached 100 lever presses. From day 3 onwards, lever pressing was maintained on variable interval schedules. On day 3, rats underwent a 60 min session of lever press training under a variable interval 30 s schedule. From day 4 until the end of the experiment, rats were maintained on a variable interval of 120 s. These sessions lasted 120 min unless otherwise noted. On days 9–10, rats received preexposure to the CS to be used in the experiment during a 120 min preexposure session. Rats were habituated to the tethering procedure for 4 d on days 7–10.
Fiber photometry
Rats underwent fear conditioning on days 11–13 where they received differential fear conditioning to two CS. One CS (CS+: a 60 s flashing 2 Hz LED light or a 60 s 80 dB clicker, counterbalanced) was paired four times with a 0.6 mA, 0.5 s footshock, whereas the other CS (CS−: a 60 s flashing 2 Hz LED light or a 60 s 80 dB clicker, counterbalanced) was not. The trials were presented in a pseudorandom order with an intertrial interval (ITI) of 1200 to 1800 s.
Recordings were completed using Fiber Photometry Systems from Doric Instruments and Tucker-Davis Technologies (RZ5P, Synapse). Excitation light was emitted from 465 and 405 nm LEDs (Doric Instruments), controlled via dual channel programmable LED drivers. These wavelengths were reflected into the 400 μm prebleached patch cable via a Dual Fluorescence Mini Cube (Doric Instruments). Light intensity at the tip of the patch was set to 200–400 μW and was kept constant across sessions. At the start of each recording session, patch cables were attached to the fiber optic implant and recording was initiated. Excitation light was delivered 3 min before each CS onset and terminated 1 min after each CS offset.
GCaMP6f fluorescence was collected from the same implant/patch cable. Ca2+-dependent (525 nm) and isobestic control (430 nm) fluorescence signals (corresponding to 465 nm and 405 nm excitation, respectively) were relayed to femtowatt photoreceivers (Newport, 2151) through dichroic mirrors and bandpass filters within the Fluorescence Mini Cube (Doric Instruments). Synapse software controlled and modulated excitation light (465 nm, 220 Hz; 405 nm, 330 Hz) and demodulated transduced fluorescence signals in real-time (1 kHz sampling rate) via the RZ5P. Synapse/RZ5P also received Med-PC signals to record behavioral events and experimenter-controlled stimuli in real time.
BLA neurons and fear learning
Rats were attached to bilateral patch cables outputting at least 9 mW of 625 nm light, measured through an unimplanted fiber optic cannula, before session commencement in this and subsequent experiments. On days 11–13, rats underwent 120 min conditioning sessions where they received four presentations of 60 s auditory CS (85 dB clicker) coterminating with a 0.5 s, 0.6 mA footshock US. The 625 nm light delivery coincided with US presentations and extended for a further 4.5 s after US. There was a randomized ITI of 1200–1800 s. For the offset control, rats were trained identically to the above with the single exception that 625 nm light delivery occurred randomly in the ITI between CS–US pairings during conditioning. All rats were tested in a single 70 min session on day 14. Rats received four 60 s presentations of the auditory CS with an ITI of 900 s.
BLA neurons and fear extinction learning
Rats underwent fear conditioning on days 11–13 where they received four presentations of an auditory CS (85 dB clicker) coterminating with a 0.5 s, 0.6 mA footshock US. All CS were presented with a randomized ITI of 1200–1800 s. Fear acquisition sessions were identical to the above. On days 14–16, rats were extinguished. All rats received four 60 s presentations of the auditory CS, which coterminated with 0.5 s of photoinhibition. This extended for a further 4.5 s beyond the CS. These stimulus events were presented with a randomized ITI of 490–1200 s. For the offset control, the same offset control rats from the acquisition experiment were trained to fear a different CS (visual CS 4 pairings a day for 3 d with a 0.5 s, 0.6 mA footshock US). They were extinguished to the CS in a manner identical to the above, with the single exception that 625 nm light delivery occurred randomly in the ITI between CS presentations.
Reacquisition of fear conditioning.
On days 17–20, rats that underwent fear reacquisition received four presentations of the auditory CS coterminating with a 0.5 s, 0.6 mA footshock US in 70 min reacquisition sessions. The ITI was randomized 1200–1800 s. There was no photoinhibition.
Acquisition of appetitive conditioning.
On days 17–20, rats that underwent the appetitive conditioning procedure received four presentations of the auditory CS (30 s in duration) followed by the delivery of 3 × 45 mg sucrose pellets in a 60 min session. The lever that had been used for conditioned suppression was retracted during these sessions. The ITI was randomized from 300–600 s. There was no photoinhibition.
BLA neurons and safety learning
For this experiment, baseline lever press training was conducted as described earlier with one exception. The house light was locked on before session commencement and remained on after termination of the session because the house light off was used as CS in this experiment. On days 9–10, all rats underwent preexposure training where they received three 60 s presentations of each of the following stimuli: a flashing LED, the house light turning off, an 85 dB clicker, and a 1800 Hz, 85 dB tone. Each stimulus was presented with a randomized ITI ranging from 600 to 900 s. On days 11–15, rats received discrimination training where the aforementioned visual cues were counterbalanced as CSA and CSB, whereas the auditory cues were counterbalanced as CSX and CSY. These rats received four 60 s presentations of AX coterminating with a 0.5 s, 0.6 mA shock (AX+) and four nonreinforced presentations of BX− per day. These stimuli were presented with randomized ITIs of 600–900 s. Photoinhibition was delivered on BX− trials only, coterminating for 0.5 s of the BX− trial and extending for a further 4.5 s. On days 16–17, rats received four 60 s presentations of Y coterminating with a 0.5 s, 0.6 mA shock. These stimulus events were presented with a randomized ITI of 1200–1800 s. All rats then underwent tests of summation and retardation. On day 18, rats underwent a summation test where they received four 60 s presentations of the compound AY and BY, each. On days 19–21, rats underwent a retardation test where they were conditioned to B via four pairings with a 0.5 s, 0.6 mA shock.
An eYFP-naive group was used as a control during the retardation. These rats received the same lever press training but then received simple AX+/B− discrimination training. All other behavioral procedures remained the same.
BLA neurons and CS preexposure
Rats underwent fear conditioning training on days 11–14 where they received two presentations of visual CSA (flashing LED) coterminating with a 0.5 s, 0.6 mA footshock US and four presentations of an auditory CSX (85 dB clicker) coterminating with photoinhibition at 0.5 s and extending for a further 4.5 s. All CS were presented with a randomized ITI of 600–900 s. These training sessions lasted 120 min. On days 15–16, all rats received two 60 s presentations of a compound CSAX and two presentations of CSA per session, in a counterbalanced order, with a randomized ITI of 490–1200 s. This session lasted 70 min. On days 17–19, all rats received four presentations of CSX per session with a randomized ITI of 1200–1800 s. Each presentation of CSX coterminated with a 0.5 s, 0.6 mA foot-shock US. This session lasted 120 min.
Histology
Cannula and viral placements were verified at the end of behavioral procedures. Following transcardial perfusion with 0.9% saline, 1% sodium nitrite solution, and 360 μl/L heparin, then 4% buffered PFA, brains were postfixed and then placed in 20% hypertonic sucrose solution for 24–48 h. A cryostat (Leica Microsystems) was used to collect 40 μm coronal sections, preserved in phosphate-buffered azide (0.1% sodium azide) at 4°C before immunohistochemistry. eYFP labeling used single-color peroxidase immunohistochemistry.
Free floating sections were washed for 30 min in 0.1 m phosphate buffer (PB; pH 7.4), followed by 50% ethanol for 30 min and then 3% hydrogen peroxide diluted in 50% ethanol for 30 min. Sections were blocked (30 min with 5% normal horse serum (NHS) diluted in PB), then placed in 1:2000 chicken anti-GFP (Invitrogen; A10262) diluted in 0.3% Triton-X, 2% NHS, and 0.1 m PB, pH 7.4, and incubated at 4°C for 48 h. Sections were washed three times for 20 min each (PB, pH 7.4), incubated in 1:3000 biotinylated donkey anti-chicken (Jackson ImmunoResearch Laboratories; 703 065 155) (diluted in a solution of 0.3% Triton-X, 2% NHS, and 0.1 m PB, pH 7.4), overnight at room temperature. They were then washed in PB, pH 7.4, and incubated in avidin-biotin (ABC reagent; Vector Elite kit 6 μl/ml avidin and 6 μl/ml biotin) diluted with PB containing 0.2% Triton, pH 7.4. eYFP-IR was identified using a DAB (D5637-56, Sigma) reaction. Immediately before this, sections were washed twice in PB, pH 7.4, and once in 0.1 m acetate buffer, pH 6.0. Sections were incubated in DAB solution (0.025% DAB, 0.04% ammonium chloride, and 0.2% d-glucose in 0.1 m acetate buffer, pH 6.0). The peroxidase reaction was catalyzed by 0.2 μl/ml of glucose oxidase and then were rinsed with 0.1 m acetate buffer. Fiber placements and extent of eYFP-IR per rat were verified and photographed using a transmitted light microscope (Olympus BX51). Only animals with fiber placements and AAV expression in basolateral amygdala were included in the analyses. A total of 28 rats were excluded due to these criteria (1 from photometry, 9 from fear acquisition experiment, 6 from extinction experiment, 6 from safety learning experiment, 6 from simple discrimination experiment).
Quantification and statistical analyses
Suppression ratios (SRs) were calculated as SR = a/(a + b) (Annau and Kamin, 1961), where a represents the number of lever presses during the CS period and b represents the number of lever presses recorded 60 s before CS. An SR of 0.5 indicates low suppression or low fear, whereas an SR of 0 indicates complete suppression or high fear. For the appetitive conditioning procedure, a ratio of a/(a + b), where a represents the number of magazine entries during the CS period and b represents the number of magazine entries 30 s before the CS, was used. In this instance, a ratio of 1 indicates exclusive entry into the magazine port during the CS, whereas a ratio of 0.5 indicates equivalent port entries during the CS and before the CS. These data were analyzed via orthogonal contrasts (Harris, 2004). The Hay's Decision-wise error rate (α) was controlled at 0.05 for each contrast.
For fiber photometry, event-related GCaMP6f fluorescence signals were analyzed using customized MATLAB scripts. Demodulated fluorescence signals were Gaussian filtered (to smooth each signal) and converted into a movement-corrected ΔF/F signal by applying a least-squares linear fit to the 405 nm signal, aligning it to the 465 nm signal. This fitted 405 signal was used to determine the Ca2+-dependent signal as follows: ΔF/F = (465 signal-fitted 405 signal)/fitted 405 signal. For each session, ΔF/F signals around behavioral events (time 0) were isolated and aggregated; 4 to 2 s before each event was used as a baseline (set to 0%) to normalize perievent ΔF/F, the 2 s leading up to each event was defined as the preevent transient, and the 5 s following each event was defined as the event transient. Areas under the curve for event transients were calculated by approximating the integral (trapezoidal method) of the isolated normalized ΔF/F curves. Areas under the curve were analyzed using single-means t tests against 0.
Results
BLA photoinhibition impairs fear learning
Conditioned suppression of lever pressing for food was used to assess conditioned fear. This is a well-established measure of learned fear. It has several advantages. Suppression has a nonzero baseline because rats lever press for a pellet reward at a constant rate, so revealing decreases and increases in fear; there are high levels of activity during training and testing; it is equally sensitive to visual and auditory CS despite these CS eliciting different amounts of freezing on the same trial (Bevins and Ayres, 1991), and its assessment is completely automated.
We used fiber photometry to examine shock US-evoked activity of BLA neurons. In this and remaining experiments, we used AAVs driven from the CaMKIIα promoter. Because this promoter preferentially, but not exclusively, results in expression in BLA CaMKIIα principal cells, we refer to the manipulated cells as neurons rather than principal neurons. Rats received differential fear conditioning so that one CS (CS+, visual or auditory) was paired with a footshock US and a second CS (CS−, auditory or visual) was not. AAV-CaMKIIα vectors were used to express the genetically encoded calcium (Ca2+) indicator gCaMP6f in BLA neurons (Fig. 1a), and fiber photometry (n = 6) (Gunaydin et al., 2014) was used to record Ca2+ transients during the shock US.
Rats discriminated the dangerous CS+ from the CS−. A suppression ratio of 0.5 indicates no fear, and a suppression ratio of 0 indicates high fear. There was selective suppression of lever pressing, indicative of learned fear to the CS+ (Fig. 1b) (main effect CS+ v CS−, F(1,5) = 86.84, p < 0.0001; main effect trial, F(1,5) = 25.33, p = 0.004; CS × trial interaction, F(1,5) = 58.97, p = 0.001). The shock US evoked robust Ca2+ transients on CS+ trials that were absent on CS− trials (Fig. 1c). Area under the curve analyses for the 5 s following the shock US (Fig. 1d) showed increases for CS+ (day 1: t(22) = 2.26, p = 0.03; day 2: t(22) = 3.01, p = 0.006; day 3: t(23) = 4.01, p = 0.0005) but no changes for CS− (day 1: t(23) = −1.58, p = 0.12; day 2: t(23) = −0.26, p = 0.79; day 3: t(23) = 0.06, p = 0.95), confirming robust US-evoked activity in BLA neurons during our fear conditioning preparation. We also performed a repeated-measures ANOVA to assess change in US-evoked responses across days. There was main effect of trial type (F(1,5) = 8.38, p = 0.034), but no main effect of day (F(1,5) = 3.84, p = 0.11) or trial × day interaction (F(1,5) = 0.63, p = 0.46), showing that there was no change in this US-evoked activity in BLA neurons across the course of conditioning.
Next, in separate animals, whole-cell patch-clamp recordings were made from eNpHR3.0-expressing BLA neurons in vitro to confirm photoinhibition. These neurons had the properties expected of BLA principal neurons (Table 1; Fig. 2a). Photoinhibition induced a rapid-onset hyperpolarization that persisted for duration of the light (Fig. 2b; n = 7 of 7 cells). This was sufficient to inhibit action potentials evoked by depolarizing current injections (Fig. 2c) or synaptic stimulation (Fig. 2d). Light-evoked responses were not observed in non–eNpHR3.0-expressing neurons.
Table 1.
Property | Mean ± SD | n |
---|---|---|
Resting membrane potential | −69 ± 7 mV | 7 |
Input resistance | 145 ± 48 mΩ | 7 |
Membrane time constants | 29 ± 13 ms | 7 |
To examine the impact of photoinhibition during aversive reinforcement, rats expressing AAV-CaMKIIα-eNpHR3.0-eYFP (CaMKIIα-eNpHR3.0) (n = 7) or AAV-CaMKIIα-eYFP (CaMKIIα-eYFP) (n = 7) in BLA (Fig. 3a) received fear conditioning to an auditory CS. They received photoinhibition during US delivery and for 4.5 s afterward (Fig. 3b), to encompass any activity changes persisting beyond the US. There were no differences between groups in pre-CS lever pressing rates (Table 2). Group eNpHR3.0 learned less fear than group eYFP (Fig. 3b) (main effect of group, F(1,12) = 4.74, p = 0.05; main effect of day, F(1,12) = 294.42, p < 0.0001; no group × day interaction, F(1,12) = 4.08, p = 0.06). They also expressed less fear on test (F(1,12) = 7.89, p = 0.016) (Fig. 3b), showing that photoinhibition impaired Pavlovian fear learning in conditioned suppression.
Table 2.
This impairment was specific to inhibition of US-evoked activity. Separate groups expressing CaMKIIα-eYFP (n = 7) or CaMKIIα-eNpHR3.0 (n = 5) in BLA (Fig. 3c) received fear conditioning with photoinhibition at random times during the ITI. Again, there were no differences between groups in pre-CS lever pressing rates. There was no effect on fear learning (acquisition main effect of day, F(1,10) = 90.48, p < 0.0001; no main effect of group, F(1,10) = 0.049, p = 0.82; or group × day interaction, F(1,10) = 0.044, p = 0.83) (test: F(1,10) = 0.35, p = 0.56; Fig. 3d).
BLA photoinhibition augments fear loss during extinction
Just as rats learn to fear a CS that signals shock, so too do they learn to reduce fear to that CS when it is presented in the absence of shock during extinction training. We asked whether BLA photoinhibition during nonreinforcement would affect fear extinction learning. Rats expressing CaMKIIα-eYFP (n = 14) or CaMKIIα-eNpHR3.0 (n = 11) in BLA (Fig. 4a–c) received fear conditioning to an auditory CS followed by extinction training involving CS alone presentations and photoinhibition at the time of the expected but absent footshock US.
Photoinhibition during extinction training augmented loss of conditioned fear (Fig. 4d). Group eNpHR3.0 showed significantly less fear than group eYFP (main effect of group, F(1,23) = 12.37, p = 0.002), and fear decreased across the days of extinction (main effect of day, F(1,23) = 107.73, p < 0.0001; no group × day interaction, F(1,23) = 0.91, p = 0.35). This augmentation of fear loss was temporally specific. Photoinhibition during the extinction ITI (Fig. 4f) in separate groups (eNpHR3.0, n = 5; eYFP n = 7) had no effect (main effect of trial, F(1,10) = 36.34, p < 0.0001; no main effect of group, F(1,10) = 0.27, p = 0.61; and no interaction, F(1,10) = 0.01, p = 0.92) (Fig. 4g).
Manipulations that augment extinction can produce resistance to fear relapse (Leung and Westbrook, 2008; Leung et al., 2012). To examine whether the augmented loss of fear here was accompanied by resistance to relapse, rats that had received extinction training + photoinhibition (Fig. 4d) were divided into four groups. Two groups (eYFP, n = 6; or eNpHR3.0, n = 5) received fear (aversive) reacquisition training so that they again received pairings of the extinguished CS with the shock US (Fig. 4e). There was no photoinhibition during reacquisition. The groups did not differ on the last trial of extinction training (F(1,9) = 1.92, p = 0.19) or on the first trial of reacquisition training (F(1,9) = 2.50, p = 0.14). However, group eNpHR3.0 was retarded in fear reacquisition (main effect of day, F(1,9) = 18.61, p = 0.002; main effect of group, F(1,9) = 13.99, p = 0.005; no group × day interaction, F(1,9) = 0.36, p = 0.56).
Resistance to relapse might have been due to a general deficit in learning about the CS after extinction. The other two groups (eYFP, n = 8; or eNpHR3.0, n = 6) that had received photoinhibition during US omission in fear extinction received Pavlovian appetitive conditioning so that the extinguished fear CS was now paired with delivery of sucrose pellets. There was no photoinhibition during this appetitive conditioning. We measured head entries into the magazine where sucrose pellets were delivered to determine CS elevation ratios, a reliable index of Pavlovian appetitive learning (Lattal, 1999). The eNpHR3.0 group was not retarded in acquisition of appetitive learning (Fig. 4e) (main effect of day, F(1,12) = 19.88, p = 0.0008; no main effect of group, F(1,12) = 1.77, p = 0.20; no group × day interaction, F(1,12) = 0.55, p = 0.47). So, BLA optogenetic inhibition during aversive nonreinforcement enhances loss of fear during extinction and selectively impairs relearning of fear to that CS but does not impair not appetitive learning to that CS.
BLA photoinhibition impairs safety learning
If BLA optogenetic inhibition augments fear loss in an extinction paradigm, does it also augment fear reductions during safety learning? We used an AX+/BX− discrimination design to assess this. Rats expressing CaMKIIα-eNpHR3.0 (n = 6) or CaMKIIα-eYFP (n = 7) in BLA (Fig. 5a) received fear conditioning of the compound CS AX (i.e., CSA and CSX+) and nonreinforced presentations of the compound CS BX (CSB and CSX−) (Fig. 5b). This establishes CSA as a fear CS. CSX is established as a weak fear CS because it is unreliably paired with the shock US. CSB is established as a conditioned inhibitor of fear (a learned safety signal) because it signals absence of the shock US (Wagner et al., 1968; Wagner and Rescorla, 1972; Josselyn et al., 2005; Jovanovic et al., 2012; Kazama et al., 2013). We photoinhibited during the expected but absent shock US on CS BX− trials during discrimination training only (Fig. 5b).
Both groups discriminated the dangerous AX from the safe BX (Fig. 5b). There was no main effect of group (F(1,11) = 1.93, p = 0.19), a main effect of stimulus (F(1,11) = 29.76, p = 0.0002), a linear trend to AX+ (F(1,11) = 119.20, p < 0.0001), and significant quadratic trend to BX− (F(1,11) = 164.24, p < 0.0001). There was slower discrimination learning among eNpHR3.0 animals; day-by-day analyses of fear to BX− showed a significant difference on day 4 (F(1,11) = 6.45, p = 0.027).
Rats were trained to fear a new CS, Y, via pairings with shock (Fig. 5c). CSY would serve as a target for testing the fear inhibitory properties of CSB. Both groups learned to fear CSY at the same rate (no main effect of group, F(1,11) = 0.18, p = 0.67; main effect of day, F(1,11) = 32.36, p = 0.0001; no group × day interaction, F(1,11) = 0.21, p = 0.65). This shows that there was no long-lasting impact of photoinhibition on fear learning to a different CS.
The first criterion for conditioned inhibition is that CSB should reduce fear in a summation test (Rescorla, 1969) (Fig. 5d). Rats were tested with a compound comprising two fear CS (A and Y) versus a compound comprising the inhibitor (B) and a fear CS (Y). There was no photoinhibition. Rats should express high levels of fear to AY because both CSA and CSY had previously been paired with shock. At issue were whether rats showed reduced fear to BY and whether this conditioned inhibition was different between the eNpHR3.0 and eYFP groups. All animals showed evidence for conditioned inhibition, less fear to BY compared with AY (main effect of stimulus, F(1,11) = 91.74, p < 0.0001). However, conditioned inhibition (i.e., BY test), but not conditioned fear (AY test), was weaker in the eNpHR3.0 groups (group × stimulus interaction, F(1,11) = 5.52, p = 0.039; BY simple effect, F(1,11) = 6.34, p = 0.029; no AY simple effect, F(1,11) = 0.75, p = 0.40).
The second criterion for conditioned inhibition is that CSB should be slow to transform into a fear CS in a retardation test (Rescorla, 1969) (Fig. 5e). We compared fear learning with CSB among the eNpHR3.0 and eYFP groups with a control group, eYFP-naive. This control group had received A+/B− discrimination training, which does not establish B as a conditioned inhibitor, and received fear conditioning to B for the first time during the retardation test. They had not received photoinhibition. All groups acquired fear during the retardation test (main effect of day, F(1,16) = 18.88, p = 0.001). CSB passed the retardation test in the eNpHR3.0 and eYFP groups compared with the eYFP-naive group (F(1,16) = 7.70, p = 0.014). However, unlike the summation test, the eYFP and eNpHR3.0 groups did not differ in retardation (no main effect of group or group × day interaction for eYFP vs eNpHR3.0, F(1,16) = 0.54, p = 0.47; eYFP vs eYFP naive, F(1,16) = 0.04, p = 0.83; or eNpHR3.0 vs eYFP naive, F(1,16) = 0.84, p = 0.37). In contrast to fear extinction, photoinhibition during aversive nonreinforcement impaired conditioned inhibition learning as measured by a summation test but, like extinction, retarded later fear relearning.
BLA photoinhibition does not affect simple discrimination or latent inhibition
Simple preexposure to a CS also supports a form of inhibitory learning, latent inhibition (Lubow, 1973). Latently inhibited CS are slow to be transformed into fear CS but, unlike conditioned inhibitors, cannot reduce fear to other CS (Rescorla, 1969). We asked whether BLA photoinhibition would affect CS learning during preexposure.
Rats expressing eNpHR3.0 (n = 5) or eYFP (n = 5) in BLA (Fig. 6a) received presentations of CSA with a shock US and separate presentations of CSB alone with photoinhibition (A+/B−). During A+/B− discrimination training, there was a main effect for CSA across days (linear trend: F(1,8) = 48.88, p = 0.0001) but no main effect of group (F(1,8) = 0.09, p = 0.77) or group × day interaction (F(1,8) = 0.54, p = 0.48) (Fig. 6b). Thus, brief photoinhibition had no effect on learning about CSB, fear learning to CSA, or simple discrimination learning. Such simple discrimination training does not normally imbue CSB with the properties of a safety signal (Rescorla and Wagner, 1972; Wagner and Rescorla, 1972), and we confirmed this by showing that CSB could not reduce fear to CSA in a summation test (no main effect of group, F(1,8) = 0.001, p = 0.97; no significant difference in responding to A or AB, F(1,8) = 0.07, p = 0.79; in the eNpHR3.0 and eYFP groups, F(1,8) = 0.03, p = 0.61) (Fig. 6c). However, preexposure to CSB should have retarded fear conditioning due to latent inhibition. This was the case (CSA from original discrimination training vs CSB, F(1,8) = 39.49, p = 0.0002). BLA photoinhibition did not strengthen or weaken this latent inhibition (no main effect of group, F(1,8) = 0.255, p = 0.63; no interaction between factors, F(1,8) = 0.90, p = 0.37) (Fig. 6d).
Discussion
Here we isolated distinct features of fear, safety, and appetitive learning to understand the learning related roles of BLA neurons during aversive reinforcement and nonreinforcement. Photoinhibition during shock US reinforcement impaired fear learning. Photoinhibition during nonreinforcement also had effects on inhibitory learning: facilitating loss of conditioned responding during extinction, impairing relearning of fear but not learning of appetitive conditioning, and impairing learning of conditioned inhibition but not simple discrimination or latent inhibition. The most parsimonious explanation of these findings is that BLA photoinhibition disrupts CS salience.
Basolateral amygdala and salience
A primary function of the shock US or its absence during fear conditioning is to maintain CS salience (Hall and Rodríguez, 2017). Salience refers to the capacity of a stimulus to activate its internal physiological or mental representation (i.e., it is a quality of the CS). The maintenance of CS salience by the US prevents habituation to the CS during conditioning, allowing the CS to be learned about and responded to. Salience is a precursor for learning, determining the eligibility of a CS to enter into an association as well as the rate at which learning occurs. However, unlike the closely related attentional construct of associability, which refers only to the extent to which a CS can be associated with a US, salience is also necessary for stimulus control over behavior, determining the magnitude of conditioned responding. Highly salient stimuli have increased capacities to support learning and conditioned responding, whereas low salience stimuli have these capacities reduced. The deficits in learning and responding reported here are consistent with BLA photoinhibition during moments of reinforcement and nonreinforcement causing loss of CS salience.
Reductions in CS salience impair fear learning because less salient CS are poorly learned about, due to slower rates of learning, and less able to elicit conditioned responses. Interestingly, because the asymptote of learning is determined by the US, not the CS, asymptotic levels of learning could have been unaffected. Our experimental designs did not permit examination of this possibility, and it would be difficult to assess given the role of CS salience in governing the strength of conditioned responding. Reductions in CS salience will impair learning during extinction but also reduce conditioned responding during extinction because less salient CS are poor at eliciting conditioned responses. In other words, the more rapid loss of fear during extinction likely reflects deficits in behavioral control by the less salient CS rather than differences in extinction learning per se. Impaired fear relearning and responding after extinction follow from this reduction in CS salience. Impairments in safety learning occur for the same reasons. Reductions in CS salience reduce safety learning and the capacity of the safety CS to inhibit fear responses, leading to poorer performance in the summation test. Importantly, despite impairing safety learning, the same reductions in CS salience lead to slower fear learning and less fear responding during the retardation test because less salient CS are poorly learned about and less able to elicit conditioned responses.
The salience reduction had three important characteristics: it was CS-specific, long-lasting, and outcome-specific. The reduction in salience was stimulus-specific: there were no impairments of learning or responding to CS that were not followed by BLA photoinhibition (e.g., offset controls, control CS). Moreover, even within the same animals, there was no deficit in later fear learning to a novel CS paired with shock (Fig. 5). It was long-lasting: impairments in learning and responding were detected days after last photoinhibition (e.g., retardation of fear learning following extinction or conditioned inhibition). Finally, the reductions in salience were specific to learning about or responding to CS with a predictive relationship to the presence of shock or the absence of an expected shock. There was no impairment in subsequent appetitive conditioning to the CS, even though BLA plays a critical role in appetitive learning, or in a simple CS preexposure task where the US was absent. This specificity is striking. It shows the important role of US-evoked activity in maintaining the capacity of the CS to control behavior and suggests that salience changes caused by BLA optogenetic inhibition may be outcome or motivationally specific. This supports the findings that distinct BLA circuits contribute to appetitive and aversive learning (Namburi et al., 2015; Beyeler et al., 2016).
Human anxiety disorders are associated with heightened amygdala activation to threatening stimuli (Etkin and Wager, 2007). Interestingly, the consequences of BLA photoinhibition reported here (stimulus-specific, long-lasting, and outcome-specific reductions in behavioral control) are precisely the goals of interventions for human anxiety disorders. This raises the possibility that therapeutic approaches to reduce threat stimulus salience could be especially effective in ameliorating amygdala contributions to human anxiety.
Other BLA functions in fear learning
BLA principal neurons serve a variety of other functions in fear learning, but these do not coherently account for the results reported here. Reinforcement and nonreinforcement generate a prediction error signal that instructs learning and association formation. Could the effects here be due to modulation of a Rescorla–Wagner temporal difference (Rescorla and Wagner, 1972; Sutton and Barto, 1981; Sutton, 1988) prediction error? Fear learning is instructed by positive prediction error (actual outcome of trial > expected outcome), whereas fear extinction learning is instructed by negative prediction error (actual outcome < expected outcome) (McNally and Westbrook, 2006; McNally et al., 2011). This error determines the strength of US inputs to the BLA (McNally et al., 2011). Interestingly, our photometry data showed no evidence, at the population level, for changes in US-evoked activity (but for one example of such decreases in single-unit activity, see Johansen et al., 2010b; for examples of increases and decreases, see Grewe et al., 2017). BLA photoinhibition could have reduced positive prediction error or augmented negative prediction error. However, conditioned inhibition depends on the same negative prediction error as extinction (Wagner and Rescorla, 1972) and should have been augmented. Instead, conditioned inhibition was impaired.
Prediction error also instructs association formation indirectly by controlling attention allocated to the CS (i.e., associability) (Pearce and Hall, 1980). CS associability is upregulated when prediction error is high and downregulated when prediction error is low. BLA photoinhibition could have reduced CS associability or prevented upregulation of associability and so reduced fear and safety learning. However, there was no effect on latent inhibition, which is due to a reduction in CS associability. Moreover, extinction learning also involves upregulation of associability because it involves a prediction error and so should have been reduced. Instead, the loss of fear during extinction was enhanced. Together, prediction error accounts of BLA activity at the time of reinforcement and nonreinforcement are unable to explain the impact of BLA photoinhibition on fear learning.
Activity of BLA principal neurons during the post-training period aids consolidation of fear memories (Huff et al., 2013), and such consolidation processes can occur during the aftermath of each conditioning trial (Kamin, 1968; Wagner et al., 1973). However, extinction memories, like fear memories, undergo consolidation. If consolidation had been impaired, then fear extinction should have been impaired and later fear relearning enhanced. Instead, the opposite pattern of results was observed.
Finally, these effects of BLA photoinhibition cannot be due to a simple blunting of emotional reactivity. Although such a blunting could impair fear and safety learning by reducing the aversive emotional response to shock and the relief occasioned by safety, respectively, it would not lead to the long-lasting and fear-specific impairments in later learning.
These roles for BLA neurons in aversive prediction errors, memory consolidation, and other processes are likely embedded within distributed, multiplexed reinforcement signals (e.g., Roesch et al., 2010, 2012). For example, in Pavlovian appetitive conditioning, multiple neural signals can be detected in BLA during reinforcement and nonreinforcement that are well described by the actions of prediction error and its effects on CS processing (i.e., associability) and US processing (e.g., Roesch et al., 2010, 2012). Alternatively, they could involve distinct subpopulations of BLA principal neurons that might be more specifically revealed via pathway- and projection-specific imaging and manipulation. Finally, they might involve activity of the same or different neurons at different times during the conditioning trial (Livneh and Paz, 2012; Likhtik and Paz, 2015; Sengupta et al., 2016). For example, we show here that CS salience is determined by BLA activity during US presentations. CS associability may be determined by BLA activity during CS presentations. Regardless, our data show that the primary behavioral consequence of BLA optogenetic inhibition during reinforcement and nonreinforcement across fear conditioning, fear extinction, and conditioned inhibition is a reduction in CS salience.
In conclusion, we show that brief optogenetic inhibition of BLA neurons around moments of aversive reinforcement or nonreinforcement causes reductions in the salience of conditioned stimuli, rendering these stimuli less able to be learned about and less able to control fear or safety behaviors. This reduction was stimulus-specific, long-lasting, and specific to aversive emotional states, precisely the goals of therapeutic interventions in human anxiety. Our findings identify a core learning process disrupted by BLA optogenetic inhibition. They suggest that a primary function of BLA neurons during reinforcement and nonreinforcement is to maintain the salience of conditioned stimuli that signal reinforcement or nonreinforcement. This maintenance of salience is a necessary precursor for such stimuli to gain control over fear and safety behavior.
Footnotes
This work was supported by Australian Research Council Grants DP170100075 and DP160100004 to G.P.M., and Australian Postgraduate Award to Y.L. Data are archived in the University of New South Wales Long Term Data Archive (ID: D0235272). We thank Kathryn Baker, Kelsey Zimmerman, Nathan Holmes, and Fred Westbrook for helpful discussions of these experiments.
The authors declare no competing financial interests.
References
- Annau Z, Kamin LJ (1961) The conditioned emotional response as a function of the intensity of the US. J Comp Physiol Psychol 54:428–432. 10.1037/h0042199 [DOI] [PubMed] [Google Scholar]
- Bevins RA, Ayres JJ (1991) Two issues in Pavlovian fear conditioning: selective fear of bright vs dark, and CS determinants of CR form. Behav Process 24:211–218. 10.1016/0376-6357(91)90076-C [DOI] [PubMed] [Google Scholar]
- Beyeler A, Namburi P, Glober GF, Simonnet C, Calhoon GG, Conyers GF, Luck R, Wildes CP, Tye KM (2016) Divergent routing of positive and negative information from the amygdala during memory retrieval. Neuron 90:348–361. 10.1016/j.neuron.2016.03.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davis M. (1992) The role of the amygdala in fear and anxiety. Annu Rev Neurosci 15:353–375. 10.1146/annurev.ne.15.030192.002033 [DOI] [PubMed] [Google Scholar]
- Ehrlich I, Humeau Y, Grenier F, Ciocchi S, Herry C, Lüthi A (2009) Amygdala inhibitory circuits and the control of fear memory. Neuron 62:757–771. 10.1016/j.neuron.2009.05.026 [DOI] [PubMed] [Google Scholar]
- Etkin A, Wager TD (2007) Functional neuroimaging of anxiety: a meta-analysis of emotional processing in PTSD, social anxiety disorder, and specific phobia. Am J Psychiatry 164:1476–1488. 10.1176/appi.ajp.2007.07030504 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gore F, Schwartz EC, Brangers BC, Aladi S, Stujenske JM, Likhtik E, Russo MJ, Gordon JA, Salzman CD, Axel R (2015) Neural representations of unconditioned stimuli in basolateral amygdala mediate innate and learned responses. Cell 162:134–145. 10.1016/j.cell.2015.06.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grewe BF, Gründemann J, Kitch LJ, Lecoq JA, Parker JG, Marshall JD, Larkin MC, Jercog PE, Grenier F, Li JZ, Lüthi A, Schnitzer MJ (2017) Neural ensemble dynamics underlying a long-term associative memory. Nature 543:670–675. 10.1038/nature21682 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gunaydin LA, Grosenick L, Finkelstein JC, Kauvar IV, Fenno LE, Adhikari A, Lammel S, Mirzabekov JJ, Airan RD, Zalocusky KA, Tye KM, Anikeeva P, Malenka RC, Deisseroth K (2014) Natural neural projection dynamics underlying social behavior. Cell 157:1535–1551. 10.1016/j.cell.2014.05.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hall G, Rodríguez G (2017) Habituation and conditioning: salience change in associative learning. J Exp Psychol Anim Learn Cogn 43:48–61. 10.1037/xan0000129 [DOI] [PubMed] [Google Scholar]
- Harris RJ. (2004) ANOVA: an analysis of variance primer. Itasca, IL: Peacock. [Google Scholar]
- Huff ML, Miller RL, Deisseroth K, Moorman DE, LaLumiere RT (2013) Posttraining optogenetic manipulations of basolateral amygdala activity modulate consolidation of inhibitory avoidance memory in rats. Proc Natl Acad Sci U S A 110:3597–3602. 10.1073/pnas.1219593110 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johansen JP, Hamanaka H, Monfils MH, Behnia R, Deisseroth K, Blair HT, LeDoux JE (2010a) Optical activation of lateral amygdala pyramidal cells instructs associative fear learning. Proc Natl Acad Sci U S A 107:12692–12967. 10.1073/pnas.1002418107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johansen JP, Tarpley JW, LeDoux JE, Blair HT (2010b) Neural substrates for expectation-modulated fear learning in the amygdala and the periaqueductal gray. Nat Neurosci 13:979–986. 10.1038/nn.2594 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johansen JP, Diaz-Mataix L, Hamanaka H, Ozawa T, Ycu E, Koivumaa J, Kumar A, Hou M, Deisseroth K, Boyden ES, LeDoux JE (2014) Hebbian and neuromodulatory mechanisms interact to trigger associative memory formation. Proc Natl Acad Sci U S A 111:5584–5592. 10.1073/pnas.1421304111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Josselyn SA, Falls WA, Gewirtz JC, Pistell P, Davis M (2005) The nucleus accumbens is not critically involved in mediating the effects of a safety signal on behavior. Neuropsychopharmacology 30:17–26. 10.1038/sj.npp.1300530 [DOI] [PubMed] [Google Scholar]
- Jovanovic T, Kazama A, Bachevalier J, Davis M (2012) Impaired safety signal learning may be a biomarker of PTSD. Neuropharmacology 62:695–704. 10.1016/j.neuropharm.2011.02.023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kamin LJ. (1968) Attention-like processes in classical conditioning. In: Miami symposium on the prediction of behavior: aversive stimulation (Campbell BJ, Church RM, eds), pp 9–33. Miami, Florida: University of Miami. [Google Scholar]
- Kazama AM, Schauder KB, McKinnon M, Bachevalier J, Davis M (2013) A novel AX+/BX− paradigm to assess fear learning and safety-signal processing with repeated-measure designs. J Neurosci Methods 214:177–183. 10.1016/j.jneumeth.2013.01.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lattal KM. (1999) Trial and intertrial durations in Pavlovian conditioning: issues of learning and performance. J Exp Psychol Anim Behav Process 25:433–450. 10.1037/0097-7403.25.4.433 [DOI] [PubMed] [Google Scholar]
- Leung HT, Westbrook RF (2008) Spontaneous recovery of extinguished fear responses deepens their extinction: a role for error-correction mechanisms. J Exp Psychol Anim Behav Process 34:461–474. 10.1037/0097-7403.34.4.461 [DOI] [PubMed] [Google Scholar]
- Leung HT, Reeks LM, Westbrook RF (2012) Two ways to deepen extinction and the difference between them. J Exp Psychol Anim Behav Process 38:394–406. 10.1037/a0030201 [DOI] [PubMed] [Google Scholar]
- Likhtik E, Paz R (2015) Amygdala-prefrontal interactions in (mal)adaptive learning. Trends Neurosci 38:158–166. 10.1016/j.tins.2014.12.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Livneh U, Paz R (2012) Amygdala-prefrontal synchronization underlies resistance to extinction of aversive memories. Neuron 75:133–142. 10.1016/j.neuron.2012.05.016 [DOI] [PubMed] [Google Scholar]
- Lubow RE. (1973) Latent inhibition. Psychol Bull 79:398–407. 10.1037/h0034425 [DOI] [PubMed] [Google Scholar]
- Lüthi A, Luscher C (2014) Pathological circuit function underlying addiction and anxiety disorders. Nat Rev Neurosci 17:1635–1643. 10.1038/nn.3849 [DOI] [PubMed] [Google Scholar]
- Marek R, Strobel C, Bredy TW, Sah P (2013) The amygdala and medial prefrontal cortex: partners in the fear circuit. J Physiol 591:2381–2391. 10.1113/jphysiol.2012.248575 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maren S, Quirk GJ (2004) Neuronal signalling of fear memory. Nat Rev Neurosci 5:844–852. 10.1038/nrn1535 [DOI] [PubMed] [Google Scholar]
- McKernan MG, Shinnick-Gallagher P (1997) Fear conditioning induces a lasting potentiation of synaptic currents in vitro. Nature 390:609–611. 10.1038/37605 [DOI] [PubMed] [Google Scholar]
- McNally GP, Westbrook RF (2006) Predicting danger: the nature, consequences, and neural mechanisms of predictive fear learning. Learn Mem 13:245–253. 10.1101/lm.196606 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McNally GP, Johansen JP, Blair HT (2011) Placing prediction into the fear circuit. Trends Neurosci 34:283–292. 10.1016/j.tins.2011.03.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Namburi P, Beyeler A, Yorozu S, Calhoon GG, Halbert SA, Wichmann R, Holden SS, Mertens KL, Anahtar M, Felix-Ortiz AC, Wickersham IR, Gray JM, Tye KM (2015) A circuit mechanism for differentiating positive and negative associations. Nature 520:675–678. 10.1038/nature14366 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paré D, Quirk GJ, LeDoux JE (2004) New vistas on amygdala networks in conditioned fear. J Neurophysiol 92:1–9. 10.1152/jn.00153.2004 [DOI] [PubMed] [Google Scholar]
- Paxinos G, Watson C (2007) The rat brain in stereotaxic coordinates, Ed 6 Amsterdam, the Netherlands: Elsevier. [Google Scholar]
- Pearce JM, Hall G (1980) A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev 87:532–552. 10.1037/0033-295X.87.6.532 [DOI] [PubMed] [Google Scholar]
- Rescorla RA. (1969) Pavlovian conditioned inhibition. Psychol Bull 72:77–94. 10.1037/h0027760 [DOI] [Google Scholar]
- Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning, Vol II: Current research and theory (Black AH, Prokasy WF, eds), pp 64–99. New York, NY: Appleton-Century Crofts. [Google Scholar]
- Roesch MR, Calu DJ, Esber GR, Schoenbaum G (2010) Neural substrates of variations in event-processing learning in the basolateral amygdala. J Neurosci 30:2464–2471. 10.1523/JNEUROSCI.5781-09.2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roesch MR, Esber GR, Li J, Daw ND, Schoenbaum G (2012) Surprise! Neural correlates of Pearce-Hall and Rescorla–Wagner coexist within the brain. Eur J Neurosci 35:1190–1200. 10.1111/j.1460-9568.2011.07986.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sah P, Faber ES, Lopez De Armentia M, Power J (2003) The amygdaloid complex: anatomy and physiology. Physiol Rev 83:803–834. 10.1152/physrev.00002.2003 [DOI] [PubMed] [Google Scholar]
- Schafe GE, Nader K, Blair HT, LeDoux JE (2001) Memory consolidation of Pavlovian fear conditioning: a cellular and molecular perspective. Trends Neurosci 24:540–546. 10.1016/S0166-2236(00)01969-X [DOI] [PubMed] [Google Scholar]
- Sengupta A, Winters B, Bagley EE, McNally GP (2016) Disrupted prediction error links excessive amygdala activation to excessive fear. J Neurosci 36:385–395. 10.1523/JNEUROSCI.3670-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sutton RS. (1988) Learning to predict by the methods of temporal differences. Machine Learning 3:9–44. 10.1023/A:1022633531479 [DOI] [Google Scholar]
- Sutton RS, Barto AG (1981) Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88:135–170. 10.1037/0033-295X.88.2.135 [DOI] [PubMed] [Google Scholar]
- Tovote P, Fadok JP, Lüthi A (2015) Neuronal circuits for fear and anxiety. Nat Rev Neurosci 16:317–331. 10.1038/nrn3945 [DOI] [PubMed] [Google Scholar]
- Wagner AR, Logan FA, Haberlandt K, Price T (1968) Stimulus selection in animal discrimination learning. J Exp Psychol 76:171–180. 10.1037/h0025414 [DOI] [PubMed] [Google Scholar]
- Wagner AR, Rudy JW, Whitlow JW (1973) Rehearsal in animal conditioning. J Exp Psychol 97:407–426. 10.1037/h0034136 [DOI] [PubMed] [Google Scholar]
- Wagner AR, Rescorla RA (1972) Inhibition in Pavlovian conditioning: application of a theory. In: Inhibition and learning (Halliday MS, Boakes RA, eds), pp 301–336. London, UK: Academic Press. [Google Scholar]
- Wolff SB, Gründemann J, Tovote P, Krabbe S, Jacobson GA, Müller C, Herry C, Ehrlich I, Friedrich RW, Letzkus JJ, Lüthi A (2014) Amygdala interneuron subtypes control fear learning through disinhibition. Nature 509:453–458. 10.1038/nature13258 [DOI] [PubMed] [Google Scholar]
- Yau JO, McNally GP (2015) Pharmacogenetic excitation of dorsomedial prefrontal cortex restores fear prediction error. J Neurosci 35:74–83. 10.1523/JNEUROSCI.3777-14.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]