Abstract
Combining beta-blockers with exposure-therapy has been advocated to reduce fear, yet experimental studies combining beta-blockers with memory reactivation have had contradictory results. We explored how beta-blockade might affect the course of safety learning and the subsequent return of fear in a double-blind placebo-controlled functional magnetic resonance imaging study in humans (N=46). A single dose of propranolol prior to extinction learning caused a loss of conditioned fear responses, and prevented the subsequent return of fear and decreased explicit memory for the fearful events in the absence of drug. Fear-related neural responses were persistently attenuated in the dorsal medial prefrontal cortex (dmPFC), increased in the hippocampus 24h later, and correlated with individual behavioral indices of fear. Prediction error-related responses in the ventral striatum persisted during beta-blockade. We suggest that this pattern of results is most consistent with a model where beta-blockade can prevent the return of fear by i) reducing retrieval of fear memory, via the dmPFC and ii) increasing contextual safety learning, via the hippocampus. Our findings suggest that retrieval of fear memory and contextual safety learning form potential mnemonic target mechanisms to optimize exposure-based therapy with beta-blockers.
Keywords: fear, conditioning, extinction, beta-blockade, dorsomedial prefrontal cortex, hippocampus
INTRODUCTION
The primary treatment for trauma- and stressor-related disorders is exposure therapy, which is based on the principle of fear extinction. Although such extinction-based therapies can be initially effective, 19-62% of patients experience return of fear following treatment (Vervliet et al, 2013). This risk of relapse, i.e. fear recovery, highlights the need for effective treatments that persist. Here we aimed to investigate the effects of beta-blockade on extinction and the subsequent return of fear in humans.
Reports that reactivating fear memories in the presence of beta-blockers can prevent the return of fear have advocated combining psychotherapy with beta-blockers to improve outcome (Debiec and Ledoux, 2004; Kindt et al, 2009; Kroes et al, 2010; Muravieva and Alberini, 2010; Schwabe et al, 2012). Beta-blockers can reduce retrieval of fear memories (Kroes et al, 2010; Muravieva et al, 2010), and have been suggested to impair reconsolidation (Debiec et al, 2004; Kindt et al, 2009; Schwabe et al, 2012), both associated with a reduction of fear responses. Research on reconsolidation proposes that upon reactivation, stable memories can become flexible again and susceptible to strengthening or weakening and require re-storage to be maintained (Nader et al, 2000; Sara, 2000). Critically, memory needs to be reactivated by a brief single reminder for the original memory to become flexible and undergo reconsolidation (Eisenberg et al, 2003). In contrast, extinction-based psychotherapy typically involves reactivating fear memory by repeated and prolonged exposure to a fear-evoking stimulus in absence of aversive consequences resulting in reduction of fear responses (Vervliet et al, 2013). Unlike reconsolidation, extinction does not alter the original memory but forms a novel co-existing safety memory that competes with the expression of fear (Myers and Davis, 2006; Quirk and Mueller, 2008). The influence of beta-blockade on extinction learning is unclear, but several studies report that beta-blockade during extinction impairs the consolidation of the novel safety memory resulting in a subsequent increase in fear (Bos et al, 2012; Cain et al, 2004; Mueller et al, 2008; Ouyang and Thomas, 2005). In sum, fear memory reactivation first involves retrieval and, dependent on reactivation conditions, reconsolidation or extinction can subsequently become the dominant memory process (Eisenberg et al, 2003). We hypothesize that beta-blockade will affect the dominant memory mechanism and can thus either decrease or increase the return of fear, and hence influence therapeutic outcome positively or negatively. Combining beta-blockers with exposure-therapy is therefore precarious until we better understand and can experimentally manipulate the mnemonic mechanisms that should be targeted to prevent fear recovery.
We also aimed to investigate the effect of beta-blockade on different memory systems. Based on previous research we hypothesized that beta-blockade might alternatively attenuate autonomic fear responses (Kindt et al, 2009), reduce explicit emotional memory (Kroes et al, 2010) and/or the subjective feeling for fearful events (Schwabe et al, 2013). Although merely attenuating autonomic fear responses could be considered clinically optimal, intact explicit knowledge may increase the likelihood of fear recovery (Phelps et al, 2001; Raio et al, 2012) and could thus also be a necessary target of effective treatment strategies.
Finally, we aimed to investigate the influence of beta-blockade on the neural mechanisms underlying fear memory and their relationship to behavior. Within the domain of fear conditioning and extinction distinct brain regions including the amygdala, midbrain, dorsomedial prefrontal cortex (dmPFC), ventromedial prefrontal cortex (vmPFC), hippocampus, and insula have been attributed with specific functions and can collectively be described as a fear and safety neurocircuitry (Milad et al, 2007; Myers et al, 2006; Quirk et al, 2008). We hypothesized that beta-blockade may influence this fear and safety neurocircuitry as it is under noradrenergic control (Hermans et al, 2011). Furthermore, extinction learning has been proposed to critically depend on mismatch between expectancy and outcome, i.e. prediction error signals (Rescorla and Wagner, 1972a). The ventral striatum reflects a neural signature of prediction errors (O’Doherty et al, 2003) that may drive learning in the fear and safety neurocircuitry (Schiller et al, 2008). Ventral striatal prediction error-related responses have been found to be affected by dopamine manipulation (Pessiglione et al, 2006). Considering the close relationship between the two catecholamines dopamine and noradrenaline and their pharmacological manipulation (Dayan and Finberg, 2003; Fang and Yu, 1995; Smith and Greene, 2012) we hypothesized that beta-blockade might alter this neural signature of prediction errors and potentially affect learning. Further, it has been suggested that alteration of reactivated fear memory by beta-blockade depends on a prediction error signal (Sevenster et al, 2013b). We therefore hypothesized that individual’s neural signatures of prediction error responses might be correlated with the absence of fear recovery.
In the current study, we tested whether beta-blockade during extinction learning one day after acquisition would result in either a subsequent increase or decrease in the expression of conditioned fear as measured one day later, in the absence of drug. We designed our study such that we could probe effects of beta-blockade on neural activity in the fear and safety neurocircuitry and its relationship to autonomic, explicit, and subjective measures of fear; an approach that could potentially provide insight into memory and neural mechanisms underlying a potential therapeutic effect.
MATERIALS AND METHODS
For a full description of the Materials and Methods see the Supplemental Information. Briefly, fifty-four healthy young human participants were initially included in the study. In a double-blind design, participants were pseudo-randomly assigned to one of the drug groups so that for each of four consecutive participants two would receive a beta-blocker (40mg Propranolol HGl) and two placebo (microcrystalline cellulose). Five participants were excluded on Day 1 as they displayed no conditioned skin conductance responses, three participants could not complete the study due to scanner problems and one participant in the propranolol group did not complete the reinstatement and re-extinction task due to scanner problems. The placebo group comprised 24 participants (11 males, 13 females) and the propranolol group 22 participants (8 males, 14 females). All participants gave written informed consent. The study was approved by the institutional ethics committee (CMO Regio Arnhem-Nijmegen, The Netherlands, CMO2010/257).
Over three consecutive days participants were differentially cue-conditioned to a stimulus signaling threat (CS+) of transcutaneous electrical shock (US) and a cue signaling safety (CS−) in a specific context on Day 1 (Fig. S1a). On Day 2 participants received a single dose of propranolol or placebo and underwent an extinction paradigm. On Day 3, in the absence of drug, the possible return of fear was first tested as spontaneous recovery during a recall task. Next, a stronger test of fear recovery was employed where first the general level of arousal was increased by four unsignaled shocks, and next fear reinstatement was assessed during a re-extinction task. The context of extinction, recall, and re-extinction differed from conditioning (ABBB design) to better match treatment settings, and to maximize the chance of detecting hippocampal responses (Kalisch et al, 2006; Marschner et al, 2008; Milad et al, 2007). We measured the influence of beta-blocker administration on Day 2 on (a) learned fear as indexed by skin conductance responses (SCR) (Bach et al, 2011) on Day 2 and 3, (b) explicit memory and subjective experience of the fearful events tested at the end of Day 3, (c) neural functioning using Blood Oxygenation Level Dependent functional Magnetic Resonance Imaging (BOLD-fMRI) on Day 2 and 3, (d) the relationship between behavior (SCR and explicit memory) and neural responses, and (e) a neural signature of reinforcement learning.
RESULTS
We first determined that no incidental between-group differences existed at baseline and that propranolol was active on Day 2 only. There were no significant differences with respect to age, trait-anxiety, heart-rate, and blood-pressure on Day 1. The single-dose of propranolol affected blood pressure on Day 2, but not Day 3, replicating previous reports (Kindt et al, 2009; Kroes et al, 2010) (Fig. S1c, Supplemental Results).
Beta-adrenergic blockade results in a loss of fear, and prevents return of fear
Next, we focused on effects of beta-blockade during extinction learning on sympathetic fear responses as measured using SCR. Both groups acquired differential conditioned fear responses on Day 1 (Phase (early, late phase of task) × CStype (CS+, CS−) repeated measures ANOVA: F1, 44=5.503, p=0.024). There were no significant differences between groups and, critically, differential responses at the end of conditioning were similar between groups indicating the acquisition of comparable fear memory in both groups (Fig. 1 and Table S1 for additional statistics). Note, we only included non-reinforced CS+ trials in our analyses to prevent potential bias by shock delivery. For Day 2, we observed an interaction of Drug (propranolol, placebo) × Phase (early, late) × CStype (CS+, CS−) (F1, 44=7.779, p=0.008), but no main effect of drug. Specifically, during the early phase of extinction the placebo group showed retention of learned fear, whereas the propranolol group did not show significant differences in response to CS+ and CS− presentations. In the late phase of extinction we no longer observed a group effect and neither group showed significant differential conditioned responses, indicating successful extinction training. On Day 3, after the drug had washed out, we still observed between-group differences (recall: Drug × Phase (F1.676, 73.739=7.565, p=0.002); re-extinction: Drug × CStype (F1, 43=5.560, p=0.023)). While the placebo group showed both spontaneous recovery and reinstatement of fear, the propranolol group showed no spontaneous recovery and no fear reinstatement. Hence, a single dose of propranolol prior to extinction learning eliminated learned fear responses in a new context, resulted in a subsequent loss of fear and prevented the return of fear one day later in the absence of drug.
Beta-adrenergic blockade attenuates explicit memory of fearful events
Beyond propranolol eliminating sympathetic fear responses, we also found that beta-blockade affected explicit memory. At the end of the experiment on Day 3, participants estimated the number of shocks they had received following the presentation of each type of CS on each day (Fig. 1). To avoid explicit recall from influencing SCR (Phelps et al, 2001; Raio et al, 2012), explicit estimation was probed only at the end of Day 3. All participants received the same number of shocks, and learning as measured by SCR on Day 1 was indistinguishable between groups suggesting that both groups acquired comparable fear memories. Nevertheless, participants who had received propranolol on Day 2 underestimated the number of shocks they had received following CS+ presentations on Day 1 (Day (day 1, 2, 3) × CStype (CS+, CS−) × Drug (propranolol, placebo): F2, 84=3.518, p=0.034). No significant differences for the CS− were observed. Beta-blockade did not significantly affect subjective fear measures (Supplemental Results). Thus, beta-blockade during extinction eliminated not only learned sympathetic fear responses, but also reduced explicit memory of the fearful events.
Beta-adrenergic blockade affects the fear and safety neurocircuitry
In view of the positive effects of propranolol on eliminating sympathetic fear responses and reducing explicit memory, we next examined propranolol effects on neuronal responses in the fear and safety neurocircuitry. To increase specificity we followed previous region of interest analyses in the field (Kalisch et al, 2006; Milad et al, 2007; Phelps et al, 2004). As such, we restricted all our BOLD-fMRI analyses to our previously defined regions of interest (amygdala, dmPFC, midbrain, vmPFC, hippocampus, and insula) that also showed differential responses [CS+ versus CS−] across both groups. This approach ensured that selection of regions of interest was orthogonal to potential drug interactions.
On Day 2, propranolol eliminated differential conditioned SCR. BOLD-fMRI data analyses comparing CS+ trials to the CS− trials during extinction revealed differential neural responses in the insula, dmPFC, vmPFC, and midbrain across both groups (Fig. 2, Table S2). We observed group differences in dmPFC and midbrain activity (Drug × CStype dmPFC: F1, 44=4.894, p=0.032; midbrain: F1, 44=4.509, p=0.039, Fig. 3, Table S3). Specifically, the placebo group, but not the propranolol group, exhibited greater dmPFC responses [CS+ vs. CS−]. This differential dmPFC responses in the placebo group disappeared during extinction learning. In contrast, the propranolol group, but not the placebo group, exhibited greater midbrain responses [CS+ vs. CS−] throughout the task.
On Day 3, the placebo group showed spontaneous recovery and reinstatement of fear whereas the propranolol group did not. BOLD-fMRI data analyses for the recall task revealed differential neural responses [CS+ vs. CS−] in the midbrain, hippocampus, amygdala, and dmPFC across both groups (Fig. 2, Table S3). We observed a group difference in hippocampal responses that just fell short of being significant (Drug × CStype: F1, 44=3.820, p=0.053), yet this between-groups trend effect was corroborated by significant across-group analyses probing the relationship between neural responses and SCR (see below). Specifically, the propranolol group showed greater differential hippocampal responses during the early phase of the recall task (testing spontaneous recovery), whereas evidence for this differential response only arose in the late phase for the placebo group (Fig. 3, Table S3). During the re-extinction task (i.e. after fear reinstatement), we observed BOLD-fMRI responses [CS+ vs. CS−] in regions including the dmPFC and insula across both groups (Fig. 2, Table S3). The dmPFC responses were greater in the placebo group than in the propranolol group (main effect Drug: F1, 43=4.371, p=0.042, Fig. 3, Table S3). Other regions exhibiting differential responses were not significantly affected by beta-blockade (Fig. S2, Table S3). Thus, beta-blockade during extinction affected neural processing in the dmPFC and midbrain on Day 2, and altered subsequent neural processing during the recall and re-extinction task in the hippocampus and dmPFC on Day 3, respectively.
Previous research has indicated a relationship between the expression of differential SCR and dmPFC responses (Klumpers et al, online prepublication), and between hippocampus responses and an SCR index of subsequent fear recovery (Milad et al, 2007). In addition, the hippocampus has been implicated in explicit knowledge of conditioned contingencies (Bechara, 1995; Knight et al, 2009). We replicated these findings and observed that smaller dmPFC responses were associated with less fear, whereas greater hippocampal responses were associated with less fear and reduced explicit memory of fearful events (see Supplementary Results and Fig. S3).
Ventral striatal prediction error responses persist during beta-blockade and show no significant relationship with the loss of fear
In subsequent analyses we aimed to test our two hypotheses that beta-blockade might affect a neural signature of prediction errors and that this neural signature might be correlated with absence of the return of fear. We first fitted a Rescorla-Wagner model (Rescorla and Wagner, 1972b) to the SCR data and observed that neural responses in the ventral striatum reflected the behavioral estimates of the prediction errors (Fig. 4, Table S4), replicating previous findings (O’Doherty et al, 2003; Schiller et al, 2008). Testing our first hypothesis we found that this well-established ventral striatal signature of prediction error responses remained intact during beta-blockade (Fig. 4). Moreover, rank-correlation analyses across participants from both groups revealed that participants with greater mean differential SCR responses, i.e. those whose SCR reflected most learning, exhibited greater ventral striatal prediction errors (Fig. 4). Testing our second hypothesis, we detected no significant correlation between ventral striatal prediction error-related responses and spontaneous recovery or the reinstatement of fear on Day 3 (Fig. 4). We also observed prediction error related responses in the ventral striatum when we fitted the model’s free parameters to the SCR data of the extinction task separately for each group. Assessing the optimal solution for each individual subject did not reveal group differences in learning rate or a relationship with the return of fear (see Supplemental Results). Thus, we found evidence for learning-related ventral striatal prediction error responses that persisted during beta-blockade and that were unrelated to the modification of retrieved memories.
DISCUSSION
Here we aimed to investigate the effects of beta-blockade on extinction and the subsequent return of fear in humans. (1) We show that a single dose of the beta-blocker propranolol administered prior to extinction learning eliminated differential fear responses during extinction, and prevented spontaneous recovery and reinstatement of fear in the absence of drug one day later. (2) Beta-blockade also reduced subsequent explicit memory, but not the subjective feelings, for the fearful events in the absence of drug. (3) We found beta-blockade to affect the fear and safety neurocircuitry. During extinction we observed a loss of fear-related responses in the dmPFC and increased responses in the midbrain. The loss of fear on Day 3 was accompanied by increased differential responses in the hippocampus during recall, whereas the absence of the return of fear was reflected by reduced responses in the dmPFC. (4) We identified that neural responses in beta-blockade affected regions of the fear and safety neurocircuitry correlated with observed changes in behavior. The dmPFC responses correlated positively with sympathetic fear responses, whilst hippocampal responses correlated negatively with fear responses and explicit memory of the fearful events. In complementary analyses we found prediction error responses in the ventral striatum that persisted during beta-blockade and bore no relationship with the loss of fear (Fig. 4).
Mechanistic implications of physiological results
For Day 2, analyses of SCR during extinction indicated that beta-blockade affected extinction learning. For Day 3 after the drug had washed out, our SCR results indicate that beta-blockade resulted in a loss of fear and prevented the return of fear. We conceive that our results could be explained by an effect on several mechanisms, namely i) retrieval, ii) reconsolidation, and/or iii) new contextual safety learning. First, our results accord with studies reporting a role for noradrenaline in retrieval of aversive and appetitive memory (Kroes et al, 2010; Muravieva et al, 2010; Otis et al, 2013; Otis et al, 2014; Otis and Mueller, 2011b; Ouyang et al, 2005). We observed an interaction effect between Drug and CStype but not a main effect of Drug on Day 2 indicating an inability to discriminate between the CS+ and CS− and a generalization of fear to both stimuli, but not a general reduction in fear responses. The detection of this effect was only possible because we employed a differential conditioning (CS+ vs. CS−) paradigm that is standard in most human conditioning studies, but has not been used in previous animals studies and a previous human study investigating the role of beta-blockade during extinction learning (Bos et al, 2012; Cain et al, 2004; Mueller et al, 2008). Beta-blockade induced retrieval impairments have been found to persist (Otis et al, 2011a, 2013; Otis et al, 2014) and may thus also have contributed to the loss of fear and absence of fear recovery we observed on Day 3.
Second, our results of Day 3 are similar to those of previous studies combining beta-blockade with single brief memory reactivation that have attributed the loss of fear and absence of the return of fear to disrupted reconsolidation, i.e. an attenuation of the original fear memory trace (Debiec et al, 2004; Kindt et al, 2009; Misanin et al, 1968; Nader et al, 2000; Przybyslawski and Sara, 1997; Schwabe et al, 2012; Sevenster et al, 2013b). Reconsolidation and extinction have been suggested to be mutually exclusive processes where interventions only affect the dominant memory process (Eisenberg et al, 2003). The initiation of reconsolidation requires a single brief memory reactivation whereas we repeatedly reactivated memory likely causing extinction to be the dominant memory process effectively preventing reconsolidation to occur. Furthermore, reconsolidation is a time-dependent process (Nader and Hardt, 2009), yet we already observe an effect of beta-blockade over the multiple extinction trials, which might not be powerful enough to be detected by a single reactivation trial, adding to our consideration that an effect on reconsolidation is unlikely to explain our results.
Third, our results of Day 3 contrast with studies that report impaired consolidation of the extinction memory trace due to beta-blockade resulting in increased fear one day later (Bos et al, 2012; Mueller et al, 2008; Ouyang et al, 2005). The role of noradrenaline in strengthening learning and consolidation including that of extinction training is well-established (Cain et al, 2004; Davis et al, 1979; McGaugh, 2004). Further, central neural signals can function as intrinsic reinforcer and drive fear-related neural plasticity (Clugnet and LeDoux, 1990). We therefore conceive the possibility that phasic noradrenaline release associated with fear expression functions as an intrinsic US resulting in the association of conditioned fear with a novel context effectively supporting fear generalization. Thus, eliminating expression of differential conditioned responses during extinction may have prevented formation of an association between the new context and the retrieved fear memory. In support of this idea, an effect of beta-blockade on retrieval may result in a sustained reduction of emotional memory due to new learning at the time of retrieval (Kroes et al, 2010). In contrast, studies that have reported impaired consolidation of extinction due to beta-blockade have tested extinction memory in the same context as in which conditioning occurred (Bos et al, 2012; Mueller et al, 2008; Ouyang et al, 2005), potentially explaining discrepancies.
Linking beta-blockade effects on brain and behavior
Our results indicate that beta-blockade prior to extinction learning affected neural functioning in the dmPFC, midbrain, and hippocampus. First, the dmPFC is considered to be the human homologue of the rodent prelimbic cortex (Heidbreder and Groenewegen, 2003; Ongur et al, 2003), suggested to support retention and retrieval of fear (Burgos-Robles et al, 2009; Gilmartin and McEchron, 2005; Klavir et al, 2012; Schiller and Johansen, 2009), and be affected by beta-blockade resulting in reduced retrieval of fear (Burgos-Robles et al, 2009; Gilmartin et al, 2005; Muravieva et al, 2010; Otis et al, 2011a, 2013; Rodriguez-Romaguera et al, 2009). Similarly, we found that propranolol reduced, but not permanently eliminated, responses to the CS+ in the dmPFC. Further, neural responses in this propranolol-sensitive dmPFC region were related to the reduction of the simultaneous expression of fear responses, congruent with previous reports (Klavir et al, 2012; Klumpers et al, 2012; Klumpers et al). The drop in blood pressure on Day 2 induced by propranolol was associated with reduced dmPFC responses, but not SCR, which implies that beta-blockade effects on behavioral indices of fear are likely centrally mediated and not the result of non-specific peripheral effects (Fig. S4, Supplemental Discussion). Considering the occurrence of phasic noradrenaline responses to significant cues (Aston-Jones and Cohen, 2005) and the role of the dmPFC in retrieval of fear memories (Burgos-Robles et al, 2009; Gilmartin et al, 2005; Schiller et al, 2009) we suggest that our findings align with an interpretation where cue-evoked phasic rises in noradrenaline regulate retrieval of fear memories via the dmPFC. Second, we observed greater conditioned responses for the propranolol group in a midbrain region, but as we had no a prior hypothesis for a direct relation between responses in this region and behavioral measures we will limit discussion of this region to the Supplemental Information. Third, beta-blockade induced greater differential hippocampal responses during the recall task on the next day. Previous studies have suggested that the hippocampus is critical for context conditioning and extinction (Bouton and King, 1983; Kalisch et al, 2006; Milad et al, 2007), thus we propose reduced noradrenergic signaling may prevent fear generalization and result in the formation of new contextual safety memories. In support of this suggestion we found the emergence of a differential hippocampal conditioned response in the propranolol group associated with both reduced measures of subsequent sympathetic recovery of fear and subsequent explicit memory of the fearful events. Hence, our findings suggest that the hippocampus provides a contextual safety signal resulting in reduced fear. Fourth, we found that a well-established neural signature of prediction errors in the ventral striatum (O’Doherty et al, 2003; Schiller et al, 2008), that has been found to be affected by dopamine manipulation (Pessiglione et al, 2006), persisted during beta-blockade. We found greater neural prediction error responses to be associated with greater learning as expressed in SCR, but not to be related to the loss of fear or return of fear even though prediction-error related responses have been implied to initiate reconsolidation (Sevenster et al, 2013b). Collectively, this pattern of results is most consistent with a model where beta-blockade can prevent the return of fear by reducing retrieval of fear memory via the dmPFC and by increasing contextual safety learning via the hippocampus.
Noradrenaline and multiple memory systems
Recent human studies report differential effects of beta-blockers on explicit versus implicit measures of fear expression (Bos et al, 2012; Sevenster et al, 2013a), supporting the idea that memory of multiple systems (Henke, 2010) may be affected differently by beta-blockade (Muravieva et al, 2010). Our results support these ideas, as we found that beta-blockade caused a loss of sympathetic fear responses, merely attenuate explicit memory, but left the subjective experience of fear unaffected. Moreover, while we detected a loss of fear memory representations in the dmPFC, several other brain areas retained these representations (Fig. S2, Table S3). A critical question for future research pertains to the contribution of these regions to fear memory, and the possibility for expression of fear to recover (Phelps et al, 2001; Raio et al, 2012), or the persistence of a cognitive representation of fear that may be less sensitive to alteration (Kroes et al, 2014; Kroes and Fernández, 2012; Schiller and Phelps, 2011).
Future directions and conclusions
Beta-blockade might prevent output structures from driving fear responses (Cecchi et al, 2002; Schulz et al, 2002), enhance extinction (Eisenberg et al, 2003), or disrupt reconsolidation (Agren et al, 2012; Debiec et al, 2004; Nader et al, 2000; Schiller et al, 2013), but our results are not consistent with such alternative explanations (see Supplemental Discussion). Yet, a true exclusion of a contribution of these mechanisms to our results requires directed investigations beyond the scope of this study. In addition, if the loss of fear and absence of the return of fear in our study is in fact due to new contextual safety learning, then fear should renew in the original conditioning context (Bouton et al, 1983). Further, we found beta-blockade to affect sympathetic fear responses and explicit memory for fearful events but how beta-blockade during extinction influences interactions between different types of memory remains an open question. Finally, recent computations latent cause models have tried to capture the difference between updating an old memory and the formation of a new memory (Gershman et al, 2012). The idea is that if prediction errors change slowly, new learning experiences are assigned as being generated from the same underlying latent cause and effectively update the predictions of an old memory. If prediction errors increase rapidly or if the context changes, new learning experiences are inferred to be generated from a different underlying latent cause and effectively form a new memory. In addition, recent experimental studies imply that high phasic noradrenergic responses increase the likelihood that a memory is updated and low phasic responses that a novel memory is formed (Eldar et al, 2013; Nassar et al, 2012). Based on this we speculate that beta-blockade prior to extinction training in a different context could have ensured that participants formed a new latent cause and learned that a situation was different and safe, and when confronted with the same context the next day they may have retrieved this novel contextual safety memory preventing fear. It would be worthwhile for future research to test the effect of beta-blockade on prediction errors in contextual safety learning and compare computational models that formalize this function (Gershman et al, 2012; Redish et al, 2007). Regardless of these limitations and questions for future investigations, the novelty of our findings is twofold. First, we demonstrate a novel method to reduce fear and prevent fear recovery by administering beta-blockers prior to extinction learning in humans. Second, by investigating neural mechanisms, we reveal a role for noradrenaline in fear retrieval and new contextual safety learning dependent on the dmPFC and hippocampus to be the most parsimonious explanation for our findings. Our results provide support to studies investigating the combined use of beta-blockers and exposure therapy aiming to improve treatment of anxiety disorders.
Supplementary Material
ACKNOWLEDGEMENTS
We would like to thank S Kooijman for additional participant recruitment, screening and clinical coordination, A Takashima and N ter Huurne for medical assistance, N Müller for contributions to reinforcement learning analyses, and SJ Fallon for providing stimulus material in the form of his living room. We acknowledge helpful discussion of this work and comments on previous versions of this manuscript from Christina Alberini, Nathaniel Daw, Joseph Dunsmoor, Erno Hermans, Floris Klumpers, Elizabeth Phelps, and Bryan Strange.
FUNDING
Guillén Fernández is supported by European Research Council advanced investigator grant (ERC R0001075) and the funding agency had no role in the design of the study, collection and analysis of data and publication decision.
Footnotes
DISCLOSURES
The authors declare no conflict of interest.
Supplementary information is available at the Neuropsychopharmacology website
REFERENCES
- Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JDE. Reward-Motivated Learning: Mesolimbic Activation Precedes Memory Formation. Neuron. 2006;50(3):507–517. doi: 10.1016/j.neuron.2006.03.036. [DOI] [PubMed] [Google Scholar]
- Agren T, Engman J, Frick A, Björkstrand J, Larsson E-M, Furmark T, et al. Disruption of Reconsolidation Erases a Fear Memory Trace in the Human Amygdala. Science. 2012;337(6101):1550–1552. doi: 10.1126/science.1223006. [DOI] [PubMed] [Google Scholar]
- Aston-Jones G, Cohen JD. An Integrative Theory of Locus Coeruleus-Norepinephrine Function: Adaptive Gain and Optimal Performance. Annu Rev Neurosci. 2005;28(1):403–450. doi: 10.1146/annurev.neuro.28.061604.135709. [DOI] [PubMed] [Google Scholar]
- Bach DR, Weiskopf N, Dolan RJ. A Stable Sparse Fear Memory Trace in Human Amygdala. J Neurosci. 2011;31(25):9383–9389. doi: 10.1523/JNEUROSCI.1524-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bechara A. Double dissociation of conditioning and declarative knowledge relative to the amygdala and hippocampus in humans. Science. 1995;269:1115. doi: 10.1126/science.7652558. [DOI] [PubMed] [Google Scholar]
- Bos MGN, Beckers T, Kindt M. The effects of noradrenergic blockade on extinction in humans. Biol Psychol. 2012;89(3):598–605. doi: 10.1016/j.biopsycho.2012.01.007. [DOI] [PubMed] [Google Scholar]
- Bouton ME, King DA. Contextual control of the extinction of conditioned fear: Tests for the associative value of the context. J Exp Psychol Anim Behav Process. 1983;9(3):248–265. [PubMed] [Google Scholar]
- Burgos-Robles A, Vidal-Gonzalez I, Quirk GJ. Sustained Conditioned Responses in Prelimbic Prefrontal Neurons Are Correlated with Fear Expression and Extinction Failure. J Neurosci. 2009;29(26):8474–8482. doi: 10.1523/JNEUROSCI.0378-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cain CK, Blouin AM, Barad M. Adrenergic Transmission Facilitates Extinction of Conditional Fear in Mice. Learn Mem. 2004;11(2):179–187. doi: 10.1101/lm.71504. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carter RM, MacInnes JJ, Huettel SA, Adcock RA. Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses. Front Behav Neurosci. 2009;3 doi: 10.3389/neuro.08.021.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cecchi M, Khoshbouei H, Morilak DA. Modulatory effects of norepinephrine, acting on alpha1 receptors in the central nucleus of the amygdala, on behavioral and neuroendocrine responses to acute immobilization stress. Neuropharmacology. 2002;43(7):1139–1147. doi: 10.1016/s0028-3908(02)00292-7. [DOI] [PubMed] [Google Scholar]
- Clugnet M, LeDoux J. Synaptic plasticity in fear conditioning circuits: induction of LTP in the lateral nucleus of the amygdala by stimulation of the medial geniculate body. J Neurosci. 1990;10(8):2818–2824. doi: 10.1523/JNEUROSCI.10-08-02818.1990. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davis M, Redmond DE, Baraban JM. Noradrenergic agonists and antagonists: Effects on conditioned fear as measured by the potentiated startle paradigm. Psychopharmacology (Berl) 1979;65(2):111–118. doi: 10.1007/BF00433036. [DOI] [PubMed] [Google Scholar]
- Dayan L, Finberg JPM. L-DOPA increases noradrenaline turnover in central and peripheral nervous systems. Neuropharmacology. 2003;45(4):524–533. doi: 10.1016/s0028-3908(03)00190-4. [DOI] [PubMed] [Google Scholar]
- Debiec J, Ledoux JE. Disruption of reconsolidation but not consolidation of auditory fear conditioning by noradrenergic blockade in the amygdala. Neuroscience. 2004;129(2):267–272. doi: 10.1016/j.neuroscience.2004.08.018. [DOI] [PubMed] [Google Scholar]
- Eisenberg M, Kobilo T, Berman DE, Dudai Y. Stability of Retrieved Memory: Inverse Correlation with Trace Dominance. Science. 2003;301(5636):1102–1104. doi: 10.1126/science.1086881. [DOI] [PubMed] [Google Scholar]
- Eldar E, Cohen JD, Niv Y. The effects of neural gain on attention and learning. Nat Neurosci. 2013;16(8):1146–1153. doi: 10.1038/nn.3428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fang J, Yu PH. Effect of haloperidol and its metabolites on dopamine and noradrenaline uptake in rat brain slices. Psychopharmacology (Berl) 1995;121(3):379–384. doi: 10.1007/BF02246078. [DOI] [PubMed] [Google Scholar]
- Gershman SJ, Niv Y. Exploring a latent cause theory of classical conditioning. Learn Behav. 2012;40(3):255–268. doi: 10.3758/s13420-012-0080-8. [DOI] [PubMed] [Google Scholar]
- Gilmartin MR, McEchron MD. Single neurons in the medial prefrontal cortex of the rat exhibit tonic and phasic coding during trace fear conditioning. Behav Neurosci. 2005;119(6):1496–1510. doi: 10.1037/0735-7044.119.6.1496. [DOI] [PubMed] [Google Scholar]
- Heidbreder CA, Groenewegen HJ. The medial prefrontal cortex in the rat: evidence for a dorso-ventral distinction based upon functional and anatomical characteristics. Neurosci Biobehav Rev. 2003;27(6):555–579. doi: 10.1016/j.neubiorev.2003.09.003. [DOI] [PubMed] [Google Scholar]
- Henke K. A model for memory systems based on processing modes rather than consciousness. Nat Rev Neursci. 2010;11(7):523–532. doi: 10.1038/nrn2850. [DOI] [PubMed] [Google Scholar]
- Hermans EJ, van Marle HJF, Ossewaarde L, Henckens MJAG, Qin S, van Kesteren MTR, et al. Stress-Related Noradrenergic Activity Prompts Large-Scale Neural Network Reconfiguration. Science. 2011;334(6059):1151–1153. doi: 10.1126/science.1209603. [DOI] [PubMed] [Google Scholar]
- Kalisch R, Korenfeld E, Stephan KE, Weiskopf N, Seymour B, Dolan RJ. Context-Dependent Human Extinction Memory Is Mediated by a Ventromedial Prefrontal and Hippocampal Network. J Neurosci. 2006;26(37):9503–9511. doi: 10.1523/JNEUROSCI.2021-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kindt M, Soeter M, Vervliet B. Beyond extinction: erasing human fear responses and preventing the return of fear. Nat Neurosci. 2009;12(3):256–258. doi: 10.1038/nn.2271. [DOI] [PubMed] [Google Scholar]
- Klavir O, Genud-Gabai R, Paz R. Low-Frequency Stimulation Depresses the Primate Anterior-Cingulate-Cortex and Prevents Spontaneous Recovery of Aversive Memories. J Neurosci. 2012;32(25):8589–8597. doi: 10.1523/JNEUROSCI.6481-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Klumpers F, Heitland I, Oosting RS, Kenemans JL, Baas JMP. Genetic variation in serotonin transporter function affects human fear expression indexed by fear-potentiated startle. Biol Psychol. 2012;89(2):277–282. doi: 10.1016/j.biopsycho.2011.10.018. [DOI] [PubMed] [Google Scholar]
- Klumpers F, Kroes M, Heitland I, Everaerd D, Akkermans SEA, Oosting RS, et al. Dorsomedial prefrontal cortex mediates the impact of 5-HTTLPR genotype on anticipatory threat reactions. Biol Psychiatry. doi: 10.1016/j.biopsych.2014.07.034. [DOI] [PubMed] [Google Scholar]
- Klumpers F, Kroes MC, Heitland I, Everaerd D, Akkermans SEA, Oosting RS, et al. Dorsomedial Prefrontal Cortex Mediates the Impact of Serotonin Transporter Linked Polymorphic Region Genotype on Anticipatory Threat Reactions. Biol Psychiatry. doi: 10.1016/j.biopsych.2014.07.034. online prepublication. [DOI] [PubMed] [Google Scholar]
- Knight DC, Waters NS, Bandettini PA. Neural substrates of explicit and implicit fear memory. Neuroimage. 2009;45(1):208–214. doi: 10.1016/j.neuroimage.2008.11.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kroes MC, Tendolkar I, van Wingen GA, van Waarde JA, Strange BA, Fernandez G. An electroconvulsive therapy procedure impairs reconsolidation of episodic memories in humans. Nat Neurosci. 2014;17(2):204–206. doi: 10.1038/nn.3609. [DOI] [PubMed] [Google Scholar]
- Kroes MCW, Fernández G. Dynamic neural systems enable adaptive, flexible memories. Neurosci Biobehav Rev. 2012;36(7):1646–1666. doi: 10.1016/j.neubiorev.2012.02.014. [DOI] [PubMed] [Google Scholar]
- Kroes MCW, Strange BA, Dolan RJ. β-Adrenergic Blockade during Memory Retrieval in Humans Evokes a Sustained Reduction of Declarative Emotional Memory Enhancement. J Neurosci. 2010;30(11):3959–3963. doi: 10.1523/JNEUROSCI.5469-09.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marschner A, Kalisch R, Vervliet B, Vansteenwegen D, Buchel C. Dissociable Roles for the Hippocampus and the Amygdala in Human Cued versus Context Fear Conditioning. J Neurosci. 2008;28(36):9030–9036. doi: 10.1523/JNEUROSCI.1651-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McGaugh J. The amygdala modulates the consolidation of memories of emotionally arousing experiences. Annu Rev Neurosci. 2004;27:1–28. doi: 10.1146/annurev.neuro.27.070203.144157. [DOI] [PubMed] [Google Scholar]
- Milad MR, Wright CI, Orr SP, Pitman RK, Quirk GJ, Rauch SL. Recall of fear extinction in humans activates the ventromedial prefrontal cortex and hippocampus in concert. Biol Psychiatry. 2007;62(5):446–454. doi: 10.1016/j.biopsych.2006.10.011. [DOI] [PubMed] [Google Scholar]
- Misanin JR, Miller RR, Lewis DJ. Retrograde Amnesia Produced by Electroconvulsive Shock after Reactivation of a Consolidated Memory Trace. Science. 1968;160(3827):554–555. doi: 10.1126/science.160.3827.554. [DOI] [PubMed] [Google Scholar]
- Mueller D, Porter JT, Quirk GJ. Noradrenergic Signaling in Infralimbic Cortex Increases Cell Excitability and Strengthens Memory for Fear Extinction. J Neurosci. 2008;28(2):369–375. doi: 10.1523/JNEUROSCI.3248-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Muravieva EV, Alberini CM. Limited efficacy of propranolol on the reconsolidation of fear memories. Learn Mem. 2010;17(6):306–313. doi: 10.1101/lm.1794710. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Myers KM, Davis M. Mechanisms of fear extinction. Mol Psychiatry. 2006;12(2):120–150. doi: 10.1038/sj.mp.4001939. [DOI] [PubMed] [Google Scholar]
- Nader K, Hardt O. A single standard for memory: the case for reconsolidation. Nat Rev Neurosci. 2009;10(3):224–234. doi: 10.1038/nrn2590. [DOI] [PubMed] [Google Scholar]
- Nader K, Schafe GE, LeDoux JE. Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature. 2000;406(6797):722–726. doi: 10.1038/35021052. [DOI] [PubMed] [Google Scholar]
- Nassar MR, Rumsey KM, Wilson RC, Parikh K, Heasly B, Gold JI. Rational regulation of learning dynamics by pupil-linked arousal systems. Nat Neurosci. 2012;15(7):1040–1046. doi: 10.1038/nn.3130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- O’Doherty JP, Dayan P, Friston KJ, Critchley HD, Dolan RJ. Temporal Difference Models and Reward-Related Learning in the Human Brain. Neuron. 2003;38(2):329–337. doi: 10.1016/s0896-6273(03)00169-7. [DOI] [PubMed] [Google Scholar]
- Ongur D, Ferry AT, Price JL. Architectonic subdivision of the human orbital and medial prefrontal cortex. J Comp Neurol. 2003;460:425–449. doi: 10.1002/cne.10609. [DOI] [PubMed] [Google Scholar]
- Otis JM, Dashew KB, Mueller D. Neuroscience Meeting Planner. Society for Neuroscience; Washington, DC: 2011a. Prelimbic cortex and dorsal hippocampus β-adrenergic receptors mediate retrieval of a cocaine-associated memory; p. 471.409/FF425. [Google Scholar]
- Otis JM, Dashew KB, Mueller D. Neurobiological Dissociation of Retrieval and Reconsolidation of Cocaine-Associated Memory. J Neurosci. 2013;33(3):1271–1281. doi: 10.1523/JNEUROSCI.3463-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Otis JM, Fitzgerald MK, Mueller D. Inhibition of Hippocampal [beta]-Adrenergic Receptors Impairs Retrieval But Not Reconsolidation of Cocaine-Associated Memory and Prevents Subsequent Reinstatement. Neuropsychopharmacology. 2014;39(2):303–310. doi: 10.1038/npp.2013.187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Otis JM, Mueller D. Inhibition of β-Adrenergic Receptors Induces a Persistent Deficit in Retrieval of a Cocaine-Associated Memory Providing Protection against Reinstatement. Neuropsychopharmacology. 2011b;36(9):1912–1920. doi: 10.1038/npp.2011.77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ouyang M, Thomas SA. A requirement for memory retrieval during and after long-term extinction learning. Proc Natl Acad Sci U S A. 2005;102(26):9347–9352. doi: 10.1073/pnas.0502315102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006;442(7106):1042–1045. doi: 10.1038/nature05051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Phelps EA, Delgado MR, Nearing KI, LeDoux JE. Extinction learning in humans: role of the amygdala and vmPFC. Neuron. 2004;43(6):897–905. doi: 10.1016/j.neuron.2004.08.042. [DOI] [PubMed] [Google Scholar]
- Phelps EA, O’Connor KJ, Gatenby JC, Gore JC, Grillon C, Davis M. Activation of the left amygdala to a cognitive representation of fear. Nat Neurosci. 2001;4(4):437–441. doi: 10.1038/86110. [DOI] [PubMed] [Google Scholar]
- Przybyslawski J, Sara SJ. Reconsolidation of memory after its reactivation. Behav Brain Res. 1997;84:241–246. doi: 10.1016/s0166-4328(96)00153-2. [DOI] [PubMed] [Google Scholar]
- Quirk GJ, Mueller D. Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology. 2008;33(1):56–72. doi: 10.1038/sj.npp.1301555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raio CM, Carmel D, Carrasco M, Phelps EA. Nonconscious fear is quickly acquired but swiftly forgotten. Current biology : CB. 2012;22(12):R477–R479. doi: 10.1016/j.cub.2012.04.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Redish AD, Jensen S, Johnson A, Kurth-Nelson Z. Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling. Psychol Rev. 2007;114(3):784–805. doi: 10.1037/0033-295X.114.3.784. [DOI] [PubMed] [Google Scholar]
- Rescorla R, Wagner A. Classical Conditioning. Nature Publishing Group; 1972a. pp. 64–99. [Google Scholar]
- Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, editors. Classical Conditioning II. Appleton-Century-Crofts; New York: 1972b. pp. 64–99. [Google Scholar]
- Rodriguez-Romaguera J, Sotres-Bayon F, Mueller D, Quirk GJ. Systemic Propranolol Acts Centrally to Reduce Conditioned Fear in Rats Without Impairing Extinction. Biol Psychiatry. 2009;65(10):887–892. doi: 10.1016/j.biopsych.2009.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sara SJ. Retrieval and Reconsolidation: Toward a Neurobiology of Remembering. Learn Mem. 2000;7(2):73–84. doi: 10.1101/lm.7.2.73. [DOI] [PubMed] [Google Scholar]
- Schiller D, Johansen J. Prelimbic Prefrontal Neurons Drive Fear Expression: A Clue for Extinction–Reconsolidation Interactions. J Neurosci. 2009;29(43):13432–13434. doi: 10.1523/JNEUROSCI.4299-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schiller D, Kanen JW, LeDoux JE, Monfils M-H, Phelps EA. Extinction during reconsolidation of threat memory diminishes prefrontal cortex involvement. Proc Natl Acad Sci U S A. 2013;110(50):20040–20045. doi: 10.1073/pnas.1320322110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schiller D, Levy I, Niv Y, LeDoux JE, Phelps EA. From Fear to Safety and Back: Reversal of Fear in the Human Brain. J Neurosci. 2008;28(45):11517–11525. doi: 10.1523/JNEUROSCI.2265-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schiller D, Phelps EA. Does reconsolidation occur in humans? Front Behav Neurosci. 2011;5 doi: 10.3389/fnbeh.2011.00024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schulz B, Fendt M, Schnitzler H-U. Clonidine injections into the lateral nucleus of the amygdala block acquisition and expression of fear-potentiated startle. Eur J Neurosci. 2002;15(1):151–157. doi: 10.1046/j.0953-816x.2001.01831.x. [DOI] [PubMed] [Google Scholar]
- Schwabe L, Nader K, Pruessner JC. beta-Adrenergic blockade during reactivation reduces the subjective feeling of remembering associated with emotional episodic memories. Biol Psychol. 2013;92(2):227–232. doi: 10.1016/j.biopsycho.2012.10.003. [DOI] [PubMed] [Google Scholar]
- Schwabe L, Nader K, Wolf OT, Beaudry T, Pruessner JC. Neural Signature of Reconsolidation Impairments by Propranolol in Humans. Biol Psychiatry. 2012;71(4):380–386. doi: 10.1016/j.biopsych.2011.10.028. [DOI] [PubMed] [Google Scholar]
- Sevenster D, Beckers T, Kindt M. Prediction Error Governs Pharmacologically Induced Amnesia for Learned Fear. Science. 2013a;339(6121):830–833. doi: 10.1126/science.1231357. [DOI] [PubMed] [Google Scholar]
- Sevenster D, Beckers T, Kindt M. Prediction error governs pharmacologically induced amnesia for learned fear. Science. 2013b;339(6121):830–833. doi: 10.1126/science.1231357. [DOI] [PubMed] [Google Scholar]
- Smith CC, Greene RW. CNS Dopamine Transmission Mediated by Noradrenergic Innervation. J Neurosci. 2012;32(18):6072–6080. doi: 10.1523/JNEUROSCI.6486-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vervliet B, Craske MG, Hermans D. Fear Extinction and Relapse: State of the Art. Annual Review of Clinical Psychology. 2013;9(1):215–248. doi: 10.1146/annurev-clinpsy-050212-185542. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.