Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 Feb 1.
Published in final edited form as: Behav Brain Res. 2020 Oct 11;398:112931. doi: 10.1016/j.bbr.2020.112931

Thought suppression inhibits the generalization of fear extinction

Augustin C Hennings 1,2, Sophia A Bibb 3, Jarrod A Lewis-Peacock 1,2,3,4,5, Joseph E Dunsmoor 1,2,5,*
PMCID: PMC7722076  NIHMSID: NIHMS1636974  PMID: 33053386

Abstract

A challenge for translating fear extinction research into clinical treatments for stress and anxiety disorders is that extinction learning tends not to generalize beyond the treatment context. This may be because the hippocampus limits the expression of extinction memories. Consequently, downregulating the hippocampus may help to promote the generalization of extinction learning. One nonpharmacological strategy to downregulate hippocampal activity in humans is motivated forgetting in which a participant deliberately attempts to suppress the encoding and/or retrieval of episodic memories. Here, we evaluated whether this strategy could facilitate extinction generalization by augmenting extinction training with thought suppression. Participants were threat conditioned using two conditioned stimulus (CS) categories paired with an electrical shock. Subsequently, during extinction training, one CS category was accompanied by thought suppression. Participants were tested for extinction generalization 24 hours later with conceptual variations of the extinguished stimuli. Contrary to our prediction, we found that extinction training paired with thought suppression resulted in enhanced shock expectancy (i.e., worse generalization) relative to standard extinction. We conclude that thought suppression during memory encoding likely acts as an inhibitory cue that blocks the acquisition of extinction memories, and therefore may not be a viable tactic to promote extinction generalization in the treatment of anxiety disorders.

Keywords: Pavlovian extinction, directed forgetting, thought suppression, protection from Extinction

1. Introduction

Learned fear can be stubbornly resistant to change, even after experiences of safety that disconfirm threat expectations. Techniques to maximize safety learning are clinically relevant for optimizing treatment for stress and anxiety disorders (Craske et al., 2018). Consequently, there is growing research interest in behavioral and pharmacological strategies that produce persistent safety memories to effectively counteract retrieval and expression of fear memories. This area of research focuses predominately on Pavlovian fear extinction, in which omission of an expected threat diminishes conditioned defensive responses. It is well established that extinction learning produces a new memory but leaves the original conditioned fear memory more or less intact (Bouton and Moody, 2004). This secondary extinction memory is transient and often fails to generalize over time, across contexts, and to variations of the feared stimulus not present at the time of extinction training (Maren et al., 2013). A number of clever behavioral and pharmacological strategies have been developed to help compensate for the limited nature of extinction training and to promote the generalization of extinction memories (Craske et al., 2018; Dunsmoor et al., 2015a; Fitzgerald et al., 2014; Singewald et al., 2015). These strategies are informed by an increased understanding of the neurobehavioral mechanisms of fear and extinction. Here, we investigated a novel approach to modulate long-term extinction memories in humans through top-down suppression of memory encoding processes at the time of extinction training. Our goal was to determine whether a strategy of thought suppression, which putatively downregulates the hippocampus via top-down inhibition from the prefrontal cortex (Anderson and Hanslmayr, 2014), modulates extinction memory formation and enhances extinction memory generalization across time and to conceptual variations of learned threat.

The specificity of extinction memory serves an adaptive function. That is, from an evolutionary standpoint it is better to mistakenly regard harmless stimuli as dangerous than mistakenly treat harmful stimuli as safe, a phenomenon known as anxiety conservation. This “better safe than sorry” approach to threat is supported by mechanisms in the brain that tie extinction memories to the spatiotemporal details present at the time of extinction learning, a process largely governed by the hippocampus (Izquierdo et al., 2016; Maren et al., 2013). Emerging evidence from rodent neurophysiology shows that projections from the ventral hippocampus to the medial prefrontal cortex promotes fear expression to an extinguished conditioned stimulus (CS) that is encountered outside the extinction context (Marek et al., 2018). Consequently, one possible approach to render extinction more generalizable after learning is to temporarily downregulate hippocampal function to release the specificity of extinction training. Neurobehavioral research in rodents indicates that inactivation of the hippocampus prevents the renewal of extinguished fear when animals are tested outside the extinction context (Hobin et al., 2006). Administration of the muscarinic cholinergic antagonist scopolamine, which impairs contextual processing in the hippocampus, also promotes extinction generalization across contexts in rodents (Zelikowsky et al., 2013). However, a recent study translating this pharmacological approach to humans produced mixed results and did not find strong effects of scopolamine on preventing contextual renewal (Craske et al., 2019).

Another approach to downregulating hippocampal activity is through deliberate attempts to prevent the formation or retrieval of specific memories. One non-pharmacological strategy involves direct suppression of explicit memory encoding processes (Bjork et al., 1998). Human neuroimaging research shows that instructions to suppress one’s thoughts while presented with target memoranda diminishes hippocampal activity through a mechanism of top-down inhibition mediated by the lateral prefrontal cortex (Anderson and Hanslmayr, 2014). Whether a behavioral strategy that putatively downregulates hippocampal function could serve to release the specificity of extinction training (akin to a temporary lesion or pharmacological inactivation in rodents) is unknown. We modified a multi-day Pavlovian threat conditioning and extinction design by adding an instruction for participants to suppress their thoughts at the moment of extinction memory formation. We tested the effects of thought suppression on extinction retrieval 24 hours later to variations of the extinguished stimuli as a test of extinction generalization.

There are competing hypotheses for the effect of instructed memory suppression on extinction learning. One hypothesis is in line with rodent studies showing that diminished hippocampal processing releases extinction from specificity, thereby promoting extinction memory generalization (Hobin et al., 2006; Zelikowsky et al., 2013). If so, we would predict a diminished return of threat when extinction is accompanied by thought suppression as compared to standard extinction. Such a result would be clinically relevant and might suggest a possible enhancement to extinction-based therapy for fear and anxiety.

An alternative hypothesis is that pairing thought suppression with extinction training might serve the same function as an adding an additional inhibitory stimulus that interferes with extinction to the target CS. Such effects are sometimes referred to as protection from extinction (Lovibond et al., 2000, 2009; Rescorla, 2003) and would be anticipated based on prominent error-correcting associative learning models (Rescorla and Wagner, 1972). That is, learning models of extinction propose that extinction is determined by the surprising omission of the expected unconditioned stimulus (US). This drives the prediction error that diminishes the CS-US association, resulting in a decrease in the conditioned response. If, however, the CS is accompanied by an added stimulus, then the absence of the US is less surprising or could be attributed to the presence of the added stimulus (i.e., conditioned inhibition). If so, then we would predict an enhanced return of fear for a CS extinguished during thought suppression as compared to a typical extinction procedure. Such evidence would likewise be informative for extinction-based therapies, as it would support treatments focused on engaging with feared stimuli or situations in order to maximize the discrepancy between predicted and actual outcomes (Craske et al., 2014).

2. Materials and Methods

The goal of the present study was to investigate for the first time whether deliberate thought suppression during extinction training promotes generalization of safety learning. We developed a novel within-subjects Pavlovian threat conditioning task with two CS categories (CS+’s) associated with a mildly aversive shock to the wrist (US), and an unpaired control stimulus (CS−) (Figure 1A). Following threat acquisition, one CS+ category was presented alone (standard extinction) whereas the other CS+ category was accompanied by an instruction for the subject to momentarily suppress their thoughts (CS+S). Participants returned 24 hours later and were presented with novel variations of all three CS categories in a test of extinction generalization. Threat acquisition, extinction, and renewal were measured using trial-by-trial ratings of shock expectancy with a continuous rating bar, as well as skin conductance responses (SCR). We used a category threat conditioning design (see Dunsmoor and Kroes, 2019), in which the two CS+’s and CS− were comprised of trial unique (i.e., non-repeating) exemplars from three distinct superordinate semantic categories: animals, tools, and food. This category-conditioning design allowed us to investigate whether extinction to specific exemplars generalizes to novel conceptual variations from the extinguished categories.

Figure 1.

Figure 1.

Experimental Procedure. A. Multi-day associative threat learning and extinction paradigm. During threat acquisition, two CS+ categories (animals and tools) co-terminated with a mild electric shock. Food stimuli served as the CS− and were never paired with shock. Extinction learning followed acquisition. During extinction, one CS+ category (animals or tools, counterbalanced across participants) was presented with the suppress cue on every trial (CS+S). The suppress cue was indicated by the color of the image border and fixation cross changing from grey to blue. 24 hours later, shock electrodes were re-attached and participants underwent a renewal test using novel images from each CS category. B. Thought suppression instruction. The instructions were designed to encourage direct thought suppression, and to discourage thought substitution. These instructions were only given to participants in Experiment 1; participants in Experiment 2 received the cue on CS+S trials during extinction, but they did not receive any instructions regarding the cue.

2.1. Participants

A total of 21 participants were recruited for Experiment 1 (12 Female), and 21 were recruited for Experiment 2 (14 Female). Participants were recruited under the requirements that they be between the ages of 18–45 be able to speak and read English fluently, and self-report no lifetime history of any neurological or psychiatric disorder, as well as not currently taking any psychoactive medication. As detailed below, Experiment 1 and Experiment 2 were nearly identical, with the only exception being that participants in Experiment 1 received a set of instructions regarding a cue to suppress their thoughts during extinction training (Figure 1B), while participants in Experiment 2 received the same cue but without any prior instructions. All participants provided written informed consent prior to beginning the experiment and were compensated at the rate of $20/hour. All procedures were in compliance with the Institutional Review Board of the University of Texas at Austin (IRB # 2017-02-0094).

2.2. Experimental Procedure

The experiment was conducted across two sessions separated by a 24-hour break. Experimental stimuli consisted of trial unique exemplars from three semantic categories, animals, tools, and food. In this category conditioning procedure, no single basic-level exemplar is repeated, such that participants form an association to an entire semantic category (Figure 1A) (see Dunsmoor and Kroes, 2019). For example, there were not pictures of different dogs during threat acquisition, extinction, or the renewal test. The animal and tool categories served as the CS+’s, and the food category always served as the CS−. Common phobic stimuli were excluded from the animals and tools, and food images were filtered to exclude distinctly appetizing images. Stimuli were displayed for 4.5 seconds, and the intertrial interval was randomized to 7.5 or 9.5 seconds. Trial order was pseudorandomized such that no more than 2 of the same CS type were presented consecutively. All participants received the same CS trial order, but the specific basic-level exemplar on each CS trial was randomized for each participant. The first trial of the renewal test on Day 2 was always a CS− to account for initial orienting responses (see also Dunsmoor et al., 2019; Schiller et al., 2010). The experiment was built and displayed using PsychoPy in Python (Peirce et al., 2019). The unconditioned stimulus (US) was a 50-millisecond electric shock delivered to the right wrist using a BIOPAC (Goleta, CA) STM200 module. The shock was calibrated at the beginning of the first session to be “highly annoying and unpleasant, but not painful” in accordance with the IRB and prior research in our laboratory (e.g., Keller and Dunsmoor, 2020).

2.2.1. Threat expectancy and psychophysiology

Throughout the experiment a continuous expectancy bar was used to measure explicit threat expectancy. At the beginning of Day 1, participants were given instructions on how to use the continuous expectancy bar and completed three practice trials with dummy stimuli (colored squares). Participants were told that they would complete a learning experiment, and that their expectancy ratings would not influence the shock contingencies. The right thumb stick of a Logitech F310 gamepad (www.logitech.com) was used to control the expectancy bar in order to answer the question “Do you think that the picture you see will shock you?”. The bar displayed a range from 100% No to 100% Yes and was reset to the middle (0%) at the beginning of each trial. During an intertrial interval the previous response was cleared, and the bar could not be moved. For analysis, the range of expectancy ratings were scaled to −1 (100% No) to 1 (100% Yes).

In addition to explicit threat expectancy, SCR were measured to gauge autonomic arousal. SCR electrodes were placed on the hypothenar eminence of the left palm. Over the course of data collection, two mirror image testing rooms were used, and SCR was measured with either a BIOPAC MP150 or MP160 module (Goleta, CA). Participants always completed both sessions of the experiment in the same room. SCR were scored using previously validated criteria (Dunsmoor et al., 2019). Specifically, SCR were considered related to a CS if the trough-to-peak deflection occurred within a set time window that extended from 0.5 seconds following CS onset to CS offset (4.5 + 0.5 seconds), lasted between 0.5 and 5.0 seconds, and was greater than 0.02 μS. If SCR did not fit these criteria it was scored as zero. SCR were scored using the Autonomate script for MATLAB (The MathWorks) (Green et al., 2014). SCR values were square root normalized prior to analysis.

2.2.2. Associative threat learning task

Forty-eight stimuli per category were used on Day 1, and an additional 12 stimuli per category were used on Day 2. In order to reduce the influence of event boundaries on dependent measures of fear learning (Dunsmoor et al., 2018), threat acquisition and extinction were split into two runs of equal lengths for a total of 4 runs on Day 1. There was a brief pause between each run that lasted less than one minute. For analysis, these runs are considered early and late acquisition and extinction, respectively. Each run consisted of 36 trials, 12 of each CS type. Threat acquisition occurred over the first two runs, during which 66% of CS+ images, both animals and tools, co-terminated with the US (32 total shocks). Partial CS+US reinforcement (66%) was used to delay extinction (Grady et al., 2016; Humphreys, 1939). Extinction learning immediately followed acquisition, during which US pairings were omitted for both CS+ categories. During extinction learning one CS+ category was presented with the suppress cue 100% of the time. The suppressed CS+ category was counterbalanced across participants and is referred to as the “CS+S”. See section 2.3 Thought suppression for more information on this manipulation. The next day, participants had both sets of electrodes re-attached (shock and SCR) and were told that they would continue the task as before. During this test there were no US presentations or thought suppression cues, and participants were presented with novel, threat-ambiguous stimuli. For these reasons, we consider this a renewal test, as opposed to a test of spontaneous recovery. Consistent with previous literature investigating extinction retrieval, only the early renewal test (4 trials/CS type; 12 trials total) was considered for analysis (Dunsmoor et al., 2019; Milad et al., 2009). These early trials are most likely to reflect retrieval of the threat or extinction memory, whereas the later trials are more likely reflect further extinction learning from the renewal test itself.

2.2.3. Recognition memory test

Following the renewal test on Day 2, the electrodes were removed and all participants completed a surprise recognition memory test for stimuli seen on Day 1 (threat acquisition and extinction learning). This phase of the experiment was self-paced. Along with all Day 1 stimuli, 32 novel foils per category were used in the recognition memory test (total of 80 images per category, 40% novel lures). Participants responded on each trial whether the image was “definitely old”, “maybe old”, “maybe new”, or “definitely new”.

2.2.4. Surveys

Following extinction learning on Day 1, participants completed a brief survey designed to evaluate the success of suppression in Experiment 1. Participants in were asked to rate on a scale of 1–10 how annoying or unpleasant they found the shock to be throughout the experiment. They were also asked to estimate the total number of shocks they received (excluding calibration) and if they could state what the “rule” was for the picture-shock pairings. Only participants in Experiment 1 were asked to rate, from 1–10, how well they were able to suppress the pictures when cued to during the experiment. Average suppression success rating was 5.86 (s.e.m. 0.44). In addition, they were asked to report the strategy, if any, that they used to suppress pictures during the experiment, as well as what they thought the “rule” was for which pictures they were instructed to suppress. After the recognition memory test on Day 2, all participants completed the Intolerance of Uncertainty (IUS) and the State-trait anxiety inventory (STAI) surveys.

2.3. Thought suppression

At the beginning of Day 1, participants in Experiment 1 were given additional instructions in order to facilitate thought suppression of the CS+S category during extinction. The full instructions are shown in Figure 1B. These instructions were crafted in order to maximize top-down functional suppression of the hippocampus as shown in neuroimaging experiments, and avoid thought substitution, which engages a different functional mechanism for thought removal (Anderson and Hanslmayr, 2014; Benoit and Anderson, 2012). In order to cue suppression, the color of both the border around each image, as well as the fixation cross immediately preceding and following the picture, changed from grey to blue. On suppress trials, the fixation cross changed to blue 2 seconds before the CS+S picture, the color border remained blue during the CS+S trial, and then the fixation cross remained blue for 1.5 seconds after stimulus offset before changing back to grey. The average time of the intertrial intervals between stimuli did not change (7.5 or 9.5 seconds). The total length of the suppress cue (8 seconds) was selected in order to maximize thought suppression during extinction learning. Participants in Experiment 1 were given three additional practice trials with dummy stimuli at the start of the experiment to familiarize themselves with the thought suppression manipulation. These participants were instructed at the start of the task that the suppress cue could appear at any point during the experiment. For Experiment 2, participants were not given any information about the suppress cue and did not receive suppression practice trials. However, the cue was still presented with all CS+S trials during extinction learning.

2.4. Statistical Analysis

Threat expectancy, SCR, and recognition memory for different phases of the experiment were first assessed using repeated measures ANOVAs including within subject factors of phase and condition (CS type). A priori comparisons were evaluated with two-tailed paired t-tests. Both threat expectancy and SCR were determined to be non-normally distributed using a Shapiro-Wilk test (Shapiro and Wilk, 1965) implemented in the Python package pingouin (Vallat, 2018). Accordingly, permutation tests were used to obtain all p-values for these measures. The R package permuco (Frossard and Renaud, 2019) was used to permute repeated measures ANOVAs, and permuted difference of means for follow-up comparisons was implemented using custom Python code. The number of permutations was set to 10,000, allowing for a minimum possible p-value of 0.0001. All p-values are reported as two-tailed. For clarity, parametric F and t statistics and corresponding degrees of freedom are reported alongside permutation test p-values. When used, post-hoc follow-up comparisons were Bonferroni corrected by multiplying the post-hoc p-values by the number of tests.

2.5. Missing Data

Due to technical errors, two participants in Experiment 1 are missing SCR from acquisition and extinction, and one subject in Experiment 2 is missing threat expectancy from extinction. Data from these participants are excluded from relevant analyses.

3. Results

3.1. Experiment 1

3.1.1. Acquisition

Threat expectancy results demonstrated successful associative threat learning for the two CS+ categories relative to the CS− (Figure 2A). There was a main effect of condition F(2,40) = 58.07, Pperm = 0.0001, and main effect of phase (late vs. early acquisition) F(2, 40) = 6.00, Pperm = 0.007. There was no significant condition by phase interaction. Planned comparisons during late acquisition show greater expectancy relative to the CS− for both the CS+ (t20 = 6.89, Pperm = 0.0001) and CS+S (t20 = 9.76, Pperm = 0.0001). There was no difference in expectancy between the CS+ and CS+S (t20 = 1.04, Pperm = 0.32).

Figure 2.

Figure 2.

Experiment 1 behavioral results. A. Threat expectancy. Expectancy for receiving an aversive electrical shock to the wrist was measured using a continuous expectancy bar during all phases of the experiment. The bar ranged from −1 (100% Do not expect a shock) to 1 (100% Expect a shock). Results confirm successful acquisition and extinction of both CS+ categories. During renewal, expectancy for receiving the shock was significantly higher on trials from the CS+S than the CS+ and CS−. B. Skin conductance responses. Results confirm successful acquisition and subsequent extinction for both CS+ categories relative to the CS−. However, there was a general increase in arousal for all three CS categories during the renewal test. Points and error bars correspond to mean and 95% bootstrapped confidence intervals, respectively.

The same basic pattern of results was observed for SCR (Figure 2B). There was a main effect of condition (F(2, 36) = 10.91, Pperm = 0.0006), but not a significant main effect of phase or interaction of condition by phase. Planned comparisons during late acquisition show greater mean SCR for both the CS+ (t18 = 3.79, Pperm = 0.0014) and CS+S (t18 = 3.26, Pperm = 0.0008) versus the CS−. There was no difference in SCR between the CS+ and CS+S (t18 = 1.14, Pperm = 0.27), indicating equivalent threat learning to both CS+ categories.

3.1.2. Extinction

Extinction followed acquisition, during which one category (CS+S) was accompanied by a cue for participants to suppress their thoughts. Threat expectancy and SCR values confirmed successful extinction. For threat expectancy, there were significant main effects of phase (F(1, 20) = 29.23, Pperm = 0.0001) and condition (F(2, 40) = 19.94, Pperm = 0.0001), as well as a significant phase by condition interaction (F(2, 40) = 3.62, Pperm = 0.035). Planned comparisons during late extinction showed that expectancy for both CS+ and CS+S was still higher than CS− expectancy (CS+ t20 = 3.76, Pperm = 0.0006; CS+S t20 = 3.71, Pperm = 0.0006). Importantly, post-hoc comparisons of late extinction vs. late acquisition show significantly reduced expectancy for both the CS+ (t20 = −5.75, Bonferroni corrected Pperm = 0.0002) and the CS+S (t20 = −5.40, Bonferroni corrected Pperm = 0.0002). Notably, there was no difference in threat expectancy between the CS+ and CS+S categories (t20 = 0.78, Pperm = 0.45), indicating the thought suppression cue did not influence extinction learning itself.

For SCR, there were significant main effects of both phase (F(1, 18) = 5.92, Pperm = 0.028) and condition (F(2, 36) = 3.42, Pperm = 0.045), but no significant condition by phase interaction. By late extinction, there was no difference relative to the CS− for the CS+ (t18 = −1.67, Pperm = 0.11). However, SCR for the suppressed category (CS+S) was still higher relative to the CS− (t18 = 2.33, Pperm = 0.03). Again, post-hoc comparisons of late extinction vs. late acquisition show reduced SCR for both the CS+ (t18 = −4.32, Bonferroni corrected Pperm = 0.0006) and the CS+S (t18 = −4.01, Bonferroni corrected Pperm = 0.0006). In contrast to threat expectancy results, SCR for the suppressed CS+S was significantly greater than for CS+ (t18 = 2.49, Pperm = 0.025).

3.1.3. Renewal Test

The following day, participants had SCR and shock electrodes reattached and completed a renewal test with novel category exemplars. No new instructions were given on Day 2, and participants were simply told that the experiment would resume. No thought suppression cues or shocks were presented during renewal test. Results of threat expectancy revealed a main effect of condition (F(2, 40) = 28.11, Pperm = 0.0001). Planned comparisons showed that there was significant renewal of threat expectancy relative to the CS− for both the CS+ (t(20) = 5.18, Pperm = 0.0001) and the CS+S (t20 = 7.20, Pperm = 0.0001). Critical to our main hypothesis, we tested the difference in renewal of threat expectancy between the previously suppressed and extinguished CS+S, and the extinguished CS+ (without thought suppression). During the renewal test, threat expectancy was significantly higher for the CS+S compared to the CS+ (Figure 3; t20 = 2.92, Pperm = 0.0068). These results indicate that thought suppression during extinction learning did not produce greater extinction generalization, and instead resulted in greater renewal of shock expectancy than standard extinction.

Figure 3.

Figure 3.

Experiment 1 renewal test. Thought suppression increased renewal of threat expectancy during the 24-hour delayed renewal test (CS+S vs. CS+ t20 = 2.92, Pperm = 0.0068). Mean values and 95% confidence intervals are also shown in Figure 2A. Individual participants are shown as points, with connecting lines for each subject between the two conditions.

SCRs showed a generalized increase in arousal for each CS condition, and there was no significant main effect of condition (F(2, 40) = 0.19, Pperm = 0.83).

3.1.4. Recognition Memory Test

Following the renewal test, participants completed a recognition memory test for all items seen during acquisition and extinction with the addition of novel foils. Previous work has shown that thought suppression results in decreased recognition memory for previously suppressed stimuli (Benoit and Anderson, 2012; Wang et al., 2019a). But notably, memory studies of this type traditionally include both a “forget” or “suppress” cue as well as an explicit “remember” or “view” cue. We did not include a cue to remember a particular CS category in the present study. High confidence corrected recognition (hits – false alarms) was scored for each CS type and encoding phase, acquisition and extinction. A repeated measures ANOVA revealed only a main effect of phase (F(1, 20) = 24.00, P = 8.68e-5). No significant main effect of condition or phase by condition interaction was observed. A post-hoc comparison showed that overall, participants remembered fewer items from extinction compared to acquisition (t20 = −3.77, P = 0.0012). This difference in recognition memory between extinction and acquisition is in-line with previous experiments utilizing a similar category conditioning paradigm (Dunsmoor et al., 2015b, 2018; Keller and Dunsmoor, 2020). That we did not find an additional effect of thought suppression on recognition memory is perhaps owed to the absence of an explicit “remember” or “view” cue accompanying another CS category.

3.2. Experiment 2

In Experiment 1, we found that thought suppression during extinction learning did not increase extinction generalization, but instead resulted in an increase in shock expectancy relative to standard extinction. One possibility is that thought suppression during extinction training served the same function as an inhibitory cue, which acted to thwart extinction learning by preventing the omission of the US to diminish associative value of the CS, i.e., protection from extinction (Lovibond et al., 2000, 2009; Rescorla, 2003). However, by our design, there are two possible routes by which thought suppression protected the CS from extinction: the cognitive process of thought suppression or the mere presence of the perceptual cue on those trials. That is, the thought suppression cue (blue border and fixation cross) could itself serve as an inhibitory cue, irrespective of the instructions and cognitive operation of thought suppression. To address this possibility, we conducted a second experiment that was identical to Experiment 1 in design, but participants were not given instructions regarding the colored border during extinction trials. Thus, the change in the colored border and fixation cross on CS+S trials during extinction served only as an added feature to CS+S trials. If the cue itself was sufficient to protect the CS+S category from extinction, then we would predict a replication of Experiment 1 of increased renewal of threat expectancy to the CS+S compared to the CS+. However, if the cognitive operation of thought suppression is the relevant feature that protects the CS+S from extinction, then there should not be a difference in threat expectancy between the CS+S and CS+ during the renewal test. The post-experiment surveys confirmed that there was no difference in either STAI or IUS scores between participants in Experiments 1 and 2. Additionally, participants in both experiments did not differ either in the perceived number of received shocks on day 1 or in retrospective shock intensity.

3.2.1. Acquisition

Threat expectancy confirmed successful acquisition, and results were similar to Experiment 1. There was a main effect of condition (F(2, 40) = 48.48, Pperm = 0.0001). There was no main effect of phase, nor significant condition by phase interaction. Planned comparisons during late acquisition show greater expectancy for both the CS+ (t20 = 6.26, Pperm = 0.0003) and the CS+S (t20 = 6.33, Pperm = 0.0001) relative to the CS−. There was no difference in threat expectancy between the CS+ and CS+S (t20 = 0.33, Pperm = 0.75).

SCR results also confirmed successful acquisition. There was a significant main effect of condition (F(2, 40) = 11.60, Pperm = 0.0001) and phase (F(1, 20) = 4.91, Pperm = 0.040). There was no condition by phase interaction. Planned comparisons show greater SCR relative to the CS− for both CS+ (t20 = 3.63, Pperm = 0.0009) and the CS+S (t20 = 3.05, Pperm = 0.0057). There was no difference in SCR between the CS+ and CS+S (t20 = 0.87, Pperm = 0.40).

3.2.2. Extinction

As in Experiment 1, extinction immediately followed acquisition. The cue (colored border and fixation cross) was presented with the CS+S exemplars, but participants had not previously seen the cue nor received any instructions regarding it. Threat expectancy confirmed successful extinction. There were main effects of both condition (F(2, 38) = 11.97, Pperm = 0.0001) and phase (F(1, 19) = 49.01, Pperm = 0.0001), as well as a significant condition by phase interaction (F(2, 38) = 5.64, Pperm = 0.0077). As in Experiment 1, planned comparisons during late extinction showed that threat expectancy for CS+ was still higher than CS− expectancy (t19 = 3.56, Pperm = 0.0003). However, unlike in Experiment 1, there was no difference between CS+S and CS− expectancy (t19 = 1.60, Pperm = 0.12). We conducted post-hoc comparisons of CS+ and CS+S expectancy from late acquisition to late extinction, and found that it was reduced in late extinction for both CS+’s (CS+ t19 = −10.85, Bonferroni corrected Pperm = 0.0002; CS+S t19 = −9.09, Bonferroni corrected Pperm = 0.0002). There was no difference in threat expectancy between the CS+ and CS+S (t19 = −1.37, Pperm = 0.19).

SCR again confirmed successful extinction. There was a significant main effect of condition (F(2, 40) = 3.94, Pperm = 0.026). No significant main effect of phase nor interaction of condition by phase was observed. Planned comparisons showed no difference between either the CS+ (t20 = 1.28, Pperm = 0.23), or the CS+S (t20 = 1.20, Pperm = 0.28) and the CS−. There was no difference in SCR between the CS+ and CS+S (t20 = 0.36, Pperm = 0.81).

3.2.3. Renewal Test

As in Experiment 1, participants completed a renewal test on the following day with novel category exemplars. Again, no thought suppression cues or shocks were presented during this test. Threat expectancy showed a main effect of condition (F(2, 40) = 18.49, Pperm = 0.0001). There was significant renewal of threat expectancy relative to the CS− for both the CS+ (t20 = 6.05, Pperm = 0.0001) and the CS+S (t20 = 4.30, Pperm = 0.0002). Critical to our hypothesis, there was no difference in threat expectancy between the CS+ and CS+S (Figure 5; t20 = −0.49, Pperm = 0.63). These results demonstrate that the presentation of the suppression cue alone, without the engagement of thought suppression, was insufficient to produce the significant renewal of threat expectancy for CS+S that was observed in Experiment 1.

Figure 5.

Figure 5.

Experiment 2 renewal test. The visual thought suppression cue, not paired with instructions to engage in thought suppression, does not increase renewal of threat expectancy during a 24 delayed test (CS+S vs. CS+ (t20 = −0.49, Pperm = 0.63). Mean values and 95% confidence intervals are replicated from Figure 4. Individual participants are shown as points, with connecting lines for each subject between the two conditions.

Also, as in Experiment 1, there was no main effect of condition for SCR (F(1, 20) = 0.60, Pperm = 0.55), and no follow-up comparisons were considered.

3.2.4. Recognition Memory Test

Following the renewal test, participants completed a surprise recognition memory test. Considering high-confidence corrected recognition, there was only a significant main effect of phase (F(1, 20) = 49.27, P = 0.0001). No significant main effect of condition or condition by phase interaction was observed. A post-hoc comparison showed that memory was overall lower for items encoded during extinction compared to acquisition (t20 = −7.02, P = 8.27e-7).

4. Discussion

Laboratory techniques to alleviate negative associations and expectations are of increasing interest as potential avenues to innovate and improve psychotherapy for disorders of fear, anxiety, and stress. As extinction is characterized by its transience and specificity, strategies to strengthen extinction and promote its generalization are of particular interest. Based on rodent studies showing that hippocampal downregulation helps prevent fear renewal (Hobin et al., 2006; Zelikowsky et al., 2013), we examined whether a behavioral instruction associated with of top-down hippocampal modulation likewise could serve to promote extinction generalization in humans. Contrary to promoting extinction generalization, an instruction to suppress one’s thoughts resulted in a greater return of threat expectancy as compared to standard extinction. A follow-up experiment supported the inference that thought suppression itself served as an inhibitor during extinction learning that “protected” the CS from extinction. These findings have implications for therapies based on principles of extinction, predominately exposure therapy.

One possible explanation for elevated renewal to the suppressed category is a substantive shift in cognitive states (or task demands) between extinction and renewal test for the CS+S category. That is, in Experiment 1 participants were asked to engage in a particular cognitive operation (thought suppression) only during the extinction phase. This may have resulted in hyper-specific learning that the CS+S category is safe only in conjunction with the engagement of thought suppression. Consequently, participants may have reverted to the original CS-US association at the time of renewal test, when there was no instruction to suppress thoughts. Another possible explanation is that having the CS+S be the target of both thought suppression and extinction learning prevented later retrieval of the extinction association. In this case, the thought suppression may have inhibited encoding of both contextual features and stimulus features, such that the novel CS+S stimuli presented during the renewal test did not trigger retrieval of the extinction association. In either case, that threat expectancy was not different between CS+ categories in Experiment 2 (which lacked any thought suppression) suggests that the instruction itself, and not the colored cue, served as salient contextual information during extinction learning.

Although several contextual features differed between extinction learning and the renewal test (presence of the suppression cue, novel category exemplars, change in temporal context), it could be that the observed effect is a type of selective spontaneous recovery. Future work could test whether more salient shifts in context between acquisition, extinction, and test lead to different effects of thought suppression on extinction (i.e. “ABB” vs. “ABA” designs). It is also unclear whether thought suppression would lead to increased renewal of threat appraisal in a design with delayed as opposed to immediate extinction. Previous work has demonstrated that delayed extinction leads to less spontaneous recovery and renewal of fear (Huff et al., 2009). The key difference is that in delayed extinction, the threat association has been consolidated. However, the goal of thought suppression during extinction would still be to impair encoding of contextual information during the new learning of the extinction association. It could be then that thought suppression would have a similar outcome as in immediate extinction.

The current experiment is based on neuroimaging research showing that thought suppression downregulates hippocampal activity (Anderson and Hanslmayr, 2014), however we cannot verify that this top-down regulation is at play in this behavioral study without neuroimaging data. That is, it is possible our observed effects were a general effect of task instructions, rather than thought suppression specifically. Because of our lack of a trial-by-trial readout of hippocampal activity, we also cannot verify with certainty how successful participants were at suppressing their thoughts on CS+S trials, or whether the suppression was in fact limited to these trials. The vast majority of item-method directed forgetting studies contrast a to-be-forgotten (TBF) condition with a to-be-remembered (TBR) condition and find that memory for TBF items is worse compared to TBR items. However, studies have shown that when memory for TBF items is either no different than, or better than memory for items not paired with an instruction (uncued) (Gao et al., 2019; Schindler and Kissler, 2018; Zwissler et al., 2015). In no case is memory for TBF items poorer than memory for uncued items. These results suggest that the difference in memory between TBR and TBF items observed in item-method directed forgetting studies may be the result of increased processing or active rehearsal of TBR items, in contrast to disrupted encoding of TBF items (Gao et al., 2019; Schindler and Kissler, 2018; Zwissler et al., 2015). This could explain why we did not observe differences in episodic memory between the CS conditions in the present study. In the current design, one category was paired with a salient thought suppression cue during extinction learning, and the other two CS conditions were uncued. A future variation of this design could incorporate remember cues into extinction learning, as well as suppression cues.

We can also speculate on whether a different type of thought suppression would produce the same putative outcome, or instead lead to enhanced extinction generalization. One alternative to the item-method directed forgetting paradigm is the think/no-think paradigm (TNT) (Anderson and Green, 2001). TNT designs induce suppression by instructing participants to suppress the retrieval of a learned cue-target association when presented with the cue. Not only does TNT suppression reduce episodic memory for suppressed targets, it can also reduce the influence of suppressed information for future decisions (Gagnepain et al., 2014; Wang et al., 2019b). For this reason, TNT suppression may also be more clinically relevant than thought suppression during encoding. Intrusive thoughts are a common symptom in many anxiety disorders, and can be triggered by secondary associations (Mineka and Zinbarg, 2006). The ability to suppress these thoughts may be adaptive, and a recent neuroimaging study observed deficits in functional connectivity during TNT suppression in individuals with post-traumatic stress disorder (PTSD) compared to both trauma exposed and healthy controls (Mary et al., 2020). In the latter study, individuals that were trauma exposed but did not go on to develop PTSD had stronger connectivity between prefrontal control regions and posterior memory regions during top-down suppression compared to trauma exposed individuals with PTSD. Thus, disruptions in the ability to suppress thoughts may contribute to the development and maintenance of PTSD. If this is the case, patients may benefit from additional suppression training in the context of therapy. Before this idea can be translated into treatment, research should investigate whether TNT suppression combined with extinction learning results in a different outcome than the one we observed with thought suppression in Experiment 1. It could be that TNT is more potent than item-method thought suppression. However, as we report here, introducing an additional cognitive operation during extinction learning can result in a greater return of fear later on, and thus it is possible that even a TNT manipulation could also lead to an increased renewal of threat appraisal.

Finally, the limitation presented by the SCR results should be considered. Specifically, SCR results did not dissociate renewal between any of the CS categories, but were instead enhanced for all CS types, even the unpaired CS−. One possibility is that the use of novel category exemplars during the test generated an unexpected degree of non-associative orienting to the images that was reflected in arousal but not in cognitive threat appraisal. Another account of the divergence between threat expectancy and SCR may be that these behavioral measures are assaying different psychological constructs. A current theory of negative affective processing in humans suggests that there is a dissociation between the cognitive experiences of emotion and physiological reactivity (LeDoux and Pine, 2016; however see Fanselow and Pennington, 2018). This idea is supported by recent findings that the neural representations of fear and physiological reactivity (i.e. SCR) are related, but ultimately separable (Taschereau-Dumouchel et al., 2019). It could be the case that top-down thought suppression does not influence the cognitive and physiological systems equally. Future work should explore how top-down inhibitory control can be implemented alongside extinction learning in a way to impact both cognitive and physiological outcomes.

5. Conclusion

We investigated whether thought suppression during extinction learning could facilitate extinction generalization. In contrast to our primary hypothesis, we found that extinction with thought suppression had a protective effect, such that there was a significant renewal of threat appraisal for the suppressed category during a delayed associative memory test relative to standard extinction. In a second experiment, we confirmed that a suppression cue alone was insufficient to replicate this effect, suggesting that the cognitive engagement of thought suppression was necessary to interfere with extinction learning. Future work should investigate whether other forms of suppression, such as retrieval suppression, could better facilitate the generalization of safety learning.

Figure 4.

Figure 4.

Experiment 2 behavioral results. Experimental design was nearly identical to Experiment 1, however participants were not instructed to engage in thought suppression during extinction learning. The blue border and fixation cross still accompanied presentations of the CS+S as in Experiment 1. A. Threat expectancy. Continuous threat expectancy confirmed successful threat acquisition, extinction, and renewal. No differences were observed between the CS+ and CS+S at any time point. B. Skin conductance responses. SCR confirmed successful acquisition and extinction, and a generalized increase in arousal to all CS types at renewal test. Points and error bars correspond to means and 95% bootstrapped confidence intervals.

Funding:

This work was supported by NIH R00MH106719 to J.E.D.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Data Availability: All de-identified behavioral data available upon request to J.E. Dunsmoor (joseph.dunsmoor@austin.utexas.edu).

References

  1. Anderson MC, and Green C (2001). Suppressing unwanted memories by executive control. Nature 410, 366–369. [DOI] [PubMed] [Google Scholar]
  2. Anderson MC, and Hanslmayr S (2014). Neural mechanisms of motivated forgetting. Trends Cogn. Sci 18, 279–292. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Benoit RG, and Anderson MC (2012). Opposing Mechanisms Support the Voluntary Forgetting of Unwanted Memories. Neuron 76, 450–460. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Bjork EL, Bjork RA, and Anderson MC (1998). Varieties of goal-directed forgetting. In Intentional Forgetting: Interdisciplinary Approaches, Golding JM, and MacLeod CM, eds. (Hillsdale, NJ: Erlbaum; ), pp. 103–137. [Google Scholar]
  5. Bouton ME, and Moody EW (2004). Memory processes in classical conditioning. In Neuroscience and Biobehavioral Reviews, pp. 663–674. [DOI] [PubMed] [Google Scholar]
  6. Craske MG, Treanor M, Conway CC, Zbozinek T, and Vervliet B (2014). Maximizing exposure therapy: An inhibitory learning approach. Behav. Res. Ther 58, 10–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Craske MG, Hermans D, and Vervliet B (2018). State-of-the-art and future directions for extinction as a translational model for fear and anxiety. Philos. Trans. R. Soc. B Biol. Sci 373, 20170025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Craske MG, Fanselow M, Treanor M, and Bystritksy A (2019). Cholinergic Modulation of Exposure Disrupts Hippocampal Processes and Augments Extinction: Proof-of-Concept Study With Social Anxiety Disorder. Biol. Psychiatry 86, 703–711. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Dunsmoor JE, and Kroes MC (2019). Episodic memory and Pavlovian conditioning: ships passing in the night. Curr. Opin. Behav. Sci 26, 32–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Dunsmoor JE, Niv Y, Daw N, and Phelps EA (2015a). Rethinking Extinction. Neuron 88, 47–63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Dunsmoor JE, Davachi L, Phelps EA, and Murty VP (2015b). Emotional learning selectively and retroactively strengthens memories for related events. Nature 520, 345–348. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Dunsmoor JE, Kroes MCW, Moscatelli CM, Evans MD, Davachi L, and Phelps EA (2018). Event segmentation protects emotional memories from competing experiences encoded close in time. Nat. Hum. Behav 2, 291–299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Dunsmoor JE, Kroes MCW, Li J, Daw ND, Simpson HB, and Phelps EA (2019). Role of human ventromedial prefrontal cortex in learning and recall of enhanced extinction. J. Neurosci 2713–2718. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Fanselow MS, and Pennington ZT (2018). A return to the psychiatric dark ages with a two-system framework for fear. Behav. Res. Ther 100, 24–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Fitzgerald PJ, Seemann JR, and Maren S (2014). Can fear extinction be enhanced? A review of pharmacological and behavioral findings. Brain Res. Bull 105, 46–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Frossard J, and Renaud O (2019). permuco: Permutation Tests for Regression, Repeated Measures) ANOVA/ANCOVA and Comparison of Signals.
  17. Gagnepain P, Henson RN, and Anderson MC (2014). Suppressing unwanted memories reduces their unconscious influence via targeted cortical inhibition. Proc. Natl. Acad. Sci. U. S. A 111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Gao H, Qi M, and Zhang Q (2019). Forgetting cues are ineffective in promoting forgetting in the item-method directed forgetting paradigm. Int. J. Psychophysiol 144, 25–33. [DOI] [PubMed] [Google Scholar]
  19. Grady AK, Bowen KH, Hyde AT, Totsch SK, and Knight DC (2016). Effect of continuous and partial reinforcement on the acquisition and extinction of human conditioned fear. Behav. Neurosci 130, 36–43. [DOI] [PubMed] [Google Scholar]
  20. Green SR, Kragel PA, Fecteau ME, and LaBar KS (2014). Development and validation of an unsupervised scoring system (Autonomate) for skin conductance response analysis. Int. J. Psychophysiol 91, 186–193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Hobin JA, Ji J, and Maren S (2006). Ventral hippocampal muscimol disrupts context-specific fear memory retrieval after extinction in rats. Hippocampus 16, 174–182. [DOI] [PubMed] [Google Scholar]
  22. Huff NC, Hernandez JA, Blanding NQ, and LaBar KS (2009). Delayed Extinction Attenuates Conditioned Fear Renewal and Spontaneous Recovery in Humans. Behav. Neurosci 123, 834–843. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Humphreys LC (1939). The effect of random alternation of reinforcement on the acquisition and extinction of conditioned eyelid reactions. J. Exp. Psychol 25, 141–158. [Google Scholar]
  24. Izquierdo I, Furini CRG, and Myskiw JC (2016). Fear memory. Physiol. Rev 96, 695–750. [DOI] [PubMed] [Google Scholar]
  25. Keller NE, and Dunsmoor JE (2020). The effects of aversive-to-appetitive counterconditioning on implicit and explicit fear memory. Learn. Mem 27, 12–19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. LeDoux JE, and Pine DS (2016). Using neuroscience to help understand fear and anxiety: A two-system framework. Am. J. Psychiatry 173, 1083–1093. [DOI] [PubMed] [Google Scholar]
  27. Lovibond PF, Davis NR, and O’Flaherty AS (2000). Protection from extinction in human fear conditioning. Behav. Res. Ther 38, 967–983. [DOI] [PubMed] [Google Scholar]
  28. Lovibond PF, Mitchell CJ, Minard E, Brady A, and Menzies RG (2009). Safety behaviours preserve threat beliefs: Protection from extinction of human fear conditioning by an avoidance response. Behav. Res. Ther 47, 716–720. [DOI] [PubMed] [Google Scholar]
  29. Marek R, Jin J, Goode TD, Giustino TF, Wang Q, Acca GM, Holehonnur R, Ploski JE, Fitzgerald PJ, Lynagh T, et al. (2018). Hippocampus-driven feed-forward inhibition of the prefrontal cortex mediates relapse of extinguished fear. Nat. Neurosci 21, 384–392. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Maren S, Phan KL, and Liberzon I (2013). The contextual brain: Implications for fear conditioning, extinction and psychopathology. Nat. Rev. Neurosci 14, 417–428. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Mary A, Dayan J, Leone G, Postel C, Fraisse F, Malle C, Vallée T, Klein-Peschanski C, Viader F, de la Sayette V, et al. (2020). Resilience after trauma: The role of memory suppression. Science 367, eaay8477. [DOI] [PubMed] [Google Scholar]
  32. Milad MR, Pitman RK, Ellis CB, Gold AL, Shin LM, Lasko NB, Zeidan MA, Handwerger K, Orr SP, and Rauch SL (2009). Neurobiological Basis of Failure to Recall Extinction Memory in Posttraumatic Stress Disorder. Biol. Psychiatry 66, 1075–1082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Mineka S, and Zinbarg R (2006). A contemporary learning theory perspective on the etiology of anxiety disorders: It’s not what you thought it was. Am. Psychol 61, 10–26. [DOI] [PubMed] [Google Scholar]
  34. Peirce J, Gray JR, Simpson S, MacAskill M, Höchenberger R, Sogo H, Kastman E, and Lindeløv JK (2019). PsychoPy2: Experiments in behavior made easy. Behav. Res. Methods 51, 195–203. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Rescorla RA (2003). Protection from extinction. Learn. Behav 31, 124–132. [DOI] [PubMed] [Google Scholar]
  36. Rescorla RA, and Wagner AR (1972). A theory of classical conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Class. Cond. II Curr. Res. Theory 21, 64–99. [Google Scholar]
  37. Schiller D, Monfils MH, Raio CM, Johnson DC, LeDoux JE, and Phelps EA (2010). Preventing the return of fear in humans using reconsolidation update mechanisms. Nature 463, 49–53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Schindler S, and Kissler J (2018). Too hard to forget? ERPs to remember, forget, and uninformative cues in the encoding phase of item-method directed forgetting. Psychophysiology 55. [DOI] [PubMed] [Google Scholar]
  39. Shapiro SS, and Wilk MB (1965). An Analysis of Variance Test for Normality (Complete Samples). Biometrika 52, 591. [Google Scholar]
  40. Singewald N, Schmuckermair C, Whittle N, Holmes A, and Ressler KJ (2015). Pharmacology of cognitive enhancers for exposure-based therapy of fear, anxiety and trauma-related disorders. Pharmacol. Ther 149, 150–190. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Taschereau-Dumouchel V, Kawato M, and Lau H (2019). Multivoxel pattern analysis reveals dissociations between subjective fear and its physiological correlates. Mol. Psychiatry 1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Vallat R (2018). Pingouin: statistics in Python. J. Open Source Softw 3, 1026. [Google Scholar]
  43. Wang TH, Placek K, and Lewis-Peacock JA (2019a). More is less: Increased processing of unwanted memories facilitates forgetting. J. Neurosci 39, 3551–3560. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Wang Y, Luppi A, Fawcett J, and Anderson MC (2019b). Reconsidering unconscious persistence: Suppressing unwanted memories reduces their indirect expression in later thoughts. Cognition 187, 78–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Zelikowsky M, Hast TA, Bennett RZ, Merjanian M, Nocera NA, Ponnusamy R, and Fanselow MS (2013). Cholinergic blockade frees fear extinction from its contextual dependency. Biol. Psychiatry 73, 345–352. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Zwissler B, Schindler S, Fischer H, Plewnia C, and Kissler JM (2015). “Forget me (not)?” - Remembering forget-items versus un-cued items in directed forgetting. Front. Psychol 6, 1741. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES