Abstract
Spontaneous recovery in extinction appears to be inversely related to the acquisition-to-extinction interval, but it remains unclear why this is the case. Rat subjects trained with one of three interference paradigms exhibited less spontaneous recovery of the original response after delayed than immediate interference, regardless of whether interference resulted in attenuated fear (extinction, CS-Shock followed by CS-noShock), acquisition of conditioned fear (latent inhibition, CS-noShock followed by CS-Shock), or acquisition of a response (counterconditioning, CS-Shock followed by CS-Sucrose). We suggest that delaying interference treatment increases the relative similarity of the interference and test contexts, facilitating retrieval of the interfering association and attenuating recovery of the original response.
Various Pavlovian conditioning paradigms are instances of “retroactive interference between outcomes,” in which recall of the association between a conditioned stimulus (CS) and unconditioned stimulus (US) is impaired when training of an association between the CS and a different US is interpolated between original training and testing (Bouton 1993; Miller and Escobar 2002; Escobar et al. 2004). For example, in “extinction” (Pavlov 1927), CS-Shock pairings (the original association) are followed by CS-noShock presentations (the interfering association), and responding is consistent with the interfering association. However, retroactive interference wanes with time, and the original association once again comes to control behavior, a phenomenon known as “spontaneous recovery” (Pavlov 1927; Rescorla 2004a).
According to recent reports, spontaneous recovery from extinction may be an inverse function of the original-interfering training (O-I) interval (Rescorla 2004b; Maren and Chang 2006; Woods and Bouton 2008; Chang and Maren 2009; Huff et al. 2009; Johnson et al. 2010; but see Myers et al. 2006; Norrholm et al. 2008; Schiller et al. 2008; Archbold et al. 2010; Johnson et al. 2010). However, why delaying extinction reduces spontaneous recovery is not fully understood. Maren and Chang (2006) reported that reducing fear prior to immediate extinction by reducing the number of CS-Shock pairings or conducting extinction in a novel context attenuated spontaneous recovery, whereas arousing fear prior to delayed extinction by delivering shocks in a novel context increased spontaneous recovery. Seemingly, entering extinction in a state of fear reduces the long-term effectiveness of extinction (Morris et al. 2005). However, immediate extinction also appears to be of low effectiveness in appetitive preparations (Rescorla 2004b; Woods and Bouton 2008), suggesting that a general state of anticipation of an outcome rather than fear may be the relevant variable. Immediate extinction also appears to be context-independent (Myers et al. 2006; Chang and Maren 2009), which may be interpreted as reflecting nonassociative decreases in responding that dissipate with time (e.g., habituation (Chang and Maren 2009).
We propose an alternative view based on differential retrieval of recently learned information, modulated by the O-I interval. Increasing the O-I interval both enhances the discriminability of the contexts of original and interference training, and makes the contexts of interference training and testing more similar due to their greater relative proximity. Consequently, the test context may better reactivate memories of interference training in the delayed than the immediate condition (Bouton 1993; Escobar et al. 2001), increasing the likelihood of observing retroactive interference (Pineño et al. 2000) independent of level of fear at the onset of interference training.
Other Pavlovian interference phenomena have the same basic structure as extinction, but differ on whether subjects enter the interference training phase in a state of fear, and whether interference training results in fear attenuation. For example, in the latent inhibition (LI) paradigm (CS-noShock, CS-Shock) (Lubow and Moore 1959), subjects enter the interference phase in a state of low fear, regardless of the duration of the O-I interval. Similarly, in the counterconditioning paradigm (CS-Shock, CS-Sucrose) (Sherrington 1947), subjects receiving immediate interference training enter Phase 2 in a state of high fear (due to the recent shock treatment) and acquire an appetitive response, precluding the development of CS habituation. The present studies investigate the impact of manipulating the O-I interval in extinction (Experiment 1), LI (Experiment 2), and counterconditioning (Experiment 3) to assess the following two specific possibilities. First, if the effects of the O-I interval are mostly due to receiving interference training in a state of heightened fear, LI should be insensitive to manipulations of the O-I interval (but see Aguado et al. 1994; Killcross et al. 1998). Second, if immediate extinction results in habituation to the CS rather than interference, counterconditioning should be insensitive to manipulations of the O-I interval. However, if delaying interference treatment increases the similarity between the interference and test contexts, more retroactive interference (less spontaneous recovery) should be observed after long than after short O-I intervals, regardless of whether interference treatment results in attenuated fear (extinction), fear (LI), or a response incompatible with fear (counterconditioning).
The subjects were male Sprague-Dawley rats. Subjects in Experiment 1 (n = 32, ∼60-d old) were experimentally naïve and subjects in Experiments 2 and 3 (n = 32/study, ∼95-d old) had previously participated in unrelated studies, but were naïve to the apparatus and stimuli used in the present studies. Subjects were pair-housed in standard plastic cages on a 12:12-h light:dark cycle. In Experiments 1 and 2, water availability was restricted to 30 min/d (food available ad libitum), and in Experiment 3, subjects were brought down and maintained at 85% of their free feeding weight (water available ad libitum). The apparatus were eight identical chambers (30.5 × 24.1 × 21.0 cm), housed in sound-attenuation cubicles illuminated with 100-mA houselights delivered at 28 VDC. Exhaust fans provided constant background noise (70 dB [A-scale]). The side walls of the chamber were made of aluminum sheet metal; the remaining walls and ceiling were made of clear polycarbonate. A grid floor made of 4.8-mm stainless-steel rods was used to deliver a scrambled footshock. Various auditory stimuli could be delivered at 10 dB (A-scale) above background. In Experiments 1 and 2, depressing a response lever was associated with delivery of 0.05-mL droplets of water into a receptacle cup located inside a niche. In Experiment 3, automatic dispensers delivered two 45-mg sucrose pellets into the cup, and infrared photobeams recorded head entries into the niche.
In Experiment 1 (extinction) (Fig. 1), lever-pressing was trained in four 1-h autoshaping sessions with water reinforcement delivered on concurrent FT-5-min/FR-1 (Day 1), FR-1 (Days 2 and 3), and VI-20-sec (Day 4 and subsequent) schedules. On Day 5 (Delayed condition) or 6 (Immediate condition), all subjects received three pairings of X (a 30-sec pulsating white noise) and a 0.85-mA, 0.5-sec footshock (ITI: 10 min). After completion of the 24-min session, all animals were returned to their home cages. Either 12 min (Immediate condition) or 24 h (Delayed condition) after the last conditioning trial, the first extinction trial was delivered. Extinction animals were scheduled to receive 20 X presentations (mean ITI: 3 min) in a 67-min session. However, due to a programming error, only 19 presentations occurred. Subjects in the Control condition received time-equivalent context exposure. Because shock treatment severely disrupts baseline behavior, on Day 8 (Day 7 was a no-treatment day) all subjects received a 60-min restabilization-of-baseline treatment. On Day 9 (72 h after extinction) all subjects were returned to the test chambers and received six presentations of X (ITI: 10 min), to assess spontaneous recovery of fear.
For all measures, “response ratios” were calculated using the formula A/(A + [B ÷ 3]) (Annau and Kamin 1961), where A and B represent responding during the 30-sec CS and a 90-sec baseline period, respectively. If both A and B were zero, response ratios were incalculable. Acquisition of the Phase 2 contingency was analyzed using repeated measures analyses; for these analyses, missing scores were estimated as the average of the adjacent scores. If replacement was not possible, the subject was excluded from the analyses. Because all subjects continued to receive their scheduled treatment, their data were not excluded from the spontaneous recovery analyses. (Details on data management are presented in the Supplemental Materials.) Significance was established at alpha <0.05.
Extinction was analyzed with a 2 (condition: extinction vs. control) × 2 (delay) × 5 (four-trial block) ANOVA, which revealed a main effect of condition, F(1,23) = 73.66, a main effect of block, and a Condition × Block interaction, F′s(4,92) = 4.19 and 11.06, respectively. (note that the last block had only three trials). The main effect of delay and all interactions with this factor were not significant, all F’s < 1.26, replicating previous observations from our laboratory that extinction progresses equivalently in the two delay conditions (Fig. 1A; Johnson et al. 2010; but see Maren and Chang 2006; Schiller et al. 2008; Woods and Bouton 2008). Spontaneous recovery was analyzed with a 2 (condition) × 2 (delay) × 2 (3-trial block) ANOVA, which revealed main effects of condition, delay, and block, F′s(1,27) = 42.48, 6.03, and 60.01, respectively, as well as interactions of Block × Condition, Block × Delay, and Block × Condition × Delay, F′s(1,26) = 60.89, 7.01, and 7.56, respectively. Thus, delaying extinction increased the likelihood of responding, consistent with recently acquired information (X-noShock; retroactive interference), whereas providing immediate extinction increased intrusions from distally acquired information (X-Shock; spontaneous recovery) (Fig. 1B).
Subjects in Experiment 2 (LI) (Fig. 2) had been previously trained on the lever-press response. Thus, on Day 1, they received one 60-min session on the VI-20-sec schedule to reestablish baseline responding. On Day 2 (Delayed condition) or 3 (Immediate condition), subjects in the LI condition received 36 presentations of X (mean ITI: 2 min) in a 75-min session. Subjects in the Control condition received 36 equivalent presentations of nontarget stimulus A (X and A were a 5000-Hz tone and a 1500-Hz pulsating tone, counterbalanced). Two minutes after the last stimulus presentation, subjects were returned to their home cages, and then returned to the test chambers for the conditioning phase. Conditioning consisted of six pairings of X and a 0.60-mA, 0.5-sec footshock (mean ITI: 5 min), starting 12 min (Immediate condition) or 24 h (Delayed condition) after the last preexposure CS presentation (session duration: 45 min). On Days 4 and 5, baseline was restabilized and, on Day 6 (72 h after conditioning), spontaneous recovery was assessed with six X presentations as described for Experiment 1.
Conditioning was analyzed with a 2 (condition: LI vs. control) × 2 (delay) × 2 (three-trial block) ANOVA, which revealed main effects of condition (indicative of retardation-of-acquisition in the LI groups) and block, and a Condition × Block interaction, F′s(1,20) = 17.50, 64.52, and 26.43, respectively. As was the case with extinction, O-I interval did not have an effect on acquisition of the Phase 2 contingency (Fig. 2A). Spontaneous recovery was assessed with a 2 (condition) × 2 (delay) × 2 (3-trial block) ANOVA, which revealed main effects of condition and block, and a Condition × Delay interaction, F′s(1,25) = 4.28, 25.28, and 4.27, respectively. The effect of delay was marginal, F(1,25) = 3.88, P < 0.061. Thus, delaying conditioning increased responding, consistent with recently acquired information (X-Shock; retroactive interference), whereas providing immediate conditioning increased intrusions from distally acquired information (X-noShock), even if those distal memories did not evoke conditioned fear (Fig. 2B).
In Experiment 3 (counterconditioning) (Fig. 3), all subjects were trained on Day 1 to insert their heads into the food cull to obtain sucrose reinforcement delivered on a FT-4-min schedule during a 1-h session. On Day 2 (Delayed condition) or 3 (Immediate condition), subjects in the counterconditioning (CC) condition received three pairings of X (a white noise) and a 0.60-mA, 1-sec footshock (ITI: 10 min; session duration: 25 min). Subjects in the Control condition received equivalent unpaired presentations of X and the shock (mean ITI: 5 min). Although this control condition does not allow for a dissociation of the effects of extinction and counterconditioning, it was selected to provide a no-fear baseline against which to compare the effectiveness of counterconditioning training. Two minutes after the last stimulus presentation, all subjects were returned to their home cages. Then, either 12 min (Immediate condition) or 24 h (Delayed condition) after the last conditioning trial, all subjects received 20 X-Sucrose pairings (mean ITI: 3 min) in a 70-min session. On Day 5 (72 h after counterconditioning [Day 4 was a no-treatment day]), spontaneous recovery was assessed with four presentations of X.
The two delay conditions acquired the X-sucrose contingency at an equivalent rate (Fig. 3A). A 2 (condition: CC vs. control) × 2 (delay) × 5 (four-trial block) ANOVA revealed a main effect of condition, F(1,28) = 24.12 (indicative of retardation-of-acquisition in the CC groups), as well as a main effect of block and a Condition × Block interaction, F′s(4,112) = 23.11 and 5.65, respectively. Spontaneous recovery was assessed with a 2 (condition) × 2 (delay) × 2 (two-trial block) ANOVA, which revealed main effects of condition, delay, and block, as well as a Condition × Delay interaction, F′s(1,27) = 51.07, 4.80, 4.83, and 6.35, respectively. Thus, consistent with the observations of Experiments 1 and 2, delaying counterconditioning increased responding, consistent with recently acquired information (X-sucrose; retroactive interference), whereas providing immediate counterconditioning increased intrusions from distally acquired information (X-footshock; spontaneous recovery) (Fig. 3B).
Temporal proximity between events can provide contextual information, and events that occur close in time can be encoded as part of a single “temporal context” (e.g., Bouton 1988, 1993). In the case of extinction, increasing the O-I interval can make the conditioning and extinction experiences be encoded in distinct temporal contexts. If testing occurs soon after extinction, the test and extinction contexts should be more temporally similar than the test and acquisition contexts, favoring retrieval of the extinction (X-noShock) contingency. Conversely, in the immediate condition, acquisition and extinction occur in close proximity and may be encoded as part of a single temporal context. Discriminability in terms of time may explain the observation of different levels of spontaneous recovery following immediate and delay extinction. For example, the “temporal weighting rule” (e.g., Devenport 1998) suggests that recent experiences are weighed more heavily than remote experiences (in this case, weight is equivalent to behavioral control). Thus, experiences that can be considered by the organism as relatively recent (the interfering association in the delayed condition) would be weighed more heavily than experiences that are more remote in time (the original association in the delayed condition). However, if the two experiences occur close in time (immediate condition), they would be weighed equally, and the recent experience would exert less behavioral control. Furthermore, the model assumes that, over time, the weight of an experience is discounted hyperbolically, meaning that experiences discount steeply first and then more slowly. That is, over time, recent and remote experiences come to be discounted to an equivalent weight. Previous data from our laboratory yield support for this perspective: If testing is delayed long after extinction, robust spontaneous recovery is observed after delayed extinction (Johnson et al. 2010). It remains to be seen whether a similar relationship holds for LI and counterconditioning.
Determining whether delaying interference treatment results in longer-lasting behavioral control than providing immediate interference treatment has important applied implications (see Johnson et al. 2010). Our observation that the O-I interval had similar effects in extinction and LI suggests that increasing the O-I interval does not reduce spontaneous recovery solely due to entering exposure treatment under low levels of fear. Furthermore, the observation that the O-I interval had similar effects in the counterconditioning preparation suggests that heightened spontaneous recovery after short O-I interval does not result solely from nonassociative processes (e.g., habituation) because an association was trained during the X-Sucrose pairings. These data are consistent with our view that the test context preferentially activated the more recently acquired information in the delayed condition, but this preferential activation was not observed in the immediate condition.
Acknowledgments
Support for this work is from National Institute of Mental Health grant R15 81269 to M.E. We thank Justin S. Johnson for assistance with data collection and manuscript preparation. We also thank Gregory Arnsdorff, Jessica Angel, and Daniel Krenn for their assistance with data collection.
Footnotes
[Supplemental material is available for this article.]
References
- Aguado L, Symonds M, Hall G 1994. Interval between preexposure and test determines the magnitude of latent inhibition: Implications for an interference account. Anim Learn Behav 22: 188–194 [Google Scholar]
- Annau Z, Kamin LJ 1961. The conditioned emotional response as a function of intensity of the US. J Comp Physiol Psychol 54: 428–432 [DOI] [PubMed] [Google Scholar]
- Archbold GEB, Bouton ME, Nader K 2010. Evidence for the persistence of contextual fear memories following immediate extinction. Eur J Neurosci 31: 1303–1311 [DOI] [PubMed] [Google Scholar]
- Bouton ME 1988. Context and ambiguity in the extinction of emotional learning: Implications for exposure therapy. Behav Res Ther 26: 137–149 [DOI] [PubMed] [Google Scholar]
- Bouton ME 1993. Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychol Bull 114: 80–99 [DOI] [PubMed] [Google Scholar]
- Chang C-H, Maren S 2009. Early extinction after fear conditioning yields a context-independent and short-term suppression of conditioned freezing in rats. Learn Mem 16: 62–68 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Devenport LD 1998. Spontaneous recovery without interference: Why remembering is adaptive. Anim Learn Behav 26: 172–181 [Google Scholar]
- Escobar M, Matute H, Miller RR 2011. Cues trained apart compete for behavioral control in rats: Convergence with the associative interference literature. J Exp Psychol Gen 130: 97–115 [DOI] [PubMed] [Google Scholar]
- Escobar M, Arcediano F, Platt TL, Miller RR 2004. Interference and time: A brief review and an integration. Rev Neurosci 15: 415–438 [DOI] [PubMed] [Google Scholar]
- Huff NC, Hernandez JA, Blanding NQ, LaBar KS 2009. Delayed extinction attenuates conditioned fear renewal and spontaneous recovery in humans. Behav Neurosci 123: 834–843 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johnson JS, Escobar M, Kimble WL 2010. Long-term maintenance of immediate or delayed extinction is determined by the extinction-test interval. Learn Mem 17: 639–644 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Killcross AS, Kiernan MJ, Dwyer D, Westbrook RF 1998. Effects of retention interval on latent inhibition and perceptual learning. Q J Exp Psychol 51B: 59–74 [DOI] [PubMed] [Google Scholar]
- Lubow RE, Moore AU 1959. Latent inhibition: The effect of nonreinforced pre-exposure to the conditional stimulus. J Comp Physiol Psychol 52: 415–419 [DOI] [PubMed] [Google Scholar]
- Maren S, Chang C-H 2006. Recent fear is resistant to extinction. Proc Natl Acad Sci 103: 18020–18025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller RR, Escobar M 2002. Associative interference between cues and between outcomes presented together and presented apart: An integration. Behav Process 57: 163–185 [DOI] [PubMed] [Google Scholar]
- Morris RW, Furlong TM, Westbrook RF 2005. Recent exposure to a dangerous context impairs extinction and reinstates lost fear reactions. J Exp Psychol Anim Behav Process 31: 40–55 [DOI] [PubMed] [Google Scholar]
- Myers KM, Ressler KJ, Davis M 2006. Different mechanisms of fear extinction dependent on length of time since fear acquisition. Learn Mem 13: 216–223 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Norrholm SD, Vervliet B, Jovanovic T, Boshoven W, Myers KM, Davis M, Rothbaum B, Duncan EJ 2008. Timing of extinction relative to acquisition: A parametric analysis of fear extinction in humans. Behav Neurosci 122: 1016–1030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pavlov IP 1927. Conditioned reflexes. Oxford University Press, London, England [Google Scholar]
- Pineño O, Ortega N, Matute H 2000. The relative activation of the associations modulates interference between elementally trained cues. Learn Motiv 31: 128–152 [Google Scholar]
- Rescorla RA 2004a. Spontaneous recovery. Learn Mem 11: 501–509 [DOI] [PubMed] [Google Scholar]
- Rescorla RA 2004b. Spontaneous recovery varies inversely with the training-extinction interval. Learn Behav 32: 401–408 [DOI] [PubMed] [Google Scholar]
- Schiller D, Cain CK, Curley NG, Schwartz JS, Stern SA, LeDoux JE, Phelps EA 2008. Evidence for recovery of fear following immediate extinction in rats and humans. Learn Mem 15: 394–402 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sherrington CS 1947. The integrative action of the central nervous system. Cambridge University Press, Cambridge, UK [Google Scholar]
- Woods AM, Bouton ME 2008. Immediate extinction causes a less durable loss of performance than delayed extinction following either fear or appetitive conditioning. Learn Mem 15: 909–920 [DOI] [PMC free article] [PubMed] [Google Scholar]