Abstract
Painful events shape future behaviour in two ways: stimuli associated with pain onset subsequently support learned avoidance (i.e. punishment-learning) because they signal future, upcoming pain. Stimuli associated with pain offset in turn signal relief and later on support learned approach (i.e. relief-learning). The relative strengths of such punishment- and relief-learning can be crucial for the adaptive organization of behaviour in the aftermath of painful events. Using Drosophila, we compare punishment- and relief-memories in terms of their temporal decay and sensitivity to retrograde amnesia. During the first 75 min following training, relief-memory is stable, whereas punishment-memory decays to half of the initial score. By 24 h after training, however, relief-memory is lost, whereas a third of punishment-memory scores still remain. In accordance with such rapid temporal decay from 75 min on, retrograde amnesia erases relief-memory but leaves a half of punishment-memory scores intact. These findings suggest differential mechanistic bases for punishment- and relief-memory, thus offering possibilities for separately interfering with either of them.
Keywords: Drosophila melanogaster, memory stability, punishment-learning, relief-learning, retrograde amnesia, reinforcement
1. Introduction
A painful event has two sides: A ‘negative’ aspect at its onset and a ‘positive’ aspect at its offset, at the moment of relief [1]. Flies, for example, avoid an odour once it has been associated with the onset of an electric shock (odour → shock; henceforth called punishment-learning); yet they approach an odour once it has been associated with shock offset (shock → odour; henceforth called relief-learning; [2,3]). Similar Janus-headed results are found in rats and man: visual cues associated with shock onset potentiate startle, whereas cues associated with shock offset attenuate startle [4,5]. Thus, if embedded into a natural string of events, the net effect of such an adverse life event may depend on the relative strengths of oppositely valenced memories related to its onset (punishment-memory) and its offset (relief-memory). Here, we compare the time course of decay, as well as the susceptibility to post-training cold-amnesia, between these two kinds of memory. The differences we find in both these parameters suggest a dissociation of the mechanisms underlying punishment- and relief-memories.
2. Material and methods
Training and testing followed standard methods with the modifications described in detail in Yarali et al. [3] and electronic supplementary material, figure S1. Please note that these modifications, necessary to reveal relief-memory, make the procedure about sixfold more laborious than the standard protocol: a cohort of 100–150 wild-type Canton-S flies was differentially trained such that odour X was paired with electric shock, while odour Y was not. Then, the flies were offered the choice between both odours in a T-maze and the flies in either arm of the maze were counted. A preference index (Pref) was calculated as (all Pref values are documented in the electronic supplementary material, figures S2 and S3):
The assignment of benzaldehyde (BA) and 3-octanol (OCT) as X and Y was balanced across experiments, which allowed calculation of an associative learning index (LI) as:
Negative LIs therefore indicate conditioned avoidance, whereas positive LIs indicate conditioned approach. Importantly, for punishment-training, odour X was presented before shock onset, whereas for relief-training it was presented upon shock offset; six training trials were concatenated in both cases (for details, see the electronic supplementary material, figure S1).
(a). Memory decay
This experiment used a 2 × 5 experimental design (figure 1a), such that flies underwent either punishment- or relief-training, and were then tested after retention periods of 25, 50, 75,240 min, or 24 h. During the retention period and in the intervals between training trials, flies were kept in their regular food vials. These vials either remained within the experimental room yet outside the conditioning apparatus (50, 75 and 240 min retention periods) or were transferred overnight to the culture facility (24 h retention period).
(b). Resistance to cold-amnesia
This experiment used a 2 × 2 experimental design (figure 2a), such that flies underwent either punishment- or relief-training, and then either did or did not receive cold-amnesia at 60 min after training. Testing then took place 60 min later, i.e. at 120 min after training. Cold-amnesia was implemented by transferring flies into ice-cold plastic vials and then keeping them on ice for 2 min before transferring them back to regular food vials.
(c). Statistics
Non-parametric statistics were used throughout. Kruskal–Wallis (KW) tests and Mann–Whitney U (MWU) tests were used to compare LI values between multiple and two groups of flies, respectively. One-sample sign tests (OSS) were used to determine whether scores of a given group were significantly different from zero. Throughout, a significance level of p < 0.05 was adopted. For multiple comparisons within a dataset, critical p-levels were adjusted by a Bonferroni correction (p < 0.05 divided by the number of comparisons) to maintain the experiment-wide error rate at 5 per cent. Data are plotted as box plots, representing the median as the middle line, the 25 and 75 per cent quantiles as boundaries of the box and the 10 and 90 per cent quantiles as whiskers.
3. Results
(a). Memory decay
In terms of absolute learning scores (figure 1b), punishment-memory is obviously much stronger than relief-memory, as has been reported previously [2,3]. For the current context, it is important that punishment-memory scores decay as the retention period lengthens (KW: p < 0.05, N = 20 in all cases, d.f. = 4, H = 36.69; MWU comparing later retention periods to the earliest one (25 min): p < 0.05/4 in all cases, U = 97.00, 57.00, 62.00, 12.00). In fact, within 75 min punishment-memory has decayed to approximately 50 per cent of the initial score. Critically, however, punishment-memory remains detectable for at least 24 h (OSS for each retention period: p < 0.05/5 in all cases).
Relief-memory scores also change with lengthening of the retention period (KW: p < 0.05; N = 51, 35, 46, 43, 40; d.f. = 4, H = 13.82), but in a different way from punishment-memory scores. That is, compared with the shortest retention interval of 25 min, relief-memory remains stable during at least the first 240 min (MWU: p > 0.05/4 in all cases, U = 839.00, 1161.00, 833.00; mind the tendencial difference for the 240 min retention period). At 24 h after training, however, relief-memory scores have decayed significantly (MWU: p < 0.05/4; U = 634.5). Fittingly, relief-learning memory scores are significantly positive only for retention periods of up to 75 min (OSS: p < 0.05/5 in all cases except for 240 min, where p = 0.014 and 24 h, where p = 0.4).
(b). Resistance to cold-amnesia
Despite decaying more slowly than punishment-memory within the first 240 min after training (figure 1), relief-memory seems more sensitive to retrograde amnesia. Implementing cold-amnesia 60 min after training eliminates the relief-memory scores measured another 60 min later, i.e. after a 120 min retention period (figure 2; MWU comparing the cold-anaesthesia group to control: p < 0.05, U = 41.00, N = 14, 14; OSS: p < 0.05/2 for the control group but p = 0.79 for the cold-amnesia group). The same treatment reduces punishment-memory scores only to about half (MWU: p < 0.05, U = 54.00, N = 14, 14; OSS: p < 0.05/2 for each group).
4. Discussion
We provide the first systematic comparison of the temporal dynamics of punishment- versus relief-memory. Over the first 4 h following training, relief-memory decays much slower than punishment-memory (figure 1b). This slow decay is reminiscent of the slow initial decay rate of sugar reward-memory [6–8]. With respect to longer retention periods, however, relief-memory differs from both punishment- and reward-memories: multiple, temporally spaced training trials result in detectable punishment-memory beyond 24 h [9,10], whereas for such long-term reward-memory, a single training trial suffices [8,11]. For relief-learning, despite using multiple, spaced training trials, we find no appreciable memory scores at 24 h (figure 1b). Thus, the temporal pattern of decay for relief-memories differs from both punishment- and reward-memories.
Regarding cold-amnesia, both punishment- and reward-memories are only partially susceptible within the first 2 h following training [6–10,12–14]. That is, cold-amnesia typically spares a so-called amnesia-resistant component of reward- and of punishment-memory. Indeed, we confirm that punishment-memory 1 h after training is composed of an amnesia-sensitive component and an amnesia-resistant component (figure 2). Critically, however, cold-amnesia abolishes relief-memory completely (figure 2). Given that for punishment-memory, anaesthesia-sensitive versus -resistant components of memory seem to have partially different genetic requirements (for proper function of e.g. the amnesiac and radish [12], rutabaga [10], synapsin [13] and bruchpilot [14] genes), it would be interesting to look for roles of these genes in relief-learning.
If, within a single subject, the events before and after a traumatic episode were to induce punishment- and relief-memory, our finding that both these forms of memory differ in strength and susceptibility to retrograde amnesia may be of practical importance: while trying to erase punishment-memory, one may unwittingly also erase relief-memory. Dependent on the relative strength of these memories and the relative effectiveness of the treatment, the net effect of such manipulation may make the overall-mnemonic effect of the traumatic episode even more adverse.
References
- 1.Solomon RL, Corbit JD. 1974. An opponent-process theory of motivation. I. Temporal dynamics of affect. Psychol. Rev. 81, 119–145 10.1037/h0036128 (doi:10.1037/h0036128) [DOI] [PubMed] [Google Scholar]
- 2.Tanimoto H, Heisenberg M, Gerber B. 2004. Event timing turns punishment to reward. Nature 430, 983. 10.1038/430983a (doi:10.1038/430983a) [DOI] [PubMed] [Google Scholar]
- 3.Yarali A, Niewalda T, Chen Y, Tanimoto H, Duerrnagel S, Gerber B. 2008. Pain relief-learning in fruit flies. Anim. Behav. 76, 1173–1185 10.1016/j.anbehav.2008.05.025 (doi:10.1016/j.anbehav.2008.05.025) [DOI] [Google Scholar]
- 4.Andreatta M, Mühlberger A, Yarali A, Gerber B, Pauli P. 2010. A rift between implicit and explicit conditioned valence in human pain relief-learning. Proc. R. Soc. B 277, 2411–2416 10.1098/rspb.2010.0103 (doi:10.1098/rspb.2010.0103) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Andreatta M, Fendt M, Mühlberger A, Wieser MJ, Imobersteg S, Yarali A, Gerber B, Pauli P. 2012. Onset and offset of aversive events establish distinct memories requiring fear- and reward networks. Learn. Mem. 19, 518–526 10.1101/lm.026864.112 (doi:10.1101/lm.026864.112) [DOI] [PubMed] [Google Scholar]
- 6.Tempel B, Bonini N, Dawson DR, Quinn WG. 1983. Reward learning in normal and mutant Drosophila. Proc. Natl Acad. Sci. USA 80, 1482–1486 10.1073/pnas.80.5.1482 (doi:10.1073/pnas.80.5.1482) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Schwaerzel M, Jaeckel A, Mueller U. 2007. Signaling at A-kinase anchoring proteins organizes anesthesia-sensitive memory in Drosophila. J. Neurosci. 27, 1229–1233 10.1523/JNEUROSCI.4622-06.2007 (doi:10.1523/JNEUROSCI.4622-06.2007) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Krashes MJ, Waddell S. 2008. Rapid consolidation to a radish and protein synthesis-dependent long-term memory after single-session appetitive olfactory conditioning in Drosophila. J. Neurosci. 28, 3103–3113 10.1523/JNEUROSCI.5333-07.2008 (doi:10.1523/JNEUROSCI.5333-07.2008) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tully T, Preat T, Boynton SC, Del Vecchio M. 1994. Genetic dissection of consolidated memory in Drosophila. Cell 79, 35–47 10.1016/0092-8674(94)90398-0 (doi:10.1016/0092-8674(94)90398-0) [DOI] [PubMed] [Google Scholar]
- 10.Isabel G, Pascual A, Preat T. 2004. Exclusive consolidated memory phases in Drosophila. Science 304, 1024–1027 10.1126/science.1094932 (doi:10.1126/science.1094932) [DOI] [PubMed] [Google Scholar]
- 11.Colomb J, Kaiser L, Chabaud MA, Preat T. 2009. Parametric and genetic analysis of Drosophila appetitive long-term memory and sugar motivation. Genes Brain Behav. 8, 407–415 10.1111/j.1601-183X.2009.00482.x (doi:10.1111/j.1601-183X.2009.00482.x) [DOI] [PubMed] [Google Scholar]
- 12.Folkers E, Waddell S, Quinn WG. 2006. The Drosophila radish gene encodes for a protein necessary for anesthesia-resistant memory. Proc. Natl Acad. Sci. USA 103, 17496–17500 10.1073/pnas.0608377103 (doi:10.1073/pnas.0608377103) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Knapek S, Gerber B, Tanimoto H. 2010. Synapsin is selectively required for anesthesia-sensitive memory. Learn. Mem. 17, 76–79 10.1101/lm.1661810 (doi:10.1101/lm.1661810) [DOI] [PubMed] [Google Scholar]
- 14.Knapek S, Sigrist S, Tanimoto H. 2011. Bruchpilot, a synaptic zone protein for anesthesia-resistant memory. J. Neurosci. 31, 3453–3458 10.1523/JNEUROSCI.2585-10.2011 (doi:10.1523/JNEUROSCI.2585-10.2011) [DOI] [PMC free article] [PubMed] [Google Scholar]