Abstract
Relief from pain is positively valenced and entails reward-like properties. Notably, stimuli that became associated with pain relief elicit reward-like implicit responses too, but are explicitly evaluated by humans as aversive. Since the unpredictability of pain makes pain more aversive, this study examined the hypotheses that the predictability of pain also modulates the valence of relief-associated stimuli. In two studies, we presented one conditioned stimulus (FORWARDCS+) before a painful unconditioned stimulus (US), another stimulus (BACKWARDCS+) after the painful US, and a third stimulus (CS−) was never associated with the US. In Study 1, FORWARDCS+ predicted half of the USs while the other half was delivered unwarned and followed by BACKWARDCS+. In Study 2, all USs were predicted by FORWARDCS+ and followed by BACKWARDCS+. In Study 1 both FORWARDCS+ and BACKWARDCS+ were rated as negatively valenced and high arousing after conditioning, while BACKWARDCS+ in Study 2 acquired positive valence and low arousal. Startle amplitude was significantly attenuated to BACKWARDCS+ compared to FORWARDCS+ in Study 2, but did not differ among CSs in Study 1. In summary, predictability of aversive events reverses the explicit valence of a relief-associated stimulus.
Keywords: backward conditioning, forward conditioning, implicit and explicit responses, pain relief, threat unpredictability
Introduction
Reliable predictions of painful or threatening events modulate the perception of such events. Namely, both humans and mice respond to an aversive auditory stimulus with greater amygdala activation when such stimulus was presented unpredictably than when it was predictable (Herry et al., 2007). Moreover, human participants rate a painful stimulus more intense and more negative when they cannot reliably predict its delivery by means of a visual cue (Carlsson et al., 2006). In the same vein, a context in which a painful electric shock was unpredictably delivered induced higher anxiety level and potentiated startle response compared to a context where the same shock was predictable (Fonteyne et al., 2010). Since the startle response is an ancestral defensive reflex, the amplitude of which is modulated by the emotional state of an individual (Lang, 1995), it can be considered as an implicit biopsychological measure of the individual's emotional state. Thus, threatening situations prime defensive responses and cause potentiation of startle amplitude, while appetitive situations cause startle amplitude attenuation (Fendt and Fanselow, 1999; Koch, 1999). Hence, these findings suggest that the simple unpredictability of an aversive event increases the experienced aversiveness as indicated by explicit and implicit measures.
The present study moved one step further to examine if and how the unpredictability of an aversive event affects the relief experienced after its offset. According to previous findings, pain relief is appetitive and organisms react with reward-like responses to stimuli associated with it. Namely, humans show reward-like brain activations (e.g., ventral striatum) to a stimulus temporally contiguous to the decrease (Seymour et al., 2005) or the omission (Leknes et al., 2011) of a painful stimulation. Moreover, conditioned responses to a relief-associated stimulus are similar to those to a reward-associated stimulus. That is, appetitive events or stimuli predicting these events induce attenuation of the startle response (Schneider and Spanagel, 2008), or activation of the ventral striatum (Gottfried et al., 2002). Comparably, fruit flies avoid an odor (conditioned stimulus, CS) which was repeatedly presented before a painful unconditioned stimulus (US; forward conditioning or fear conditioning) but approach an odor which repeatedly followed a painful US (backward conditioning or pain relief conditioning; Tanimoto et al., 2004; Yarali et al., 2008). In the same vein, rats show after the injury of the muscle of a paw conditioned place preference (CPP) for the chamber in which the pain was alleviated by a local anesthesia (Navratilova et al., 2012). Finally, rats and humans respond with startle attenuation to a stimulus associated with pain offset, and such relief-associated stimulus activate striatal regions (Andreatta et al., 2010, 2012). Therefore, the relief reaction which follows a painful stimulation seems to entail appetitive properties.
These results support the opponent-process theory of Solomon (1980) and the relaxation theory of Denny (1971) which assert that aversive or painful events are initially characterized by a negative emotional state determined by the aversiveness of the pain itself. However, as soon as such aversive stimulation terminates, individuals feel an emotional state which entails opponent, namely appetitive properties. In line, the pleasantness of pain relief is linearly correlated with the aversiveness of the preceding painful stimulation that is the more the pain intensity is increased the more positive the following relief is experienced (Leknes et al., 2008). Considering the etiology of anxiety disorders (Mineka and Zinbarg, 2006), avoidance behavior is frequently considered to be maintained by negative reinforcement due to the relief following such behaviors (Kim et al., 2006). Besides such operant conditioning, classical conditioning may play an important role too since stimuli associated with the relief very likely guide behaviors (i.e., safety behavior). In any case, it is of crucial importance to unravel the impact of relief on conditioned responses and behaviors because this may in the long run allow improving therapeutic intervention of anxiety disorders.
Despite the appetitive physiological and neural responses, humans may value a stimulus associated with relief as negatively valenced and high arousing. We found that the verbal and explicit ratings of the participants dissociated from the physiological/neural and implicit responses (Andreatta et al., 2010, 2012). This dissociation can be understood on the basis of psychological theories which posit two systems: an impulsive and a reflective system, which can work in a synergic or antagonist fashion (Strack and Deutsch, 2004). The impulsive system generates behaviors on the basis of automatic processes influenced by simple associative learning mechanisms, while the reflective system generates behaviors on the basis of explicit knowledge about the situation. It is then presumable that the physiological and neural responses to a relief-associated CS are mediated by the impulsive system, but the ratings by the reflective system, which seems to consider the temporal contiguity of the US more important than the ongoing appetitive reaction. Supportively, human participants in our previous studies reported the stimulus presented upon pain termination—that is at the moment of relief—as being temporally linked to the painful US (Andreatta et al., 2010, 2012).
Because pain aversiveness is modulated by its predictability and because appetitive properties of pain relief depend on pain aversiveness, we assume that the predictability of pain modulates the following relief as well. In line with our previous studies (Andreatta et al., 2010, 2012), we hypothesize that participants show attenuated startle amplitude (i.e., reward-like responses) to a relief-associated stimulus. We further hypothesize that startle amplitude would be more attenuated for stimuli associated with the offset of unpredictable vs. predictable painful USs. Moreover, we expect a dissociation between physiological and verbal responses to a stimulus associated with the offset of an US which is delivered unpredictably as in our previous between-subjects designed studies; that is negative valence and high arousal ratings (Andreatta et al., 2010, 2012). On the contrary, we expect positive ratings of the relief-associated CS when it follows a predictable US, because in this case participants would not explicitly associate the relief-associated CS with the painful US. In order to investigate these hypotheses, we conducted two studies in which we presented one stimulus as signal for pain onset (FORWARDCS+) and another stimulus upon the moment of the relief (i.e., after pain offset, BACKWARDCS+). In the first study, participant could predict only half of the painful USs, whereas the other half was delivered unwarned. In the second study, participants could reliably predict all painful USs. In both studies, we measured startle responses and skin conductance response (SCR) to conditioned visual stimuli as indices of implicit and physiological learning. In addition, we collected verbal reports for the valence and the arousal of the visual stimuli as indices of explicit and cognitive learning.
Study 1
In Study 1 we investigated whether the unpredictability of a painful event (US) would induce reward-like physiological responses but negative reports. In other words, we wanted to replicate the results of our previous between-subjects study (Andreatta et al., 2010) in a within-subjects study. To this purpose, each participants experienced sixteen USs which were presented predictably at the offset of one visual stimulus (FORWARDCS+) and 16 USs which were delivered unpredictably shortly before another visual stimulus (during relief, BACKWARDCS+).
Materials and methods
Participants
Forty-one volunteers participated in the study and were recruited through media advertisements. For their participations, individuals received 14€. Eleven participants were excluded from the analysis. Three participants were excluded because they lost the electrodes for the electric shock (US) during the experiment and one because of technical problems. Seven additional participants were excluded from the analysis, one because interrupted the experiment, three because they were coded as non-responders (mean startle amplitude <5 μV) and three because they did not have enough startle responses per condition (minimum = 4; for details see Materials and Methods). At the end, we considered 30 participants for the analysis (16 males; mean age: 25.33 years, SD = 3.18; range = 20–33 years).
Stimulus material
The aversive US consisted of a mild painful electric shock (200 ms duration). The shock was an electric pulse delivered with a frequency of 50 Hz. The intensity of the shock was individually assessed with a threshold procedure consisting of two ascending and descending series of electric shocks in steps of 0.5 mA (for details see Andreatta et al., 2010). The electric shock was generated by a current stimulator (Digitimer DS7A, Digitimer Ltd, Welwyn Garden City, UK, 400 V, maximum of 9.99 mA) and delivered by two disk electrodes with 9 mm diameter and spacing 30 mm over the forearm of the dominant hand. Participants rated the subjective painfulness of the US by means of a scale ranging from 0 (“feeling nothing at all”) to 10 (“very intense pain”) with 4 as an anchor for “just noticeable pain.” The mean value of painful intensities was then increased by 1 mA. The mean intensity of the US was 2.32 mA (SD = 0.64) while the subjective intensity was 6.30 (SD = 1.51).
As visual conditioned stimuli (CS) we used yellow geometrical shapes presented for 8 s on a 19″ computer screen localized circa 80 cm in front of the participants at the eye level over a black background. Shapes were a square, a triangle, a circle and a hexagon with 7.8 cm width and 7.8 cm height. The inter-stimulus interval (ISI), defined as the time between CS onset and US onset was as follows: the US was delivered either at the offset of one shape (FORWARDCS+; ISI = 8 s) or 6 s before the onset of another shape (BACKWARDCS+; ISI = −6 s). During the conditioning phase, three shapes were presented: FORWARDCS+, BACKWARDCS+ and a third shape (CS−), which was never associated with the US. During the test phase, four shapes were presented: FORWARDCS+, BACKWARDCS+, CS−, and a novel shape (NEW) as control stimulus. Shapes were counterbalanced across participants.
The startle probe was a burst of white noise of 98 dB with duration of 50 ms. The acoustic stimuli were presented binaurally over headphones and occurred randomly 3–7 s after shape's onset.
Two questionnaires were used as indicators for anxiety traits and the actual emotional state of the participants. The German version of the State-Trait Anxiety Inventory (STAI, Laux et al., 1981) is an inventory to assess the trait and/or the state anxiety of the participants. Both the trait and the state version consist of 20 items, respectively. Participants had to rate on a 4-point Likert scale from 1 (“almost never”) until 4 (“almost always”) how much the item would describe their anxiety. Higher scores indicate greater anxiety. Participants' anxiety level before and after the experiment did not change significantly [35.4 ± 4.8 vs. 35.7 ± 4.6; t(29) = 0.31, p = 0.758]. Trait anxiety scores in the current sample ranged between 20 and 58 (mean = 36.7, SD = 8.64), which is comparable to the published normal range of adults (Laux et al., 1981). The Positive and Negative Affect Schedule (PANAS; Krohne et al., 1996) is a questionnaire to asses participants' mood. High scores on the PA scale reflect positive affectivity and individuals are disposed to emotions such as enthusiasm. While high scores on the NA scale represent negative affectivity and individuals are disposed to emotions such as distress. Participant had to indicate to what extend he/she feels a particular emotion on a scale ranging from 1 (“very slightly”) to 5 (“extremely”). Participants negative affect did not change throughout the experiment significantly [13.07 ± 5.4 vs. 11.60 ± 2.6; t(29) = 1.56, p = 0.129], but they reported less positive mood at the end of the experiment in comparison to the beginning [28.9 ± 4.7 vs. 24.97 ± 5.3; t(29) = 4.42, p < 0.001]. Such decrease of participant's positive mood might have depended on the unpleasantness of the paradigm (painful electric shock as well as an aversive white noise were presented).
Procedure
Upon the arrival in the laboratory, participants read and signed an informed consent approved by the ethics committee of the Deutsche Gesellschaft für Psychologie (DGPs), in which they were informed that a series of geometrical shapes, an electric shock and loud noises will have been presented and that they should keep the shapes in their visual focus. We did not mention the contingency between CSs and US. After having filled in the questionnaires, the electrodes were attached and the pain threshold procedure was performed as described above.
The experiment consisted of two phases: The conditioning and the test phase separated by subjective ratings. During the conditioning phase (Figure 1A) participants saw three out of four geometrical shapes 16 times each. Altogether, there were 48 trials, 16 CS− trials, 16 FORWARDCS+ trials, and 16 BACKWARDCS+ trials. The inter-trial interval (ITI) defined as the time between stimulus offset and the subsequent stimulus onset varied between 20 and 30 s (mean = 25 s). The choice of this relatively long ITI was made in accordance with our previous study (Andreatta et al., 2010) as well as to avoid carry-over effects from one trial to the following one. Stimulus presentation was randomized with the only restriction that the same stimulus may not be presented more than twice in a row. No startle probe was presented during conditioning.
Before the test phase, 7 white noises were delivered every 7–15 s in order to decrease the initial startle reactivity. During the test phase participants saw four geometrical shapes, that were the three CSs (FORWARDCS+, BACKWARDCS+, and CS−) and a novel neutral shape (NEW) as control stimulus. No US was delivered during the test phase. Each stimulus was presented 16 times in a pseudorandom order (i.e., the same stimulus was not presented more than twice consequently), so altogether there were 64 trials. During the test phase, for 8 of the 16 stimulus presentations a startle probe was delivered between 3 and 7.5 s after stimulus onset in order to provoke the automatic defensive reflex. As in the conditioning phase, the ITIs varied between 20 and 30 s. In order to assure the unpredictability of the startle probes we additionally delivered 8 startling noises during the ITIs.
Before and after the conditioning phase as well as after the test phase, participants had to rate the valence (pleasantness) and the arousal (excitatory) of the visual stimuli by using two different visual analog scales (VAS) ranging from 1 until 9. One indicates “very unpleasant” for the valence and “calm” for the arousal, while 9 indicates “very pleasant” and “exciting,” respectively. In addition, after the conditioning phase we verified participants' contingency awareness with a VAS ranging from 0 (no association) until 100 (perfect association). The contingency awareness indicates participant's ability to verbally report the association between the FORWARDCS+, BACKWARDCS+ or CS−, and the US.
Physiological recording and data reduction
Physiological responses were recorded with a V-Amp 16 amplifier and Vision Recorder V-Amp Edition Software (Version 1.03.0004, BrainProducts Inc., Munich, Germany). A sampling rate of 1000 Hz and a 50 Hz notch filter were applied. The offline analyses of these responses were conducted with Brain Vision Analyzer (Version 2.0; BrainProducts Inc., Munich, Germany).
Startle response was measured by means of electromyography (EMG) at the left orbicularis oculi muscle with two 5 mm Ag/AgCl electrodes. According to the guidelines (Blumenthal et al., 2005), one electrode was positioned under the pupil and the second one 1 cm laterally. The ground and the reference electrodes were placed on the right and left mastoids respectively. Before attaching the electrodes, the skin was slightly abraded and cleaned with alcohol in order to keep the impedance below 8 kΩ. EMG activity was continuously recorded. The electromygraphic signal was offline filtered with a 28 Hz low cutoff filter and a 500 Hz high cutoff filter as well as with a 50 Hz notch filter. Then the EMG signal was rectified and a moving average of 50 ms was applied. As baseline we used the 50 ms before startle probe onset (Grillon et al., 2006). Responses to startle probes were scored manually, and trial with excessive baseline shifts (±5 μV) or movement artifacts were excluded from further analysis. Altogether, 19.1% of the trials were rejected, and a minimum of 4 out of 8 startle responses for each condition was required to keep the participant for further analysis. The peak amplitude was defined as the maximum peak relative to baseline during the 20–120 ms time window after startle probe onset. The raw data were then normalized within-subjects using z-scores in order to reduce the influence of the individual variability and to better detect the psychological processes. The z-scores were averaged for each condition (FORWARDCS+, BACKWARDCS+, CS−, NEW, and ITI). In order to investigate startle potentiation or startle attenuation, the scores for the ITI startle responses were subtracted from the startle responses of each condition.
SCR was recorded using two 5 mm Ag/AgCl electrodes placed on the palm of the no-dominant hand. SCR was continuously recorded with the same V-Amp system, which delivered a constant current of 0.5 V. Sampling rate was 1000 Hz. The galvanic response was offline filtered with 1 Hz high cutoff filter. The SCR was defined as difference (in μS) between the response onset (1–3 s after shape onset) and the response peak (Tranel and Damasio, 1994; Delgado et al., 2011). Trials containing startle probes were not considered for the analysis of the SCR. Responses below 0.02 μS were coded as zero. For SCR analysis of the conditioning phase, two further participants were excluded and for the SCR analysis during the test phase we excluded 10 further participants because they had no detectable SCR (non-responses) in each condition. The skin raw conductance data were then square root transformed in order to normalize the distribution and the scores were averaged for each condition separately for the conditioning (FORWARDCS+, BACKWARDCS+, CS−) and the test phase (FORWARDCS+, BACKWARDCS+, CS−, and NEW).
Data analysis
All data were analyzed with SPSS for Windows (Version 20.0, SPSS Inc.). Startle amplitude, valence, arousal and contingency ratings were separately analyzed with multivariate analysis of variance (MANOVA). For all dependent variables MANOVAs had as within-subjects factor stimulus (FORWARDCS+, BACKWARDCS+, CS−, and NEW). The SCR was separately analyzed for the conditioning (FORWARDCS+, BACKWARDCS+, and CS−) and the test phase (FORWARDCS+, BACKWARDCS+, CS−, and NEW) having stimulus as within-subjects factor. In the analysis for the valence and the arousal ratings, the within-subjects factor phase was added (T1: before conditioning, T2: after conditioning, T3: after test phase), as well as for the contingency ratings (T1: after conditioning, T2: after test phase). The alpha (α) level was set at 0.05 for all analyses. The effect size is reported as partial η2.
Results
Valence ratings (Figure 2A, left panel)
The valence of the four CSs was differentially affected by conditioning as confirmed by the significant Stimulus × Phase interaction [F(6, 23) = 2.77, p = 0.035, η2p = 0.42]. According to follow up t-tests, the valence of the four geometrical shapes did not differ before conditioning (all ps > 0.42) and were rated as neutral (i.e., 5; all ps > 0.40). After conditioning, the FORWARDCS+ and the BACKWARDCS+ had comparable valence [t(28) = 0.56, p = 0.579] which was significantly more negative than the valence of both the CS− [FORWARDCS+: t(28) = 3.48, p = 0.002; BACKWARDCS+: t(28) = 2.73, p = 0.011] and the NEW [FORWARDCS+: t(28) = 3.08, p = 0.005; BACKWARDCS+: t(28) = 2.38, p = 0.024]. Valence ratings between the CS− and the NEW did not differ [t(28) = 1.65, p = 0.110]. After the test phase, the FORWARDCS+ valence [t(28) = 1.86, p = 0.073] and the BACKWARDCS+ valence [t(28) = 2.00, p = 0.055] remained slightly more negative than the CS− valence although these comparisons just failed to reach the significance level. The valence ratings for the NEW did not differ from the other stimuli (all ps > 0.26) and the valence of the FORWARDCS+ did not differ from the BACKWARDCS+ [t(28) = 0.44, p = 0.663]. In summary, both the FORWARDCS+ and the BACKWARDCS+ acquired negative explicit valence after conditioning.
Arousal ratings (Figure 2B, left panel)
The arousal of the four CSs was differentially modulated by conditioning as the significant Stimulus × Phase interaction indicates [F(6, 23) = 2.51, p = 0.051, η2p = 0.40]. Follow-up t-tests revealed equal arousal ratings among the geometrical shapes (all ps > 0.26) before conditioning. After conditioning, the FORWARDCS+ [t(28) = 1.98, p = 0.058], the BACKWARDCS+ [t(28) = 1.97, p = 0.059], but not the NEW [t(28) = 1.90, p = 0.098] were slightly rated more arousing than the CS−, although these tests just failed to reach the significance level. Moreover, the FORWARDCS+, the BACKWARDCS+, and the NEW did not differ regarding arousal ratings (all ps > 0.44). After the test phase, the FORWARDCS+ [t(28) = 2.30, p = 0.029] and the BACKWARDCS [t(28) = 2.39, p = 0.024] were rated more arousing than the CS−, but not to the NEW [t(28) = 0.94, p = 0.354]. Notably, arousal ratings of the FORWARDCS+ did not differ significantly from those of the BACKWARDCS+ [t(28) = 0.27, p = 0.787] and the NEW [t(28) = 1.55, p = 0.133] after the test phase, and the BACKWARDCS+ was rated with higher arousal compared to the NEW [t(28) = 2.20, p = 0.036]. In summary, the FORWARDCS+ and the BACKWARDCS+ were rated as high arousing stimuli after conditioning, and such ratings lasted until the end of the experiment.
Startle response (Figure 3A)
Analysis of the startle response revealed no significant main effect of stimulus [F(3, 27) = 0.23, p = 0.875, η2p = 0.03] indicating no differential responses to the FORWARDCS+, the BACKWARDCS+, the CS−, and the NEW. We, however, compared z-scores of the startle amplitudes to the four visual stimuli with the mean (i.e., 0) and found that only the FORWARDCS+ induced a significant potentiation of the startle response [t(29) = 2.10, p = 0.044].
SCR (Figure 4A)
Analysis of the SCR revealed that the conditioning differentially affected the SCR to the CSs as reflected in the significant main effect of stimulus [F(2, 26) = 15.72, p < 0.001, η2p = 0.547]. Follow up t-tests indicated that the FORWARDCS+ elicited higher SCRs compared to the CS− [t(27) = 3.69, p = 0.001] and to the BACKWARDCS+ [t(27) = 5.71, p < 0.001]. Moreover, SCRs to the BACKWARDCS+ were significantly lower than to the CS− [t(27) = 4.21, p < 0.001]. Analysis of the SCR during the test phase indicated successful extinction learning as all stimuli elicited comparable SCRs [F(3, 17) = 0.15, p = 0.928, η2p = 0.026]. In summary, the FORWARDCS+ elicited enhanced fear responses (i.e., high SCR), whereas the BACKWARDCS+ seems to be less arousing as indicated by low SCR.
Contingency awareness (Table 1)
Table 1.
After conditioning | After test phase | |||
---|---|---|---|---|
Study 1 | Study 2 | Study 1 | Study 2 | |
FORWARDCS+ | 83.45 (24.39) | 97.14 (11.02) | 70.69 (36.83) | 84.76 (33.56) |
BACKWARDCS+ | 71.72 (31.97) | 7.62 (19.98) | 65.17 (37.57) | 8.57 (23.93) |
CS− | 20.00 (27.52) | 8.10 (18.61) | 24.14 (32.35) | 8.57 (18.24) |
Scores (standard deviation) indicate the subjective expectancy of the painful US in association with the respective shapes. Zero indicated “no association at all” and 100 “perfect association.”
Participants were aware about the contingency between the CSs and the US as indicated by a significant main effect stimulus [F(2, 27) = 24.10, p < 0.001, η2p = 0.641]. Follow up t-tests indicated that participants reported significant higher contingency ratings for the FORWARDCS+ [t(28) = 6.89, p < 0.001] and the BACKWARDCS+ [t(28) = 5.20, p < 0.001] than for the CS−. Furthermore, contingency ratings for the FORWARDCS+ and the BACKWARDCS+ did not differ [t(28) = 1.88, p = 0.071]. In summary, participants recognized the associations between the FORWARDCS+ and the BACKWARDCS+ and the US.
Discussion
The main goal of Study 1 was to investigate the modulatory role of the unpredictability of a painful electric shock (US) over relief. To this end, we presented half of the USs predictably after one visual stimulus (FORWARDCS+) while the other half was presented unwarned shortly before another visual stimulus (BACKWARDCS+). In line with our previous findings (Andreatta et al., 2010), we found that both the FORWARDCS+ and the BACKWARDCS+ compared to the CS− stimulus acquired explicit aversive properties through conditioning as indicated by negative valence and high arousal ratings (Figure 2). This acquired explicit aversiveness of both the FORWARDCS+ and the BACKWARDCS+ might be due to the cognitive knowledge that these two visual stimuli were temporally presented in association with the painful electric shock as the participants' contingency ratings indicate.
A further interesting and new result of this study is the modulation of the SCR by the CSs (Figure 4A). Namely, SCR to the BACKWARDCS+ was significantly lower compared to the FORWARDCS+ and the CS− during conditioning indicating that the relief-associated stimulus (BACKWARDCS+) was less arousing than the pain-signaling stimulus (FORWARDCS+) and even less arousing than the safety signal (CS−). These results are in line with previous human findings of low SCR during relief which also was positively correlated with the intensity ratings of the relief (Leknes et al., 2008). Notably, the physiological and the verbal responses dissociated. Namely, participants rated the BACKWARDCS+ as arousing, but they showed low SCR. Such dissociation is in line with the valence-related dissociation found in our previous studies (Andreatta et al., 2010, 2012). Thus, in the previous studies and the current study we found relief-like physiological responses (attenuation of startle amplitude and low SCR), but fear-like verbal reports (negative valence and high arousal). Apparently, the offset of unpredictable aversive stimuli is valued in an antagonist fashion by the implicit impulsive system and the explicit reflective system (Strack and Deutsch, 2004). On the one hand, the physiological responses reflect the implicit relief-reactions going on after a painful event. On the other hand, the explicit negative valuation may be imposed by the explicit knowledge that the stimulus is somehow associated with pain (see contingency rating, Dunsmoor et al., 2011). Finally, SCR did not differ among the FORWARDCS+, the BACKWARDCS+, the CS−, and the NEW during the test phase and this may be due to processes linked to extinction learning (Phelps and Ledoux, 2005).
In contrast to our previous between-subjects designed study (Andreatta et al., 2010), we did not find any difference in the participants' startle responses to the CSs (Figure 3A). Most likely, differences in the number of the painful electric shocks together with their unpredictability might have played a crucial role here. In fact, we doubled the number of shocks in the present study compared to the previous between-designed studies (32 vs. 16). According to Fanselow and Lester (1988), circa-strike defensive responses depend on the shock density as well as on their imminence. Shock density refers to the number of shocks per time; the more dense the shock schedule is (i.e., the increased number of shocks), the more the animals present circa-strike defensive response (i.e., flight/fight). The imminence refers to the real presence and the vicinity of a danger, the closer a danger is the stronger fear responses are prompted. Referring to the present study, the US preceding the BACKWARDCS+ had no warning signal, which might have provoked a feeling of sustained fear or anxiety (Barlow, 2000; Grillon et al., 2008; Davis et al., 2010; Fonteyne et al., 2010). Moreover, both the USs presented after the FORWARDCS+ and those presented before the BACKWARDCS+ may have been experienced as one single aversive event, which was sometimes predicted, but sometimes not. Therefore, the unreliable prediction of the shock might have provoked a state of uncertainty which consequently induced anxiety rather than fear. Furthermore, the anxious feeling of the individuals in this study might have been stronger than the one induced in the between-designed study because of the higher density of the shocks. Hence, we think that the conditioned responses here are induced by a post-encounter stage rather than by a circa-strike stage, in line with Fanselow (1994) and Davis et al. (2010) who assume that post-encounter behavior resembles sustained anxiety, whereas circa-strike behavior is induced by phasic fear. Thus, participants have “encountered” the threat (the US), but because of its relative predictability, such threat is not sufficiently imminent for provoking clear discriminative fear responses (e.g., potentiation of the startle response to the threat signal).
Study 2
In Study 2 we investigated the modulatory influence of a predictable pain over pain relief. For this purpose, we associated the painful electric shock (US) during all trials with both a FORWARDCS+ and a BACKWARDCS+. The FORWARDCS+ predicted all USs which were presented at its offset, and the BACKWARDCS+ followed all USs. Thus, here we never delivered an unpredictable painful US before the BACKWARDCS+, all USs were predictable by the FORWARDCS+. We expected appetitive conditioned responses to the BACKWARDCS+ as compared to the FORWARDCS+ such as attenuation of startle response and positive valence ratings. As opposed to Study 1, we did not expect a dissociation between implicit and explicit responses because in this case the FORWARDCS+ signals the US and consequently the BACKWARDCS+ might be explicitly associated with the its termination.
Materials and methods
Participants
Thirty-three volunteers participated in the study and were recruited through media advertisements. For their participations, individuals received 14€. Three participants were excluded from the analysis: One because of technical problems, one because it interrupted the recording and the third one because it was the only one who was unaware (i.e., she was not able to indicate the association between the stimuli). Two additional participants were excluded from the analysis, because they were coded as no-responders (mean startle amplitude <5 μV). At the end, we considered 28 participants for the analysis (9 males; mean age: 22.96 years, SD = 1.48; range = 21–26 year). Participants' trait anxiety scores ranged between 24 and 65 (mean = 40.6, SD = 8.86), which is comparable to the published normal range of adults (Laux et al., 1981). Participants' anxiety level (STAI state) before and after the experiment did not change significantly [37.46 ± 6.77 vs. 39.75 ± 7.86; t(27) = 1.31, p = 0.202] as well as negative affect [NA scale from PANAS; 12.50 ± 2.58 vs. 13.64 ± 4.99; t(27) = 1.25, p = 0.223]. Similar to the Study 1, participants positive mood (PA scale from PANAS) significantly decreased at the end of the experiment compared to their mood at the beginning [28.18 ± 6.04 vs. 25.61 ± 7.23; t(27) = 2.14, p = 0.041]. Again, this decreased positive mood may have been induced by the aversiveness of the stimuli used or by the boringness of the experiment.
Stimulus material
The stimulus material was exactly the same as in Study 1. The mean electric shock intensity was 1.84 mA (SD = 0.27) and participants' subjective painfulness of the US was 6.39 (SD = 1.26; range: 5–9). Importantly, participants still rated the US as painful at the end of the experiment (6.39, SD = 1.57; range: 3–10) and the two ratings did not differ [t(26) = 0.33, p = 0.746].
Procedure
The procedure of the Study 2 was almost the same as in Study 1; the only difference was the number of USs and their predictability.
During the conditioning phase participants saw three out of four geometrical shapes 16 times each. Altogether, there were 32 trials, 16 CS− trials and 16 CS+ trials. The CS+ trials started with the FORWARDCS+ onset, at FORWARDCS+ offset the US was delivered (ISI = 8 s), and 6 s later the BACKWARDCS+ was presented (ISI = −6 s; Figure 1B). The CS− trials consisted of CS− presentation. The ITI varied between 20 and 30 s (mean = 25 s) for the same reasons as in Study 1 (see Page 6). Stimulus presentation was randomized with the only restriction that the same stimulus may not be presented more than twice in a row. No startle probe was presented during conditioning. The test phase and the subjective rating were exactly the same as in Study 1.
In addition, after conditioning we verified participants' awareness about the association between the CSs and the US by means of an open question. That is, participants had to verbally report to which geometrical shape the electric shock was associated. Only one participant recalled the association between the BACKWARDCS+ and the US, one participant was not able to indicate a particular shape (she was then coded as unaware and excluded from the statistical analysis), whereas all other participants recalled the association between the FORWARDCS+ and the US.
Physiological recording and data reduction
Physiological responses and data reduction worked out in exactly the same way as in Study 1. Notably, 9.2% of the trials were rejected for the analysis of startle response. Moreover, seven further participants were excluded from the analysis for the SCR during conditioning because they had no detectable peaks per condition and 12 for the same analysis during test phase.
Data analysis
All data were analyzed with SPSS for Windows (Version 20.0, SPSS Inc.) and as for the Study 1 startle amplitude, SCR, valence, arousal and contingency ratings were separately analyzed with MANOVA. Again the alpha (α) level was set at 0.05 for all analyses.
Results
Valence ratings (Figure 2A, right panel)
Analysis of the valence ratings revealed a significant Stimulus × Phase interaction [F(6, 22) = 5.32, p = 0.002, η2p = 0.592]. Post-hoc t-tests indicated that the valence of the geometrical shapes at the beginning of the experiment was equally rated (all ps > 0.24) and that the valence was reported as neutral (i.e., 5; all ps > 0.28). After conditioning, the FORWARDCS+ was rated as more negatively valenced compared to the CS− [t(27) = 5.97, p < 0.001], the NEW [t(27) = 5.22, p < 0.001] and interestingly to the BACKWARDCS+ as well [t(27) = 5.82, p < 0.001]. The valence ratings of the CS− did not differ significantly from those of the BACKWARDCS+ [t(27) = 1.20, p = 0.242] and the NEW [t(27) = 1.22, p = 0.234], and the BACKWARDCS+ was rated more positive than the NEW [t(27) = 2.15, p = 0.041]. After the test phase, the valence ratings of the NEW were significant more negative than those of the CS− [t(27) = 2.64, p = 0.014], but no other significant differences were found (all ps > 0.09). Contrarily to the Study 1, the relief-associated stimulus (the BACKWARDCS+) acquired explicit positive valence as opposed to the threat signal (the FORWARDCS+) and similar to the safety signal (the CS−).
Arousal ratings (Figure 2B, right panel)
Analysis of the arousal ratings revealed a significant modulation of conditioning as indicated by a significant Stimulus × Phase interaction [F(6, 22) = 6.32 p = 0.001, η2p = 0.633]. Post-hoc t-tests indicated equal arousal for all four CSs at the beginning of the study (all ps > 0.12). After conditioning, the FORWARDCS+ was rated as more arousing compared to the CS− [t(27) = 5.30, p < 0.001], the NEW [t(27) = 5.14, p < 0.001] and to the BACKWARDCS+ [t(27) = 6.29, p < 0.001], while the BACKWARDCS+, the CS− and the NEW were rated with comparable arousal (all ps > 0.08). After the test phase, the FORWARDCS+ was still rated as more arousing than the CS− [t(27) = 1.99, p = 0.057; despite marginally] and the BACKWARDCS+ [t(27) = 2.50, p = 0.019], but not more arousing than the NEW [t(27) = 0.72, p = 0.475] anymore. Moreover, the NEW was rated as significantly more arousing compared to the BACKWARDCS+ [t(27) = 3.22, p = 0.003] and the CS− [t(27) = 2.81, p = 0.009]. Notably, the CS− and the BACKWARDCS+ did not differ regarding arousal ratings [t(27) = 0.50, p = 0.624]. Contrarily to the Study 1, the relief-associated stimulus (BACKWARDCS+) was valued as less arousing than the threat stimulus (FORWARDCS+).
Startle response (Figure 3B)
Analysis for the startle responses revealed a significant main effect of stimulus [F(3, 25) = 3.85, p = 0.022, η2p = 0.316]. Post-hoc t-tests indicated that the startle amplitude to the BACKWARDCS+ was significantly attenuated compared to the FORWARDCS+ [t(27) = 2.85, p = 0.008] and to the NEW [t(27) = 2.45, p = 0.021], but not to the CS− [t(27) = 1.13, p = 0.267]. Moreover, the startle responses to the CS− did not differ significantly from those to the FORWARDCS+ [t(27) = 1.53, p = 0.137] and to the NEW [t(27) = 1.00, p = 0.326]. Because we did not find significant discriminative responses to the FORWARDCS+ and the CS−, we compared the z-scores of the startle amplitudes to the four visual stimuli with the mean (i.e., 0) in order to verify whether startle amplitude to the FORWARDCS+ was potentiated. Tests revealed significant startle potentiation to the FORWARDCS+ [t(27) = 2.93, p = 0.007] and to the NEW [t(27) = 1.59, p = 0.052; despite marginally], but not to the BACKWARDCS+ [t(27) = 1.59, p = 0.123] and to the CS− [t(27) = 0.47, p = 0.640].
SCR (Figure 4B)
Analysis for the SCR during conditioning revealed a significant main effect of stimulus [F(2, 19) = 12.05, p < 0.001, η2p = 0.559]. Similar to the Study 1, post-hoc t-tests indicated significant higher SCR to the FORWARDCS+ compared to the CS− [t(20) = 3.15, p = 0.005] and to the BACKWARDCS+ [t(20) = 4.91, p < 0.001]. Again, the SCR to the BACKWARDCS+ was lower compared to the CS− [t(20) = 3.12, p = 0.005]. Same as for Study 1, analysis of the SCR during the test phase did not reveal a significant main effect of stimulus [F(3, 13) = 2.24, p = 0.132, η2p = 0.34].
Contingency awareness (Table 1)
Participants' awareness about the association between the visual stimuli and the painful shock was significantly modulated by conditioning as the significant main effect of stimulus indicated [F(2, 19) = 92.87, p < 0.001, η2p = 0.907]. Post-hoc t-tests indicated higher contingency ratings for the FORWARDCS+ compared to the BACKWARDCS+ [t(20) = 10.99, p < 0.001] and to the CS− [t(20) = 13.86, p < 0.001]. No significant difference between the BACKWARDCS+ and the CS− [t(20) = 0.06, p = 0.951] was found.
Discussion
In Study 2 we investigated whether a stimulus associated with the relief from a painful US would acquire reward-like properties even when the aversive event is fully predicted. This is exactly what we found. Thus, when the BACKWARDCS+ followed a fully predictable painful US, participants showed significant attenuation of the startle amplitude (i.e., reward-like responses) to the BACKWARDCS+ compared to the FORWARDCS+ and the NEW stimulus (Figure 3B). Therefore, when the onset of the US was predictable, the BACKWARDCS+ appears to acquire implicit positive valence in parallel to our previous findings (Andreatta et al., 2010). Strikingly and in contrast to our previous studies (Andreatta et al., 2010, 2012), the BACKWARDCS+ in this case acquired an explicit positive valence too and low arousal (see Figure 2).
Why does the BACKWARDCS+ acquire explicit appetitive properties when presented after a FORWARDCS+, but explicit aversive properties when presented “alone”? Differently from Study 1, participants might have felt in Study 2 less anxious since the threat was fully predictable. Moreover, all participants (except one) explicitly indicated the FORWARDCS+ and not the BACKWARDCS+ as the visual stimulus associated with the US (see contingency ratings, Table 1). The absence of an explicit association between the BACKWARDCS+ and the US may have determined its positive valence and its low arousal ratings. Thus, since the FORWARDCS+ reliably predicted the US, the BACKWARDCS+ became explicitly associated with the relief only.
We did not find during the test phase discriminative startle responses to the FORWARDCS+ and the CS−. This result is quite puzzling considering the broad literature on classical fear conditioning. However, we should consider that the startle responses were recorded during the test phase in which no USs were delivered. Therefore, it is possible to assume that a new learning (i.e., extinction learning) has started and modulated these responses (Milad and Quirk, 2012). In any case, the strong attenuation of the startle response to the BACKWARDCS+ suggests that relief-conditioned responses undergo slower extinction processes; although, this hypothesis must be further investigated.
Nicely, the SCR findings in Study 2 mirror the SCR results of Study 1. Namely, SCR to the BACKWARDCS+ was significantly lower compared to the other CSs during conditioning (Figure 4B). Moreover, the greater SCR to the FORWARDCS+ compared to the CS− confirms previous studies, in which participants showed increased SCR to the threat-predicting CS suggesting greater sympathetic arousal (Büchel et al., 1998; Labar et al., 1998; Weike et al., 2008; Li et al., 2011). Finally, it is conceivable that pain relief does not implicate or does not need strong sympathetic engagement because there is no real need to react since the threat is not imminent anymore (see General Discussion for further interpretations; Fanselow and Lester, 1988; Fanselow, 1994). Discriminative SCRs to the CSs disappeared during the test phase, which may be related to extinction processes.
General discussion
The goal of the present studies was to investigate the temporal sequence between pain and its relief and how their contiguity and predictability would affect the individuals' implicit and explicit responses. Because of the dependence of relief pleasantness on pain aversiveness and of pain aversiveness on pain unpredictability, we wondered whether the prediction of a painful stimulus might differentially modulate the responses to a stimulus associated with pain relief. We realized two studies which were similar in most aspects, but differed in the predictability of the painful US. During the conditioning phase of both studies, one geometrical shape (FORWARDCS+) was presented before a mild painful electric shock (aversive US), while another geometrical shape (BACKWARDCS+) was presented after the US, and a third geometrical shape (CS−) was unrelated to the US. In Study 1 on the one hand, the FORWARDCS+ and the BACKWARDCS+ were presented in different trials meaning that during the FORWARDCS+ trials the US could be predicted, while during the BACKWARDCS+ trials the BACKWARDCS+ followed an unpredicted US. In Study 2 on the other hand, the FORWARDCS+ and the BACKWARDCS+ were presented in one trial meaning that the US could be predicted by the FORWARDCS+ and the BACKWARDCS+ followed this predictable US.
Based on our previous and other fear conditioning studies, we hypothesized that the FORWARDCS+ would acquire negative affective implicit and explicit properties in both studies. This assumption was confirmed. Participants showed increased fear responses to the FORWARDCS+ as indicated by potentiation of the startle response, high SCR, and negative valence as well as enhanced arousal ratings1. In other words, the FORWARDCS+ acquired aversive explicit and implicit properties by means of its association with the painful US; it became a signal of danger (Weike et al., 2008; Andreatta et al., 2010; Delgado et al., 2011; Li et al., 2011).
For Study 1, we expected in line with our previous between-subjects studies that the BACKWARDCS+ would acquire an implicit positive valence because of its coincidence with the experience of relief, but an explicit negative valence because it is the only stimulus which was contiguous to the US. These hypotheses were confirmed for rating data, but not for startle data (for a discussion of the discrepancy in startle data between Study 1 and previous studies see Discussion of Study 1). In contrast and most important, we expected for Study 2 that the BACKWARDCS+ would acquire an implicit positive valence because of its coincidence with the experience of relief, and we also expected explicit positive properties because this stimulus should be experienced as independent from the US on a cognitive level. These hypotheses were confirmed. Thus, startle response was attenuated in response to the BACKWARDCS+ and participants reported positive valence as well as low arousal ratings for the BACKWARDCS+.
Learning the relationship between a neutral stimulus (CS) and an aversive event (US) implicates two kinds of memories (Williams et al., 2001; Hamm and Weike, 2005; Riebe et al., 2012). On the one hand, organisms form implicit fear memories which activate subcortical structures of the fear matrix like the amygdala and initiate defensive responses in an automatic manner, i.e., without cognitive appraisal. On the other hand, organisms form explicit fear memories which involve cortical structures like prefrontal cortex (PFC) and initiate fear responses requiring cognitive appraisal. Intuitively, the explicit cognitive knowledge about CS−US association may strongly influence participants' verbal reports, but to a lesser extend implicit memories. Hence, it is plausible that a stimulus presented upon the moment of the relief may acquire either aversive or appetitive explicit properties dependent on declarative encoding of the CS−US relation. In line, in Study 1 as well as in our previous studies (Andreatta et al., 2010, 2012) participants received an unpredictable aversive stimulus which was shortly followed by the BACKWARDCS+. We think that after an aversive event an appetitive reaction is always started, but the explicit encoding of such appetitive reaction is determined by the declarative processing of the temporal relationship between the stimuli. Hence, the impossibility to reliably foresee the aversive event entailed a negative valuation of all stimuli which were temporally nearby the event. On the contrary in Study 2, participants were able to reliably predict the aversive event by a preceding stimulus. Consequently, participants may have experienced the BACKWARDCS+ as “purely” associated with the relief because there was no need for an association between the painful event and any following stimuli. This interpretation is supported by the contingency ratings. In fact, if the US was unpredictable as in Study 1 and in our previous studies (Andreatta et al., 2010, 2012), participants reported an association between the US and the BACKWARDCS+. If the US was predicted by a preceding CS as in Study 2, participants report no contingency between the US and the BACKWARDCS+. As results, the synergic information from the implicit and the explicit level allows the participants to rate the BACKWARDCS+ as appetitive (i.e., positive valence) and reassuring (i.e., low arousal).
As already mentioned, pain relief entails reward-like properties (Seymour et al., 2005; Leknes et al., 2008, 2011) and promotes appetitive learning (Tanimoto et al., 2004; Yarali et al., 2008; Andreatta et al., 2010, 2012; Navratilova et al., 2012). That is, brain areas involved in the processing of rewarding events (Tobler et al., 2003) are also activated by pain relief (Seymour et al., 2005; Leknes et al., 2011), and organisms react with appetitive conditioned responses to a stimulus presented upon the relief (Tanimoto et al., 2004; Yarali et al., 2008; Andreatta et al., 2010, 2012; Navratilova et al., 2012). Confirming these studies, we found discriminative conditioned responses to the CSs in Study 2 (i.e., potentiation of the startle response to the FORWARDCS+ and attenuation of the startle response to the BACKWARDCS+), but not in Study 1. Why? First, the number of the shocks in Study 1 was doubled compared to Study 2 (32 vs. 16) and to our previous studies with between designs (Andreatta et al., 2010, 2012). Second, in Study 1 half of the shocks were reliably predictable, whereas the other half was delivered unpredictably before the BACKWARDCS+, while in Study 2 all USs were fully predictable. In the laboratory, fear responses can be induced by increasing the frequency of the shocks (shock density) together with their imminence (i.e., how reliably the danger is foreseen; Fanselow and Lester, 1988). Presumably, the high number of shocks in Study 1 together with their relative unpredictability might have induced an enhanced state of sustained fear (Davis et al., 2010) which caused the lack of discriminative startle responses to the CSs. In line, unpredictability, defined as “the absence of a signal for an aversive event” (Fonteyne et al., 2010), induces stronger fear responses to the aversive event than when it is predictable (Carlsson et al., 2006; Baratta et al., 2007; Herry et al., 2007; Fonteyne et al., 2010), a reduced capacity to identify safety periods (Lohr et al., 2007) and a sustained state of apprehension (sustained fear or anxiety; Fanselow and Lester, 1988; Davis et al., 2010). Moreover,the shock density seems also to play a role. In fact, we found relief-conditioned responses to a stimulus in the between-subjects designed studies (Andreatta et al., 2010, 2012), but not in Study 1 despite in both studies the US was presented unpredictably. Possibly, doubling the number of the aversive US may also have increased the anxiety-related responses. Hence, the unpredictability together with the high frequency of an aversive event seems to impair the ability to distinguish between threatening and safety periods.
Notably, these findings broaden our knowledge about the role of (un-)predictability of an aversive event in determining fear vs. safety conditioned responses. In fact, we could demonstrate for the first time that the unpredictability of an aversive event not only implies a sustained feeling of fear and an incapacity to identify the absence of a threat (i.e., respite), but it may also erase the ability to identify the termination of the threat (i.e., relief). That is, the stronger a sustained feeling of fear (or anxiety) is, the less evident the appetitive feeling of relief becomes. Safety is functionally related to danger meaning that an individual can identify safety periods only if it has first located the danger (Lohr et al., 2007). Based on this safety/danger relation, Lohr et al. (2007) distinguished between two kinds of safety, namely the absence of threat (i.e., respite) and the termination of threat (i.e., relief). Interestingly, a fruitless search for safety has been implicated in the etiology of anxiety disorders (Seligman, 1968; Mineka and Zinbarg, 2006; Lohr et al., 2007; Grillon et al., 2008, 2009; Davis et al., 2010), and anxious individuals have been found to be particularly sensitive to unpredictable threats (Grillon et al., 2008, 2009; Davis et al., 2010; Glotzbach-Schoon et al., 2013). Hence, individuals who show exaggerated fear responses to threatening contexts (Grillon et al., 2008, 2009; Davis et al., 2010) are less able to identify safety periods (Seligman, 1968; Mineka and Zinbarg, 2006; Lohr et al., 2007; Grillon et al., 2008, 2009; Davis et al., 2010), but they might also be less able to experience relief—as suggested by the present studies. However, further studies have to investigate the role of trait anxiety in the modulation of the relief-related responses in order to clarify whether and how the relief after an aversive event is implicated in the etiology of anxiety disorders.
Besides startle response, SCR is frequently used as physiological measure of conditioned fear (Büchel et al., 1998; Labar et al., 1998; Knight et al., 2003, 2006; Delgado et al., 2006; Weike et al., 2008). SCR reflects a phasic change in sweat gland activity induced by a re-orientation of the attentional resources toward novel and salient stimuli (Williams et al., 2000; Bradley et al., 2001; Bradley, 2009). In line with previous studies, both studies presented here found increased autonomic arousal to the danger signal (FORWARDCS+) compared to the safety signal (the CS−; Büchel et al., 1998; Labar et al., 1998; Knight et al., 2003, 2005, 2006; Weike et al., 2008; Alvarez et al., 2011), and these fear conditioned SCRs extinguished throughout the test phase. In parallel, the SCRs to the stimulus associated with the relief “signal” (BACKWARDCS+) were significantly reduced compared to the danger signal and even significantly reduced compared to the safety signal (CS−). The latter difference suggests that the processes triggered by a relief-associated stimulus differ from those underlying the processes of a stimulus signaling safety. To our knowledge, there is no evidence in the literature investigating the effects of conditioned pain relief on autonomic arousal, which makes the interpretation of our results quite difficult. Nevertheless, Leknes et al. (2008) showed that the electrodermal responses following a painful stimulus linearly decreased by the increase of painfulness. Furthermore, another possible explanation of the decreased SCR to the relief-associated stimulus might be linked to the imminence of the threat. Namely, the defensive pattern is determined by three stages defined on the imminence of threat (Fanselow, 1994). Thus, flight/fight responses are initiated by the physical contact with the threat, while the level of fear gradually decreases by danger detachment. Considering SCR as an index of physiological arousal, the low SCR in response to the BACKWARDCS+ during conditioning presumably relies on the evident termination or detachment of the painful stimulation (i.e., the US) and the no-need to initiate defensive responses.
In conclusion, our results concur with the growing evidences on the appetitive properties of pain relief and its conditionability. Importantly, the predictability and the cognitive appraisal of the association between two stimuli crucially affect the explicit aversiveness and pleasantness of the relief-associated stimulus. Thus, as soon as the danger (US) is reliably predicted by a stimulus (FORWARDCS+), another stimulus presented upon the termination of danger (BACKWARDCS+) can acquire not only implicit but also explicit appetitive properties linked to the experienced relief.
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We sincerely thank C. Ziegler und S. Meinecke for their help in collecting data. This work was supported by the Collaborative Research Center “Fear, Anxiety, and Anxiety Disorders,” SFB-TRR 58, project B1, and the DFG-FOR605 “Emotion and Behaviour,” and the University of Wuerzburg in the funding program Open Access Publishing.
Footnotes
1Explorative we compared the subjective ratings, the startle response, and the SCR to the forward CS+ after conditioning of Study 1 vs. Study 2. We found no significant differences for SCR, startle response, valence and contingency ratings (ps > 0.07). However, forward CS+ in Study 2 was significantly more arousing compared to forward CS+ in Study 1 [t(55) = 3.001, p = 0.004]. Supposedly, when a stimulus' reliability regarding a threat is partial, the arousal is spread over the other stimuli too as possible informers about the threat.
References
- Alvarez R. P., Chen G., Bodurka J., Kaplan R., Grillon C. (2011). Phasic and sustained fear in humans elicits distinct patterns of brain activity. Neuroimage 55, 389–400 10.1016/j.neuroimage.2010.11.057 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andreatta M., Fendt M., Mühlberger A., Wieser M. J., Imobersteg S., Yarali A., et al. (2012). Onset and offset of aversive events establish distinct memories requiring fear- and reward network. Learn. Mem. 19, 518–526 10.1101/lm.026864.112 [DOI] [PubMed] [Google Scholar]
- Andreatta M., Mühlberger A., Yarali A., Gerber B., Pauli P. (2010). A rift between implicit and explicit conditioned valence after pain-relief learning in humans. Proc. Biol. Sci. 277, 2411–2416 10.1098/rspb.2010.0103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baratta M. V., Christianson J. P., Gomez D. M., Zarza C. M., Amat J., Masini C. V., et al. (2007). Controllable versus uncontrollable stressors bi-directionally modulate conditioned but not innate fear. Neuroscience 146, 1495–1503 10.1016/j.neuroscience.2007.03.042 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barlow D. H. (2000). Unraveling the mysteries of anxiety and its disorders from the perspective of emotion theory. Am. Psychol. 55, 1247–1263 10.1037/0003-066X.55.11.1247 [DOI] [PubMed] [Google Scholar]
- Blumenthal T. D., Cuthbert B. N., Filion D. L., Hackley S., Lipp O. V., Vanboxtel A. (2005). Committee report: guidelines for human startle eyeblink electromyographic studies. Psychophysiology 42, 1–15 10.1111/j.1469-8986.2005.00271.x [DOI] [PubMed] [Google Scholar]
- Bradley M. M. (2009). Natural selective attention: orienting and emotion. Psychophysiology 46, 1–11 10.1111/j.1469-8986.2008.00702.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bradley M. M., Codispoti M., Cuthbert B. N., Lang P. J. (2001). Emotion and motivation I: defensive and appetitive reactions in picture processing. Emotion 1, 276–298 10.1037/1528-3542.1.3.276 [DOI] [PubMed] [Google Scholar]
- Büchel C., Morris J., Dolan R. J., Friston K. J. (1998). Brain systems mediating aversive conditioning: an event-related fRMI study. Neuron 20, 947–957 10.1016/S0896-6273(00)80476-6 [DOI] [PubMed] [Google Scholar]
- Carlsson K., Andersson J., Petrovic P., Petersson K. M., Öhman A., Ingvar M. (2006). Predictability modulates the affective and sensory-discriminative neural processing of pain. Neuroimage 32, 1804–1814 10.1016/j.neuroimage.2006.05.027 [DOI] [PubMed] [Google Scholar]
- Davis M., Walker D. L., Miles L., Grillon C. (2010). Phasic vs sustained fear in rats and humans: role of the extended amygdala in fear vs anxiety. Neuropsychopharm 35, 105–135 10.1038/npp.2009.109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Delgado M. R., Jou R. L., Phelps E. A. (2011). Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers. Front. Neurosci. 5:71 10.3389/fnins.2011.00071 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Delgado M. R., Olsson A., Phelps E. A. (2006). Extending animal models of fear conditioning to humans. Biol. Psychol. 73, 39–48 10.1016/j.biopsycho.2006.01.006 [DOI] [PubMed] [Google Scholar]
- Denny M. R. (1971). Relaxation theory and experiments, in Aversive Conditioning and Learning, ed Brush F. R. (New York, NY: Academic Press; ), 235–295 [Google Scholar]
- Dunsmoor J. E., Martin A., Labar K. S. (2011). Role of conceptual knowledge in learning and retention of conditioned fear. Biol. Psychol. 89, 300–305 10.1016/j.biopsycho.2011.11.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fanselow M. S. (1994). Neural organization of the defensive behavior system responsible for fear. Psychon. Bull. Rev. 1, 429–438 10.3758/BF03210947 [DOI] [PubMed] [Google Scholar]
- Fanselow M. S., Lester L. S. (1988). Approach to aversively motivated behavior: Predatory imminence as a determinant of the topography of defensive behavior, in Evolution and Learning, eds Bolles R. C., Beecher M. D. (London: Lawrence Erlbaum Associated; ), 185–211 [Google Scholar]
- Fendt M., Fanselow M. S. (1999). The neuroanatomical and neurochemical basis of conditioned fear. Neurosci. Biobehav. Rev. 23, 743–760 10.1016/S0149-7634(99)00016-0 [DOI] [PubMed] [Google Scholar]
- Fonteyne R., Vervliet B., Hermans D., Frank B., Vansteenwegen D. (2010). Exposure to the context and removing the unpredictability of the US: two methods to reduce contextual anxiety compared. Biol. Psychol. 85, 361–369 10.1016/j.biopsycho.2010.08.007 [DOI] [PubMed] [Google Scholar]
- Glotzbach-Schoon E., Tadda R., Andreatta M., Tröger C., Ewald H., Grillon C., et al. (2013). Enhanced discrimination between threatening and safe contexts in high-anxious individuals. Biol. Psychol. 93, 159–166 10.1016/j.biopsycho.2013.01.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gottfried J. A., O'Doherty J., Dolan R. J. (2002). Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J. Neurosci. 22, 10829–10837 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grillon C., Baas J. M., Cornwell B., Johnson L. (2006). Context conditioning and behavioral avoidance in a virtual reality environment: effect of predictability. Biol. Psychiat. 60, 752–759 10.1016/j.biopsych.2006.03.072 [DOI] [PubMed] [Google Scholar]
- Grillon C., Lissek S., Rabin S., McDowell D., Dvir S., Pine D. S. (2008). Increased anxiety during anticipation of unpredictable but not predictable aversive stimuli as a psychophysiologic marker of panic disorder. Am. J. Psychiatry 165, 898–904 10.1176/appi.ajp.2007.07101581 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grillon C., Pine D. S., Lissek S., Rabin S., Bonne O., Vythilingam M. (2009). Increased anxiety during anticipation of unpredictable aversive stimuli in posttraumatic stress disorder but not in generalized anxiety disorder. Biol. Psychiatry 66, 47–53 10.1016/j.biopsych.2008.12.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hamm A. O., Weike A. I. (2005). The neuropsychology of fear learning and fear regulation. Int. J. Psychophysiol. 57, 5–14 10.1016/j.ijpsycho.2005.01.006 [DOI] [PubMed] [Google Scholar]
- Herry C., Bach D. R., Esposito F., Di Salle F., Perrig W. J., Scheffler K., et al. (2007). Processing of temporal unpredictability in human and animal amygdala. J. Neurosci. 27, 5958–5966 10.1523/JNEUROSCI.5218-06.2007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim H., Shimojo S., O'Doherty J. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4:e233 10.1371/journal.pbio.0040233 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knight D., Nguyen H., Bandettini P. (2006). The role of awareness in delay and trace fear conditioning in humans. Cogn. Affect. Behav. Neurosci. 6, 157–162 10.3758/CABN.6.2.157 [DOI] [PubMed] [Google Scholar]
- Knight D. C., Nguyen H. T., Bandettini P. A. (2003). Expression of conditional fear with and without awareness. Proc. Natl. Acad. Sci. U.S.A. 100, 15280–15283 10.1073/pnas.2535780100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knight D. C., Nguyen H. T., Bandettini P. A. (2005). The role of the human amygdala in the production of conditioned fear responses. Neuroimage 26, 1193–1200 10.1016/j.neuroimage.2005.03.020 [DOI] [PubMed] [Google Scholar]
- Koch M. (1999). The neurobiology of startle. Prog. Neurobiol. 59, 107–128 10.1016/S0301-0082(98)00098-7 [DOI] [PubMed] [Google Scholar]
- Krohne H. W., Egloff B., Kohmann C. W., Tausch A. (1996). Untersuchungen mit einer deutschen Version der “Positive and Negative Affect Schedule” (PANAS). Diagnostica 42, 139–156 [Google Scholar]
- Labar K. S., Gatenby J. C., Gore J. C., Ledoux J. E., Phelps E. A. (1998). Human amygdala activation during conditioned fear acquisition and extinction: a mixed-trial fRMI study. Neuron 20, 937–945 10.1016/S0896-6273(00)80475-4 [DOI] [PubMed] [Google Scholar]
- Lang P. J. (1995). The emotion probe. Studies of motivation and attention. Am. Psychol. 50, 372–385 10.1037/0003-066X.50.5.372 [DOI] [PubMed] [Google Scholar]
- Laux L., Glanzmann P., Schaffner P., Spielberger C. D. (1981). Das State-Trait Angstinventar. Weinheim: Beltz Test [Google Scholar]
- Leknes S., Brooks J. C. W., Wiech K., Tracey I. (2008). Pain relief as an opponent process: a psychophysiological investigation. Eur. J. Neurosci. 28, 794–801 10.1111/j.1460-9568.2008.06380.x [DOI] [PubMed] [Google Scholar]
- Leknes S., Lee M., Berna C., Andersson J., Tracey I. (2011). Relief as a reward: hedonic and neural responses to safety from pain. PLoS ONE 6:e17870 10.1371/journal.pone.0017870 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li J., Schiller D., Schoenbaum G., Phelps E. A., Daw N. D. (2011). Differential roles of human striatum and amygdala in associative learning. Nat. Neurosci. 14, 1250–1252 10.1038/nn.2904 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lohr J. M., Olatunji B. O., Sawchuk C. N. (2007). A functional analysis of danger and safety signals in anxiety disorders. Clin. Psychol. Rev. 27, 114–126 10.1016/j.cpr.2006.07.005 [DOI] [PubMed] [Google Scholar]
- Milad M. R., Quirk G. (2012). Fear extinction as a model for translational neuroscience: ten years of progress. Annu. Rev. Psychol. 63, 129–151 10.1146/annurev.psych.121208.131631 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mineka S., Zinbarg R. (2006). A contemporary learning theory perspective on the etiology of anxiety disorders. Am. Psychol. 61, 10–26 10.1037/0003-066X.61.1.10 [DOI] [PubMed] [Google Scholar]
- Navratilova E., Xie J. Y., Okun A., Qu C., Eyde N., Ci S., et al. (2012). Pain relief produces negative reinforcement through activation of mesolimbic reward–valuation circuitry. Proc. Natl. Acad. Sci. U.S.A. 109, 20709–20713 10.1073/pnas.1214605109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Phelps E. A., Ledoux J. E. (2005). Contributions of the amygdala to emotion processing: from animal models to human behavior. Neuron 48, 175–187 10.1016/j.neuron.2005.09.025 [DOI] [PubMed] [Google Scholar]
- Riebe C. J., Pamplona F. A., Kamprath K., Wotjak C. T. (2012). Fear relief—towards a new conceptual framework and what endocannabinoids gotta do with it. Neuroscience 204, 159–185 10.1016/j.neuroscience.2011.11.057 [DOI] [PubMed] [Google Scholar]
- Schneider M., Spanagel R. (2008). Appetitive odor-cue conditioning attenuates the acoustic startle response in rats. Behav. Brain Res. 189, 226–230 10.1016/j.bbr.2007.12.017 [DOI] [PubMed] [Google Scholar]
- Seligman M. E. (1968). Chronic fear produced by unpredictable electric shock. J. Comp. Physiol. Psychol. 66, 402–411 10.1037/h0026355 [DOI] [PubMed] [Google Scholar]
- Seymour B., O'Doherty J. P., Koltzenburg M., Wiech K., Frackowiak R., Friston K., et al. (2005). Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat. Neurosci. 8, 1234–1240 10.1038/nn1527 [DOI] [PubMed] [Google Scholar]
- Solomon R. L. (1980). The opponent-process theory of acquired motivation. The cost of pleasure and the benefit of pain. Am. Psychol. 35, 691–712 10.1037/0003-066X.35.8.691 [DOI] [PubMed] [Google Scholar]
- Strack F., Deutsch R. (2004). Reflective and impulsive determinants of social behavior. Pers. Soc. Psychol. Rev. 8, 220–247 10.1207/s15327957pspr0803_1 [DOI] [PubMed] [Google Scholar]
- Tanimoto H., Heisenberg M., Gerber B. (2004). Event timing turns punishment to reward. Nature 430, 983 10.1038/430983a [DOI] [PubMed] [Google Scholar]
- Tobler P. N., Dickinson A., Schultz W. (2003). Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci. 23, 10402–10410 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tranel D., Damasio H. (1994). Neuroanatomical correlates of electrodermal skin conductance responses. Psychophysiology 31, 427–438 10.1111/j.1469-8986.1994.tb01046.x [DOI] [PubMed] [Google Scholar]
- Weike A. I., Schupp H. T., Hamm A. O. (2008). In dubio pro defensio: initial activation of conditioned fear is not cue specific. Behav. Neurosci. 122, 685–696 10.1037/0735-7044.122.3.685 [DOI] [PubMed] [Google Scholar]
- Williams L. M., Brammer M. J., Skerrett D., Lagopolous J., Rennie C., Kozek K., et al. (2000). The neural correlates of orienting: an integration of fMRI and skin conductance orienting. [Miscellaneous Article]. Neuroreport 11, 3011–3015 10.1097/00001756-200009110-00037 [DOI] [PubMed] [Google Scholar]
- Williams L. M., Phillips M. L., Brammer M. J., Skerrett D., Lagopoulos J., Rennie C., et al. (2001). Arousal dissociates amygdala and hippocampal fear responses: evidence from simultaneous fMRI and skin conductance recording. Neuroimage 14, 1070–1079 10.1006/nimg.2001.0904 [DOI] [PubMed] [Google Scholar]
- Yarali A., Niewalda T., Chen Y.-C., Tanimoto H., Duerrnagel S., Gerber B. (2008). Pain relief learning in fruit flies. Anim. Behav. 76, 1173–1185 10.1016/j.anbehav.2008.05.025 [DOI] [Google Scholar]