Abstract
Background
Responding emotionally to danger is critical for survival. Normal functioning also requires flexible alteration of emotional responses when a threat becomes safe. Aberrant threat and safety learning occur in many psychiatric disorders, including posttraumatic stress disorder, obsessive-compulsive disorder, and schizophrenia, in which emotional responses can persist pathologically. While there is evidence that threat and safety learning can be modulated by the serotonin systems, there have been few studies in humans. We addressed a critical clinically relevant question: How does lowering serotonin affect memory retention of conditioned threat and safety memory?
Methods
Forty-seven healthy participants underwent conditioning to two stimuli predictive of threat on day 1. One stimulus but not the other was subsequently presented in an extinction session. Emotional responding was assessed by the skin conductance response. On day 2, we employed acute dietary tryptophan depletion to lower serotonin temporarily, in a double-blind, placebo-controlled, randomized between-groups design. We then tested for the retention of conditioned threat and extinction memory. We also measured self-reported intolerance of uncertainty, known to modulate threat memory expression.
Results
The expression of emotional memory was attenuated in participants who had undergone tryptophan depletion. Individuals who were more intolerant of uncertainty showed even greater attenuation of emotion following depletion.
Conclusions
These results support the view that serotonin is involved in predicting aversive outcomes and refine our understanding of the role of serotonin in the persistence of emotional responsivity, with implications for individual differences in vulnerability to psychopathology.
Keywords: Emotion, Fear conditioning, Memory, Serotonin, Threat conditioning, Tryptophan depletion
Emotional responses to threats are critical for survival. Once a threat is no longer present, emotion must adapt to reflect safety for normal functioning to continue. Dysfunction of threat and safety learning lies at the core of posttraumatic stress disorder (1) and anxiety disorders (2,3) and is a feature of obsessive-compulsive disorder (4, 5, 6) and schizophrenia (7). Elucidating contributors to persistent emotional reactions is essential for developing new treatments. We tested the influence of the neuromodulator serotonin (5-HT) on the retention of conditioned threat and safety memory, with a widely used laboratory model (8).
In Pavlovian threat conditioning paradigms, more commonly known as fear conditioning (9), a neutral stimulus is paired with an aversive outcome (e.g., mild electric shock). Individuals learn that the cue signals threat, and an anticipatory sympathetic nervous system arousal response occurs. This manifests as measurable perspiration known as the skin conductance response (SCR). After learning that a cue signals threat, the stimulus can be repeatedly presented without the aversive consequence (extinction learning)—a model of exposure therapy in the clinic by which a new memory of safety should be formed. These two memories—threat and safety—compete for expression upon re-encountering a conditioned stimulus (CS) (10,11). Conditioned threat memories (learned physiological responses to conditioned stimuli) often persist despite extinction training, and re-emerge after the passage of time (spontaneous recovery) or after re-exposure to adversity (reinstatement) (10). Understanding what contributes to spontaneous recovery and reinstatement is of great clinical interest and has implications for conditions such as posttraumatic stress disorder (8,12).
Serotonin, meanwhile, is widely implicated in aversive learning (13). While several studies have begun to explore the role of serotonin in threat and safety learning and in aversive memory, most experiments have been carried out in rodents (14). The dearth of human studies at the nexus of threat memory and serotonin function is particularly surprising given that first-line pharmacological treatments of disorders in which threat conditioning processes are impaired modulate serotonin (15). No one, to our knowledge, has manipulated serotonin experimentally to examine its influence on spontaneous recovery in humans.
Acute tryptophan depletion (ATD) is commonly used to study serotonin: tryptophan, the biosynthetic precursor to serotonin, is temporarily removed from the diet in the presence of other amino acids, which decreases serotonin synthesis (16, 17, 18, 19, 20). ATD and 5-HT2A/2C receptor antagonism via ritanserin have attenuated threat conditioning in humans, as assessed by SCR (21,22). 5-HT can also impact startle when anticipating shocks during acquisition (23, 24, 25). Fourteen-day administration of the serotonin reuptake inhibitor (SRI) escitalopram in humans did not impact the acquisition of threat memory but facilitated extinction (using SCR) (26). Fourteen-day treatment with fluoxetine (an SRI) in mice, initiated before extinction, diminished spontaneous recovery and reinstatement; fluoxetine was present in all postacquisition phases (27). Treatment of rats, the primary animal model, with citalopram (an SRI) for 22 days, before extinction training but after conditioning, impaired extinction, whereas 9-day treatment had no effect; spontaneous recovery and reinstatement were not studied (28). A human behavioral genetics study found a relationship between spontaneous recovery (not acquisition or extinction) and variation in the serotonin transporter polyadenylation polymorphism (29). Other human studies have shown that 5-HT modulated explicit, often same-day, memory (30, 31, 32) and processing of emotional facial expressions (33), rather than implicit memory assessed physiologically.
Another factor can influence threat conditioning processes: intolerance of uncertainty, the dispositional tendency to appraise uncertain situations as aversive (34, 35, 36, 37, 38, 39, 40, 41, 42, 43), assessed by the Intolerance of Uncertainty Scale (IUS) (44). Indeed, high IUS score has been linked to enhanced spontaneous recovery and reinstatement (34,36). Critically, effects of high intolerance of uncertainty on threat conditioning processes were distinct from trait anxiety (37,38,40, 41, 42). Intolerance of uncertainty is a transdiagnostic construct (45, 46, 47) and is heightened in individuals with diagnoses spanning generalized anxiety disorder, social phobia, panic disorder, agoraphobia, obsessive-compulsive disorder, and depression (46,47), and those with posttraumatic stress disorder symptoms (48), making the IUS score relevant for psychiatric classification frameworks (e.g., RDoC [Research Domain Criteria]) (49). To our knowledge, this study is the first to employ the IUS in the context of serotonin’s emotional effects.
Here, we employed ATD in healthy humans and investigated the following questions: How does lowering serotonin affect the retention of conditioned threat and extinction memory, and does intolerance of uncertainty influence how serotonin modulates emotion? We predicted that lowering serotonin function would modulate the expression of previously formed threat memory, without affecting expression of extinction memory, and that accounting for IUS score would contribute to explaining these effects.
Methods and Materials
Participants
Forty-seven healthy participants (mean age, 25 years; age range, 18–25 years; 29 males, 18 females), free from psychiatric disorder, who met criterion for Pavlovian conditioning (assessed by SCR) were included. Participants (Table 1) gave informed consent and were paid.
Table 1.
Placebo | Depletion | |
---|---|---|
Age, Years | 24.23 (5.88) | 25.80 (6.24) |
Education, Years | 17.18 (2.38) | 17.28 (2.42) |
BDI-II | 5.23 (4.38) | 4.04 (3.92) |
STAI | 37.36 (7.27) | 35.52 (5.96) |
IUS | 55.73 (13.69) | 49.80 (13.44) |
Acute Tryptophan Depletion
Participants were randomly assigned to receive either ATD (n = 25; 16 males, 9 females) or placebo (n = 22; 13 males, 9 females) in a double-blind between-groups design. The depletion group received a drink that contained a balance of all essential amino acids except tryptophan. The placebo group received the same drink, with tryptophan (50).
Task and Procedure
The protocol received ethical approval. Participants attended sessions on 2 consecutive days. Day 1 comprised a short afternoon session with no serotonergic manipulation. Participants were subjected to the threat of mild electrical stimulation (shock) (1,29,51, 52, 53), which was calibrated to be uncomfortable but not painful. Acquisition involved three conditioned stimuli (CSs): CS+E, CS+N, and CS−. Two CSs, CS+E (extinguished) and CS+N (not extinguished), were paired with receipt of shock (unconditioned stimulus [US]) on 37.5% of trials; the CS− was never paired with the US (Figure 1). Extinction followed: the CS+E and CS− were repeatedly presented, both without the US. The CS+N was not presented. On day 2, participants arrived in the morning having fasted for at least 9 hours, gave a blood sample, and ingested either the placebo or ATD drink. In the afternoon a second blood sample was taken and, at least 4.5 hours following ingestion (54), participants were re-exposed to the CS+E, CS+N, and CS− without the US, to assess spontaneous recovery to the CS+E (10). At this stage, the CS+N is a comparator against which spontaneous recovery of the CS+E can be measured. If ATD modulates expression of the original threat memory, it would be expected to alter responses to the CS+N. If it specifically affects the expression of the extinction memory (spontaneous recovery), it would be expected to alter responses to the CS+E but not to the CS+N. Reinstatement comprised four USs, not paired with any CS, followed by re-exposure to all conditioned stimuli. Reacquisition was conducted exactly as initial acquisition. Greater reacquisition can be reflective of a stronger threat memory (10). The context remained the same across both days.
Results
Blood and Mood
Robust depletion of tryptophan was achieved (t43 = −15.317, p = 5.05 × 10−19) (Figure 2). Mood, assessed prior to the task, after depletion had taken effect, did not differ from those participants who received placebo (t38 = −1.227, p = .228).
Acquisition Before Depletion
Threat conditioning was achieved and was no different between those who later received placebo versus depletion (Figure 3A). Repeated-measures analysis of covariance (ANCOVA) with group assignment (future placebo, future ATD) and sex (male, female) as between-subjects factors, stimulus (CS+E, CS+N, CS−; all trials) as a within-subjects factor, and IUS as a covariate yielded a main effect of stimulus (F1,56 = 9.239, p = .002, ηp2 = .180), no main effect of group assignment (F1,42 = 0.591, p = .446, ηp2 = .014), and no group assignment × stimulus interaction (F1,56 = 1.272, p = .277, ηp2 = .029). There was a significant stimulus × IUS interaction (F1,56 = 4.175, p = .035, ηp2 = .090), no main effect of sex, and no interactions with sex (F < 3.5, p > .05, ηp2 < .08). Paired t tests confirmed that SCRs to the CS+E (t46 = −5.315, p = 3 × 10−6) and CS+N (t46 = −4.632, p = 3 × 10−5) were each significantly greater than to the CS−.
Extinction Before Depletion
ANCOVA was performed with group assignment (future placebo, future ATD) and sex (male, female) as between-subjects factors, stimulus (CS+E, CS−) and phase (early, late; first and last two trials) as within-subjects factors, and IUS as covariate. There was no difference during extinction between those who later received placebo versus depletion (F1,42 = 1.165, p = .287, ηp2 = .027), nor was there an interaction between group and phase (F1,42 = 0.003, p = .960, ηp2 = 6.10 × 10−5). In contrast to acquisition, there was no longer a significant effect of stimulus during the extinction session (F1,42 = 1.490, p = .229, ηp2 = .034), indicating evidence of extinction. Additionally, there was an effect of phase (F1,42 = 4.125, p = .049, ηp2 = .089), showing lower responding, irrespective of stimulus, in the late trials. There was no phase × stimulus interaction (F1,42 = 0.074, p = .787, ηp2 = .002). There was no main effect of IUS, nor were there any significant interactions with IUS (F < 2.5, p > .05, ηp2 < .06). There was a main effect of sex (F1,42 = 5.064, p = .030, ηp2 = .108), such that females extinguished better than males. We therefore included sex as a factor in the core day 2 analyses.
Spontaneous Recovery After Depletion
ATD modulated emotional responses during the spontaneous recovery phase (Figure 4A). ANCOVA was conducted with serotonin status (placebo, ATD), sex (male, female), and stimulus (CS+E, CS+N, CS−; first half of trials) as factors, controlling for strength of initial conditioning and IUS. SCR during acquisition was used as a covariate because we were interested in assessing the influence of ATD on memory expression, irrespective of how the strength of the initial memory affected expression a day later. IUS was used as an additional covariate because this trait can affect threat memory expression (34). There was a significant main effect of serotonin status (F1,41 = 7.729, p = .008, ηp2 = .159)—emotional responses were significantly attenuated under ATD. There was a main effect of stimulus (F2,68 = 3.750, p = .036, ηp2 = .084). There was no main effect of sex, nor were there any significant interactions with sex (F < 1.1, p > .05, ηp2 < .03). The strength of acquisition covariate was significant (F1,41 = 140.487, p = 1.311 × 10−16, ηp2 = .815). Rerunning the ANCOVA without IUS as a covariate also yielded a significant main effect of serotonin status (F1,42 = 5.406, p = .025, ηp2 = .114). IUS, furthermore, was a significant predictor over and above trait anxiety (55) (see Supplement). Paired t tests revealed that responses to the CS+E and CS+N, collapsed across serotonergic status, were each significantly greater than responses to the CS− (CS+E [t46 = −4.549, p = 3.9 × 10−5], CS+N [t46 = −5.089, p = 7 × 10−6]), demonstrating that return of threat memory expression occurred irrespective of serotonin status. Responses to the CS+E and CS+N did not differ from one another (t46 = −0.312, p = .756), likely because there was not robust extinction of the CS+E. There was no serotonin × stimulus interaction (F2,68 = 1.916, p = .162, ηp2 = .045), indicating that the effect of ATD was not specific to any CS. Conditioning to both CS+s from day 1 was retained on day 2 in both the placebo and ATD groups; however, overall emotional responsivity was diminished by ATD, irrespective of stimulus.
Relationship Between Spontaneous Recovery and Extent of Depletion
The extent of tryptophan depletion significantly correlated with the attenuation of threat responding but not with safety memory expression during the spontaneous recovery phase (Figure 5A). Critically, this substantiated the relationship between depletion and conditioned threat memory expression during spontaneous recovery. Using a partial correlation to control for strength of acquisition, IUS, and sex, there was a significant relationship between the degree of tryptophan depletion overall (including both placebo and ATD conditions) and the extent to which the threat memory returned. The extent of depletion correlated with the SCR to the CS+E and CS+N, and not to the CS−, indicating that the effect of tryptophan depletion did not generalize to safety memory expression: threat memory responses were more attenuated the greater the depletion (CS+E [r40 = .413, p = .007], CS+N [r40 = .389, p = .011], CS− [r40 = .113, p = .478]), which remained significant after being subjected to the Benjamini–Hochberg procedure at q = .15 for three comparisons (56). These relationships did not reach significance in the ATD condition alone (p > .05). However, there was no interaction between stimulus (CS+E, CS+N, CS−) and plasma results on SCR, as assessed by ANCOVA with plasma values, IUS score, sex, and strength of initial conditioning as predictors (F2,67 = 2.315, p = .115, ηp2 = .055).
Role of Intolerance of Uncertainty in ATD Effects on Spontaneous Recovery
Next, we examined how IUS score related to SCR during spontaneous recovery (Figure 6A). Correlation analyses between IUS score and SCR to each CS, controlling for strength of conditioning, revealed significant effects in the depletion group only: individuals more intolerant of uncertainty showed significantly diminished emotional expression to the CS+E (r25 = −.554, p = .004), CS+N (r25 = −.453, p = .023), and CS− (r25 = −.418, p = .038). Under placebo, this relationship with IUS score was not present (CS+E [r25 = −.135, p = .549], CS+N [r25 = −.249, p = .264], CS− [r25 = −.109, p = .629]). Critically, these results survived correction for six comparisons (56). Next, an interaction term between serotonin and IUS score was incorporated into the general linear model used in the initial analysis of spontaneous recovery, to examine whether IUS score and serotonin status interacted to modulate SCR to specific stimuli. ANCOVA with serotonin and IUS score as a between-subjects interaction term, controlling for main effects and strength of initial conditioning, sex (male, female) as an additional between-subjects factor, and stimulus (CS+E, CS+N, CS−) as within-subjects factors, did not show an interaction between serotonin and IUS score (F1,41 = 0.058, p = .811, ηp2 = .001) or between serotonin, IUS score, and stimulus (F2,67 = 1.278, p = .281, ηp2 = .030). While there was no interaction between ATD and IUS score, the correlation results suggest that ATD modulated the relationship between IUS score and SCR to the conditioned stimuli.
Reinstatement After Depletion
The SCRs to the US during reinstatement were unaffected by ATD (F1,39 = 0.729, p = .399, ηp2 = .018) (Figure 4B). Instead, ATD modulated cue-evoked SCRs during the reinstatement phase of the experiment. ANCOVA revealed a significant effect of serotonin status (F1,39 = 4.403, p = .042, ηp2 = .101), again with lower SCRs under ATD. By this stage in the experiment, however, there was no longer a main effect of stimulus (F1,47 = 0.083, p = .823, ηp2 = .002); there was no differential response to the CS+s relative to the CS−, and thus no reinstatement of the threat memory. There was also no serotonin × stimulus interaction (F1,47 = 1.306, p = .267, ηp2 = .032).
Relationship Between Reinstatement and Extent of Depletion
Controlling for strength of acquisition, IUS score, and sex, there was a significant correlation between depletion and CS+E and CS− responses but not between depletion and CS+N responses (CS+E [r38 = .413, p = .008], CS+N [r38 = .234, p = .146], and CS− [r38 = .455, p = .003]) (Figure 5B). These results were not predicted and need further investigation in future studies.
Reacquisition After Depletion
Because effects in these paradigms are often short lived (57), and participants’ SCRs tended to habituate later in the experiment, the same analysis used in the spontaneous recovery and reinstatement phases was repeated on the first two trials of the reacquisition phase, which showed a main effect of serotonin status: responses to the conditioned stimuli were attenuated overall by ATD (F1,39 = 6.974, p = .012, ηp2 = .152) (Figure 4C). There was no main effect of stimulus (F2,78 = 1.598, p = .209, ηp2 = .039), nor was there a serotonin × stimulus interaction (F2,78 = 2.194, p = .118, ηp2 = .053), providing no evidence of reconditioning in either group.
Relationship Between Reacquisition and Extent of Depletion
A partial correlation analysis was performed, as in the prior phases (accounting for sex), isolating the first two trials, as before. There was a significant correlation between depletion and SCRs to the CS+E and CS−, but not to the CS+N (CS+E [r38 = .475, p = .002], CS+N [r38 = .229, p = .156], CS− [r38 = .371, p = .018]) (Figure 5C). These results were not predicted and require further investigation in future studies.
Summary of Results
Baseline conditioning and extinction did not differ between those destined to receive placebo versus ATD. The key result was that ATD attenuated the expression of previously acquired emotion in the spontaneous recovery phase. While the reduction in SCR during the spontaneous recovery phase by ATD was not specific to any of the three stimuli at the group level, the greater the extent of depletion, the more the CS+E and CS+N were attenuated, whereas there was no such correlation for SCRs to the CS−. Differential conditioning was not abolished by ATD, and accounting for IUS score contributed to the prediction of how ATD modulated SCR during spontaneous recovery. Following ATD, individuals more intolerant of uncertainty showed significantly less emotional expression to all three stimuli during the spontaneous recovery phase. Importantly, SCR to the US was unaffected by ATD. ATD also attenuated responses during the reinstatement and reacquisition phases, consistent with the spontaneous recovery phase results; however, there was no longer evidence of differential conditioning.
Discussion
Here we showed, for the first time, that modulating serotonin affected the expression of aversive emotional memory in humans. During the key phase of the study—spontaneous recovery—ATD diminished physiological responses to the CS+s and CS− nonspecifically, and differential conditioning was preserved. Analysis of individual plasma samples, however, revealed that a greater degree of depletion was associated with reduced emotional responding to the CS+s, with no effect on CS− responses. These plasma data suggest that aversive emotional memory was attenuated by ATD. Examining intolerance of uncertainty, a trait previously related to spontaneous recovery (34), aided in uncovering how ATD affected emotion by contributing to the prediction of the general linear model. Individuals with a higher IUS score showed even lower responses during spontaneous recovery when depleted. ATD also attenuated cue-evoked SCRs during the reinstatement and reacquisition phases. Importantly, unconditioned responses were unaffected by ATD, indicating that the effect was specific to learned cues and not a general blunting of arousal encompassing responses to aversion itself. Mood was unaffected by ATD, consistent with previous studies of healthy volunteers (58, 59, 60). By using a task that elicited physiological reactions, however, it was possible to uncover an effect of serotonin on emotion. The primary implication of the study is that serotonin plays a central role in conditioned threat memory expression. Excessive serotonin signaling may be an important contributor to the persistence of pathological emotional reactions. This might be a feature of individuals who are highly intolerant of uncertainty, a trait we propose could represent a latent marker of vulnerability to serotonergic dysregulation.
The directionality of the depletion effects—a reduction, rather than enhancement, of emotion—may seem counterintuitive. These results, however, are in line with and advance influential theories of serotonin function (61, 62, 63) and are consistent with an array of experimental data (14,21,22,62,64). Serotonin is thought to be critically involved in predicting punishment, and aversively conditioned cues stimulate serotonin release (14,62, 63, 64). The present results are most directly comparable to, and therefore substantiated by, two studies that diminished serotonin function in healthy humans and showed attenuated SCR during threat conditioning of neutral cues (21,22). One of these studies additionally employed functional magnetic resonance imaging and found that the attenuation of SCR following ATD was accompanied by diminished signals in the amygdala and orbitofrontal cortex that were otherwise evoked by cues predictive of aversion (21). The current study represents an important extension of this work on initial conditioning in humans by addressing a critical clinically relevant question: How does lowering serotonin impact the intensity with which previously formed emotional memories return? Our results are also consistent with a study that conditioned rats off-drug and tested them a day later for threat memory expression under a different serotonergic manipulation. Acute SRI administration, which increases extracellular serotonin, enhanced conditioned threat memory expression, and this effect was blocked by administering a 5-HT2C antagonist (but not by a 5-HT3 antagonist) (65). Indeed, downregulation of 5-HT2C receptors is believed to occur with repeated administration of SRIs and may contribute to their therapeutic effects (62).
The present results appear to agree with what is known about the basic serotonergic innervation of different amygdala subnuclei. The basolateral nucleus of the amygdala (BLA) is critical for storing associations between cues and aversive outcomes (66). The central nucleus of the amygdala (CeA), meanwhile, is a major source of Pavlovian conditioned output from the amygdala and signals downstream to structures, including the hypothalamus and periacqueductal gray, that contribute to defensive reactions such as perspiration in humans and freezing in rodents (66). Critically, the BLA receives dense serotonergic innervation, while the CeA receives weak serotonergic input (14). Indeed, overexpressing 5-HT2C receptors in the BLA and infusing a 5-HT2A/2C agonist into the BLA enhanced defensive behaviors in rodents, whereas 5-HT2C knockout mice displayed the opposite behavioral effect (14). This is remarkably consistent with the present findings: emotional responses to predictive cues (conditioned stimuli), which should heavily engage serotonin signaling in the BLA, were modulated by ATD, whereas SCR to the aversive outcome itself was unaffected. Indeed, it is the CeA that responds to aversive outcomes (67). That activity associated with aversive expectations occurs in the BLA, but not in the CeA, has furthermore been associated with individual differences in trait anxiety in humans (67). Meanwhile, it should be noted that in the absence of stimuli, serotonin has an inhibitory role in the lateral amygdala of rats (68,69): this accords with the view that the amygdala is a relatively “silent” brain structure, containing a strong inhibitory network to minimize firing of cells spontaneously or to irrelevant stimuli (70).
Group-level SCR during the spontaneous recovery phase was lower under ATD for the CS−, as well as for the CS+s. While the CS− is safe and thus typically associated with lower SCRs regardless of ATD, the CS− can still evoke SCRs: anticipatory arousal may be diminished but not entirely absent. The implication, based on our data, is that normally occurring nonzero CS− responses (anticipatory arousal) are serotonergically mediated and thus attenuated by ATD. In the reinstatement and reacquisition phases, in which there was no longer a differential response to the CS+s relative to the CS− regardless of serotonin status, likely owing to the short-lived nature of effects in these paradigms (57), a similar logic applies: the nonspecific attenuation of cue-evoked SCRs by ATD appears to reflect serotonin-mediated anticipatory arousal. In other words, group-level analyses of the spontaneous recovery, reinstatement, and reacquisition phases show that ATD attenuated anticipatory arousal elicited by both the CS+ and CS−.
An important limitation is that we did not see robust evidence for complete extinction on day 1. One reason could be the use of partial reinforcement during acquisition, which can prolong conditioning (43,71,72). We employed two CS+s to compare retention of conditioning versus retention of extinction: ultimately, these could not be definitively parsed. While the lack of difference between the CS+E and CS+N on day 2 is likely due to incomplete extinction, it is also possible (10) that including the CS+N in all day 2 phases cued memory for conditioning on day 1—thus enhancing memory expression for CS+E—more so than an extinction memory trace. SCR habituated during reinstatement and reacquisition, which often occurs (57), but made it more difficult to ascertain effects. The ATD group tended to have nonsignificantly lower SCRs even before depletion: while this could possibly have affected results after depletion, a covariate was included to control for this possibility. The distribution of SCR values, furthermore, was highly variable, even after appropriate transformation.
Another limitation is that serotonin was not measured directly. ATD as a method has been critiqued (73), yet defended on the basis of considerable evidence (18,20). Consonant results from human ATD studies and rodent experiments with 5,7-dihydroxytryptamine (50,74), which induces profound serotonin loss, bolsters the case that ATD reduces central serotonin.
We have shown for the first time that lowering serotonin attenuated the subsequent return of threat responses, conditioned prior to depletion: this has particular clinical relevance and advances the human literature on serotonin and threat conditioning (5,7,8,12,14). Integrating traits and neurochemical state is relevant for understanding vulnerability in health and may inform transdiagnostic mechanisms of illness to refine psychiatric classification (49) and help direct treatment strategies.
Acknowledgments and Disclosures
This work was supported by a Wellcome Trust Senior Investigator Award (Grant No. 104631/Z/14/Z [to TWR]), the National Institute for Health Research Cambridge Biomedical Research Centre (Mental Health Theme) (to BJS), the UK Medical Research Council (Grant No. MC_PC_17213 [to RNC]), a Gates Cambridge Scholarship (to JWK), and an Angharad Dodds John Bursary in Mental Health and Neuropsychiatry (to JWK). The views expressed are those of the authors and not necessarily those of the National Institute for Health Research or the Department of Health and Social Care.
We thank the staff at the National Institute for Health Research/Wellcome Trust Clinical Research Facility at Addenbrooke’s Hospital, where the study was conducted, and Rachel Kyd of the Cambridge University Hospital Research and Development Office for assistance with study approval.
TWR discloses consultancy with Cambridge Cognition, Greenfields Bioventures, and Unilever; he receives research grants from Shionogi & Co and GlaxoSmithKline, royalties for CANTAB from Cambridge Cognition, and editorial honoraria from Springer Verlag and Elsevier. BJS discloses consultancy with Cambridge Cognition, Greenfield BioVentures, and Cassava Sciences and receives royalties for CANTAB from Cambridge Cognition. RNC consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press. All other authors report no biomedical financial interests or potential conflicts of interest.
Footnotes
Supplementary material cited in this article is available online at https://doi.org/10.1016/j.bpsc.2020.12.012.
Supplementary Material
References
- 1.Milad M.R., Pitman R.K., Ellis C.B., Gold A.L., Shin L.M., Lasko N.B. Neurobiological basis of failure to recall extinction memory in posttraumatic stress disorder. Biol Psychiatry. 2009;66:1075–1082. doi: 10.1016/j.biopsych.2009.06.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kim M.J., Loucks R.A., Palmer A.L., Brown A.C., Solomon K.M., Marchante A.N., Whalen P.J. The structural and functional connectivity of the amygdala: From normal emotion to pathological anxiety. Behav Brain Res. 2011;223:403–410. doi: 10.1016/j.bbr.2011.04.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Marin M.F., Zsido R.G., Song H., Lasko N.B., Killgore W.D.S., Rauch S.L. Skin conductance responses and neural activations during fear conditioning and extinction recall across anxiety disorders. JAMA Psychiatry. 2017;74:622–631. doi: 10.1001/jamapsychiatry.2017.0329. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Apergis-Schoute A.M., Gillan C.M., Fineberg N.A., Fernandez-Egea E., Sahakian B.J., Robbins T.W. Neural basis of impaired safety signaling in obsessive compulsive disorder. Proc Natl Acad Sci U S A. 2017;114:3216–3221. doi: 10.1073/pnas.1609194114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.McLaughlin N.C.R., Strong D., Abrantes A., Garnaat S., Cerny A., O’Connell C. Extinction retention and fear renewal in a lifetime obsessive-compulsive disorder sample. Behav Brain Res. 2015;280:72–77. doi: 10.1016/j.bbr.2014.11.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Milad M.R., Furtak S.C., Greenberg J.L., Keshaviah A., Im J.J., Falkenstein M.J. Deficits in conditioned fear extinction in obsessive-compulsive disorder and neurobiological changes in the fear circuit. JAMA Psychiatry. 2013;70:608–618. doi: 10.1001/jamapsychiatry.2013.914. [DOI] [PubMed] [Google Scholar]
- 7.Holt D.J., Coombs G., Zeidan M.A., Goff D.C., Milad M.R. Failure of neural responses to safety cues in schizophrenia. Arch Gen Psychiatry. 2012;69:893–903. doi: 10.1001/archgenpsychiatry.2011.2310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Graham B.M., Milad M.R. The study of fear extinction: Implications for anxiety disorders. Am J Psychiatry. 2011;168:1255–1265. doi: 10.1176/appi.ajp.2011.11040557. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.LeDoux J.E., Pine D.S. Using neuroscience to help understand fear and anxiety: A two-system framework. Am J Psychiatry. 2016;173:1083–1093. doi: 10.1176/appi.ajp.2016.16030353. [DOI] [PubMed] [Google Scholar]
- 10.Bouton M.E. Context, ambiguity, and unlearning: Sources of relapse after behavioral extinction. Biol Psychiatry. 2002;52:976–986. doi: 10.1016/s0006-3223(02)01546-9. [DOI] [PubMed] [Google Scholar]
- 11.Schiller D., Delgado M.R. Overlapping neural systems mediating extinction, reversal and regulation of fear. Trends Cogn Sci. 2010;14:268–276. doi: 10.1016/j.tics.2010.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Milad M.R., Quirk G.J. Fear extinction as a model for translational neuroscience: Ten years of progress. Annu Rev Psychol. 2012;63:129–151. doi: 10.1146/annurev.psych.121208.131631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cools R., Roberts A.C., Robbins T.W. Serotoninergic regulation of emotional and behavioural control processes. Trends Cogn Sci. 2008;12:31–40. doi: 10.1016/j.tics.2007.10.011. [DOI] [PubMed] [Google Scholar]
- 14.Bauer E.P. Serotonin in fear conditioning processes. Behav Brain Res. 2015;277:68–77. doi: 10.1016/j.bbr.2014.07.028. [DOI] [PubMed] [Google Scholar]
- 15.Stahl S.M. 4th ed. Cambridge University Press; Cambridge, United Kingdom: 2013. Stahl’s Essential Psychopharmacology: Neuroscientific Basis and Practical Applications. [Google Scholar]
- 16.Bel N., Artigas F. Reduction of serotonergic function in rat brain by tryptophan depletion: Effects in control and fluvoxamine-treated rats. J Neurochem. 1996;67:669–676. doi: 10.1046/j.1471-4159.1996.67020669.x. [DOI] [PubMed] [Google Scholar]
- 17.Biggio G., Fadda F., Fanni P., Tagliamonte A., Gessa G.L. Rapid depletion of serum tryptophan, brain tryptophan, serotonin and 5-hydroxyindoleacetic acid by a tryptophan-free diet. Life Sci. 1974;14:1321–1329. doi: 10.1016/0024-3205(74)90440-8. [DOI] [PubMed] [Google Scholar]
- 18.Crockett M.J., Clark L., Roiser J.P., Robinson O.J., Cools R., Chase H.W. Converging evidence for central 5-HT effects in acute tryptophan depletion. Mol Psychiatry. 2012;17:121–123. doi: 10.1038/mp.2011.106. [DOI] [PubMed] [Google Scholar]
- 19.Nishizawa S., Benkelfat C., Young S.N., Leyton M., Mzengeza S., de Montigny C. Differences between males and females in rates of serotonin synthesis in human brain. Proc Natl Acad Sci. 1997;94:5308–5313. doi: 10.1073/pnas.94.10.5308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Young S.N. Acute tryptophan depletion in humans: A review of theoretical, practical and ethical aspects. J Psychiatry Neurosci. 2013;38:294–305. doi: 10.1503/jpn.120209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Hindi Attar C., Finckh B., Büchel C. The influence of serotonin on fear learning. PLoS One. 2012;7 doi: 10.1371/journal.pone.0042397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Hensman R., Guimaraes F.S., Wang M., Deakin J.F.W. Effects of ritanserin on aversive classical conditioning in humans. Psychopharmacology (Berl) 1991;104:220–224. doi: 10.1007/BF02244182. [DOI] [PubMed] [Google Scholar]
- 23.Grillon C., Chavis C., Covington M.F., Pine D.S. Two-week treatment with the selective serotonin reuptake inhibitor citalopram reduces contextual anxiety but not cued fear in healthy volunteers: A fear-potentiated startle study. Neuropsychopharmacology. 2009;34:964–971. doi: 10.1038/npp.2008.141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Grillon C., Levenson J., Pine D.S. A single dose of the selective serotonin reuptake inhibitor citalopram exacerbates anxiety in humans: A fear-potentiated startle study. Neuropsychopharmacology. 2007;32:225–231. doi: 10.1038/sj.npp.1301204. [DOI] [PubMed] [Google Scholar]
- 25.Robinson O.J., Overstreet C., Allen P.S., Pine D.S., Grillon C. Acute tryptophan depletion increases translational indices of anxiety but not fear: Serotonergic modulation of the bed nucleus of the stria terminalis? Neuropsychopharmacology. 2012;37:1963–1971. doi: 10.1038/npp.2012.43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bui E., Orr S.P., Jacoby R.J., Keshaviah A., Leblanc N.J., Milad M.R. Two weeks of pretreatment with escitalopram facilitates extinction learning in healthy individuals. Hum Psychopharmacol Clin Exp. 2013;28:447–456. doi: 10.1002/hup.2330. [DOI] [PubMed] [Google Scholar]
- 27.Karpova N.N., Pickenhagen A., Lindholm J., Tiraboschi E., Kulesskaya N., Agustsdottir A. Fear erasure in mice requires synergy between antidepressant drugs and extinction training. Science. 2011;334:1731–1734. doi: 10.1126/science.1214592. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Burghardt N.S., Sigurdsson T., Gorman J.M., McEwen B.S., LeDoux J.E. Chronic antidepressant treatment impairs the acquisition of fear extinction. Biol Psychiatry. 2013;73:1078–1086. doi: 10.1016/j.biopsych.2012.10.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Hartley C.A., McKenna M.C., Salman R., Holmes A., Casey B.J., Phelps E.A., Glatt C.E. Serotonin transporter polyadenylation polymorphism modulates the retention of fear extinction memory. Proc Natl Acad Sci U S A. 2012;109:5493–5498. doi: 10.1073/pnas.1202044109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Elliott R., Zahn R., Deakin J.F.W., Anderson I.M. Affective cognition and its disruption in mood disorders. Neuropsychopharmacology. 2011;36:153–182. doi: 10.1038/npp.2010.77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Harmer C.J., Bhagwagar Z., Cowen P.J., Goodwin G.M. Acute administration of citalopram facilitates memory consolidation in healthy volunteers. Psychopharmacology (Berl) 2002;163:106–110. doi: 10.1007/s00213-002-1151-x. [DOI] [PubMed] [Google Scholar]
- 32.Harmer C.J., Phil D., Shelley N.C., Cowen P.J., Psych F.R.C., Goodwin G.M. Increased positive versus negative affective perception and memory in healthy volunteers following selective serotonin and norepinephrine reuptake inhibition. Am J Psychiatry. 2004;161:1256–1263. doi: 10.1176/appi.ajp.161.7.1256. [DOI] [PubMed] [Google Scholar]
- 33.Harmer C.J., Rogers R.D., Tunbridge E., Cowen P.J., Goodwin G.M. Tryptophan depletion decreases the recognition of fear in female volunteers. Psychopharmacology (Berl) 2003;167:411–417. doi: 10.1007/s00213-003-1401-6. [DOI] [PubMed] [Google Scholar]
- 34.Dunsmoor J.E., Campese V.D., Ceceli A.O., LeDoux J.E., Phelps E.A. Novelty-facilitated extinction: Providing a novel outcome in place of an expected threat diminishes recovery of defensive responses. Biol Psychiatry. 2015;78:203–209. doi: 10.1016/j.biopsych.2014.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Freeston M.H., Rhéaume J., Letarte H., Dugas M.J., Ladouceur R. Why do people worry? Pers Individ Dif. 1994;17:791–802. [Google Scholar]
- 36.Lucas K., Luck C.C., Lipp O.V. Novelty-facilitated extinction and the reinstatement of conditional human fear. Behav Res Ther. 2018;109:68–74. doi: 10.1016/j.brat.2018.08.002. [DOI] [PubMed] [Google Scholar]
- 37.Morriss J., Saldarini F., Chapman C., Pollard M., van Reekum C.M. Out with the old and in with the new: The role of intolerance of uncertainty in reversal of threat and safety. J Exp Psychopathol. 2019;10 2043808719834451. [Google Scholar]
- 38.Morriss J., Macdonald B., Van Reekum C.M. What is going on around here? Intolerance of uncertainty predicts threat generalization. PLoS One. 2016;11 doi: 10.1371/journal.pone.0154494. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Morriss J., van Reekum C.M. I feel safe when I know: Contingency instruction promotes threat extinction in high intolerance of uncertainty individuals. Behav Res Ther. 2019;116:111–118. doi: 10.1016/j.brat.2019.03.004. [DOI] [PubMed] [Google Scholar]
- 40.Morriss J. What do I do now? Intolerance of uncertainty is associated with discrete patterns of anticipatory physiological responding to different contexts. Psychophysiology. 2019;56 doi: 10.1111/psyp.13396. [DOI] [PubMed] [Google Scholar]
- 41.Morriss J., Christakou A., van Reekum C.M. Intolerance of uncertainty predicts fear extinction in amygdala-ventromedial prefrontal cortical circuitry. Biol Mood Anxiety Disord. 2015;5:4. doi: 10.1186/s13587-015-0019-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Morriss J., Christakou A., van Reekum C.M. Nothing is safe: Intolerance of uncertainty is associated with compromised fear extinction learning. Biol Psychol. 2016;121:187–193. doi: 10.1016/j.biopsycho.2016.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Morriss J., Wake S., Lindner M., McSorley E., Dodd H. How many times do I need to see to believe? The impact of intolerance of uncertainty and exposure experience on safety-learning and retention in young adults. Int J Psychophysiol. 2020;153:8–17. doi: 10.1016/j.ijpsycho.2020.04.012. [DOI] [PubMed] [Google Scholar]
- 44.Carleton R.N., Norton M.A.P.J., Asmundson G.J.G. Fearing the unknown: A short version of the Intolerance of Uncertainty Scale. J Anxiety Disord. 2007;21:105–117. doi: 10.1016/j.janxdis.2006.03.014. [DOI] [PubMed] [Google Scholar]
- 45.Carleton R.N. Into the unknown: A review and synthesis of contemporary models involving uncertainty. J Anxiety Disord. 2016;39:30–43. doi: 10.1016/j.janxdis.2016.02.007. [DOI] [PubMed] [Google Scholar]
- 46.Gentes E.L., Ruscio A.M. A meta-analysis of the relation of intolerance of uncertainty to symptoms of generalized anxiety disorder, major depressive disorder, and obsessive-compulsive disorder. Clin Psychol Rev. 2011;31:923–933. doi: 10.1016/j.cpr.2011.05.001. [DOI] [PubMed] [Google Scholar]
- 47.McEvoy P.M., Mahoney A.E.J. To be sure, to be sure: Intolerance of uncertainty mediates symptoms of various anxiety disorders and depression. Behav Ther. 2012;43:533–545. doi: 10.1016/j.beth.2011.02.007. [DOI] [PubMed] [Google Scholar]
- 48.Fetzner M.G., Horswill S.C., Boelen P.A., Carleton R.N. Intolerance of uncertainty and PTSD symptoms: Exploring the construct relationship in a community sample with a heterogeneous trauma history. Cognit Ther Res. 2013;37:725–734. [Google Scholar]
- 49.Cuthbert B.N., Insel T.R. Toward the future of psychiatric diagnosis: The seven pillars of RDoC. BMC Med. 2013;11:126. doi: 10.1186/1741-7015-11-126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Worbe Y., Savulich G., Voon V., Fernandez-Egea E., Robbins T.W. Serotonin depletion induces “waiting impulsivity” on the human four-choice serial reaction time task: Cross-species translational significance. Neuropsychopharmacology. 2014;39:1519–1526. doi: 10.1038/npp.2013.351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Raio C.M., Brignoni-Perez E., Goldman R., Phelps E.A. Acute stress impairs the retrieval of extinction memory in humans. Neurobiol Learn Mem. 2014;112:212–221. doi: 10.1016/j.nlm.2014.01.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Schiller D., Kanen J.W., LeDoux J.E., Monfils M.-H., Phelps E.A. Extinction during reconsolidation of threat memory diminishes prefrontal cortex involvement. Proc Natl Acad Sci U S A. 2013;110:20040–20045. doi: 10.1073/pnas.1320322110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Haaker J., Golkar A., Hermans D., Lonsdorf T.B. A review on human reinstatement studies: An overview and methodological challenges. Learn Mem. 2014;21:424–440. doi: 10.1101/lm.036053.114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Carpenter L.L., Anderson G.M., Pelton G.H., Gudin J.A., Kirwin P.D.S., Price L.H. Tryptophan depletion during continuous CSF sampling in healthy human subjects. Neuropsychopharmacology. 1998;19:26–35. doi: 10.1016/S0893-133X(97)00198-X. [DOI] [PubMed] [Google Scholar]
- 55.Spielberger C., Gorsuch R., Lushene R. Consult Psychologists Press; Palo Alto, CA: 1983. STAI Manual for the State-Trait Anxiety Inventory. [Google Scholar]
- 56.Skandali N., Rowe J.B., Voon V., Deakin J.B., Cardinal R.N., Cormack F. Dissociable effects of acute SSRI (escitalopram) on executive, learning and emotional functions in healthy humans. Neuropsychopharmacology. 2018;43:2645–2651. doi: 10.1038/s41386-018-0229-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Gershman S.J., Hartley C.A. Individual differences in learning predict the return of fear. Learn Behav. 2015;43:243–250. doi: 10.3758/s13420-015-0176-z. [DOI] [PubMed] [Google Scholar]
- 58.Bell C.J., Hood S.D., Nutt D.J. Acute tryptophan depletion. Part II: Clincal effects and implications. Aust N Z J Psychiatry. 2005;39:565–574. doi: 10.1080/j.1440-1614.2005.01628.x. [DOI] [PubMed] [Google Scholar]
- 59.Booij L., Van der Does a JW., Riedel W.J. Monoamine depletion in psychiatric and healthy populations: Review. Mol Psychiatry. 2003;8:951–973. doi: 10.1038/sj.mp.4001423. [DOI] [PubMed] [Google Scholar]
- 60.Ruhé H.G., Mason N.S., Schene A.H. Mood is indirectly related to serotonin, norepinephrine and dopamine levels in humans: A meta-analysis of monoamine depletion studies. Mol Psychiatry. 2007;12:331–359. doi: 10.1038/sj.mp.4001949. [DOI] [PubMed] [Google Scholar]
- 61.Cools R., Nakamura K., Daw N.D. Serotonin and dopamine: Unifying affective, activational, and decision functions. Neuropsychopharmacology. 2011;36:98–113. doi: 10.1038/npp.2010.121. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Deakin J.F.W. The origins of “5-HT and mechanisms of defence” by Deakin and Graeff: A personal perspective. J Psychopharmacol. 2013;27:1084–1089. doi: 10.1177/0269881113503508. [DOI] [PubMed] [Google Scholar]
- 63.Deakin J.F.W., Graeff F. 5-HT and mechanisms of defence. J Psychopharmacol. 1991;5:305–315. doi: 10.1177/026988119100500414. [DOI] [PubMed] [Google Scholar]
- 64.Bocchio M., McHugh S.B., Bannerman D.M., Sharp T., Capogna M. Serotonin, amygdala and fear: Assembling the puzzle. Front Neural Circuits. 2016;10:24. doi: 10.3389/fncir.2016.00024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Burghardt N.S., Bush D.E.A., McEwen B.S., LeDoux J.E. Acute selective serotonin reuptake inhibitors increase conditioned fear expression: Blockade with a 5-HT2C receptor antagonist. Biol Psychiatry. 2007;62:1111–1118. doi: 10.1016/j.biopsych.2006.11.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.LeDoux J.E. Emotion circuits in the brain. Annu Rev Neurosci. 2000;23:155–184. doi: 10.1146/annurev.neuro.23.1.155. [DOI] [PubMed] [Google Scholar]
- 67.Michely J., Rigoli F., Rutledge R.B., Hauser T.U., Dolan R.J. Distinct processing of aversive experience in amygdala subregions. Biol Psychiatry Cogn Neurosci Neuroimaging. 2019;5:291–300. doi: 10.1016/j.bpsc.2019.07.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Stutzmann G.E., McEwen B.S., Ledoux J.E. Serotonin modulation of sensory inputs to the lateral amygdala: Dependency on corticosterone. J Neurosci. 1998;18:9529–9538. doi: 10.1523/JNEUROSCI.18-22-09529.1998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Stutzmann G.E., LeDoux J.E. GABAergic antagonists block the inhibitory effects of serotonin in the lateral amygdala: A mechanism for modulation of sensory inputs related to fear conditioning. J Neurosci. 1999;19:RC8. doi: 10.1523/JNEUROSCI.19-11-j0005.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.LeDoux J. The amygdala. Curr Biol. 2007;17:868–874. doi: 10.1016/j.cub.2007.08.005. [DOI] [PubMed] [Google Scholar]
- 71.Grady A.K., Bowen K.H., Hyde A.T., Totsch S.K., Knight D.C. Effect of continuous and partial reinforcement on the acquisition and extinction of human conditioned fear. Behav Neurosci. 2016;130:36–43. doi: 10.1037/bne0000121. [DOI] [PubMed] [Google Scholar]
- 72.Leonard D.W. Partial reinforcement effects in classical aversive conditioning in rabbits and human beings. J Comp Physiol Psychol. 1975;88:596–608. doi: 10.1037/h0076419. [DOI] [PubMed] [Google Scholar]
- 73.van Donkelaar E.L., Blokland A., Ferrington L., Kelly P.A.T., Steinbusch H.W.M., Prickaerts J. Mechanism of acute tryptophan depletion: Is it only serotonin? Mol Psychiatry. 2011;16:695–713. doi: 10.1038/mp.2011.9. [DOI] [PubMed] [Google Scholar]
- 74.Winstanley C.A., Dalley J.W., Theobald D.E.H., Robbins T.W. Fractioning impulsivity: Contrasting effects of central 5-HT depletion on different measures of impulsive behaviour. Neuropsychopharmacology. 2004;29:1331–1343. doi: 10.1038/sj.npp.1300434. [DOI] [PubMed] [Google Scholar]
- 75.Beck A.T., Steer R.A., Ball R., Ranieri W.F. Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. J Pers Assess. 1996;67:588–597. doi: 10.1207/s15327752jpa6703_13. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.