Abstract
Background
Major depressive disorder (MDD) is characterized by a high risk for relapses and chronic developments. Clinical characteristics such as residual symptoms have been shown to negatively affect the long-term course of MDD. However, it is unclear so far how trait repetitive negative thinking (RNT) as well as cognitive and affective momentary states, the latter experienced during daily-life, affect the long-term course of MDD.
Method
We followed up 57 remitted depressed (rMDD) individuals six (T2) and 36 (T3) months after baseline. Clinical outcomes were time to relapse, time spent with significant symptoms as a marker of chronicity, and levels of depressive symptoms at T2 and T3. Predictors assessed at baseline included residual symptoms and trait RNT. Furthermore, momentary daily life affect and momentary rumination, and their variation over the day were assessed at baseline using ambulatory assessment (AA).
Results
In multiple models, residual symptoms and instability of daily-life affect at baseline independently predicted a faster time to relapse, while chronicity was significantly predicted by trait RNT. Multilevel models revealed that depressive symptom levels during follow-up were predicted by baseline residual symptom levels and by instability of daily-life rumination. Both instability features were linked to a higher number of anamnestic MDD episodes.
Conclusions
Our findings indicate that trait RNT, but also affective and cognitive processes during daily life impact the longer-term course of MDD. Future longitudinal research on the role of respective AA-phenotypes as potential transdiagnostic course-modifiers is warranted.
Introduction
Major depressive disorder (MDD) is a highly prevalent mental disorder characterized by a high risk of chronicity and relapse [1–3]. In light of the unfavorable long-term course of MDD, it is important to identify risk factors that contribute to the clinical course of the disorder. In previous studies, clinical characteristics such as the number of previous episodes and subclinical residual symptoms have been identified as relevant course modifiers [2, 4, 5]. Less is known about the influence of maladaptive habitual cognitive thinking on the long-term course of depression. First evidence suggests that rumination, a cognitive trait defined as a negative pattern of responding to distress by repetitively and passively focusing on the meanings, causes, and consequences of one’s depressive symptoms [6, 7] predicts symptom severity [8, 9], as well as a chronic symptom course in depression [10]. Maladaptive habitual thinking styles like rumination or worry are subordinate constructs of the broader concept of trait repetitive negative thinking (RNT) [11, 12]. RNT is defined as repeatedly occurring, uncontrollable, negative and abstract thoughts from which it is difficult to disengage and has been considered to represent a potential transdiagnostic cognitive risk factor for various mental disorders [12]. Studies suggest that trait RNT is cross-sectionally associated with symptoms and treatment outcomes of depression and anxiety [11, 13, 14]. Only one study so far has identified the predictive validity of RNT for the 3-year course of depressive symptoms in a nonclinical sample [15]. Comparable data in clinically depressed samples is still missing.
In contrast to macro-level risk factors such as trait RNT, possible dysfunctional cognitive and affective momentary state variables reflect mental states at the micro-level of moment-to-moment experiencing during daily life (cf. [16, 17, 18]). The investigation of such momentary experiences and their variability over the day appears important, because there is increasing evidence that they may affect the course of psychopathology at the macro-level (for a review see [18]). A promising approach to examine micro-level risk factors in depression is ambulatory assessment (AA) [16, 19]. Here, individual data is repeatedly collected over a given period of time and in different contexts. During AA, individuals rate their affective states and current thoughts or activities. Thereby, it is possible to assess state-like vulnerability factors in a naturalistic context and to investigate their predictive value for the future course of illness [18, 20].
Several studies have investigated affective state variables showing that MDD patients report less positive and more negative affect in daily life compared to healthy controls [21, 22]. Recent efforts undertaken to test predictive effects of momentary affective processes on the course of depression yielded compelling results, substantiating that individual responses to stressful and rewarding events during daily life are associated with future depressive symptoms [18, 23, 24]. In addition, depressive individuals seem to display a distinct affective dynamic over the day [25–27]. Mood instability has predominantly been studied in patients with other psychopathology, such as those with borderline personality disorder [28, 29], but first evidence suggests that, for example, variations in negative affect may also have detrimental effects on the clinical course [30] and treatment response [31] in MDD. Furthermore, by applying a dynamic system framework, we could previously show that high entropy, i.e. frequent and unpredictable changes in the interplay between momentary mood and rumination, was related to an increase of depressive symptoms during six months in remitted depressed (rMDD) individuals [32].
There is a clear lack of AA-studies investigating momentary cognitive processes as a potential course-modifying vulnerability factor. One such possibly important cognitive momentary risk factor is daily-life rumination. Up to now, momentary rumination has been predominantly examined in non-clinical samples, thereby demonstrating an increase in depressive symptoms, e.g. sleep disturbances [33] or negative affect [34] over a short period. Furthermore, depressive symptoms in a student sample were predicted by the level of momentary rumination [35]. Compared to control participants, clinically depressed and anxious individuals are characterized by higher levels of momentary rumination [36]. In a previous study [37], we found that momentary rumination was associated with higher cortisol secretion over the day in rMDD individuals, demonstrating prolonged activation of the bodily stress system in response to rumination with possible detrimental effects on the further course of depression. However, studies explicitly investigating the impact of momentary rumination and its instability over the day on the long-term course of depression in clinical samples are lacking.
In summary, it appears of high importance to investigate the possible predictive value of both trait RNT and momentary affective and cognitive states during daily life for the long-term course of depression. Therefore, the present study aimed to test the predictive validity of such traits and states at baseline on course-related outcomes, i.e., time to relapse, chronicity, and levels of depressive symptoms over three years, in individuals with rMDD. Although clinical predictors were not the focus of the study, we chose to additionally include residual symptom levels at baseline, which are considered a potent clinical predictor for relapse and other poor outcomes in depression [38–40], and which also overlap with other clinical predictors such as the severity of the previous index episode [41].
Based on previous research showing that both high entropy and variability in daily-life affect appears to be linked to an increase in depressive symptoms in rMDD individuals [30, 32] we expected that a fluctuating course (i.e., relapses) would be predominantly predicted by instability measures of daily life affect and cognition. Up to now, these variability measures have not been tested for the more stringent criteria of relapse. In contrast, first evidence suggests a link between habitual rumination and a chronic symptom course [10] leading to the hypothesis that chronicity and symptom level outcomes would predominantly be predicted by trait RNT.
Methods
Procedure
Participants were recruited by announcements in local newspapers and on the homepage of the Central Institute of Mental Health (CIMH), Mannheim, Germany. After a telephone prescreening, preliminary eligible participants were invited to the CIMH, and a trained clinical psychologist administered the Structured Clinical Interview for DSM-IV axis I (SCID-I, [42], see below) as part of the baseline interview (T1) to assess in- and exclusion criteria. All rMDD individuals had to fulfill either the criteria for at least two lifetime MDD episodes or a previous chronic MDD of at least two years duration. At T1, they had to be remitted from the last episode, i.e., did not fulfill the criteria of a Major Depressive Episode according to DSM-IV, for at least two months. Exclusion criteria were non-affective psychotic disorders, bipolar disorder, substance dependence, current substance abuse, generalized anxiety disorder, and current obsessive-compulsive, posttraumatic stress, and eating disorder according to DSM-IV. In addition to rMDD participants, the study also recruited healthy individuals, which are, howerver, not subject to the present analyses.
Demographic, clinical, and cognitive trait predictors in rMDD individuals were assessed at T1, followed by ambulatory assessment (AA) of affective and cognitive state factores, assessed during the days immediately following the diagnostic baseline interview (see paragraph “Predictor variables”). Follow-ups on the course of clinical depression and depressive symptoms took place at six (T2) and 36 months (T3) after baseline and were conducted by a trained clinical psychologist during a telephone interview. At all measurement points, we assessed diagnostic status and symptom levels and, at T2 and T3, the course of depression since the last assessment.
Importantly, the present study sample of rMDD participants consisted of two consecutively recruited subsamples (subsample 1: Oct 2010 to Apr 2011, subsample 2: Nov 2011 to Nov 2012) from an overarching study. The two subsamples underwent different functional magnetic resonance imaging (fMRI) experiments, conducted after the ambulatory assessment days, which are not subject to the present analyses (see, [43]). In addition, the AA of subsample 1 was restricted to the assessment of naturally occurring mood and rumination over the day, whereas in subsample 2 an additional rumination versus mindful self-focus manipulation during AA was conducted. The two AA-procedures are described in the supporting information (S1), together with detailed analyses regarding the comparability of subsample 1 and 2 and the legitimation for their combined inclusion for the present long-term analyses. The study was in accordance with the Declaration of Helsinki and was approved by the local Ethics Committee of the University of Heidelberg. All participants gave written informed consent.
Sample recruitment and attrition
Originally, 101 individuals were contacted during the telephone prescreening, of whom eight participants were excluded (n = 2 fulfilling fMRI exclusion criteria (see above), n = 6 declined to participate). At the diagnostic baseline session (T1), 27 individuals were excluded due to diagnostic exclusion criteria, resulting in a sample of n = 66 remitted depressed (rMDD) individuals with whom the comprehensive baseline assessment was carried out. Of those, one participant dropped out after T1 (could not be reached), and eight individuals dropped out after T2 (n = 1 moved abroad, n = 7 could not be reached). Consequently, 57 of initially recruited 66 participants (86.4%) provided data for all measurement points and were included in the present analyses. Demographic and clinical characteristics at study entry did not differ significantly between participants participating in both follow-ups and those who dropped out during the study, with one exception: there was a significant dropout of participants with lower education levels (n = 9 drop outs vs n = 57 completers: school education < 10y: χ2 = 5.33, p = .021). In contrast, individuals who completed the study and those who dropped out did not differ with regard to clinical variables at T1 (n = 9 drop outs vs n = 57 completers: BDI-II: t = -.225, p = .823, MADRS: t = -.431, p = .668, number of previous episodes: χ2 = .085, p = .771).
Outcome measures
The following three outcome measures related to the course of illness were investigated: time to relapse, chronicity and depressive symptom levels. The current diagnostic status at all measurement points (T1-T3) was determined with the SCID-I [42]. If an individual met criteria for a current major depressive episode (MDE) during the follow-up assessments (T2, T3), we coded the number of weeks since the beginning of the current episode. Additionally, we coded the number of weeks related to the beginning and ending of those depressive episodes occurring exclusively during the follow-up intervals. Thereby, we assessed both pure interval episodes during the T1-T2 and T2-T3 intervals and episodes that were present at T2 and T3.
Time to relapse
For the outcome “time to relapse”, we calculated the number of weeks to the first MDE after T1. Relapse was defined as the recurrence of a depressive syndrome fulfilling criteria of a MDD after T1. This term was used as an umbrella term for relapses (i.e. within six months after remission, n = 1) and recurrences (i.e. after six months, n = 20). Due to the limited sample size, we combined these two outcomes to increase statistical power.
Chronicity
Chronicity was defined as the percentage of weeks spent with significant symptoms (i.e., without distinct symptom relieve) after T1 using the information of the expanded SCID-I at T2 and T3.
Depressive symptom levels
As a measure of levels and course of depressive symptoms we used the self-rated Beck Depression Inventory Revised (BDI-II, [44]) and the interviewer-rated Montgomery and Asberg Depression Rating Scale (MADRS, [45]), which both have shown good reliability, validity and sensitivity to symptom changes [46–48]. For statistical analysis, we calculated an overall composite score for depressive symptoms by averaging the z-standardized BDI-II and MADRS scores both at T2 and T3, as done in previous research (e.g., [37, 49]).
Predictor variables
Demographic and clinical variables
Demographic variables included age, gender and education status. Clinical variables included residual depressive symptoms at baseline (T1) and current use of medication at T1 (the latter to check for possible confounding effects with residual symptoms and outcome measures). Depressive symptoms at T1 were calculated as a composite score of the MADRS and the BDI-II scores (see above).
Trait repetitive negative thinking
Trait repetitive negative thinking (RNT) was measured with the Perseverative Thinking Questionnaire (PTQ, [12, 50]), which is conceptualized as a content-independent measure of RNT. Individuals are asked how they typically think about negative experiences or problems. Research has shown that the PTQ has good psychometric properties, i.e. internal consistency, stability, factor-structure and construct validity [50, 51].
Affective and cognitive state variables
After the baseline interview, affective and cognitive state variables were assessed by AA during the following days. In subsample 1 (n = 28), participants were assessed with personal digital assistants (PDAs, Palm Tungsten E2, Palm Inc.) and the software IzyBuilder (IzyData Ltd., Fribourg, CH) over two consecutive weekdays with ten assessments per day (for detailed description see [37]). AA in subsample 2 (n = 29), was conducted over four consecutive weekdays with ten assessments per day using smartphones (HTC Touch Diamond 2) and the software MyExperienceIDE by movisens GmbH (Karlsruhe, Germany). The two subsamples completed identical affective and cognitive AA measures (for further details, see supporting information S1).
Momentary mood was measured with six bipolar items specifically developed for AA [52] that were collapsed into the three scales “valence” (items “content-discontent”, “unwell-well”), “calmness” (items “agitated-calm”, “relaxed-tense”) and “energetic arousal” (items “tired-awake”, “full of energy-without energy”). Three items (one per subscale) were recoded so that higher values indicate a more positive mood component. These subjective mood scales have shown good reliability and validity [52].
Momentary ruminative self-focus was operationalized with the average score of two items developed by Moberly and Watkins [34]: “At the moment, I am thinking about my problems” and “At the moment, I am thinking about my feelings”. These items proved to be suitable for studies with AA-designs [34, 53]. Fig 1. shows the overall study design.
Statistical analyses
For the AA predictors, we used aggregated scores, i.e. overall means over the respective assessment days, of the momentary scales (valence, calmness, energetic arousal, rumination) together with their averaged instability scores. The latter were calculated according to von Neumann and collegues [54] using the mean squared successive difference (MSSD, see Eq (1)).
(1) |
The MSSD represents instabilities in a time series as an average of all squared successive changes over time. Thereby, MSSD takes into account three components of instability: temporal order, amplitude and frequency of change. A high MSSD score reflects high temporal instability as a result of high amplitudes and high frequency of, e.g., mood swings over the day, corresponding to low temporal dependency [55–57]. MSSD is highly correlated with the standard deviation (SD) [55]. However, compared to variability, defined as the dispersion of scores from a central tendency, MSSD takes into account gradual shifts in means over time [55]. For example, while the variability of the mood component “energetic arousal” [52] would be similar for a person with two extreme states of “energetic arousal” in the morning and evening compared to a person with frequent, less extreme swings of “energetic arousal” over the day, MSSD reflects these differences [55]. MSSDs were calculated for each momentary mood component and for momentary rumination.
For each outcome, we present the results of simple regression analyses, i.e., the association between outcome and each predictor separately in a first step. To determine the independent contribution of each predictor, we then entered those predictors with a p-value of < .05 simultaneously into a multiple model using backward elimination of predictors, and retained all predictors in the model that significantly (p < .05) contributed to the respective outcome. Effects of predictors on time to relapse were estimated using Cox regressions. To predict chronicity, we applied linear regression analyses with the percentage of weeks spent with significant symptoms as the dependent variable. This outcome was positively skewed and therefore log-transformed to yield a better approximation of a normal distribution. Effects on depressive symptom levels were analyzed by hierarchical linear models with depressive composite scores at T2 and T3 as outcome. For the latter analyses, we first tested main effects of individual predictors and their interaction effect with time (T2, T3) in separate regression models. If the interaction term did not reach statistical significance, we removed this term from the respective models. In a next step we included all significant predictors and significant interaction effects in a multiple model.
In all multiple models described above, subsample status was included as a covariate to control for possible confounding effects of this variable (for further information, see supporting information S1). All statistical analyses were performed using the statistical software IBM SPSS Version 20.
Results
Participants’ characteristics
Demographic, clinical, as well as cognitive trait and state characteristics are presented in Table 1. The mean age at MDD-onset in rMDD participants was 23.8 years (SD = 11.2), and 70% of these individuals reported at least 3 lifetime MDD episodes upon entering the study.
Table 1. Demographic, clinical, cognitive trait and affective and cognitive state characteristics in remitted depressed patients (rMDD) at baseline.
rMDD (n = 57) | ||
---|---|---|
Mean (SD) / % | Range (min–max) | |
demographic | ||
age (SD) | 43 (10.3) | (23–55) |
gender (female %) | 70.2% | |
education (% > 10 years) | 63.2% | |
work situation (% in regular job or education) | 68.4% | |
marital status (% married or living together) | 49.1% | |
clinical | ||
BDI-II1 | 10.6 (8.8) | (0–36) |
MADRS2 | 5.8 (4.8) | (0–22) |
current psychotherapy | 22.8% | |
current psychotropic medication3 | 24.6% | |
number of previous episodes | 3.8 (1.9) | (1–7) |
duration of previous hospitalization (weeks) | 9.3 (12.9) | (0–75) |
residual symptom levels (composite score BDI-II1,MADRS2) | 0.5 (1.0) | (-0.8–4.1) |
trait repetitive negative thinking | ||
PTQ4 | 30.8 (14.5) | (0–60) |
affective state variables (AA)5,6 | ||
daily-life valence | 3.7 (0.9) | (2.4–5.9) |
daily-life calmness | 3.4 (0.9) | (1.6–5.7) |
daily-life energetic arousal | 3.4 (0.8) | (1.7–5.4) |
instability of daily-life valence | 1.3 (0.9) | (0.04–3.8) |
instability of daily-life calmness | 1.6 (1.2) | (0.2–6.6) |
instability of daily-life energetic arousal | 1.6 (1.1) | (0.2–5.0) |
cognitive state variables (AA)5,6 | ||
daily-life rumination | 1.6 (1.1) | (0–4.2) |
instability of state rumination | 2.9 (2.6) | (0–9.2) |
1 BDI-II BeckDepressionInventory II
2 MADRS Montgomery and Asberg Depression Rating Scale
3 selective serotonin reuptake inhibitors (SSRIs): n = 4, serotonin-norepinephrine reuptake inhibitors (SNRIs): n = 5, noradrenergic and specific serotonergic antidepressant: n = 2, selective serotonin and noradrenalin reuptake inhibitor (SSNRI): n = 1, tricyclic antidepressants (TCAs): n = 1, amber: n = 1, Lithium: n = 2, atypical antipsychotic medication: n = 1; anticonvulsant: n = 1; n = 4 participants with multiple prescriptions
4 PTQ Perseverative Thinking Questionnaire
5AA Ambulatory Assessment
6averaged across assessment days.
During the 3-year follow-up period, 28 (49.1%) of the originally remitted depressed patients had suffered at least one relapse into a major depressive episode. Furthermore, the mean proportion of weeks spent with significant symptoms during the 3-year interval was 34.9% (range 1%–95%) with 28% spending more than 50% of the weeks with significant symptoms.
Predictors of time to relapse
Simple Cox regression analyses revealed that higher levels of residual depressive symptoms, as well as higher instability of momentary rumination (AA) and of valence (AA) predicted a shorter time to relapse (Table 2). We further conducted correlational analyses on the relationship between number of previous episodes and predictors. The respective coefficients are: r = 0.246 (p = .067) for residual symptoms; r = 0.308 (p = .022) for instability of momentary valence and r = 0.468 (p < .001) for instability of momentary rumination.
Table 2. Simple and multiple regression models for time to relapse, chronicity, and depression scores (T2, T3) in remitted depressed patients (rMDD).
outcome variables | shorter time to relapse after T1a (n = 57) | chronicity/ % of weeks with significant symptoms after T1b (n = 57) | composite depression score (BDI-II/MADRS) T2, T3c (n = 57) | |||
---|---|---|---|---|---|---|
predictors | simple | multiplef | simple | multiplef | simple | multiplef |
B (SE) | B (SE) | B (SE) | B (SE) | B (SE) | B (SE) | |
demographics | ||||||
Age | 0.003 (0.019) | - | - 0.001 (0.014) | - | 0.007 (0.010) | - |
sex (1 = m, 2 = f) | -0.518 (0.388) | - | - 0.547 (0.313) | - | 0.236 (0.239) | - |
education level (0 = ≥10y, 1 = <10 y) | 0.238 (0.040) | - | 0.074 (0.304) | - | -0.034 (0.229) | - |
clinical variables | ||||||
medication use (0 = no, 1 = yes) | -0.116 (0.437) | - | -0.388 (0.337) | - | -0.366 (0.303) | - |
residual symptoms at baseline | 0.498 (0.173)** | 0.585 (0.187)** | 0.360(0.135)** | - | 0.522(0.082)*** | 0.502(0.077)*** |
trait repetetive negative thinking | 0.020 (0.014) | - | 0.037(0.039)*** | 0.032(0.009)*** | 0.024(0.007)*** | - |
affective state variables (AA)d | ||||||
valence | -0.289 (0.240) | - | -0.293 (0.160) | - | -0.386(0.113)** | - |
energetic arousal | -0.189 (0.248) | - | -0.366(0.181)* | - | -0.436(0.128)** | - |
calmness | -0.291 (0.242) | - | -0.202 (0.169) | - | -0.338(0.120)* | - |
instability of valence | 0.396(0.191)* | 0.511 (0.205)* | 0.213 (0.159) | - | 0.209 (0.118) | - |
instability of energetic arousal | 0.156 (0.147) | - | 0.165 (0.129) | - | 0.064 (0.099) | - |
instability of calmness | 0.229 (0.131) | - | 0.214 (0.119) | - | 0.089 (0.091) | - |
cognitive state variables (AA)d | ||||||
rumination | 0.275 (0.162) | - | 0.185 (0.132) | - | 0.283(0.093)** | - |
rumination*timee | - | - | - | - | 0.290(0.127)* | - |
instability of daily-life rumination | 0.138(0.065)* | - | 0.093 (0.057) | - | 0.099(0.042)* | 0.065 (0.031)* |
a cox regression model
b linear regression model
c mixed models (hierarchical linear models)
d AA Ambulatory Assessment variable
e model includes main effects and interaction effect of predictor and time
f all multiple models included subsample status as a covariate
*** p < .001
** p < .01
* p < .05
Fig 2. shows the corresponding survival curve (remaining in remission), estimated by the product-limit method of Kaplan and Meier, for rMDD individuals with low (A) and high instability (B) of affective valence at T1. In the multiple model, residual symptoms at baseline (B = .585, SE = .187, Wald = 9.7, p = .002), and higher instability of momentary valence (AA, B = .511, SE = .205, Wald = 6.1, p = .013) remained as independent significant predictors of time to relapse in the model.
Predictors of chronicity
Higher levels of residual symptoms at baseline, more trait RNT, and lower levels of momentary energetic arousal (AA) were associated with a higher percentage of weeks spent with significant symptoms in the simple regression analyses (Table 2). In the multiple analysis, only higher levels of trait RNT (B = .032, SE = .009, t = 3.37, p = .001) remained in the final model (Table 2).
Predictors of depressive symptom levels
Simple mixed model analyses revealed that higher levels of depression scores (T2, T3) were predicted by more severe residual symptoms, higher levels of trait RNT, higher momentary rumination (AA) and its interaction with time, higher instability of momentary rumination (AA), as well as by lower levels of momentary positive valence, energetic arousal and calmness (AA) during daily life. In the final multiple model, depression scores at baseline (B = .503, SE = .077, t = 6.52, p = < .001) and instability of daily-life rumination (AA) at baseline (B = .065, SE = .031, t = 2.11, p = .037) were retained as independent significant predictors.
Discussion
The present longitudinal study investigated both trait and state predictors for the course of depression in a community sample of remitted depressed individuals with regard to risk of relapse, chronicity and symptom levels during an observation period of three years. We identified a rather unfavorable long-term depression course in our sample. During the 3-year follow-up, approximately half of the sample had suffered a relapse into a Major Depressive Episode, and nearly 30% had spent more than half of the follow-up period with significant depressive symptoms. Rates of relapses and chronicity are largely comparable to those found in previous research [3, 5, 58].
In the present study, a shorter time to relapse was predicted by higher residual symptom levels, higher instability of momentary mood (valence) and higher instability of rumination during daily life (AA) at baseline. In the multiple model, residual symptoms, and higher instability of momentary mood (AA) remained as significant independent predictors. Similar to our results, previous research has identified residual depressive symptomatology as a serious risk factor for relapse [2, 59, 60]. Given the high prevalence of residual symptoms during remission [61], even after successful treatment [39], this clearly deserves more attention in future relapse prevention efforts for depression. Regarding the predictive role of momentary affective state characteristics for the long-term course of illness, our results showed that a faster time to relapse was predicted by higher instability of momentary mood at baseline, thereby confirming our hypothesis. In previous studies, negative affect variability has been found to predict future negative affective symptoms in rMDD individuals [30] and treatment response in individuals with MDD [31]. Our longitudinal results confirm and expand these findings by showing that affective instability increases the vulnerability towards relapse [25, 29]. This finding has possible clinical implications. While current intervention programs aim to reduce the prolonged negative affect in acutely depressed individuals, fluctuations in everyday affect appear to be linked to a larger susceptibility for relapses or recurrences and could therefore specifically be considered in relapse prevention programs. Clearly, these considerations warrant more rigorous testing in future research.
Chronicity, i.e., the proportion of weeks spent with significant symptoms, was predicted by residual symptom levels, high levels of trait repetitive negative thinking (RNT) and low levels of momentary energetic arousal during daily life (AA) at baseline. In the multiple model, trait repetitive negative thinking was the most powerful and single remaining predictor. These results confirm our hypothesis suggesting that dysfunctional cognitive traits represent an important course moderating factor with regard to the development of a chronic course. Concordantly, high levels of habitual state orientation [60], dysfunctional attitudes [62] as well as ruminative thinking [10] have been found to be heightened in chronic depressed individuals or to predict a chronic symptom course.
Finally, depressive symptom levels at follow-up (T2, T3) were predicted by higher levels of residual symptoms and trait RNT, as well as by virtually all cognitive and affective state variables (AA). Residual symptom levels and instability of daily-life rumination (AA) remained as independent significant predictors in the multiple model. With respect to cognitive state variables (AA), we found that, contrary to our expectation, the instability of daily life rumination over the day (AA) was an even more important predictor for longer-term elevated levels of depressive symptoms than respective mean levels. A question is why higher levels of fluctuation in rumination could be maladaptive with this regard. Possibly, the instability of rumination was related to daily life stressors, which may have mediated the effect on depression symptom levels. However, this has not been investigated in the present study and therefore remains speculative. Our analyses do also not allow to decide whether possible emotional cascades, characterized by reciprocal cycles of rumination and negative affect, or pure cognitive fluctuations in the context of more stable elevated negative mood at baseline, predicted long-term elevated depressed symptoms (cf. [63, 64]). Further research is required on these aspects.
This study has several limitations. First, in order to include patients with a primary diagnosis of MDD, individuals with certain comorbid diagnoses were excluded, which may have led to a somewhat selective sample. Second, we combined samples from two substudies with a somewhat different baseline assessment design. To account for a possible influence of subsample status, we controlled for this variable and could not identify a possible confounding effect in any of the predictor analyses. Third, although dropout rates were satisfactorily low during the three-year period, we observed a selective dropout of rMDD individuals with lower education levels, thereby reducing the generalizability of our results. Fourth, although all rMDD participants had to be out of episode for at least two months before study inclusion, their residual symptom levels varied markedly. Fifth, we did not control for stressful daily-life events in the present analyses. Thus, it is difficult to conclude how much individual differences in the assessed affective and cognitive states were affected by environmental influences [25, 65]. Sixth, due to the investigated outcomes, the instability measures had to be aggregated, thereby eliminating the dynamic aspect at the within-subject level. However, MSSD still is a measure of instability, demonstrating differences in emotional fluctuations on the between-subject level [54, 57]. Finally, the multiple models showed that single predictors were correlated, and one could argue that the presentation of results from simple models is dispensable. However, we think that these results yield information about predictors that could be relevant for research questions in future studies, which may particularly apply to the daily life measures in hand.
To conclude, our results imply that illness-related characteristics and cognitive vulnerability traits, but also affective and cognitive state variables assessed during daily life, impact the longer-term course of depression. While trait repetitive negative thinking particularly predicted longer-term chronicity, the assessed state variables partly differently affected relapses and levels of depressive symptoms. Our findings imply that particularly those rMDD individuals showing high fluctuations in daily-life affect are susceptible to relapses, while individuals with a more frequent unstable pattern of rumination over the day are especially prone to suffer from persistently elevated symptoms. Importantly, these findings were not attributable to higher residual depression levels at baseline since this course-relevant clinical predictor was also retained in the respective final multiple models. Thereby, the assessed state variables provided independent contributions for the prediction of outcomes.
The present findings have several implications. First, our longitudinal results suggest that mood and rumination instability during daily life, indicating specific patterns of emotional dysregulation [25, 29], might reflect a kind of scarring process (cf.[20]) in patients with former episodes, which–per se or in combination with other risk factors–increases vulnerability towards relapse and maintenance of depressive symptoms. In fact, both variability parameters were significantly associated with the number of anamnestic MDE episodes in that the more depressive episodes an individual had experienced in the past, the higher were the current levels of mood and rumination instability. This finding is in line with a more dimensional view on scars, suggesting a gradual development of vulnerability factors with every MDD episode [20]. Connected herewith, it has been proposed that ambulatory assessment enables to assess basic regulatory processes such as stress reactivity, reward dependence, and affective instability, which may be relevant for a number of mental disorders [66]. As regards the latter, previous daily life research has investigated affective and cognitive instability features primarily in the context of other disorders such as bipolar disorder [67], borderline personality disorder [28, 29], and non-suicidal self-injury [63, 68]. The present study suggests that instability features may also play a role as course-relevant modifiers in major depression, thereby lending support for their role as transdiagnostic endophenotypes (cf.[66]). Future longitudinal research testing the role of these AA-phenotypes across mental disorders is clearly warranted. Finally, the study of the dynamic interplay of momentary cognitive and affective variables at the micro-level may help to even better understand determinants of the course of macro-level symptoms and diagnosis [18, 20].
Supporting information
Data Availability
All relevant data are within the paper and its Supporting Information files.
Funding Statement
Support was provided by Deutsche Forschungsgemeinschaft DFG KU1464/4-1,2, KI576/12-1,2 [www.dfg.de]. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry. 2005;62(6):593–602. doi: 10.1001/archpsyc.62.6.593 [DOI] [PubMed] [Google Scholar]
- 2.Hardeveld F, Spijker J, De Graaf R, Nolen WA, Beekman ATF. Prevalence and predictors of recurrence of major depressive disorder in the adult population. Acta Psychiatrica Scandinavica. 2010;122(3):184–91. doi: 10.1111/j.1600-0447.2009.01519.x [DOI] [PubMed] [Google Scholar]
- 3.Richards D. Prevalence and clinical course of depression: A review. Clinical Psychology Review. 2011;31(7):1117–25. doi: 10.1016/j.cpr.2011.07.004 [DOI] [PubMed] [Google Scholar]
- 4.Seemüller F, Meier S, Obermeier M, Musil R, Bauer M, Adli M, et al. Three-year long-term outcome of 458 naturalistically treated inpatients with major depressive episode: Severe relapse rates and risk factors. European Archives of Psychiatry and Clinical Neuroscience. 2014;264(7):567–75. doi: 10.1007/s00406-014-0495-7 [DOI] [PubMed] [Google Scholar]
- 5.Hardeveld F, Spijker J, De Graaf R, Nolen WA, Beekman ATF. Recurrence of major depressive disorder and its predictors in the general population: Results from The Netherlands Mental Health Survey and Incidence Study (NEMESIS). Psychological Medicine. 2013;43(1):39–48. doi: 10.1017/S0033291712002395 [DOI] [PubMed] [Google Scholar]
- 6.Lyubomirsky S, Layous K, Chancellor J, Nelson SK. Thinking about rumination: The scholarly contributions and intellectual legacy of Susan Nolen-Hoeksema. Annual Review of Clinical Psychology. 2015;11:1–22. doi: 10.1146/annurev-clinpsy-032814-112733 [DOI] [PubMed] [Google Scholar]
- 7.Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. Rethinking rumination. Perspectives on Psychological Science. 2008;3(5):400–24. doi: 10.1111/j.1745-6924.2008.00088.x [DOI] [PubMed] [Google Scholar]
- 8.Kuehner C, Weber I. Responses to depression in unipolar depressed patients: An investigation of Nolen-Hoeksema's response styles theory. Psychological Medicine. 1999;29(6):1323–33. [DOI] [PubMed] [Google Scholar]
- 9.Gan P, Xie Y, Duan W, Deng Q, Yu X. Rumination and loneliness independently predict six-month later depression symptoms among Chinese elderly in nursing homes. PLoS ONE. 2015;10(9). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Wiersma JE, van Oppen P, van Schaik DJF, van der Does AJW, Beekman ATF, Penninx BWJH. Psychological characteristics of chronic depression: A longitudinal cohort study. Journal of Clinical Psychiatry. 2011;72(3):288–94. doi: 10.4088/JCP.09m05735blu [DOI] [PubMed] [Google Scholar]
- 11.McEvoy PM, Watson H, Watkins ER, Nathan P. The relationship between worry, rumination, and comorbidity: Evidence for repetitive negative thinking as a transdiagnostic construct. Journal of Affective Disorders. 2013;151(1):313–20. doi: 10.1016/j.jad.2013.06.014 [DOI] [PubMed] [Google Scholar]
- 12.Ehring T, Watkins ER. Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Therapy. 2008;1(3):192–205. [Google Scholar]
- 13.Kertz SJ, Koran J, Stevens KT, Björgvinsson T. Repetitive negative thinking predicts depression and anxiety symptom improvement during brief cognitive behavioral therapy. Behaviour Research and Therapy. 2015;68:54–63. doi: 10.1016/j.brat.2015.03.006 [DOI] [PubMed] [Google Scholar]
- 14.Spinhoven P, Drost J, van Hemert B, Penninx BW. Common rather than unique aspects of repetitive negative thinking are related to depressive and anxiety disorders and symptoms. Journal of Anxiety Disorders. 2015;33:45–52. doi: 10.1016/j.janxdis.2015.05.001 [DOI] [PubMed] [Google Scholar]
- 15.Raes F. Repetitive negative thinking predicts depressed mood at 3-year follow-up in students. Journal of Psychopathology and Behavioral Assessment. 2012;34(4):497–501. [Google Scholar]
- 16.Trull TJ, Ebner-Priemer U. Ambulatory assessment. Annual Review of Clinical Psychology. 2013;9:151–76. doi: 10.1146/annurev-clinpsy-050212-185510 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Conner TS, Barrett LF. Trends in ambulatory self-report: The role of momentary experience in psychosomatic medicine. Psychosomatic Medicine. 2012;74(4):327–37. doi: 10.1097/PSY.0b013e3182546f18 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wichers M. The dynamic nature of depression: A new micro-level perspective of mental disorder that meets current challenges. Psychological Medicine. 2014;44(7):1349–60. doi: 10.1017/S0033291713001979 [DOI] [PubMed] [Google Scholar]
- 19.Fahrenberg J, Myrtek M, Pawlik K, Perrez M. Ambulatory assessment—Monitoring behavior in daily life settings: A behavioral-scientific challenge for psychology. European Journal of Psychological Assessment. 2007;23(4):206–13. [Google Scholar]
- 20.Wichers M, Geschwind N, van Os J, Peeters F. Scars in depression: Is a conceptual shift necessary to solve the puzzle? Psychological Medicine. 2010;40(3):359–65. [DOI] [PubMed] [Google Scholar]
- 21.Myin-Germeys I, Peeters F, Havermans R, Nicolson NA, deVries MW, Delespaul P, et al. Emotional reactivity to daily life stress in psychosis and affective disorder: An experience sampling study. Acta Psychiatrica Scandinavica. 2003;107(2):124–31. [DOI] [PubMed] [Google Scholar]
- 22.Peeters F, Berkhof J, Delespaul P, Rottenberg J, Nicolson NA. Diurnal mood variation in major depressive disorder. Emotion. 2006;6(3):383–91. doi: 10.1037/1528-3542.6.3.383 [DOI] [PubMed] [Google Scholar]
- 23.Wichers M, Geschwind N, Jacobs N, Kenis G, Peeters F, Derom K, et al. Transition from stress sensitivity to a depressive state: Longitudinal twin study. The British Journal of Psychiatry. 2009;195(6):498–503. doi: 10.1192/bjp.bp.108.056853 [DOI] [PubMed] [Google Scholar]
- 24.Geschwind N, Peeters F, Jacobs N, Delespaul P, Derom C, Thiery E, et al. Meeting risk with resilience: High daily life reward experience preserves mental health. Acta Psychiatrica Scandinavica. 2010;122(2):129–38. doi: 10.1111/j.1600-0447.2009.01525.x [DOI] [PubMed] [Google Scholar]
- 25.Koval P, Pe ML, Meers K, Kuppens P. Affect dynamics in relation to depressive symptoms: Variable, unstable or inert? Emotion. 2013;13(6):1132–41. doi: 10.1037/a0033579 [DOI] [PubMed] [Google Scholar]
- 26.Thompson RJ, Mata J, Jaeggi SM, Buschkuehl M, Jonides J, Gotlib IH. The everyday emotional experience of adults with major depressive disorder: Examining emotional instability, inertia, and reactivity. Journal of Abnormal Psychology. 2012;121(4):819–29. doi: 10.1037/a0027978 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Ebner-Priemer UW, Trull TJ. Ecological momentary assessment of mood disorders and mood dysregulation. Psychological Assessment. 2009;21(4):463–75. doi: 10.1037/a0017075 [DOI] [PubMed] [Google Scholar]
- 28.Santangelo P, Reinhard I, Mussgay L, Steil R, Sawitzki G, Klein C, et al. Specificity of affective instability in patients with borderline personality disorder compared to posttraumatic stress disorder, bulimia nervosa, and healthy controls. Journal of Abnormal Psychology. 2014;123(1):258–72. doi: 10.1037/a0035619 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Trull TJ, Lane SP, Koval P, Ebner-Priemer UW. Affective dynamics in psychopathology. Emotion Review. 2015;7(4):355–61. doi: 10.1177/1754073915590617 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Wichers M, Peeters F, Geschwind N, Jacobs N, Simons CJP, Derom C, et al. Unveiling patterns of affective responses in daily life may improve outcome prediction in depression: A momentary assessment study. Journal of Affective Disorders. 2010;124(1–2):191–5. doi: 10.1016/j.jad.2009.11.010 [DOI] [PubMed] [Google Scholar]
- 31.Husen K, Rafaeli E, Rubel JA, Bar-Kalifa E, Lutz W. Daily affect dynamics predict early response in CBT: Feasibility and predictive validity of EMA for outpatient psychotherapy. Journal of Affective Disorders. 2016;206:305–14. doi: 10.1016/j.jad.2016.08.025 [DOI] [PubMed] [Google Scholar]
- 32.Koster EHW, Fang L, Marchetti I, Ebner-Priemer U, Kirsch P, Huffziger S, et al. Examining the relation between mood and rumination in remitted depressed individuals: A dynamic systems analysis. Clinical Psychological Science. 2015;3(4):619–27. [Google Scholar]
- 33.Kalmbach DA, Pillai V, Roth T, Drake CL. The interplay between daily affect and sleep: A 2‐week study of young women. Journal of Sleep Research. 2014;23(6):636–45. doi: 10.1111/jsr.12190 [DOI] [PubMed] [Google Scholar]
- 34.Moberly NJ, Watkins ER. Ruminative self-focus and negative affect: An experience sampling study. Journal of Abnormal Psychology. 2008;117(2):314–23. doi: 10.1037/0021-843X.117.2.314 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Pasyugina I, Koval P, De Leersnyder J, Mesquita B, Kuppens P. Distinguishing between level and impact of rumination as predictors of depressive symptoms: An experience sampling study. Cognition and Emotion. 2015;29(4):736–46. doi: 10.1080/02699931.2014.932755 [DOI] [PubMed] [Google Scholar]
- 36.Kircanski K, Thompson RJ, Sorenson JE, Sherdell L, Gotlib IH. Rumination and Worry in Daily Life: Examining the Naturalistic Validity of Theoretical Constructs. Clinical Psychological Science. 2015;3(6):926–39. doi: 10.1177/2167702614566603 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Huffziger S, Ebner-Priemer U, Zamoscik V, Reinhard I, Kirsch P, Kuehner C. Effects of mood and rumination on cortisol levels in daily life: An ambulatory assessment study in remitted depressed patients and healthy controls. Psychoneuroendocrinology. 2013;38(10):2258–67. doi: 10.1016/j.psyneuen.2013.04.014 [DOI] [PubMed] [Google Scholar]
- 38.Fava GA, Fabbri S, Sonino N. Residual symptoms in depression: An emerging therapeutic target. Progress in Neuro-Psychopharmacology & Biological Psychiatry. 2002;26(6):1019–27. [DOI] [PubMed] [Google Scholar]
- 39.Zajecka JM. Residual symptoms and relapse: Mood, cognitive symptoms, and sleep disturbances. Journal of Clinical Psychiatry. 2013;74(Suppl 2):9–13. [DOI] [PubMed] [Google Scholar]
- 40.Zajecka J, Kornstein SG, Blier P. Residual symptoms in major depressive disorder: Prevalence, effects, and management. The Journal of Clinical Psychiatry. 2013;74(4):407–14. doi: 10.4088/JCP.12059ah1 [DOI] [PubMed] [Google Scholar]
- 41.Madhoo M, Levine SZ. Initial severity effects on residual symptoms in response and remission: A STARD study during and after failed citalopram treatment. Journal of Clinical Psychopharmacology. 2015;35(4):450–3. doi: 10.1097/JCP.0000000000000354 [DOI] [PubMed] [Google Scholar]
- 42.Wittchen HU, Zaudig M, Fydrich T. Structured Clinical Interview for DSM-IV—German version. Göttingen: Hogrefe; 1997. [Google Scholar]
- 43.Zamoscik V, Huffziger S, Ebner-Priemer U, Kuehner C, Kirsch P. Increased involvement of the parahippocampal gyri in a sad mood predicts future depressive symptoms. Social Cognitive and Affective Neuroscience. 2014;9(12):2034–40. doi: 10.1093/scan/nsu006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Beck AT, Steer RA, Brown GK. Beck-Depression-Inventar 2ed. Frankfurt Main, Germany: Pearson; 2006. [Google Scholar]
- 45.Neumann NU, Schulte RM. Montgomery-Asberg-Depression-Rating-Scale—German version. Göttingen: Hogrefe; 1989. [Google Scholar]
- 46.Beck AT, Steer RA, Garbin MG. Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review. 1988;8(1):77–100. [Google Scholar]
- 47.Kjærgaard M, Arfwedson Wang CE, Waterloo K, Jorde R. A study of the psychometric properties of the Beck Depression Inventory‐II, the Montgomery and Ásberg Depression Rating Scale, and the Hospital Anxiety and Depression Scale in a sample from a healthy population. Scandinavian Journal of Psychology. 2014;55(1):83–9. doi: 10.1111/sjop.12090 [DOI] [PubMed] [Google Scholar]
- 48.Kuehner C, Buerger C, Keller F, Hautzinger M. [Reliability and validity of the Revised Beck Depression Inventory (BDI-II). Results from German samples]. Der Nervenarzt. 2007;78(6):651–6. doi: 10.1007/s00115-006-2098-7 [DOI] [PubMed] [Google Scholar]
- 49.Huffziger S, Reinhard I, Kuehner C. A longitudinal study of rumination and distraction in formerly depressed inpatients and community controls. Journal of Abnormal Psychology. 2009;118(4):746–56. doi: 10.1037/a0016946 [DOI] [PubMed] [Google Scholar]
- 50.Ehring T, Zetsche U, Weidacker K, Wahl K, Schönfeld S, Ehlers A. The Perseverative Thinking Questionnaire (PTQ): Validation of a content-independent measure of repetitive negative thinking. Journal of Behavior Therapy and Experimental Psychiatry. 2011;42(2):225–32. doi: 10.1016/j.jbtep.2010.12.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Ehring T, Raes F, Weidacker K, Emmelkamp PMG. Validation of the Dutch version of the Perseverative Thinking Questionnaire (PTQ-NL). European Journal of Psychological Assessment. 2012;28(2):102–8. [Google Scholar]
- 52.Wilhelm P, Schoebi D. Assessing mood in daily life: Structural validity, sensitivity to change, and reliability of a short-scale to measure three basic dimensions of mood. European Journal of Psychological Assessment. 2007;23(4):258–67. [Google Scholar]
- 53.Huffziger S, Ebner-Priemer U, Koudela S, Reinhard I, Kuehner C. Induced rumination in everyday life: Advancing research approaches to study rumination. Personality and Individual Differences. 2012;53(6):790–5. [Google Scholar]
- 54.von Neumann J, Kent RH, Bellinson HR, Hart BI. The Mean Square Successive Difference. The Annals of Mathematical Statistics. 1941;2:153–62. [Google Scholar]
- 55.Ebner-Priemer UW, Eid M, Kleindienst N, Stabenow S, Trull TJ. Analytic strategies for understanding affective (in)stability and other dynamic processes in psychopathology. Journal of Abnormal Psychology. 2009;118(1):195–202. doi: 10.1037/a0014868 [DOI] [PubMed] [Google Scholar]
- 56.Ebner-Priemer UW, Sawitzki G. Ambulatory assessment of affective instability in borderline personality disorder: The effect of the sampling frequency. European Journal of Psychological Assessment. 2007;23(4):238–47. [Google Scholar]
- 57.Jahng S, Wood PK, Trull TJ. Analysis of affective instability in ecological momentary assessment: Indices using successive difference and group comparison via multilevel modeling. Psychological Methods. 2008;13(4):354–75. doi: 10.1037/a0014173 [DOI] [PubMed] [Google Scholar]
- 58.Bukh JD, Andersen PK, Kessing LV. Rates and predictors of remission, recurrence and conversion to bipolar disorder after the first lifetime episode of depression–a prospective 5-year follow-up study. Psychological Medicine. 2016. [DOI] [PubMed] [Google Scholar]
- 59.Iovieno N, van Nieuwenhuizen A, Clain A, Baer L, Nierenberg AA. Residual symptoms after remission of major depressive disorder with fluoxetine and risk of relapse. Depression and Anxiety. 2011;28(2):137–44. doi: 10.1002/da.20768 [DOI] [PubMed] [Google Scholar]
- 60.Kuehner C, Huffziger S. Factors predicting the long-term illness course in a cohort of depressed inpatients. European Archives of Psychiatry and Clinical Neuroscience. 2013;263(5):413–23. doi: 10.1007/s00406-012-0379-7 [DOI] [PubMed] [Google Scholar]
- 61.Conradi HJ, Ormel J, de Jonge P. Presence of individual (residual) symptoms during depressive episodes and periods of remission: A 3-year prospective study. Psychological Medicine. 2011;41(6):1165–74. doi: 10.1017/S0033291710001911 [DOI] [PubMed] [Google Scholar]
- 62.Riso LP, du Toit PL, Blandino JA, Penna S, Dacey S, Duin JS, et al. Cognitive aspects of chronic depression. Journal of Abnormal Psychology. 2003;112(1):72–80. [PubMed] [Google Scholar]
- 63.Selby EA, Franklin J, Carson‐Wong A, Rizvi SL. Emotional cascades and self‐injury: Investigating instability of rumination and negative emotion. Journal of Clinical Psychology. 2013;69(12):1213–27. doi: 10.1002/jclp.21966 [DOI] [PubMed] [Google Scholar]
- 64.Selby EA, Joiner TE Jr. Emotional cascades as prospective predictors of dysregulated behaviors in borderline personality disorder. Personality Disorders: Theory, Research, and Treatment. 2013;4(2):168–74. [DOI] [PubMed] [Google Scholar]
- 65.Bylsma LM, Taylor-Clift A, Rottenberg J. Emotional reactivity to daily events in major and minor depression. Journal of Abnormal Psychology. 2011;120(1):155–67. doi: 10.1037/a0021662 [DOI] [PubMed] [Google Scholar]
- 66.Wenzel M, Kubiak T, Ebner-Priemer UW. Ambulatory assessment as a means of longitudinal phenotypes characterization in psychiatric disorders. Neuroscience Research. 2016;102:13–21. doi: 10.1016/j.neures.2014.10.018 [DOI] [PubMed] [Google Scholar]
- 67.Knowles R, Tai S, Jones SH, Highfield J, Morriss R, Bentall RP. Stability of self-esteem in bipolar disorder: Comparisons among remitted bipolar patients, remitted unipolar patients and healthy controls. Bipolar Disorders. 2007;9(5):490–5. doi: 10.1111/j.1399-5618.2007.00457.x [DOI] [PubMed] [Google Scholar]
- 68.Santangelo PS, Koenig J, Funke V, Parzer P, Resch F, Ebner-Priemer UW, et al. Ecological momentary assessment of affective and interpersonal instability in adolescent non-suicidal self-injury. Journal of Abnormal Child Psychology. 2016. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are within the paper and its Supporting Information files.