Abstract
Few studies have investigated nonsuicidal self-injury (NSSI) as a predictor of outcomes other than suicidal self-injury, severely limiting our understanding of this behavior’s full range of consequences. Three independent studies were used to examine the prospective association between NSSI and two outcomes: depressive symptoms and self-criticism. Data were collected from samples of (1) adults with past-month NSSI, (2) adults with lifetime NSSI, and (3) adults with past-year NSSI. Studies included one-month and six-month follow-up periods. Results were tested in an internal meta-analysis. Results suggested that NSSI did not prospectively predict changes in self-criticism. No changes in depressive symptoms were seen over shorter follow-up periods; however, NSSI predicted increases in depressive symptoms at six-month follow-up in one sample. The internal meta-analysis indicated a null relationship between NSSI and prospective internalizing symptoms. Future research should replicate these findings and examine a broader range of outcomes of NSSI to better understand its complex relationship to psychopathology.
Keywords: nonsuicidal self-injury, depression, self-criticism
Nonsuicidal self-injury (NSSI) is defined as direct and deliberate harm to oneself without suicidal intent (Nock, 2010). Common methods of NSSI include cutting, burning, biting, hitting, scratching, and inserting objects beneath the skin (Nock, 2010). Research suggests that NSSI occurs in up to 17% of adolescents (Swannell, Martin, Page, Hasking, & St. John, 2014) and 5% of adult community samples, and at significantly higher rates among clinical samples of both adolescents and adults (upwards of 50%; e.g., DiClemente, Ponton, & Hartley, 1991). Although NSSI occurs without suicidal intent, a growing body of literature suggests that the behavior is one of the strongest predictors of future suicidal behavior (Ribeiro et al., 2016). Moreover, greater NSSI severity (often operationalized as greater frequency, medical severity, and number of methods) is one of the strongest correlates of suicidal behaviors among those with a history of NSSI (e.g., Burke et al., 2018; Kiekens et al., 2018; Victor & Klonsky, 2014). Thus, studying NSSI and the mechanisms that maintain or exacerbate this behavior is of utmost importance.
Research suggests that the most common reasons cited for engaging in NSSI involve reduction of aversive emotional states, including to escape negative thoughts or stop bad feelings (Klonsky, 2007; Taylor et al., 2017). In line with this finding, depressive symptomatology and self-criticism have been found to be strongly associated with engagement in NSSI. Although a large body of research has examined these internalizing symptoms as predictors of NSSI, few studies have examined the extent to which NSSI may in turn influence these symptoms. Indeed, somewhat surprisingly, the prospective relations of NSSI to outcomes other than suicidal behavior have rarely been examined. Understanding the predictive relations between NSSI and other aspects of psychopathology is a critical first step to appreciating the potential impact of this behavior, including mechanisms by which it may be reinforced and maintained.
A large body of research highlights the cross-sectional association between self-criticism and NSSI (see Zelkowitz & Cole, 2018 for a review). Preliminary research aimed at better understanding the direction of this association suggests that self-criticism (Fox et al., 2018) and low self-esteem (Forrester, Slater, Jomar, Mitzman, & Taylor, 2017; Garisch & Wilson, 2015; Tatnell, Kelada, & Hasking, 2014) predict subsequent NSSI. It is unclear whether engaging in NSSI leads to increased self-criticism, however. Providing initial support for this possibility, Klonsky (2009) found that many people who engage in NSSI retrospectively report experiencing shame, guilt, and self-directed anger after engaging in these behaviors. It is also possible that the physical consequences (e.g., scarring, bruising) of NSSI may lead to increases in self-criticism over the longer-term. Supporting this notion, recent research has demonstrated strong negative implicit and explicit biases towards those who bear scarring from NSSI (Burke, Piccirillo, Moore-Berg, Alloy, & Heimberg, in press). More generally, the literature supports negative perceptions of self-harm among some providers, and suggests that individuals who self-harm are aware of such perceptions (e.g., Mitten, Preyde, Lewis, Vanderkooy, & Heintzman, 2016; Taylor, Hawton, Fortune, & Kapur, 2009). Given literature suggesting that stigmatized individuals experience low self-esteem, negative affect, and shame (Heatherton, Kleck, Hebl, & Hull, 2000; Link, Struening, Rahav, Phelan, & Nuttbrock, 1997; Stier & Hinshaw, 2007), it is plausible that engagement in NSSI may lead to greater self-criticism, as well as greater depressive symptoms.
Echoing literature on self-criticism and NSSI, a large body of research demonstrates a strong cross-sectional association between depression and NSSI (see Jacobson & Gould, 2007 and Nitkowski & Petermann, 2011 for reviews). Although there is evidence that depression is a risk factor for NSSI (e.g., Hankin & Abela, 2011), whether NSSI exacerbates depressive symptoms remains unclear. NSSI appears to reduce high arousal negative affect in the immediate moments during or following these behaviors (e.g., Franklin, Lee, Hanna, & Prinstein, 2013; Fox, Toole, Franklin, & Hooley, 2017), but preliminary evidence suggests it may lead to greater negative affective experiences over longer periods of time. Indeed, Houben and colleagues (2017) documented increases in negative mood in the hours following NSSI in an inpatient sample of individuals with borderline personality disorder. If replicated, such findings would suggest that NSSI may exacerbate a key symptom of depression.
Existing research on the association between NSSI and prospective depressive symptoms is mixed. Whereas some studies indicate that past six-month and lifetime NSSI predict increases in depressive symptoms among adolescent boys and girls (Mars et al., 2014), other research indicates that this association is specific to adolescent girls (Burke, Hamilton, Abramson, & Alloy, 2015; Lundh, Wangby‐Lundh, & Bjärehed, 2011; Lundh, Wångby-Lundh, Paaske, & Bjärehed, 2011). Marshall et al. (2013), in contrast, did not find evidence for the effect of NSSI on depressive symptoms at one or two-year follow-up periods among adolescent girls and boys.
Limitations of past research on NSSI as a predictor of internalizing symptoms may shed light on these mixed findings. First, studies generally have assessed lifetime (e.g., Mars et al., 2014) and past-year NSSI (e.g., Burke et al., 2015). Although valuable, using lifetime or even past-year NSSI histories does not allow for tests of whether these behaviors predict increases in internalizing symptoms in the shorter-term. To this end, studies of NSSI consequences over shorter periods (e.g., past month) are necessary. Second, most of the extant studies have been conducted with the same type of sample (often community-based). This limits our ability to compare associations across different types of samples, including clinical samples where engagement in NSSI may be both current and frequent. Third, previous research on this topic has primarily focused on adolescents. Although NSSI engagement is most common among adolescents, NSSI is also prevalent among young adults (Swannell et al., 2014).
Current Study
In order to address the aforementioned limitations, the current investigation sought to test whether recent (i.e., past month) NSSI predicts increases in self-criticism and depressive symptoms. This association was examined in three independent studies using samples of adults with varying lifetime severities of NSSI. We hypothesized that recent NSSI engagement would predict increases in depressive symptoms and self-criticism. The studies aimed to provide a rigorous examination of this hypothesis by using different assessment strategies (in-person versus online) and samples varying in age and NSSI recency and severity. Further, the current study used an internal meta-analysis (see Goh, Hall, & Rosenthal, 2016, for further information) based on the three studies to synthesize evidence of these associations across our studies.
Study 1–3 Methods and Results
Analytical Overview
We used linear regression to assess past month NSSI frequency as a predictor of depressive symptoms and self-criticism among individuals with a history of NSSI. Where we had multiple measures of self-criticism (Study 2), we also used a latent variable approach to assess the effect of NSSI on self-criticism. We examined outcomes at one month (Studies 1 and 2) and six months after baseline (Study 3). Although we had predictions about the likely direction of any differences, two-tailed hypothesis tests were used in an effort to adopt a more conservative approach. All analyses were conducted in SPSS v. 23.0 or 24.0. Post-hoc power analyses were conducted using GPower (Faul, Erdfelder, Lang, & Buchner, 2007). Based on the sample sizes for each study, we were sufficiently powered (i.e., power > .90) to detect a medium-sized effect for the change due to the inclusion of NSSI as a model predictor. Correlations between baseline NSSI, depressive symptoms, and self-criticism at baseline and at follow-up were examined and are reported in Table 4.
Study 1
Participants and Procedure.
Participants were 144 adults (123 female) aged 18–45 years who reported two or more past-month NSSI episodes (see Table 1 for descriptive information on all study samples). Participants primarily identified as Caucasian (87.50%) and reported living in the United States (71.53%). These participants were part of a larger, online treatment study1. Study recruitment techniques, inclusion criteria, detailed methods, and additional sample characteristics are described elsewhere (Hooley et al., in press). Briefly, participants were recruited online and randomized into one of three daily-diary treatment conditions designed to reduce engagement in NSSI. Regardless of treatment group, participants completed a baseline assessment and the majority completed a follow-up assessment four weeks later (Week 4 N = 126). Informed consent was obtained from all participants.
Table 1.
Schematic of study and sample characteristics across all three studies.
Study No. |
Age Mean (SD) |
% Female Gender |
Follow- Up Periods |
% Retention Rate |
Lifetime NSSI Mean (SD)/% Endorsed |
Past Month NSSI Mean (SD)/ % Endorsed |
---|---|---|---|---|---|---|
1 | 22.53 (4.62) | 85.42 | 4 weeks | 87.50 | 1042.43 (1908.49)/100% | 8.99 (11.59)/100% |
2 | 24.81 (3.69) | 92.10 | 4 weeks | 47.00 | 133.29 (841.03)/100% | 2.81 (16.91)/26.40% |
3 | 22.53 (4.62) | 78.35 | 6 months | 82.47 | 255.75 (316.32)/100% | 3.14 (5.48)/63.82% |
Note: Female refers to female gender.
Measures.
Self-Injurious Thoughts and Behaviors Interview (SITBI).
The SITBI (Nock, Holmberg, Photos, & Michel, 2007). The SITBI assesses history of self-injurious thoughts and behaviors. Participants are asked how many times they have engaged in NSSI over a variety of time periods (i.e., past week, past month, past year, and lifetime). They also indicate the specific behaviors in which they have engaged, along with ratings for possible functions of and contributors to the behavior(s). The interview has very strong interrater reliability (average κ = .99) as well as strong convergent and construct validity, indexed by its association with other measures of self-injurious thoughts and behaviors (Nock et al., 2007). In the present study, the online version of the SITBI was used. Prior research indicates that online and in-person versions of the SITBI produce similar SITB estimates (Franklin, Puzia, Lee, & Prinstein, 2014).
Beck Depression Inventory – II (BDI-II).
The BDI-II (Beck, Steer, Ball, & Ranieri, 1996). The BDI-II is a 21-item self-report measure used to assess symptoms of depression. All items are rated on a 4-point Likert scale, with higher scores indexing more severe depressive symptoms. The BDI-II demonstrates high internal consistency (Beck et al., 1996) as well as convergent and discriminant validity among psychiatric outpatients (Steer, Ball, Ranieri, & Beck, 1999). In the present sample, the coefficient alpha was .92 at Wave 1 and .94 at Wave 2. At baseline, average BDI scores were 37.41 (SD = 14.21); at follow-up, average BDI scores were 29.99 (SD = 16.18). Baseline and follow-up BDI scores were correlated at .76 (p < . 01).
Self-Rating Scale (SRS).
The SRS (Hooley, Ho, Slater, & Lockshin, 2010) is a brief, 8-item measure used to assess self-critical cognitions. Items are answered on a 7-point Likert scale, with higher scores indexing higher levels of self-criticism. Items include, “I often feel inferior to others,” and “I am socially inept and undesirable.” The SRS demonstrates good internal reliability and differentiates groups with and without NSSI histories (Hooley et al., 2010; St. Germain & Hooley, 2012). In the present sample, the coefficient alpha was .84 at Wave 1 and .94 at Wave 2. At baseline, average SRS scores were 41.88 (SD = 9.16); at follow-up, average SRS scores were 40.96 (SD = 11.74). Baseline and follow-up SRS scores were correlated at .81 (p < . 01).
Results.
Aim 1: Does past month NSSI frequency at baseline predict depressive symptoms one month later, controlling for baseline depressive symptoms?
As indicated in Table 2, after controlling for depressive symptoms at baseline, past-month NSSI frequency did not predict depressive symptoms reported at one-month follow-up.
Table 2.
NSSI as a predictor of depressive symptoms at 4 and 26 weeks
Predictor (NSSI measure) | b | S.E. | B | t |
---|---|---|---|---|
DV = Depressive symptoms at 4 weeks | ||||
Past month NSSI frequency (Study 1) | 0.25 | 0.31 | 0.05 | 0.81 |
Baseline depressive symptoms | 0.83 | 0.07 | 0.75 | 12.15*** |
Past month NSSI frequency (Study 2) | 0.04 | 0.07 | 0.04 | 0.55 |
Baseline depressive symptoms | 0.78 | 0.08 | 0.70 | 8.79*** |
DV = Depressive symptoms at 6 months (i.e., 26 weeks) | ||||
Past-month NSSI frequency (Study 3) | 0.57 | 0.24 | 0.22 | 2.35* |
Baseline depressive symptoms | 0.63 | 0.10 | 0.58 | 6.37*** |
Note. All analyses controlled for depressive symptoms at baseline. NSSI = nonsuicidal self-injury; DV = dependent variable
p < .10;
p < .05;
p < .01;
p < .001
Aim 2: Does past-month NSSI frequency at baseline predict self-criticism one month later, controlling for baseline self-criticism?
As seen in Table 3, after controlling for self-criticism at baseline, past month NSSI frequency did not predict subsequent self-criticism reported at one-month follow-up.
Table 3.
NSSI as a predictor of self-criticism at 4 and 26 weeks
Predictor (NSSI measure) | b | S.E. | B | t |
---|---|---|---|---|
DV = SRS score at 4 weeks | ||||
Past month NSSI frequency (Study 1) | 0.06 | 0.06 | 0.06 | 0.93 |
Baseline SRS | 0.93 | 0.09 | 0.69 | 10.66*** |
Past month NSSI frequency (Study 2) | .06 | .06 | .09 | 1.12 |
Baseline SRS | 0.73 | .09 | 0.65 | 7.78*** |
DV = DEQ score at 4 weeks | ||||
Past-Month NSSI frequency (Study 2) | 0.06 | 0.05 | .10 | 1.24 |
Baseline DEQ | 0.62 | 0.08 | 0.64 | 7.58*** |
DV = FSCSRS-Inadequate Self score at 4 weeks | ||||
Past-Month NSSI frequency (Study 2) | −0.02 | 0.04 | −0.05 | −0.63 |
Baseline FSCSRS-Inadequate Self | 0.84 | 0.09 | 0.72 | 9.28** |
DV = FSCSRS-Hated Self score at 4 weeks | ||||
Past-Month NSSI frequency (Study 2) | 0.00 | 0.02 | 0.00 | 0.005 |
Baseline FSCSRS-Hated Self score | 0.67 | 0.09 | 0.63 | 7.31** |
DV = SRS score at 6 months (i.e., 26 weeks) | ||||
Past-month NSSI frequency (Study 3) | 0.17 | 0.16 | 0.09 | 1.12 |
Baseline SRS | 0.77 | 0.09 | 0.69 | 8.51*** |
Note. SRS = Self-Rating Scale; DEQ = Depressive Experiences Questionnaire; FSCSRS = Forms of Self-Criticism and Self-Reassurance Scale; DV = Dependent Variable
p < .001
Lifetime frequency of NSSI significantly predicted FSCSRS-Hated Self score among females only (n = 26; b = 0.34, S.E. = 0.14, β = 0.39, t = 2.41)
Study 2
Participants and Procedure.
Participants were selected from a broader study of adults recruited via an online survey platform (Qualtrics Panels). Participants in the broader study were recruited based on lifetime history of either NSSI or disordered eating. The present sample consisted of 178 adults reporting lifetime histories of NSSI (5.6% male, 2.2% transgender). The sample was moderately diverse (76.40% Caucasian, 13.48% African American, 13.48% Hispanic or Latino, 4.49% Asian or Asian American, 2.81% Native American, 0.56% Other; participants could endorse more than one race or ethnicity.) Forty-six percent of the sample reported past-year NSSI; 26% of the sample reported self-injuring in the past month (see Table 1). All participants were between the ages of 18 and 30 years. Participants completed an online battery of self-report measures and were contacted for an online follow-up assessment after four weeks. Of those completing baseline assessments, 83 completed follow-up questionnaires. Analyses were completed using full information maximum likelihood (FIML) to make optimal use of available data.2 Informed consent was obtained from all participants.
Measures.
As in Study 1, participants completed the online SITBI and BDI-II to measure NSSI and depressive symptoms, respectively. Unlike Study 1, the BDI-II item about suicidal ideation was removed for safety concerns, leaving 20 items. Despite this alteration, coefficient alpha was .95 at Wave 1 and .96 at Wave 2. Mean BDI score at baseline was 22.39 (SD = 13.02); mean at follow-up was 21.68 (SD = 14.52). Correlation from baseline to follow-up was .70 (p < .01). Participants also completed the SRS (coefficient ɑs = .86 - .91). Mean SRS score at baseline was 36.08 (SD = 10.26); mean at follow-up was 35.88 (SD = 11.53). Scores were significantly correlated across waves (r = .66, p < .01). In an effort to enhance reliability of our assessment of self-criticism and facilitate comparisons across the broader literature on the construct, we administered two additional SC measures (see below).
Depressive Experiences Questionnaire (DEQ).
The DEQ (Blatt, D’Afflitti, & Quinlan, 1976) is a 66-item measure developed to measure feelings and cognitions associated with depression (as distinct from more normative negative affect). It uses 1 to 7 Likert scales (“strongly disagree” to “strongly agree”). Factor analysis reveals three subscales: self-criticism, dependency, and efficacy. The measure has been validated among undergraduates and has coefficient alphas ranging from .73 to .81. Analyses focus on the self-criticism subscale score as characterized by Bagby, Parker, Joffe, and Buis (1994). Representative items include “There is a considerable difference between how I am now and how I would like to be” and “I often find I don’t live up to my own standards or ideals.” Coefficient alphas were .81 at Wave 1 and .78 at Wave 2. At baseline, mean DEQ score was 42.02 (SD = 9.87); mean DEQ at follow-up was 41.21 (SD = 10.14). Baseline and follow-up scores were significantly correlated (r = .64, p < .01)
Forms of Self-Criticism/Self-Reassurance Scale (FSCSRS).
The FSCSRS (Gilbert, Clarke, Hempel, Miles, & Irons, 2004) is a 24-item measure that produces two subscales relevant to self-criticism: Inadequate Self and Hated Self. Participants note their agreement with each statement on a 0 to 4 (“not at all like me” to “extremely like me”) scale. We removed one item from the Hated Self scale (“I have become so angry with myself that I want to hurt or injure myself”) due to high conceptual overlap with NSSI. Coefficient alphas were .78 and .84 (Waves 1 and 2) for the Hated Self scale and .86 and .90 for the Inadequate Self scale. At baseline, mean Hated Self score was 12.65 (SD = 4.39); mean Inadequate Self score was 35.56 (SD = 6.68). At follow-up mean Hated Self score was 12.76 (SD = 4.11); mean Inadequate self score at follow-up was 34.74 (SD = 7.78). Hated Self scores were correlated across waves (r = .63, p < .01), as were Inadequate Self scores (r = .71, p < .01).
Scores for the SRS, DEQ, and FSCSRS were strongly correlated (at both waves, all pairwise rs > .60, p < .01). We also tested a single latent variable indicator as a measure of self-criticism at Waves 1 and 2. For the purposes of latent variable modeling, we combined both subscales of the FSCSRS. Factor loadings for each self-criticism measure exceeded .79 at both waves. (Both models were fully identified, thus fit statistics are non-interpretable.)
Results.
Aim 1: Does past month NSSI frequency predict depressive symptoms at one-month follow-up, controlling for baseline depressive symptoms?
Past month NSSI frequency did not predict depressive symptoms at one-month follow after controlling for baseline depressive symptoms. See Table 2.
Aim 2. Does past-month NSSI frequency predict self-criticism at one-month follow-up, controlling for baseline self-criticism?
After controlling for baseline SC measure, past-month NSSI frequency did not significantly predict any self-criticism measure score at one-month follow-up (see Table 3). We also tested the effect of NSSI on self-criticism using a latent variable approach, with all three measures of self-criticism loading onto a latent self-criticism variable. The model fit the data well (e.g., for past-month NSSI frequency, Χ29 = 10.78, p = .29; CFI = .99; IFI = .99; NFI = .97; RMSEA = .03 90% CI: [.00, .09]). Results indicated that NSSI did not significantly predict self-criticism at follow-up as measured by this latent variable after controlling for baseline self-criticism.
Study 3
Participants and Procedure.
Participants were 97 adults (78.35% female) with a past-year NSSI history recruited from the community and outpatient clinics throughout Boston, MA. More details about the sample and recruitment are described elsewhere (Fox, Toole, Franklin, & Hooley, 2017). Briefly, participants primarily identified as Caucasian (73.4%) and were aged 18 to 38. After completing an in-person baseline assessment, participants were contacted six months later for an online follow-up assessment. Of participants who completed baseline, 80 completed the six-month follow-up assessment. Informed consent was obtained from all participants.
Measures.
Study measures were identical to Study 1, including the BDI-II (coefficient alpha .89 at Wave 1 and .94 at Wave 2) to assess depressive symptoms, SRS (coefficient alpha .85 at Wave 1 and .88 at Wave 2) to assess self-criticism, and the SITBI to assess self-injurious thoughts and behaviors. Unlike in Study 1, however, the SITBI was administered as an in-person interview at baseline and as a self-report measure online at the six-month follow-up assessment. At baseline, average SRS scores were 35.92 (SD = 9.17) and average BDI scores were 26.51 (SD = 14.05); at follow-up, average SRS scores were 35.94 (SD = 10.19) and average BDI scores were 43.09 (SD = 14.87). Baseline and follow-up SRS scores were correlated at .71 (p < . 01); baseline and follow-up BDI scores were correlated at .62 (p < . 01).
Results.
Aim 1: Does past month NSSI frequency at baseline predict depressive symptoms at six-month follow-up, controlling for baseline symptoms?
As seen in Table 2, after controlling for depressive symptoms at baseline, past month NSSI frequency significantly predicted depressive symptoms six months later.
Aim 2: Does past month NSSI frequency at baseline predict self-criticism at six-month follow-up, controlling for baseline self-criticism?
As seen in Table 3, controlling for self-criticism at baseline, past month NSSI frequency did not predict self-criticism six months later.
Meta-Analysis Results
To obtain more reliable estimates of observed effects across these three research studies, we conducted an internal meta-analysis using Comprehensive Meta-Analysis Software 3.0 (Bornstein, Hedges, Higgins, & Rothstein, 2014). We used the unstandardized beta weights and their standard errors to calculate point estimates, standard error (SE), and 95% confidence intervals (CI) for the influence of NSSI frequency on depressive symptoms and self-criticism. We used the randomized effects models (see Bornstein, Hedges, Higgins, & Rothstein, 2010) because these models allow for differences across different samples (heterogeneity), thus providing more accurate and generalizable estimates of effect sizes (Lipsey and Wilson, 2001). Analyses indicated that 36.38% of the variance observed from the mini meta-analysis could be attributed to between-study rather than within-study variance. This is considered medium heterogeneity and provides support for the use of random effects models (Higgins, Thompson, Deeks, & Altman, 2003).
Overall, NSSI did not predict changes in depressive symptoms (point estimate = 0.11, SE = .09, 95% CI = −0.06 – 0.18, p = .21) or self-criticism symptoms (point estimate = 0.07, SE = .04, 95% CI = −0.01 – 0.15, p = .21), after controlling for baseline levels of these variables. These results remained nonsignificant when considering FIML, rather than listwise deletion, to account for missing data at follow-up time points. Thus, results suggest that when considering these studies in combination, thereby improving statistical power, NSSI frequency does not significantly predict depressive symptoms or self-criticism.
Discussion
The current manuscript describes three longitudinal studies aimed at better understanding the consequences of NSSI engagement for depressive symptoms and self-criticism across a variety of sample types and over two separate time frames. Three main findings emerged. First, we found that within samples reporting NSSI histories, past month NSSI frequency did not predict self-criticism across either a one or six month follow-up period (Studies 1, 2, 3). Similarly, we found that recent NSSI did not significantly predict depressive symptoms over the short-term (i.e., at one month follow-up) after controlling for baseline depression (Studies 1, 2). Internal meta-analysis corroborated these findings. We additionally found that NSSI did predict depressive symptoms over the longer term (i.e., six month follow-up), although we tested and obtained this result in only one study.
We found no evidence to support the hypothesis that NSSI engagement is associated with changes in self-criticism (assessed using three different measures) over the short or longer term. This finding is strengthened by the consistency of results across the three studies and the maintained null effect in an internal meta-analysis. Results suggest that high self-criticism may be more of a risk factor for NSSI than as a substantive consequence of having engaged in NSSI. This is consistent with prior research indicating that self-criticism may predate NSSI engagement (Hooley et al., 2010), with current theoretical models of NSSI (see Hooley & Franklin, 2018), and with research showing that self-criticism longitudinally predicts NSSI (Fox et al., 2018). We acknowledge, however, that we were sufficiently powered to detect only medium-sized effects; the possibility remains that NSSI exerts a small effect on subsequent self-criticism. Moreover, in all three samples, self-criticism at baseline and follow-up were strongly correlated, thus leaving minimal variation to predict from NSSI.
Of course, this is not to say that individuals do not experience guilt, shame, and self-directed anger immediately after engaging in NSSI (Klonsky, 2009). Whereas high levels of trait self-criticism may leave little room for increase over the longer term, state self-criticism may indeed peak in the minutes, hours, and immediate days after NSSI. Providing support for this possibility, Zuroff and colleagues (2016) observed meaningful distinctions between trait self-criticism and state variations around this mean in a sample of university students. Future research should use ecological momentary assessment (EMA) among those who self-injure to assess for possible changes in the experiences of self-criticism prior to and after NSSI.
Results regarding NSSI as a predictor of changes in depressive symptoms were mixed. Whereas past month NSSI frequency did not predict changes in depressive symptoms one month later, it did predict changes in depressive symptoms six months later. This was intriguing, particularly given that depressive symptoms at baseline and follow-up were strongly correlated at both one month and six months. Importantly however, correlations between baseline and follow-up depressive symptoms were slightly weaker at six-month follow up. Thus, it is possible that this significant finding may have resulted from the slightly greater variability in depressive symptoms observed across longer follow-up periods. In this respect, our findings are in line with research suggesting that NSSI history predicts changes in depression over longer-term follow-up periods, including a one-year follow-up (Lundh, Wangby‐Lundh, & Bjärehed, 2011; Lundh, Wångby-Lundh, Paaske, & Bjärehed, 2011) and two-year follow-up (Mars et al., 2014). These results also are congruent with recent research suggesting that the physical consequences of NSSI are often perceived as a “marker of stigma or shame” (Bachtelle & Pepper, 2015, p. 929), which may lead to internalized stigma and depressive symptomatology over longer follow-up periods. However, given that longer-term effects of NSSI on changes in depression only were tested in one of the three present studies, the “mini” meta-analysis suggested a null relation between NSSI and changes in depressive symptoms, and given other mixed findings in the literature (e.g., Marshall et al., 2013), we hesitate to draw firm conclusions from this single finding. We encourage future research to examine the association between NSSI and prospective depression. We also encourage future research to examine whether this relationship may partially account for the association between NSSI and suicide. Future studies should examine these constructs over both shorter (e.g., hours, days, weeks) and longer periods of time (e.g., years) within a longitudinal mediation model to examine this hypothesis more directly.
Although our multi-study approach has clear strengths, several limitations also deserve mention. First, self-criticism, depressive symptoms, and NSSI all were measured via self-report, thus precluding our ability to examine convergence of these constructs across various methods. Indeed, evidence from other laboratory-based studies suggests the potential utility of implicit measures of self-regard, which we were unable to capture in the present work (e.g., Hofmann, Gawronski, Gschwendner, Le, & Schmitt, 2005). Future studies could implement such laboratory-based assessments in addition to the self-report measures to facilitate multi-trait, multi-method examination of these constructs.
Second, although the present studies covered a relatively short and a longer-term follow-up period, only one study examined outcomes over six months. We also were unable to examine relations between NSSI and changes in our outcome variables in the very short-term (i.e., assessing dynamic interplay between these constructs on a daily or even hourly basis) or very long-term (i.e., one or more years later). An important next step will be examining the interplay between NSSI, self-criticism and depressive symptoms on a micro-level, for example using EMA methodology or daily diary studies (e.g., Houben et al., 2017; Turner, Yiu, Claes, Muehlenkamp, & Chapman, 2016). Future studies also should include measures of other constructs relevant to NSSI, such as anxiety symptoms, guilt, shame, and disordered eating. Participants across all three studies presented here reported lifetime histories of NSSI; self-criticism and depressive symptoms were correspondingly high and largely stable. Future studies should consider examining these relationships in samples of individuals with recent onset of NSSI or even community samples, which might show greater variability in self-criticism and depressive symptoms and potentially enhanced sensitivity to effects of engaging in NSSI.
Finally, it would be helpful to include more racially and ethnically diverse and larger samples in future studies of NSSI (e.g., Batejin, Jarvi, & Swenson, 2015; Bresin & Schoenleber, 2015; Gholamrezaei, De Stefano, & Heath, 2015). Increased sample sizes with greater diversity among participants would enhance power for detecting even smaller effect sizes than we could assess here, in addition to testing differences in the predictive associations of NSSI with self-criticism and depressive symptoms across different populations.
Despite these limitations, the present set of studies contributes meaningfully to our knowledge of the potential negative consequences of NSSI beyond future suicidal behaviors. As we search for predictors of NSSI, these findings suggest the need to also consider the impact of NSSI on key constructs such as self-criticism and depressive symptoms, as well as other psychological constructs. Only by considering such bi-directional relations will we build a complete understanding of NSSI, including its complex relation to psychopathology.
Table 4.
Zero-order Correlations of Baseline NSSI and Depressive Symptoms, Self-Criticism By Study and Wave
Study No. | NSSI1, BDI1 | NSSI1, BDI2 | NSSI1, SRS1 | NSSI1, SRS2 | NSSI1, FSC1 | NSSI1, FSC2 | NSSI1, DEQ1 | NSSI, DEQ2 |
---|---|---|---|---|---|---|---|---|
1a | .23** | .27** | .17* | .19* | n/a | n/a | n/a | n/a |
2 | .15* | .07 | .19* | .12 | .21* | −.02 | .14 | .12 |
3a | .29** | .26* | .29** | .24* | n/a | n/a | n/a | n/a |
Note. All correlations expressed as Spearman’s rho. FSC = Forms of Self-Criticism, Self-Reassurance Scale (Inadequate self, Hated Self combined total). DEQ = Depressive Experiences Questionnaire, Self-Criticism subscale.
FSC and DEQ not administered in Studies 1 and 3.
p < .05.
Acknowledgments
This research was supported by a Foundations of Human Behavior award to Jill M. Hooley. Taylor A. Burke was supported by a National Science Foundation Graduate Student Research Fellowship. Kathryn Fox was supported by The Sackler Scholars Programme in Psychobiology. Rachel L. Zelkowitz was supported by National Institute of Mental Health National Research Service Award F31MH108241-02. Lauren B. Alloy was supported by NIMH Grant MH101168. Jill Hooley was supported by a Foundations of Human Behavior grant from Harvard University. David Cole was supported by a gift from the Patricia and Rodes Hart Foundation.
Footnotes
Compliance with Ethical Standards:
Conflict of Interest: Author A, Author B, Author C, Author D, Author E, Author F, and Author G declare that they have no conflict of interest.
Ethical approval: All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent: Informed consent was obtained from all individual participants included in the study.
Analyses not reported here indicated that results were not affected when including treatment group as a covariate. These results are available upon request.
Results did not vary with the use of FIML or listwise deletion.
References
- Ammerman BA, & Brown S (2018). The mediating role of self-criticism in the relationship between parental expressed emotion and NSSI. Current Psychology, 37(1), 325–333. 10.1007/s12144-016-9516-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andover MS, Schatten HT, Morris BW, Holman CS, & Miller IW (2017). An intervention for nonsuicidal self-injury in young adults: A pilot randomized controlled trial. Journal of Consulting and Clinical Psychology, 85(6), 620–631. 10.1037/ccp0000206 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Asarnow JR, Porta G, Spirito A, Emslie G, Clarke G, Wagner KD, … Brent DA (2011). Suicide attempts and nonsuicidal self-injury in the treatment of resistant depression in adolescents: Findings from the TORDIA study. Journal of the American Academy of Child and Adolescent Psychiatry, 50(8), 772–781. 10.1016/j.jaac.2011.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bachtelle SE, & Pepper CM (2015). The physical results of nonsuicidal self-injury: The meaning behind the scars. Journal of Nervous and Mental Disease, 203(12), 927–933. 10.1097/NMD.0000000000000398 [DOI] [PubMed] [Google Scholar]
- Bagby RM, Parker JDA, Joffe RT, & Buis T (1994). Reconstruction and validation of the Depressive Experiences Questionnaire. Assessment, 1(1), 59–68. 10.1177/1073191194001001009 [DOI] [PubMed] [Google Scholar]
- Batejan KL, Jarvi SM, & Swenson LP (2015). Sexual orientation and non-suicidal self-injury: A meta-analytic review. Archives of Suicide Research, 19(2), 131–150. 10.1080/13811118.2014.957450 [DOI] [PubMed] [Google Scholar]
- Beck AT, Steer RA, & Brown GK (1996). Manual for the Beck depression inventory-II. San Antonio, TX: Psychological Corporation, 1–82. [Google Scholar]
- Beck AT (1963). Thinking and depression: idiosyncratic content and cognitive distortions. Archives of General Psychiatry, 9(4), 324–333. 10.1001/archpsyc.1963.01720160014002 [DOI] [PubMed] [Google Scholar]
- Beck AT, Steer RA, Ball R, & Ranieri WF (1996). Comparison of Beck depression inventories -IA and -II in psychiatric outpatients. Journal of Personality Assessment, 67(3), 588–597. 10.1207/s15327752jpa6703_13 [DOI] [PubMed] [Google Scholar]
- Blatt SJ, D’Afflitti JP, & Quinlan DM (1976). Experiences of depression in normal young adults. Journal of Abnormal Psychology, 85(4), 383–389. 10.1037//0021-843X.85.4.383 [DOI] [PubMed] [Google Scholar]
- Borenstein M, Hedges LV, Higgins JPT, & Rothstein HR (2014). Comprehensive Meta-Analysis (CMA) software (Version 3.0). Englewood, NJ: Biostat; Retrieved from http://www.meta-analysis.com [Google Scholar]
- Bresin K, & Schoenleber M (2015). Gender differences in the prevalence of nonsuicidal self-injury: A meta-analysis. Clinical Psychology Review, 38, 55–64. 10.1016/j.cpr.2015.02.009 [DOI] [PubMed] [Google Scholar]
- Burke TA, Hamilton JL, Abramson LY, & Alloy LB (2015). Non-suicidal self-injury prospectively predicts interpersonal stressful life events and depressive symptoms among adolescent girls. Psychiatry Research, 228(3), 416–424. 10.1016/j.psychres.2015.06.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke TA, Hamilton JL, Cohen JN, Stange JP, & Alloy LB (2016). Identifying a physical indicator of suicide risk: Non-suicidal self-injury scars predict suicidal ideation and suicide attempts. Comprehensive Psychiatry, 65, 79–87. 10.1016/j.comppsych.2015.10.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke TA, Jacobucci R, Ammerman BA, Piccirillo M, McCloskey MS, Heimberg RG, & Alloy LB (2018). Identifying the relative importance of non-suicidal self-injury features in classifying suicidal ideation, plans, and behavior using exploratory data mining. Psychiatry Research. 10.1016/j.psychres.2018.01.045 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burke TA, Piccirillo MP, Moore-Berg SL, Heimberg R, Alloy LB (in press). The stigmatization of non-suicidal self-injury. Journal of Clinical Psychology. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cawood CD, & Huprich SK (2011). Late adolescent nonsuicidal self-injury: The roles of coping style, self-esteem, and personality pathology. Journal of Personality Disorders, 25(6), 765–781. 10.1521/pedi.2011.25.6.765 [DOI] [PubMed] [Google Scholar]
- DiClemente RJ, Ponton LE, & Hartley D (1991). Prevalence and correlates of cutting behavior: Risk for HIV transmission. Journal of the American Academy of Child & Adolescent Psychiatry, 30(5), 735–739. [PubMed] [Google Scholar]
- Dunkley DM, & Grilo CM (2007). Self-criticism, low self-esteem, depressive symptoms, and over-evaluation of shape and weight in binge eating disorder patients. Behaviour Research and Therapy, 45(1), 139–149. 10.1016/j.brat.2006.01.017 [DOI] [PubMed] [Google Scholar]
- Faul F, Erdfelder E, Lang AG, & Buchner A (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. 10.3758/BF03193146 [DOI] [PubMed] [Google Scholar]
- Forrester RL, Slater H, Jomar K, Mitzman S, & Taylor PJ (2017). Self-esteem and non-suicidal self-injury in adulthood: A systematic review. Journal of Affective Disorders, 221, 172–183. 10.1016/j.jad.2017.06.027 [DOI] [PubMed] [Google Scholar]
- Fox KR, Toole KE, Franklin JC, & Hooley JM (2017). Why does nonsuicidal self-injury improve mood? A preliminary test of three hypotheses. Clinical Psychological Science, 5(1), 111–121. 10.1177/2167702616662270 [DOI] [Google Scholar]
- Franklin JC, Fox KR, Franklin CR, Kleiman EM, Ribeiro JD, Jaroszewski AC, … Nock MK (2016). A brief mobile app reduces nonsuicidal and suicidal self-injury: Evidence from three randomized controlled trials. Journal of Consulting and Clinical Psychology, 84(6), 544–557. 10.1037/ccp0000093 [DOI] [PubMed] [Google Scholar]
- Franklin JC, Lee KM, Hanna EK, & Prinstein MJ (2013). Feeling worse to feel better: Pain-offset relief simultaneously stimulates positive affect and reduces negative affect. Psychological Science, 24(4), 521–529. 10.1177/0956797612458805 [DOI] [PubMed] [Google Scholar]
- Franklin JC, Puzia ME, Lee KM, & Prinstein MJ (2014). Low implicit and explicit aversion toward self-cutting stimuli longitudinally predict nonsuicidal self-injury. Journal of Abnormal Psychology, 123(2), 463–469. 10.1037/a0036436 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Franklin JC, Hessel ET, & Prinstein MJ (2011). Clarifying the role of pain tolerance in suicidal capability. Psychiatry Research, 189(3), 362–367. 10.1016/j.psychres.2011.08.001 [DOI] [PubMed] [Google Scholar]
- Garisch JA, & Wilson MS (2015). Prevalence, correlates, and prospective predictors of non-suicidal self-injury among New Zealand adolescents: Cross-sectional and longitudinal survey data. Child and Adolescent Psychiatry and Mental Health, 9(1). 10.1186/s13034-015-0055-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gholamrezaei M, De Stefano J, & Heath NL (2017). Nonsuicidal self-injury across cultures and ethnic and racial minorities: A review. International Journal of Psychology. 10.1002/ijop.12230 [DOI] [PubMed] [Google Scholar]
- Gilbert P, Clarke M, Hempel S, Miles JNV, & Irons C (2004). Criticizing and reassuring oneself: An exploration of forms, styles and reasons in female students. British Journal of Clinical Psychology, 43(1), 31–50. 10.1348/014466504772812959 [DOI] [PubMed] [Google Scholar]
- Glassman LH, Weierich MR, Hooley JM, Deliberto TL, & Nock MK (2007). Child maltreatment, non-suicidal self-injury, and the mediating role of self-criticism. Behaviour Research and Therapy, 45(10), 2483–2490. 10.1016/j.brat.2007.04.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gray-Little B, Williams VSL, & Hancock TD (1997). An item response theory analysis of the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin, 23(5), 443–451. 10.1177/0146167297235001 [DOI] [Google Scholar]
- Hamza CA, Stewart SL, & Willoughby T (2012). Examining the link between nonsuicidal self-injury and suicidal behavior: A review of the literature and an integrated model. Clinical Psychology Review. 10.1016/j.cpr.2012.05.003 [DOI] [PubMed] [Google Scholar]
- Heatherton TF, Kleck RE, Hebl M, & Hull J (2000). Stigma: Social Psychological Perspectives. New York, NY: Guilford Press. [Google Scholar]
- Hinshaw SP, & Stier A (2008). Stigma as related to mental disorders. Annual Review of Clinical Psychology, 4(1), 367–393. 10.1146/annurev.clinpsy.4.022007.141245 [DOI] [PubMed] [Google Scholar]
- Hofmann W, Gawronski B, Gschwendner T, Le H, & Schmitt M (2005). A meta-analysis on the correlation between the Implicit Association Test and explicit self-report measures. Personality and Social Psychology Bulletin. 10.1177/0146167205275613 [DOI] [PubMed] [Google Scholar]
- Hooley JM, Fox KR, Wang SB, Kwashie A, In Press. Self-criticism and self-injury: Testing a novel treatment approach. BMC Psychiatry. [Google Scholar]
- Hooley JM, Ho DT, Slater J, & Lockshin A (2010). Pain perception and nonsuicidal self-injury: A laboratory investigation. Personality Disorders: Theory, Research, and Treatment, 1(3), 170–179. 10.1037/a0020106 [DOI] [PubMed] [Google Scholar]
- Houben M, Claes L, Vansteelandt K, Berens A, Sleuwaegen E, & Kuppens P (2017). The emotion regulation function of nonsuicidal self-injury: A momentary assessment study in inpatients with borderline personality disorder features. Journal of Abnormal Psychology, 126(1), 89–95. 10.1037/abn0000229 [DOI] [PubMed] [Google Scholar]
- Iancu I, Bodner E, & Ben-Zion IZ (2015). Self esteem, dependency, self-efficacy and self-criticism in social anxiety disorder. Comprehensive Psychiatry, 58, 165–171. 10.1016/j.comppsych.2014.11.018 [DOI] [PubMed] [Google Scholar]
- Jacobson CM, & Gould M (2007). The epidemiology and phenomenology of non-suicidal self-injurious behavior among adolescents: A critical review of the literature. Archives of Suicide Research, 11(2), 129–147. 10.1080/13811110701247602 [DOI] [PubMed] [Google Scholar]
- Kiekens G, Hasking P, Boyes M, Claes L, Mortier P, Auerbach RP, ... & Myin-Germeys I (2018). The associations between non-suicidal self-injury and first onset suicidal thoughts and behaviors. Journal of Affective Disorders, 239, 171–179. [DOI] [PubMed] [Google Scholar]
- Klonsky ED (2011). Non-suicidal self-injury in United States adults: Prevalence, sociodemographics, topography and functions. Psychological Medicine, 41(9), 1981–1986. 10.1017/S0033291710002497 [DOI] [PubMed] [Google Scholar]
- Klonsky ED (2009). The functions of self-injury in young adults who cut themselves: Clarifying the evidence for affect-regulation. Psychiatry Research, 166(2–3), 260–268. 10.1016/j.psychres.2008.02.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lewis SP, & Mehrabkhani S (2016). Every scar tells a story: Insight into people’s self-injury scar experiences. Counselling Psychology Quarterly, 29(3), 296–310. 10.1080/09515070.2015.1088431 [DOI] [Google Scholar]
- Link BG, Struening EL, Rahav M, Phelan JC, & Nuttbrock L (1997). On stigma and its consequences: Evidence from a longitudinal study of men with dual diagnoses of mental illness and substance abuse. Journal of Health and Social Behavior, 38, 177–190. 10.2307/2955424 [DOI] [PubMed] [Google Scholar]
- Lundh LG, Wångby-Lundh M, & Bjärehed J (2011). Deliberate self-harm and psychological problems in young adolescents: Evidence of a bidirectional relationship in girls. Scandinavian Journal of Psychology, 52(5), 476–483. 10.1111/j.1467-9450.2011.00894.x [DOI] [PubMed] [Google Scholar]
- Lundh L-G, Wångby-Lundh M, Paaske M, Ingesson S, & Bjärehed J (2011). Depressive symptoms and deliberate self-harm in a community sample of adolescents: A prospective study. Depression Research and Treatment, 2011, 1–11. 10.1155/2011/935871 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mars B, Heron J, Crane C, Hawton K, Lewis G, Macleod J, … Gunnell D (2014). Clinical and social outcomes of adolescent self harm: population based birth cohort study. BMJ (Clinical Research Ed.), 349(October), g5954 10.1136/bmj.g5954 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marshall SK, Tilton-Weaver LC, & Stattin H (2013). Non-suicidal self-injury and depressive symptoms during middle adolescence: a longitudinal analysis. Journal of Youth and Adolescence, 42(8), 1234–1242. 10.1007/s10964-013-9919-3 [DOI] [PubMed] [Google Scholar]
- Mitten N, Preyde M, Lewis S, Vanderkooy J, & Heintzman J (2016). The perceptions of adolescents who self-harm on stigma and care following inpatient psychiatric treatment. Social Work in Mental Health, 14(1), 1–21. 10.1080/15332985.2015.1080783 [DOI] [Google Scholar]
- Nitkowski D, & Petermann F (2011). Non-suicidal self-injury and comorbid mental disorders: A review. Fortschritte Der Neurologie Psychiatrie, 79(1), 9–20. 10.1055/s-0029-1245772 [DOI] [PubMed] [Google Scholar]
- Nock MK (2010). Self-Injury. Annual Review of Clinical Psychology, 6(1), 339–363. 10.1146/annurev.clinpsy.121208.131258 [DOI] [PubMed] [Google Scholar]
- Nock MK (2009). Why do people hurt themselves?: New insights into the nature and functions of self-injury. Current Directions in Psychological Science, 18(2), 78–83. 10.1111/j.1467-8721.2009.01613.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nock MK, Holmberg EB, Photos VI, & Michel BD (2007). Self-injurious thoughts and behaviors interview: Development, reliability, and validity in an adolescent sample. Psychological Assessment, 19(3), 309–317. 10.1037/1040-3590.19.3.309 [DOI] [PubMed] [Google Scholar]
- Penn JV, Esposito CL, Schaeffer LE, Fritz GK, & Spirito A (2003). Suicide attempts and self-mutilative behavior in a juvenile correctional facility. Journal of the American Academy of Child and Adolescent Psychiatry. 10.1097/01.CHI.0000046869.56865.46 [DOI] [PubMed] [Google Scholar]
- Ribeiro JD, Franklin JC, Fox KR, Bentley KH, Kleiman EM, Chang BP, Nock MK (2016). Self-injurious thoughts and behaviors as risk factors for future suicide ideation, attempts, and death: a meta-analysis of longitudinal studies. Psychological Medicine, 46, 225–236. 10.1017/S0033291715001804 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosenberg M, 1965. Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press [Google Scholar]
- Shahar G, 2015. Erosion: The Psychopathology of Self-Criticism. Oxford, U.K.: Oxford University Press. [Google Scholar]
- Germain SA & Hooley JM (2012). Direct and indirect forms of non-suicidal self-injury: Evidence for a distinction. Psychiatry Research, 197(1–2), 78–84. 10.1016/j.psychres.2011.12.050 [DOI] [PubMed] [Google Scholar]
- Starrs CJ, Dunkley D, Moroz M, 2017. Self-criticism and low self-esteem In Wade T (Ed.), Encyclopedia of Feeding and Eating Disorders (746–751). Singapore: Springer Verlag. [Google Scholar]
- Steer RA, Ball R, Ranieri WF, & Beck AT (1999). Dimensions of the Beck Depression Inventory-II in clinically depressed outpatients. Journal of Clinical Psychology, 55(1), 117–128. [DOI] [PubMed] [Google Scholar]
- Stier A, & Hinshaw SP (2007). Explicit and implicit stigma against individuals with mental illness. Australian Psychologist, 42, 106–117. 10.1080/00050060701280599 [DOI] [Google Scholar]
- Swannell SV, Martin GE, Page A, Hasking P, & St John NJ (2014). Prevalence of nonsuicidal self-injury in nonclinical samples: Systematic review, meta-analysis and meta-regression. Suicide and Life-Threatening Behavior. 10.1111/sltb.12070 [DOI] [PubMed] [Google Scholar]
- Tatnell R, Kelada L, Hasking P, & Martin G (2014). Longitudinal analysis of adolescent NSSI: The role of intrapersonal and interpersonal factors. Journal of Abnormal Child Psychology, 42(6), 885–896. 10.1007/s10802-013-9837-6 [DOI] [PubMed] [Google Scholar]
- Taylor TL, Hawton K, Fortune S, & Kapur N (2009). Attitudes towards clinical services among people who self-harm: systematic review. The British Journal of Psychiatry, 194(2), 104–110. 10.1192/bjp.bp.107.046425 [DOI] [PubMed] [Google Scholar]
- Turner BJ, Yiu A, Claes L, Muehlenkamp JJ, & Chapman AL (2016). Occurrence and co-occurrence of nonsuicidal self-injury and disordered eating in a daily diary study: Which behavior, when? Psychiatry Research, 246, 39–47. 10.1016/j.psychres.2016.09.012 [DOI] [PubMed] [Google Scholar]
- Victor SE, & Klonsky ED (2014). Correlates of suicide attempts among self-injurers: A meta-analysis. Clinical Psychology Review. 10.1016/j.cpr.2014.03.005 [DOI] [PubMed] [Google Scholar]
- Welkowitz J, Lish JD, & Bond RN (1985). The Depressive Experiences Questionnaire: Revision and validation. Journal of Personality Assessment, 49(1), 89–94. 10.1207/s15327752jpa4901_17 [DOI] [PubMed] [Google Scholar]
- Willoughby T, Heffer T, & Hamza CA (2015). The link between nonsuicidal self-injury and acquired capability for suicide: A longitudinal study. Journal of Abnormal Psychology. 10.1037/abn0000104 [DOI] [PubMed] [Google Scholar]
- Zelkowitz RL, & Cole DA (2018). Self-criticism as a transdiagnostic process in nonsuicidal self-injury and disordered eating: Systematic review and meta-analysis. Suicide and Life-Threatening Behavior. 10.1111/sltb.12436 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zuroff DC, Sadikaj G, Kelly AC, & Leybman MJ (2016). Conceptualizing and measuring self-criticism as both a personality trait and a personality state. Journal of Personality Assessment, 98(1), 14–21. 10.1080/00223891.2015.1044604 [DOI] [PubMed] [Google Scholar]