Abstract
The current study examines the relation between distress tolerance, perceived stress, and internalizing symptoms across adolescence. Participants included 331 youth, ages 10 to 14 at the first wave of the study, assessed annually over 5 years. A latent growth curve approach was used to test three research questions, including whether perceived stress would increase across adolescence, whether distress tolerance (as measured by a behavioral task) would predict changes in perceived stress, and whether changes in perceived stress would mediate the relation between distress tolerance and internalizing symptoms. Results suggest that, consistent with previous findings, rates of perceived stress do increase across adolescence. Further, findings indicate that distress intolerance at baseline predicted increases in perceived stress, which in turn drove increases in internalizing symptoms. These findings point to the critical role of distress tolerance in bringing about changes in depression and anxiety symptoms and suggest support for utilizing a negative reinforcement framework to understand the emergence of internalizing symptomology.
Internalizing symptoms, which include anxiety and depressive symptoms, increase in prevalence across adolescence (Kessler et al., 2005; Roza, Hofstra, van der Ende, & Verhulst, 2003), with anxiety and mood disorders representing the most commonly diagnosed conditions during this developmental period (Merikangas et al., 2010). Internalizing symptoms impose massive costs, both financial and personal (Bodden, Dirksen, & Bögels, 2008; Glied & Neufeld, 2001; Lynch & Clarke, 2006; Mandell, Guevara, Rostain, & Hadley, 2003), suggesting the importance of targeting these disorders early and expeditiously. Of note, even moderate, subclinical internalizing symptomatology is associated with significant functional impairments (Angold, Costello, Farmer, Burns, & Erkanli, 1999; Copeland, Shanahan, Costello, & Angold, 2009; Dell’Osso et al., 2003). Further, symptoms of anxiety and depression during adolescence are predictive of anxiety and depressive disorders during adulthood (Copeland, Angold, Shanahan, & Costello, 2014; Garber, Kriss, Koch, & Lindholm, 1988; Lewinsohn, Clarke, Seeley, & Rohde, 1994; Rao et al., 1995). Thus, identifying factors predictive of the emergence and persistence of internalizing symptoms has critical public health implications in terms of prevention and intervention efforts.
Relations Between Distress Tolerance (DT) and Internalizing Symptomatology
Low DT, conceptualized as the perceived or actual inability to tolerate negative experiential states (e.g., negative emotions, discomfort, and uncertainty; Leyro, Zvolensky, & Bernstein, 2010), is a transdiagnostic risk factor associated with a variety of anxiety and depression-related disorders (Abrantes et al., 2008; Ellis, Vanderlind, & Beevers, 2013; Harrington, 2006; Keough, Riccardi, Timpsno, Mitchell, & Schmidt, 2010; Telch, Jacquin, Smits, & Powers, 2003; Timpano, Buckner, Richey, Murphy, & Schmidt, 2009), as well as with internalizing symptoms (Daughters, Gorka, Magidson, MacPherson, & Seitz-Brown, 2013; Daughters et al., 2009; Wolitzky-Taylor et al., 2015). Individuals with low DT are thought to be more reactive to distress and more likely to attempt to avoid distress-eliciting situations (Leyro et al., 2010). Following from this, youth with low DT are less likely to persist on distress-inducing tasks than youth with higher DT, despite both groups experiencing similar levels of distress (Danielson, Ruggiero, Daughters, & Lejuez 2010; Daughters et al., 2009; MacPherson et al., 2010). The impact of low DT on youth can be understood within a negative reinforcement framework, which highlights the escape and avoidance of negative affective states as the primary motivational factor across situations. This conceptualization fits nicely with behavioral theories of anxiety, which suggest avoidance is relevant to the development and persistence of anxiety (Barlow, Allen, & Choate, 2004; Glick & Orsillo, 2011), giving credence to observed relations between low DT and anxiety (e.g., Cummings et al., 2013; Danielson et al., 2010; Daughters et al., 2009). Furthermore, in relation to depression, low DT is associated with engagement in rumination, which can be conceptualized as emotional avoidance without active problem solving; here, rumination mediates relations between DT and depression (Magidson et al., 2013). Thus, low DT may be associated with the onset of internalizing symptomatology during this developmental period because of how it impacts youths’ engagement with day-to-day distress.
Initial conceptualizations of DT suggested it was a stable traitlike characteristic originating in childhood (Linehan, 1993), which has been demonstrated empirically among youth (Cummings et al., 2013). More recent work suggests DT has genetic correlates (Amstadter et al., 2012), providing further evidence for the idea that DT likely impacts how youth react to distress throughout development. Given strong associations between low DT and internalizing disorders/symptoms, it is possible that low DT may be a critical factor relevant to the emergence and persistence of internalizing psychopathology. However, although several studies have linked low DT and internalizing symptomatology concurrently, no study, to our knowledge, has tested DT as a predictor of internalizing symptoms across early development. It is thus unknown whether low DT is merely associated with internalizing symptoms, or whether this traitlike characteristic increases youths’ vulnerability to the development of internalizing symptomatology during this critical developmental period. In addition, given the stability of DT during childhood and adolescence, it is possible that DT causes changes in other intermediary processes, thereby increasing rates of internalizing symptomatology during this period. However, this has not previously been examined. Thus, the current study aims to fill these gaps by furthering our understanding of how DT may serve as an early vulnerability factor for later psychopathology.
Mediators of the Relations Between DT and Internalizing Symptoms
Beyond establishing low DT as a potential risk factor for the development of internalizing symptomatology, it is critical to determine whether low DT impacts other intermediary processes relevant to the development of symptomatology. Given that DT is stable during adolescence (e.g., Cummings et al., 2013), it is possible that DT impacts youths’ reactions to different environmental factors encountered during the developmental transition from childhood to adolescence. One possible mechanism linking DT and internalizing symptoms is perceived stress, or the degree to which individuals experience stress as unmanageable and overwhelming, relative to their ability to cope with particular situations (Cohen, Kamarck, & Mermelstein, 1983). Specifically, perceived stressis often operationalized as an individual’s self-reported feelings of being unable to control or cope with nonspecific life stressors. Though related to depression and anxiety, perceived stress has been shown to be a distinct construct (Cohen et al., 1983) and to predict internalizing symptoms above and beyond discrete negative life events (Cohen, 1986; Martin, Kazarian, & Breiter, 1995). Further, early elevations in perceived stress were found to predict increases in depression and anxiety symptoms over time among youth (Galaif, Sussman, Chou, & Wills, 2003; Schmeelk-Cone & Zimmerman, 2003; Varni & Katz, 1997).
There are three main conceptual links suggesting that perceived stress may be an important mediator of the relations between DT and later internalizing symptomatology. These links highlight relations between (a) low DT and perceived stress, (b) perceptions of stress and internalizing symptomatology, and (c) low DT and internalizing symptoms through the mechanism of perceived stress.
First, emerging evidence suggests an important link between low DT and individuals’ perception of their day-to-day stressful experiences. For instance, in a daily diary study of adults, researchers found that low baseline DT was associated with reporting more daily life stressors across a variety of domains (Hawkins, Macatee, Guthrie, & Cougle, 2013). Given that individuals with lower DT are not necessarily experiencing more distress, but rather are more reactive to the distress they are experiencing (e.g., Danielson et al., 2010; Daughters et al., 2009; MacPherson et al., 2010), we would expect that they would have a heightened awareness of potentially stressful events in their environments. Following from this, it is possible these individuals would be more likely to notice more stressful events in their environments and experience an accumulation of negative affect, resulting in the onset and maintenance of internalizing symptoms (Gross, 1998, 2002; Lynch & Mizon, 2011).
Second, developmental trends in rates of perceived stress appear to mirror rates of internalizing symptoms; the perceived intensity of stressful events increases across adolescence, whereby older adolescents, specifically females, report experiencing stressful events as more intense than their younger counterparts (Jose & Ratcliffe, 2004). The perception of stress in one’s environment is consistently linked to the onset and maintenance of internalizing symptoms among youth (e.g., Hammen, 2005; Martin et al., 1995; Sontag & Graber, 2010), and researchers argue that this cognitive appraisal of the intensity of stress is central to the onset of psychopathology (e.g., Compas, Davis, Forsythe, & Wagner, 1987; Lazarus, 1999). Thus, perceived stress may be an important predictor of internalizing symptomatology among youth.
Third, because distress-intolerant individuals may be more likely to perceive their lives as being increasingly stressful over time, these individuals might be those who are most likely to develop elevated levels of internalizing symptomatology. Related to this, cross-sectional research from an HIV-positive adult sample found that individuals with lower levels of DT reported experiencing stressful experiences and evidenced greater levels of depressive symptoms (O’Cleirigh, Ironson, & Smits, 2007). Thus, perceived stress may mediate the relations between DT and internalizing symptoms such that lower levels of DT may make youth more aware of potential life stressors, which in turn may increase the likelihood of internalizing symptoms across development. In other words, children who are less able to tolerate distress may both perceive more stress in their environment (that they feel less able to cope with) and, consequently, experience greater increases in internalizing symptoms across this developmental period. These relations have not been examined previously in any sample, to our knowledge, and offer a potential intervention point for youth at risk for internalizing symptoms.
Measuring DT Among Youth
When investigating how low DT might relate to perceived stress and internalizing symptomatology, it is critical to consider the most appropriate methods for measuring the construct of DT among youth, as a number of self-report and behavioral measures of this construct exist (see Leyro et al., 2010, for a review). Given methodological and interpretive problems with using self-report measures among youth, including youths’ difficulties interpreting questions and their willingness to accurately report inner experiences (Lejuez, Kahler, & Brown, 2003; Wills, Sandy, & Yaeger, 2002), the use of a behavioral measure of DT increases confidence in findings. Because behavioral measures do not rely on youths’ abilities to accurately describe inner states and motivations, they might better capture youths’ difficulties persisting when distressed. Empirical work demonstrates youths’ persistence on a behavioral task assessing DT, the Behavioral Indicator of Resiliency to Distress (BIRD), is unrelated to self-reported distress or to actual ability to succeed on this task (Amstadter et al., 2012; Daughters et al., 2009; MacPherson et al., 2010); thus, this task captures willingness to persist, despite distress. For the present study, we were interested in understanding how DT impacted youths’ behavioral reactions to situations they perceived as stressful. Thus, behavioral assessments targeting youths’ ability to persist in goal-directed behavior when distressed were of particular interest.
Current Study
From a developmental psychopathology perspective, understanding individual factors relevant to the emergence of internalizing symptoms and disorders during adolescence (e.g., Kessler et al., 2005; Roza et al., 2003) is critical. Examining both inter- and intraindividual differences, as well as developmental trajectories of risk, allows us to examine the role of change across adolescence in predicting vulnerabilities to the onset of anxiety and depression. Low DT and high perceived distress are two specific potential risk factors for the development of internalizing symptoms, and offer potential points of intervention and prevention. Thus, the current study aimed to examine the relationship between DT, perceived stress, and internalizing symptoms in a sample of community youth followed over 5 years during the critical developmental transition from late childhood to adolescence. To that end, we proposed three hypotheses. First, we hypothesized that perceived stress would increase across adolescence. Second, we hypothesized that lower levels of DT at baseline would be associated with greater increases in perceived stress over time. Third, we hypothesized that increases in perceived stress would mediate the relation between DT and later internalizing symptoms.
Method
Participants and procedures
The current study included youth recruited from a metropolitan area as part of a longitudinal study examining the development of psychopathology. Youth and their families were recruited through media outreach and through postings and fliers at community centers, area schools, libraries, and Boys and Girls clubs. Interested families were screened for proficiency in English and their ability to take part in annual assessments. Two cohorts of participants were recruited to take part in the study. The original cohort included 277 youth who were asked to participate annually over the course of six assessments; because key measures were not introduced until the second wave of data collection, the current study utilized data collected during years 2–6. Of the original sample of 277 adolescents recruited for the first cohort, 244 youth (45% girls) between ages 10 and 14 (M = 12.07 years, SD = 0.91 years) participated at the second wave of assessment (considered the baseline for the purposes of the current study). Youth who completed both Waves 1 and 2 did not significantly differ from students who completed only Wave 1 on any demographic or study variables (ps > .274). Over the course of the study, 246 youth participated in Wave 3, 231 participated in Wave 4, 210 participated in Wave 5, and 179 participated in Wave 6. Forty-nine percent of the sample identified as White, 35% as Black, 3% as Latino/a, 1% as Asian, and 12% as “other.”
A second cohort of adolescents was recruited approximately 4 years after the first cohort began the study to increase the racial diversity of the total sample. This cohort participated in three waves of data collection and therefore contributed data to the first two waves of the current study. The second cohort included 53 youth between the ages of 10 and 15 (M = 12.46 years, SD = 1.36 years) at the baseline (Wave 2) wave, and 50 youth at the following wave. Of those participating in the second cohort, 15% identified as White, 78% identified as Black, and 6.5% as other. Each cohort’s corresponding waves of data were then combined (i.e., Cohort 1’s Wave 1 and Cohort 2’s Wave 1 were combined to create the total Wave 1 sample, etc.). The total number of youth who participated at every wave was 169; however, missing data estimation procedures (outlined below) allowed us to include all participants in the following analyses. In total, 331 adolescents contributed data to at least one data point used in the study.
Measures
Demographic variables.
We collected demographic information at the baseline assessment, including age, sex, and race/ethnicity for each participant. In line with previous research (e.g., Billy & Udry, 1985; Henry, Shcoeny, Deptula, & Slavick, 2007), we dichotomized participants into White and non-White.
Perceived Stress Scale.
Participant’s perception of their personal stress level was measured using the Ten-Item Perceived Stress Scale (PSS-10; Cohen et al., 1983). The PSS-10 is generally considered the most widely used measure of perceived stress (Taylor, 2015) and taps the appraisal of subjective stress in an individual’s life. Youth were asked to rate how often they have perceived uncontrollable or unpredictable stress in their lives over the past month on a 5-point scale (0 = never, 4 = very often). Sample items from this scale include “In the last month, how often have you found that you could not cope with all things you had to do?” Previous research suggests that the PSS-10 can be further divided into two subscales: the perceived distress subscale and the perceived coping ability subscale (Martin et al., 1995). Cohen, the developer of the original scale, favored the use of either the full-scale score or the perceived distress subscale alone (Cohen & Williamson, 1988). A recent psychometric study of the measure further supports a two-factor model of the scale, but also supports the utility of utilizing the total score (Taylor, 2015). Both the total score PSS-10 and the individual subscales have demonstrated good reliability and validity (Martin et al., 1995; Yeager et al., 2014). In the current sample, internal consistency was adequate for each wave of data for the full-scale (Cronbach α range = 0.60–0.67) and for the perceived distress subscale (Cronbach α range = 0.82–0.86). Given a lack of concordance in the literature regarding which scale more validly captures perceived stress (see Cohen & Williamson, 1988; Taylor, 2015), we opted to run all models using both the full-scale score and the perceived distress subscale.
Internalizing symptoms.
The Revised Children’s Anxiety and Depression Scale (Chorpita, Yim, Moffitt, Umemoto, & Francis, 2000) is a youth self-report measure of anxiety and depression symptoms. This measure consists of 47 items measured on a 4-point Likert-type scale. Youth were asked to rate how often they experience specific internalizing symptoms, such as “I feel sad or empty.” Higher scores denote more symptomology. The measure is used widely among adolescents and demonstrates good reliability and validity (Chorpita et al., 2000). Reliability was excellent in the current study (Cronbach αs = 0.94 and 0.95 at the baseline and final wave, respectively).
DT.
The BIRD (Lejuez et al., 2006) was developed based upon the adult computerized DT task the Paced Auditory Serial Addition Test—Children (Lejuez et al., 2003) and has previously been used as an indicator of DT among youth (Danielson et al., 2010; Daughters et al., 2009, 2013; MacPherson et al., 2010). Briefly, during the BIRD, youth have the option of persisting on a distressing task (with positive reinforcement available for persisting), or quitting the task to reduce emotional distress. More specifically, the task presents a series of 10 numbered boxes on a computer screen. Youth are instructed to click on a green dot that appears above one of the numbered boxes before the dot moves to another box. If the youth successfully clicks the box before the dot moves, an animated bird flies out of its cage while making a pleasant chirping sound, and the youth earns a point. If the youth is unable to click the green dot before it moves or the wrong box is clicked, the bird remains in its cage while making a loud and unpleasant noise, and no point is earned. The total number of points earned is recorded on the screen throughout the task, and youth are told their overall prize will depend on their performance on the task.
The task has three levels that sequentially increase in difficulty level. The first level of the BIRD lasts 3 min and begins with a 5-s latency between dot presentations. This latency is titrated based upon performance (correct answers reduce the latency by 0.5 s whereas incorrect answers increase the latency by 0.5 s), and an average latency is calculated based on the skill level of the youth. The second level of the BIRD lasts 5 min and is more difficult; it begins with the average latency from the previous level for 4 min and then reduces the latency in half for the final minute (i.e., the “challenge latency”). Following a brief rest period, the final level presents stimuli at the challenge latency for up to 5 min. Thus, both the difficulty of the task and the consequent discordant chirping noise create distress. Youth are told they have the option to quit the task at any point during the final level; however, their final prize will correspond to their total points when the task is terminated. As in previous studies, youth were shown possible prizes they could earn prior to beginning the task (e.g., DVDs, games, art supplies, sporting equipment), but were not provided information about the number of points necessary to earn these prizes. As in prior work, persistence on the final level of the BIRD was used to assess DT and was indicated by the number of seconds youth persisted (see Danielson et al., 2010).
In support of validity of the BIRD, the task reliably elicits distress in youth completing the task (Amstadter et al., 2012; Cummings et al., 2013; Daughters et al., 2009; MacPherson et al., 2010), and task performance is related to both internalizing and externalizing symptomatology (Amstadter et al., 2012; Cummings et al., 2013; Daughters et al., 2009; MacPherson et al., 2010). Further, youth who quit the task perform equally well on the task and do not differ in the amount of self-reported distress elicited by the task, as compared to youth who do not quit the task (Danielson et al., 2010; Daughters et al., 2009; MacPherson et al., 2010), demonstrating that the task does not simply measure success on the task, or distress in response to the task. Previous work provides support for concurrent validity (Daughters et al., 2009) and test retest reliability (Cummings et al., 2013) of the BIRD.
Positive and Negative Affect Schedule—Children (PANAS-C).
To ensure youth actually experienced distress during the BIRD, youth completed the PANAS-C (Laurent et al., 1999) before the task and after the second level of the task (see Daughters et al., 2009). The PANAS-C has good convergent and discriminant validity (Laurent et al., 1999). As in previous studies (e.g., Daughters et al., 2009; MacPherson et al., 2010), distress was indexed based on the summed scores of mad, frustrated, upset, embarrassed, and nervous, rated on a 10-point Likert scale.
Data analytic plan
In order to ensure that the BIRD was psychologically stressful, pre- to postaffect change on the PANAS-C was examined using paired-samples t tests. PANAS-C change scores were then compared among those who did versus did not quit the BIRD using an independent samples t test to determine whether quitting was significantly related to changes in negative affect. To ensure that the ability to succeed on the task did not impact a youth’s choice to quit the task, differences in youths’ skill level as measured by the latency period between the time the child is presented a green dot and the time the child is able to press the corresponding box were examined using an independent samples t test (see Amstadter et al., 2012; Daughters et al., 2009; MacPherson et al., 2010).
A latent growth model (LGM) approach was used to examine initial levels and change over time in rates of perceived stress. LGM utilizes multiple waves of data to estimate latent factors representing baseline levels and trajectories over time of targeted constructs. Specifically, means and variances are derived for both the latent intercept (initial level) and slope (change over time) using all available data points. Thus, even though participants from the second cohort did not complete the final three waves of the current study, their data can be entered to estimate both the latent intercept and the slope, allowing for increased power to find trends over time. A significant intercept mean would suggest that baseline value of perceived stress is different than zero, while a significant slope mean indicates that values of this construct change significantly over time. Significant variances in the intercept or slope term suggest individual differences around these estimates and support the inclusion of predictors of these differences.
In order to estimate the latent growth model of perceived stress, regression weights from the latent intercept term to each manifest measure were set to 1.0. Regression weights for the slope factor define the shape of the trajectory. We examined a model with regression weights constrained to 0.0, 1.0, 2.0, 3.0, and 4.0 (respectively) to represent a linear trend in change over time. Consistent with recommendations from Hancock, Harring, and Lawrence (2013), a competing model in which regression weights were freely estimated was compared to the constrained linear model. The difference in fit, as indexed by the change in χ2 statistic and accompanying degrees of freedom, was evaluated, and the freely estimated model was chosen if it yielded a significantly improved model fit. Next, a more parsimonious model constraining the error variances to be equal across repeated measures (i.e., setting residuals to be homoscedastic) was examined. If these constraints did not result in a significant perturbation to model fit, the model was retained.
Next, we included our time-invariant predictors, including demographic variables and DT. In order to examine mediation, we included internalizing symptoms at the last data point and regressed these symptoms onto the latent intercept, slope, and our baseline time-invariant predictors, controlling for baseline internalizing symptoms. After fitting the model, we tested the indirect effect of DT on internalizing symptoms via changes in perceived stress over time (i.e., DT → latent slope of perceived stress → end point internalizing symptoms) by estimating its confidence interval, using the bootstrapping procedure recommended by Preacher and Hayes (2008). Unlike hypothesis testing based on parametric statistics, bootstrapping procedures do not assume normality (Preacher & Hayes, 2008). An indirect effect with a confidence interval that does not contain 0 would indicate a statistically significant indirect effect (i.e., mediation).
Four fit indices were examined to determine how well our model reflected the data: the χ2 statistic, the comparative fit index (CFI; Bentler, 1988), the Tucker–Lewis index (TLI; Tucker & Lewis, 1973), and the root mean square error of approximation (RMSEA; Steiger, 1990). Nonsignificant χ2 values indicate good fit; however, this index is sensitive to sample size. CFI and TLI values greater than 0.90 and RMSEA values less than 0.08 suggest acceptable fit (Schweizer, 2010). All analyses were completed using Mplus 6.0 (Muthén & Muthén, 2010), which utilizes full information maximum likelihood estimation methods to handle missing data. Enders (2010) recommends full information maximum likelihood because it provides less biased parameter estimates than procedures such as listwise or pairwise deletion under the missing at random assumption (Little & Rubin, 1989). Thus, we were able to conduct all analyses on the full sample.
Results
Preliminary analyses
Missing data patterns among key variables at each wave were examined using Little’s (1988) missing completely at random test. Results from these analyses suggest that the data were missing completely at random, χ2 (170) = 179.06, p = .302. Data were next examined to ensure that they met the criteria for univariate normality. All skew and kurtosis statistics appeared to be in the acceptable range (≤3.0). We also examined the data for differences in rates of perceived stress between cohorts; no significant differences were detected. Descriptive statistics and correlations between all key variables are reported in Table 1.
Table 1.
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | |
---|---|---|---|---|---|---|---|---|---|---|---|
1. Sex (male) | 1.00 | ||||||||||
2. Age | .06 | 1.00 | |||||||||
3. Ethnicity (White) | .01 | .03 | 1.00 | ||||||||
4. Wave 2 BIRD | .05 | .16* | .06 | 1.00 | |||||||
5. Wave 2 RCAD | .01 | −.09 | .04 | −.14* | 1.00 | ||||||
6. Wave 2 PSS | .00 | .04 | −.02 | −.06 | .59** | 1.00 | |||||
7. Wave 3 PSS | −.11* | .01 | .01 | .01 | .45** | .51** | 1.00 | ||||
8. Wave 4 PSS | −.28** | .04 | .01 | −.13* | .40** | .40** | .59** | 1.00 | |||
9. Wave 5 PSS | −.28** | .09 | .00 | −.04 | .31** | .38** | .56** | .65** | 1.00 | ||
10. Wave 6 PSS | −.31** | −.12 | .00 | −.26** | .36** | .30** | .44** | .55** | .62** | 1.00 | |
11. Wave 6 RCAD | −.26** | .04 | .21* | −.22** | .47** | .28** | .45** | .52** | .60** | .64** | 1.00 |
M | 0.57 | 11.97 | 0.39 | 213.90 | 27.01 | 14.33 | 14.63 | 14.90 | 14.71 | 15.88 | 22.62 |
SD | 0.50 | 0.96 | 0.49 | 107.03 | 17.61 | 6.26 | 4.31 | 6.18 | 6.37 | 6.48 | 15.85 |
Note: BIRD, Behavioral Indicator of Resiliency to Distress; RCAD, Revised Children’s Anxiety and Depression Scale; PSS, Perceived Stress Scale. Ethnicity is coded 1 = White, 0 = non-White; sex is coded 1 = male, 0 = female.
p < .05.
p < .01.
We assessed whether the task was perceived as distressing by examining changes in negative affect before and after the BIRD task. Using a paired-samples t test, we found there was a significant increase in negative affect from pretask (M = 0.95, SE = 0.34) to posttask (M = 7.09, SE = 0.49); t (291) = −7.09, p , .001. In order to examine whether task-induced distress or task skill affected youths’ persistence on the task, mean-level changes in negative affect from pre- to posttask were examined using an independent-samples t test between groups of youth who did (M = 3.80, SE = 0.76) and did not (M = 3.01, SE = 0.60) quit the task. The difference between groups was not significant: t (236) = −0.81, p = .421. The mean latency period (a measure of task skill) was also examined; results suggest that youth who did (M = 1.50, SE = 0.02) and did not (M = 1.57, SE = 0.05) quit the task did not evidence different levels of skill: t (202) = 1.58, p = .117.
Unconditional model
We examined an unconditional linear growth model of perceived stress over time in which the latent slope factor loadings were constrained to be 0.0, 1.0, 2.0, 3.0, and 4.0 (respectively). Evaluation of model fit indices for the LGM suggested excel excellent fit to the data: χ2 (10) = 11.81, p = .298, CFI = 0.99, TLI = 0.99, RMSEA = 0.023, 90% confidence interval (CI) [0.000, 0.067]. We then compared the fit of this model to an unconditional model in which factor loadings associated with Waves 4–6 (corresponding to the third through last waves used in the current study) were freely estimated rather than fixed. The difference in fit between the linear model (with fixed estimates) and the freely estimated model was not significant: Δχ2 = 2.50, Δdf = 3, suggesting that changes in perceived stress can be described as a linear trend.1 Next, we constrained the residual variances to be equal across time points. This resulted in a nonsignificant change in model fit: Δχ2 = 7.56, Δdf = 4; thus, we retained the more parsimonious linear growth model with homoscedastic residuals.2
The means of both the intercept (M = 14.31, SE = 0.32, p <.001) and the slope (M = 0.31, SE = 0.12, p = .008) were significant, suggesting that baseline perceived stress is significantly greater than zero and, in support of our first hypothesis, perceived stress increases over time. Further, both the variances of the mean (variance = 21.81, SE = 2.68, p < .001) and the slope (variance = 1.57, SE = 0.35, p < .001) were significant, indicating individual differences around these estimates. The slope and intercept were also correlated with each other (r = −1.79, p = .023), indicating that participants who reported greater levels of perceived stress at baseline evidenced slower increases in perceived stress over time.
Conditional model
Next, we regressed the latent slope and intercept onto our baseline predictors, including age at baseline, sex, ethnicity, DT, and baseline internalizing symptoms. The model continued to fit the data well: χ2 (35) = 57.65, p = .009, CFI = 0.96, TLI = 0.96, RMSEA = 0.041, 90% CI [0.021, 0.060]. The results suggest that only baseline internalizing symptoms (β = 0.74, p < .001) significantly predicted the latent intercept of perceived stress, indicating that participants who endorsed higher initial levels of internalizing also reported higher baseline levels of perceived stress. DT (β = −0.21, p = .028), sex (β = −0.42, p < .001), and baseline internalizing symptoms (β = −0.31, p = .001) also significantly predicted changes in perceived stress over time. Consistent with our second hypothesis, these results suggest that lower initial levels of DT are associated with greater increases in perceived stress over time. Being female and reporting lower levels of internalizing symptoms at baseline were also associated with greater increases in perceived stress.3
Mediation model
In order to examine whether changes in perceived stress mediate the relation between DT and later internalizing symptoms, we examined a model (see Figure 1) in which we regressed internalizing symptoms at the final wave on the latent intercept and slope of perceived stress, which in turn were regressed onto our baseline predictors. This model also fit the data well: χ2 (38) = 63.57, p = .006, CFI = 0.96, TLI = 0.96, RMSEA = 0.045, 90% CI [0.024, 0.064]. Both the latent intercept (β = 0.41, p < .001) and the slope (β = 0.74, p < .001) of the perceived stress growth curve significantly predicted Wave 6 internalizing symptoms, indicating that higher baseline levels and greater changes in perceived stress over time were associated with elevated internalizing symptoms, controlling for baseline levels. Next, we examined the pathway from DT to internalizing symptoms, via changes in perceived stress over time. In support of our third hypothesis, there was a significant, if small, indirect effect (unstandardized indirect effect = −0.022, SE = 0.01), 95% CI [−0.044, −0.001], suggesting that lower levels of DT predict increases in perceived stress over time, which in turn predict elevations in internalizing symptoms.4
Discussion
The current study yielded three important findings regarding the relations between DT, perceived stress, and internalizing symptoms. First, consistent with existing literature, our results indicate that rates of perceived stress increase across adolescence. Second, these results provide the first published evidence that early levels of DT predict changes in perceived stress, such that distress-intolerant youth reported greater increases in the amount of stress they perceived in their environments over time. Third, these increases in perceived stress across adolescence mediated the relation between initial levels of DT and later internalizing symptoms. These findings are elaborated upon below.
Given that perceptions of stress may be particularly important in understanding the onset of internalizing symptoms (e.g., Cohen, 1986), investigations of the developmental trajectory and related predictors of perceived stress help to elucidate the relations between these constructs. Although research has consistently supported increases in rates of discrete stressful life events across adolescence (e.g., Ge, Conger, Lorenz, & Simons, 1994; Larson & Ham, 1993), less attention has been paid to changes in the perception of stress over this same time period. Of note, and consistent with research from previous studies (e.g., Hammen, 2005; Martin et al., 1995; Sontag & Graber, 2010), the trajectory of perceived stress appears to mirror that of the emergence of anxiety and depression. Specifically, our research supports previous findings that self-reported perceived stress increases from early to middle adolescence (e.g., van Jaarsveld, Fidler, Steptoe, Boniface, & Wardle, 2009), which parallels increases in generalized anxiety and depressive symptoms across this same developmental period (e.g., Costello, Mustillo, Erkanli, Keeler, & Angold 2003; Merikangas et al., 2010). Although our finding that lower baseline internalizing symptoms were associated with greater increases in perceived stress over time was surprising, it is noteworthy that baseline internalizing symptoms were not correlated with other theoretically related constructs including sex and DT during this time period, indicating that the relation between internalizing symptoms and previously established correlates may change across development. Further research on the predictive validity of early internalizing symptoms is certainly warranted.
Our findings complement other research indicating that being female is associated with greater increases in perceived stress over time (e.g., Martin et al., 1995; Yarcheski & Mahon, 2000). Given that rates of internalizing symptoms also increase more precipitously for girls than for boys across this developmental period (e.g., Kessler et al., 2005; Roza et al., 2003), these results suggest that girls’ appraisal of their environments as more stressful may be an important explanatory factor in understanding this emergent gender difference. These findings also suggest that early to middle adolescence represents a particularly critical developmental period for experiencing increases in perceived stress, specifically among girls. It will be important in future work to examine whether these increases in perceived stress, as a function of low DT, may help to explain elevated rates of internalizing symptomatology in girls during this developmental transition.
As noted above, this is the first study to our knowledge that demonstrates relations between low DT and increases in perceived stress over time among youth. These results suggest that youth with lower DT are more likely to perceive events that occur in their environments as stressful, negative, and potentially intolerable. Our findings also support that perceived stress is an important mechanism linking early DT and later anxiety and depression symptoms. These results are consistent with a negative reinforcement framework, which suggests that the experience of feeling overwhelmed by stress may drive maladaptive stress-responses to alleviate negative feelings, which, paradoxically, serves to increase negative affect over time (e.g., Abrantes et al., 2008; Daughters et al., 2013). While this research did not examine specific stress-responses, such as self-reported escape and avoidance behaviors beyond quitting the BIRD task itself, it does help us to understand early mechanisms linking personality factors to increases in distressing feelings that may be a primary motivator for behavior. Although this framework has been used to explain the development of substance use and anxiety disorders (e.g., MacPherson et al., 2010; Roemer, Salters, Raffa, & Orsillo, 2005), recent work has also articulated how it can be used to explain internalizing symptomology more broadly (e.g., Daughters et al., 2009). Recent research suggests that individuals with higher levels of perceived stress also self-report tendencies to use avoidance coping, indicating that individuals who experience their environments as more stressful are also more likely to avoid distressing situations as a means to cope with their own negative affect (Eisenbarth, 2012; Hager & Runtz, 2012; Halama & Bakošova, 2009; Sontag & Graber, 2010). Collectively, this provides initial evidence to suggest that lower DT youth may be those most likely to perceive events in their environments as stressful, to engage in avoidant coping when encountering these events, to generalize this behavior pattern across situations, and thus to develop elevated levels of internalizing symptomatology in response to this avoidance.
The current study therefore makes a critical contribution to the existing literature by demonstrating a temporal link between several of these constructs, including DT, perceived stress, and internalizing symptoms: early adolescents with greater distress intolerance are likely to experience their environments as uncontrollably stressful relative to their abilities to cope. This in turn is associated with concomitant increases in anxiety and depression symptoms. Although this mediation effect was small, we believe these findings address a critical gap in the literature: these results are the first, to our knowledge, to demonstrate a longitudinal link between these constructs during adolescence and add support for understanding the emergence of internalizing disorders from a negative reinforcement perspective.
Limitations and future research directions
Alongside these novel findings, the current study has several limitations. First, we did not have enough statistical power to simultaneously model changes in internalizing symptoms over time, which limits our understanding of the bidirectional nature of these relations. While we were able to examine baseline internalizing symptoms as a predictor of change in perceived stress, and changes in perceived stress as a predictor of resultant internalizing symptoms (controlling for rates at baseline), it is likely that trajectories of both stress and internalizing symptoms impact one another (e.g., Hammen, 2005). Future research should examine the relative effects of these constructs to better understand this vulnerable developmental period. Specifically, utilizing a multivariate growth modeling approach would allow researchers to examine transactional relations between these constructs over time and note the relative influence of change in either construct on the other. Second, a measure of discrete negative life events was not included in any of the waves examined in the current study. Given that the perception of stress both influences, and is influenced by, psychopathology, it will be important in future studies to disentangle the subjective perception of stress from objective stressful life events (for a review, see Monroe, 2008). Future research should consider discrete negative life events as a possible predictor of changes in perceived stress or, at a minimum, include life events as a time-varying control variable. Despite these concerns, the PSS-10 has been shown to uniquely predict related constructs, such as physical health outcomes, above and beyond psychological symptoms, suggesting promising discriminant validity (Cohen & Williamson, 1991; Cohen, Tyrrell, & Smith, 1993; Monroe & Kelley, 1995). Third, we did not have data on how youth actually coped with the stress they perceived in their environment. While perceived stress is associated with avoidant coping, which in turn is associated with the onset of internalizing symptoms (e.g., Abrantes et al., 2008; Daughters et al., 2013; Eisenbarth, 2012; Hager & Runtz, 2012; Halama & Bakošova, 2009; Sontag & Graber, 2010), we cannot be certain that youth actually engaged in this coping style. Future studies should also consider utilizing more fine-grained statistical methods, such as an autoregressive cross-lagged panel model, that would allow researchers to examine interwave change to determine whether avoidant coping mediates the relation between perceived stress and the onset of internalizing pathology. Fourth, more research needs to be done on the construct validity of DT among youth. While research has begun describing the nomological net of constructs related to DT among adults (see Leyro et al., 2010), little of this work has been undertaken in child and adolescent populations, despite evidence that distress regulation processes may be qualitatively different among youth (i.e., Garber, 1984). Thus, future studies should consider the convergent and discriminant validity of DT and related constructs, including neuroticism, grit, and resilience. Fifth and finally, while we were able to use a behavioral task to assess DT, we measured both perceived stress and internalizing symptoms utilizing self-report questionnaires that contained some similarly worded items, suggesting that monomethod bias may play a role in our findings. Despite considerable research demonstrating that these are distinct constructs (e.g., Cohen et al., 1983), some items on the PSS-10 have overlap with internalizing symptomology, such as “In the last month, how often have you felt ‘nervous’ and ‘stressed.’” While the PSS-10 is the most widely used and validated measure of perceived stress (Taylor, 2015), future research should consider alternative ways of measuring this construct.
Conclusions and clinical implications
The current study examines an important pathway in the development of internalizing symptoms that is relevant for treatment development and preventative efforts. Findings suggest that early distress intolerance predicts increases in perceived stress, which in turn is associated with elevations in anxiety and depression symptoms. This has important implications for future treatment efforts and offers multiple points for prevention and intervention. Because internalizing symptoms during adolescence are an important predictor of internalizing disorders and functional impairments during adulthood (e.g., Copeland et al., 2014), early intervention efforts could help prevent long-term impairments related to anxiety and depression throughout the life span. Early adolescents with low DT presenting for treatment could be provided with interventions aimed at increasing willingness to experience emotions and to engage in valued interactions (e.g., Livheim et al., 2015), despite perceiving their environments as stressful. Increasing youths’ acceptance of distressing emotions (and, therefore, limiting their use of behaviors associated with avoiding or escaping distress) could serve to habituate children to these feelings, thereby increasing their tolerance for distress. Low DT has been successfully addressed in interventions among adults (e.g., Bornovalova, Gratz, Daughters, Hunt, & Lejuez 2012; Linehan, 1993) and has been incorporated as a key treatment target for adolescents as well (e.g., Rathus & Miller, 2015). For instance, mindfulness training has been shown to increase affective DT specifically (Lotan, Tanay, & Bernstein, 2013). Related to this, research could investigate the utility of adding a brief therapeutic component aimed at increasing youth DT to existing interventions specifically for internalizing symptoms. Given that emotion regulation capabilities are still developing during adolescence (e.g., McCrae et al., 2012), adapting existing interventions for use with adolescent populations may have tremendous utility in preventing the onset of internalizing symptoms across this vulnerable developmental period. Treatments focused on low DT could help to target emotional avoidance and increase resiliency in low DT youth.
Taken together, the current findings begin to shed light on the complex relations between distress intolerance, perceived stress, and internalizing symptoms. Our work points to the importance of considering youth willingness to tolerate distress and the impact of this willingness on their impressions of stress in their environments. Moreover, these findings suggest important next steps in understanding the onset of depression and anxiety during adolescence, as well as potential points for prevention and intervention efforts.
Acknowledgments
This research was partly supported by National Institute of Drug Abuse Grants 1 F31 DA035033–01 (Principal Investigator, A.N.B.) and R01DA018647 (Principal Investigator, C.W.L.).
Footnotes
We also ran the model including a quadratic trend. A comparison of the Akaike information criterion and Bayesian information criterion values suggest that the linear model provides a better comparative fit than the quadratic model.
We also examined an unconditional latent growth model of the perceived distress subscale of the PSS-10. Results were similar to those reported above, with the final model (including homoscedastic residuals) fitting the data well: χ2 (14) = 14.94, p = .382, CFI = 0.99, TLI = 0.99, RMSEA = 0.014, 90% CI [0.000, 0.056]. The results suggest that perceived distress significantly increases across adolescence.
The results for the perceived distress subscale indicated a similar pattern of results. Specifically, DT, older age, greater internalizing symptoms, and being White were associated with higher baseline levels of perceived distress, while less DT, being female, and reporting higher internalizing symptoms were also associated with increases in perceived distress over time.
The results for the perceived distress subscale also suggest that increases in perceived distress mediate the relation between DT and internalizing symptoms (unstandardized indirect effect = −0.025, SE = 0.011), 95% CI [−0.046, −0.004].
References
- Abrantes AM, Strong DR, Lejuez CW, Kahler C, Carpenter LL, Price LH, … & Brown RA (2008). The role of negative affect in risk for early lapse among low distress tolerance smokers. Addictive Behaviors, 33, 1394–1401. doi: 10.1016/j.addbeh.2008.06.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Amstadter AB, Daughters SB, MacPherson L, Reynolds EK, Danielson C, Wang F, …& Lejuez CW (2012). Genetic associations with performance on a behavioral measure of distress intolerance. Journal of Psychiatric Research, 46, 87–94. doi: 10.1016/j.jpsychires.2011.09.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Angold A, Costello JE, Farmer EMZ, Burns BJ, & Erkanli A (1999). Impaired but undiagnosed. Journal of the American Academy of Child & Adolescent Psychiatry, 38, 129–137. doi: 10.1097/00004583199902000-00011 [DOI] [PubMed] [Google Scholar]
- Barlow DH, Allen LB, & Choate ML (2004). Toward a unified treatment for emotional disorders. Behavior Therapy, 35, 205–230. doi: 10.1016/S0005-7894(04)80036-4 [DOI] [PubMed] [Google Scholar]
- Bentler PM (1988). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi: 10.1037/033-2909.107.2.238 [DOI] [PubMed] [Google Scholar]
- Billy JO, & Udry JR (1985). Patterns of adolescent friendship and effects on sexual behavior. Social Psychology Quarterly, 48, 27–41. doi: 10.2307/3033779 [DOI] [Google Scholar]
- Bodden DM, Dirksen CD, & Bögels SM (2008). Societal burden of clinically anxious youth referred for treatment: A cost-of-illness study. Journal of Abnormal Child Psychology, 36, 487–497. doi: 10.1007/s10802-007-9194-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bornovalova MA, Gratz KL, Daughters SB, Hunt ED, & Lejuez CW (2012). Initial RCT of a distress tolerance treatment for individuals with substance use disorders. Drug and Alcohol Dependence, 122, 70–76. doi: 10.1016/j.drugalcdep.2011.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chorpita BF, Yim L, Moffitt C, Umemoto LA, & Francis SE (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behaviour Research and Therapy, 38, 835–855. doi: 10.1016/S0005-7967(99)00130-8 [DOI] [PubMed] [Google Scholar]
- Cohen S (1986). Contrasting the Hassles Scale and the Perceived Stress Scale: Who’s really measuring appraised stress? American Psychologist, 41, 716–718. doi: 10.1037/0003-66X.41.6.716 [DOI] [Google Scholar]
- Cohen S, Kamarck T, & Mermelstein R (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24, 385–396. doi: 10.2307/2136404 [DOI] [PubMed] [Google Scholar]
- Cohen S, Tyrrell DA, & Smith AP (1993). Negative life events, perceived stress, negative affect, and susceptibility to the common cold. Journal of Personality and Social Psychology, 64, 131–140. doi: 10.1037/0022-3514.64.1.131 [DOI] [PubMed] [Google Scholar]
- Cohen S, & Williamson GM (1991). Stress and infectious disease in humans. Psychological Bulletin, 109, 5–24. doi: 10.1037/0033-2909.109.1.5 [DOI] [PubMed] [Google Scholar]
- Cohen S, & Williamson GM (1988). Perceived stress in a probability sample of the United States. In Spacapan S & Oskamp S (Eds.), The social psychology of health (pp. 31–67). Thousand Oaks, CA: Sage. [Google Scholar]
- Compas BE, Davis GE, Forsythe CJ, & Wagner BM (1987). Assessment of major and daily stressful events during adolescence: The Adolescent Perceived Events Scale. Journal of Consulting and Clinical Psychology, 55, 534–541. doi: 10.1037/0022-006X.55.4.534 [DOI] [PubMed] [Google Scholar]
- Copeland WE, Angold A, Shanahan L, & Costello JE (2014). Longitudinal patterns of anxiety from childhood to adulthood: The Great Smoky Mountains study. Journal of the American Academy of Child & Adolescent Psychiatry, 53, 21–33. doi: 10.1016/j.jaac.2013.09.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Copeland WE, Shanahan L, Costello J, & Angold A (2009). Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Archives of General Psychiatry, 66, 764–772. doi: 10.1001/archgenpsychiatry.2009.85 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Costello E, Mustillo S, Erkanli A, Keeler G, & Angold A (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844. doi: 10.1001/archpsyc.60.8.837 [DOI] [PubMed] [Google Scholar]
- Cummings JR, Bornovalova MA, Ojanen T, Hunt E, MacPherson L, & Lejuez C (2013). Time doesn’t change everything: The longitudinal course of distress tolerance and its relationship with externalizing and internalizing symptoms during early adolescence. Journal of Abnormal Child Psychology, 41, 735–748. doi: 10.1007/s10802-012-9704-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Danielson CK, Ruggiero KJ, Daughters SB, & Lejuez CW (2010). Distress tolerance, risk-taking propensity, and PTSD symptoms in trauma-exposed youth: Pilot study. Behavior Therapist, 33, 28–34. [Google Scholar]
- Daughters SB, Gorka SM, Magidson JF, MacPherson L, & Seitz-Brown CJ (2013). The role of gender and race in the relation between adolescent distress tolerance and externalizing and internalizing psychopathology. Journal of Adolescence, 36, 1053–1065. doi: 10.1016/j.adolescence.2013.08.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daughters SB, Reynolds EK, MacPherson L, Kahler CW, Danielson CK, Zvolensky M, & Lejuez CW (2009). Distress tolerance and early adolescent externalizing and internalizing symptoms: The moderating role of gender and ethnicity. Behaviour Research and Therapy, 47, 198–205. doi: 10.1016/j.brat.2008.12.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dell’Osso L, Rucci P, Ducci F, Ciapparelli A, Vivarelli L, Carlini M, … & Cassano GB (2003). Social anxiety spectrum. European Archives of Psychiatry and Clinical Neuroscience, 253, 286–291. doi: 10.1007/s00406-003-0442-5 [DOI] [PubMed] [Google Scholar]
- Eisenbarth C (2012). Coping profiles and psychological distress: A cluster analysis. North American Journal of Psychology, 14, 485–496. [Google Scholar]
- Ellis A, Vanderlind M, & Beevers C (2013). Enhanced anger reactivity and reduced distress tolerance in major depressive disorder. Cognitive Therapy and Research Advance online publication. doi: 10.1007/s10608-012-9494-z [DOI] [Google Scholar]
- Enders CK (2010). Applied missing data analysis New York: Guilford Press. [Google Scholar]
- Galaif ER, Sussman S, Chou C, & Wills TA (2003). Longitudinal relations among depression, stress, and coping in high risk youth. Journal of Youth and Adolescence, 32, 243–258. doi: 10.1023/A:1023028809718 [DOI] [Google Scholar]
- Garber J (1984). Classification of childhood psychopathology: A developmental perspective. Child Development, 55, 30–48. doi: 10.2307/1129833 [DOI] [PubMed] [Google Scholar]
- Garber J, Kriss MR, Koch M, & Lindholm L (1988). Recurrent depression in adolescents: A follow-up-study. Journal of the American Academy of Child & Adolescent Psychiatry, 27, 49–54. doi: 10.1097/00004583-198801000-00008 [DOI] [PubMed] [Google Scholar]
- Ge X, Conger RD, Lorenz FO, & Simons RL (1994). Parents’ stressful life events and adolescent depressed mood. Journal of Health and Social Behavior, 35, 28–44. doi: 10.2307/2137333 [DOI] [PubMed] [Google Scholar]
- Glick DM, & Orsillo SM (2011). Relationships among social anxiety, self-focused attention, and experiential distress and avoidance. Journal of Cognitive and Behavioral Psychotherapies, 11, 1–12. [Google Scholar]
- Glied S, & Neufeld A (2001). Service system finance: Implications for children with depression and manic depression. Biological Psychiatry, 49, 1128–1135. [DOI] [PubMed] [Google Scholar]
- Gross JJ (1998). The emerging field of emotion regulation: An integrative review. Review of General Psychology, 2, 271–299. doi: 10.1037/1089-2680.2.3.271 [DOI] [Google Scholar]
- Gross JJ (2002). Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology, 39, 281–291. doi: 10.1017/S0048577201393198 [DOI] [PubMed] [Google Scholar]
- Hager AD, & Runtz MG (2012). Physical and psychological maltreatment in childhood and later health problems in women: An exploratory investigation of the roles of perceived stress and coping strategies. Child Abuse & Neglect, 36, 393–403. doi: 10.1016/j.chiabu.2012.02.002 [DOI] [PubMed] [Google Scholar]
- Halama P, & Bakošova K (2009). Meaning in life as a moderator of the relationship between perceived stress and coping. Studia Psychologica, 51, 143–148. [Google Scholar]
- Hammen C (2005). Stress and depression. Annual Review of Clinical Psychology, 1, 293–319. doi: 10.1146/annurev.clinpsy.1.102803.143938 [DOI] [PubMed] [Google Scholar]
- Hancock GR, Harring JR, & Lawrence FR (2013). Using latent growth modeling to evaluate longitudinal change. In Hancock GR & Mueller RO (Eds.), Structural equation modeling: A second course (pp. 309–342). Charlotte, NC: IAP. [Google Scholar]
- Harrington N (2006). Frustration intolerance beliefs: Their relationship with depression, anxiety, and anger in a clinical population. Cognitive Therapy and Research, 30, 699–709. doi: 10.1007/s10608-006-9061-6 [DOI] [Google Scholar]
- Hawkins K, Macatee R, Guthrie W, & Cougle J (2013). Concurrent and prospective relations between distress tolerance, life stressors, and anger. Cognitive Therapy and Research. Advance online publication doi: 10.1007/s10608-012-9487-y [DOI] [Google Scholar]
- Henry DB, Schoeny ME, Deptula DP, & Slavick JT (2007). Selection and socialization effects on adolescent intercourse without a condom and attitudes about the costs of sex. Child Development, 78, 825–838. doi: 10.1111/j.1467-8624.2007.01035.x [DOI] [PubMed] [Google Scholar]
- Jose PE, & Ratcliffe V (2004). Stressor frequency and perceived intensity as predictors of internalizing symptoms: Gender and age differences in adolescence. New Zealand Journal of Psychology, 33, 145–154. [Google Scholar]
- Keough ME, Riccardi CJ, Timpano KR, Mitchell MA, & Schmidt NB (2010). Anxiety symptomatology: The association with distress tolerance and anxiety sensitivity. Behavior Therapy, 41, 567–574. doi: 10.1016/j.beth.2010.04.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kessler RC, Demler O, Frank RG, Olfson M, Pincus HA, Walters EE, … & Zaslavsky AM (2005). Prevalence and treatment of mental disorders, 1990 to 2003. New England Journal of Medicine, 352, 2515–2523. doi: 10.1056/NEJMsa043266 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larson R, & Ham M (1993). Stress and “storm and stress” in early adolescence: The relationship of negative events with dysphoric affect. Developmental Psychology, 29, 130–140. doi: 10.1037/0012-1649.29.1.130 [DOI] [Google Scholar]
- Laurent J, Catanzaro SJ, Joiner TJ, Rudolph KD, Potter KI, Lambert S, … & Gathright T (1999). A measure of positive and negative affect for children: Scale development and preliminary validation. Psychological Assessment, 11, 326–338. doi: 10.1037/1040-3590.11.3.326 [DOI] [Google Scholar]
- Lazarus RS (1999). Stress and emotion: A new synthesis New York: Springer. [Google Scholar]
- Lejuez CW, Daughters SB, Danielson CW,& Ruggiero K (2006). The Behavioral Indicator of Resiliency to Distress (BIRD) [Google Scholar]
- Lejuez CW, Kahler CW, & Brown RA (2003). A modified computer version of the Paced Auditory Serial Addition Task (PASAT) as a laboratory-based stressor. Behavior Therapist, 26, 290–293. [Google Scholar]
- Lewinsohn PM, Clarke GN, Seeley JR, & Rhode P (1994). Major depression in community adolescents: Age at onset, episode duration, and time to recurrence. Journal of the American Academy of Child & Adolescent Psychiatry, 33, 809–818. doi: 10.1097/00004583-199407000-00006 [DOI] [PubMed] [Google Scholar]
- Leyro TM, Zvolensky MJ, & Bernstein A (2010). Distress tolerance and psychopathological symptoms and disorders: A review of the empirical literature among adults. Psychological Bulletin, 136, 576–600. doi: 10.1037/a0019712 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Linehan MM (1993). Dialectical and biosocial underpinnings of treatment. In Cognitive-behavioral treatment of borderline personality disorder (pp. 28–65). New York: Guilford Press. [Google Scholar]
- Little RJ (1988). A test of missing completely at random for multivariate data with missing values. Journal of American Statistical Association, 83, 1198–1202. [Google Scholar]
- Little RJ, & Rubin DB (1989). Statistical analysis with missing data New York: Wiley. [Google Scholar]
- Livheim F, Hayes L, Ghaderi A, Magnusdottir T, Hogfeldt A, Rowse J, …& Tengstrom A (2015). The effectiveness of acceptance and commitment therapy for adolescent mental health: Swedish and Australian pilot outcomes. Journal of Child and Family Studies, 24, 1016–1030. doi: 10.1007/s10826-014-9912-9 [DOI] [Google Scholar]
- Lotan G, Tanay G, & Bernstein A (2013). Mindfulness and distress tolerance: Relations in a mindfulness preventive intervention. International Journal of Cognitive Therapy, 6, 371–385. doi: 10.1521/ijct.2013.6.4.371 [DOI] [Google Scholar]
- Lynch FL, & Clarke GN (2006). Estimating the economic burden of depression in children and adolescents. American Journal of Preventive Medicine, 31(6, Suppl. 1), S143–S151. doi: 10.1016/j.amepre.2006.07.001 [DOI] [PubMed] [Google Scholar]
- Lynch TR, & Mizon GA (2011). Distress overtolerance and distress intolerance: A behavioral perspective. In Zvolensky MJ, Bernstein A, & Vujanovic AA (Eds.), Distress tolerance: Theory, research, and clinical applications ( pp. 52–79). New York: Guilford Press [Google Scholar]
- MacPherson L, Reynolds EK, Daughters SB, Wang F, Cassidy J, Mayes LC, & Lejuez CW (2010). Positive and negative reinforcement underlying risk behavior in early adolescents. Prevention Science, 11, 331–342. doi: 10.1007/s11121-010-0172-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Magidson JF, Listhaus AR, Seitz-Brown CJ, Anderson KE, Lindberg B, Wilson A, & Daughters SB (2013). Rumination mediates the relationship between distress tolerance and depressive symptoms among substance users. Cognitive Therapy and Research Advance online publication. doi: 10.1007/s10608-012-9488-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mandell DS, Guevara JP, Rostain AL, & Hadley TR (2003). Economic grand rounds: Medical expenditures among children with psychiatric disorders in a Medicaid population. Psychiatric Services, 54, 465–467. doi: 10.1176/appi.ps.54.4.465 [DOI] [PubMed] [Google Scholar]
- Martin RA, Kazarian SS, & Breiter HJ (1995). Perceived stress, life events, dysfunctional attitudes, and depression in adolescent psychiatric inpatients. Journal of Psychopathology and Behavioral Assessment, 17, 81–95. doi: 10.1007/BF02229205 [DOI] [Google Scholar]
- McRae K, Gross JJ, Weber J, Robertson ER, Sokol-Hessner P, Ray RD, … & Ochsner KN (2012). The development of emotion regulation: An fMRI study of cognitive reappraisal in children, adolescents and young adults. Social Cognitive and Affective Neuroscience, 7, 11–22. doi: 10.1093/scan/nsr093 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merikangas KR, He J, Burstein M, Swanson SA, Avenevoli S, Cui L, …& Swendsen J (2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the National Comorbidity Survey Replication—Adolescent Supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49, 980–989. doi: 10.1016/j.jaac.2010.05.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Monroe SM (2008). Modern approaches to conceptualizing and measuring human life stress. Annual Review of Clinical Psychology, 4, 33–52. doi: 10.1146/annurev.clinpsy.4.022007.141207 [DOI] [PubMed] [Google Scholar]
- Monroe SM, & Kelley JM (1995). Measurement of stress appraisal. In Cohen S, Kessler RC, & Gordon LU (Eds.), Measuring stress: A guide for health and social scientists (pp. 122–147). Oxford: Oxford University Press. [Google Scholar]
- Muthén LK, & Muthén BO (2010). Mplus user’s uide (6th ed.). Los Angeles: Author. [Google Scholar]
- O’Cleirigh C, Ironson G, & Smits JAJ (2007). Does distress tolerance moderate the impact of major life events on psychosocial variables and behaviors important in the management of HIV? Behavior Therapy, 38, 314–323. doi: 10.1016/j.beth.2006.11.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preacher KJ, & Hayes AF (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavioral Medicine Research, 40, 879–891. doi: 10.3758/BRM.40.3.879 [DOI] [PubMed] [Google Scholar]
- Rao U, Ryan ND, Birmaher B, Dahl RE, Williamson DE, Kaufman J,…& Nelson B (1995). Unipolar depression in adolescents: Clinical outcome in adulthood. Journal of the American Academy of Child & Adolescent Psychiatry, 34, 566–578. doi: 10.1097/00004583-199505000-00009 [DOI] [PubMed] [Google Scholar]
- Rathus JH, & Miller AL (2015). DBT® skills manual for adolescents. New York: Guilford Press. [Google Scholar]
- Roemer L, Salters K, Raffa SD, & Orsillo SM (2005). Fear and avoidance of internal experiences in GAD: Preliminary tests of a conceptual model. Cognitive Therapy and Research, 29, 71–88. doi: 10.1007/s10608-005-1650-2 [DOI] [Google Scholar]
- Roza SJ, Hofstra MB, van der Ende J, & Verhulst FC (2003). Stable prediction of mood and anxiety disorders based on behavioral and emotional problems in childhood: A 14-year follow-up during childhood, adolescence, and young adulthood. American Journal of Psychiatry, 160, 2116–2121. doi: 10.1176/appi.ajp.160.12.2116 [DOI] [PubMed] [Google Scholar]
- Schmeelk-Cone KH, & Zimmerman MA (2003). A longitudinal analysis of stress in African American youth: Predictors and outcomes of stress trajectories. Journal of Youth and Adolescence, 32, 419–430. doi: 10.1023/A:1025934301468 [DOI] [Google Scholar]
- Schweizer K (2010). Improving the interpretability of the variances of latent variables by uniform and factor-specific standardizations of loadings. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 6, 152–159. doi: 10.1027/1614-2241/a000016 [DOI] [Google Scholar]
- Sontag LM, & Graber JA (2010). Coping with perceived peer stress: Gender-specific and common pathways to symptoms of psychopathology. Developmental Psychology, 46, 1605–1620. doi: 10.1037/a0020617 [DOI] [PubMed] [Google Scholar]
- Steiger JH (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180. doi: 10.1207/s15327906mbr25024 [DOI] [PubMed] [Google Scholar]
- Taylor JM (2015). Psychometric analysis of the Ten-Item Perceived Stress Scale. Psychological Assessment, 27, 90–101. doi: 10.1037/a0038100 [DOI] [PubMed] [Google Scholar]
- Telch MJ, Jacquin K, Smits JAJ, & Powers MB (2003). Emotional responding to hyperventilation as a predictor of agoraphobia status among individuals suffering from panic disorder. Journal of Behavior Therapy and Experimental Psychiatry, 34, 161–170. doi: 10.1016/S0005-7916(03)00037-5 [DOI] [PubMed] [Google Scholar]
- Timpano KR, Buckner JD, Richey JA, Murphy DL, & Schmidt NB (2009). Exploration of anxiety sensitivity and distress tolerance as vulnerability factors of hoarding behaviors. Depression and Anxiety, 26, 343–353. doi: 10.1002/da.20469 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tucker LR, & Lewis C (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. doi: 10.1007/BF02291170 [DOI] [Google Scholar]
- van Jaarsveld CHM, Fidler JA, Steptoe A, Boniface D, & Wardle J (2009). Perceived stress and weight gain in adolescence: A longitudinal analysis. Obesity, 17, 2155–2161. doi: 10.1038/oby.2009.183 [DOI] [PubMed] [Google Scholar]
- Varni JW, & Katz ER (1997). Stress, social support and negative affectivity in children with newly diagnosed cancer: A prospective transactional analysis. Psycho-Oncology, 6, 267–278. doi: [DOI] [PubMed] [Google Scholar]
- Wills TA, Sandy JM, & Yaeger AM (2002). Stress and smoking in adolescence: A test of directional hypotheses. Health Psychology, 21, 122–130. doi: 10.1037/0278-6133.21.2.122 [DOI] [PubMed] [Google Scholar]
- Wolitzky-Taylor K, Guillot CR, Pang RD, Kirkpatrick MG, Zvolensky MJ, Buckner JD, & Leventhal AM (2015). Examination of anxiety sensitivity and distress tolerance as transdiagnostic mechanisms linking multiple anxiety pathologies to alcohol use problems in adolescents. Alcoholism: Clinical and Experimental Research, 39, 532–539. doi: 10.1111/acer.12638 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yarcheski A, & Mahon NE (2000). A causal model of depression in early adolescents. Western Journal of Nursing Research, 22, 879–894. doi: 10.1177/01939450022044854 [DOI] [PubMed] [Google Scholar]
- Yeager DS, Johnson R, Spitzer BJ, Trzesniewski KH, Powers J, & Dweck CS (2014). The far-reaching effects of believing people can change: Implicit theories of personality shape stress, health, and achievement during adolescence. Journal of Personality and Social Psychology, 106, 867–884. doi: 10.1037/a003633 [DOI] [PubMed] [Google Scholar]