Abstract
Background/Objective: Stress is perceived differently across individuals, which might be particularly true for nonclinical and clinical subjects. For this reason, we tested a German adaption of the 10-item Perceived Stress Scale (PSS-10) for model fit and measurement invariance in a big nonclinical and clinical sample. Method: We (1) conducted multiple confirmatory factor analysis (CFA) in 1,248 nonclinical subjects and 575 outpatients, (2) measurement invariance with multigroup CFA, (3) assessed correlations with relevant constructs and (4) calculated internal consistencies for overall stress and the subscales Helplessness and Self-efficacy. Results: In both samples, CFA revealed a robust two-factorial structure with an excellent model fit. Group comparisons revealed strict measurement invariance. Correlations with associated measures support validity. Internal consistencies were good to very good. Conclusions: We show highly satisfactory psychometric properties of the German PSS-10 for nonclinical and clinical individuals. Measurement invariance analyses demonstrated that varying stress levels of people with a different mental health status are due to true interindividual differences.
Keywords: Perceived Stress Scale, Clinical subjects, Factor analyses, Invariance, Instrumental study.
Resumen
Antecedentes/Objetivo: El estrés se percibe de manera diferente entre los individuos, lo que podría ser particularmente cierto para los sujetos no clínicos y clínicos. Por esta razón, probamos una adaptación alemana de la Perceived Stress Scale de 10 ítems (PSS-10) para el ajuste del modelo y la invarianza de la medición en una gran muestra clínica y no clínica. Método: Realizamos (1) un análisis factorial confirmatorio múltiple (CFA) en 1.248 sujetos no clínicos y 575 pacientes ambulatorios, (2) invarianza de medición con CFA multigrupo, (3) correlaciones con constructos relevantes y (4) cálculos de la consistencia interna para la escala general y las subescalas Desvalidez y Autoeficacia. Resultados: En ambas muestras, el CFA reveló una estructura robusta de dos factores con un excelente ajuste del modelo. Las comparaciones grupales indicaron invarianza estricta. Las correlaciones con las medidas asociadas respaldan la validez. Los coeficientes de consistencia interna fueron buenos a muy buenos. Conclusión: Mostramos propiedades psicométricas altamente satisfactorias de la version alemana de la PSS-10 para individuos no clínicos y clínicos. Los análisis de invarianza de medición demostraron que los niveles variables de estrés de las personas con un estado de salud mental diferente se deben a diferencias interindividuales verdaderas.
Palabras clave: Perceived Stress Scale, Pacientes, Análisis Factorial, Invarianza, Estudio instrumental.
Stress is a major contributor to both physical and mental illness (Cohen et al., 2019, Wessa et al., 2015, Zorn et al., 2017). In order to understand the etiological relevance of stress, we have to illuminate how stressors are subjectively perceived. According to the transactional stress model (Lazarus & Folkman, 1984), subjective stress typically occurs when situations are appraised as threatening and the environmental demands exceed an individual's coping resources. In line with this idea, research has shown that the mere exposure to a stressor (e.g., life events) or the presence of physiological stress symptoms (e.g., elevated cortisol levels) do not necessarily result in subjective stress (Campbell and Ehlert, 2012, Galatzer-Levy et al., 2018). Instead, we have to take into account that the cognitive appraisal of an objective stressor essentially contributes to the overall degree of perceived stress (Conway, Rutter, & Brown, 2016).
A commonly used instrument to assess perceived stress is The Perceived Stress Scale (PSS; Cohen, Kamarck, & Mermelstein, 1983). The PSS assesses the degree of how individuals perceive situations in their lives as uncontrollable, unpredictable and overloaded relative to their subjective coping abilities (Cohen et al., 1983) as represented by the two subscales Perceived helplessness (PH) and Perceived self-efficacy (PSE). There has been an ongoing discussion whether the questionnaire is best described by two subscales or rather unidimensional (Cohen et al., 1983, Taylor, 2015). However, most studies have agreed on the two-factorial structure and that a subset of 10 out of 14 original items reflect the best psychometric properties. To date, the 10-item version (PSS-10) is internationally widely use (Nielsen et al., 2016, Taylor, 2015). Unlike other stress scales, the PSS is an economic tool to measure the interplay between the two dimensions and offers additional value to stress research, since its items do not only assess certain areas of life (e.g., work or social stress, as assessed in the Stress Reactivity Scale; Schlotz et al., 2011), do not concentrate on isolated aspects of stress theory exclusively (e.g., only asking for demands, Stressful Life Event Questionnaire; Roohafza et al., 2011; or resources, Coping Competence Questionnaire; Schroder & Ollis, 2013) and do not contain a large number of items (e.g., Stress Overload Scale, Amirkhan, 2012; Trier Inventory of Chronic Stress, Petrowski, Paul, Albani, & Brähler, 2012).
It is well understood that stress has negative effects on mental health (Francisco, Arce, Vílchez, & Vales, 2016). Amongst others, helplessness seems to be an essential component of psychopathological symptoms (Zahn et al., 2015), whereas self-efficacy can alleviate the effects of stressors on psychopathology (Guerra et al., 2014, Schönfeld et al., 2016). Given the fact that the report of internal states is highly influenced by the presence or absence of psychopathological symptoms (Gorlin et al., 2019), it becomes clear that the validity of a questionnaire like the PSS might be influenced by the characteristics of the sample it is administered in, because the nomological relations of a latent construct can strongly depend on the source of data (Skorikov & VanderVoort, 2003). From a psychometric perspective, testing whether the same instrument can be adequately used in multiple samples is essential, as a profound interpretation of results can only be ensured this way (Guillot-Valdés, Guillén-Riquelme, & Buela-Casal, 2019).
Interestingly, only one study has directly compared the two-factorial structure of the PSS between nonclinical and clinical subjects in an English-speaking population (Lavoie & Douglas, 2012), which is surprising given its frequent use in both populations (e.g., Denovan et al., 2019, Khalili et al., 2017). To find out about group differences, the authors performed multiple group confirmatory factor analysis (MGCFA). MGCFA has its roots in structural equation modelling and tests if a model and its manifest and latent properties are the same (invariant) across different subgroups, which, in turn, allows to draw inferences about the validity of group comparisons. Lavoie & Douglas (2012) only found configural (weak) invariance between a large psychiatric and a community sample, meaning that the overall construct of stress was measured differently in both populations and could not be interpreted equally. Furthermore, they used the 14-item version although to date the 10-item version is being preferred in a vast number of studies. After testing several models, they concluded an 11-item version fit their data best, which is contradictory to most research on the PSS model structure. Given the relevance the PSS has for clinical stress research, we are convinced that more empirical data is needed to clarify the latent structure of the questionnaire.
To the best of our knowledge, no study has investigated the latent construct of stress in the German PSS-10 for both nonclinical and clinical individuals. For this reason, we aimed to test several model structures and to compare them in both groups. Based on previous findings, we hypothesized a two-factorial model structure to show the best fit. To evaluate the models, we first performed CFA in both samples. Second, we compared both populations via MGCFA and tested for measurement invariance.
Method
Participants and Procedure
Data of the nonclinical sample was incidentally derived from online surveys carried out between November 2015 and February 2016, yielding N = 1,248 individuals (541 men) aged between 18 and 65 years (M = 34.89, SD = 13.06). A majority of the subjects indicated to be in a relationship or married (63%) and to have a high school diploma (85%) (Table 1). Data of the clinical sample was incidentally collected between September 2016 and March 2017 from N = 575 outpatients (196 men, 19-64 years, M = 36.23, SD = 12.53) waiting for or currently undergoing psychotherapy. Most subjects were single (57%) and had a high school diploma (28%) or less (48%). Amongst others, the most frequent diagnoses were affective (36%) and anxiety disorders (28%) with most patients having comorbidities as well (Table 1). The samples differed with regard to age (F(1821) = 4.24, p = .04) and gender (χ2(1, N = 1,823) = 248.43, p < .001). As our data collection started before similar PSS versions were introduced (Klein et al., 2016, Reis et al., 2017), we decided to stay with our version since we aimed at a congruent comparison of our nonclinical and our clinical sample. All subjects indicated German as their mother tongue and gave their written informed consent prior to the study. All studies were conducted in accordance with the Declaration of Helsinki and were approved by the local ethics committee at the University of Mainz.
Table 1.
Nonclinical n = 1,248 |
Clinical n = 575 |
|
---|---|---|
Gender | ||
Male | 541 | 196 |
Female | 707 | 379 |
Age (years) | ||
18-29 | 580 | 239 |
30-39 | 250 | 119 |
40-49 | 183 | 109 |
50-65 | 235 | 108 |
Marital status | ||
Single | 411 | 164 |
Married and relationship | 792 | 98 |
Divorced and widowed | 45 | 28 |
Missing | 0 | 285 |
Schooling | ||
Still in school | 7 | 38 |
Less than high school diploma | 137 | 269 |
High school diploma | 1065 | 155 |
other schooling | 39 | 94 |
missing | 0 | 19 |
Main diagnosis | n | comorbidity1 |
Affective disorders | 163 | 107 |
Psychotic disorders | 9 | 3 |
Substance abuse and dependency | 1 | 1 |
Anxiety disorders | 126 | 96 |
Somatoform disorders | 51 | 44 |
Eating disorders | 38 | 33 |
Sleep disorders | 1 | 1 |
Adjustment disorder | 12 | 5 |
Sexual and sexual identity disorders | 2 | 1 |
Personality disorders | 21 | 17 |
Other | 25 | 15 |
No final diagnosis yet2 | 126 | - |
Note. 1Absolute and relative number of people with one or more comorbidities within one of the categories shown on the left. 2All patients underwent a structured diagnostic interview (SCID-I and SCID-II; Wittchen, Wunderlich, Gruschwitz, & Zaudig, 1997). Patients waiting for psychotherapy did not have a verified diagnosis yet.
Instruments
The PSS-10 was translated and back-translated by two independent native German and English speakers, both with a degree in psychology. Wording incongruities were discussed in an expert committee and conferred with a native speaker. The questionnaire consists of 10 items, each beginning with “In the last month, how often have you …” and has a 5-point Likert scale ranging from 1 (never) to 5 (very often). The PH scale consists of the six negative worded items (1, 2, 3, 6, 9, and 10) and the PSE scale contains the four positive worded items (4, 5, 7, and 8). The total score (PSS-TOTAL) is computed by reversing the PSE items and summing up all items. Higher scores reflect greater levels of perceived stress. Instructions and items can be retrieved from Appendix 1.
To find out about associated constructs in the clinical sample, we used the 53-item Brief Symptom Inventory (BSI; Franke, 2000) with the main subscale Global Severity Index (GSI), as a measure for symptom severity. The BSI has been validated in the German population and internal consistency of the GSI scale is excellent. Furthermore, we asked participants about their overall physical health (1 item) and mental health (1 item) in the last month using visual analogous scales (VAS), both ranging from 1 (very bad) to 9 (very good).
In the nonclinical sample, we also used the VAS named above and a well-being questionnaire to assess a related construct, as perceived stress and well-being are often investigated together (Wersebe et al., 2018). The WHO-5 has been well validated in numerous populations and shows good internal consistency of α=.84 (Bech, Olsen, Kjoller, & Rasmussen, 2003).
Data analysis
CFA was calculated using the Bollen-Stine bootstrapped maximum likelihood (ML) estimation method in SPSS AMOS 23 (Arbuckle & Wothke, 1999). Given the variety of different PSS models claimed in the literature, we tested a (1) one-factor model (overall stress) and (2) a two-factor model (PH and PSE). For model evaluation, we used the comparative fit index (CFI), the Tucker-Lewis index (TLI), the root mean square error of approximation with 90% confidence intervals (RMSEA) and the standardized root mean square residual (SRMR). According to the criteria by Hu & Bentler (1999), values close to or higher than .95 for CFI and TLI; close to or smaller than < .06 for RMSEA and < 08 for SRMR indicated a good fit. For competing models, lowest values of the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) represented measures for parsimony and served as indicators for the favored model.
For group comparisons, we applied hierarchical nested modelling following the MGCFA procedure stated by Vandenberg & Lance (2000). In MGCFA, invariance is tested by restricting different model parameters in a stepwise fashion and comparing the resulting models between several groups (here: clinical vs. nonclinical). If the model fit does not worsen significantly, one can infer that latent group differences are caused by true interindividual differences. Here, we concentrated on equal form, equal factor loadings and equal intercepts and therefore gradually tested configural, metric and scalar invariance (CI/MI/SI) (Putnick & Bornstein, 2016). A more restrictive model was only nested if invariance of the preceding model held. Invariance was considered given if parameter changes for CFI, TLI, RMSEA and SRMR were no bigger than Δ=+/-.01 (Cheung & Rensvold, 2002).
Descriptive analyses (means, standard deviations) as well as Student's t-tests, Spearman's rank correlations and internal consistencies (Cronbach's alpha) and were performed using SPSS 23.0. p-values < 05 indicated statistical significance. Correlations of r = .20, r = .50 and r = .80 were interpreted as small, moderate and strong (Cohen, 1992).
Results
Tests of factor models
Since most studies on the PSS have been conducted in nonclinical individuals, we first tested competing models in the nonclinical sample. The one-factor model fit the data poorly. The two-factor solution fit the data well with the factors correlating at r = -.85 (see Table 2 for the statistical indices of every model). Since the two-factor solution was the most parsimonious, it was chosen as most viable PSS-10 model.
Table 2.
χ2 (df) | CFI | TLI | RMSEA (90%CI) | SRMR | AIC | BIC | ΔCFI | ΔTLI | ΔRMSEA | ΔSRMR | |
---|---|---|---|---|---|---|---|---|---|---|---|
Nonclinical sample | |||||||||||
1-factor | 544.851 (35) |
.907 | .881 | .108 (.100-.116) |
.057 | ||||||
2-factor | 275.559 (34) |
.956 | .942 | .075 (.067-.084) |
.040 | 317.55 | 425.27 | ||||
2-factor finala |
167.316 (32) |
.975 | .965 | .058 (.050-.067) |
.031 | 213.31 | 331.29 | ||||
Clinical sample | |||||||||||
1-factor | 946.493 (35) |
.589 | .472 | .213 (.201-.225) |
.180 | ||||||
2-factor | 189.822 (34) |
.940 | .920 | .089 (.077-.102) |
.050 | 231.82 | 323.26 | ||||
2-factor finala |
151.644 (32) |
.954 | .935 | .081 (.068-.094) |
.046 | 197.64 | 198.54 | ||||
Clinical vs. Nonclinical sample | |||||||||||
Configural Invariance | 345.776 (64) |
.965 | .951 | .049 (.044-.054) |
.035 | ||||||
Metric Invariance |
376.719 (72) |
.962 | .953 | .048 (.043-.053) |
.038 | -.003 | .002 | -.001 | .003 | ||
Structural Invariance | 586.620 (82) |
.938 | .931 | .058 (.054-.063) |
.039 | -.024 | -.022 | .010 | .001 |
Note. The final 2-factor model was compared with the unmodified 2-factor model; a in the final model, errors of items 1 and 3 and items 1 and 9 were freed to correlate; df = degrees of freedom; CFI = Comparative fit index; TLI = Tucker-Lewis index; RMSEA = root mean square error of approximation (90% confidence interval shown in brackets); SRMR = standardized root mean square residual; Δ = difference; configural invariance = equal form; metric invariance = equal loadings; structural invariance = equal intercepts.
In a next step, we checked modification indices for significant residual correlations to uncover potential method bias. Accordingly, the residuals of items 1 and 9 and items 1 and 3 were freed to correlate (all belonging to the PH subscale; see Fig. 1). Following these adjustments, the overall model fit improved and appeared to be excellent, resulting as final PSS-10 model (χ232 = 167.316; p < .001; CFI = .975; TLI = .965; RMSEA = .058[.050-.067]; SRMR = .031).
For the clinical sample, we calculated the same models (Table 2). Again, we found the 2-factor solution with correlating residuals to have the best overall fit (χ232 = 151.644; p < .001; CFI = .954; TLI = .935; RMSEA = .081[.068-.094]; SRMR = .046) with both factors correlating at r = -.70 (for the final model, see Fig. 1). Item loadings ranged from .48 to .83 (nonclinical) and .54 to .84 (clinical).
Group comparison for nonclinical vs. clinical subjects
First of all, the baseline CI model fit the data equally well in clinical and nonclinical individuals. Nesting the metric model into the configural model did not produce a worse fit meaning that the relationship between items and factors were equal across both populations. Finally, differences in goodness-of-fit indices in the scalar model were excellent (Table 2) except for CFI and TLI which yielded a minor change of ΔCFI = -.024 and ΔTLI = -.022. As this was due to differential item functioning (DIF), we did stepwise hierarchical nesting for every single item in order to find out which item(s) might be affected. Out of all 10 items, only item 7 revealed a violation of the criteria offered by Cheung amp; Rensvold (2002) with a difference of ΔCFI = -.017 and ΔTLI = -.020. This was regarded as minor issue since other studies have reported statistical deviations of item 7 as well (Cole, 1999, Reis et al., 2017) and the fit indices themselves were still adequate. Thus, SI and strong measurement invariance was given. It is important to note that multigroup analyses are sensitive to sample size. For this reason, we calculated an additional MGCFA with a random subsample of n = 575 nonclinical subjects, which was retrieved using the SPSS random sample command. However, results did not differ substantially from the original analyses (SI: ΔCFI = -.033; ΔTLI = -.030; ΔRMSEA = .013; ΔSRMR = .003).
Internal consistence and associated constructs
Internal consistencies in both samples were good to very good, yielding αnonclin = .88 and αclin = .89 for PSS-TOTAL, αnonclin = .85 and αclin = .85 for PH and αnonclin = .79 and αclin = .82 for PSE. For nonclinical individuals, PSS-TOTAL correlated negatively with well-being (r = -.71). In the clinical sample, PSS-TOTAL was positively associated with GSI (r = .49). In both samples, PSS-TOTAL correlated moderately with reported physical health (rclin = -.40; rnonclin = -.41) and strongly with mental health (rclin = -.72; rnonclin = -.73; all p's < .001) (Table 3). Mean scores of all PSS scales were significantly higher in the clinical population than in the nonclinical population (PSS-TOTAL: Mnonclin = 28.33, SDnonclin = 6.97, Mclin = 31.61, SDclin = 7.17, t(1821) = -9.24, p < .001, d = 0.47; PH: Mnonclin = 17.88, SDnonclin = 4.77, Mclin = 19.43, SDclin = 4.86; t(1821) = -6.39, p < .001, d = 0.32; PSE: Mnonclin = 13.55, SDnonclin = 2.80, Mclin = 11.82, SDclin = 3.26; t(1821) = 10.99, p < .001, d = 0.59).
Table 3.
1 | 2 | 3 | 4 | 5 | 6 | 7 | |
---|---|---|---|---|---|---|---|
1 Global Stress (PSS-TOTAL) | 1 | ||||||
2 Helplessness (PH) | .95*** (.96***) |
1 | |||||
3 Self-Efficacy (PSE) | -.86*** (-.86***) |
-.66*** (-.69***) |
1 | ||||
4 Physical Health | -.45*** (-.42***) |
-.41*** (-.40***) |
.41*** (.36***) |
1 | |||
5 Mental Health | -.75*** (-.73***) |
.70*** (-.69***) |
.66*** (.64**) |
.51*** (.48***) |
1 | ||
6 Well-being (WHO) | (-.71***) | (-.66***) | (.65***) | (.44***) | (.71***) | 1 | |
7 Global Severity Index (BSI) | .49*** | .50*** | -.35*** | -.21*** | -.35*** | - | 1 |
Note. Correlation coefficients refer to N = 1,248 nonclinical and N = 575 clinical subjects; statistical indices from nonclinical subjects are shown in brackets; PSS = Perceived Stress Scale; Physical and Mental Health were assessed using 9-point visual analogue scales; WHO = Well-Being Index; BSI = Brief Symptom Inventory; **p < .01; ***p < .001.
Discussion
In the present study, we introduced a German translation of the PSS-10 and assessed its factor structure, for the first time, in a large clinical sample consisting of patients with diverse mental illnesses. We also compared the results from the clinical sample with a big nonclinical sample and yielded highly satisfactory psychometric properties. In the light of the transactional stress model (Lazarus & Folkman, 1984), our findings support a two-dimensional model. Particularly, the factor structure could be replicated throughout both populations, which supports the notion that our adaptation of the German PSS-10 can be administered equally well in nonclinical and clinical samples. Therefore, this work is an important contribution for the psychometric measurement of helplessness and self-efficacy in clinical populations, both being substantial elements of overall perceived stress.
To our best of knowledge, we conducted the first study that directly compared multiple models and groups by using a sophisticated methodological approach. To find the best fitting model, we carefully chose a multistep procedure: First, we ran multiple CFAs for both nonclinical and clinical individuals to test several competing models. Our findings revealed a robust two-factorial structure which is in line with previous studies (Denovan et al., 2019, Nielsen et al., 2016). Although Cohen and colleagues (1983) originally stated a one-factorial model, our findings clearly support a two-factorial structure.
In our two-factor solution, item 7 (PSE scale) showed slightly low communality and factor loading in the nonclinical sample (ʎ2 = .23; β = .48), which has been observed previously (Reis et al., 2017). Yet, due to relevant scale downsizing, it would not have been statistically recommendable to exclude it (Marsh, Hau, Balla, & Grayson, 1998), why we did not calculate another model without this item (Marsh et al., 1998). Interestingly, when we tested for strong measurement invariance, the same item was the only one affected by differential item functioning. Since strong invariance can hold even when single items show slight statistical variations (Cole, 1999), however, we concluded that the minor deviations by item 7 were not meaningful for the overall construct of perceived stress and thus came to the conclusion that the PSS-10 is strictly invariant over clinical and nonclinical subjects.
In a practical perspective, our study entails some important implications. Based on our finding that the clinical population showed significantly higher perceived stress, the PSS-10 could be used as a first screening instrument to detect individuals with heightened levels of stress. This is of particular importance, since higher levels of stress put people into risk for the development of mental illness (Dikmen-Yildiz, Ayers, & Phillips, 2018). By identifying overall helplessness and current coping abilities, clinicians can get a first idea of an individual's overall psychiatric strain. As we could show, the PSS-10 reliably measures stress in nonclinical and clinical individuals and thus offers a possibility to crosswalk between different phases of subjective stress. Also, due to the dynamic nature of stress, it is important to monitor both acute and continuous perceived stress. Thus, assessing the connection between PSS-scores and long-term clinical outcomes would be a promising direction for future research. Monitoring stress levels over a longer period of time could provide additional insights about intraindividual changes. In this vein, studies should also apply the PSS-10 over the time course of psychotherapeutical interventions, given the fact that the two PSS core facets are typically targeted in cognitive-behavioral therapy: Counteracting helplessness and promoting coping abilities fosters self-efficacy and, in turn, behavioral change (the close association of the two constructs was also reflected by the correlation of the latent factors in our model). For example, studies have shown that enhancing self-efficacy promotes overall psychotherapy outcome (e.g., Cusack et al., 2018, Leon-Quismondo and Lahera, 2016). Together with the interplay of stress and mental health (Conway et al., 2016, Keeley et al., 2016, Schönfeld et al., 2016) research also points to a connection with well-being (Cleland, Kearns, Tannahill, & Ellaway, 2016). Results from our study also indicate that well-being as well as psychological and physiological health have a strong association with global subjective stress.
Limitations and future directions
We did not divide our clinical sample by diagnosis but ran our analyses for the overall population instead because we wanted to maximize generalizability of our findings, since there is a broad range of mental disorders and the presence of at least one comorbidity is fairly common (about 55%; Jacobi et al., 2015). As our study shows promising results, future studies ought to obtain validation data in more homogeneous subgroups to find out about disorder-specific psychometric characteristics. Besides, as pointed out earlier, observing long-term changes in perceived stress over the course of illness and/or psychotherapy could also be of particular interest. Finally, our study did not take specific sources of stress and external stressors into account. Linking global stress with the occurrence and impact of life events could yield insights into the interplay of objective stressors and subjective stress responses.
Taken together, our analyses show that the German PSS-10 is a valid questionnaire to capture perceived helplessness and self-efficacy which, in the light of the transactional stress model, are known to be hallmark features of subjective perceived stress. Our study yielded highly satisfactory psychometric results for different populations and thus is an economic and easy-to-use scale to assess global subjective stress and its facets helplessness and self-efficacy.
Funding
This study was supported by the German Research Foundation (grant number WE3638/5-1).
Acknowledgements
The authors would like to thank Dr. Dominik Leiner for the possibility to use the German SoSci survey panel for data acquisition and Simone Klöckner for her help with editing the manuscript. We also thank Dr. Anne Szostek and Louisa Morrison for their translations of the PSS-10 as well as Tonio Krappmann and Nastasja García Rodríguez for their help with the Spanish manuscript.
Appendix A. Appendix 1 Instructions and items of an adaptation of the German 10-item Perceived Stress Scale.
Instruktionen: Die folgenden Fragen beschäftigen sich mit Ihren Gedanken und Gefühlen während des letzten Monats. Bitte geben Sie für jede Frage an, wie oft sie in entsprechender Art und Weise gedacht oder gefühlt haben.
Instructions: The questions in this scale ask you about your feelings and thoughts during the last month. In each case, you will be asked to indicate how often you felt or thought a certain way.
Item | Question |
---|---|
1 | Wie oft waren Sie im letzten Monat aufgewühlt, weil etwas unerwartet passiert ist? In the last month, how often have you been upset because of something that happened unexpectedly? |
2 | Wie oft hatten Sie im letzten Monat das Gefühl, nicht in der Lage zu sein, die wichtigen Dinge in Ihrem Leben kontrollieren zu können? In the last month, how often have you felt that you were unable to control the important things in your life? |
3 | Wie oft haben sie sich im letzten Monat nervös und gestresst gefühlt? In the last month, how often have you felt nervous and “stressed”? |
4 | Wie oft waren Sie im letzten Monat zuversichtlich, dass Sie fähig sind, ihre persönlichen Probleme zu bewältigen? In the last month, how often have you felt confident about your ability to handle your personal problems? |
5 | Wie oft hatten Sie im letzten Monat das Gefühl, dass sich die Dinge zu Ihren Gunsten entwickeln? In the last month, how often have you felt that things were going your way? |
6 | Wie oft hatten Sie im letzten Monat den Eindruck, nicht all Ihren anstehenden Aufgaben gewachsen zu sein? In the last month, how often have you found that you could not cope with all the things that you had to do? |
7 | Wie oft waren Sie im letzten Monat in der Lage, ärgerliche Situationen in Ihrem Leben zu beeinflussen? In the last month, how often have you been able to control irritations in your life? |
8 | Wie oft hatten Sie im letzten Monat das Gefühl, alles im Griff zu haben? In the last month, how often have you felt that you were on top of things? |
9 | Wie oft haben Sie sich im letzten Monat über Dinge geärgert, über die Sie keine Kontrolle hatten? In the last month, how often have you been angered because of things that were outside of your control? |
10 | Wie oft hatten Sie im letzten Monat das Gefühl, dass sich so viele Schwierigkeiten angehäuft haben, dass Sie diese nicht überwinden konnten? In the last month, how often have you felt difficulties were piling up so high that you could not overcome them? |
Note. English translation in italics. Answer range: 1-5; the helplessness subscale is computed by summing up Items 1, 2, 3, 6, 9 and 10; the self-efficacy subscale is computed by summing up items 4, 5, 7 and 8; the total score is the sum of all helplessness and reversed self-efficacy items. Higher scores reflect greater levels of stress.
References
- Amirkhan J.H. Stress overload: A new approach to the assessment of stress. American Journal of Community Psychology. 2012;49:55–71. doi: 10.1007/s10464-011-9438-x. [DOI] [PubMed] [Google Scholar]
- Arbuckle J.L., Wothke W. Smallwaters Corporation; Chicago: 1999. AMOS 4.0 Users Guide. [Google Scholar]
- Bech P., Olsen L.R., Kjoller M., Rasmussen N.K. Measuring well-being rather than the absence of distress symptoms: A comparison of the SF-36 Mental Health subscale and the WHO-Five Well-Being Scale. International Journal of Methods in Psychiatric Research. 2003;12:85–91. doi: 10.1002/mpr.145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campbell J., Ehlert U. Acute psychosocial stress: Does the emotional stress response correspond with physiological responses? Psychoneuroendocrinology. 2012;37:1111–1134. doi: 10.1016/j.psyneuen.2011.12.010. [DOI] [PubMed] [Google Scholar]
- Cheung G.W., Rensvold R.B. Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal. 2002;9:233–255. doi: 10.1207/S15328007SEM0902_5. [DOI] [Google Scholar]
- Cleland C., Kearns A., Tannahill C., Ellaway A. The impact of life events on adult physical and mental health and well-being: Longitudinal analysis using the GoWell health and well-being survey. BMC Research Notes. 2016;9:470. doi: 10.1186/s13104-016-2278-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen J. A power primer. Psychological Bulletin. 1992;112:155–159. doi: 10.1037//0033-2909.112.1.155. [DOI] [PubMed] [Google Scholar]
- Cohen S., Kamarck T., Mermelstein R. A Global Measure of Perceived Stress. Journal of Health and Social Behavior. 1983;24:385–396. doi: 10.2307/2136404. [DOI] [PubMed] [Google Scholar]
- Cohen S., Murphy M.L.M., Prather A.A. Ten Surprising Facts About Stressful Life Events and Disease Risk. Annual Review of Psychology. 2019;70:577–597. doi: 10.1146/annurev-psych-010418-102857. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cole S.R. Assessment of differential item functioning in the Perceived Stress Scale-10. Journal of Epidemiology and Community Health. 1999;53:319–320. doi: 10.1136/jech.53.5.319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Conway C.C., Rutter L.A., Brown T.A. Chronic environmental stress and the temporal course of depression and panic disorder: A trait-state-occasion modeling approach. Journal of. Abnormal Psychology. 2016;125:53–63. doi: 10.1037/abn0000122. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cusack S.E., Coleman J.A., Rappaport L.M., Sheerin C. Moderation of improvement in self-efficacy following group psychotherapy for PTSD. Psychological Services. 2018;16:657–663. doi: 10.1037/ser0000260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Denovan A., Dagnall N., Dhingra K., Grogan S. Evaluating the Perceived Stress Scale among UK university students: Implications for stress measurement and management. Studies in Higher Education. 2019;44:120–133. doi: 10.1080/03075079.2017.1340445. [DOI] [Google Scholar]
- Dikmen-Yildiz P., Ayers S., Phillips L. Longitudinal trajectories of post-traumatic stress disorder (PTSD) after birth and associated risk factors. Journal of affective disorders. 2018;229:377–385. doi: 10.1016/j.jad.2017.12.074. [DOI] [PubMed] [Google Scholar]
- Francisco C., Arce C., Vílchez M.D.P., Vales Á. Antecedents and consequences of burnout in athletes: Perceived stress and depression. International Journal of Clinical and Health Psychology. 2016;16:239–246. doi: 10.1016/j.ijchp.2016.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Franke G.H. Beltz Test GmbH; Göttingen, Germany: 2000. BSI brief symptom inventory von L. R. Derogatis (Kurzform der SCL-90-R) deutsche Version; Manual. [Google Scholar]
- Galatzer-Levy I.R., Huang S.H., Bonanno G.A. Trajectories of resilience and dysfunction following potential trauma: A review and statistical evaluation. Clinical psychology review. 2018;63:41–55. doi: 10.1016/j.cpr.2018.05.008. [DOI] [PubMed] [Google Scholar]
- Gorlin E.I., Werntz A.J., Fua K.C., Lambert A.E., Namaky N., Teachman B.A. Remembering or knowing how we felt: Depression and anxiety symptoms predict retrieval processes during emotional self-report. Emotion. 2019;19:465–479. doi: 10.1037/emo0000436. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guerra C., Cumsille P., Martínez M.L. Post-traumatic stress symptoms in adolescents exposed to an earthquake: Association with self-efficacy, perceived magnitude, and fear. International Journal of Clinical and Health Psychology. 2014;14:202–207. doi: 10.1016/j.ijchp.2014.05.001. [DOI] [Google Scholar]
- Guillot-Valdés M., Guillén-Riquelme A., Buela-Casal G. Reliability and validity of the Basic Depression Questionnaire. International Journal of Clinical and Health Psychology. 2019;19:243–250. doi: 10.1016/j.ijchp.2019.07.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hu L.-t., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal. 1999;6:1–55. doi: 10.1080/10705519909540118. [DOI] [Google Scholar]
- Jacobi F., Höfler M., Strehle J., Mack S., Gerschler A., Scholl L., Mack S., Gerschler A., Scholl L., Busch M., Hapke U., Maske U., Seiffert I., Gaebel W., Maier W., Wagner M., Wittchen H.-U. Twelve-months prevalence of mental disorders in the German Health Interview and Examination Survey for Adults - Mental Health Module (DEGS1-MH): A methodological addendum and correction. International Journal of Methods in Psychiatric Research. 2015;24:305–313. doi: 10.1002/mpr.1479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Keeley J.W., Reed G.M., Roberts M.C., Evans S.C., Robles R., Matsumoto C., Brewin C., Cloitre M., Perkonigg A., Rousseau C., Gureje O., Lovell A., Sharan P., Maercker A. Disorders specifically associated with stress: A case-controlled field study for ICD-11 mental and behavioural disorders. International Journal of Clinical and Health Psychology. 2016;16:109–127. doi: 10.1016/j.ijchp.2015.09.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Khalili R., Sirati Nir M., Ebadi A., Tavallai A., Habibi M. Validity and reliability of the Cohen 10-item Perceived Stress Scale in patients with chronic headache: Persian version. Asian Journal of Psychiatry. 2017;26:136–140. doi: 10.1016/j.ajp.2017.01.010. [DOI] [PubMed] [Google Scholar]
- Klein E.M., Brähler E., Dreier M., Reinecke L., Müller K.W., Schmutzer G., Wölfling K., Beutel M.E. The German version of the Perceived Stress Scale - psychometric characteristics in a representative German community sample. BMC Psychiatry. 2016;16:159. doi: 10.1186/s12888-016-0875-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lavoie J.A.A., Douglas K.S. The Perceived Stress Scale: Evaluating Configural, Metric and Scalar Invariance across Mental Health Status and Gender. Journal of Psychopathology and Behavioral Assessment. 2012;34:48–57. doi: 10.1007/s10862-011-9266-1. [DOI] [Google Scholar]
- Lazarus R.S., Folkman S. Springer; New York, NY: 1984. Stress, appraisal, and coping. [Google Scholar]
- Leon-Quismondo L., Lahera G. Relationship between cognitions and perceived self-efficacy with the severity of panic disorder with agoraphobia. European Psychiatry. 2016;33:S324. doi: 10.1016/j.eurpsy.2016.01.1119. [DOI] [Google Scholar]
- Marsh H.W., Hau K.T., Balla J.R., Grayson D. Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis. Multivariate Behavioral Research. 1998;33:181–220. doi: 10.1207/s15327906mbr3302_1. [DOI] [PubMed] [Google Scholar]
- Nielsen M.G., Ørnbøl E., Vestergaard M., Bech P., Larsen F.B., Lasgaard M., Christensen K.S. The construct validity of the Perceived Stress Scale. Journal of Psychosomatic Research. 2016;84:22–30. doi: 10.1016/j.jpsychores.2016.03.009. [DOI] [PubMed] [Google Scholar]
- Petrowski K., Paul S., Albani C., Brähler E. Factor structure and psychometric properties of the trier inventory for chronic stress (TICS) in a representative German sample. BMC Medical Research Methodology. 2012;12:42. doi: 10.1186/1471-2288-12-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Putnick D.L., Bornstein M.H. Measurement Invariance Conventions and Reporting: The State of the Art and Future Directions for Psychological Research. Developmental Review. 2016;41:71–90. doi: 10.1016/j.dr.2016.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reis D., Lehr D., Heber E., Ebert D.D. The German Version of the Perceived Stress Scale (PSS-10): Evaluation of Dimensionality, Validity, and Measurement Invariance With Exploratory and Confirmatory Bifactor Modeling. Assessment. 2017 doi: 10.1177/1073191117715731. [DOI] [PubMed] [Google Scholar]
- Roohafza H., Ramezani M., Sadeghi M., Shahnam M., Zolfagari B., Sarafzadegan N. Development and validation of the stressful life event questionnaire. International Journal of Public Health. 2011;56:441–448. doi: 10.1007/s00038-011-0232-1. [DOI] [PubMed] [Google Scholar]
- Schlotz W., Yim I.S., Zoccola P.M., Jansen L., Schulz P. The Perceived Stress Reactivity Scale: Measurement invariance, stability, and validity in three countries. Psychological Assessment. 2011;23:80–94. doi: 10.1037/a0021148. [DOI] [PubMed] [Google Scholar]
- Schönfeld P., Brailovskaia J., Bieda A., Zhang X.C., Margraf J. The effects of daily stress on positive and negative mental health: Mediation through self-efficacy. International Journal of Clinical and Health Psychology. 2016;16:1–10. doi: 10.1016/j.ijchp.2015.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schroder K.E.E., Ollis C.L. The Coping Competence Questionnaire: A measure of resilience to helplessness and depression. Motivation and Emotion. 2013;37:286–302. doi: 10.1007/s11031-012-9311-8. [DOI] [Google Scholar]
- Skorikov V.B., VanderVoort D.J. Relationships Between The Underlying Constructs Of The Beck Depression Inventory And The Center For Epidemiological Studies Depression Scale. Educational and Psychological Measurement. 2003;63:319–335. doi: 10.1177/0013164402251035. [DOI] [Google Scholar]
- Taylor J.M. Psychometric analysis of the Ten-Item Perceived Stress Scale. Psychological Assessment. 2015;27:90–101. doi: 10.1037/a0038100. [DOI] [PubMed] [Google Scholar]
- Vandenberg R.J., Lance C.E. A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research. Organizational Research Methods. 2000;3:4–70. doi: 10.1177/109442810031002. [DOI] [Google Scholar]
- Wersebe H., Lieb R., Meyer A.H., Hofer P., Gloster A.T. The link between stress, well-being, and psychological flexibility during an Acceptance and Commitment Therapy self-help intervention. International Journal of Clinical and Health Psychology. 2018;18:60–68. doi: 10.1016/j.ijchp.2017.09.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wessa M., Perlini C., Brambilla P. Neuropsychological underpinnings of the dynamics of bipolar disorder. Epidemiology and Psychiatric Sciences. 2015;24:479–483. doi: 10.1017/S2045796015000098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wittchen H.-U., Wunderlich U., Gruschwitz S., Zaudig M. Hogrefe; Göttingen: 1997. Strukturiertes Klinisches Interview für DSM-IV. Achse II: Persönlichkeitsstörungen. [Google Scholar]
- Zahn R., Lythe K.E., Gethin J.A., Green S., Deakin J.F.W., Young A.H., Moll J. The role of self-blame and worthlessness in the psychopathology of major depressive disorder. Journal of Affective Disorders. 2015;186:337–341. doi: 10.1016/j.jad.2015.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zorn J.V., Schür R.R., Boks M.P., Kahn R.S., Joëls M., Vinkers C.H. Cortisol stress reactivity across psychiatric disorders: A systematic review and meta-analysis. Psychoneuroendocrinology. 2017;77:25–36. doi: 10.1016/j.psyneuen.2016.11.036. [DOI] [PubMed] [Google Scholar]