Abstract
Background
Three versions of Perceived Stress Scale (PSS-14, PSS-10, and PSS-4) are among the most widely used measures of stress. The aim of current study was to validate this instrument in a sample of non-demented elderly adults to facilitate studies of the impact of stress on health.
Methods
768 nondemented adults over the age of 70 years completed the PSS-14 questionnaire and other neuropsychological tests. Exploratory Factor Analysis (EFA) was used to determine the underlying factor structure of all PSS versions and Confirmatory Factor Analysis (CFA) was used to test the construct validity of factors. The internal consistency reliability of the scales was assessed using Cronbach's alpha, and concurrent validity was evaluated by examining PSS relation with age, gender, depression, anxiety, and Positive Affect and Negative Affect Schedule (PANAS).
Results
A two-factor model was the optimal fit for the 14- and 10-item versions of PSS. For the PSS-14, all items’ loadings exceeded 0.4 for one of the two factors except item 12. Therefore, we studied a 13-item version of PSS as well as 10- and 4-item subsets representing PSS-10 and PSS-4. Internal consistency coefficients were satisfactory for the full scale of PSS-13 and PSS-10, but not for PSS-4. Women reported higher levels of stress than men. Higher levels of total PSS scores showed association with higher levels of depression, anxiety, and negative affect, and lower level of positive affect.
Conclusions
The 13- and 10-item versions of PSS may be used to understand the experience of stress among older adults.
Keywords: Perceived Stress Scale, older adults, Coping, Distress, Psychometric Properties
INTRODUCTION
Stress in the American population has increased significantly in recent years and is considered a major health issue (American Psychological Association 2007). Several studies show that stress is also very common in elderly adults and plays a major role in the development of both physical and psychological health problems including depression (Fiske, et al. 2009), anxiety (Kogan, et al. 2000), sleep disorders (Jean-Louis, et al. 2001), and cognitive decline (Dickinson, et al. 2011). Therefore, a psychometrically sound global measure of perceived stress in older adults could provide valuable additional information about the relationship between stress and age-associated pathology (Cohen, et al. 1983).
Stress can be studied by assessing life events and daily hassles, by measuring perception of events or biological consequences. One method quantifies life events over a defined period (Holmes and Rahe 1967) to produce a cumulative stress score. These scores are usually based on either the number of events or a sum of events weighted to reflect adjustment difficulties that have occurred within a specified time frame. Although higher life event scores are associated with increased physical or psychological dysfunction, the magnitude of the association has been low (Rabkin and Struening 1976).
Perceived stress occurs when an individual judges that situational demands exceed his or her resources (Lazarus and Folkman 1984). Stressful events presumably increase the risk of disease when coping resources are insufficient to address the threat or demand. The Perceived Stress Scale (PSS) (Cohen et al. 1983) is a 14-item scale developed in accordance with the transactional perspective. Instead of focusing on a particular event, the PSS provides a global appraisal of stress by asking respondents to report whether their lives seem to be unpredictable, uncontrollable, or overloaded. Rather than tying appraisal to particular situations, the PSS is sensitive to the nonoccurrence of events as well as to ongoing life circumstances, to stress resulting from events occurring in the lives of friends and relatives, and to expectations concerning future events (Cohen and Williamson 1988).
In samples of college students, Cohen and colleagues (Cohen et al. 1983) showed that the PSS was reliable and correlated with life-event scores, depressive and physical symptomatology, utilization of health services, social anxiety, and smoking-reduction maintenance. They showed that the PSS was a better predictor of the outcomes than life-event scores, and that it measures a different and independently predictive construct than a depressive symptomatology scale. PSS scores were significantly correlated with physical symptoms even after controlling for the life-events score(Pbert, et al. 1992). Furthermore, it has been shown that higher levels of cortisol, a biological indicator of stress, are associated with higher PSS scores (van Eck and Nicolson 1994).
The PSS has 14, 10, and 4-item versions and has emerged as one of the more common non-invasive measures of subjective stress in psychophysical health research (Sharp, et al. 2007). The 4-item and 10-item versions are subsets of items from the 14-item scale. A few prior studies of the psychometric properties of the English version of PSS have used principle component analysis (PCA) or exploratory factor analysis (EFA). These studies were conducted on samples of community-dwelling adults, (Cohen and Williamson 1988) psychiatric populations including adult outpatients (mean age of 36.20 years, SD = 10.81), (Hewitt, et al. 1992) adolescent inpatients (mean age of 14.28 years, SD=1.22) (Martin, et al. 1995), women recovering from breast cancer (mean age of 51 years, SD = 10) (Golden-Kreutz, et al. 2004), college students (Roberti, et al. 2006), and adults who had survived the death of a family member or significant other by suicide (mean age of 43.3 years ,SD=13.7) (Mitchell, et al. 2008). Moreover, the PSS has been translated into several other languages and its psychometric properties have been evaluated in a variety of populations (Andreou, et al. 2011; Leung, et al. 2010; Remor 2006). Despite wide usage of the PSS, it has not been assessed in community samples of elderly adults.
Stress plays an important role in the aging process. The importance of stress in older adults is likely to increase as the population of adults above the age of 65 will double to constitute nearly 20% of the US population by 2030 (He, et al. 2005). Therefore, ensuring that we have reliable and valid tests to measure stress in the elderly population is critical. The aim of the current study was to verify psychometric properties, internal consistency reliability, and validity of different versions of PSS (4-, 10-, and 14-item) in a community-based sample of non-demented elderly adults.
METHODS
Participants
The participants were 768 nondemented adults over the age of 70 years drawn from the Einstein Aging Study (EAS). The study design and methods of the EAS are described elsewhere (Katz, et al. 2011). Briefly, potential participants were recruited through systematic sampling from voter registration lists for Bronx County, New York. Eligible participants were at least 70 years old, Bronx residents, non-institutionalized, and English speaking. Exclusion criteria included visual or auditory impairments that preclude neuropsychological testing, active psychiatric symptomatology that interfered with the ability to complete assessments, and nonambulatory status.
Participants who were demented before their initial assessment with the PSS, or were diagnosed with dementia at the time of their initial PSS, were excluded from these analyses. A diagnosis of dementia was based on standardized clinical criteria from the Diagnostic and Statistical Manual, Fourth Edition (American Psychiatric Association. and American Psychiatric Association. Task Force on DSM-IV. 2000) and required impairment in memory plus at least one additional cognitive domain, accompanied by evidence of functional decline. Diagnoses were assigned at consensus case conferences, which included a comprehensive review of cognitive test results, relevant neurological signs and symptoms, and functional status. For this cross-sectional analysis, we included only the first administration of the PSS.
In addition, participants were categorized into two groups of normal and Mild Cognitive Impaired (MCI) based on the criteria described in detail previously(Katz et al. 2011). Briefly, the MCI group consisted of participants with either amnestic MCI (aMCI) or non-amnestic MCI. Participants were classified as having aMCI if the memory domain was impaired or naMCI if there was impairment in one or more domains other than memory including attention, executive function, visuospatial ability, or language. Non-amnestic MCI was diagnosed in nondemented participants without functional impairment who did not meet memory criterion for aMCI but had impairment (1.5SD below the age adjusted mean) in at least 1 non-memory cognitive domain.
All studies were approved by institutional review board of Albert Einstein College of Medicine. After informed consent was obtained, participants received medical, neurological, and neuropsychological assessments.
Psychological Evaluation
The 14-item Perceived Stress Scale (PSS-14) was used to assess perceived stress. (Cohen et al. 1983) Seven out of the fourteen items of PSS-14 are worded negative (1, 2, 3, 8, 11, 12, 14) and the remaining seven are positive (4, 5, 6, 7, 9, 10, 13). Each item was rated on a five point Likert-type scale (0 = never to 4 = very often). Total scores are calculated after reversing positive items’ scores and then summing up all scores. Possible total scores for PSS-14 range from 0 to 56. A higher score indicates greater stress.
Depressive symptoms were assessed using the 15-item Geriatric Depression scale (GDS) that assesses mood disturbance symptoms that are commonly associated with depression experienced among older adults (Sheikh 1986). Anxiety symptoms were measured using the Beck anxiety inventory (BAI) which is designed to obtain a measure of anxiety that is relatively independent of depression (Beck, et al. 1988). These instruments have high reliability and validity in community-based samples (Osman, et al. 1997; Walters, et al. 2001).
The Positive Affect and Negative Affect Schedule (PANAS) questionnaire was used to assess general affect or mood (Watson, et al. 1988). This questionnaire consists of 10 positive affect traits (PA; interested, excited, strong, enthusiastic, proud, alert, inspired, determined, attentive and active) and 10 negative affect traits (NA; distressed, upset, guilty, scared, hostile, irritable, ashamed, nervous, jittery and afraid). These are considered higher level mood states and account for most of the important variances from many discrete moods (Cooper and Mcconville 1989). The responses were recorded on a five-point Likert scale ranging from “not at all” = 1, to “extremely” = 5. A score for each scale was obtained by summing item scores. The scales have high internal consistency, with Cronbach's alpha ranging from 0.84 to 0.87 for the NA scale and 0.84 to 0.90 for the PA scale.(Watson and Walker 1996) PANAS scales have been shown to have convergent, construct and discriminant validity (Watson et al. 1988) and have been previously employed in studies of older adults (Segal 1999; Simpson, et al. 2008).
The SF-36 questionnaire was used to evaluate quality of life. This questionnaire has been previously validated for use in older adults (Walters et al. 2001). We measured memory using the Free and Cued Selective Reminding Test –Immediate Recall (FCSRT-IR) (Buschke 1984) and the Logical Memory I (LM I)(Wechsler 1987) subtest from the Wechsler Memory Scale-Revised. Global cognitive status was measured by the Blessed Information -Memory- Concentration (BIMC) Test (Roth, et al. 1967). Details of neuropsychological tests have been previously described (Katz et al. 2011).
Statistical Analysis
Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA)
EFA was used to determine the factor structure of the PSS, and CFA was used to confirm the factor structure. Model evaluations were made using a variety of fit indices, including the comparative fit index (CFI), standardized root mean square residual (SRMR) [28], and the root mean square error of approximation (RMSEA). Values of CFI > 0.9, SRMR < 0.08, and RMSEA < 0.08 are indicative of a good fit with the data(Hoyle 1995). Model chi-square test statistics and associated degrees of freedom and p-values were reported for completeness, although they were not used in model evaluation (Beckstead, et al. 2008).
Split-half Analysis
To further examine the validity of our factor solution, we repeated EFA and CFA by running a split-half analysis. For this purpose we randomly selected half of the sample and performed the EFA. Subsequently, based on the factor solution proposed by EFA we performed CFA on both halves of the sample.
The internal consistency reliability of the scale was assessed by Cronbach's alpha and concurrent validity was evaluated by examining the PSS relationship with gender, depression, anxiety and PANAS. Divergent validity was assessed by examining the PSS correlation with Bodily pain index from SF-36 health survey. Total stress scores were computed by first reversing the scores of the positive items and then summing all the items of the PSS. Spearman's correlations, t-tests, and ANOVAs were used as appropriate.
All analyses were conducted using SPSS 20 (Chicago, IL: SPSS Inc.) and STATA version 12 (STATA Corp., Texas, USA).
RESULTS
The sample had a mean age of 80.0 years (SD=5.5). The sample was 60.5% women and 67.3% white, with a mean of 14.1 years (SD=3.4) of education. Sample demographics are presented in table 1.
Table 1.
Total sample, N=768 | Non-MCI N=644 | MCI N=124 | |
---|---|---|---|
Women (%) | 60.5 | 60.9 | 58.9 |
White (%) | 67.3 | 68.2 | 62.9 |
Age, mean (SD), y | 80.0(5.5) | 79.6(5.3) | 81.7(5.8) |
Education, mean (SD), y | 14.1(3.4) | 14.2(3.3) | 13.2(3.5) |
BIMC total errors, median (range) | 1 (0-11) | 1.7(1.9) | 3.0(2.6) |
FCSRT-IR free recall score, mean (SD) | 30.8(6.4) | 31.9(5.6) | 24.8(7.1) |
FCSRT-IR total recall score, mean (SD) | 47.6(2.2) | 47.7(2.2) | 47.1(2.1) |
Logical Memory I total score, mean (SD) | 20.8(6.7) | 21.5(6.6) | 17.2(6.3) |
Verbal IQ, mean (SD) | 109.8(16.4) | 110.3(16.2) | 104.7(17.1) |
Beck Anxiety Index, mean(SD)† | 4.2(5.6) | 4.1(5.4) | 4.3(6.3) |
Geriatric Depression Scale(GDS), mean(SD) | 2.2(2.1) | 2.1(2.1) | 2.6(2.3) |
PSS-13, mean(SD) * | 17.1(7.6) | 16.9(7.5) | 18.2(7.8) |
Positive Factor (Coping), mean(SD) | 18.1(5.4) | 18.2(5.3) | 17.0(5.9) |
Negative Factor (Distress), mean(SD) * | 7.2(4.4) | 7.2(4.3) | 7.3(4.6) |
PANAS-X-Positive Affect†† | 21.0(8.0) | 21.2(8.1) | 19.2(7.9) |
PANAS-X-Negative Affect†† | 7.7(6.4) | 7.3(6.2) | 8.1(6.9) |
• FCSRT-IR: Free and Cued Selective Reminding Test -Immediate Recall BIMC: Blessed Information -Memory-Concentration Test; PANAS: Positive Affect and Negative Affect Schedule
• Range of possible scores for demographic data: BIMC (0-33), FCSRT-IR (0-48; for both free and total recall), LM I (0-50), GDS (0-15), and BAI (0-63)
Beck anxiety Index available for n=229
PANAS data available for n=699
Question 12 in PSS-14 is excluded from analysis
PSS Factor Analysis
EFA on the entire sample resulted in a two-factor model. Table 2 displays the items and the standardized factor loadings based on EFA. All loadings exceeded 0.3 for one of either of the factors except item 12 (How often have you been thinking about things that you have to accomplish?), which loaded highly on both factors. Therefore, we removed item 12 from the scale and all further analysis was based only on 13 items (PSS-13). Seven items loaded on the first factor, and six items loaded on the second factor. The first factor involved positive questions (reverse-keyed items), and the second factor involved negative questions. The two factors were associated with each other (rs = −0.28, p < 0.001). Hewitt and colleagues (Hewitt et al. 1992) named the factor with negative questions “perceived distress” and the factor with positive questions “perceived coping”.
Table 2.
PSS-14 | PSS-13 | PSS-10 | PSS-4 | ||||||
---|---|---|---|---|---|---|---|---|---|
Items | Positive (Coping) | Negative (Distress) | Positive (Coping) | Negative (Distress) | Positive (Coping) | Negative (Distress) | Positive (Coping) | Negative (Distress) | |
In the last month, how often have you (been/felt) | |||||||||
1 | Upset by something happening unexpectedly? | 0.027 | 0.629 | 0.049 | 0.628 | 0.137 | 0.626 | ||
2 | Unable to control the important things in your life? | 0.166 | 0.746 | 0.188 | 0.755 | 0.288 | 0.757 | 0.284 | 0.736 |
3 | Nervous and stressed? | 0.076 | 0.701 | 0.102 | 0.702 | 0.210 | 0.697 | ||
4 | Dealt successfully with day-to-day problems and annoyances? | 0.605 | −0.149 | 0.597 | −0.123 | ||||
5 | Effectively coping with important changes that were occurring in your life? | 0.739 | −0.016 | 0.741 | 0.018 | ||||
6 | Confident about your ability to handle your personal problems? | 0.769 | 0.116 | 0.768 | 0.156 | 0.721 | 0.156 | 0.726 | 0.213 |
7 | Things were going your way? | 0.639 | 0.367 | 0.651 | 0.397 | 0.730 | 0.383 | 0.780 | 0.418 |
8 | Could not cope with all the things that you had to do? | 0.122 | 0.627 | 0.148 | 0.626 | 0.217 | 0.630 | ||
9 | Dealt successfully with irritating life hassles? | 0.710 | 0.099 | 0.715 | 0.132 | 0.679 | 0.130 | ||
10 | You were on top of things? | 0.685 | 0.298 | 0.694 | 0.332 | 0.761 | 0.316 | ||
11 | Angered because of things that were outside your control? | 0.047 | 0.668 | 0.073 | 0.667 | 0.160 | 0.673 | ||
12 | Thinking about things that you have to accomplish? | -0.322 | 0.358 | ||||||
13 | Able to control the way you spend your time? | 0.692 | 0.131 | 0.685 | 0.172 | ||||
14 | Difficulties were piling up so high that you could not overcome them? | 0.155 | 0.659 | 0.182 | 0.658 | 0.269 | 0.663 | 0.268 | 0.678 |
• Extraction method: Principal Axis Factoring
• Rotation Method: Oblimin
• Factor loadings of more than 0.4 are bolded in the table.
We assessed goodness of fit for one and two-factor models to the 13, 10, and 4-item versions of PSS using CFA (table 3). The 2-factor model fitted well to PSS-10 and marginally well to PSS-13 as reflected by higher CFI and lower RMSEA and SRMR. For the PSS-4, the model did not converge for the 2-factor model. One-factor model did not fit well to any of the three PSS versions. Nested model comparisons using chi-square test also confirmed that 2-factor models fit better than the 1-factor models for both PSS-10 (χ2 (1) = 718, p<0.001) and PSS-13 (χ2 (1) = 1312, p<0.001).
Table 3.
MODEL | Χ 2 | df | p-value | CFI | RMSEA | SRMR | |
---|---|---|---|---|---|---|---|
PSS-13 | 1-factor model | 1736 | 65 | <0.001 | 0.569 | 0.182 | 0.167 |
2-factor model | 424 | 64 | <0.001 | 0.905 | 0.086 | 0.075 | |
PSS-10 | 1-factor model | 876 | 35 | <0.001 | 0.627 | 0.202 | 0.136 |
2-factor model | 158 | 34 | <0.001 | 0.952 | 0.069 | 0.048 | |
PSS-4 | 1-factor model | 165 | 2 | <0.001 | 0.73 | 0.327 | 0.10 |
2-factor model | Convergence not achieved |
• CFI: Comparative Fit Index; RMSEA: Root Mean Squared Error of Approximation; SRMR: Standardized Root Mean Squared Residual
Subsequently, we performed the split-half analysis by performing EFA on half of the sample and CFA on both halves. Because the results were similar to full-sample analysis, here we present only the results from the entire sample and provide the split-half results as supplementary materials (see supplementary tables S-1 and S-2).
Internal Consistency Reliability analysis
Internal consistency reliability coefficients, using Cronbach's alpha, for the negative subscale of PSS-13, PSS-10, and PSS-4, were 0.83, 0.83, and 0.67, respectively. The Cronbach's alpha value of positive subscale of PSS-13, PSS-10, and PSS-4, were 0.86, 0.81, and 0.71, respectively. Finally, the Cronbach's alpha value of the full scale for PSS-13, PSS-10, and PSS-4 were 0.83, 0.82, and 0.66, respectively. Based on Kline's criterion, reliability coefficients of more than 0.7 confirm internal consistency(Kline 2000). Therefore, our results indicate that PSS-13 and PSS-10 pass the Kline's criterion for internal consistency, but PSS-4 does not.
MCI population
We also repeated the analysis on a subset of subjects with MCI. Only the two-factor model for PSS-13 showed good model fits, and models for PSS-10 and PSS-4 showed unsatisfactory fit (see supplementary materials, tables S-3, S-4, and S-5).
Concurrent and divergent validity
Scores on the positive and negative subscales were computed by averaging the corresponding items for PSS; higher scores on negative and positive subscales indicate higher levels of perceived distress and coping ability, respectively. The overall PSS score was computed by adding the negative subscale scores and the reverse of the positive subscale scores. Higher overall scores indicate higher levels of stress. In order to provide additional support for the predictive validity of the PSS we investigated the correlation between 13-item PSS (total stress score) and the two negative factor (NF) and positive factor (PF) with other demographic and neuropsychological measures (table 4).
Table 4.
Coping | Distresstt | Total Stress | |
---|---|---|---|
Age | −0.18** | −0.03 | 0.12** |
Education (years) | 0.18** | 0.04 | −0.10* |
FCSRT-IR Free Recall | 0.10* | 0.00 | −0.08* |
FCSRT-IR Total Recall | −0.04 | −0.02 | −0.04 |
Logical Memory I | 0.14** | 0.04 | −0.09* |
BIMC | −0.13** | 0.05 | 0.12** |
Beck Anxiety Scoret | −0.18** | 0.35** | 0.29** |
GDS Score | −0.32** | 0.33** | 0.39** |
PANASX-Positive Affect | 0.43** | −0.20** | −0.41** |
PANASX-Negative Affect | −0.22** | 0.57** | 0.44** |
Correlation is significant at the 0.05 level.
Correlation is significant at the 0.01 level.
Beck anxiety score available for n=249
Question 12 in PSS-14 is excluded from analysis
Women reported a significantly higher total stress score than men (t=−3.2, p= 0.007); there was a similar trend for NF with women reporting more distress than men (t= −3.9, p=0.018). The PF did not demonstrate a gender difference (t= 1.3, p=0.22). Furthermore, total PSS was associated with age (rs = 0.12, p = 0.005). Analysis of PSS factors showed that there is a reverse correlation between PF and age (rs =−0.18, p<0.001), but there is no association between NF and age (rs = −0.03, p =0.44). As the total years of education increased, total stress score decreased (rs = −0.08, p = 0.02).
Total stress score was negatively correlated with the free recall score from the FCSRT-IR (rs = −0.08, p = 0.02) and logical memory (rs = −0.09, p =0.014); PF was positively correlated with FCSRT-IR free recall (rs = 0.10, p = 0.004) and logical memory (rs = 0.14, p < 0.001); but there was no association between NF and FCSRT-IR free recall (rs < 0.001, p = 0.99) or logical memory (rs = 0.0.4, p =0.29).
Depression was positively associated with total stress score (rs = 0.39, p< 0.001); it was positively correlated with the NF (rs = 0.32, p< 0.001), and inversely associated with the PF (rs = −0.32, p< 0.001). In addition, anxiety was positively associated with total stress score (rs = 0.29, p< 0.001); negatively associated with the PF (rs = −0.18, p< 0.001) and positively associated with the NF (rs = 0.35, p< 0.001).
As external validators, we also compared the association between coping, distress, and the total score for the 13-item version with PANAS scores. Higher levels of stress were associated with lower scores of PANAS Positive affect (rs = −0.39, p< 0.001), and higher scores of PANAS negative affect (NA: rs = 0.46, p< 0.001). The NF (PA: rs = −0.19, p< 0.001; NA: rs = 0.59, p< 0.001) and the PF (PA: rs = 0.42, p<0.001; NA: rs = −0.23, p< 0.001) also correlated with PANAS-X negative affect and PANAS-X positive affect.
There was some support for divergent validity, as well, as correlations between PSS and SF-36 bodily pain measure -which was not intended to measure perceived stress- was low (PSS: rs = 0.18, p<0.001; PF: rs = 0.14, p<0.001; NF: rs = −0.17 , p<0.001)
DISCUSSION
In this study, we explored the factor structure, and internal consistency reliability of the three versions of PSS and validity of PSS-13 in a community-based sample of adults over the age of 70. The results confirmed a two-factor structure for PSS-10 and PSS-13 and also demonstrated the internal consistency and concurrent validity for PSS and its corresponding subscales.
In accordance with other studies testing PSS in younger populations, (Andreou et al. 2011; Golden-Kreutz et al. 2004; Leung et al. 2010; Ramirez and Hernandez 2007; Sharp et al. 2007) our findings support a two-factor structure of the 13- and 10-item versions of PSS, and that the two factor models provided optimal approximations of the data of this scale. For PSS-14, item 12 loaded highly on both factors, indicating that this item was not a good measure for either of the subscale factors. This item also failed to load on the two factors in the previous studies (Andreou et al. 2011; Leung et al. 2010; Martin et al. 1995; Mitchell et al. 2008). This suggests that future community-based studies of older adults may wish to exclude item 12 when calculating the total score or subscale scores. Similar to other studies (Cohen et al. 1983; Cohen and Williamson 1988; Glaser, et al. 1999), the internal consistency reliability analysis of PSS-13 and PSS-10 showed satisfactory alpha coefficients for the full range as well as the 2 subscales.
In our study, women had significantly higher PSS scores, which is consistent with previous studies (Andreou et al. 2011; Remor 2006; Wong, et al. 2004). Women showed significantly higher scores in the NF and lower scores in the PF than men.
The total PSS score and its subscales correlated with depression, anxiety and affect in the anticipated directions, which are indicative of the concurrent validity of the PSS. In our sample depression was associated with higher total PSS scores, higher distress and lower coping. This is consistent with previous findings showing correlations between depression and PSS.(Candrian, et al. 2008; Dennis, et al. 2008; Elavsky and Gold 2009; Hewitt et al. 1992; Lee, et al. 2012; Leung et al. 2010) In addition, consistent with earlier findings (Brajenovic-Milic, et al. 2010; Chen, et al. 2012), we showed that there is a significant correlation between anxiety and PSS. Finally, in line with previous studies (Golden-Kreutz et al. 2004) we showed that there is a reverse correlation between Positive Affect of PANAS scale and PSS and a direct association between Negative Affect and PSS score.
Although we studied a sample of older adults free of dementia, we included participants with MCI. The results showed that the free recall score from FCSRT-IR is positively correlated with coping and negatively correlated with total stress score. Stress may have a negative influence on memory. Alternatively, poor memory may be associated with increased stress. Analysis of validity in MCI population on a subset of subjects with MCI showed reliable fit only for the two-factor model of PSS-13. In addition, only PSS-13 & PSS-10 passed the criteria for internal consistency reliability. This suggests that among the 3 versions of PSS, PSS-13 is the best choice for assessing stress in MCI population.
In our two-factor model for PSS, all the positively worded items loaded together and all the negatively worded items loaded together. Other studies have shown that positive wording versus negative wording of similar items influences the outcome (Wouters, et al. 2012). This difference in wording may be an important drive for the 2-factor structure. But since the correlation of the two factors is relatively weak (rs = −0.28), we suggest that there may be other differences between the constructs.
Although previous studies of PSS showed strong correlation between NF(distress)and PF(coping) in younger populations (Andreou et al. 2011; Leung et al. 2010), in our study these factors are weakly correlated (rs = −0.28) and should be considered as correlated, but somewhat independent factors. In addition, PF and NF show different correlations with other variables (i.e. memory domain). Therefore we suggest using these factors as separate indicators of stress in future studies of older adults.
The strength of this study is our utilization of a large systematic community sample of participants over the age of 70. There are a few limitations for this study. A participation bias may be operative in these findings since individuals with more stress might not elect to participate in research studies. Furthermore, since we excluded participants with dementia and severe psychiatric symptomatology, the results should not be extended to these populations. In addition the average level of education in our population was 14.1 and higher than general population, which might limit generalizability of the findings. Finally, although we assessed internal consistency reliability of the PSS in our sample, we did not assess test-retest reliability.
CONCLUSION
The Perceived Stress Scale revealed satisfactory psychometric properties in non-demented elderly adults and therefore its 13-item (PSS-14 excluding item 12) and 10-item versions are acceptable for use in elderly adults.
Supplementary Material
ACKNOWLEDGMENTS
This research was supported by National Institute on Aging Grant AG03949 and AG026728.
Funding Sources: Funding was provided by National Institute on Aging Grant AG03949 and AG026728.
Footnotes
Author Contributions: Lipton, Katz, Zimmerman, Sliwinski: Study concept and design. Katz: Data acquisition. Ezzati, Jiang, Katz, Zimmerman, Sliwinski, Lipton: Data analysis and interpretation. Ezzati, Jiang: Initial manuscript preparation. Ezzati, Jiang, Katz, Zimmerman, Sliwinski, Lipton: Critical revision of manuscript for important intellectual content. All authors contributed to and approved the final manuscript.
Conflict of Interest: All authors declare that there are no financial, personal, or other potential conflicts of interest to report.
REFERENCES
- American Psychiatric Association. & American Psychiatric Association . Diagnostic and statistical manual of mental disorders : DSM-IV-TR. American Psychiatric Association; Washington, DC: 2000. Task Force on DSM-IV. [Google Scholar]
- American Psychological Association Stress: a major health problem in the US, warns APA. Retrieved June. 2007:2008. [Google Scholar]
- Andreou E, Alexopoulos EC, Lionis C, Varvogli L, Gnardellis C, Chrousos GP, Darviri C. Perceived Stress Scale: reliability and validity study in Greece. International journal of environmental research and public health. 2011;8:3287–3298. doi: 10.3390/ijerph8083287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. Journal of consulting and clinical psychology. 1988;56:893–897. doi: 10.1037//0022-006x.56.6.893. [DOI] [PubMed] [Google Scholar]
- Beckstead JW, Yang CY, Lengacher CA. Assessing cross-cultural validity of scales: a methodological review and illustrative example. International journal of nursing studies. 2008;45:110–119. doi: 10.1016/j.ijnurstu.2006.09.002. [DOI] [PubMed] [Google Scholar]
- Brajenovic-Milic B, Martinac Dorcic T, Kuljanic K, Petrovic O. Stress and anxiety in relation to amniocentesis: do women who perceive their partners to be more involved in pregnancy feel less stressed and anxious? Croatian medical journal. 2010;51:137–143. doi: 10.3325/cmj.2010.51.137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buschke H. Cued recall in amnesia. Journal of clinical neuropsychology. 1984;6:433–440. doi: 10.1080/01688638408401233. [DOI] [PubMed] [Google Scholar]
- Candrian M, Schwartz F, Farabaugh A, Perlis RH, Ehlert U, Fava M. Personality disorders and perceived stress in major depressive disorder. Psychiatry research. 2008;160:184–191. doi: 10.1016/j.psychres.2007.06.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen J, Wang Z, Guo B, Arcelus J, Zhang H, Jia X, Xu Y, Qiu J, Xiao Z, Yang M. Negative affect mediates effects of psychological stress on disordered eating in young Chinese women. PloS one. 2012;7:e46878. doi: 10.1371/journal.pone.0046878. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. Journal of health and social behavior. 1983;24:385–396. [PubMed] [Google Scholar]
- Cohen S, Williamson G. Perceived stress in a probability sample in the United States. In: Spacapan S, Oskamp S, editors. The social psychology of health. Sage; Newbury Park: 1988. [Google Scholar]
- Cooper C, Mcconville C. The Factorial Equivalence of State Anxiety Negative Affect and State Extraversion Positive Affect. Pers Indiv Differ. 1989;10:919–920. [Google Scholar]
- Dennis JP, Markey MA, Johnston KA, Vander Wal JS, Artinian NT. The role of stress and social support in predicting depression among a hypertensive African American sample. Heart & lung : the journal of critical care. 2008;37:105–112. doi: 10.1016/j.hrtlng.2007.03.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dickinson WJ, Potter GG, Hybels CF, McQuoid DR, Steffens DC. Change in stress and social support as predictors of cognitive decline in older adults with and without depression. International journal of geriatric psychiatry. 2011;26:1267–1274. doi: 10.1002/gps.2676. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Elavsky S, Gold CH. Depressed mood but not fatigue mediate the relationship between physical activity and perceived stress in middle-aged women. Maturitas. 2009;64:235–240. doi: 10.1016/j.maturitas.2009.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fiske A, Wetherell JL, Gatz M. Depression in older adults. Annual review of clinical psychology. 2009;5:363. doi: 10.1146/annurev.clinpsy.032408.153621. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Glaser R, Kiecolt-Glaser JK, Marucha PT, MacCallum RC, Laskowski BF, Malarkey WB. Stress-related changes in proinflammatory cytokine production in wounds. Archives of general psychiatry. 1999;56:450–456. doi: 10.1001/archpsyc.56.5.450. [DOI] [PubMed] [Google Scholar]
- Golden-Kreutz DM, Browne MW, Frierson GM, Andersen BL. Assessing stress in cancer patients: a second-order factor analysis model for the Perceived Stress Scale. Assessment. 2004;11:216–223. doi: 10.1177/1073191104267398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- He W, Sengupta M, Velkoff VA, DeBarros KA. 65+ in the United States: US Census Bureau Current Population Reports. US Government Printing Office; Washington, DC: 2005. pp. 23–209. [Google Scholar]
- Hewitt PL, Flett GL, Mosher SW. The Perceived Stress Scale - Factor Structure and Relation to Depression Symptoms in a Psychiatric Sample. J Psychopathol Behav. 1992;14:247–257. [Google Scholar]
- Holmes TH, Rahe RH. The Social Readjustment Rating Scale. Journal of psychosomatic research. 1967;11:213–218. doi: 10.1016/0022-3999(67)90010-4. [DOI] [PubMed] [Google Scholar]
- Hoyle RH. Structural equation modeling : concepts, issues, and applications. Sage Publications; Thousand Oaks: 1995. [Google Scholar]
- Jean-Louis G, Magai C, Cohen C, Zizi F, von Gizycki H, DiPalma J, Casimir G. Ethnic differences in self-reported sleep problems in older adults. SLEEP-NEW YORK. 2001;24:926–936. doi: 10.1093/sleep/24.8.926. [DOI] [PubMed] [Google Scholar]
- Katz MJ, Lipton RB, Hall CB, Zimmerman ME, Sanders AE, Verghese J, Dickson DW, Derby CA. Age-specific and Sex-specific Prevalence and Incidence of Mild Cognitive Impairment, Dementia, and Alzheimer Dementia in Blacks and Whites: A Report From the Einstein Aging Study. Alzheimer disease and associated disorders. 2011 doi: 10.1097/WAD.0b013e31823dbcfc. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kline P. A Psychometrics Primer. Free Association Books; London: 2000. [Google Scholar]
- Kogan JN, Edelstein BA, McKee DR. Assessment of anxiety in older adults: current status. Journal of Anxiety Disorders. 2000;14:109–132. doi: 10.1016/s0887-6185(99)00044-4. [DOI] [PubMed] [Google Scholar]
- Lazarus RS, Folkman S. Stress, appraisal, and coping. Springer Pub. Co.; New York: 1984. [Google Scholar]
- Lee JS, Joo EJ, Choi KS. Perceived Stress and Self-esteem Mediate the Effects of Work-related Stress on Depression. Stress and health : journal of the International Society for the Investigation of Stress. 2012 doi: 10.1002/smi.2428. [DOI] [PubMed] [Google Scholar]
- Leung DY, Lam TH, Chan SS. Three versions of Perceived Stress Scale: validation in a sample of Chinese cardiac patients who smoke. BMC public health. 2010;10:513. doi: 10.1186/1471-2458-10-513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin RA, Kazarian SS, Breiter HJ. Perceived stress, life events, dysfunctional attitudes, and depression in adolescent psychiatric inpatients. J Psychopathol Behav. 1995;17:81–95. [Google Scholar]
- Mitchell AM, Crane PA, Kim Y. Perceived stress in survivors of suicide: Psychometric properties of the Perceived Stress Scale. Research in nursing & health. 2008;31:576–585. doi: 10.1002/nur.20284. [DOI] [PubMed] [Google Scholar]
- Osman A, Kopper BA, Barrios FX, Osman JR, Wade T. The Beck Anxiety Inventory: Reexamination of factor structure and psychometric properties. Journal of Clinical Psychology. 1997;53:7–14. doi: 10.1002/(sici)1097-4679(199701)53:1<7::aid-jclp2>3.0.co;2-s. [DOI] [PubMed] [Google Scholar]
- Pbert L, Doerfler LA, DeCosimo D. An evaluation of the perceived stress scale in two clinical populations. J Psychopathol Behav. 1992;14:363–375. [Google Scholar]
- Rabkin JG, Struening EL. Live events, stress, and illness. Science. 1976;194:1013–1020. doi: 10.1126/science.790570. [DOI] [PubMed] [Google Scholar]
- Ramirez MT, Hernandez RL. Factor structure of the Perceived Stress Scale (PSS) in a sample from Mexico. The Spanish journal of psychology. 2007;10:199–206. doi: 10.1017/s1138741600006466. [DOI] [PubMed] [Google Scholar]
- Remor E. Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS). The Spanish journal of psychology. 2006;9:86–93. doi: 10.1017/s1138741600006004. [DOI] [PubMed] [Google Scholar]
- Roberti JW, Harrington LN, Storch EA. Further Psychometric Support for the 10-Item Version of the Perceived Stress Scale. Journal of College Counseling. 2006;9:135–147. [Google Scholar]
- Roth M, Tomlinson BE, Blessed G. The relationship between quantitative measures of dementia and of degenerative changes in the cerebral grey matter of elderly subjects. Proceedings of the Royal Society of Medicine. 1967;60:254–260. [PMC free article] [PubMed] [Google Scholar]
- Segal DLB, Jay A, Becker, Lee A, Chatman, Carla Effects of emotional expression on adjustment to spousal loss among older adults. Journal of Mental Health and Aging. 1999;5:297–310. [Google Scholar]
- Sharp LK, Kimmel LG, Kee R, Saltoun C, Chang CH. Assessing the Perceived Stress Scale for African American adults with asthma and low literacy. The Journal of asthma : official journal of the Association for the Care of Asthma. 2007;44:311–316. doi: 10.1080/02770900701344165. [DOI] [PubMed] [Google Scholar]
- Sheikh JI, Yesavage JA. Geriatric Depression Scale (GDS): Recent evidence and development of a shorter version, in Clinical Gerontology: A Guide to Assessment and Intervention. The Haworth Press; NY: 1986. pp. 165–173. [Google Scholar]
- Simpson EE, McConville C, Rae G, O'Connor JM, Stewart-Knox BJ, Coudray C, Strain JJ. Salivary cortisol, stress and mood in healthy older adults: the Zenith study. Biological psychology. 2008;78:1–9. doi: 10.1016/j.biopsycho.2007.12.001. [DOI] [PubMed] [Google Scholar]
- van Eck MM, Nicolson NA. Perceived stress and salivary cortisol in daily life. Annals of Behavioral Medicine; Annals of Behavioral Medicine. 1994 [Google Scholar]
- Walters SJ, Munro JF, Brazier JE. Using the SF-36 with older adults: a cross-sectional community-based survey. Age and ageing. 2001;30:337–343. doi: 10.1093/ageing/30.4.337. [DOI] [PubMed] [Google Scholar]
- Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology. 1988;54:1063–1070. doi: 10.1037//0022-3514.54.6.1063. [DOI] [PubMed] [Google Scholar]
- Watson D, Walker LM. The long-term stability and predictive validity of trait measures of affect. Journal of personality and social psychology. 1996;70:567–577. doi: 10.1037//0022-3514.70.3.567. [DOI] [PubMed] [Google Scholar]
- Wechsler D. WMS-R : Wechsler Memory Scale--Revised : manual. Psychological Corp. : Harcourt Brace Jovanovich; San Antonio: 1987. [Google Scholar]
- Wong JG, Cheung EP, Cheung V, Cheung C, Chan MT, Chua SE, McAlonan GM, Tsang KW, Ip MS. Psychological responses to the SARS outbreak in healthcare students in Hong Kong. Medical teacher. 2004;26:657–659. doi: 10.1080/01421590400006572. [DOI] [PubMed] [Google Scholar]
- Wouters E, le Roux Booysen F, Ponnet K, Van Loon FB. Wording Effects and the Factor Structure of the Hospital Anxiety & Depression Scale in HIV/AIDS Patients on Antiretroviral Treatment in South Africa. PloS one. 2012;7:e34881. doi: 10.1371/journal.pone.0034881. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.