Abstract
The Center for Epidemiological Studies Depression Scale (CES-D) is widely used to assess depressive symptoms in the general population. It lacks validation for widespread use within the American Indian population, however. To address this gap, we explored and confirmed the factor structure of the CES-D among a community sample of southeastern American Indian women. We analyzed data from a sample of 150 American Indian women ages 18 to 50 from a southeastern tribe who had complete responses on the CES-D as part of a larger cross-sectional, community-engaged study. We performed exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to assess the measure’s validity. We examined EFA models ranging from one to five factors, with the four-factor structure yielding the best overall model fit (CFI = 1.00, TLI = 0.99, RMSEA = 0.03). Differences between the four-factor EFA-retained structure from our sample and Radloff’s four-factor structure emerged. Only the interpersonal factor was common to both factor structures. Our study findings confirm the validity of the original four-factor structure of the CES-D for younger adult American Indian women in the Southeast. Contrasting findings with the EFA-retained structure, however, provide a more nuanced interpretation of our results.
Keywords: American Indian, depression, factor analysis, validity, women
Depression is a growing public health concern in the United States. Trends in depression prevalence show a significant increase in the US population from 2005 to 2015 (Weinberger et al., 2018). Despite the general consensus that American Indians suffer a disproportionate burden of mental health problems compared to other racial and ethnic groups, few studies have examined the prevalence of depression in this population (Amparo et al., 2011; Asdigian et al., 2018; Gone & Trimble, 2012). American Indians are an extremely diverse population, representing 574 federal and 63 state recognized tribal nations in the United States (National Congress of American Indians, 2020). In one recent national epidemiologic study conducted by Hasin and colleagues (2018), American Indian and Alaska Native adults had the highest 12-month (15.9%) and lifetime (28.2%) prevalence of major depressive disorder—as defined by the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5)—of any racial and ethnic group. In two small community-based samples of American Indians from southeastern U.S. tribes, the prevalence of clinically significant depressive symptomatology ranged from 13.2% to 25% (McKinley et al., 2021; Schure & Goins, 2017). Some studies have revealed gender-related disparities in depressive symptoms, with women experiencing greater severity than men. For example, among American Indians in the Strong Heart Family Study, women had elevated rates of severe depressive symptoms (15.5%) compared to men (7.2%) (Zhao et al., 2016). Because few available published study results rely on population-based measures, estimates of depression prevalence in the American Indian population remain widely unexplored and—due to the immense diversity among tribal nations—have limited generalizability.
One of the most widely used, generalizable, population-based measures of depressive symptoms is the Center for Epidemiological Studies Depression Scale (CES-D). Although the CES-D is a well-established measure of the frequency of depressive symptoms in the general population (Radloff, 1977), its validation for use with American Indians remains inadequate (Gray et al., 2019; Schure & Goins, 2017). Only a few studies have assessed the validity of the CES-D in American Indian adults, and most focus on older adults or elders (Barbosa-Leiker et al., 2021; Gray et al., 2019, Schure & Goins, 2017; Somervell et al., 1993). In one recent study, Gray and colleagues (2019) reported construct and convergent validity of the CES-D in a sample of 473 Northern Plains Indians aged ≥ 18 years. The CES-D showed strong to moderate correlations with the Beck Depression Inventory-II (BDI-II), Tri-Ethnic Depression Scale (TEDS), Beck Hopelessness Scale (BHS), and SCL-90-R depression measures. In another study by Schure & Goins (2017), the CES-D demonstrated concurrent and divergent validity in a sample of 491 older (≥55 years) community-dwelling American Indians residing in the southeast. The CES-D was directly correlated with chronic pain and physical disability and indirectly correlated with social support and self-efficacy in this population.
Findings from a meta-analysis support the stability of the four-factor structure (i.e., depressed affect, positive affect, somatic symptoms, and interpersonal conflict) (Radloff, 1977) of the CES-D and congruence of structures across diverse racial and ethnic groups. These findings are inconsistent in minority populations, however, including American Indians (Kim et al., 2011; Schure & Goins, 2017). In examining the CES-D factor structure, Schure and Goins (2017) determined a two-factor solution—with 16 of the 20 items loading onto factor 1 (depressed affect) and three items loading onto factor 2 (positive affect)—to be the best fit model in their sample. In contrast, Barbosa-Leiker et al. (2021) found that the 20-item CES-D demonstrated poor model fit in their study of American Indian elders from the Northern Plains, Southern Plains, and Southwest. Instead, a three-factor model (i.e., depressed affect, somatic symptoms, and wellbeing) of the 12-item CES-D demonstrated the most valid factor structure. Wide variations in the factor structure across these samples warrant further investigations.
Insufficient exploration of the CES-D’s validity in American Indians is problematic given the cultural diversity among tribal groups. Consequently, depression measures may have limited construct validity, meaning the CES-D may not be as appropriate for this population since it was developed and normed with predominately White samples. Establishing the validity of the CES-D is further complicated by unique sociohistorical stressors among various American Indian tribes and age groups, which may cause varied expressions of depression (Brave Heart, 2003; Burnette et al., 2019; Tucker et al., 2016). Furthermore, the gendered experience of depression has not been well characterized in the American Indian population. Of the recent studies measuring depression, only one stratified their results by gender and found that women American Indian elders had higher levels on the depressed affect and somatic symptoms subscales than men American Indian elders (Barbosa-Leiker et al., 2021; Gray et al., 2019; Schure & Goins, 2017). Therefore, American Indian women may have psychological processes that manifest in ways researchers are not currently capturing. Reported variation in the conceptualization and expression of depression within other racial and ethnic populations underscores the scope of the problem in accurately measuring depressive symptoms in American Indians (Kim et al., 2011; Torres, 2012). Insufficient evidence on the CES-D’s validity and the gendered depression experience in the American Indian population necessitates examining the factors of depression in American Indian women, a population at high risk of mental health conditions. Although some studies have examined the construct validity of the CES-D in American Indians—reporting two to three factors as the most valid factor structure—these studies focused mainly on older adults and heterogeneous samples, leaving younger (<50 years) American Indian women understudied. Thus, in this study, the researchers aimed to explore and confirm the CES-D’s factor structure with a community sample of younger adult American Indian women in the southeast.
Methods
Data Source
We used data collected from the Hazardous Air Pollutants, Positivity, and Inflammation (HAPPI) study, a cross-sectional, community-engaged study conducted between 2018 and 2019 (Brooks et al., 2019). The goal of the HAPPI study was to explore whether positive psychological states buffer the cardiovascular-associated inflammatory effects of ambient air pollution in American Indian women residing in the southeastern United States. Briefly, we collected demographic, psychological, biological, and physical health data. For this secondary analysis, we included baseline data from a sample of 150 American Indian women ages 18–50 from a southeastern tribe who had complete responses on the CES-D. Minimum sample size recommendations for conducting factor analyses vary widely and generally lie within two categories—absolute numbers and ratios. The rule of thumb for minimum Ns in absolute numbers range from 100 to 500 (Kyriazos, 2018). Others rely on the ratio of participants (N) to variables (p), also known as the N:p ratio. The suggested N:p ratio ranges from 5 (with a minimum N > 100) to 10 participants per variable. Based on these criteria, our study met the recommended minimum sample size considered adequate to perform factor analyses.
Procedures
In the HAPPI study, we used convenience sampling methods to recruit a community sample of American Indian women ages 18 to 50 residing in southeastern North Carolina (Brooks et al., 2019). We recruited through various means, including flyer advertisements, direct contact, word of mouth, and community events, such as a health fair sponsored by a local academic institution. Women who expressed interest in the survey contacted the study personnel for informed consent and the completion of anonymous self-administered surveys and in-person study visits. Additional information regarding the data collection procedure is detailed elsewhere (Brooks et al., 2019). Participants completing the study received a $50 gift card. All study procedures were reviewed and approved by the tribal health board, Tribal Council, and the Institutional Review Boards at the University of North Carolina at Chapel Hill and local community healthcare organization.
Measures
Depressive Symptoms (CES-D, 20-item)
We administered the 20-item version of the CES-D, a self-report screening tool used to measure depressive symptoms in the general population, to eligible women (Radloff, 1977). Item responses range from (0) rarely or none of the time to (3) most or all of the time. Item scores are summed after reverse coding the four positively worded items (e.g., “I was happy”). Possible scores range from 0 to 60, with higher scores signifying a higher frequency of depressive symptoms. Risk for clinical depression, indicated by a typical cutoff score of ≥16, has high sensitivity (.87) and moderate specificity (.70); however, cut points vary by population (Vilagut et al., 2016).
Demographics
Demographic characteristics in these analyses included age, level of education (e.g., some high school, high school, some college, etc.), employment status, and household income.
Analysis
We used STATA v. 15 to conduct a descriptive analysis of the data (i.e., means, standard deviations, and item-to-total correlations). We conducted two tests to determine feasibility of the factor analysis approach, a Kaiser-Meyer-Olkin (KMO) test and a Bartletts’ test for sphericity (StataCorp, 2017). A KMO index value of 0.50 or higher and a significant (p<0.05) Bartlett’s test indicate that the data was suitable for factor analyses (Williams et al., 2010).
Due to inconsistent factor structure findings and limited investigations among American Indian women in the existing literature, we used Mplus version 8.0 (Muthén & Muthén, 2019) to perform exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). We tested four factor models—ranging from one factor to five factors—using direct oblimin rotation to determine the appropriate number of correlated factors to retain. Model fit was evaluated using criteria described by DeVellis (2016), which includes the evaluation of eigenvalues greater than one. Additionally, we evaluated communalities (h2), with values of 0.4 or higher indicating acceptable variance with other items in the scale or factor (Costello and Osborne, 2005). We used the highest factor loadings for each CES-D item to signal the primary factor where the item would be retained for the confirmatory analyses. Finally, we tested the original four-factor CES-D structure as determined by Radloff (1977).
Model fit was assessed using a weighted least square mean and variance adjusted estimator (WLSMV) to account for the categorical response items of the 20-item CES-D. Acceptable goodness of fit indices was based on cutoff values previously specified (Hu and Bentler, 1999), including the chi-square, comparative fit index (CFI ≥ 0.95), Tucker-Lewis index (TLI ≥ 0.95), and Root Mean Squared Error of Approximation (RMSEA ≤ 0.06).
Results
Descriptive Statistics
This study’s sample included demographic and CES-D data from 150 American Indian women ages 18 to 50, with a mean age of 36.5 years (SD = 10.2). Table 1 includes demographic information for this sample. Most participants were currently employed (55.7%). Approximately 33% of women had earned a college or graduate degree. About 40% of participants reported an annual household income of > $35K.
Table 1.
Demographics (n = 150)
| Demographic Measure | Mean | SD | Frequency | Percent |
|---|---|---|---|---|
|
| ||||
| Age (in years) | 36.5 | 10.2 | ||
| Employment status | ||||
| Currently employed | 83 | 55.7 | ||
| Unemployed | 66 | 44.3 | ||
| Highest level of education completed | ||||
| Less than high school | 1 | 0.67 | ||
| High school or equivalent | 39 | 26.2 | ||
| Some college, but no degree | 60 | 40.3 | ||
| College (Associate/Bachelor’s degree) | 30 | 20.1 | ||
| Graduate (Master’s/Professional/Doctoral degree) | 19 | 12.8 | ||
| Annual income | ||||
| <$35k | 82 | 55.0 | ||
| $35.1 – 50k | 18 | 12.1 | ||
| $50.1 – 75k | 22 | 14.8 | ||
| >75.k | 20 | 13.4 | ||
Sample Means, Standard Deviations, and Item-to-Total Correlations of the CES-D
Table 2 presents the means, standard deviations, and item-to-total correlations (ITCs) for each CES-D item in our study sample. Mean CES-D item responses ranged from 0.33 (SD = 0.62 – “I felt like people dislike me”) to 1.52 (SD = 1.13 – “I felt everything I did was an effort”). Reliability analysis of the CES-D resulted in a Cronbach’s alpha of 0.91, indicating adequate internal consistency reliability. As listed in Table 2, the items generally showed very good discrimination, with ITCs exceeding acceptable standards (r > 0.30; Hajjar, 2018) on all except two items (“I felt that I was just as good as other people” and “I felt everything I did was an effort”).
Table 2.
CES-D Sample Means, Standard Deviations, and Item-to-Total Correlations
| Scale Item | Mean | Standard Deviation (SD) |
Item-to-Total Correlations | |
|---|---|---|---|---|
|
| ||||
| Depressed | ||||
| 3 | Blues | 0.57 | 0.83 | 0.65 |
| 6 | Depressed | 0.66 | 0.92 | 0.76 |
| 9 | Failure | 0.35 | 0.67 | 0.73 |
| 10 | Fearful | 0.38 | 0.63 | 0.57 |
| 14 | Lonely | 0.51 | 0.84 | 0.69 |
| 17 | Cry | 0.42 | 0.72 | 0.69 |
| 18 | Sad | 0.62 | 0.78 | 0.76 |
| Somatic | ||||
| 1 | Bothered | 0.60 | 0.78 | 0.53 |
| 2 | Appetite | 0.59 | 0.82 | 0.65 |
| 5 | Mind | 0.79 | 0.92 | 0.66 |
| 7 | Effort | 1.52 | 1.13 | 0.02 |
| 11 | Sleep | 1.06 | 1.04 | 0.46 |
| 13 | Talk | 0.54 | 0.77 | 0.51 |
| 20 | Get Going | 0.62 | 0.83 | 0.74 |
| Positive | ||||
| 4 | Good | 1.10 | 1.10 | 0.20 |
| 8 | Hopeful | 0.93 | 0.97 | 0.45 |
| 12 | Happy | 0.73 | 0.85 | 0.61 |
| 16 | Enjoy | 0.62 | 0.82 | 0.60 |
| Interpersonal | ||||
| 15 | Unfriendly | 0.47 | 0.74 | 0.59 |
| 19 | Dislike | 0.33 | 0.62 | 0.61 |
Note. CES-D = Center for Epidemiologic Studies Depression Scale.
EFA Results
The KMO index of the overall scale was 0.91, and the Bartlett test yielded a significant result (X2=1506.17, df=190, p<0.001), which signaled adequacy for the subsequent factor analyses. We tested five exploratory factor models to determine the optimal fit for our confirmatory testing. The one-factor and two-factor EFA models yielded the poorest overall model fit (1-factor: CFI = 0.94, TLI = 0.94, RMSEA = 0.08; 2-factor CFI = 0.98, TLI = 0.97, RMSEA = 0.05). The three- and four-factor model yielded model fit closer to our predetermined standards described by Hu and Bentler (1999), (3-factor: CFI = 0.99, TLI = 0.98, RMSEA = 0.05; 4-factor CFI = 1.00, TLI = 0.99, RMSEA = 0.03). Finally, our five-factor exploratory solution also yielded good model fit (CFI = 1.00, TLI = 1.00, RMSEA = 0.02) but was not selected for further confirmatory analyses due to its eigenvalue (0.85), which falls below the optimal EFA fit criteria retention of the value one (DeVellis, 2016). Thus, we selected the four-factor model for subsequent confirmatory analyses in accordance with model fit and alignment with eigenvalue criteria.
The four-factor solution accounted for 61.1% of the variance in the overall CES-D. The eigenvalues were 10.40, 1.73, 1.10, and 0.98 for the first four factors. Direct oblimin rotated factor loadings for the four-factor EFA model are illustrated in Table 3. For the four-factor model, factor 1 comprised four items (bothered, mind, failure, sleep), factor 2 contained eight items (appetite, blues, depressed, effort, lonely, cry, sad, and get going), factor 3 included six items (good, hopeful, fearful, happy, talk, enjoy), and factor 4 had two items (unfriendly, dislike).
Table 3.
Exploratory Factor Analysis, 4-Factor Structure of the Full 20-Item CES-D (n = 149)
| Factors | |||||
|---|---|---|---|---|---|
|
|
|||||
| Scale Items | 1 | 2 | 3 | 4 | |
| 1 | I was bothered by things that usually don’t bother me | 0.590* | 0.110 | −0.019 | 0.151 |
| 2 | I didn’t feel like eating; my appetite was poor | 0.295 | 0.427* | 0.087 | 0.122 |
| 3 | I felt that I could not shake off the blues even with help from my family or friends | 0.217 | 0.674* | −0.023 | 0.016 |
| 4 | I felt that I was as good as other people | −0.230 | −0.168 | 0.516* | 0.382* |
| 5 | I had trouble keeping my mind on what I was doing | 0.798* | −0.019 | 0.115 | 0.117 |
| 6 | I felt depressed | 0.172 | 0.855* | 0.078 | −0.216* |
| 7 | I felt everything I did was an effort | 0.023 | 0.323* | −0.243 | −0.161 |
| 8 | I felt hopeful about the future | −0.032 | 0.007 | 0.786* | −0.041 |
| 9 | I thought my life had been a failure | 0.475* | 0.099 | 0.456* | 0.100 |
| 10 | I felt fearful | 0.326* | 0.200 | 0.346* | −0.009 |
| 11 | My sleep was restless | 0.458* | 0.243 | −0.064 | −0.016 |
| 12 | I was happy | 0.032 | 0.115 | 0.804* | −0.005 |
| 13 | I talked less than usual | 0.262 | 0.283 | 0.239* | −0.047 |
| 14 | I felt lonely | −0.008 | 0.660* | 0.121 | 0.197* |
| 15 | People were unfriendly | 0.221 | 0.171 | −0.007 | 0.664* |
| 16 | I enjoyed life | 0.120 | 0.085 | 0.724* | −0.019 |
| 17 | I had crying spells | −0.092 | 0.880* | −0.003 | 0.175 |
| 18 | I felt sad | −0.009 | 0.838* | 0.121 | 0.112 |
| 19 | I felt that people dislike me | 0.173 | 0.215 | 0.082 | 0.642* |
| 20 | I could not get “going” | 0.375 | 0.431* | 0.079 | 0.162 |
Note. CES-D = Center for Epidemiologic Studies Depression Scale
= significant at p<0.05.
CFA Results and Factor Loadings
Based on the results of the EFA, we ran four-factor confirmatory analyses to assess model fit. Additionally, we tested the original four-factor structure proposed by Radloff (1977). Table 4 summarizes fit indices of our confirmed models. The four-factor EFA-retained model yielded acceptable model fit as demonstrated by model fit indices (WLSMV χ2 = 239.37, CFI = 0.98, TLI = 0.97, RMSEA = 0.06, 90% CI: 0.04–0.07). The four-factor Radloff model yielded a slightly improved model fit (WLSMV χ2 = 225.17, CFI = 0.98, TLI = 0.98, RMSEA = 0.05, 90% CI: 0.05–0.08). Figure 1 illustrates the final measurement models of the four-factor EFA-retained model and the original Radloff factor configuration. In the EFA-retained model, factors 1–3 corresponded to distracted thoughts, sadness, and mixed affect; factor 4—equivalent to Radloff’s fourth factor—corresponded to interpersonal conflict.
Table 4.
Confirmatory Factor Analysis Fit Statistics for the CES-D (n = 149)
| Comparison of Factor Models | ||||||
|---|---|---|---|---|---|---|
|
|
||||||
| Model | χ 2 | df | χ2 p value | CFI | TLI | RMSEA (90% CI) |
|
|
||||||
| 4-Factor Model (EFA-retained) | 239.37 | 164 | <0.001 | 0.98 | 0.97 | 0.06 (0.04–0.07) |
| 4-Factor Model (Radloff) | 225.17 | 164 | <0.001 | 0.98 | 0.98 | 0.05 (0.05–0.08) |
Note. CES-D = Center for Epidemiologic Studies Depression Scale; CFI = Comparative Fit Index; TLI = Tucker-Lewis Index; RMSEA = Root Mean Squared Error Approximation; Confidence Interval.
Figure 1.
Measurement Model of Four-Factor Solutions of (a) EFA-retained model and (b) original Radloff four-factor solution (n = 149)
Note. # = non-significant at p<0.05; * = reverse-coded items.
Discussion
To our knowledge, this study was the first to assess the factor structure of the CES-D using EFA and CFA with a community sample of younger American Indian women from the southeast. The four-factor structure derived from Radloff’s original four-factor configuration demonstrated the best model fit of the CES-D in our sample. This finding differs from previous studies reporting a two-factor (Schure & Goins, 2017) or three-factor (Barbosa-Leiker et al., 2021) solution as the best fitting models in samples of older American Indians. The contrast in model fit—a four-factor versus two- or three-factor structure—could reflect not only the heterogeneity in gender but also the cultural diversity among tribal groups. Indeed, studies using heterogeneous samples of racial and ethnic minorities show that the CES-D may differ by key characteristics of within-group populations, such as nationality, tribe, and gender (Adams et al., 2020; Goodwill, 2020; Rivera-Medina et al., 2010; Torres, 2012). Most of this research, however, has focused on people of African descent. Our study offers important parallel conclusions to the variations in CES-D construct validity among American Indian women residing in the Southeast region of the United States.
Differences between the four-factor EFA-retained structure from our sample and Radloff’s (1977) four-factor structure also emerged. Compared to Radloff’s original four-factor structure of the CES-D, we found different factor loadings for the “fearful,” “failure,” “talk,” “appetite,” and “effort” items. Notably, rather than into domains related to negative affect and somatic factors, these items were dispersed onto three factors characterized by distracted thoughts, sadness, and mixed affect. Additionally, the interpersonal factor domain was consistent across factor solutions, containing two items: “I felt that people dislike me” and “people were unfriendly.” As noted by Kim et al. (2011), the different factor configurations may be due, in part, to the underlying assumptions of the exploratory compared to confirmatory approaches. EFAs are primarily data-driven, while a priori hypotheses and researcher-imposed models guide CFAs. These important differences may inform our findings and demonstrate the importance of considering a wider variety of confirmatory models when testing the construct validity of measures among racial and ethnic minority samples. Additionally, in the case of measuring mental health outcomes, there may be no equivalent concepts of depression across cultures.
We offer several rationales to potentially explain our study findings. First, of the studies that have examined the CES-D factor structure, few have compared the more data-driven EFA-retained structures with the original, hypothesized Radloff configuration. Consequently, published research may skew towards presenting more uniform findings (e.g., publication bias) that support the original four-factor structure instead of allowing the data to drive a new configuration. Next, consistent with several other CES-D validation studies, racial and ethnic minority women experiencing depression may present differently than their White counterparts. Indeed, a recent systematic review illustrates that African American and Latina/Hispanic women were more likely to report physical symptoms associated with depression than their White counterparts (Lara-Cinisomo et al., 2020). In contrast, one study concluded that there was no significant difference in somatization between American Indian and Alaska Native women and other racial and ethnic groups (Uebelacker et al., 2009). In a separate study, Makambi et al. (2009) evaluated the factor structure of the CES-D in a subset of US Black women enrolled in a large prospective cohort study—the Black Women’s Health Study. Compared to their sample of healthy Black women, American Indian women in our sample had higher mean scores on all CES-D items except three (i.e., fearful, lonely, and talk). Moreover, we found incongruencies in factor loadings of the “fearful” and “talk” items across the two samples. Thus, American Indian women appear to present with more severe and culturally nuanced somatization of depressive symptoms than Black women. Divergences in symptom severity and factor loadings across these two racial and ethnic groups suggest that women’s experiences of depression reflect conceptualizations and expressions unique to their culture. Inferences drawn from this comparison must also consider the mean age difference (36.5 years, SD = 10.2 versus 53.8 years, SD = 9.7) between the American Indian and Black women in these samples since middle-aged adults generally report lower scores on the CES-D than young adults (Johnson et al., 2008). Given the mixed evidence, additional studies are needed to clarify the cause-effect relationship, namely, whether (a) cultural presentations of depression include more somatization or (b) if depression causes more somatization among racial and ethnic minority women.
Additionally, Lewis and colleagues (2015) elaborate that the two interpersonal items in the CES-D measure (“I felt that people dislike me” and “people were unfriendly”) may identify feelings of discrimination rather than clinically relevant symptoms of major depressive disorder, particularly among racial and ethnic minorities. Other researchers’ findings corroborate the importance of considering social influences and their role in shaping depressive symptoms among American Indians (Dinges & Duong-Tran, 1992). For American Indians, studies show that family closeness and, more broadly, connection to tribal culture are unique cultural factors that may be protective against depressed mood and other negative emotions (Hodge et al., 2009; Martin & Yurkovich, 2014). Family systems theory, which posits that families are relationally and emotionally interconnected, may be applied in future research to provide critical insights into the connection between tribal communities, families, and mental wellbeing among American Indians (Brown, 1999; Morgaine, 2001). Inversely, the endorsement of interpersonal conflict in the CES-D among American Indians may reflect disrupted relational ties within their family or community. Further research should consider disentangling these potential explanations by employing more robust longitudinal designs to examine the temporal sequence between disrupted relational ties among family members within tribal communities, discriminatory experiences, somatic presentations, and depressive symptoms.
Finally, we found that the “effort” item in our EFA-retained confirmatory model was nonsignificant; additionally, its factor loading was lower than the remaining CES-D items (i.e., 0.03 versus 0.33–0.94). Our findings are consistent with previous research in diverse populations (Adams et al., 2019; Brooks et al., 2022; Kim et al., 2011) and may imply that a single-item measure of effort demonstrates diminished reliability and validity due to its convergence with other multidimensional concepts of strain. Several qualitative studies affirm the interconnectedness of strain and negative emotions is a complex experience that may explain its inconsistency in the CES-D (Christiansen et al., 2019; Walls et al., 2007). Of the studies focused on the strain-emotion relationship among American Indian populations, most have highlighted its influence on suicide outcomes (Ivanich & Teasdale, 2018; LaFromboise & Malik, 2016; Walls et al., 2007; Yang et al., 2018). More research is needed to clarify how strain influences the expression of depressed mood among American Indians.
Limitations
The limitations of our study include the generalizability of findings, small sample size, lack of a separate confirmatory dataset, and minimal clinical implications. First, we based our findings on a gender-homogenous study sample within one tribal group. Thus, we caution against broad applicability to other diverse tribal populations across the United States. Next, the small sample size may have influenced the interpretation of our model fit indices, mainly the chi-square fit criteria, which is most sensitive to sample size. To reduce interpretative bias from a small sample size, we included relative and absolute measures of model fit that are considered less sensitive to sample size. It is also important to note that our sample size is comparable to samples in other studies. Another limitation was our inability to confirm the factor structure using a different dataset. Given our sample size of 150, splitting the sample would not make it viable for a separate confirmatory dataset based on the sample size parameters detailed in Kyriazos (2018). Finally, the CES-D is a population-based measure of depressive symptoms rather than a clinical diagnostic tool, which limits our ability to consider clinical implications. Apart from the mentioned limitations, our study contributes important findings on the construct validity of the CES-D among American Indian women. To our knowledge, this is the first study to explore and confirm the CES-D factor structure in a gender-homogenous sample of younger American Indian women. Findings from our study provide evidence on the measurement of depression from a population-based perspective; however, future studies should also focus on validating tools that are more appropriate for clinical diagnoses, such as the Patient Health Questionnaire (PHQ-9) and Composite International Diagnostic Interview (CIDI).
Conclusion
Our study confirms that the four-factor structure of the CES-D is the best model fit for our community sample of American Indian women. Future studies should examine the validity of the CES-D for measuring depressive symptoms in other tribal groups and gender-homogenous study samples. Consistent with other studies, a single-item measuring effort may not align consistently with other items in the CES-D. Researchers should consider whether effort or strain is conceptually distinct from depression, particularly among historically marginalized populations. Our study builds on extant research showing the original four-factor structure of the CES-D is well-suited for American Indians. Still, contrasting the Radloff structure with our EFA-retained structure provides an alternative interpretation. Applying our findings to clinical settings, the divergence between our EFA-retained model and the original Radloff four-factor structure may imply that providers should not rely on summary scores but rather on the symptom structure expressed by the individual.
Funding Information
This work was supported by the National Institute of Environmental Health Science (NIEHS), National Institutes of Health (NIH), through Grant Award Number K23ES027026; National Heart, Lung, and Blood Institute (NHLBI), National Institutes of Health, through Grant Award Number K24HL105493; National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number UL1TR002489; and U.S. Environmental Protection Agency (EPA) Assistance Agreement 83578501. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or EPA.
Footnotes
Conflicts of Interests
The authors declare that there is no conflict of interest that could be perceived as prejudicing the impartiality of the research reported.
References
- Adams LB, Farrell M, Mall S, Mahlalela N, & Berkman L. (2020). Dimensionality and differential item endorsement of depressive symptoms among aging Black populations in South Africa: Findings from the HAALSI study. Journal of Affective Disorders, 277, 850–856. 10.1016/j.jad.2020.08.073 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Adams LB, Gottfredson N, Lightfoot AF, Corbie-Smith G, Golin C, & Powell W. (2019). Factor analysis of the CES-D 12 among a community sample of Black men. American Journal of Men’s Health, 13(2),1557988319834105. 10.1177/1557988319834105 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Amparo P, Farr SL, & Dietz PM (2011). Chronic disease risk factors among American Indian/Alaska Native women of reproductive age. Preventing Chronic Disease, 8(6), A118. [PMC free article] [PubMed] [Google Scholar]
- Asdigian NL, Bear UR, Beals J, Manson SM, & Kaufman CE (2018). Mental health burden in a national sample of American Indian and Alaska Native adults: Differences between multiple-race and single-race subgroups. Social Psychiatry and Psychiatric Epidemiology, 53(5), 521–530. 10.1007/s00127-018-1494-1 [DOI] [PubMed] [Google Scholar]
- Barbosa-Leiker C, Burduli E, Arias-Losado R, Muller C, Noonan C, Suchy-Dicey A, Nelson L, Verney SP, Montine TJ, & Buchwald D. (2021). Gender differences in the assessment of depression in American Indian older adults: The Strong Heart Study. Psychological Assessment, 33(6), 574–579. 10.1037/pas0001024 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brave Heart MY (2003). The historical trauma response among natives and its relationship with substance abuse: A Lakota illustration. Journal of Psychoactive Drugs, 35(1), 7–13. 10.1080/02791072.2003.10399988 [DOI] [PubMed] [Google Scholar]
- Brooks JL, Berry DC, Currin EG, Ledford A, Knafl GJ, Fredrickson BL, Beeber LS, HAPPI Community Partnership Committee, Peden DB, & Corbie-Smith GM (2019). A community-engaged approach to investigate cardiovascular-associated inflammation among American Indian women: A research protocol. Research in Nursing & Health, 42(3), 165–175. 10.1002/nur.21944 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brooks JL, Knafl GJ, Adams LB, Woods-Giscombé CL, Berry DC, Currin EG, & Corbie-Smith GM (2022). Methodological considerations in scale refinement with diverse populations: A case example using the CES-D with a community sample of American Indian women. Issues in Mental Health Nursing, 43(8), 776–783. 10.1080/01612840.2022.2053012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown J. (1999). Bowen family systems theory and practice: Illustration and critique. Australian and New Zealand Journal of Family Therapy, 20, 94–103. 10.1002/j.1467-8438.1999.tb00363.x [DOI] [Google Scholar]
- Burnette CE, Roh S, Liddell J, & Lee YS (2019). American Indian women cancer survivors’ coping with depressive symptoms. Journal of Psychosocial Oncology, 37(4), 494–508. 10.1080/07347332.2018.1525467 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Christiansen K, Gadhoke P, Pardilla M, & Gittelsohn J. (2019). Work, worksites, and wellbeing among North American Indian women: A qualitative study. Ethnicity & Health, 24(1), 24–43. 10.1080/13557858.2017.1313964 [DOI] [PubMed] [Google Scholar]
- Costello AB, & Osborne JW (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, & Evaluation, 10, 1–9. 10.7275/JYJ1-4868. [DOI] [Google Scholar]
- Devillis RF (2016). Scale development: Theory and applications (4th ed.). Thousand Oaks, CA: Sage. [Google Scholar]
- Dinges NG, & Duong-Tran Q. (1992). Stressful life events and co-occurring depression, substance abuse and suicidality among American Indian and Alaska Native adolescents. Culture, Medicine and Psychiatry, 16(4), 487–502. 10.1007/BF00053589 [DOI] [PubMed] [Google Scholar]
- Gone JP, & Trimble JE (2012). American Indian and Alaska Native mental health: Diverse perspectives on enduring disparities. Annual Review of Clinical Psychology, 8, 131–160. 10.1146/annurev-clinpsy-032511-143127 [DOI] [PubMed] [Google Scholar]
- Goodwill JR (2020). Testing for measurement invariance across gender in the 12-item CES-D: An investigation among a nationally representative sample of African Americans. Cultural Diversity and Ethnic Minority Psychology. 10.1037/cdp0000409 [DOI] [PubMed] [Google Scholar]
- Gray JS, Brionez J, Petros T, & Gonzaga KT (2019). Psychometric evaluation of depression measures with Northern Plains Indians. American Journal of Orthopsychiatry, 89(4), 534–541. 10.1037/ort0000309 [DOI] [PubMed] [Google Scholar]
- Hajjar SE (2018). Statistical analysis: Internal-consistency reliability and construct validity. International Journal of Quantitative and Qualitative Research Methods, 6(1), 27–38. [Google Scholar]
- Hasin DS, Sarvet AL, Meyers JL, Saha TD, Ruan WJ, Stohl M, & Grant BF (2018). Epidemiology of adult DSM-5 major depressive disorder and its specifiers in the United States. JAMA Psychiatry, 75(4), 336–346. 10.1001/jamapsychiatry.2017.4602 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hodge D, Limb G, Cross T. (2009). Moving from colonization toward balance and harmony: A Native American perspective on wellness. Social Work, 54, 211–219. 10.1093/sw/54.3.211 [DOI] [PubMed] [Google Scholar]
- Hu LT, & Bentler PM (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. 10.1080/10705519909540118 [DOI] [Google Scholar]
- Ivanich J, & Teasdale B. (2018). Suicide ideation among adolescent American Indians: An application of general strain theory. Deviant Behavior, 39(6), 702–715 10.1080/01639625.2017.1304799 [DOI] [Google Scholar]
- Johnson CS, Mcleod PJ, Sharpe D, & Johnston EM (2008). Differences among core dimensions of the Centre for Epidemiological Studies Depression (CES-D) Scale across age and gender groups. Canadian Journal of Community Mental Health, 27(1), 79–91. 10.7870/cjcmh-2008-0006. [DOI] [Google Scholar]
- Kim G, Decoster J, Huang CH, & Chiriboga DA (2011). Race/ethnicity and the factor structure of the Center for Epidemiologic Studies Depression Scale: A meta-analysis. Culture Diversity Ethnic Minority Psychology, 17(4), 381–396. 10.1037/a0025434 [DOI] [PubMed] [Google Scholar]
- Kyriazos TA (2018). Applied psychometrics: Sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology, 9, 2207–2230. 10.4236/psych.2018.98126 [DOI] [Google Scholar]
- LaFromboise TD, & Malik SS (2016). A culturally informed approach to American Indian/Alaska Native youth suicide prevention. In Zane N, Bernal G, & Leong FTL (Eds.), Cultural, racial, and ethnic psychology book series. Evidence-based psychological practice with ethnic minorities: Culturally informed research and clinical strategies (p. 223–245). American Psychological Association. 10.1037/14940-011 [DOI] [Google Scholar]
- Lara-Cinisomo S, Akinbode TD, & Wood J. (2020). A systematic review of somatic symptoms in women with depression or depressive symptoms: Do race or ethnicity matter? Journal of Women’s Health, 29(10), 1273–1282. 10.1089/jwh.2019.7975 [DOI] [PubMed] [Google Scholar]
- Lewis TT, Cogburn CD, & Williams DR (2015). Self-reported experiences of discrimination and health: Scientific advances, ongoing controversies, and emerging issues. Annual Review of Clinical Psychology, 11, 407–440. 10.1146/annurev-clinpsy-032814-112728 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Makambi KH, Williams CD, Taylor TR, Rosenberg L, & Adams-Campbell LL (2009). An assessment of the CES-D scale factor structure in black women: The Black Women’s Health Study. Psychiatry Research, 168(2), 163–170. 10.1016/j.psychres.2008.04.022 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Manson SM, Shore JH, & Bloom JD (1985). The depressive experience in American Indian communities: A challenge for psychiatric theory and diagnosis. In Kleinman A. & Good B. (Eds.), Culture and Depression: Studies in the Anthropology and Cross-Cultural Psychiatry of Affect and Disorder (pp. 331–368). University of California Press. [Google Scholar]
- Martin D, Yurkovich E. (2014). “Close-knit” defines a healthy Native American, Indian family. Journal of Family Nursing, 20, 51–72. 10.1177/1074840713508604 [DOI] [PubMed] [Google Scholar]
- McKinley CE, Boel-Studt S, Renner LM, & Figley CR (2021). Risk and protective factors for symptoms of depression and anxiety among American Indians: Understanding the roles of resilience and trauma. Psychological Trauma: Theory, Research, Practice, and Policy, 13(1), 16–25. 10.1037/tra0000950 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morgaine C. (2001). Family Systems Theory CFS 410U. web.pdx.edu/~cbcm/CFS410U/ FamilySystemsTheory.pdf [Google Scholar]
- Muthén LK, & Muthén B. (2019). Mplus. The Comprehensive Modelling Program for Applied Researchers: User’s Guide, 5. [Google Scholar]
- National Congress of American Indians (2020). Tribal Nations and the United States: An Introduction. Washington, D.C., February 2020. [Google Scholar]
- Power T, Wilson D, Best O, Brockie T, Bourque Bearskin L, Millender E, & Lowe J. (2020). COVID-19 and Indigenous Peoples: An imperative for action. Journal of Clinical Nursing, 29(15–16), 2737–2741. 10.1111/jocn.15320 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Radloff LS (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. 10.1177/014662167700100306 [DOI] [Google Scholar]
- Rivera-Medina CL, Caraballo JN, Rodríguez-Cordero ER, Bernal G, & Dávila-Marrero E. (2010). Factor structure of the CES-D and measurement invariance across gender for low-income Puerto Ricans in a probability sample. Journal of Consulting and Clinical Psychology, 78(3), 398. 10.1037/a0019054 [DOI] [PubMed] [Google Scholar]
- Schure M, & Goins RT (2017). Psychometric examination of the Center for Epidemiologic Studies Depression scale with older American Indians: The Native Elder Care Study. American Indian Alaska Native Mental Health Research, 24(3), 1–17. 10.5820/aian.2403.2017.1 [DOI] [PubMed] [Google Scholar]
- Somervell PD, Beals J, Kinzie JD, Boehnlein J, Leung P, & Manson SM (1993). Use of the CES-D in an American Indian village. Culture, Medicine and Psychiatry, 16, 503–517. 10.1007/BF00053590 [DOI] [PubMed] [Google Scholar]
- StataCorp. (2017). Stata Statistical Software: Release 15. StataCorp LLC. [Google Scholar]
- Torres E. (2012). Psychometric properties of the Center for Epidemiologic Studies Depression Scale in African American and Black Caribbean US adults. Issues in Mental Health Nursing, 33(10), 687–696. 10.3109/01612840.2012.697534 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tucker RP, Wingate LR, & O’Keefe VM (2016). Historical loss thinking and symptoms of depression are influenced by ethnic experience in American Indian college students. Culture Diversity Ethnic Minority Psychology, 22(3), 350–358. 10.1037/cdp0000055 [DOI] [PubMed] [Google Scholar]
- Uebelacker LA, Strong D, Weinstock LM, & Miller IW (2009). Use of item response theory to understand differential functioning of DSM-IV major depression symptoms by race, ethnicity and gender. Psychological Medicine, 39(4), 591. 10.1017/S0033291708003875 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vilagut G, Forero CG, Barbaglia G, & Alonso J. (2016). Screening for depression in the general population with the Center for Epidemiologic Studies Depression (CES-D): A systematic review with meta-analysis. PloS One, 11(5), e0155431. 10.1371/journal.pone.0155431 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walls ML, Chapple CL, & Johnson KD (2007). Strain, emotion, and suicide among American Indian youth. Deviant Behavior, 28(3), 219–246. 10.1080/01639620701233100 [DOI] [Google Scholar]
- Weinberger A, Gbedemah M, Martinez A, Nash D, Galea S, & Goodwin R. (2018). Trends in depression prevalence in the USA from 2005 to 2015: Widening disparities in vulnerable groups. Psychological Medicine, 48(8), 1308–1315. 10.1017/S0033291717002781 [DOI] [PubMed] [Google Scholar]
- Williams B, Brown T, & Onsman A. (2010). Exploratory factor analysis: A five-step guide for novices. Australian Journal of Paramedicine, 8(3). 10.33151/ajp.8.3.93 [DOI] [Google Scholar]
- Yang F, Nelson-Gardell D, & Guo Y. (2018). The role of strains in negative emotions and bullying behaviors of school-aged children. Children and Youth Services Review, 94, 290–297. 10.1016/j.childyouth.2018.10.016 [DOI] [Google Scholar]
- Zhao Q, Zhu Y, Yeh F, Lin J, Lee ET, Cole SA, Calhoun D, & Zhao J. (2016). Depressive symptoms are associated with leukocyte telomere length in American Indians: Findings from the Strong Heart Family Study. Aging, 8(11), 2961–2970. 10.18632/aging.101104 [DOI] [PMC free article] [PubMed] [Google Scholar]

