Abstract
Objectives:
Acculturation has emerged as a key variable in racial/ethnic minorities and immigrant research. Although findings generally conclude acculturation leads to adverse outcomes (e.g., risk behaviors), scholars often find contradicting results. This increased attention to the core definitional questions about what acculturation is and how it should be measured, specifically across different racial/ethnic groups.
Methods:
This study examined the measurement invariance using Multigroup Confirmatory Factor Analysis (MG-CFA) by comparing three common domains of acculturation measures across Asian and Hispanic populations (i.e., Ethnic Identification, Language Proficiency and Preference, and Acculturative Stress) using the National Latino and Asian American Study (NLAAS).
Results:
A total sample of 4,649 (nLatinx=2,554 and nAsian=2,095) was used. The results suggested that aspects of ethnic identification and acculturative stress measures significantly varied between groups. For example, Latinxs had higher factor loadings in certain Acculturative Stress items related to government and legal status. In contrast, Asians had higher factor loadings in an item related to Ethnic Identification.
Conclusions:
The results suggested that aspects of acculturation do not necessarily measure the same way across all populations; researchers/clinicians should consider racial/ethnic specific scales when using acculturation related measures. Future research should test universal acculturation scales across other ethnic subgroups and include more complex acculturation measures like cultural values and norms.
Keywords: acculturation, measurement invariance, ethnic identification, language proficiency and preference, acculturative stress
The enactment of Immigration and Nationality Act of 1965 enabled an influx of non-European immigrants, largely from Latin America, Asia, Africa, the Caribbean, and the Middle East, into the United States (Schwartz et al., 2010). Scholars recognized the unique challenges and difficulties Latin and Asian immigrants face which are different than earlier generations of immigrants of European decent (Xie & Greenman, 2005). Thus, immigration-related factors such as acculturation have emerged as a key variable in ethnic minority research. This increased attention to acculturation has been accompanied by core definitional questions about what acculturation is and how it functions. In earlier research, while sociologists viewed acculturation as a process of irreversible accommodation and eventual assimilation into the host culture group (Gordon, 1964), anthropologists described acculturation as a process of interactivity between cultures (Redfield et al., 1936). Both anthropologists and sociologists defined acculturation as a process that occurs at the group/population level (Barnett, 1954). More recently, psychologists have focused on individual differences or within-group heterogeneity. For example, Berry (2003) proposed acculturation as a two separate processes framework: 1) maintenance of the original culture and 2) development of relationships with the new culture; acculturation involves adoption of values, attitudes, and behaviors of the host society.
Ethnic Identification
Phinney (1990) suggests that Ethnic Identity is an aspect of acculturation that focuses on the subjective sense of belonging to the culture. Early empirical studies on acculturation and ethnic identity suggest that acculturating individuals are more likely to forget or surrender their ethnic traditions (Berry & Annis, 1974). In recent years, scholars have begun to view the acceptance of one culture and the abandonment of the other as two separate practices and can co-occur (Berry, 1990). This two-dimensional process recognizes the need to address two major aspects of sense of belonging within the context of the new and original cultures (e.g., preserving one’s heritage culture and the adaptation of the host society) and can be both secure or undeveloped concurrently (Phinney et al., 2001).
English Language Proficiency and Preference
Like Ethnic Identification, the view on the acquisition of a second language can differ depending on how one views the acculturation process (i.e., linear vs. multi-dimensions). Under a linear continuum view, learning the language of the host society occurs at the expense of the native language and culture (Schumann, 1990). On the other hand, others have argued that one does not necessarily suffer any language loss when acquiring a new language (i.e., bilingualism), which aligns with the two-dimensional process approach described by Berry (1990) and Phinney (2001). In general, language proficiency and preference are acculturation behavioral indicators and found to be valid measures of acculturation (Hunt et al., 2004) and explain a large proportion of variance in acculturation (Coronado et al., 2005).
Acculturative Stress
Acculturative Stress is a stress reaction associated with the process of acculturation; it is rooted in the intercultural contact between the individual and the host society (Berry, 2006). In a unidimensional approach to acculturation, acculturative stress is viewed as stressors specifically pertain to the immigrant experience and the level of acculturation is inversely correlated with the degree of acculturative stress (Caplan, 2007). Others have described acculturative stress as a related but distinct construct from acculturation. For example, a study found that level of acculturation did not correspond to the level of acculturative stress (Hovey & King, 1996). Similarly, the bi-dimensional perspective views acculturative stress as a construct that encompasses other facets of the immigrant experience such as discrimination and loss of cultural values that extend beyond generation post immigration (Caplan, 2007).
Group Differences in Acculturation
Literature suggests that acculturation may differ between Latinx and Asian Americans due to factors such as socioeconomic status and the context of reception by the host country (Portes & Rumbaut, 2006). For example, Asian immigrants are portrayed as “model minority” due to their good socioeconomic standing (Wong et al., 1998) while many Latinx migrants are low-wage workers with minimal human capital (Portes & Zhou, 1993). It has been reported that Latinx Americans have higher poverty (15.7%) and lower college graduation (18.8%) rates compared to Asian Americans’ 7.3% and 58.1%, respectively (Creamer, 2020; U.S. Census Bureau, 2020). Exemplified by the recent unethical and unlawful practice of the Immigration and Customs Enforcement (ICE), Latinx Americans are also more likely to be targets of harmful immigration policies and discrimination (Tran et al., 2010). Consequently, many Latinx Americans may be more likely to remain isolated from the larger U.S. culture and become less acculturated than Asian Americans. Studies have confirmed that Latinx Americans experienced higher stress levels associated with acculturation than Asian Americans (Kimbro et al., 2014).
There does not seem to be a census on Ethnic Identification group differences across the two populations. For example, studies have found that Asian and Latinx adolescents both showed similar levels of ethnic identity (Hsiao & Wittig, 2008) while others have found Asian students have lower ethnic identity scores than their Latinx counterparts (Phinney & Alipuria, 1990). It has also been suggested that Southeastern Asian refugees tend to maintain a stronger ethnic orientation compared to Latinx immigrants (Wong-Rieger & Quintana, 1987) which implies patterns could be sample or context-specific.
Acculturation and Health/Mental Health
A large body of literature has been devoted to explaining the existing relationship between acculturation and health, particularly in Hispanic Americans (Lara et al., 2005; Thomson & Hoffman-Goetz, 2009) and Asian Americans (Suinn, 2010). Furthermore, contemporary theories suggested that the link between acculturation and mental health outcome is likely mediated by other variables (Organista et al., 2003) such as acculturative stress (Hwang & Ting, 2008). Due to its complexity, acculturation research often yields inconsistent findings in relation to health outcomes (Castro, 2007). For example, studies have shown that acculturation is associated with either higher (Moscicki et al., 1989), lower (González et al., 2001), or no difference (Cuellar & Roberts, 1997) in depression risk among Latinx population. Similarly, among Asian Americans, acculturation has been associated with better (Chou et al., 2010), worse (Acevedo-Garcia et al., 2010), and no difference (John et al., 2012) in self-rated health. These inconsistencies call into question how acculturation is measured.
How is Acculturation Measured?
It is important to note that the operational definition of acculturation can dictate the direction and magnitude of its effect. The operationalization and measurement of the acculturation process are often viewed as problematic (Thomson & Hoffman-Goetz, 2009) and what has changed as a result of acculturation has been challenging to pinpoint. The most commonly referenced domains have included language use and other cultural behaviors (Szapocznik et al., 1980), values and attitudes (Berry et al., 2006), and ethnic/heritage identity (Phinney & Ong, 2007). Generally, acculturation measures employ various methodological approaches, including scale and non-scale (Choi et al., 2008). Numerous standard scales have been developed to assess various domains and dimensions of acculturation. For example, the Ethnic Identity Scale (Umaña-Taylor et al., 2004) is often used to measure ethnic identification while others focus on aspects of acculturation specific to the population.
Non-scales use proxy measures and they are widely used as indicators of acculturation in population studies like public health (Lara et al., 2005; Thomson & Hoffman-Goetz, 2009). Non-scales typically use a singular or a combination of indicators such as language, place of birth/immigration status, and age at immigration/length of residence to assess the dimensions of acculturation. Although they are quick and convenient (Lara et al., 2005) and psychometrically sound (Marin, 1992), non-scales do not always directly measure elements in attitudes or behaviors which limit the utility of the information (Thomson & Hoffman-Goetz, 2009).
Importance of Examining Racial/Ethnic Differences
Research has highlighted the importance of tailoring scale items and structure by examining differences across racial/ethnic groups and interpreting scores based on individuals’ cultures and backgrounds (Trent et al., 2013). Failing to consider systematic variations due to cultural and racial/ethnic differences (e.g., response pattern and symptom expression) can lead to inaccurate and misleading conclusions (Lambert et al., 2004). Thus, some researchers suggested that for certain groups, we should pay attention to the particular cultural elements specific to the groups (Rogler et al., 1991). As a result, many acculturation instruments are available specific for different racial/ethnic populations.
Examining Measurement Invariance
Measurement Invariance (MI) can mathematically explain measurement equivalence across groups to obtain accurate comparisons. MI requires the association between the items/test scores (i.e., the raw scores from the instrument) and the latent factors to be independent of group membership (e.g., ethnicity) or measurement occasion (time; Mellenbergh, 1989). If MI is not present in the instrument, the comparison of the raw scores is almost as if we are comparing apples to oranges, and subsequent analyses will become meaningless. Thus, measures must meet specific criteria in order for researchers to have confidence in any analyses dealing with group comparison. For these reasons, adequately examining MI in acculturation across ethnic subgroups is needed due to the erroneous research interest.
The construct Acculturation has been plagued by conceptual vagueness and too many definitions in the literature and the lack of understanding of how acculturation is measured across ethnic groups has limited research findings. The purpose of this study is to examine the MI in three commonly used acculturation domains (i.e., Ethnic Identification, Language Proficiency and Preference, and Acculturative Stress) across Asian and Latinx American samples.
Method
Participants
The National Latino and Asian American Study (NLAAS) is a nationally representative household survey of Latinx and Asian Americans that collected psychiatric information, environmental and sociocultural factors and experiences (Heeringa et al., 2004). The NLAAS used a multi-stage national area probability sampling with special supplements for adults of Puerto Rican, Cuban, Chinese, Filipino, and Vietnamese national origin. A final NLAAS sample of 2,554 Latinx and 2,095 Asian Americans were recruited and a detailed description can be found in the parent study (Heeringa et al., 2004).
Measures
Acculturation domains were examined at the level of latent variables, which correct for measurement error and indicator-specific influences. A description of the three latent constructs is in the following: Ethnic identification. Ethnic identification is a four items measure adapted from the National Comorbidity Survey-Replication (Crengle et al., 2012; Vega et al., 1998) to measure how closely the respondent identified with other people of the same racial/ethnic background, how much time they would choose to spend with others of the same racial/ethnic group, and cultural commitment to one’s racial/ethnic group, with values ranging. Higher scores indicate higher identification with individual’s ethnic/racial group.
English proficiency and preference.
English language proficiency is assessed using three items adapted from the Cultural Identity Scales for Latino Adolescents (Felix-Ortiz et al., 1994) intended to measure self-evaluated proficiency in speaking, reading, and writing English. English language preference includes three items – two questions ask, “What language do you speak with most of your [family/friends]?” and a third question asks, “In what language do you think?” Higher scores indicate higher proficiency and preference for English.
Acculturative Stress.
The Acculturative Stress scale, adapted from the Mexican American Prevalence and Services Survey (Vega et al., 1998) and the Occupational/Emotional Stress subscale of the Hispanic Stress Inventory (Cervantes et al., 1991), is a nine items scale used to assess legal stress, discrimination, and language barrier. Higher scores indicate higher stress related to acculturation.
Analysis
Confirmatory Factor Analysis (CFA).
Stata 14 (Stata, 2015) was used to examine CFA for each domain. Maximum likelihood estimation was used to fit the model and assess model fit. Model fit was evaluated using different fit indices, including χ2/df ratio (Bryant & Yarnold, 1995), the root mean square error of approximation (RMSEA; Steiger, 1990), standardized root mean residual (SRMR; Bentler, 1990), comparative fit index (CFI; Bentler, 1990), and the Tucker–Lewis index (TLI; Tucker & Lewis, 1973). Low values (<.10 for moderate fit, <.06 for good fit) are desired for RSMEA and SRMR, while high values (>.90 good; >.95 excellent) are desired for the CFI and TLI (Tucker & Lewis, 1973).
Multigroup Confirmatory Factor Analysis (MG-CFA).
Following steps outlined in Brown (2006), MG-CFA was used to determine if measurements were invariant across the Asian and Latinx samples. The procedure involved analyzing separate input matrices specific to each group and placing constraints on various parameters (i.e., factor loadings, intercepts, residuals, etc.). MG-CFA began with conducting simple CFAs using separated Asian and Latino subsamples to compare the adequate fit of each group. Then the analyses used the two populations simultaneously with constraints: Model 1) all parameters free (Configural Invariance); Model 2) loadings are invariant (Metric Invariance); Model 3 loadings & intercepts are invariant (Strong/Scalar Invariance); and Model 4) loadings, intercepts & residuals are invariant (Strict Invariance). A description of each model can be found in Gregorich (2006). A reduction of more than .01 in CFI (ΔCFI > .01) is deemed to be a significantly poorer fit (Cheung & Rensvold, 2002). Change of CFI was used as a benchmark because it is less susceptible to confounding influences from large sample sizes (Bentler, 1990), while chi-square tests are sensitive to sample size (Brown, 2014). It is also notable that it is rare for all items to evidence measurement invariance at all levels, particularly in cross-cultural psychometric research (Cheung & Rensvold, 1999). In this case, partial invariance was conducted in order to allow item(s) to vary across groups in order to determine which item(s) cause poor model fit.
Results
Basic descriptive statistics and reliability coefficients were calculated (Table 1). The Asian sample reported more English Proficiency and Preference (p < .001; d = .267) while the Latinx sample reported more Acculturative Stress (p < .001; d = . 277). Reliabilities were also examined and stratified by subgroups. While Language Proficiency and Preference (CronbachAsian’s α = .93 and CronbachLatinx’s α = .95) and Ethnic Identification (CronbachAsian’s α = .70 and CronbachLatinx’s α = .60) displayed moderate and high reliability across both Asian and Latinx samples, Acculturative Stress (CronbachAsian’s α = .58 and CronbachLatinx’s α = .69) displayed less than ideal threshold at α = .70 (Nunnally & Bernstein, 1994).
Table 1.
Asian Sample | Latinx Sample | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
M | SD | Range | ɑ | M | SD | Range | ɑ | ||||
Ethnic identification | All | 12.31 | 2.47 | 4 to 16 | 0.70 | All | 12.33 | 2.34 | 4 to 16 | 0.60 | |
Vietnamese | 13.67 | 2.36 | 4 to 16 | 0.68 | Cuban | 12.87 | 2.25 | 5 to 16 | 0.59 | ||
Filipino | 11.88 | 2.33 | 5 to 16 | 0.65 | Puerto Rican | 12.14 | 2.21 | 4 to 16 | 0.54 | ||
Chinese | 12.31 | 2.47 | 4 to 16 | 0.70 | Mexican | 12.25 | 2.27 | 5 to 16 | 0.58 | ||
Asian Others | 11.90 | 2.45 | 4 to 16 | 0.70 | Hispanic Others | 12.08 | 2.56 | 4 to 16 | 0.66 | ||
English proficiency and preference | All | 15.80 | 6.41 | 6 to 27 | 0.93 | All | 13.97 | 7.18 | 6 to 27 | 0.95 | |
Vietnamese | 11.81 | 5.39 | 6 to 27 | 0.92 | Cuban | 12.15 | 6.71 | 6 to 27 | 0.95 | ||
Filipino | 20.07 | 4.75 | 6 to 27 | 0.85 | Puerto Rican | 16.73 | 6.45 | 6 to 27 | 0.93 | ||
Chinese | 15.80 | 6.41 | 6 to 27 | 0.93 | Mexican | 13.78 | 7.52 | 6 to 27 | 0.96 | ||
Asian Others | 18.68 | 5.10 | 6 to 27 | 0.86 | Hispanic Others | 13.94 | 7.08 | 6 to 27 | 0.95 | ||
Acculturative Stress | All | 3.46 | 2.55 | 1 to 13 | 0.58 | All | 4.22 | 2.88 | 1 to 13 | 0.69 | |
Vietnamese | 3.62 | 2.51 | 1 to 10 | 0.56 | Cuban | 3.92 | 2.58 | 1 to 11 | 0.63 | ||
Filipino | 2.67 | 2.10 | 1 to 11 | 0.55 | Puerto Rican | 3.01 | 2.27 | 1 to 10 | 0.60 | ||
Chinese | 3.46 | 2.55 | 1 to 13 | 0.62 | Mexican | 4.92 | 3.31 | 1 to 13 | 0.76 | ||
Asian Others | 3.50 | 2.55 | 1 to 11 | 0.59 | Hispanic Others | 4.30 | 2.69 | 1 to 12 | 0.59 |
Standardized factor loadings of the items were provided in Table 2 for context. Fit indexes and sample sizes for all CFA and multigroup models were presented in Table 3. While fit indexes indicated good to excellent fit in Ethnic Identification and English Proficiency and Preference (e.g., TLI and CFI were all >.95 across both groups), Acculturative Stress did not meet the moderate threshold for both populations (RMSEAAsian = .120 and .RMSEALatinx = 122). There were also differences in terms of fit indices between groups. For example, RMSEA for both Ethnic Identification and English Proficiency and Preference were shown to be good fits for the Asian sample (0.057 and 0.070, respectively). However, the same fit indices for the Latinx sample were worse (RMSEAEthnic Identification = 0.070 and RMSEAEnglish Proficiency and Preference = 0.105).
Table 2.
Factor Loading | |||||
---|---|---|---|---|---|
Construct | Item | Item Content | Asian | Latinx | All |
Ethnic identification | EI1 | Identify with others of same racial/ethnic descent | 0.73 | 0.73 | 0.73 |
EI2 | Feel close in your ideas/feelings w/ppl of same racial descent | 0.80 | 0.86 | 0.83 | |
EI3 | Amountt time would like to spend w/ppl of same racial/ethnic group | 0.59 | 0.55 | 0.57 | |
EI4 | Importance for same racial/ethnic group to marry within group | 0.43 | 0.20 | 0.29 | |
English proficiency and preference | EP&P1 | How well do you speak English | 0.93 | 0.95 | 0.94 |
EP&P2 | How well do you read English | 0.97 | 0.98 | 0.98 | |
EP&P3 | How well write English | 0.95 | 0.96 | 0.96 | |
EP&P4 | Language spoken with friends | 0.86 | 0.92 | 0.90 | |
EP&P5 | Language spoken with family | 0.78 | 0.80 | 0.79 | |
EP&P6 | Language in which you think | 0.91 | 0.93 | 0.91 | |
Acculturative Stress | AS1 | Felt guilty about leaving family/friends in country of origin | 0.22 | 0.29 | 0.27 |
AS2 | Same respect in US as in country of origin | 0.37 | 0.25 | 0.31 | |
AS3 | Limited contact with family and friends | 0.23 | 0.37 | 0.33 | |
AS4 | Interaction hard due to difficulty with English language | 0.61 | 0.49 | 0.55 | |
AS5 | Treated badly due to poor/accented English | 0.69 | 0.59 | 0.60 | |
AS6 | Difficult to find work due to Latino/Asian descent | 0.66 | 0.66 | 0.66 | |
AS7 | Questioned about legal status | 0.13 | 0.42 | 0.32 | |
AS8 | Think might be deported if go to social/government agency | 0.15 | 0.51 | 0.40 | |
AS9 | Avoid health service due to INS | 0.16 | 0.51 | 0.41 |
Table 3.
Model | χ2 | df | χ2/df | RMSEA | 90% CI | SRMR | TLI | CFI | △CFI | |
---|---|---|---|---|---|---|---|---|---|---|
Ethnic identification | All | 37.570 | 2 | 18.79 | 0.062 | [0.046, 0.080] | 0.022 | 0.972 | 0.991 | -- |
Asian | 15.560 | 2 | 7.78 | 0.057 | [0.033, 0.085] | 0.019 | 0.978 | 0.993 | -- | |
Latinx | 27.040 | 2 | 13.52 | 0.070 | [0.048, 0.095] | 0.026 | 0.963 | 0.988 | -- | |
Configural | 42.604 | 4 | 10.65 | 0.065 | [0.048, 0.083] | 0.023 | 0.970 | 0.990 | -- | |
Metric | 101.620 | 7 | 14.52 | 0.077 | [0.064, 0.090] | 0.046 | 0.958 | 0.976 | −0.014 | |
Partial Metric* | 51.298 | 6 | 8.55 | 0.057 | [0.044, 0.072] | 0.025 | 0.977 | 0.988 | −0.002 | |
English proficiency and preference | All | 282.320 | 8 | 35.29 | 0.091 | [0.082, 0.100] | 0.022 | 0.982 | 0.991 | -- |
Asian | 80.390 | 8 | 10.05 | 0.070 | [0.057, 0.085] | 0.024 | 0.988 | 0.993 | -- | |
Latinx | 212.420 | 8 | 26.55 | 0.105 | [0.093, 0.117] | 0.019 | 0.979 | 0.989 | -- | |
Configural | 292.810 | 16 | 18.3 | 0.091 | [0.082, 0.101] | 0.021 | 0.982 | 0.990 | -- | |
Metric | 343.69 | 20 | 17.18 | 0.088 | [0.080, 0.097] | 0.021 | 0.983 | 0.989 | −0.001 | |
Scalar | 476.580 | 24 | 19.86 | 0.095 | [0.088, 0.103] | 0.021 | 0.980 | 0.984 | −0.005 | |
Strict | 574.600 | 30 | 19.15 | 0.093 | [0.087, 0.100] | 0.023 | 0.981 | 0.981 | −0.003 | |
Acculturative Stress | All | 1272.954 | 27 | 47.15 | 0.132 | [0.126, 0.138] | 0.084 | 0.527 | 0.645 | -- |
Asian | 532.070 | 27 | 19.71 | 0.120 | [0.111, 0.129] | 0.087 | 0.534 | 0.650 | -- | |
Latinx | 565.287 | 27 | 20.94 | 0.122 | [0.113, 0.131] | 0.073 | 0.624 | 0.718 | -- | |
Configural | 1097.360 | 54 | 20.32 | 0.121 | [0.115, 0.127] | 0.081 | 0.585 | 0.689 | -- | |
Metric | 1432.590 | 62 | 23.11 | 0.129 | [0.123, 0.135] | 0.109 | 0.525 | 0.591 | −0.098 | |
Partial Metric** | 1130.834 | 59 | 19.17 | 0.117 | [0.111, 0.123] | 0.083 | 0.610 | 0.680 | −0.009 |
Set EI4 free;
set AS7–9 free.
Multigroup Confirmatory Factor Analysis
The following analyses examined the model fit across the two groups using MG-CFA. Ethnic Identification. First, the analysis tested for equal form by placing equality constraints on the factorial structure across groups (configural invariance). Results showed adequate fit indices which supported the similar item cluster patterns which mapped well on the same number factor model. Specifically, RMSEA suggested moderate fit (.065) while SRMR suggested good fit (0.023), and both TLI and CFI were above .95. Next, metric noninvariance was found when examining the two groups. As the metric invariance test showed a significant drop in fit (ΔCFI = −.014), partial metric invariance was conducted by identifying the noninvariant item loadings based on the procedures outlined in Cheung and Rensvold (1999). Item 4 (“Importance for same racial/ethnic group to marry within group”), when allowed to vary, increased fit to meet metric invariance (ΔCFI = −.002). The partial metric invariance determines if each group’s items are equally related to their latent variable. In this case, item 4 was less related to Ethnic Identification for Latinx than the Asian sample. This aligned with Table 2 where item 4 showed a smaller loading onto the factor in Latinx sample (Latinx: .20; Asian: .43).
English Proficiency and Preference.
As seen in Table 3, each model was invariant as compared to the previous model with the largest change in CFI = .005. These results suggested that each subsample had the same factorial structure (configural), factor loadings (metric), item means (scalar), and error variances (strict) for all items; this implied that the scale performs similarly for both samples and that the subscale scores can be interpreted the same regardless of the race/ethnicity.
Acculturative Stress.
As seen in Table 2, results showed that loadings onto Acculturative Stress were small to moderate (Asian range: .13–.69; Latinx range: .25–.66). Specifically, items related to government and legal status (items 7 to 9) had smaller loadings among the Asian sample (range: .13 to .16) than the Latinx sample (range: .42 to .51). Following support for configural invariance across groups, the metric invariance was conducted by imposing equality constraints on all factor loadings across groups, as shown in Table 3. The test resulted in a significant CFI drop in model fit relative to the equal configural invariance (△CFI = .098), suggesting that at least one item loading was noninvariant across groups (Brown, 2014). Therefore, partial metric invariance was examined by identifying the noninvariant item loadings; a series of invariance tests were conducted by constraining each item loading one at a time. This process identified noninvariant items that significantly degraded the model. Once items were identified, the test for partial metric invariance then allowed one item loadings at a time to be freely estimated across groups until △CFI ≤ .01. After “freeing” items 7 to 9, (“Questioned about legal status,” “Think might be deported if go to social/government agency,” and “Avoid health service due to INS?”), fit indices supported a marginally good fit and the change of CFI is less than .01 (△CFI = .009). Overall, the results indicated that the general item–factor relationships were the same across the two groups after loosening a portion of the constraints.
Discussion
The purpose of this study is to test the psychometric properties of three Acculturation domains and understand how these measures vary across Asian and Latinx samples. MG-CFA was used to examine whether items vary or measure similarly between Latinx and Asian Americans. For Ethnic Identification, partial metric invariance was achieved when item 4 (“Importance for same racial/ethnic group to marry within group”) was set vary. Similarly, items 7–9 (“Questioned about legal status,” “Think might be deported if go to social/government agency,” and “Avoid health service due to INS?”) which were related to government or legal status were also degrading the model when set constrained. These findings demonstrated that measurement invariance could not simply be assumed across the two populations.
Understanding reasons for differential reporting by domain can help us better understand each population’s sensitivity to particular items. For Ethnic Identification, the difference in attitude toward marrying in-group may perhaps be due to a few reasons. First, interracial marriages for Asian Americans were deemed illegal until the banning of anti-miscegenation laws by the US Supreme Court in 1967. The sociopolitical context may have subsequently promoted the tradition and the importance of marrying within among Asian Americans. Secondly, a study found that 68% of Latinx Americans had outdated at least once (Tucker & Mitchell-Kernan, 1995). Latinx Americans are more accustomed to interracial dating which may indirectly make marrying within less critical. It is important to note that studies on ethnic identity are often conducted with adolescents and young adults, an important developmental stage for identity. Items on dating and marriage coincide with the importance of exploring intimacy within this developmental stage.
For Acculturative Stress, items related to government and legal status are more relevant to Latinx Americans maybe relate to the relatively large amount of unauthorized immigrants in this group (Passel & D’Vera, 2016). As pointed out earlier, Latinx Americans are more likely to be targets of unfair immigrant policy (e.g., ICE), making these stressors more salient. It also confirms their relatively disadvantaged socioeconomic position (i.e., legal status) which isolated them from the larger society and subsequent acculturated opportunities.
For English Language Proficiency and Preference, strict invariance was achieved. This implied that language items performed similarly for both Asian and Latinx subsamples which allows scores to be interpreted the same way. This is useful because language items are quick and convenient and often correlate with measurement scales that explain more variance in acculturation scales than other constructs (Marin, 1992). A demonstration of MI allows researchers to conduct cross-cultural comparisons without any psychometric concerns.
Conclusion
This study has several major strengths, including large sample sizes, sophisticated statistical analyses, and incorporating popular measurement domains across disciplines. Nevertheless, there are also some limitations. The primary limitation is the use of the limited number of items (e.g., four items only in Ethnic Identification) and relatively poor psychometric property in Acculturative Stress. Also, the analyses may be benefited from including additional prevalent domains (e.g., measures for cultural practices and values, individualism vs. collectivism, etc.). In addition, literature has shown considerable heterogeneity within ethnic subgroups (e.g., Chinese, Vietnamese, Filipino, Cuban, Mexicans, Puerto Rican, etc.) and simply assuming MI across all subgroups can be problematic. Further research may consider looking at differential item functioning across different racial/ethnic subgroups. Lastly, acculturation measures should also consider accounting for age. For example, identity development (e.g., Erikson’s psychosocial development) may cause individual’s ethnic identification to vary tremendously (Erikson & Erikson, 1998). The information provided in this study can also better inform clinicians in understanding different aspects of acculturation in practice. For example, instead of one size fits all, social workers and other clinicians may gain knowledge about certain aspects of acculturation that are fundamentally different between populations. Subsequently, it can inform their practice with racially/ethnically diverse client populations by focusing on relevant acculturation aspects specific to the clients’ backgrounds.
Funding:
This work was supported by the National Institute on Drug Abuse grants under Grant T32DA007233-36.
Footnotes
Financial interests: The author has no relevant financial or non-financial interests to disclose.
Disclosure statement: The author declares that they have no competing interests.
Data deposition: Data sharing is not applicable to this article as no new data were created; data used in the study is publicly accessible.
Ethical consideration: The NLAAS study obtained institutional review board (IRB) approval from Cambridge Health Alliance, the University of Washington, and the University of Michigan, and no additional IRB approval was necessary because the data were obtained from a publicly available secondary source.
Data availability statement:
Data associated with this paper can be found in Inter-university Consortium for Political and Social Research data repository under https://doi.org/10.1002/mpr.181
References
- Acevedo-Garcia D, Bates LM, Osypuk TL, & McArdle N (2010). The effect of immigrant generation and duration on self-rated health among US adults 2003–2007. Soc. Sci. Med, 71(6), 1161–1172. 10.1016/j.socscimed.2010.05.034 [DOI] [PubMed] [Google Scholar]
- Barnett HG (1954). Acculturation: An Exploratory Formulation The Social Science Research Council Summer Seminar on Acculturation, 1953: Comment. Am. Anthropol, 56(6), 1000–1002. 10.1525/aa.1954.56.6.02a00030 [DOI] [Google Scholar]
- Bentler PM (1990). Comparative fit indices in struçtual models. Psychological Bulletin, 107, 238–246. [DOI] [PubMed] [Google Scholar]
- Berry J (1990). Psychology of acculturation. In Berman J (Ed.), Nebraska Symposium on Motivation (Vol. 37, pp. 201–234). [PubMed] [Google Scholar]
- Berry JW (2003). Conceptual approaches to acculturation. In Acculturation: Advances in theory, measurement, and applied research. (pp. 17–37). American Psychological Association. 10.1037/10472-004 [DOI] [Google Scholar]
- Berry JW (2006). Stress perspectives on acculturation. In Sam D & Berry JW (Eds.), The Cambridge handbook of acculturation psychology (pp. 43–57). Cambridge University Press. [Google Scholar]
- Berry JW, & Annis RC (1974). Acculturative Stress: The Role of Ecology, Culture and Differentiation. Journal of Cross-Cultural Psychology, 5(4), 382–406. 10.1177/002202217400500402 [DOI] [Google Scholar]
- Berry JW, Phinney JS, Sam DL, & Vedder PE (2006). Immigrant youth in cultural transition: Acculturation, identity, and adaptation across national contexts. Lawrence Erlbaum Associates. [Google Scholar]
- Brown T (2006). Confirmatory factor analysis for applied research. Guilford Press. [Google Scholar]
- Brown T (2014). Confirmatory Factor Analysis for Applied Research, Second Edition (2nd ed.). Guilford Publications. [Google Scholar]
- Bryant FB, & Yarnold PR (1995). Principal-components analysis and exploratory and confirmatory factor analysis. In Grimm LG& Yarnold PR(Eds.), Reading and understanding multivariate statistics (pp. 99–136). American Psychological Association. [Google Scholar]
- Caplan S (2007). Latinos, Acculturation, and Acculturative Stress: A Dimensional Concept Analysis. Policy, Politics, & Nursing Practice, 8(2), 93–106. 10.1177/1527154407301751 [DOI] [PubMed] [Google Scholar]
- Castro FG (2007). Is Acculturation Really Detrimental to Health? Am. J. Public Health, 97(7), 1162–1162. 10.2105/AJPH.2007.116145 [DOI] [Google Scholar]
- Cervantes RC, Padilla AM, & Salgado de Snyder N (1991). The Hispanic Stress Inventory: A culturally relevant approach to psychosocial assessment. Psychological assessment: a journal of consulting and clinical psychology, 3(3), 438. 10.1037/1040-3590.3.3.438 [DOI] [Google Scholar]
- Cheung GW, & Rensvold RB (1999). Testing Factorial Invariance across Groups: A Reconceptualization and Proposed New Method. J. Manage, 25(1), 1–27. 10.1177/014920639902500101 [DOI] [Google Scholar]
- Cheung GW, & Rensvold RB (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Struct. Equ. Modeling, 9(2), 233–255. 10.1207/S15328007SEM0902_5 [DOI] [Google Scholar]
- Choi S, Rankin S, Stewart A, & Oka R (2008). Effects of acculturation on smoking behavior in Asian Americans: a meta-analysis. J. Cardiovasc. Nurs, 23(1), 67–73. 10.1097/01.JCN.0000305057.96247.f2 [DOI] [PubMed] [Google Scholar]
- Chou C-F, Johnson PJ, & Blewett LA (2010). Immigration and selected indicators of health status and healthcare utilization among the Chinese. J. Immigr. Minor. Health, 12(4), 470–479. 10.1007/s10903-009-9240-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Coronado GD, Thompson B, McLerran D, Schwartz SM, & Koepsell TD (2005). A short acculturation scale for Mexican-American populations. Ethn Dis, 15(1), 53–62. [PubMed] [Google Scholar]
- Creamer J (2020). Inequalities Persist Despite Decline in Poverty For All Major Race and Hispanic Origin Groups. United States Census Bureau; Retrieved from https://www.census.gov/library/stories/2020/09/poverty-rates-for-blacks-and-hispanics-reached-historic-lows-in-2019.html [Google Scholar]
- Crengle S, Robinson E, Ameratunga S, Clark T, & Raphael D (2012). Ethnic discrimination prevalence and associations with health outcomes: data from a nationally representative cross-sectional survey of secondary school students in New Zealand. BMC Public Health, 12(45), 1–11. 10.1186/1471-2458-12-45 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cuellar I, & Roberts R (1997). Relations of Depression, Acculturation, and Socioeconomic Status in a Latino Sample. Hisp. J. Behav. Sci, 19(2), 230–238. 10.1177/07399863970192009 [DOI] [Google Scholar]
- Erikson EH, & Erikson JM (1998). The Life Cycle Completed (Extended Version). W. W. Norton & Company. [Google Scholar]
- Felix-Ortiz M, Newcomb MD, & Myers H (1994). A Multidimensional Measure of Cultural Identity for Latino and Latina Adolescents. Hisp. J. Behav. Sci, 16(2), 99–115. 10.1177/07399863940162001 [DOI] [Google Scholar]
- González HM, Haan MN, & Hinton L (2001). Acculturation and the prevalence of depression in older Mexican Americans: baseline results of the Sacramento Area Latino Study on Aging. J. Am. Geriatr. Soc, 49(7), 948–953. 10.1046/j.1532-5415.2001.49186.x [DOI] [PubMed] [Google Scholar]
- Gordon MM (1964). Assimilation in American Life. Oxford University Press. [Google Scholar]
- Gregorich SE (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care, 44(11 Suppl 3), S78–94. 10.1097/01.mlr.0000245454.12228.8f [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heeringa SG, Wagner J, Torres M, Duan N, Adams T, & Berglund P (2004). Sample designs and sampling methods for the Collaborative Psychiatric Epidemiology Studies (CPES). Int. J. Methods Psychiatr. Res, 13(4), 221–240. 10.1002/mpr.179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hovey JD, & King CA (1996). Acculturative Stress, Depression, and Suicidal Ideation among Immigrant and Second-Generation Latino Adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 35(9), 1183–1192. 10.1097/00004583-199609000-00016 [DOI] [PubMed] [Google Scholar]
- Hsiao J, & Wittig MA (2008). Acculturation among three racial/ethnic groups of host and immigrant adolescents. American journal of community psychology, 42(3–4), 286–297. 10.1007/s10464-008-9205-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunt L, Schneider S, & Comer B (2004). Should “acculturation” be a variable in health research? A critical review of research on US Hispanics. Soc Sci Med, 59(5), 973–986. 10.1016/j.socscimed.2003.12.009 [DOI] [PubMed] [Google Scholar]
- Hwang W-C, & Ting JY (2008). Disaggregating the effects of acculturation and acculturative stress on the mental health of Asian Americans. Cultur. Divers. Ethnic Minor. Psychol, 14(2), 147–154. 10.1037/1099-9809.14.2.147 [DOI] [PubMed] [Google Scholar]
- John DA, de Castro AB, Martin DP, Duran B, & Takeuchi DT (2012). Does an immigrant health paradox exist among Asian Americans? Associations of nativity and occupational class with self-rated health and mental disorders. Social Science and Medicine, 75(12), 2085–2098. 10.1016/j.socscimed.2012.01.035 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kimbro RT, Gorman BK, & Schachter A (2014). Acculturation and Self-Rated Health among Latino and Asian Immigrants to the United States. Social Problems, 59(3), 341–363. 10.1525/sp.2012.59.3.341 [DOI] [Google Scholar]
- Lambert SF, Cooley MR, Campbell KD, Benoit MZ, & Stansbury R (2004). Assessing anxiety sensitivity in inner-city African American children: psychometric properties of the childhood anxiety sensitivity index. J. Clin. Child Adolesc. Psychol, 33(2), 248–259. 10.1207/s15374424jccp3302_5 [DOI] [PubMed] [Google Scholar]
- Lara M, Gamboa C, Kahramanian MI, Morales LS, & Bautista DE (2005). Acculturation and Latino health in the United States: a review of the literature and its sociopolitical context. Annu Rev Public Health, 26, 367–397. 10.1146/annurev.publhealth.26.021304.144615 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marin G (1992). Issues in the measurement of acculturation among Hispanics. In Geisinger KF (Ed.), Psychological Testing of Hispanics (pp. 23–51). APA. [Google Scholar]
- Mellenbergh GJ (1989). Item bias and item response theory. Int. J. Educ. Res, 13(2), 127–143. 10.1016/0883-0355(89)90002-5 [DOI] [Google Scholar]
- Moscicki EK, Locke BZ, Rae DS, & Boyd JH (1989). DEPRESSIVE SYMPTOMS AMONG MEXICAN AMERICANS: THE HISPANIC HEALTH AND NUTRITION EXAMINATION SURVEY. Am. J. Epidemiol, 130(2), 348–360. 10.1093/oxfordjournals.aje.a115341 [DOI] [PubMed] [Google Scholar]
- Nunnally JC, & Bernstein IH (1994). Psychometric Theory (3 ed.). McGraw-Hill. [Google Scholar]
- Organista PB, Organista KC, & Kurasaki K (2003). The relationship between acculturation and ethnic minority health. In Chun KM, Organista PB, & Marín G (Eds.), Acculturation: Advances in theory, measurement, and applied research (pp. 139–161). American Psychological Association. [Google Scholar]
- Passel J, & D’Vera C (2016). Overall Number of U.S. Unauthorized Immigrants Holds Steady since 2009. http://www.pewhispanic.org/2016/09/20/overall-number-of-u-s-unauthorized-immigrants-holds-steady-since-2009/
- Phinney JS (1990). Ethnic identity in adolescents and adults: review of research. Psychol Bull, 108(3), 499–514. 10.1037/0033-2909.108.3.499 [DOI] [PubMed] [Google Scholar]
- Phinney JS, & Alipuria LL (1990). Ethnic identity in college students from four ethnic groups. J Adolesc, 13(2), 171–183. 10.1016/0140-1971(90)90006-s [DOI] [PubMed] [Google Scholar]
- Phinney JS, Horenczyk G, Liebkind K, & Vedder P (2001). Ethnic Identity, Immigration, and Well-Being: An Interactional Perspective. Journal of Social Issues, 57(3), 493–510. 10.1111/0022-4537.00225 [DOI] [Google Scholar]
- Phinney JS, & Ong AD (2007). Conceptualization and measurement of ethnic identity: Current status and future directions. J. Couns. Psychol, 54(3), 271–281. 10.1037/0022-0167.54.3.271 [DOI] [Google Scholar]
- Portes A, & Rumbaut RG (2006). Immigrant America: A Portrait. University of California Press. [Google Scholar]
- Portes A, & Zhou MIN (1993). The New Second Generation: Segmented Assimilation and its Variants. The ANNALS of the American Academy of Political and Social Science, 530(1), 74–96. 10.1177/0002716293530001006 [DOI] [Google Scholar]
- Redfield R, Linton R, & Herskovits MJ (1936). Memorandum for the Study of Acculturation. American Anthropologist, 38(1), 149–152. 10.1525/aa.1936.38.1.02a00330 [DOI] [Google Scholar]
- Rogler LH, Cortes DE, & Malgady RG (1991). Acculturation and mental health status among Hispanics. Convergence and new directions for research. Am. Psychol, 46(6), 585–597. 10.1037//0003-066x.46.6.585 [DOI] [PubMed] [Google Scholar]
- Schumann JH (1990). Extending the Scope of the Acculturation/Pidginization Model to Include Cognition. TESOL Quarterly, 24(4), 667–684. 10.2307/3587114 [DOI] [Google Scholar]
- Schwartz SJ, Unger JB, Zamboanga BL, & Szapocznik J (2010). Rethinking the concept of acculturation: implications for theory and research. Am Psychol, 65(4), 237–251. 10.1037/a0019330 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stata. (2015). STATA Base Reference Manual 14. Stata Press. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.637.2432 [Google Scholar]
- Steiger JH (1990). Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivariate Behav. Res, 25(2), 173–180. 10.1207/s15327906mbr2502_4 [DOI] [PubMed] [Google Scholar]
- Suinn RM (2010). Reviewing acculturation and Asian Americans: How acculturation affects health, adjustment, school achievement, and counseling. Asian Am. J. Psychol, 1(1), 5–17. 10.1037/a0018798 [DOI] [Google Scholar]
- Szapocznik J, Kurtines WM, & Fernandez T (1980). Bicultural involvement and adjustment in Hispanic-American youths. Int. J. Intercult. Relat, 4(3–4), 353–365. 10.1016/0147-1767(80)90010-3 [DOI] [Google Scholar]
- Thomson MD, & Hoffman-Goetz L (2009). Defining and measuring acculturation: a systematic review of public health studies with Hispanic populations in the United States. Soc. Sci. Med, 69(7), 983–991. 10.1016/j.socscimed.2009.05.011 [DOI] [PubMed] [Google Scholar]
- Tran AGTT, Lee RM, & Burgess DJ (2010). Perceived discrimination and substance use in Hispanic/Latino, African-born Black, and Southeast Asian immigrants. Cultural Diversity and Ethnic Minority Psychology, 16(2), 226–236. 10.1037/a0016344 [DOI] [PubMed] [Google Scholar]
- Trent LR, Buchanan E, Ebesutani C, Ale CM, Heiden L, Hight TL, Damon JD, & Young J (2013). A measurement invariance examination of the Revised Child Anxiety and Depression Scale in a Southern sample: differential item functioning between African American and Caucasian youth. Assessment, 20(2), 175–187. 10.1177/1073191112450907 [DOI] [PubMed] [Google Scholar]
- Tucker LR, & Lewis C (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10. 10.1007/BF02291170 [DOI] [Google Scholar]
- Tucker MB, & Mitchell-Kernan C (1995). Social Structural and Psychological Correlates of Interethnic Dating. Journal of Social and Personal Relationships, 12(3), 341–361. 10.1177/0265407595123002 [DOI] [Google Scholar]
- U.S. Census Bureau. (2020). U.S. Census Bureau Releases New Educational Attainment Data. Retrieved from https://www.census.gov/newsroom/press-releases/2020/educational-attainment.html
- Umaña-Taylor AJ, Yazedjian A, & Bámaca-Gómez M (2004). Developing the Ethnic Identity Scale Using Eriksonian and Social Identity Perspectives. Identity, 4(1), 9–38. 10.1207/S1532706XID0401_2 [DOI] [Google Scholar]
- Vega WA, Kolody B, Aguilar-Gaxiola S, Alderete E, Catalano R, & Caraveo-Anduaga J (1998). Lifetime Prevalence of DSM-III-R Psychiatric Disorders Among Urban and Rural Mexican Americans in California. Archives of General Psychiatry, 55(9), 771–778. 10.1001/archpsyc.55.9.771 [DOI] [PubMed] [Google Scholar]
- Wong P, Lai CF, Nagasawa R, & Lin T (1998). Asian Americans as a Model Minority: Self-Perceptions and Perceptions by other Racial Groups. Sociological Perspectives, 41(1), 95–118. 10.2307/1389355 [DOI] [Google Scholar]
- Wong-Rieger D, & Quintana D (1987). Comparative Acculturation of Southeast Asian and Hispanic Immigrants and Sojourners. Journal of Cross-Cultural Psychology, 18(3), 345–362. 10.1177/0022002187018003005 [DOI] [Google Scholar]
- Xie Y, & Greenman E (2005). Segmented Assimilation Theory: A Reformulation and Empirical Test. PSC Research Report, 5(581), 1–38. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data associated with this paper can be found in Inter-university Consortium for Political and Social Research data repository under https://doi.org/10.1002/mpr.181