Abstract
A growing body of research has documented associations between discrimination, anger and delinquency, but the exact nature of these associations remains unclear. Specifically, do aggressive behaviors emerge over time as a consequence of perceived discrimination and anger? Or do adolescents who engage in aggressive behavior perceive that they are being discriminated against and become angry? We use autoregressive cross-lagged path analysis on a sample of 692 Indigenous adolescents (mean age=12 years) from the Northern Midwest and Canada to answer these research questions. Results showed that the direction of effects went only one way; both perceived discrimination and anger were significantly associated with subsequent aggression. Moreover, early discrimination and anger each had indirect effects on aggressive behavior three years later, and anger partially mediated the association between discrimination and aggression. Perceived discrimination is but one of many strains related to their unequal social position that these Indigenous youth experience, and have important implications for the proliferation of disparities in later life.
Both perceived discrimination and aggression represent important yet under researched problems for Indigenous communities. The scarcity of research is notable considering that discrimination has been identified as a culturally-specific risk factor for Indigenous well-being (Whitbeck et al. 2001; Zimmerman et al. 1996). What we do know is that discrimination is a consistent correlate of several negative outcomes. Experiences with discrimination are positively associated with anger (Mellor et al. 2009), depressive symptoms, and alcohol abuse among Indigenous adults (Whitbeck, McMorris et al. 2002; Whitbeck et al. 2004). It is also associated with increased depressive symptoms, substance use, anger, suicide ideation, and problem behaviors among Indigenous adolescents (Walls et al. 2007; Whitbeck et al. 2001; Yoder et al. 2006).
North American Indigenous (American Indian, Alaska Native, Canadian First Nations) adolescents are overrepresented in violent crime statistics, including offending and victimization. Combined rates of violence, specifically homicide, suicide, and family violence, are higher for American Indians on reservations than for any other group in the United States (Bachman 1992), with similar patterns for Canadian Aboriginal people (Royal Commission on Aboriginal Peoples (RCAP) 1996). The rate of violent victimization for American Indians is more than twice the national average (Perry 2004), and occurs across age groups, housing locations, and gender (Greenfeld and Smith 1999). Further, American Indians are more likely than any other ethnic group to be victims of interracial violence, committed 60% of the time by white perpetrators (Perry 2004).
Most research treats perceived discrimination as an independent variable and finds it to be positively associated with a variety of negative outcomes for young people (e.g., Taylor and Turner 2002). Yet a smaller body of research indicates that for some young people, perceptions of discrimination may be outcomes of peer rejection (Patterson, DeBaryshe, and Ramsey 1989), hostile attribution biases (Crick and Dodge 1996), or misinterpreting the motives of others (Crocker et al. 1991). This research suggests aggressive behavior is positively associated with perceived discrimination. We know of no studies that have explicitly investigated the temporal association between discrimination and adolescent aggressive behavior, an oversight that may have important implications for prior research that assumed the direction of effects without testing them. Moreover, the primary emphasis of research on discrimination and aggressive or delinquent behavior has been on African American samples (e.g., Caldwell et al. 2004; Martin et al. 2011). Consequently, we know even less about the association between perceived discrimination and aggression among Indigenous adolescents.
Additionally, anger has been identified as a correlate of aggression or delinquency (Agnew 1992; Camodeca and Goosens 2005) and perceived discrimination (Mellor et al. 2009; Whitbeck et al. 2001). It is generally treated as a precursor to aggression (Camodeca and Goosens 2005) and hypothesized to be an intervening variable between strain (i.e., perceived discrimination) and delinquency (Agnew 1992). Yet, as with perceived discrimination and aggression, we are aware of no studies to date that have explicitly tested those assumptions for Indigenous adolescents.
In this report we use autoregressive cross-lagged path analysis with longitudinal data on 692 adolescents from the upper Midwest and Canada to answer three research questions. First, does early aggression lead to perceived discrimination, or do perceptions of discrimination lead to aggressive behavior? Second, does aggressive behavior precede adolescent anger, or does anger lead to aggression? Third, does anger mediate the association between perceived discrimination and aggression over time?
Aggression as an Outcome of Perceived Discrimination
In general, perceived discrimination is widespread among people with disadvantaged social status (Kessler, Mickelson, and Williams 1999), and has adverse effects on health, mental health, and behavior across age groups (Taylor and Turner 2002; Thoits 2010; Whitbeck et al. 2001; Williams, Neighbors, and Jackson 2003). Stress process theory offers a useful lens through which to understand the effects of perceived discrimination: the surrounding social structure brings with it stressful experiences, which affect individual functioning (Pearlin 1999). Minority groups face disproportionately high numbers of chronic stressors, including poverty, discrimination, and family disruption (Williams, Takeuchi, and Adair 1992). Chronic stressors are those that occur continuously, or so regularly in daily life as to be perceived as continuous by the individual (Wheaton 1994). Indeed, minority status itself can serve as a stressor (Meyer 1995; Vega and Rumbaut 1991). Pearlin (1999) argues that certain stressors like status strain, which evolves out of an individual’s unequal social position, and contextual strain, which arises from difficulties encountered in an individual’s proximal environment, are persistent and chronic stressors because they are embedded in enduring social contexts.
According to stress theory, perceived discrimination impairs healthy functioning; in the case of the present study, it is associated with adolescent aggression. Delinquent behavior may serve as an adaptation to strain, an unconscious effort of young people to cope with the stress of perceived discrimination (Brezina 1996; Hoffmann 2010). In a study of American Indian youth by Whitbeck et al. (2002), perceived discrimination was associated with being involved with a gang, which is perhaps a coping mechanism for marginalized minority youth. Repeat experiences with perceived discrimination over time may lead to an escalation in aggressive behaviors (Hoffmann and Cerbone 1999). As Indigenous adolescents expand their social worlds, particularly as they leave the relative protection of reservations/reserves, they are more likely to encounter discrimination and prejudice.
Perceived Discrimination as an Outcome of Aggressive Behavior
There is also evidence that perceived discrimination is an outcome, rather than a predictor, of aggressive behavior. Aggressive youth are more likely to be rejected by peer groups than are nonaggressive youth (Dodge et al. 2003; Patterson et al. 1989). Furthermore, antisocial behavior likely also leads to rejection by other social groups, especially for racial and ethnic minorities who face more prejudice and discrimination. Rejection may be viewed as unfair or unwarranted, leading to perceptions of discrimination. For example, in their study of children aged 9–12 years, Crick and Dodge (1996) noted that reactive aggressive children had more hostile attribution biases (assigning malicious intent to others) than other children, particularly in ambiguous situations where the intent of others was not clear. This situational ambiguity is particularly salient to the perceptions of those with stigmatized status regarding the motives of those with dominant status. Using a sample of Black and White college students, Crocker and colleagues (1991) found that Black students were more likely to attribute prejudiced motives to the negative reactions of White peers when they perceived race was an issue.
Taken together, this literature suggests that aggressive adolescents may have particular difficulty in correctly understanding the nuances of interactions, especially with others who are from a different racial or ethnic group. Because of these interactional difficulties, aggressive adolescents who are rejected by peer and other social groups may perceive the rejection as due to discrimination rather than to their own behavior. The question of temporal order becomes an important one given that aggressive behavior can escalate with rejection. Understanding the aggressive behavior-perceived discrimination relationship would inform prevention and intervention programming for aggressive Indigenous youth.
Associations between Anger, Aggression, and Perceived Discrimination
Several causes of anger have been identified, such as someone or something which prevents one from attaining goals, creates or causes unpleasant events, or treats one unfairly (Berkowitz and Harmon-Jones 2004). Thus it is easy to see anger as a natural emotional response to experiences of discrimination. For example, research with the Mapuche people of Chile found that experiences with discrimination led to feelings of anger, as well as shame and feelings of powerlessness (Mellor et al. 2009). Anger has also been identified as an antecedent to aggression (Camodeca and Goosens 2005; Cornell, Peterson, and Richards 1999). Moreover, Agnew recognized anger as an intervening mechanism between stress and delinquent behavior in hisGeneral Strain Theory (1992, 2001). The first model in Figure 1 provides a graphic illustration of this argument, which has been supported in the literature on delinquency. In their longitudinal study of high school youth, Aseltine, Gore and Gordon (2000) found that family conflict and negative life events, both sources of strain, increased anger, which in turn increased aggressive delinquency. Although no research to date has looked specifically at discrimination, anger, and aggression among Indigenous youth, Whitbeck and colleagues (2001) found that perceived discrimination was associated with early onset substance use via its effects on anger and delinquent behavior in a sample of American Indian middle school students.
On the other hand, however, anger may also be fueled by having a negative appraisal of a situation or event (Smith et al. 1993), which casts doubt on assumptions that anger precedes aggression. Individuals with a hostile attribution bias or who believe that reactions to their aggressive behaviors are prejudiced may become angry in response to perceived unfair treatment (Figure 1, Model 2). Although anger has been conceptualized as an intervening variable in the stress-delinquency relationship (Agnew 1992, 2001), Agnew et al. (2002) also described angry adolescents as more likely to perceive interactions as malicious and to have more intense emotional reactions to those events. Although there is more support in the literature for the first argument, the temporal order of aggression and anger remains ambiguous.
DATA & METHODS
Sample
These data were collected as part of an ongoing longitudinal study designed in partnership with four U.S. reservations, four Canadian First Nations reserves, and a university-based research team. The reservations/reserves share a common cultural tradition and language with minor regional variations in dialects. The sample represents one of the most populous Indigenous cultures in the United States and Canada. As part of this partnership’s confidentiality agreements, the names of the cultural group and participating reservations and reserves will not be identified. At each site, Tribal Council-appointed advisory boards are responsible for handling personnel difficulties, advising the research team on questionnaire development, and reviewing/approving reports and presentation proposals. All participating staff on the reservations and reserves (i.e., interviewers, site coordinators) were approved by advisory boards and were either enrolled tribal members or in a very few cases, spouses of enrollees. Interviewers for this project were trained prior to each interview wave concerning methodological guidelines of personal interviewing and protection of human subjects.
Each participating reservation/reserve provided a list of families of tribally-enrolled children aged 10–12 years (with some minor variations due to birthdays from time of recruitment) who lived on or proximate to (within 50 miles) the reservation or reserve. We attempted to contact all families with a target child within the specified age range in order to achieve a population sample within participating communities of this cultural group. Families for this study were recruited through personal interviewer visits during which they were presented a traditional gift, an overview of the project, and an invitation to participate. For those families who agreed to participate, both the target adolescent and at least one adult caretaker (and in some cases, two adults) were interviewed and were given $40 upon completion of the interviews. Recruitment and incentive procedures were approved both by community-based advisory boards and the University IRB. The recruitment procedure resulted in an initial response rate of 79.4%. Retention rates ranged from 94.6% at Wave 2 to 90% at Wave 5.
Measures
Aggression was assessed using the aggression subscale from the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (American Psychiatric Association 1994) conduct disorder criteria. This measure is a summed count of six dichotomous indicators of aggressive behaviors at each wave of data collection. Adolescents were asked if they had done any of the following in the past twelve months: threatened or frightened someone on purpose; been in a physical fight in which someone was or could have been hurt; started a physical fight in which someone was or could have been hurt; tried to hurt someone badly or been physically cruel to someone; hurt someone with a weapon; and threatened someone with a weapon. Youth who answered ‘yes’ were coded as 1, ‘no’ was coded as 0. The measure had acceptable internal reliability at each wave, with Cronbach’s α ranging from .71 at Wave 2 to .75 at Wave 5.
Perceived Discrimination is a measure adapted from the Schedule of Racist Events (Landrine and Klonoff 1996) that has been validated in prior studies of Indigenous populations (Whitbeck et al. 2001). This measure is a mean indicator of the frequency of experiencing specific instances of discrimination. The adolescents were asked seven questions regarding how often in the past twelve months the following experiences occurred because of their ethnicity: other kids have said something bad or insulting to you; a store owner, sales clerk, or person working at a place of business treated you in a disrespectful way; other kids ignored you or left you out of some activity; adults suspected you of doing something wrong; someone yelled a racial slur or racial insult at you; other kids treated you badly; and you had a teacher who didn’t expect you to do well. Response options ranged from 0 = never to 2 = many times. Higher scores reflect more perceived discrimination. Cronbach’s α for this scale was .83 at Wave 2, .80 at Wave 3, and .81 at Wave 5.
Anger was assessed using the Tri-Ethnic anger scale (Oetting, Beauvais, and Edwards 1988). This measure is a mean indicator of the frequency of experiencing feelings of anger. The adolescents were asked six questions about how often they feel angry, are quick-tempered, get mad, feel like hitting someone, fly off the handle, or are hotheaded. Response options ranged from 0 = none of the time to 2 = most of the time, with higher scores reflecting more anger. The measure has good internal reliability with Cronbach’s α of .79 at Wave 2, .81 at Wave 3, and .83 at Wave 5.
Control Variables
Remote Location refers to the proximity of the adolescent’s reservation or reserve to towns or other communities. There are two locations identified for this sample. A rural location refers to those reservations within somewhat close proximity to other towns, and remote refers to those far removed from other communities. All reservations and reserves are either rural or remote. The variable is coded so that 0 = rural and 1 = remote. Age is a continuous measure of the target adolescent’s age on his or her last birthday at Wave 2. Gender is dichotomized and coded such that 0 = male and 1 = female. Per capita family income is measured by asking parents/caretakers to indicate their overall household incomes at Wave 2 as above or below $25,000 in the past year. Two other questions narrow that response to $10,000–$15,000 ranges. Midpoints of these ranges were divided by the number of people living within the household, which was then divided by 1,000 to set the metric of this measure in thousands of dollars.
Method
A series of autoregressive cross-lagged path models were tested to answer the first and second research questions regarding the temporal order of discrimination and aggression, and anger and aggression. This type of model allows cross-variable associations to be measured after controlling for within-variable associations, and also allows for reciprocal relationships to be tested (Burkholder and Harlow 2003). First, we tested a model for discrimination and aggression, which included autoregressive paths from aggression at Wave 2 (AggressionW2) to aggression at Wave 3(AggressionW3), and perceived discrimination at Wave 2 (DiscriminationW2) to Wave 3 perceived discrimination (DiscriminationW3), plus cross-sectional correlations between the two constructs (AggressionT2 with DiscriminationW2, AggressionW3 with DiscriminationW3). In addition, cross-lag paths were added from discrimination to subsequent aggression, and aggression to subsequent discrimination. We also control for age, gender, remote location, and per capita family income. We then tested a model for anger and aggression following the same procedure. The basic autoregressive cross-lag model is shown in Figure 2.
To answer the third research question regarding the mediating role of anger, we use the results of the cross-lagged models to specify temporal order to estimate a path model of perceived discrimination and anger predicting later aggression. In this model, aggression at Wave 5 was added as a distal outcome of earlier discrimination and anger. We estimated cross-lagged paths from discrimination to anger and subsequent aggression, and from anger to subsequent aggression. As in the cross-lag models, autoregressive paths and cross-sectional correlations were included. Decomposition of effects was used to assess the indirect effects of early discrimination and anger on later aggression.
All autoregressive cross-lag model analyses were run with the Mplus structural equations program (Muthén and Muthén 2007). Results were interpreted in terms of the models’ goodness of fit, using the following indices: Tucker-Lewis Index (TLI), the comparative fit index (CFI), and the Root Mean Square Error of Approximation (RMSEA). Values of >.90 are considered acceptable for the TLI and CFI indices (Bentler 1990), and values of .05 to .08 for the RMSEA index reflect a satisfactory fit (Hu and Bentler 1999). Because two of the constructs (perceived discrimination and aggression) had positively skewed distributions, we used the maximum likelihood estimator with robust standard errors, which is robust to nonnormality (Asparouhov and Muthén 2005; Muthén and Muthén 2007).
The analyses are based on adolescent self-report data from Waves 2, 3, and 5, collected in 2003, 2004 and 2006. The baseline assessments of behaviors and experiences in the first wave of data collection used lifetime reports. In subsequent waves of full data collection (i.e., Wave 2, 3, and 5), the reports were for behaviors and experiences in the past year. The fourth wave of data collection was limited to mental health diagnostic questionnaires and did not include the focal measures used in the present analysis. At Wave 2, target adolescents were between 11 and 14 years of age, with a mean age of 12 years. The sample is 50% female, 8.9% live on a remote reserve, and the average per capita family income is $5,791. Means, standard deviations, and alpha reliabilities for the study variables are presented at the bottom of Table 1.
Table 1.
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Discrimination W2 | 1.00 | ||||||||||||
2 | Anger W2 | .21 *** | 1.00 | |||||||||||
3 | Aggression W2 | .26 *** | .42 *** | 1.00 | ||||||||||
4 | Discrimination W3 | .52 *** | .16 *** | .19 *** | 1.00 | |||||||||
5 | Anger W3 | .18 *** | .46 *** | .24 *** | .20 *** | 1.00 | ||||||||
6 | Aggression W3 | .21 *** | .29 *** | .43 *** | .23 *** | .31 *** | 1.00 | |||||||
7 | Discrimination W5 | .35 *** | .13 ** | .11 ** | .45 *** | .18 *** | .17 *** | 1.00 | ||||||
8 | Anger W5 | .16 *** | .38 *** | .17 *** | .18 *** | .41 *** | .16 *** | .24 *** | 1.00 | |||||
9 | Aggression W5 | .20 *** | .20 *** | .31 *** | .23 *** | .24 *** | .38 *** | .30 *** | .35 *** | 1.00 | ||||
10 | Remote Location | −.03 | −.10 ** | −.08 * | −.01 | −.16 *** | −.07 | −.08 | −.09 * | −.13 ** | 1.00 | |||
11 | Age | .04 | .05 | .14 *** | .11 ** | .05 | .13 ** | .03 | −.05 | .10 * | −.09 | 1.00 | ||
12 | Gender | .01 | −.02 | −.09 * | −.04 | −.01 | −.16 *** | .02 | .01 | −.14 *** | .04 | −.05 | 1.00 | |
13 | Per Capita Family Income | −.05 | −.09 * | −.09 * | −.08 * | −.06 | −.06 | −.05 | .00 | −.06 | −.01 | .05 | −.02 | 1.00 |
Mean | .21 | .95 | .75 | .21 | .97 | .82 | .26 | .94 | .99 | .09 | 12.08 | .50 | $ 5,791 | |
SD | .31 | .42 | 1.23 | .30 | .42 | 1.27 | .33 | .72 | 1.43 | .84 | $ 4,221 | |||
α | .83 | .70 | .71 | .80 | .74 | .72 | .81 | .76 | .75 |
p<.05;
p<.01;
p<.001
Missing Data
Over time, adolescents and their families left the study, and in some cases reentered it. There were 707 adolescents interviewed in Wave 2, 695 in Wave 3, and 672 in Wave 5. Because we are estimating change over time, the analyses included only those adolescents for whom we had observations for at least two time points on the focal variables (discrimination, anger, and aggression). Maximum likelihood estimation with robust standard errors was used to handle missing data, a technique that maximizes statistical power by borrowing information from the observed data (Enders 2010). Of the 708 adolescents for whom we had at least two observations, 16 cases had missing data on all of the exogenous variables and were excluded from the analysis, resulting in a final sample size of 692.
RESULTS
Univariate and Bivariate Analyses
The mean number of aggressive behaviors increased from .75 aggressive acts in the past year at Wave 2 to .99 aggressive acts at Wave 5 (bottom of Table 1). Although the overall prevalence of aggressive behaviors was low (indeed, a large majority of adolescents at each wave reported engaging in no aggressive behavior), it did increase over time. The frequency of experiencing discrimination remained low over time, ranging from .21 to .26. These values indicate that overall, adolescents reported experiencing discrimination never to a few times. Anger was higher than perceived discrimination but also remained steady over time, with values ranging from .94 to .97. This translates to adolescents feeling angry some of the time, on average.
Bivariate correlations (top of Table 1) indicate that discrimination, anger, and aggression are significantly associated with each other and that these associations occur across time. Significant positive associations were found among the focal variables at all three time points, as well as across the time points. DiscriminationW2 was correlated with anger and aggression at Waves 2, 3, and 5. AngerW2 was also correlated with aggression at all three waves. But in general, associations between the more proximal variables (i.e., measured at the same time-point) were stronger than those between distal variables. The strongest associations were between the same measures assessed at different time-points (e.g., perceived discrimination at Waves 2, 3, and 5).
Cross-Lagged Path Models
To address the first research question, does early aggression increase perceived discrimination, or do experiences with discrimination lead to aggressive behavior, a cross-lagged path model was estimated (Table 2). To test for gender differences in the sequence of perceived discrimination and aggression, multigroup models were estimated. The multigroup model tests did not indicate any significant differences in parameters across models. Because there were no gender group differences, the model in which gender was included as a control variable was used. Overall model fit was adequate. Both aggression and discrimination were quite stable across time. The autoregressive paths were all strong and significant, suggesting good reliability and measurement of these constructs across time. The cross-sectional correlations were also significant and positive, ranging from .13 to .26. The path from perceived discrimination to later aggression was significant and positive, even after controlling for prior aggression. There was no association between aggression and subsequent discrimination.
Table 2.
Explanatory Variables | Response Variables - Discrimination and Aggressiona
|
Response Variables - Anger and Aggressionb
|
||||||
---|---|---|---|---|---|---|---|---|
Discrimination W2 | Aggression W2 | Discrimination W3 | Aggression W3 | Anger W2 | Aggression W2 | Anger W3 | Aggression W3 | |
|
|
|||||||
Remote Location=1 | −.08 [.13] | −.25 * [.11] | −.40 ** [.14] | −.25 * [.11] | ||||
Age | .03 [.04] | .14 *** [.04] | .04 [.04] | .14 *** [.04] | ||||
Gender (female=1) | .04 [.08] | −.16 * [.08] | −.06 [.08] | −.16 * [.08] | ||||
Per Capita Family Income | −.04 [.04] | −.10 ** [.03] | −.12 ** [.04] | −.10 ** [.03] | ||||
Discrimination W2 | .50 *** [.04] | .11 * [.05] | ||||||
Aggression W2 | .06 [.04] | .41 *** [.04] | .04 [.04] | .39 *** [.05] | ||||
Anger W2 | .50 *** [.04] | .12 ** [.04] | ||||||
R2 | .00 | .04 ** | .27 *** | .20 *** | .03 * | .04 ** | .27 ** | .20 *** |
p<.05;
p<.01;
p<.001 (two-tailed tests)
Notes: Standard errors in parentheses.
Model fit: χ2(df)= 25.14(8). RMSEA = .06. CFI: .96. TLI: .88.
Model fit: χ2(df)= 22.24(8). RMSEA = .05. CFI: .97. TLI: .92.
The second research question, does aggressive behavior precede adolescent anger, or does anger lead to aggression, was addressed using an autoregressive cross-lagged path model, presented in Table 2. As with the prior model, multigroup modeling was used to estimate possible gender differences in the temporal ordering of anger and aggression. Because the tests did not indicate significant differences across gender groups, we included gender as a control variable in the final model. This model had good fit. The autoregressive path for anger was strong, indicating that anger was quite stable across time. The cross-sectional correlations between anger and aggression were larger at both time points than those between discrimination and aggression. The association between AngerW2 and AggressionW3 was significant and positive, even after controlling for earlier aggression. Most notably, the association between earlier aggression and later anger was not significant. To summarize the results of the two cross-lag path models, both perceived discrimination and anger were positively associated with later aggression, but aggression was not associated with either later discrimination or anger.
Path Model of Discrimination and Anger on Later Aggression
Once the temporal order of the variables was identified, a path model was estimated with earlier anger and perceived discrimination predicting later aggression (Figure 3, Table 3). Wave 5 Aggression, Perceived Discrimination, and Anger were added to the model. Because we did not test temporal ordering between perceived discrimination and anger, we included paths from anger to subsequent perceived discrimination, and from perceived discrimination to subsequent anger. Based on the fit criteria described above, the path model had an acceptable fit. The variables in the model explained about 18% of variance in adolescent aggression at Wave 5. Perceived discrimination was positively associated with subsequent (i.e., in the next wave) aggression and anger. Anger was positively associated with subsequent aggression but was not associated with subsequent perceived discrimination.
Table 3.
Explanatory Variables | Response Variables
|
||||||||
---|---|---|---|---|---|---|---|---|---|
Discrimination W2 | Anger W2 | Aggression W2 | Discrimination W3 | Anger W3 | Aggression W3 | Discrimination W5 | Anger W5 | Aggression W5 | |
Remote Location=1 | −.09 [.13] | −.40 ** [.14] | −.25 * [.11] | ||||||
Age | .03 [.04] | .04 [.04] | .14 *** [.04] | ||||||
Gender (female=1) | .04 [.08] | −.06 [.08] | −.16 * [.08] | ||||||
Per Capita Family Income | −.04 [.04] | −.12 *** [.04] | −.10 ** [.03] | ||||||
Discrimination W2 | .50 *** [.04] | .10 ** [.04] | .10 * [.05] | ||||||
Anger W2 | .06 [.04] | .50 *** [.03] | .11 ** [.04] | ||||||
Aggression W2 | .36 *** [.05] | ||||||||
Discrimination W3 | .44 *** [.04] | .10 ** [.04] | .14 *** [.04] | ||||||
Anger W3 | .06 [.04] | .39 *** [.04] | .11 ** [.04] | ||||||
Aggression W3 | .31 *** [.05] | ||||||||
R2 | .00 | .03 * | .04 ** | .27 *** | .28 *** | .21 *** | .21 *** | .17 *** | .18 *** |
p<.05;
p<.01;
p<.001 (two-tailed tests)
Notes: Standard errors in parentheses. χ2(df)= 114.97(37). Root mean square error of approximation = .06. Comparative fit index: .93. Tucker-Lewis index: .87.
To address the third research question regarding whether anger mediates the association between perceived discrimination and aggression, we examined the indirect effects of Perceived DiscriminationW2 on AggressionW5 (Table 4). The significant indirect effect via anger was small but statistically significant, indicating that anger partially mediates the association between perceived discrimination at Wave 2 and aggression at Wave 5. We also calculated the total effects of perceived discrimination as well as the indirect and total effects of angerat Wave 2 (direct effects from each of the Wave 2 variables on AggressionW5 were tested but neither the regression coefficients nor the chi-square test were significant; therefore we did not include those paths in the final model). Two interesting findings emerged. First, the effect of perceived discrimination at Wave 2 on aggression at Wave 5 was partially mediated by perceived discrimination at Wave 3. Further, the total effect of DiscriminationW2 on AggressionW5 was only slightly smaller in magnitude than the direct effect of Perceived Discrimination at Wave 3 on AggressionW5. These results suggest that early experiences with perceived discrimination may be just as important as later experiences in understanding aggressive behavior. Second, the effect of AngerW2 on AggressionW5 was partially mediated by anger at Wave 3, making the total effect of AngerW2 on AggressionW5 similar in magnitude to the direct effect of AngerW3 on AggressionW5. This indicates that early anger influences aggressive behavior both proximally and distally. In sum, early perceived discrimination and anger are each related to aggression three years later, and anger explains a portion of the perceived discrimination-aggression relationship.
Table 4.
Aggression W5 | |
---|---|
Discrimination W2 | |
Indirect thru Discrimination W3 | .07 ** |
Indirect thru Anger W3 | .01 * |
Indirect thru Aggression W3 | .03 |
Total Indirect Effect | .11 *** |
Anger W2 | |
Indirect thru Discrimination W3 | .01 |
Indirect thru Anger W3 | .06 ** |
Indirect thru Aggression W3 | .04 ** |
Total Indirect Effect | .10 *** |
p<.05;
p<.01;
p<.001 (two-tailed tests)
DISCUSSION AND CONCLUSIONS
We could locate no prior studies with Indigenous youth that established the temporal order of perceived discrimination, anger, and aggression, nor any research that has investigated whether anger mediates the association between discrimination and aggression. Thus, these findings make three important contributions to the sociology of mental health. First, we established that perceived discrimination was significantly and positively associated with later aggression among Indigenous adolescents, even when controlling for prior aggression, age, gender, income, and location. Prior empirical work has found significant associations between perceived discrimination and a host of negative outcomes (e.g., Sellers et al. 2003; Whitbeck et al. 2001), but to our knowledge this is the first longitudinal analysis that orders the association between perceived discrimination and aggression across time and does so with a sample of Indigenous youth. This finding fits well within the stress paradigm in which perceived discrimination has been widely conceptualized as a stressor that negatively impacts well-being (Harrell 2000; Williams, et al. 2003; Williams et al. 1997).
Second, we tested the temporal order of anger and aggression, and found that among this sample, anger was positively associated with changes in aggression. Prior research suggests that anger is a precursor to aggression (Aseltine et al. 2000; Camodeca and Goossens 2005; Cornell et al. 1999) but may also be a more common characteristic or reaction of aggressive children (Agnew et al. 2002; Smith et al. 1993). Our findings offer support for the first explanation, that among this sample of North American Indigenous youth, anger precedes aggressive behavior even when controlling for prior aggression, age, gender, income, and location.
Third, we found that anger partially mediates the perceived discrimination-aggression association. Early perceived discrimination (i.e., at Wave 2 when adolescents were ages 11 to 13 years) were associated with aggressive behavior three years later via its effects on subsequent anger (i.e., at Wave 3). Further, the effects of perceived discrimination may be cumulative. Perceived discrimination at Wave 2 was associated with aggression at Wave 5 via its effects on perceived discrimination at Wave 3. These findings indicate that perceived discrimination has both more proximal, direct effects on aggression as well as distal effects, through anger and later perceived discrimination, that accumulate over time for these adolescents. Despite stability in perceived discrimination and anger, aggressive behavior increased among these Indigenous adolescents, suggesting that early experiences of perceived discrimination and the anger associated with them have longer-term consequences for aggressive behavior. The same pattern held for anger. A small but growing body of research has identified perceived discrimination as an important contributor to negative health and mental health outcomes for Indigenous people (e.g., Mellor et al. 2009; Walls et al. 2007; Whitbeck et al. 2001; Yoder et al. 2006). We expand on this literature by demonstrating perceived discrimination’s effects on aggression as well as its indirect effects via anger and subsequent perceived discrimination for Indigenous youth.
This study provides further evidence of the detrimental effects of perceived discrimination on adolescent well-being, and does so with an understudied population of North American Indigenous adolescents. The life courses of different racial and ethnic groups are “products of not only their specific individual experiences but also their membership in historically distinct and unequal social and economic groupings” (Hawkins, Laub, and Lauristen 1998:40). Following Wheaton and Clark’s (2003) argument that past social contexts are important to present functioning, we posit that current social contexts are important to future functioning and well-being.
The present study offers important insights for crime and delinquency scholars as well. Perceived discrimination has been notably absent from criminological explanations of aggressive and delinquent behaviors (Unnever et al. 2009). Trying to explain differences in crime and delinquency for minority groups, and in particular for Indigenous youth, by looking only at individual-level explanatory factors and excluding social and historical contexts will give an incomplete picture. Perceived discrimination is a significant source of strain for minority adolescents that affects negative emotional responses such as anger, both of which are important in understanding why some Indigenous adolescents engage in aggressive behavior. Although not the only explanatory factors, perceived discrimination and anger do serve to situate the behavior in both contemporary and historical contexts.
Limitations
As with all research, this study has limitations that need to be considered. First, although this is a prospective longitudinal study, only three waves of data were available for this analysis. Replicating this study as the adolescents age into adulthood will enrich our understanding of the developmental and potentially cumulative effects of discrimination and anger on aggressive behavior. Second, although we were able to establish the temporal order of the variables, we do not claim that discrimination or anger cause adolescents to become aggressive. By accounting for prior levels of aggression, however, perceived discrimination and anger are each positively associated with changes in aggression and likely contribute to the development of aggression during adolescence. Future research on younger respondents that measures discrimination, anger, and aggression, as well as alternative explanations for aggression, is necessary to better understand the contributions of perceived discrimination and anger to the etiology of aggression. Third, these results may not be generalizable to different Indigenous cultures. The diversity of Indigenous cultures within the United States and Canada is substantial, and the patterns and findings of this study may not apply to other cultures. Fourth, this sample is entirely rural and may not reflect experiences of urban Indigenous adolescents. Even with these limitations in mind, we believe that the findings of this study contribute to the overall literatures on aggression and perceived discrimination, particularly as they apply to minority adolescents.
Conclusions
This research lays the foundation for further longitudinal studies pertaining to the effects of perceived discrimination on the development of young people. It is very clear from these analyses that discrimination experiences contribute to the etiology of anger and aggressive behaviors among Indigenous adolescents. It is likely that this same pattern will hold for the effects of other negative developmental outcomes such as psychological distress and substance abuse. The issue of timing is extremely important. Many adolescents may experience discrimination for the first time in their teenage years, yet others may have even earlier experiences. Emerging research on the childhood stress suggests that early adversity such as discrimination contributes to health, mental health, and behavioral disparities, across the lifecourse, as well as the intergenerational transmission of disparities (Shonkoff et al. 2012). As Pearlin and colleagues (2005) note, “early adversity in an important domain of life can be connected to later health when that adversity has a presence that reaches across time” (209). There is a need for further research in Indigenous communities that will enhance our understanding of the effects of perceived discrimination, as well as the mechanisms through which they function, on the well-being of Indigenous people over the life course.
As evidence mounts that discrimination is an important stressor for minority adults and adolescents, it is critical that we develop early responses to ameliorate its effects. These could involve family-based programs where families are taught to develop action plans to deal with discrimination assertively rather than trying to cope passively or to lash out. School based programs should do more than demonstrate that discrimination exists; they need to teach skills for dealing with the associated anger and the potential for acting on it. Finally, we need efforts at the macro-level to address structural inequalities to “lessen people’s lifetime accruals of events and chronic hardships” (Thoits 2010: S47). Perceived discrimination is but one of many strains related to their unequal social position that these reservation-dwelling Indigenous youth experience. North American Indigenous people also face frequent reminders of the historical losses their people have suffered, including ethnic cleansing, boarding schools, and forced relocation to reservations and reserves (Duran and Duran 1995; Whitbeck, Chen, et al. 2004). With few economic and educational opportunities and high rates of poverty (Ogunwole 2006), many reservations resemble third world countries. As Thoits notes in her review of stress research (2010), the stressors of minority group status, including discrimination, are additive in their harmful effects on well-being and contribute to the proliferation of disparities across generations. As the present study demonstrates, the accumulation of perceived discrimination experiences and its effects on anger has long-term consequences for aggressive among Indigenous youth.
Footnotes
This research was funded by the National Institute on Drug Abuse (DA13580) and the National Institute of Mental Health (MH67281), Les B. Whitbeck, Principal Investigator.
Contributor Information
Kelley J. Sittner Hartshorn, Email: khartshorn2@unl.edu, University of Nebraska-Lincoln, 210 Benton Hall, Lincoln NE 68588-0623.
Les B. Whitbeck, Email: lwhitbeck2@unl.edu, Department of Sociology, University of Nebraska-Lincoln, 739 Oldfather Hall, Lincoln, NE 68588-0324.
Dan R. Hoyt, Email: dhoyt2@unl.edu, Department of Sociology, University of Nebraska-Lincoln, 709 Oldfather Hall, Lincoln, NE 68588-0324.
References
- Agnew Robert. Building on the Foundation of General Strain Theory: Specifying the Types of Strain Most Likely to Lead to Crime and Delinquency. Journal of Research in Crime and Delinquency. 2001;38(4):319–361. [Google Scholar]
- Agnew Robert. Foundation for a General Strain Theory of Crime and Delinquency. Criminology. 1992;30(1):47–88. [Google Scholar]
- Agnew Robert, Brezina Timothy, Wright John Paul, Cullen Francis T. Strain, Personality Traits, and Delinquency: Extending General Strain Theory. Criminology. 2002;40(1):43–72. [Google Scholar]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4. Washington, DC: American Psychiatric Association; 1994. [Google Scholar]
- Aseltine Robert H, Gore Susan, Gordon Jennifer. Life Stress, Anger and Anxiety, and Delinquency: An Empirical Test of General Strain Theory. Journal of Health and Social Behavior. 2000;41(3):256–275. [PubMed] [Google Scholar]
- Asparouhov Tihomir, Muthén Bengt. Multivariate Statistical Modeling with Survey Data. Proceedings of the Federal Committee on Statistical Methodology (FCSM) Research Conference.2005. [Google Scholar]
- Bachman Ronet. Death and Violence on the Reservation: Homicide, Family Violence, and Suicide in American Indian Populations. New York: Auburn House; 1992. [Google Scholar]
- Bentler Peter M. Comparative Fit Indexes in Structural Models. Psychological Bulletin. 1990;107(2):238–246. doi: 10.1037/0033-2909.107.2.238. [DOI] [PubMed] [Google Scholar]
- Berkowitz Leonard, Harmon-Jones Eddie. Toward an Understanding of the Determinants of Anger. Emotion. 2004;4(2):107–130. doi: 10.1037/1528-3542.4.2.107. [DOI] [PubMed] [Google Scholar]
- Burkholder Gary J, Harlow Lisa L. An Illustration of a Longitudinal Cross-Lagged Design for Larger Structural Equation Models. Structural Equation Modeling. 2003;10(3):465–486. [Google Scholar]
- Caldwell Cleopatra H, Kohn-Wood Laura P, Schmeelk-Cone Karen H, Chavous Tabbye M, Zimmerman Marc A. Racial Discrimination and Racial Identity as Risk or Protective Factors for Violent Behaviors in African American Young Adults. American Journal of Community Psychology. 2004;33(1):91–105. doi: 10.1023/b:ajcp.0000014321.02367.dd. [DOI] [PubMed] [Google Scholar]
- Camodeca Marina, Goossens Frits A. Aggression, Social Cognitions, Anger and Sadness in Bullies and Victims. Journal of Child Psychology and Psychiatry. 2005;46(2):186–197. doi: 10.1111/j.1469-7610.2004.00347.x. [DOI] [PubMed] [Google Scholar]
- Cornell Dewey G, Peterson Catherine S, Richards Herbert. Anger as a Predictor of Aggression among Incarcerated Adolescents. Journal of Consulting and Clinical Psychology. 1999;67(1):108–115. doi: 10.1037//0022-006x.67.1.108. [DOI] [PubMed] [Google Scholar]
- Crick Nicki R, Dodge Kenneth A. Social Information-Processing Mechanisms in Reactive and Proactive Aggression. Child Development. 1996;67(3):993–1002. [PubMed] [Google Scholar]
- Crocker Jennifer, Voelkl Kristin, Testa Maria, Major Brenda. Social Stigma: The Affective Consequences of Attributional Ambiguity. Journal of Personality and Social Psychology. 1991;60(2):218–228. doi: 10.1037//0022-3514.64.1.60. [DOI] [PubMed] [Google Scholar]
- Dodge Kenneth A, Crick Nicki R. Social Information-Processing Bases of Aggressive Behavior in Children. Personality and Social Psychology Bulletin. 1990;16(1):8–22. [Google Scholar]
- Dodge Kenneth A, Lansford Jennifer E, Burks Virginia Salzer, Bates John E, Pettit Gregory S, Fontaine Reid, Price Joseph M. Peer Rejection and Social Information-Processing Factors in the Development of Aggressive Behavior Problems in Children. Child Development. 2003;74(2):374–393. doi: 10.1111/1467-8624.7402004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duran Eduardo, Duran Bonnie. Native American Postcolonial Psychology. Albany, NY: State University of New York Press; 1995. [Google Scholar]
- Enders Craig K. Applied Missing Data Analysis. New York: The Guilford Press; 2010. [Google Scholar]
- Greenfeld Lawrence A, Smith Steven K. American Indians and Crime. Washington, DC: Bureau of Justice Statistics; 1999. [Google Scholar]
- Harrell Shelly P. A Multidimensional Conceptualization of Racism-Related Stress: Implications for the Well-Being of People of Color. American Journal of Orthopsychiatry. 2000;70(1):42–57. doi: 10.1037/h0087722. [DOI] [PubMed] [Google Scholar]
- Hawkins Darnell F, Laub John H, Lauristen Janet L. Race, Ethnicity, and Serious Juvenile Offending. In: Loeber Rolf, Farrington David P., editors. Serious and Violent Juvenile Offenders: Risk Factors and Successful Interventions. Thousand Oaks, CA: Sage Publications; 1998. pp. 30–46. [Google Scholar]
- Hoffmann John P. A Life-Course Perspective on Stress, Delinquency, and Young Adult Crime. American Journal of Criminal Justice. 2010;35(3):105–120. [Google Scholar]
- Hoffmann John P, Cerbone Felicia Gray. Stressful Life Events and Delinquency Escalation in Early Adolescence. Criminology. 1999;37(2):343–374. [Google Scholar]
- Hu Li-tze, Bentler Peter M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling. 1999;6(1):1–55. [Google Scholar]
- Kessler Ronald C, Mickelson Kristin D, Williams David R. The Prevalence, Distribution, and Mental Health Correlates of Perceived Discrimination in the United States. Journal of Health and Social Behavior. 1999;40(3):208–230. [PubMed] [Google Scholar]
- Landrine Hope, Klonoff Elizabeth A. The Schedule of Racist Events: A Measure of Racial Discrimination and a Study of Its Negative Physical and Mental Health Consequences. Journal of Black Psychology. 1996;22(2):144–168. [Google Scholar]
- Martin Monica J, McCarthy Bill, Conger Rand D, Gibbons Frederick X, Simons Ronald L, Cutrona Carolyn E, Brody Gene H. The Enduring Significance of Racism: Discrimination and Delinquency Among Black American Youth. Journal of Research on Adolescence. 2011;21:662–676. doi: 10.1111/j.1532-7795.2010.00699.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mellor David, Merino María Eugenia, Saiz José L, Quilaqueo Daniel. Emotional Reactions, Coping and Long-Term Consequences of Perceived Discrimination among the Mapuche People of Chile. Journal of Community & Applied Social Psychology. 2009;19(6):473–491. [Google Scholar]
- Meyer Ilan H. Minority Stress and Mental Health in Gay Men. Journal of Health and Social Behavior. 1995;36(1):38–56. [PubMed] [Google Scholar]
- Muthén Linda K, Muthén Bengt O. Mplus User’s Guide. 5. Los Angeles: Muthen & Muthen; 2007. [Google Scholar]
- Oetting Eugene R, Beauvais Fred, Edwards Ruth. Alcohol and Indian Youth: Social and Psychological Correlates and Prevention. Journal of Drug Issues. 1988;18(1):87–101. [Google Scholar]
- Patterson Gerald R, DeBaryshe Barbara D, Ramsey Elizabeth. A Developmental Perspective on Antisocial Behavior. The American Psychologist. 1989;44(2):329–35. doi: 10.1037//0003-066x.44.2.329. [DOI] [PubMed] [Google Scholar]
- Pearlin Leonard I. Stress and Mental Health: A Conceptual Overview. In: Horwitz Allan V, Schied Teresa L., editors. A Handbook for the Study of Mental Health: Social Contexts, Theories, and Systems. Cambridge, UK: Cambridge University Press; 1999. pp. 161–175. [Google Scholar]
- Pearlin Leonard I, Schieman Scott, Fazio Elena M, Meersman Stephen C. Stress, Health, and the Life Course: Some Conceptual Perspectives. Journal of Health and Social Behavior. 2005;46(2):205–219. doi: 10.1177/002214650504600206. [DOI] [PubMed] [Google Scholar]
- Perry Steven W. American Indians and Crime - A BJS Statistical Profile, 1992–2002. U.S. Department of Justice, Bureau of Justice Statistics; 2004. [Google Scholar]
- Royal Commission on Aboriginal Peoples. Highlights from the Report of the Royal Commission on Aboriginal Peoples. Indian and Northern Affairs Canada. 1996 Retrieved July 2, 2010 ( http://www.ainc-inac.gc.ca/ap/pubs/rpt/rpt-eng.asp)
- Sellers Robert M, Caldwell Cleopatra H, Schmeelk-Cone Karen H, Zimmerman Marc A. Racial Identity, Racial Discrimination, Perceived Stress, and Psychological Distress among African American Young Adults. Journal of Health and Social Behavior. 2003;44(3):302–317. [PubMed] [Google Scholar]
- Shonkoff Jack P, Garner Andrew S, et al. The Lifelong Effects of Early Childhood Adversity and Toxic Stress. Pediatrics. 2012;129:e232–e246. doi: 10.1542/peds.2011-2663. [DOI] [PubMed] [Google Scholar]
- Smith Craig A, Haynes Kelly N, Lazarus Richard S, Pope Lois K. In Search of the ‘Hot’ Cognitions: Attributions, Appraisals, and Their Relation to Emotion. Journal of Personality and Social Psychology. 1993;65(5):916–929. doi: 10.1037//0022-3514.65.5.916. [DOI] [PubMed] [Google Scholar]
- Taylor John, Jay Turner R. Perceived Discrimination, Social Stress, and Depression in the Transition to Adulthood: Racial Contrasts. Social Psychology Quarterly. 2002;65(3):213–225. [Google Scholar]
- Thoits Peggy A. Stress and Health. Journal of Health and Social Behavior. 2010;51(1 suppl):S41–S53. doi: 10.1177/0022146510383499. [DOI] [PubMed] [Google Scholar]
- Unnever James D, Cullen Francis T, Mathers Scott A, McClure Timothy E, Allison Marisa C. Racial Discrimination and Hirschi’s Criminological Classic: A Chapter in the Sociology of Knowledge. Justice Quarterly. 2009;26(3):377–409. [Google Scholar]
- Vega William A, Rumbaut Rubén G. Ethnic Minorities and Mental Health. Annual Review of Sociology. 1991;17:351–383. [Google Scholar]
- Walls Melissa L, Whitbeck Les B, Hoyt Dan R, Johnson Kurt D. Early-Onset Alcohol Use Among Native American Youth: Examining Female Caretaker Influence. Journal of Marriage and Family. 2007;69(2):451–464. [Google Scholar]
- Wheaton Blair. Sampling the Stress Universe. In: Avison William R, Gotlib Ian H., editors. Stress and Mental Health: Contemporary Issues and Prospects for the Future. New York: Plenum Press; 1994. pp. 77–114. [Google Scholar]
- Wheaton Blair, Clarke Philippa. Space Meets Time: Integrating Temporal and Contextual Influences on Mental Health in Early Adulthood. American Sociological Review. 2003;68(5):680–706. [Google Scholar]
- Whitbeck Les B, Chen Xiaojin, Hoyt Dan R, Adams Gary W. Discrimination, Historical Loss and Enculturation: Culturally Specific Risk and Resiliency Factors for Alcohol Abuse among American Indians. Journal of Studies on Alcohol. 2004;65(4):409–418. doi: 10.15288/jsa.2004.65.409. [DOI] [PubMed] [Google Scholar]
- Whitbeck Les B, Hoyt Dan R, Chen Xiaojin, Stubben Jerry D. Predictors of Gang Involvement among American Indian Adolescents. Journal of Gang Research. 2002;10(1):11–26. [Google Scholar]
- Whitbeck Les B, Hoyt Dan R, McMorris Barbara J, Chen Xiaojin, Stubben Jerry D. Perceived Discrimination and Early Substance Abuse among American Indian Children. Journal of Health and Social Behavior. 2001;42(4):405–424. [PubMed] [Google Scholar]
- Whitbeck Les B, McMorris Barbara J, Hoyt Dan R, Stubben Jerry D, LaFromboise Teresa D. Perceived Discrimination, Traditional Practices, and Depressive Symptoms among American Indians in the Upper Midwest. Journal of Health and Social Behavior. 2002;43(4):400–418. [PubMed] [Google Scholar]
- Williams David R, Takeuchi David T, Adair Russell K. Socioeconomic Status and Psychiatric Disorder among Blacks and Whites. Social Forces. 1992;71(1):179–194. [Google Scholar]
- Williams David R, Neighbors Harold W, Jackson James S. Racial/Ethnic Discrimination and Health: Findings From Community Studies. American Journal of Public Health. 2003;98(Supplement_1):S29–37. doi: 10.2105/ajph.98.supplement_1.s29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams David R, Yu Yan, Jackson James S, Anderson Norman B. Racial Differences in Physical and Mental Health: Socio-economic Status, Stress and Discrimination. Journal of Health Psychology. 1997;2(3):335–351. doi: 10.1177/135910539700200305. [DOI] [PubMed] [Google Scholar]
- Yoder Kevin A, Whitbeck Les B, Hoyt Dan R, LaFromboise Teresa D. Suicidal Ideation Among American Indian Youths. Archives of Suicide Research. 2006;10(2):177–190. doi: 10.1080/13811110600558240. [DOI] [PubMed] [Google Scholar]
- Zimmerman Marc A, Ramierex-Valles Jesus, Wahienko Kathleen M, Walter Benjamin, Dyer Sandra. Resiliency in Ethnic Minority Families, Vol 1. Native and Immigrant American Families. Madison, WI: University of Wisconsin; 1996. Enculturation Hypothesis: Exploring Direct and Protective Factors among Native American Youth; pp. 199–219. [Google Scholar]