Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Aug 1.
Published in final edited form as: J Racial Ethn Health Disparities. 2019 Feb 20;6(4):733–742. doi: 10.1007/s40615-019-00572-1

Overt Perceived Discrimination and Racial Microaggressions and Their Association with Health Risk Behaviors among a Sample of Urban American Indian/Alaska Native Adolescents

Daniel L Dickerson 1, Ryan A Brown 2, David J Klein 2, Denis Agniel 2, Carrie Johnson 3, Elizabeth J D’Amico 2
PMCID: PMC6661006  NIHMSID: NIHMS1522243  PMID: 30788812

INTRODUCTION

American Indian/Alaska Native (AI/AN) adolescents experience significant health disparities [1-9], For example, AI/AN adolescents report high rates of alcohol use [2-4], marijuana use [5], commercialized tobacco use [1], mental health disorders [6], and physical health problems [7-9]. The population of AI/ANs residing in urban areas has been consistently growing, and now constitutes 70% of the overall AI/AN population [10]. AI/AN adolescents residing in urban areas tend to report high rates of illicit drug use, as well as mental and physical health problems [11-12]. AI/ANs have experienced a long and complex history of numerous traumas throughout history that may lead to risky health behaviors [13-15]. However, studies assessing factors contributing to risky health behaviors in this population are limited. Analyzing the potential effects of the broad range of perceived discrimination (PD) experiences, including both overt PD and racial microaggressions (RMA), among urban AI/AN adolescents on health outcomes offers a unique opportunity to further our understanding of these health disparities.

Researchers have theorized that exposure to various historically traumatic events is related to health disparities experienced by AI/ANs [13-15]. These historical traumas include forced removal from AI/AN homelands, forced placement into boarding schools with the intent of assimilating AI/AN youth into mainstream U.S. society, and laws prohibiting AI/ANs from practicing their religious and spiritual ceremonies [14]. A U.S. law postulated to contribute to various health disparities among urban AI/ANs is the Relocation Act of 1956 [16]. This Act financed the relocation of individual AIs and AI families to job training centers in designated U.S. cities. However, the relocation of AI/ANs to urban areas has been described as an attempt to abolish tribes through a process of assimilation, thereby “getting rid of the Indian problem” [17]. Rather than establishing economic stability, large numbers of AI/ANs who moved to urban areas became unemployed, homeless, and disconnected from their community-based support networks [18,19]. As a result, this relocation put AI/ANs who migrated to urban areas at risk for a variety of health problems [18-19] and appears to have contributed to an inter-generational effect whereby successive generations of urban AI/ANs continue to experience various health and other disparities [20,21].

The complex urban environment poses multiple challenges for AI/AN adolescents. Traditionally, AI/ANs lived in an extended family and community network. Through these connections, they were able to engage in AI/AN traditional practices that emphasized wellness and balance [22-24]. Although some urban AI/AN communities are comprised of tightly knit groups, many urban areas, including Los Angeles, are geographically and socially fragmented [25]. As a result, urban AI/AN adolescents often feel ostracized, socially disconnected, confused about their identity, and victimized [26,27]. For example, in a study conducted by our group in large urban areas in California, urban AI/AN adolescents reported a wide array of PD incidents, ranging from more blatant forms of discrimination, such as mockery, bullying, stereotypes, and harassment to more subtle forms such as being asked to be the “token Indian [27].” Meanwhile, Jones & Galliher suggest that pressure for Native youth to assimilate into mainstream culture may sometimes create expectations for them to demonstrate more “traditional” Native behaviors per stereotyped expectations of mainstream culture. This can often place them at greater risk of “being singled out” and experiencing discrimination [28].

Many studies have revealed experiences of PD across racial/ethnic groups, as well as relationships between these experiences and negative outcomes. For example, in one study conducted among 2,490 adolescents (African American 51%, Hispanic 31.4%, and White 17.8%), most (73%) reported experiencing racial/ethnic discrimination, and 42% of experiences were “somewhat’ or “very disturbing’ in terms of intensity [29]. PD may detrimentally affect numerous health conditions and problems among various minority racial/ethnic groups [29-32]. For example, adolescents who experienced racial/ethnic discrimination at least occasionally were more likely to report greater physical aggression, delinquency, and suicidal ideation [29]. Also, in a study identifying trajectories of PD from 9th grade through emerging adulthood among 2,722 Hispanic students, the group with increased discrimination had a higher risk of cigarette, alcohol, marijuana, and hard drug use compared to the low and stable discrimination group [31].

The history of overt racism and unjust actions experienced by AI/ANs is well documented. However, among AI/AN adolescents, most studies assessing associations of PD and health related disorders have been conducted on U.S. reservations and Canadian First Nation reserves. Studies conducted among these groups have shown that PD is associated with increased odds of being either a bully victim or a bully perpetrator [33], depressive symptoms [34], thinking about suicide [35], early substance use initiation [36], and increased risk for development of an alcohol use disorder [37].

RMA have recently received attention as an emerging form of PD. RMA refer to “subtle insults (verbal, nonverbal, and/or visual) directed toward racial minorities, often automatically or unconsciously” [38] and are well documented among the AI/AN population [39-44]. Among AI/ANs, some examples of RMA include: being asked to prove one’s “Indianness” or authenticity by a non-Native person, witnessing use of Indian mascots on sports teams, being told, “but you don’t look like a real Indian,” and being told by a non-Native person that he or she was an Indian in a past life or that their grandmother was a Cherokee princess. The emergence of RMA experienced by AI/ANs are reflective of newer and subtler forms of modem racial attitudes and covert efforts to maintain racial inequality [42].

Although research on RMA among AI/ANs has been limited, existing research suggests a link between RMA and negative health outcomes. For example, Walls et al. found that reports of RMA correlated with self-reported history of heart attack, worse depressive symptoms, and prior year hospitalization among adults diagnosed with type two diabetes [44]. In a study conducted among 114 Native American young adults with representation from nearly 70 distinct Indigenous groups from the contiguous U.S., Alaska, Canada, and Mexico, 98% reported experiencing at least one type of RMA. The extent to which participants were bothered by the RMA was mild. However, greater Native identification was strongly associated with more RMA experiences [41]. In a study utilizing the Microaggressions Distress Scale developed by Walters [39], greater reports of RMA were associated with higher odds of physical pain and impairment among a sample of gay, lesbian, bisexual, and other sexual-minority AI/AN adults. In addition, reports of experiencing RMA were positively associated with fair or poor health among participants with low levels of actualization, but this association was weak among those with high levels of actualization. Actualization referred to the degree to which respondents had a positive integration between self and group identity with regard to political, ethnic, racial, cultural, and spiritual dimensions of being Native. Furthermore, actualization was suggested to buffer the negative impact of discrimination [39]. Although the literature on RMA among AI/ANs has grown substantially in recent years, studies analyzing the role of RMA in leading to risky health behaviors among urban AI/AN adolescents across various health domains is currently limited.

Among urban AI/AN adolescents, to our knowledge, only one study has examined adolescents’ experiences of PD [12]. The authors conducted a secondary analyses study among a sample of 7th and 8th grade students enrolled in four urban middle schools in Washington State. Utilizing the discrimination subscale from the Multicultural Events Scale for Adolescents (MESA) [45,46]. participants reported whether six different events had occurred in the previous three months. Samples of events included: “You were unfairly accused of doing something bad because of your race or ethnicity” and “People put you down for practicing the customs or traditions of your own race or ethnicity or country of origin.” They found that urban AI/AN adolescents reported more PD in comparison to non-Hispanic Whites [12].

To further our understanding of the potential effects of PD (including both overt PD and RMA) on urban AI/AN adolescents, we examine associations between overt PD and RMA experiences and a variety of health outcomes among a sample of adolescents surveyed throughout the state of California. In this study, we utilize the short version of the Microaggressions Distress Scale [47], a culturally appropriate instrument that incorporates both overt PD and RMA items. We also analyze the association between overt PD and RMA and traditional practice participation to test whether effects of overt PD and RMA are moderated for adolescents with greater participation in traditional practices. Due to numerous studies demonstrating associations between PD among AI/AN adolescents [33-37], and various minority racial/ethnic groups [29-32], we hypothesized that overt PD and RMA would be associated with alcohol and marijuana use, commercialized tobacco use, consequences of alcohol and marijuana use, mental health, and general health status among our sample of urban AI/AN adolescents. We also hypothesized that greater traditional practice participation would decrease the association between experiences of overt PD and RMA and all health risk behaviors. This study provides an opportunity to deepen our understanding of ongoing health disparities among urban AI/ANs.

METHODS

Participants and Recruitment

We recruited participants as part of a randomized controlled trial analyzing the potential benefits of Motivational Interviewing and Culture for Urban Native American Youth (MICUNAY), a new culture-focused substance use prevention/intervention program targeting urban AI/AN adolescents ages 14-18 [48]. MICUNAY was initially developed by Drs. D’Amico and Dickerson in collaboration with community members, providers, and a MICUNAY community advisory board through a series of focus groups [48,49]. We developed MICUNAY in response to community recommendations for providing substance use interventions that integrated evidence-based treatments with AI/AN traditional healing practices [50,51]. Adolescents lived in urban areas in northern, central, and southern California. Inclusion criteria included verbally self-identifying as AI/AN (or being verbally identified by a family or community member as AI/AN) and being 14-18 years of age. We recruited with flyers at organizations serving AI/ANs, pow-wows and other community events, and community forums. A total of 185 youth completed a comprehensive baseline survey upon entering the study, including substance use characteristics, sociodemographic information, and cultural characteristics. Participants received a $25 gift card for completing the baseline survey. The study protocol was approved by the institution’s Internal Review Board. Three participants did not respond to any PD items and were therefore excluded, reducing the analytic sample size to 182 adolescents.

Measures

Demographics.

We asked participants questions about their age, gender, and tribal affiliation. Also, using categories established by National Institutes of Health (NIH), participants were asked to “mark all that apply” for the following categories: American Indian or Alaska Native, Hispanic or Latino/Latina, Asian or Asian American, Native Hawaiian or Pacific Islander, black or African American, white or Caucasian, and other. High school degree status of parents was also obtained.

Traditional practices.

Adolescents indicated whether they had ever participated in different traditional practices (choosing from a list of more than 20 traditional practices, such as attending Pow Wows, basket weaving, seeing a traditional healer, and playing Native hand or stick games). Adolescents reported how many times in their lives they participated in each traditional activity using a Likert scale from: never, 1 time, 2 times, 3 to 10 times, 11 to 20 times, to more than 20 times. Items are based upon extensive research conducted with AI/AN adolescents, parents, and community partners [52].

Alcohol marijuana use, and commercialized tobacco use.

Adolescents reported past-year alcohol, marijuana, and commercialized tobacco use with existing published measures [53]. Adolescents indicated how many times they used/tried at least one drink of alcohol or marijuana on a 6-point Likert scale from none to “more than 20 times.” Using this same scale, adolescents also reported past year heavy drinking by indicating the number of times they used/tried five or more drinks in a row within a couple of hours. Adolescents also answered questions about past year cigarette and electronic (e)-cigarette using the same 6-point Likert scale from none to “more than 20 times.” Adolescents answered questions about past year smokeless tobacco use on a 4-point Likert scale from none to “more than 20 times.” These were dichotomized to “any use” versus “no use”, which is typical given low use rates at younger ages [54].

Consequences of alcohol and marijuana use were assessed based on DSM-IV criteria with seven items for alcohol and five items for marijuana [53]. The seven questions for alcohol asked how many times in the past three months the following things happened because of drinking alcohol?: 1.) You felt really sick because of drinking alcohol, 2.) You got into trouble at school or home because of drinking alcohol, 3.) You did something you later felt sorry for because of drinking alcohol, 4.) You didn’t study for something you should have because of drinking alcohol, 5.) You got into a fight or argument because of drinking alcohol, 6.) You missed school because of drinking alcohol, and 7.) Could not remember what you did because of drinking alcohol. The five questions for marijuana asked how many times in the past three months the following things because of using marijuana (pot, weed, hash)?: 1.) You missed school because of using marijuana, 2.) You did something you later felt sorry for because of using marijuana, 3.) You got into trouble at school or home because of using marijuana, 4.) You had trouble concentrating on what you were doing because of using marijuana, and 5.) Could not remember what you did because of using marijuana. We analyzed indicators for any consequences versus no consequences in the previous three months.

Mental health.

Mental health was measured with the well-validated Mental Health Inventory-5 (α = .74) [55]. This survey consists of five questions asking during the past month:1.) How much of the time have you been a very nervous person?, 2.) How much of the time have you felt calm and peaceful?, 3.) How much of the time have you felt downhearted and blue?, 4.) How much of the time have you been a happy person?, and 5.) How often have you felt so down in the dumps that nothing could cheer you up? Relevant items were reversed so that a higher total score (transformed to range from 0-100, alpha=0.73) indicates better mental health.

General health status.

General health was assessed with one item (“In general, would you say health is [poor/fair/good/very good/excellent]?”) using a 5-point scale (1= poor to 5=excellent) from the SF-12 [56].

Overt perceived discrimination and racial microaggressions.

Experiences with both overt PD and RMA were measured using the short version of the Microaggressions Distress Scale [47]. Ten items ask about verbal, behavioral and environmental encounters in the last year that implicitly or explicitly diminished racial heritage, identity or culture (e.g., asked if real Indian by non-natives). The short version of the Microaggressions Distress Scale is designed to measure instances of overt PD as well as RMA specific to the experiences of AI/ANs and was developed with AI/AN community-based focus groups and reviewed for coherence and clarity by AI/AN researchers [47]. Adolescents reported whether the following events occurred in the the last twelve months: 1) Have you experienced unfair treatment by the police because you are Native?, 2) Have you experienced being called a racist name like Squaw or Red Skin?, 3) Have you experienced being trailed or followed around in a store because you are Native?, 4) Have you experienced being mistaken by non-Natives as a racial group other than Native?, 5) Have you experienced being told by a non-Native person that he or she was an Indian in a past life or that their grandmother was a Cherokee princess?, 6) Have you experienced being told by non-Natives that they felt a spiritual connection to Indians?, 7) Have you experienced being told by non-Natives how “lucky” you are to be Indian?, 8) Have you experienced being asked you are a “real Indian” by a non-Native person?, 9) Have you been asked to prove your Indianness or authenticity by a non-Native person?, and 10) Have you experienced being hit, kicked, or physically attacked because you are Native? Adolescents were considered to have endorsed having experienced a form of PD if they responded “Yes” or “I’m not sure, but I think so” to an item. We included “I’m not sure, but I think so” along with “Yes” due to the often subtle and indirect nature of RMA. We used the total number of forms of overt PD/RMA experienced by an individual for analysis. In the event that a respondent failed to answer all items (n = 3 individuals), missing endorsements were imputed as the average of the other items. Chronbach’s alpha for the scale was 0.80.

Statistical analysis.

To assess the association between overt PD and RMA and health outcomes, we conducted either logistic regression (for dichotomous outcomes: i.e., any use of each substance; presence of alcohol or marijuana consequences) or linear regression (for continuous outcomes: i.e., mental and physical health, traditional practices). Our power analysis found that for outcomes such as cigarette and e-cigarette use and marijuana and alcohol consequences, where the number of individuals reporting these behaviors is 25-30, we had 80% power to detect an effect with an odds ratio of about 3 for a five-unit increase in the short version of the Microaggressions Distress Scale. For more prevalent outcomes, such as alcohol use, we had 80% power to detect an odds ratio around 2.5.

For each outcome, we conducted a bivariate regression model to determine any unadjusted association with overt PD and RMA. We followed this with a second regression model controlling for age and gender to determine whether evidence for the association with overt PD and RMA remained after adjusting for these potential confounding characteristics. We divided the short version of the Microaggressions Distress Scale by 5 such that a one-unit increase represents five additional discriminatory events. This 5-unit jump is equivalent to the difference between an adolescent at the 25th percentile and an adolescent at the 75th percentile of the scale. The modified short version of the Microaggressions Distress Scale is entered into all models linearly. We performed all statistical analyses with SAS v9.4.

RESULTS

Demographics

The average age of the sample was 15.6, with somewhat fewer 17 (16.7%) and 18-year-olds (10.6%) in the study (Table 1). Males and females were evenly distributed. Among youth who knew about their parent’s education, a high percentage of mothers (80%) and fathers (73%) completed high school. AI/AN adolescents reported various mixed races, with the highest (46%) reporting Hispanic heritage. Thirty-five youth did not check AI/AN on the survey, although they self-identified verbally as AI/AN to be in the study. Over 100 tribes are represented. To protect the confidentiality of participants, we do not report tribal affiliations [57].

Table 1.

MICUNAY Descriptives (n=182)

Demographics No. (%)
Age
 14-year-old 50 (28)
 15-year-old 38 (21)
 16-year-old 43 (24)
 17-year-old 31 (17)
 18-year-old 19 (10)
Sex --
 Female 94 (52)
 Male 88 (48)
Race/EthnicityΛ --
 Hispanic/Latino(a) 83 (46)
 American Indian/Alaska Native 150 (82)
 Asian/Asian American/Pacific Islander 7 (4)
 Black/African American 20 (11)
 White/Caucasian 32 (18)
 Other 8 (4)
High School Degree --
 Mother 119 (80)
 Father 93 (73)
Perceived Discrimination and Outcomes Mean (SD) or No. (%)
 Short version of the Microaggressions Distress Scale (0-9) 3.6 (2.6)
 Participation in American Indian/Alaska Native Traditional Practices (lifetime) 95.1 (97.6)
 Mental Health Inventory-5 Score (0-100) 67.4 (18.5)
 General Health Status (present) (1-5) 3.7 (0.9)
 Cigarette use (any in past year) 27 (15)
 e-cigarette use (any in past year) 29 (16)
 Alcohol use (any in past year) 63 (35)
 Heavy drinking (any in past year) 43 (23)
 Marijuana use (any in past year) 66 (36)
 Consequences of alcohol use (any in past three months) 29 (16)
 Consequences of marijuana use (any in past three months) 28 (15)
Λ

Note that all youth had to self-identify as American Indian/Alaska Native (AI/AN) to be part of the project. They then completed a survey asking them to label their race/ethnicity. These numbers and percentages reflect what youth reported on the survey and can overlap if they identified more than one race/ethnicity. Thirty-five youth did not check AI/AN on the survey, although they self-identified verbally as AI/AN to be in the study.

Perceived discrimination and Racial Microaggressions

Adolescents reported experiencing a mean of 3.57 (standard deviation 2.64) overt PD/RMA events in the past year (Table 1), with a 25th percentile of 1, a median of 3.5, and a 75th percentile of 6. Thirty-two adolescents (18%) reported no overt PD/RMA in the past year, and an additional 19 (10%) reported only one form of overt PD/RMA. Thirty-one adolescents (17%) reported at least seven of the ten forms of overt PD/RMA. The remaining 55% experienced between two and six forms of overt PD/RMA.

Traditional Practices Participation

As shown in table 1, adolescents reported having participated in an average (SD) of 95.1 (97.6) AI/AN traditional practices during their lifetime. Going to Pow Wows was the most frequently reported activity (86%), followed by learning about tribal history (81%), eating Native foods (75%), and engaging in prayer (75%). Only 25% of our sample reporting engaging in traditional practices fewer than 21 times.

Risk Behaviors

As shown in Table 1, during the past year, 35% of adolescents reported alcohol use, 23% engaged in heavy drinking, and 36% used marijuana. Sixteen percent of adolescents reported experiencing any consequences due to alcohol in the past 3 months, and 15% reported any consequences from marijuana use. Fifteen percent of adolescents reported cigarette use, and 16% used e-cigarettes. The average score on the MHI-5 was 67.4; a 60 or higher is considered “good” mental health for adolescents [58]. Overall, 91% of adolescents reported their general health status as good, very good, or excellent.

Associations between discrimination and RMA and health risk behaviors

Throughout, we report odds ratios for the effects of experiencing five additional overt PD/RMA events, the interquartile range of overt PD/RMA events in our sample. As shown in Table 2, we found that after adjusting for age and gender, each additional five overt PD/RMA events were associated with 2.49 times the odds of reporting cigarette use in the past year [95% confidence interval (CI) 1.05-5.91, p=0.04]. Smaller non-significant associations and similarly wide confidence intervals were found for nearly all substance use outcomes after adjusting for age and gender: e-cigarette use in past year (adjusted odds ratio (AOR) 1.65, CI (0.74-3.66), any heavy drinking in the past year (AOR 1.23, CI 0.61-2.49), and any marijuana use in the past year (AOR 0.97, CI 0.52-1.81). There was a strong and significant association between overt PD/RMA and alcohol-related consequences in the past three months (AOR 3.02, CI 1.26-7.25, p=0.01). Furthermore, past month mental health scores were estimated to be 3.31 units lower for every five additional events after adjusting for age and gender, but the confidence interval was large, and included everything from an 8.38-unit deficit to a 1.76-unit benefit for the high-overt PD/RMA adolescents. Results were very similar for a parallel set of bivariate regression models (that is, when not adjusting for age and gender).

Table 2.

Associations between Discrimination and Health Risk Behaviors

Unadjusted Adjusted for age and
gender
Outcome OR (95% CI) p-
value
OR (95% CI) p-
value
Cigarettes (any in past year) 3.13 (1.37-7.13) 0.007 2.49 (1.05-5.91) 0.04
e-cigarettes (any in past year) 2.11 (0.98-4.56) 0.06 1.65 (0.74-3.66) 0.22
Drinking (any in past year) 1.60 (0.89-2.88) 0.11 1.24 (0.66-2.30) 0.51
Heavy drinking (any in past year) 1.69 (0.88-3.26) 0.12 1.23 (0.61-2.49) 0.56
Marijuana (any in past year) 1.34 (0.75-2.38) .32 0.97 (0.52-1.81) 0.93
Consequences relates to alcohol use (any in past three months) 3.80 (1.67-8.63) .001 3.02 (1.26-7.25) 0.013
Consequences related to marijuana use (any in past three months) 1.82 (0.84-3.95) .13 1.41 (0.63-3.17) 0.40
b (95% CI) p-
value
b (95% CI) p-
value
Mental health (past one month) −4.00 (2.60) 0.13 −3.31 (−8.38, 1.76) 0.20
Physical health (present) −0.07 (0.13) 0.59 0.02 (−0.23, 0.27) 0.89

For analysis, the discrimination scale has been divided by 5 such that a one unit increase represents five additional perceived discrimination events.

Due to the low numbers of youth who did not engage in traditional practices (3.3%), we were unable to analyze whether effects of overt PD and RMA on health behaviors were moderated by traditional activity participation.

DISCUSSION

This study contributes significantly to the literature in this area by providing an understanding of the role of overt PD and RMA and health behaviors experienced by urban AI/AN adolescents. Given that there is little work to date on AI/AN adolescents in urban settings, it is crucial that further studies be conducted analyzing the effects of overt PD and RMA among this understudied and marginalized population. Findings from this select sample of urban AI/AN adolescents provide an opportunity to explore potential protective factors that may help increase resiliency among adolescents of color, thereby decreasing health disparities experienced by disenfranchised populations. Overall, overt PD and RMA experiences among these urban AI/AN adolescents did not significantly affect their substance use or mental or physical health. After adjusting for age and gender, overt PD and RMA was only correlated with past year cigarette use and alcohol-related consequences experienced in the past three months. This was surprising, and contrasts with other studies that have demonstrated significant associations between PD and multiple health behaviors [29-32,33-37]. Due to the long history of historical trauma, overt PD, and RMA experienced by this population, one would expect to see correlations between overt PD and RMA and risky health behaviors within this population.

The correlation of commercialized smoking and overt PD and RMA among our sample of urban AI/AN adolescents is noteworthy due to the high prevalence of commercialized smoking among AI/AN adolescents [59], and due to higher likelihood of alcohol and illicit drug use among adolescents who smoke [60]. In a study conducted among AI youth in California, historical trauma was found to be a direct risk factor for cigarette smoking [61]. Findings in our study similarly suggest the potential risk for cigarette smoking among AI/AN adolescents who experience overt PD and RMA, which may be rooted in historically based traumas experienced by this population. Nonetheless, further studies analyzing the role of overt PD and RMA and their association with commercialized smoking with larger samples of urban AI/AN adolescents are suggested.

Findings from this study help elucidate the potential protective effects of cultural-connectedness as it relates to experiences of overt PD and RMA among a highly marginalized population. Cultural connectedness has been suggested to increase cultural exploration and identification with traditional Indigenous values, which may help create awareness of how to best cope with experiences of broader societal/institutional discrimination [62]. In a study conducted among a sample of Navajo adolescents, embeddedness in and connection to Navajo culture and, in some cases, connection to White American culture served as a buffer to the negative effects of discrimination [63]. The benefits of cultural-connectedness for urban AI/AN adolescents is also reflected in recent statewide reports in California [50,51]. These reports emphasize the importance that urban AI/AN communities place on participation in traditional practices and in establishing a more cohesive structured and visible AI/AN community within urban areas to reverse behavior and health problems among this population [50,51]. Traditional practices have gained increasing recognition in the literature with regard to the potential benefits of AI/AN traditional practices on health and well-being [22-24]. We recruited nearly all participants through community-based organizations, and the majority reported participation in traditional practices. Thus, given their higher level of cultural-connectedness, these urban AI/AN adolescents may have been able to buffer some of their experiences of overt PD and RMA. Further studies with larger urban AI/AN adolescent samples are needed to analyze the potential protective effects of cultural cohesion and connectedness and other factors that may help to decrease the effects of overt PD and RMA on health behaviors. Several reports have identified factors that reduce the effects of discriminatory experiences on individuals [64]. These factors include high self-regard for one's ancestral heritage, racial/ethnic group cohesion and connectedness, and parental processes that aid in coping strategies [64,65]. The negative influence of discrimination on mental health and behavioral outcomes is also suggested to be buffered among those with more positive personal evaluations of their racial group [66]. Findings from our study among urban AI/AN adolescents further substantiate these factors that may help to decrease the potential effect of overt PD and RMA on various health behaviors among racial/ethnic minority groups.

Another reason we may not have found associations between overt PD and RMA and most health outcomes may be due to the age of our sample. The effects of PD may accumulate across the lifespan [67]. Experiences of discrimination during the developmental stage of adolescence may be internalized and grow over time as the adolescent’s sense of self is being formed with their experiences of discrimination [68]. Thus, effects of overt PD and RMA on health outcomes may differ between adolescents and adults given that adolescents have not had as much time to process these experiences. Further longitudinal research is needed to assess the role of overt PD and RMA on outcomes during various stages of development among urban AI/AN adolescents.

Of note, 35 adolescents did not check AI/AN on their baseline survey, although they self-identified verbally as AI/AN to be in the study. This highlights the complexities of cultural and ethnic identity among AI/AN adolescents within the urban setting [69]. To date, there are few studies that address how AI/AN view themselves and navigate their identities [70], and how this may affect overall health and well-being. Further research should examine the role of identity in urban AI/AN adolescents, and how this relates to both overt PD and RMA and health outcomes.

Unfortunately, we are unable to test whether effects of overt PD and RMA on various health domains are moderated by greater participation in traditional practices due to overall high rates of participation observed in our sample. Future studies analyzing these associations among urban AI/AN adolescents may help clarify the potential role of traditional practice engagement in developing greater cultural connectedness and decreasing effects of overt PD and RMA experienced in this population.

This study has several limitations. First, the sample was from California and reported high levels of engagement in traditional practices, likely due to our recruitment within various AI/AN clinics. Thus, results are not generalizable to all urban areas in the U.S. Second, although recognized as a culturally relevant measure for overt PD and RMA, the short version of the Micoaggressions Distress Scale, to our knowledge, has not been fully evaluated psychometrically. Third, our mental health measure [55] is limited as it only included five questions. Thus, we may not have fully captured urban AI/AN adolescents’ mental health symptoms. In addition, although used widely [71], our measure of physical health only had one question and may therefore not have captured physical health with sufficient sensitivity. Furthermore, adolescents in this study may have minimized their physical health problems because serious, chronic health conditions generally do not emerge until adulthood. The limited research conducted on self-rated health among adolescents indicates that chronic health conditions generally do not contribute to their assessments of self-rated health [72]. Despite limitations, results provide important information on the role of overt PD and RMA among an understudied group in the U.S.

Conclusions

Although most urban AI/AN adolescents in our California sample reported experiencing overt PD and RMA, these experiences were generally not associated with their substance use or mental and physical health. We need more longitudinal work to examine associations between overt PD and RMA and various health domains among urban AI/AN adolescents to better understand the role of overt PD and RMA in this population. Future work is also needed that considers AI/AN cultural identity and participation in traditional practices in the context of urban environments, community attachment, and historical trauma loss to more fully contextualize our understanding of the role of overt PD and RMA on health behaviors among this population.

Acknowledgements:

We would like to acknowledge our funder, National Institute on Alcohol Abuse and Alcoholism (Grant number: R34AA024818, D’Amico/Dickerson, co-PIs).

Footnotes

Conflict of Interest: All authors declare that they have no conflict of interest.

REFERENCES

  • 1.Centers for Disease Control. American Indian and Alaska Natives Tobacco Use. 2018. https://www.cdc.gov/tobacco/disparities/american-indians/index.htm. Accessed 8 May 2018.
  • 2.Chen HJ, Balan S, Price RK. Association of contextual factors with drug use and binge drinking among White, Native American, and Mixed-Race adolescents in the general population. J Youth Adolesc. 2012; 41:1426–41. [PubMed: 22791181] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Friese B, Grube JW, Seninger S, Paschall MJ, Moore RS. Drinking behavior and sources of alcohol: Differences between Native American and White youths. J Stud Alcohol Drugs. 2011; 72:53–60. [PubMed: 21138711] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Stanley LR, Swaim RC. Initiation of alcohol, marijuana, and inhalant use by American-Indian and white youth living on or near reservations. Drug Alcohol Depend. 2015; 155:90–6. [PubMed: 26347406] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Swaim RC, Stanley LR. Multivariate family factors in lifetime and current marijuana use among American Indian and white adolescents residing on or near reservations. Drug Alcohol Depend. 2016; 169:92–100. [PubMed: 27810659] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Urban Indian Health Institutes. Urban American Indian and Alaska Native Youth: An Analysis of Select National Data Sources. 2009. http://www.uihi.org/wp-content/uploads/2012/10/2009-Youth-Report.pdf. Accessed 4 February 2018.
  • 7.Bullock A, Sheff K, Moore K, Manson S. Obesity and Overweight in American Indian and Alaska Native Children. 2006-2015. Am J Public Health. 2017; 107(9):1502–7. [PubMed: 28727519] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Dabelea D, Mayer-Davis EJ, Saydah S. Prevalence of type 1 and type 2 diabetes among children and adolescents from 2001 to 2009. JAMA. 2014; 311(17):1778–86. [PubMed: 24794371] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Indian Health Service. Disparities. 2018. https://www.ihs.gov/MedicalPrograms/Diabetes/HomeDocs/Resources/FactSheets/FactsheetAIAN508c.pdf. Assessed 10 August 2018.
  • 10.U.S. Census Bureau. (2010). Census 2010 American Indian and Alaska Native Summary File; Table: PCT2; Urban and rural; Universe Total Population; Population group name: American Indian and Alaska Native alone or in combination with one or more races. [Google Scholar]
  • 11.Rutman S, Park A, Castor M, Taualii M, Forquera R. Urban American Indian and Alaska Native Youth: Youth Risk Behavior Survey 1997–2003. Matem Child Health J. 2008; 12:S76–S81. [PubMed: 18483839] [DOI] [PubMed] [Google Scholar]
  • 12.Serafini K, Donovan DM, Wendt DC, Matsumiya B, McCarty CA. A Comparison of Early Adolescent Behavioral Health Risks Among Urban American Indians/Alaska Natives and their Peers. Am Indian Alsk Native Ment Health Res. 2017; 24(2):1–17. doi: 10.5820/aian.2402.2017.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Brave Heart MYH. Substance abuse, co-occurring mental health disorders, and the historical trauma response among American Indians/Alaska Natives (Research Monograph). Washington, DC: Bureau of Indian Affairs, Division of Alcohol and Substance Abuse Prevention; 2005. [Google Scholar]
  • 14.Duran E, Duran B. Native American post-colonial psychology. Albany: State University of New York; 1995. [Google Scholar]
  • 15.Johnson CL. An innovative healing model: Empowering urban Native Americans In: Witko T, ed. Mental health care for urban Indians: Clinical insights from Native practitioners (pp. 189–204). Washington, DC: American Psychological Association; 2006. [Google Scholar]
  • 16.Oklahoma State University. Indian Affairs: Laws and Treaties. n.d. http://dc.library.okstate.edu/digital/collection/kapplers. Accessed 3 March 2018.
  • 17.Blume A Social Issues in Living Color: volume 1: Challenges and Solutions from the Perspective of Ethnic Minority Psychology [3 volumes]. 2017. http://publisher.abcclio.com/9781440833373. Accessed 15 May 2018.
  • 18.Evans-Campbell T, Walters KL. Indigenist practice competencies in child welfare practice: a decolonization framework to address family violence and substance abuse among First Nations peoples In: Fong R, McRoy R, Ortiz Hendricks C (Eds). Intersecting child welfare, substance abuse, and family violence: Culturally competent approaches. Alexandria, VA: CSWE Press; 2006. [Google Scholar]
  • 19.LaFromboise TD, Berman JS, Sohi BK: American Indian women In: Comas-Diza L, Green B (Eds.): Women of color: Integrating ethnic and gender identities in Psychotherapy. New York, Guilford Press, 1994. [Google Scholar]
  • 20.Myhra LL. "It runs in the family": intergenerational transmission of historical trauma among urban American Indians and Alaska Natives in culturally specific sobriety maintenance programs. Am Indian Alsk Native Ment Health Res. 2011; 18(2):17–40. [PubMed: 22302280] [DOI] [PubMed] [Google Scholar]
  • 21.Myhra LL, Wieling E. Intergenerational patterns of substance abuse among urban American Indian families. J Ethn Subst Abuse. 2014; 13(1):1–22. [PubMed: 24564557] [DOI] [PubMed] [Google Scholar]
  • 22.de Rus Jacquet A, Tambe MA, Ma SY, McCabe GP, Vest JHC, Rochet JC. Pikuni-Blackfeet traditional medicine: Neuroprotective activities of medicinal plants used to treat Parkinson's disease-related symptoms. J Ethnopharmacol. 2017; 12;206:393–407. [PubMed: 28088492] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Joe JR, Young RS, Moses J, Knoki-Wilson U, Dennison J. A collaborative case study: The Office of Native Medicine. Am Indian Alsk Native Ment Health Res. 2016; 23(2):50–63. [PubMed: 27115132] [DOI] [PubMed] [Google Scholar]
  • 24.Jernigan VB, D’Amico EJ, & Keawe‘aimoku Kaholokula J Prevention research with indigenous communities to expedite dissemination and implementation efforts. Prev Sci. In Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Weaver HN. Urban and Indigenous: The Challenges of being a Native American in the City. Journal of Community Practice. 2012; 20:4, 470–88, doi: 10.1080/10705422.2012.732001. [DOI] [Google Scholar]
  • 26.Jeffries R, Nix M, Singer C. American Indians "Dropping" Out of Traditional High Schools: Barriers & Bridges to Success. The High School Journal. 2002; 85(3):38–46. [Google Scholar]
  • 27.Brown RA, Dickerson DL, D’Amico EJ. Cultural identity among urban American Indian/Alaska Native youth: Implications for alcohol and drug use. Prev Sci. 2016; 17(7):852–61. [PubMed: 27450682] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Jones ML, Galliher RV. Daily racial microaggressions and ethnic identification among Native American young adults. Cultur Divers Ethnic Minor Psychol. 2015; 21(1):1–9. [PubMed: 25090153] [DOI] [PubMed] [Google Scholar]
  • 29.Tobler AL, Maldonado-Molina MM, Staras SA, O'Mara RJ, Livingston MD, Komro KA. Perceived racial/ethnic discrimination, problem behaviors, and mental health among minority urban youth. Ethn Health. 2013; 18(4):337–49. [PubMed: 23043428] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Brodish AB, Cogburn CD, Fuller-Rowell TE, Peck S, Malanchuk O, Eccles JS. Perceived Racial Discrimination as a Predictor of Health Behaviors: the Moderating Role of Gender. Race Soc Probl. 2011; 3(3):160–9. [PubMed: 22844386] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Unger JB, Soto DW, Baezconde-Garbanati L. Trajectories of perceived discrimination from adolescence to emerging adulthood and substance use among Hispanic youth in Los Angeles. Addict Behav. 2016; 53:108–12. [PubMed: 26477013] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Nadimpalli SB, Hutchinson MK. An integrative review of relationships between discrimination and Asian American health. J Nurs Scholarsh. 2012; 44(2):127–35. [PubMed: 22551064] [DOI] [PubMed] [Google Scholar]
  • 33.Melander LA, Sittner Hartshorn KJ, Whitbeck LB. Correlates of bullying behaviors among a sample of North American Indigenous adolescents. J Adolesc. 2013; 36(4):675–84. [PubMed: 23849662] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Whitbeck LB, Walls ML, Johnson KD, Morrisseau AD, McDougall CM. Depressed affect and historical loss among North American Indigenous adolescents. Am Indian Alsk Native Ment Health Res. 2009; 16(3):16–41. [PubMed: 20052631] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Yoder KA, Whitbeck LB, Hoyt DR, LaFromboise T. Suicidal ideation among American Indian youths. Arch Suicide Res. 2006; 10(2):177–90. [PubMed: 16574615] [DOI] [PubMed] [Google Scholar]
  • 36.Whitbeck LB, Hoyt DR, McMorris BJ, Chen X, Stubben JD. Perceived discrimination and early substance abuse among American Indian children. J Health Soc Behav. 2001; 42(4):405–24. [PubMed: 11831140] [PubMed] [Google Scholar]
  • 37.Armenta BE, Sittner KJ, Whitbeck LB. Predicting the Onset of Alcohol Use and the Development of Alcohol Use Disorder among Indigenous Adolescents. Child Dev. 2016; 87(3):870–82. [PubMed: 27028364] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Solorzano D, Ceja M, Yosso T. Critical race theory, racial microaggressions, and campus racial climate: The experiences of African American college students. Journal of Negro Education. 2000; 69:60–73. [Google Scholar]
  • 39.Chae DH, Walters KL. Racial discrimination and racial identity attitudes in relation to self-rated health and physical pain and impairment among two-spirit American Indians/Alaska Natives. Am J Public Health. 2009; April;99Suppl 1:S144–51. [PubMed: 19218182] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Clark DA, Spanierman LB, Reed TD, Soble JR, Cabana S. Documenting weblog expressions of racial microaggressions that target American Indians. Journal of Diversity in Higher Education. 2011; 4(1):39–50. doi: 10.1037/a0021762. [DOI] [Google Scholar]
  • 41.Jones ML, Galliher RV. Daily racial microaggressions and ethnic identification among Native American young adults. Cultur Divers Ethnic Minor Psychol. 2015; 21(1):1–9. [PubMed: 25090153] [DOI] [PubMed] [Google Scholar]
  • 42.Senter MS, Ling DA. “It's Almost Like They Were Happier When You Were Down”: Microaggressions and Overt Hostility Against Native Americans in a Community with Gaming. Sociological Inquiry. 2017; 87(2); 256–81. https://doi.Org/10.1111/soin.12171. [Google Scholar]
  • 43.Sittner KJ, Greenfield BL, Walls ML. Microaggressions, diabetes distress, and self-care behaviors in a sample of American Indian adults with type 2 diabetes. J Behav Med. 2018; 41(1):122–9. [PubMed: 29116568] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Walls ML, Gonzalez J, Gladney T, Onello E. Unconscious biases: racial microaggressions in American Indian health care. J Am Board Fam Med. 2015; 28(2):231–9. [PubMed: 25748764] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Gonzales NA, Gunnoe ML, Jackson KM, Samaniego RY. (1995). Validation of a multicultural events scale for urban adolescents. Paper presented at the Biennial Conference of the Society for Community Research and Action, Chicago, IL. [Google Scholar]
  • 46.Gonzales NA, Tein JY, Sandler IN, Friedman RJ. On the limits of coping interaction between stress and coping for inner-city adolescents. J Adolesc Res. 2001; 16:372–95. 10.1177/0743558401164005. [DOI] [Google Scholar]
  • 47.Walters K Lessons from the field: Race, culture and children’s mental health Center for Excellence in Children’s Mental Health 2009; University of Minnesota. [Google Scholar]
  • 48.Dickerson DL, Brown RA, Johnson CL, Schweigman K, D'Amico EJ. Integrating motivational interviewing and traditional healing to address alcohol and drug use among urban American Indian/Alaska Native youth. J Subst Abuse Treat. 2016; 65:26–35. [PubMed: 26306776] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Jernigan VB, D’Amico EJ, Duran B, & Buchwald D (2018). Multilevel and community-level interventions with Native Americans: Challenges and opportunities. Prev Sci. 2018; June 2. doi: 10.1007/s11121-018-0916-3. [Epub ahead of print] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Dickerson DL, Johnson CL, Castro C, Naswood C, Leon JMP (2012). CommUNITY Voices: Integrating traditional healing services for urban American Indians/Alaska Natives in Los Angeles County Learning Collaborative Summary Report. Los Angeles, CA: Los Angeles County Department of Mental Health. [Google Scholar]
  • 51.Native American Health Center. (2012). Native vision: A focus on improving behavioral health wellness for California Native Americans-California Reducing Disparities Project Native American population report. Oakland, CA: Native American Health Center. [Google Scholar]
  • 52.Kaufman CE, Black K, Keane EM, Big Crow CK, Shangreau C, Arthur-Asmah R, et al. Planning for a group-randomized trial with American Indian youth. J Adolesc Health Care. 2014; 54(3):S59–S63. [PubMed: 24560078] [DOI] [PubMed] [Google Scholar]
  • 53.D'Amico EJ, Parast L, Meredith LS, Ewing BA, Shadel WG, Stein BS. Screening in primary care: What is the best way to identify at-risk youth for substance use? Pediatrics. 2016; 138:1–9. [PubMed: 27940696] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.D’Amico EJ, Tucker JS, Miles JNV, Ewing BA, Shih RA, Pedersen ER. Alcohol and marijuana use trajectories in a diverse longitudinal sample of adolescents: Examining use patterns from age 11 to 17. Addiction. 2016; 111(10): 1825–35. [PubMed: 27130360] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Stewart AL, Ware JE, Sherboume CD, Wells KB. Psychological distress/well-being and cognitive functioning measures In: Stewart A, Ware JE (Eds). Measuring functioning and well-being: The medical outcomes study approach. Durham, NC: Duke University Press; 1992:102–142. [Google Scholar]
  • 56.Ware JE, Kosinski M, Keller SD. A 12-item short form health survey: Construction of scales and preliminary tests. Med Care. 1996; 34:220–33. [PubMed: 8628042] [DOI] [PubMed] [Google Scholar]
  • 57.Norton I, Manson S. Research in American Indian and Alaska Native communities: Navigating the cultural universe of values and process. J Consult Clin Psychol. 1996; 64:856–60. [PubMed: 8916611] [DOI] [PubMed] [Google Scholar]
  • 58.Meredith LS, Ewing BA, Stein BS, Shadel WG, Brooks Holliday S, Parast L, et al. Influence of mental health and alcohol or other drug use risk on adolescent reported care received in primary care settings. BMC Fam Pract. 2018; 19(1):10. [PubMed: 29316897] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Olani S, et al. "Racial/ethnic disparities in tobacco product use among middle and high school students -- United States, 2014-2017" MMWR 2018, 67(34);952–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Levine A, Huang Y, Drisaldi B, Griffin EA Jr, Pollak DD, Xu S, et al. Molecular mechanism for a gateway drug: epigenetic changes initiated by nicotine prime gene expression by cocaine. Sci Transl Med. 2011; 2;3(107):107ra109. [PubMed: 22049069] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Soto C, Baezconde-Garbanati L, Schwartz SJ, Unger JB. Stressful life events, ethnic identity, historical trauma, and participation in cultural activities: Associations with smoking behaviors among American Indian adolescents in California._Addict Behav 2015;50:64–9. [PubMed: 26102434] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Walls ML, Whitbeck L, Armenta B. A Cautionary Tale: Examining the Interplay of Culturally Specific Risk and Resilience Factors in Indigenous Communities. Clin Psychol Sci. 2016; 4(4):732–43. [PubMed: 28138417] [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Galliher RV, Jones MD, Dahl A. Concurrent and longitudinal effects of ethnic identity and experiences of discrimination on psychosocial adjustment of Navajo adolescents. Dev Psychol. 2011; 47(2):509–26. [PubMed: 21142373] [DOI] [PubMed] [Google Scholar]
  • 64.Committee on Improving the Health, Safety, and Well-Being of Young Adults; Board on Children, Youth, and Families; Institute of Medicine; National Research Council; Bonnie RJ, Stroud C, Breiner H, editors. Washington (DC): National Academies Press (US); 2015. January 27. [PubMed] [Google Scholar]
  • 65.Ashbum-Nardo L, Monteith MJ, Arthur SA, Bain A. Race and the psychological health of African Americans. Group Process Intergroup Relat. 2007; 10:471–91. doi: 10.1177/1368430207081536. [DOI] [Google Scholar]
  • 66.Hughes D, Rodriguez J, Smith EP, Johnson DJ, Stevenson HC, Spicer P. Parents' ethnicracial socialization practices: a review of research and directions for future study. Dev Psychol. 2006; 42(5):747–70. [PubMed: 16953684] [DOI] [PubMed] [Google Scholar]
  • 67.Solorzano DG, Ceja M, Yosso T. Critical race theory, racial microaggressions, and campus racial climate: The experiences of African American college students. J Negro Educ. 2000. Winter; 69:60–73. [Google Scholar]
  • 68.Walsh SD, Kolobox T, Simanovskaya O. What is it about perceived discrimination that can lead immigrant adolescents to alcohol use and delinquency? The mediating role of feelings of alienation. Subst Use Misuse. 2018; October 26:1–13. doi: 10.1080/10826084.2018.1495738. [Epub ahead of print] [DOI] [PubMed] [Google Scholar]
  • 69.D’Amico EJ, Dickerson DL, Brown RA, Klein D, Agniel D, Johnson CL. Unveiling an "Invisible Population": Health, Substance Use, Sexual Behavior, Culture, and Discrimination among Urban American Indian/Alaska Native Adolescents in California. Accepted for Publication. Ethn Health. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Brown RA, D’Amico EJ, Dickerson DL, Klein D, Agniel D, Johnson CL. Identifying as American Indian/Alaska Native: Implications for Adolescent Behavioral Health and Well-Being. Accepted for Publication. Youth Soc. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Cernin PA, Cresci K, Jankowski TB, Lichtenberg PA. Reliability and validity testing of the short-form health survey in a sample of community-dwelling African American older adults. J Nurs Meas. 2010; 18(1):49–59. [PubMed: 20486477] [DOI] [PubMed] [Google Scholar]
  • 72.Boardman JD "Self-rated health among U.S. adolescents." J Adolesc Health. 2006; 38(4):401–8. [PubMed: 16549301] [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES