Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 May 4.
Published in final edited form as: Am Indian Alsk Native Ment Health Res. 2020;27(1):21–41. doi: 10.5820/aian.2701.2020.21

COMMUNITY AWARENESS OF OUTREACH EFFORTS TO REDUCE UNDERAGE DRINKING ON CALIFORNIA INDIAN RESERVATIONS

Cindy L Ehlers 1, Jennifer R Geisler 2, Juan A Luna 3, David A Gilder 4, Daniel Calac 5, Juliet P Lee 6, Roland S Moore 7
PMCID: PMC7197713  NIHMSID: NIHMS1582881  PMID: 32259273

Abstract

We report an evaluation of a combined individual- and community-level treatment and prevention effort to reduce underage drinking by American Indian (AI) youths on rural California Indian reservations. The interventions included: brief motivational interviewing and psychoeducation for Tribal youths, restricting alcohol sales to minors in alcohol sales outlets, and community mobilization and awareness activities. Surveys were collected from 120 adults and 74 teens to evaluate the awareness and effectiveness of the interventions. A high proportion of adult (93%) and youth (96%) respondents endorsed being aware of one or more of the intervention activities, and 88% of adults and 71% of youth felt the program impacted the community in a positive way. Eighty-four percent of adults and 63% of youth agreed that as a result of the activities that they decided to take action to reduce teen drinking in their community. Being aware of more of the intervention activities significantly increased the odds of taking action to change drinking behaviors. This study documents that a significant proportion of the community was aware of the intervention efforts and that awareness caused them to take action to reduce underage drinking. Such efforts may benefit other AI/AN communities seeking to reduce underage drinking.

INTRODUCTION

American Indians and Alaska Natives (AI/ANs) have significant health disparities with regard to alcohol use, substance use disorders, and related morbidity and mortality. It is particularly important that intervention efforts begin at a young age in AI/ANs since early initiation of alcohol use and heavy drinking increases the risks for lifetime alcohol use disorders (Grant & Dawson, 1997; Hingson, Heeren, & Winter, 2006), particularly among AI/ANs where it has been documented that drinking begins at a younger age than other groups (Chartier & Caetano, 2010;Ehlers, Slutske, Gilder, Lau, & Wilhelmsen, 2006). Additionally, since youth from rural communities have elevated risk for underage drinking, as compared to their urban and suburban counterparts (De Haan, Boljevac, & Schaefer, 2009), AI/AN youth on rural Indian reservations may have particularly heightened risk (Blum, Harmon, Harris, Bergeisen, & Resnick, 1992; Cheadle & Whitbeck, 2011; Friese & Grube, 2008; Potthoff et al., 1998; Stanley, Harness, Swaim, & Beauvais, 2014; Walsh & Baldwin, 2015).

Recent reviews of interventions among AI/AN youth reveal that AI/AN populations have been relatively underrepresented in evidence-based prevention efforts to reduce underage drinking (Walsh & Baldwin, 2015). Many authors have additionally stressed the importance of using a community-based comprehensive and collaborative strategy to address the problems of youth substance abuse in AI/AN communities in order to effect long term solutions. One such program is the community readiness model (see Donnermeyer, Plested, Edwards, Oetting, & Littlethunder, 1997; Edwards, Jumper-Thurman, Plested, Oetting, & Swanson, 2000; Oetting et al., 1995; Oetting, Jumper-Thurman, Plested, & Edwards, 2001; Plested, Jumper-Thurman, Edwards, & Oetting, 1998; Plested, Smitham, Jumper-Thurman, Oetting, & Edwards, 1999). That model has six primary dimensions of which community knowledge of the efforts is a key component (Thurman, Plested, Edwards, Foley, & Burnside, 2003). Another program aimed at increasing community awareness and providing psychoeducation focusing on empathy, cultural humility, and cultural responsiveness in substance use disorder (SUD) treatment is the “Through the Diamond Threshold” program (Robbins, Stare, & Riggin, 2019). Community involvement and awareness of SUD programs thus is key to obtaining stakeholder buy in to a program and to foster sustainability. In a review of the epidemiology and etiology of substance use in AIs, Whitesell and colleagues (2012) also suggest that “the development of effective prevention strategies, built through collaboration between researchers and Native communities, drawing from the wisdom of both, is a high priority” (p. 1). Novins and Baron (2004) found few studies with sufficient research rigor to draw firm conclusions about effectiveness, but another review by Jiwa, Kelly, and Pierre- Hansen (2008) highlighted infrastructure development and community involvement as key components of successful AI substance use prevention programs. More recently, two studies have demonstrated that multi-level prevention trials can successfully reduce alcohol use among AI teens (Komro et al., 2017; Moore et al., 2018), opening up the possibility that such programs can be successfully applied more widely to reduce substance-related harm among AIs. One study used a multi-level prevention trial among AI teens in the Cherokee Nation (see Komro et al., 2017; Komro et al., 2015). That study found that the combination of a community organizing intervention targeting alcohol access and a school-based screening with brief intervention was effective in reducing 30-day alcohol use and heavy episodic drinking. In our own study, reported in Moore and colleagues (2018), we found that a multi-level intervention was also successful in reducing past 30-day drinking and heavy episodic drinking in rural California Indian reservation communities exposed to the interventions.

In assessing the effectiveness of a multi-level intervention, it is not always possible to determine 1) to what extent the youth and other community members were aware of the intervention and 2) which programs among the intervention efforts were the most effective. The present study reports data assessing the awareness and perceived effectiveness of the successful multi-level intervention we carried out (see Moore et al., 2018) from 2008–2011 to reduce and prevent underage drinking in nine contiguous rural California Indian reservations. The main results of the study have been described previously (see Gilder et al., 2017; Gilder, Gizer, Lau, & Ehlers, 2014; Gilder et al., 2011; Lee et al., 2015; Moore et al., 2018; Moore et al., 2012). The overall project was initiated following requests from leaders of these sovereign Tribal nations and included both individual-level and community-level strategies (described later). Extended outreach efforts aimed at raising the awareness of alcohol problems and mobilizing extended community support for the project goals were also accomplished. Since the Tribal communities did not want to participate in a randomized control study, previous assessments of the overall impacts of the combined interventions relied on alcohol use data from the California Healthy Kids Survey (CHKS). This anonymous survey was collected in the school districts serving the nine participating reservations and in nine comparison reservations who were not part of the intervention. Although evaluation of the CHKS spotlighted the effectiveness of the multi-level intervention (Moore et al., 2018), the aims of the present report are to: 1) more fully describe the methods used in the community outreach program, 2) present results of a community survey that queried youth and adults on their awareness of the different aspects of the interventions, and 3) describe results from the survey that assessed the perceived effectiveness of the interventions.

METHODS

This project represents a collaboration between AI/AN clinicians and community members among nine consortium Tribes within a half-hour drive of a primary and satellite branch of the Southern California Tribal Health Clinic (a pseudonym used to protect confidentiality) and prevention scientists. Prior to the advent of the study, an advisory panel of AI leaders was convened to ensure community participation and approval (Lee et al., 2011). A description of the overall strategy has been published previously (Moore et al., 2018). Briefly, the individual-level strategy included eligible youths that were randomized to receive a culturally tailored brief motivational interviewing (MI) session or a psychoeducation (PE) session. The MI component assessed the readiness of the individual youth to change their alcohol drinking (or not start) and then implemented a directive psychotherapeutic treatment tailored to that stage of change (Miller, 1996; Miller & Rollnick, 2013; Venner, Feldstein, & Tafoya, 2006). The PE session was delivered by the therapist and consisted of watching two DVDs on the consequences of drinking and dangers of binge drinking. MI and PE were delivered in both individual and group formats (Gilder et al., 2017). The community-level Environmental Prevention strategy included a Reward and Reminder program aimed at reducing youth access to alcohol. This program enlisted AI young adults who were aged < 21 years, but judged to look younger, to visit off-premise alcohol stores located on and near the reservations and attempt to purchase alcoholic beverages (Moore et al., 2012). Project staff “rewarded” clerks who asked for age identification or “reminded” clerks who did not request identification of the existence of underage sales laws (Biglan et al., 1996; Biglan, Ary, Smolkowski, Duncan, & Black, 2000; Flewelling et al., 2013).

The treatment and prevention strategies were supported by a community outreach program to: 1) raise community awareness about the risks of underage substance use, 2) inform the community members about the different strategies that were being used to reduce drinking in youth, and 3) to mobilize support for the interventions. The research team developed informational materials on underage alcohol use for distribution to youths, parents, Tribal leaders, and health clinic professionals. Presentations were given using clinical and scientific information on the risks of underage drinking and prevention strategies that were combined with traditional arts activities and discussion of historical trauma that was tailored to the age group of the participants and the particular venue of the presentations. In addition, “activities” were used to engage parents and youth to participate and to listen carefully to the presentations. These activities included a series of five games that are presented in Table 1.

Table 1.

Presentation Activities

Activity Description

Who wants to be a millionaire Prior to the activity, the team presents on the consequences of underage drinking. Then, following the format of the popular television show, youth are quizzed on information presented earlier in the activity.
Puzzle piece Each youth receives a white puzzle piece after a presentation on preventing underage drinking. Pens, markers, and sharpies are available for the youth to write, draw, color or however they choose to express what alcohol means to them.
Obstacle course Youth are asked to walk through an obstacle course with beer goggles (i.e., goggles worn to simulate the effect of intoxication). Obstacles included walking on a line that was curved and straight, shooting a basketball in a basket and jumping through hula hoops.
Distract-A-Match Youth count out loud from 100 back to 0 while matching shapes and colors. Youth then wear beer goggles (i.e., goggles worn to simulate the effect of intoxication) and try to complete the same tasks while counting backwards from 100.
Nuts and bolts Youth must unscrew and screw a nut off a bolt and then re-screw the nut. Next, the youth must complete the same task wearing thick gloves. Finally, youth wear the beer goggles (i.e., goggles worn to simulate the effect of intoxication) and try to complete the same tasks.

A total of 298 presentations and activities were completed. Research staff from the local AI communities presented the materials and activities and discussed alcohol-related risks and alcohol-free strategies with the youths and parents. The venues included health fairs, pow-wows, and cultural gatherings (98 events). The research staff also gave presentations at after-school programs for each Tribe, at a reservation charter school, at Tribal councils, and other meetings (101 presentations to youths and 72 to parents and Tribal leaders), and gave presentations and trainings to the medical, dental, and community health departments at the tribal health clinics (27 events), as seen in Table 2. As an additional outreach strategy, Tribal youths were invited to design billboards placed alongside roads on and between reservations that contained messages aimed at reducing underage drinking among Tribal youth (Moore et al., 2012). Cultural tailoring of the activities was a focus of the outreach effort but to an extent was complicated by the fact that the study area contains at least four major language groups and nine reservations, which share some, but by no means all, spiritual, symbolic, and artistic traditions. Therefore, the tailoring touched on familiar elements of local storytelling styles and referenced some familiar iconography from basket designs, but could be characterized as “surface” rather than “deep” cultural adaptation (Resnicow, Baranowski, Ahluwalia, & Braithwaite, 1999). For example, to create the billboard, the study team held a series of youth workshops on the different reservations in which various alternative designs were presented, including reference to local traditional musical instruments (e.g., gourd rattles) and dreamcatchers. Youth offered their own designs (some relying upon generic Western cultural motifs and others more focused on Tribal imagery) and then voted on their favorites, which contributed to a collaborative ownership of the billboard when it was printed and placed along a central roadway linking many of the reservations.

Table 2.

Format of Community Outreach Activities

Activity Number

Information Booths 98
Age-Tailored Presentations to Youth 101
Presentations to Parents and Tribal Leaders 72
Presentations to Tribal Clinic Health Professionals 27
Total 298

At the conclusion of the interventions, a survey was taken of the local community to assess the awareness and perceived effectiveness of the interventions, including the outreach component. Surveys were collected at multiple tribal events from 120 adults (21 yrs. and older) and 74 youth (20 yrs. or less) who were residing in the reservation study area. The survey queried, for each component of the intervention, whether an individual was aware of the component and, if aware, whether he or she took action to reduce underage drinking (adults) or reduced their own drinking (youth, if they had already begun drinking). Additional questions assessed whether the intervention as a whole (all components) moved individuals along the transtheoretical model of stages of behavior change from pre-contemplation to action to reduce underage drinking.

Statistical Analyses

Descriptive statistics of participants’ ages and gender, and how many participants endorsed each scale item were tabulated and compared. Two sets of outcome variables from the surveys were analyzed: awareness of an intervention and perceived effectiveness to change a behavior. Awareness of an activity was a dichotomous measure (yes vs. no). Perceived effectiveness was assessed using Likert scale variables, and they were treated as dichotomous (“Strongly agree” and “Agree” vs. “Neutral,” “Disagree,” and “Strongly disagree”). In the youth survey a participant could also indicate that they had never drank and, thus, would not be included in the perceived effectiveness measure. Gender effects on outcome variables were conducted using Fisher’s exact test. Age effects on outcome variables were determined using ANOVA. Fisher’s exact test was also used to compare responses between adults and youth. Logistic regression, that included age and/or gender when it was significant for that item, was used to determine the relationship between the number of interventions that the participant was aware of and the perceived effectiveness of the intervention to change behavior. Analyses were carried out using SPSS Version 20 (IBM Corp., 2011). Significance was set at p < 0.05.

RESULTS

This study sought to evaluate the awareness and perceived effectiveness of combined individual- and community-level interventions to reduce underage drinking by AI youths on rural California Indian reservations. A survey was drafted to query both adults (n = 120) and youth (n = 74).

Adult Survey

The mean age of the adults who completed the survey was 43.5 years (± 2.6). There were 90 women and 30 men who participated in completing the survey. As seen in Table 3, the first five questions of the survey queried the participant as to whether they: 1) were aware of the existence of the overall intervention; 2) saw the billboard; 3) were aware of the Reward and Reminder program; 4) were aware of the MI/PE intervention; and 5) were aware of the alcohol information outreach activities described in the present report. A high proportion (93%, n = 111) of respondents endorsed being aware of one or more of the intervention activities. With respect to individual items, as seen in Table 3, the highest percentage were aware of the Reward and Reminder (77%; n = 92), and the least number (49%; n = 59) had seen the billboard. There were no age differences in the proportion of participants who responded positively to having been aware of any of the intervention activities. The only gender difference seen was in response to the Reward and Reminder program where a higher proportion of men endorsed knowing about that program than women (Fisher’s exact test = 4.0; df = 1,119; p < 0.05).

Table 3.

Awareness of Prevention Activities. Number and percent shown for those surveyed who was aware of prevention activities.

Community Prevention Activities Awareness Survey Question Adult Youth

1 I was aware of the youth alcohol prevention efforts conducted by the Southern California Tribal Health Center (SCTHC) preventing underage drinking program 91 (76%) 54 (73%)
2 I saw the billboard with the alcohol prevention message along the [name removed] state highway on the [name removed] Reservation 59 (49%) 23 (31%)
3 I was aware of the convenience store checks that the program conducted to ensure proper ID checking by clerks when selling alcohol 92 (77%) 50 (68%)
4 I was aware of the motivational interviewing and alcohol education videos conducted by the SCTHC’s preventing underage drinking program 76 (63%) 45 (61%)
5 I was aware of the alcohol information presentations that SCTHC staff conducted at local schools, tribal afterschool programs, and community youth events 78 (65%) 55 (74%)

The second seven items on the survey are listed in Table 4, as well as the proportion of adult respondents who agreed or disagreed with each item. There were no age or gender differences in the proportion of respondents who agreed or disagreed with these items. Ninety percent (n = 108) of respondents agreed to liking the intervention activities, and 88% (n = 106) felt the nterventions impacted the community in a positive way. Seventy-one percent (n = 84) agreed that the overall intervention prompted them to take an action against teen drinking. Sixty-seven percent (n = 78) said that the Reward and Reminder program and 64% (n = 76) said that the MI/PE program helped them to take an action to reduce a teen’s drinking. The most highly endorsed item was the alcohol information presentations. Seventy-two percent (n = 85) of adults indicated that the presentations helped them to take an action to reduce a teen’s drinking.

Table 4.

Effectiveness of Prevention Activities. Number and percentage of those surveyed who “strongly agree” or “agree.”

Community Prevention Activities Awareness Survey Question Adult Youth

6 I liked these prevention activities 108 (90%) 32 (55%)
7 These activities impacted the community in a positive way 106 (88%) 44 (71%)
8 These activities prompted me to take an action against a teen’s drinking (cut down or stop drinking) 84 (71%) 20 (56%)
9 The billboard helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 70 (60%) 18 (56%)
10 The convenience store checks helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 78 (67%) 21 (64%)
11 The motivational interviewing or alcohol education videos helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 76 (64%) 18 (56%)
12 The alcohol information presentations helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 85 (72%) 19 (63%)

Note: Survey wording differed slightly for adult and youth, with youth survey indicated in parentheses. Total numbers of youth answering each question varied because on the Youth Survey youth had an option to answer “Didn’t know about them” (Questions 6–7) and “I don’t drink” (Questions 9–12).

The final three items on the survey queried whether, as a result of the activities, the person felt empowered to do something about teen drinking and if they moved along the transtheoretical model of stages of behavior change from pre-contemplation to contemplation or from contemplation to preparation to take action to reduce drinking. There were no age or gender effects on these three items. As seen in Table 5, a high percentage of respondents (80%, n = 86) agreed that they went from not realizing there was a problem to realizing there was a problem with teen drinking in their community. Eighty-four percent (n = 93) said that the activities resulted in their going from thinking that they couldn’t do anything to thinking that they could do something about teen drinking in their community. Eighty-four percent (n = 92) agreed that as a result of the activities they decided to take action to reduce teen drinking in their community.

Table 5.

Empowerment (Q14) and Movement along the Transtheoretical Model of Stages of Behavior Change from Pre-contemplation to Contemplation (Q13) and from Contemplation to Preparation (Q15). Number and percent shown for those surveyed whom “strongly agree” or “agree.”

Community Prevention Activities Awareness Survey Question Adult Youth

13 As a result of these activities I went from not realizing there was a problem to realizing there was a problem with teen drinking in my (family or) community 86 (80%) 20 (57%)
14 As a result of these activities I went from thinking I couldn’t do anything to thinking I could do something about teen drinking in my (family or) community 93 (84%) 19 (63%)
15 As a result of these activities I decided to take action to reduce teen drinking in my family or community 92 (84%) 19 (63%)

Note: Survey wording differed slightly for adult and youth, with youth survey indicated in parentheses. Total numbers of youth answering each question varied because on the Youth Survey youth had an option to answer “Already realized it” (Question 13), “Already thought so” (Question 14), and “Already decided” (Question 15).

Table 6 presents the odds ratios and p-values for a set of analyses that investigated whether having been aware of multiple numbers of the intervention activities (responses to items 1 to 5 in Table 2) resulted in an increase in the odds that they would endorse the 10 other items in the survey. Using logistic regression, it was found that being aware of more of the activities significantly increased the odds of positively endorsing all other items except two of the change items (moving from not knowing there was a problem to knowing, and going from thinking they couldn’t do anything to thinking that they could).

Table 6.

Increased Awareness of Prevention Activities and Effect on Action

Community Prevention Activities Awareness Survey Question Adult Youth
OR p OR p

6 I liked these prevention activities 2.06 0.001 1.86 0.009
7 These activities impacted the community in a positive way 1.61 0.008 1.76 0.012
8 These activities prompted me to take an action against a teen’s drinking (cut down or stop drinking) 1.40 0.01 2.01 0.024
9 The billboard helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 1.63 0.001 1.29 0.472
10 The convenience store checks helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 1.46 0.004 1.45 0.156
11 The motivational interviewing or alcohol education videos helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 1.59 0.001 1.66 0.114
12 The alcohol information presentations helped me to take an action to reduce a teen’s drinking (cut down or stop drinking) 1.59 0.001 1.45 0.168
13 As a result of these activities I went from not realizing there was a problem to realizing there was a problem with teen drinking in my (family or) community 1.16 0.32 1.36 0.263
14 As a result of these activities I went from thinking I couldn’t do anything to thinking I could do something about teen drinking in my (family or) community 1.25 0.16 1.45 0.17
15 As a result of these activities I decided to take action to reduce teen drinking in my family or community 1.67 0.003 1.45 0.17

Note: Survey wording differed slightly for adult and youth, with youth survey indicated in parentheses.

Youth Survey

The mean age of the youth who completed the survey was 14.2 years (± 0.5). There were 38 girls and 36 boys who participated in completing the survey. There were no age or gender differences in the proportion of youth who responded positively to having been aware of the intervention activities. A high proportion (96%, n = 71) of youth endorsed being aware of one or more of the activities. With respect to individual items, as seen in Table 3, the highest percentage were aware of the educational outreach (74%; n = 55), and the least number (31%; n = 23) had seen the billboard. The second seven items on the survey are listed in Table 4, as well as the proportion of youth respondents who agreed or disagreed with each item. There was only one age difference on these items. Youth who agreed that the billboard helped them to cut down on or stop drinking were younger than those who did not agree with this item (F = 9.3; df = 1,93; p < 0.005). There were also some gender differences in the proportion of respondents who agreed or disagreed with these items. Girls were more likely to say that the billboard (F = 8.7; df = 1,31; p < 0.005) and the MI/PE (F = 5.0; df = 1,31; p < 0.04) helped them to cut down or stop drinking as compared to boys. Fifty-five percent (n = 32) of youth agreed to liking the intervention activities, and 71% (n = 44) felt theinterventions impacted the community in a positive way. Fifty-six percent (n = 20) agreed that the overall intervention prompted them to cut down or stop drinking. The most highly endorsed items that prompted them to change their drinking behavior were the alcohol presentations at the community outreach sessions (63%; n = 19) and the Reward and Reminder program (64%; n = 21).

There were no age effects on the final three items on empowerment and the transtheoretical model of stages of behavior change from pre-contemplation to action to reduce drinking in the youth. However, girls were more likely than boys to agree that they went from not realizing there was a problem to realizing there was a problem with teen drinking in their family or community (F = 5.04; df = 1,34; p < 0.04). As seen in Table 5, 57% (n = 20) overall agreed that they went from not realizing there was a problem to realizing there was a problem, 63% (n = 19) said that the activities resulted in them going from thinking that they couldn’t do anything to thinking that they could do something, and 63% (n = 19) agreed that as a result of the activities they decided to take action to reduce teen drinking in their family or community.

Table 6 presents the odds ratios and p-values for a set of analyses that investigated whether having been aware of multiple numbers of the intervention activities (responses to items 1 to 5 in Table 3) resulted in an increase in the odds that the youth would endorse the 10 other items in the survey. Using logistic regression that included age and/or gender when it was significant for that item revealed that being aware of more of the activities significantly increased the odds of positively endorsing three of the items (liking intervention activities, feeling they positively impacted the community, and activities prompted me to cut down or stop drinking).

Comparison of Youth and Adult Surveys

There were some differences between the youth and adults in endorsement of individual items on the survey. A higher percentage of adults endorsed having seen the billboard (F = 6.1; df =1,193; p < 0.02) than youth. Adults were more likely than youth to endorse liking the activities (F = 28.2, df = 1,177; p < 0.0001) and that the activities impacted the community positively (F = 8.5; df = 1,181; p < 0.007). Adults were also more likely than youth to endorse that they overall agreed that they went from not realizing there was a problem to realizing there was a problem (F = 7.5, df = 1,141; p < 0.01), said that the activities resulted in their going from thinking that they couldn’t do anything to thinking that they could do something (F = 6.05, df = 1,140; p < 0.02), and agreed that as a result of the activities they decided to take action to reduce teen drinking in their family or community (F = 6.5, df = 1,138; p < 0.02).

DISCUSSION

It has been suggested that health outcomes in intervention studies are the result of three factors: 1) the magnitude of the effect of the intervention, 2) the awareness and penetration of an intervention into the community, and 3) the sustainability of the effects (Hawe, Noort, King, & Jordens, 1997). Several studies have shown the efficacy of Environmental Prevention strategies to reduce community alcohol problems, including underage drinking, by reducing commercial alcohol availability (Holder et al., 2000; Treno, Gruenewald, Lee, & Remer, 2007; Treno & Lee, 2002; Wagenaar, Toomey, & Erickson, 2005). However, few investigators have described interventions on alcohol use among AI/AN youths (see Cheadle et al., 1995; Gabriel, Leichtling, Bolan, & Becker, 2013; Kulis, Ayers, & Harthun, 2017; May & Moran, 1995; Usera, 2017; Wagenaar, Livingston, Pettigrew, Kominsky, & Komro, 2018; Whitesell et al., 2012; Williams & Perry, 1998). A few studies have included AI/ANs in the study design but were not powered to test for effects that might be specific to the AI/AN sample (Livingston et al., 2018; Perry et al., 2000; Perry et al., 1996). In one of those studies, community-level and individual approaches were employed and the 2-year intervention resulted in significant reductions in alcohol use (Komro et al., 2017). However, that study also found a convergence in outcomes during the final year, suggesting that the effects of the intervention might not have been sustained (Komro et al., 2017). The overall study, on which the current set of analyses are based, was a multi-level intervention for underage drinking in AI youth that included analyses for two years before the intervention and four years following the intervention. That study showed a significant and sustained effect on underage drinking (Moore et al., 2018).

The current study described the response to a multi-component community-based intervention to reduce and prevent underage drinking that could be culturally tailored by other tribal communities. A small survey of youth visiting an Indian Health Clinic, in the catchment area of this study, found that 37% of boys and 54% of girls had drunk one or more standard drinks in their lifetimes, and that 27% of boys and 39% of girls reported having been intoxicated with alcohol one or more times (Gilder et al., 2013), thus documenting the need for reducing underage drinking. With respect to the interventions, we found that a high proportion of AI individuals queried endorsed knowing about one or more of the intervention activities (93% of adults and 96% of youth). There were some differences between adults and youth in what individual components of the intervention they were aware of, with adults being more likely to know about the intervention activities than youth. The importance of engagement of youth in intervention activities has been stressed by others who have conducted successful multi-level trials for reducing adolescent alcohol use (Perry et al., 2000).

In assessing the effectiveness of a multi-level intervention, it is not always possible to determine which components among the intervention efforts were the most effective. The present study sought to query both youth and adult AIs as to what activities they thought led to changes in their (teen) or their teen’s (adult) drinking behaviors. Overall, over half of the adults felt that the interventions prompted them to behavioral change with the most highly endorsed individual item being alcohol information presentations at the community outreach sessions. Interestingly, a lower percentage of youth agreed that the interventions prompted them to cut down or stop drinking (although many youth also indicated that they did not drink). Additionally, there were some gender differences in youth responses with girls appearing to have been more affected by the interventions than boys. Overall, the youth also felt that the alcohol presentations at the community outreach were effective in prompting them to cut down or stop drinking.

These data are consistent with a component analysis of the effects of different intervention strategies that were used in Project Northland, a multi-level intervention trial to prevent and reduce alcohol use in rural Minnesota that included some AI youth (Stigler, Perry, Komro, Cudeck, & Williams, 2006). In those sets of analyses, the strongest effects were documented for the planners of parent program components and extra-curricular activities, and only modest effects were seen for the classroom curricula. There has been widespread consensus that although classroom education programs are the most common venue for prevention (Botvin & Griffin, 2007), they have resulted in sparse evidence for efficacy in reducing teen substance use (Pan & Bai, 2009; Spoth, Greenberg, & Turrisi, 2009). There have been some suggestions that the most effective programs include interactive activities (Botvin & Griffin, 2007). Our studies support this construct and further suggest that engaging both parents and teens in interactive educational activities can result in action toward behavioral change of underage drinking by both adults and teens.

Our results suggest that exposure to multiple types of intervention strategies can significantly enhance the odds that an adult will take action to prevent underage drinking and that a teen will change their drinking behavior. These findings support the multi-level intervention approach. It has been suggested that a “paradigm shift” from using European American prevention science techniques to those that are culturally relevant to the community are needed in order to create a “grass roots” level approach to AI substance use prevention (Whitbeck, Walls, & Welch, 2012). Our study group supports this idea and our study suggests that involving both teens and adults in each step of the process in designing an intervention is important. Our findings are of particular importance for AI/AN communities because of the value AI/AN Tribes place on the well-being of their children, which can be potentially threatened by alcohol involvement (Connors, 2011). Considering the relative young age of many AI/AN populations (National Congress of American Indians, 2019), developing culturally relevant and effective interventions to reduce youth drinking takes on additional significance.

This study has several limitations and strengths that should be considered. Working within the guidelines of tribal consent, this survey was not conducted using randomized sampling methods and may represent a biased sample of the AI community. Among adult respondents there were more women than men who chose to participate. Furthermore, although the results strongly suggested that the interventions had substantial effects, we were also unable to randomly assign reservations to intervention and control conditions. Additionally, since the Reward and Reminder component was not designed to modify individuals’ behaviors, but to reduce commercial availability of alcohol to underage youths at the community level, exposure to this component could also not be randomized. Study strengths included tribal participation and the demonstration of significant impact and multiplicative effects of the interventions. Tribal leader ownership and support of this project was key in the successful implementation of the described project activities and provided ongoing insight and guidance that ensured that intervention activities and goals were locally acceptable and culturally appropriate. In addition, participation by young adult AI/AN project research staff might well have been critical to the successful outcomes achieved. In conclusion, this study documents that a significant proportion of the community was aware of the intervention efforts and that awareness caused them to take action to reduce underage drinking. Such efforts may benefit other AI/AN communities seeking to reduce underage drinking.

ACKNOWLEDGEMENTS

We are grateful for the invaluable support, advice, and encouragement of Project Officer Judith Arroyo, PhD, and of community leaders and members, including the tribal institutional review board and the Southern California Tribal Health Clinic Scientific Advisory Board. We acknowledge the thoughtful contributions of staff members Rosalie Flores, MA, Nadeana Nelson, AA, Marc Emerson, MPH, Sergio Quintero, BA, Linda Corey, RN, MS, Philip Lau, MA, Richard Mc Gaffigan, MSW, and George Pojas, AA, as well as consultants Fred Beauvais, PhD, Ray Daw, MA, Anne Kraft, MSW, CSWA, Peter Monti, PhD, Nichea Spillane, PhD, and Kamilla Venner, PhD, to the theoretical and practical elements of the project. The views expressed in this article are solely those of the authors and do not necessarily reflect the views of the funding organizations.

FUNDING INFORMATION This research was supported by the National Institute on Alcohol Abuse and Alcoholism (and Office of Behavioral and Social Sciences Research) grants R01AA016479, R01AA10201, R56AA023755, and R01AA023755.

Contributor Information

Cindy L. Ehlers, Scripps Research Institute in La Jolla, California.

Jennifer R. Geisler, Southern California Tribal Health Clinic in California.

Juan A. Luna, Southern California Tribal Health Clinic in California.

David A. Gilder, Scripps Research Institute in La Jolla, California.

Daniel Calac, Southern California Tribal Health Clinic in California.

Juliet P. Lee, Prevention Research Center in Berkeley, California.

Roland S. Moore, Prevention Research Center in Berkeley, California.

REFERENCES

  1. Biglan A, Ary D, Koehn V, Levings D, Smith S, Wright Z, … Henderson J (1996). Mobilizing positive reinforcement in communities to reduce youth access to tobacco. American Journal of Community Psychology, 24(5), 625–638. 10.1007/bf02509717 [DOI] [PubMed] [Google Scholar]
  2. Biglan A, Ary DV, Smolkowski K, Duncan T, & Black C (2000). A randomised controlled trial of a community intervention to prevent adolescent tobacco use. Tobacco Control, 9(1), 24–32. 10.1136/tc.9.1.24 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Blum RW, Harmon B, Harris L, Bergeisen L, & Resnick MD (1992). American Indian-- Alaska Native youth health. JAMA, 267(12), 1637–1644. 10.1001/jama.267.12.1637 [DOI] [PubMed] [Google Scholar]
  4. Botvin GJ, & Griffin KW (2007). School-based programmes to prevent alcohol, tobacco and other drug use. International Review of Psychiatry, 19(6), 607–615. 10.1080/09540260701797753 [DOI] [PubMed] [Google Scholar]
  5. Chartier K, & Caetano R (2010). Ethnicity and health disparities in alcohol research. Alcohol Research & Health, 33(1–2), 152–160. https://pubs.niaaa.nih.gov/publications/arh40/152160.pdf [PMC free article] [PubMed] [Google Scholar]
  6. Cheadle A, Pearson D, Wagner E, Psaty BM, Diehr P, & Koepsell T (1995). A community-based approach to preventing alcohol use among adolescents on an American Indian reservation. Public Health Reports, 110(4), 439–447. https://www.ncbi.nlm.nih.gov/pubmed/7638331 [PMC free article] [PubMed] [Google Scholar]
  7. Cheadle JE, & Whitbeck LB (2011). Alcohol use trajectories and problem drinking over the course of adolescence: A study of North American indigenous youth and their caretakers. Journal of Health and Social Behavior, 52(2), 228–245. 10.1177/0022146510393973 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Connors T (2011). Our children are sacred, Why the Indian Child Welfare Act matters. American Bar Association Judges Journal, 50(2), 33–39. Retrieved from https://www.courts.ca.gov/documents/jj_spr11_connors.pdf [Google Scholar]
  9. De Haan L, Boljevac T, & Schaefer K (2009). Rural community characteristics, economic hardship, and peer and parental influences in early adolescent alcohol use. Journal of Early Adolescence, 30(5), 629–650. 10.1177/0272431609341045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Donnermeyer JF, Plested BA, Edwards RW, Oetting G, & Littlethunder L (1997). Community readiness and prevention programs. Journal of the Community Development Society, 28(1), 65–83. 10.1080/15575339709489795 [DOI] [Google Scholar]
  11. Edwards RW, Jumper-Thurman P, Plested BA, Oetting ER, & Swanson L (2000). Community readiness: Research to practice. Journal of Community Psychology, 28(3), 291–307. [DOI] [Google Scholar]
  12. Ehlers CL, Slutske WS, Gilder DA, Lau P, & Wilhelmsen KC (2006). Age at first intoxication and alcohol use disorders in Southwest California Indians. Alcoholism, Clinical and Experimental Research, 30(11), 1856–1865. 10.1111/j.1530-0277.2006.00222.x [DOI] [PubMed] [Google Scholar]
  13. Flewelling RL, Grube JW, Paschall MJ, Biglan A, Kraft A, Black C, … Ruscoe J (2013). Reducing youth access to alcohol: findings from a community-based randomized trial. American Journal of Community Psychology, 51(1–2), 264–277. 10.1007/s10464-012-9529-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Friese B, & Grube J (2008). Differences in drinking behavior and access to alcohol between Native American and white adolescents. Journal of Drug Education, 38(3), 273–284. 10.2190/DE.38.3.e [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Gabriel RM, Leichtling GJ, Bolan M, & Becker LG (2013). Using community surveys to inform the planning and implementation of environmental change strategies: Participatory research in 12 Washington communities. American Journal of Community Psychology, 51(1–2), 243–253. 10.1007/s10464-012-9543-5 [DOI] [PubMed] [Google Scholar]
  16. Gilder DA, Geisler JR, Luna JA, Calac D, Monti PM, Spillane NS, … Ehlers CL (2017). A pilot randomized trial of Motivational Interviewing compared to Psycho-Education for reducing and preventing underage drinking in American Indian adolescents. Journal of Substance Abuse Treatment, 82, 74–81. 10.1016/j.jsat.2017.09.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Gilder DA, Gizer IR, Lau P, & Ehlers CL (2014). Item Response Theory analyses of DSM-IV and DSM-5 stimulant use disorder criteria in an American Indian community sample. Drug and Alcohol Dependence, 135, 29–36. 10.1016/j.drugalcdep.2013.10.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Gilder DA, Luna JA, Calac D, Moore RS, Monti PM, & Ehlers CL (2011). Acceptability of the use of motivational interviewing to reduce underage drinking in a Native American community. Substance Use and Misuse, 46(6), 836–842. 10.3109/10826084.2010.541963 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Gilder DA, Luna JA, Roberts J, Calac D, Grube JW, Moore RS, & Ehlers CL (2013). Usefulness of a survey on underage drinking in a rural American Indian community health clinic. American Indian and Alaska Native Mental Health Research, 20(2), 1–26. 10.5820/aian.2002.2013.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Grant BF, & Dawson DA (1997). Age at onset of alcohol use and its association with DSM- IV alcohol abuse and dependence: Results from the National Longitudinal Alcohol Epidemiologic Survey. Journal of Substance Abuse, 9, 103–110. 10.1016/S0899-3289(97)90009-2 [DOI] [PubMed] [Google Scholar]
  21. Hawe P, Noort M, King L, & Jordens C (1997). Multiplying health gains: The critical role of capacity-building within health promotion programs. Health Policy, 39(1), 29–42. 10.1016/s0168-8510(96)00847-0 [DOI] [PubMed] [Google Scholar]
  22. Hingson RW, Heeren T, & Winter MR (2006). Age at drinking onset and alcohol dependence‒Age at onset, duration, and severity. Archives of Pediatrics and Adolescent Medicine, 160(7), 739–746. 10.1001/archpedi.160.7.739 [DOI] [PubMed] [Google Scholar]
  23. Holder HD, Gruenewald PJ, Ponicki WR, Treno AJ, Grube JW, Saltz RF, … Roeper P. (2000). Effect of community-based interventions on high-risk drinking and alcohol- related injuries. JAMA, 284(18), 2341–2347. 10.1001/jama.284.18.2341 [DOI] [PubMed] [Google Scholar]
  24. IBM Corp [Computer software]. (2011). IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp. [Google Scholar]
  25. Jiwa A, Kelly L, & Pierre-Hansen N (2008). Healing the community to heal the individual: Literature review of aboriginal community-based alcohol and substance abuse programs. Canadian Family Physician, 54(7), 1000–1000, e1007. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/18625824 [PMC free article] [PubMed] [Google Scholar]
  26. Komro KA, Livingston MD, Wagenaar AC, Kominsky TK, Pettigrew DW, Garrett BA, & Cherokee Nation Prevention Trial, T. (2017). Multilevel prevention trial of alcohol use among American Indian and White high school students in the Cherokee Nation. American Journal of Public Health, 107(3), 453–459. 10.2105/AJPH.2016.303603 [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Komro KA, Wagenaar AC, Boyd M, Boyd BJ, Kominsky T, Pettigrew D, … Molina MM (2015). Prevention trial in the Cherokee Nation: Design of a randomized community trial. Prevention Science, 16(2), 291–300. 10.1007/s11121-014-0478-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Kulis SS, Ayers SL, & Harthun ML (2017). Substance use prevention for urban American Indian youth: A efficacy trial of the culturally adapted Living in 2 Worlds Program. Journal of Primary Prevention, 38(1–2), 137–158. 10.1007/s10935-016-0461-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Lee JP, Calac D, Montag AC, Brodine S, Luna JA, Flores RY, … Moore RS (2011). Indian student involvement in Tribal community-based research: Underage drinking prevention among rural Native Californians. Journal of Rural and Community Psychology, 14(2). https://www.ncbi.nlm.nih.gov/pubmed/25356438 [PMC free article] [PubMed] [Google Scholar]
  30. Lee JP, Moore RS, Roberts J, Nelson N, Calac D, Gilder DA, & Ehlers CL (2015). Off-premise alcohol outlets on and around tribal land: Risks for rural California Indian youth. Journal of Ethnicity in Substance Abuse, 14(1), 59–78. 10.1080/15332640.2014.958643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Livingston MD, Komro KA, Wagenaar AC, Kominsky TK, Pettigrew DW, & Garrett BA (2018). Effects of alcohol interventions on other drug use in the Cherokee Nation. American Journal of Public Health, 108(2), 259–261. 10.2105/AJPH.2017.304188 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. May PA, & Moran JR (1995). Prevention of alcohol misuse: a review of health promotion efforts among American Indians. American Journal of Health Promotion, 9(4), 288–299. 10.4278/0890-1171-9.4.288 [DOI] [PubMed] [Google Scholar]
  33. Miller WR (1996). Motivational interviewing: Research, practice, and puzzles. Addictive Behaviors, 21(6), 835–842. 10.1016/0306-4603(96)00044-5 [DOI] [PubMed] [Google Scholar]
  34. Miller WR, & Rollnick S (2013). Motivational interviewing: Helping people change (3rd ed.). New York: Guilford Press. [Google Scholar]
  35. Moore RS, Gilder DA, Grube JW, Lee JP, Geisler JA, Friese B, … Ehlers CL(2018). Prevention of underage drinking on California Indian reservations Using individual- and community-level approaches. American Journal of Public Health, 108(8), 1035–1041. 10.2105/AJPH.2018.304447 [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Moore RS, Roberts J, McGaffigan R, Calac D, Grube JW, Gilder DA, & Ehlers CL (2012). Implementing a reward and reminder underage drinking prevention program in convenience stores near Southern California American Indian reservations. American Journal of Drug and Alcohol Abuse, 38(5), 456–460. 10.3109/00952990.2012.696758 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. National Congress of American Indians. (2019). Indian Country Demographics. Retrieved from http://www.ncai.org/about-tribes/demographics
  38. Novins DK, & Baron AE (2004). American Indian substance use: The hazards for substance use initiation and progression for adolescents aged 14 to 20 years. Journal of the American Academy of Child and Adolescent Psychiatry, 43(3), 316–324. 10.1097/00004583-200403000-00013 [DOI] [PubMed] [Google Scholar]
  39. Oetting ER, Donnermeyer JF, Plested BA, Edwards RW, Kelly K, & Beauvais F (1995). Assessing community readiness for prevention. International Journal of the Addictions, 30(6), 659–683. 10.3109/10826089509048752 [DOI] [PubMed] [Google Scholar]
  40. Oetting ER, Jumper-Thurman P, Plested B, & Edwards RW (2001). Community readiness and health services. Substance Use and Misuse, 36(6–7), 825–843. 10.1081/JA-100104093 [DOI] [PubMed] [Google Scholar]
  41. Pan W, & Bai H (2009). A multivariate approach to a meta-analytic review of the effectiveness of the D.A.R.E. program. International Journal of Environmental Research and Public Health, 6(1), 267–277. 10.3390/ijerph6010267 [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Perry CL, Williams CL, Komro KA, Veblen-Mortenson S, Forster JL, Bernstein- Lachter R, … McGovern P (2000). Project Northland high school interventions: Community action to reduce adolescent alcohol use. Health Education and Behavior, 27(1), 29–49. 10.1177/109019810002700105 [DOI] [PubMed] [Google Scholar]
  43. Perry CL, Williams CL, Veblen-Mortenson S, Toomey TL, Komro KA, Anstine PS, … Wolfson M (1996). Project Northland: Outcomes of a communitywide alcohol use prevention program during early adolescence. American Journal of Public Health, 86(7), 956–965. 10.2105/ajph.86.7.956 [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Plested BA, Jumper-Thurman P, Edwards R, & Oetting ER (1998). Community readiness: A tool for community empowerment. Prevention Researcher, 5(2), 5–7. [Google Scholar]
  45. Plested BA, Smitham DM, Jumper-Thurman P, Oetting ER, & Edwards RW (1999). Readiness for drug use prevention in rural minority communities. Journal of Substance Use and Misuse, 34(4,5), 521–544. 10.3109/10826089909037229 [DOI] [PubMed] [Google Scholar]
  46. Potthoff SJ, Bearinger LH, Skay CL, Cassuto N, Blum RW, & Resnick MD (1998). Dimensions of risk behaviors among American Indian youth. Archives of Pediatrics and Adolescent Medicine, 152(2), 157–163. 10.1001/archpedi.152.2.157 [DOI] [PubMed] [Google Scholar]
  47. Resnicow K, Baranowski T, Ahluwalia JS, & Braithwaite RL (1999). Cultural sensitivity in public health: defined and demystified. Ethnicity and Disease, 9(1), 10–21. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/10355471 [PubMed] [Google Scholar]
  48. Robbins RR, Stare BG, & Riggin BM (2019). Through the Diamond Threshold: A community-based psycho-educational group training program for treatment of substance use disorders among American Indians. American Indian and Alaska Native Mental Health Research, 26(1), 79–105. 10.5820/aian.2601.2019.79 [DOI] [PubMed] [Google Scholar]
  49. Spoth R, Greenberg M, & Turrisi R (2009). Overview of preventive interventions addressing underage drinking: State of the evidence and steps toward public health impact. Alcohol Research & Health, 32(1), 53–66. https://pubs.niaaa.nih.gov/publications/arh321/53-66.pdf [PMC free article] [PubMed] [Google Scholar]
  50. Stanley LR, Harness SD, Swaim RC, & Beauvais F (2014). Rates of substance use of American Indian students in 8th, 10th, and 12th grades living on or near reservations: Update, 2009–2012. Public Health Reports, 129(2), 156–163. 10.1177/003335491412900209 [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Stigler MH, Perry CL, Komro KA, Cudeck R, & Williams CL (2006). Teasing apart a multiple component approach to adolescent alcohol prevention: What worked in Project Northland? Prevention Science, 7(3), 269–280. 10.1007/s11121-006-0040-7 [DOI] [PubMed] [Google Scholar]
  52. Thurman PJ, Plested BA, Edwards RW, Foley R, & Burnside M (2003). Community readiness: The journey to community healing. Journal of Psychoactive Drugs, 35(1), 27–31. 10.1080/02791072.2003.10399990 [DOI] [PubMed] [Google Scholar]
  53. Treno AJ, Gruenewald PJ, Lee JP, & Remer LG (2007). The Sacramento Neighborhood Alcohol Prevention Project: Outcomes from a community prevention trial. Journal of Studies on Alcohol and Drugs, 68(2), 197–207. 10.15288/jsad.2007.68.197 [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Treno AJ, & Lee JP (2002). Approaching alcohol problems through local environmental interventions. Alcohol Research & Health, 26(1), 35–40. https://pubs.niaaa.nih.gov/publications/arh26-1/35-41.htm [PMC free article] [PubMed] [Google Scholar]
  55. Usera JJ (2017). The efficacy of an American Indian culturally-based risk prevention program for upper elementary school youth residing on the Northern Plains reservations. Journal of Primary Prevention, 38(1–2), 175–194. 10.1007/s10935-016-0462-3 [DOI] [PubMed] [Google Scholar]
  56. Venner KL, Feldstein SW, & Tafoya N (2006). Native American motivational interviewing: Weaving Native American and Western practices. Retrieved from https://www.integration.samhsa.gov/clinical-practice/Native_American_MI_Manual.pdf
  57. Wagenaar AC, Livingston MD, Pettigrew DW, Kominsky TK, & Komro KA (2018). Communities mobilizing for change on alcohol (CMCA): Secondary analyses of a randomized controlled trial showing effects of community organizing on alcohol acquisition by youth in the Cherokee nation. Addiction, 113(4), 647–655. 10.1111/add.14113 [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Wagenaar AC, Toomey TL, & Erickson DJ (2005). Preventing youth access to alcohol: outcomes from a multi-community time-series trial. Addiction, 100(3), 335–345. 10.1111/j.1360-0443.2005.00973.x [DOI] [PubMed] [Google Scholar]
  59. Walsh ML, & Baldwin JA (2015). American Indian substance abuse prevention efforts: A review of programs, 2003–2013. American Indian and Alaska Native Mental Health Research, 22(2), 41–68. 10.5820/aian.2202.2015.41 [DOI] [PubMed] [Google Scholar]
  60. Whitbeck LB, Walls ML, & Welch ML (2012). Substance abuse prevention in American Indian and Alaska Native communities. American Journal of Drug and Alcohol Abuse, 38(5), 428–435. 10.3109/00952990.2012.695416 [DOI] [PubMed] [Google Scholar]
  61. Whitesell NR, Beals J, Crow CB, Mitchell CM, & Novins DK (2012). Epidemiology and etiology of substance use among American Indians and Alaska Natives: Risk, protection, and implications for prevention. American Journal of Drug and Alcohol Abuse, 38(5), 376–382. 10.3109/00952990.2012.694527 [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Williams CL, & Perry CL (1998). Lessons from Project Northland: Preventing alcohol problems during adolescence. Alcohol Health and Research World, 22(2), 107–116. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/15706784 [PMC free article] [PubMed] [Google Scholar]

RESOURCES