Abstract
Contemporary prevention science has focused on the application of cultural adaptations of evidence-based prevention programs for minority youth populations. Far less is known about culturally grounded methods that are intended to organically develop prevention programs within specific populations and communities. This article systematically reviews recent literature on culturally grounded interventions used to prevent health disparities in ethnic minority youth populations. In this review, we assessed 31 peer-reviewed articles published in 2003 or later that fit inclusionary criteria pertaining to the development and evaluation of culturally grounded prevention programs. The evaluated studies indicated different approaches toward cultural grounding, as well as specific populations, geographic regions, and health issues that have been targeted. Specifically, the findings indicated that most of the studies focused on the development and evaluation of culturally grounded HIV/STI and substance abuse prevention programs for Mexican American, African American, and American Indian/Alaska Native youth residing in the South or Southwestern U.S. These studies largely relied on community-based participatory or qualitative research methods to develop programs from the “ground up.” This review has implications for the development of future culturally grounded and culturally adapted prevention programs targeting underserved minority youth populations and geographic regions. Specifically, it identifies populations and regions where culturally grounded prevention efforts are underdeveloped or non-existent, providing some scientific direction for the future development of these types of programs.
Keywords: Culturally grounded prevention, Health disparities, Minority youth, Health promotion
Over the past two decades, there has been an increased focus on incorporating culturally specific content in prevention programs in order to address health disparities and promote health equity in marginalized populations (Barrera, Castro, Strycker, & Toobert, 2013). Research has suggested that prevention interventions that meaningfully incorporate the values and norms of targeted cultural groups promote both cultural "fit" and program effectiveness for those populations (Castro, Barrera, & Martinez, 2004; Okamoto, Helm, et al., 2014). While social and behavioral intervention research has largely endorsed the value of cultural specificity, it has also described multiple methods by which culture can be infused into prevention curricula (Okamoto, Kulis, Marsiglia, Holleran Steiker, & Dustman, 2014; Resnicow, Soler, Braithwaite, Ahluwalia, & Butler, 2000). Further, while the prevention literature has described the theoretical use of and scientific value behind some of these methods to develop culturally focused prevention interventions (Barrera et al., 2013; Castro, Barrera, & Holleran Steiker, 2010; Castro et al., 2004; Resnicow, Soler, Braithwaite, Ahluwalia, & Butler, 2000), relatively little is known about the use of approaches that build prevention curricula from the "ground up" (i.e., culturally grounded prevention; Okamoto, Kulis, et al., 2014). As a result, little is known about the contexts in which this type of approach should be used and the populations that may benefit most from these approaches. The purpose of this article is to provide a systematic review of published literature pertaining to culturally grounded prevention for ethnic minority youth, which is intended to elucidate how this approach has been used with different populations and in different settings. This review has implications for the future use of culturally grounded approaches to prevention development with specific youth populations and within specific contexts.
Literature Review
Definition of Culturally Grounded Prevention
Culturally grounded prevention programs utilize collaborative approaches toward their development and evolve from the "ground up" (Lee, Vu, & Lau, 2013; Okamoto, Kulis, et al., 2014). The “ground up” or "bottom up" nature of these approaches indicate that they start from the values, behaviors, norms, and worldviews of the populations they are intended to serve, and therefore are most closely connected to the lived experiences and core cultural constructs of the targeted populations and communities (Okamoto, Kulis, et al., 2014). Central to culturally grounded approaches, researchers work collaboratively with members of the target community in order to create a program from inception to implementation, beginning with a community needs assessment to identify priorities for prevention (Lee, Vu, & Lau, 2013). Lee and colleagues distinguished culturally grounded prevention from another bottom up approach--the indigenous approach--by which a single (or few) community stakeholder(s) develop a curriculum without the collaboration of researchers or the community-at-large.
Lee et al. (2013) and Okamoto, Kulis, et al. (2014) further differentiate culturally grounded from culturally adapted prevention. Currently, there is more empirical and theoretical literature describing the development and effectiveness of culturally adapted interventions than of culturally grounded interventions (Okamoto, Kulis, et al., 2014). In contrast to culturally grounded approaches, cultural adaptations are defined as the modification of an existing intervention, such as changing the language and cultural references in curricular lessons, in order to make the intervention compatible with a specific population (Bernal, Jiménez-Chafey, & Domenech Rodríguez, 2009; Resnicow, Baranowski, Ahluwalia, & Braithwaite, 1999). Cultural adaptations often rely upon a top-down approach, in which investigator-driven research based on theories about a specific problem within a cultural group is used to modify an intervention (Lee et al., 2013). In sum, there are subtle distinctions in the ways in which culturally grounded approaches are used to develop social and behavioral interventions, compared with other approaches that are used to infuse cultural content in these interventions. Overall, the results of culturally grounded approaches are prevention programs with a high degree of social and cultural validity and "fit."
Methodological Approaches to Culturally Grounded Prevention
There are several approaches in the design and implementation of culturally grounded prevention interventions. Okamoto et al. (2006) described the use of an ecologically based assessment that can serve as the foundation for such interventions. Ecologically based assessment involves the elucidation of specific environmental and cultural correlates of community problems, and is important for the development of prevention programs. This approach can build upon protective factors for minority youth populations, including indigenous youth (Okamoto et al., 2006). For example, as part of an ecologically based assessment, Napoli, Marsiglia, and Kulis (2003) surveyed a large subsample of indigenous youth in the Southwest U.S., and found that a strong sense of belonging in school provided a protective effect against drug use.
Community-based participatory research (CBPR) methods are another means toward developing a foundation for culturally grounded prevention programs. CBPR is an applied collaborative approach involving both researchers and community members in the research process (Horowitz, Robinson, & Seifer, 2009). Specific to culturally grounded prevention, CBPR provides one avenue toward promoting culturally appropriate preconception health care for American Indian youth (Richards & Mousseau, 2012). Richards and Mousseau’s use of CBPR was intended to increase the effectiveness of health promotion and prevention programs by involving the target community in the design, implementation, and evaluation of the programs. Through their use of CBPR, the investigators identified and created different methods for delivering a prevention message. They also used focus groups in the development of key media messages to increase community members’ knowledge of preconception health (Richards & Mousseau, 2012). Another form of community-based participatory research includes community-based participatory action research (PAR), in which both researchers and community members create prevention components with a focus towards social change. The purpose of PAR is to empower marginalized communities through their active involvement in the research process (Baum, MacDougall, & Smith, 2006). Helm et al. (2015) described the use of this method in the development of the Puni Ke Ola substance use prevention program for rural Native Hawaiian youth. Their approach to PAR utilized social action in support of Hawaiian approaches to community- and family-based wellness. Using a photovoice methodology, Hawaiian youth are currently developing prevention components in collaboration with researchers. These components are based largely on community landmarks, images, and references, their cultural significance, and how they can be used for psychosocial protection against substance use and abuse.
Relevance of the Study
Research has suggested that prevention programs may need to be culturally grounded for certain youth ethnic groups, such as indigenous youth, because the content or delivery of existing prevention programs are not as effective for these populations as for other youth ethnic groups (Dixon et al., 2007). The challenge of cultural grounding is that it is time consuming and expensive relative to cultural adaptations (Holleran Steiker et al., 2008; Okamoto, Kulis, et al.,2014). This is a particular concern for communities that have severe health disparities and require a more immediate public health response, and is particularly problematic in times of severe budget constraints. Our study is relevant because we provide some scientific direction for the use of culturally grounded methods for specific populations and regions, specifically pointing to the populations and regions where cultural grounding might be indicated. Further, culturally grounded prevention interventions have the potential to anchor culturally focused prevention within certain regions and with certain populations, addressing health disparities for targeted youth populations, while also providing a conceptually shorter adaptational bridge for programs focused on related populations and regions (Okamoto, Helm, et al., 2014).
Using this logic, culturally grounded prevention programs developed for Native Hawaiian youth, for example, would have more applicability for adaptation to other indigenous youth (particularly those within the Pacific region) than programs developed for youth on the continental U.S., and could also serve as a template for adaptations to other Pacific Islander youth. This systematic review examines the characteristics of programs developed using culturally grounded approaches and can help to develop future youth prevention programs of this nature. Using specific inclusionary criteria, we provide specific information related to youth populations and regions using culturally grounded methods, as well as the means toward developing culturally grounded programs. This information can point to youth populations and regions underserved by grounded programs, allowing preventionists to respond to specific health-related needs. As such, this systematic literature review contributes to the alleviation of population-specific health disparities, and will aid in the creation of future culturally focused interventions for youth.
Method
Figure 1 illustrates a flowchart of the process of identifying articles for this systematic review. In Step 1, the two primary authors conducted a computerized search of online databases including PsycNet, PubMed, EBSCO, and SocIndex. In each database, we used a combination of terms to search for related articles. These terms included “culturally grounded,” “prevention,” “youth,” “intervention,” “rural,” “adaptation,” and “culture.” During these searches, we used other related terms such as “adolescents” and “children” to expand the search perimeter. We also identified articles related to culturally grounded prevention programs for youth in several online registries (i.e., National Registry of Evidence-based Programs and Practices [NREPP], the Cochrane Library, and Blueprints for Healthy Youth Development). In order to highlight recent studies, we limited these online database and registry searches to peer-reviewed articles published since 2003. The literature search in Step 1 yielded a total of 4,340 articles. After cross-checking the databases and eliminating any duplicate articles, we reduced the total number of articles to 3,276.
Figure 1.
Method for Literature Review. This figure illustrates our process for identifying and reducing the number of articles included this review.
In Step 2, the two primary authors read and evaluated all abstracts based on the inclusionary and exclusionary criteria for this study. Articles were included in this study if (1) they pertained to the development or evaluation of culturally grounded prevention programs1 across multiple areas, such as substance abuse, suicide, and HIV; (2) they focused on non-majority youth (e.g., ethnic and/or sexual minority youth) who were ages 18 years or younger; and (3) they described an empirically based (data driven) approach toward the development of prevention programs. Articles were excluded in this study if (1) they focused on non-adapted or culturally adapted prevention programs2 across multiple areas, such as substance abuse, suicide, and HIV; (2) they were non-empirical in nature (i.e., those in which data were not collected nor analyzed); (3) they focused on majority youth (e.g., White, middle class youth), or non-youth populations; (4) they focused exclusively on indigenous program development (e.g., grassroots programs; Lee et al., 2013); and (5) they were not peer reviewed. Based on our initial assessment using these criteria, we reduced the number of articles to 252. In Step 3, the two primary authors screened the full text of the remaining 252 articles using the inclusionary and exclusionary criteria, which further reduced the total number of articles to 55.
Finally, Step 4 of the process consisted of a further evaluation and validation of the remaining 55 articles. Additional co-authors screened and discussed the full text of each remaining article to determine whether or not it fully fit the inclusionary criteria. Through this process, we eliminated additional articles after further investigation showed that they did not fit these criteria. For example, we eliminated Brody, Yu, Chen, Kogan, and Smith (2012), because the authors focused on an adaptation of an existing group-based parenting skills training intervention for rural African American preadolescents that was originally developed by investigators from the same research team. Other studies were eliminated based on lack of evidence of cultural grounding (e.g., Pantin et al., 2009; Prado et al., 2007). Articles were also eliminated when we found that they took on a more indigenous approach to prevention described by Lee et al. (2013) or that they used the terms “cultural grounding” when, in fact, they used an adaptational approach (e.g., Colby et al., 2013). Upon completion of the validation process, 24 additional articles were excluded, resulting in a total of 31 articles for inclusion in this study.
Results
The 31 peer-reviewed articles which met the inclusionary criteria for this study are outlined in Table 1. The articles are summarized in terms of the research designs used in the studies, the demographics of the populations examined in the studies, and culturally grounded program characteristics and study outcomes.
Table 1.
Results From Literature Review
Study | Program Name |
Issue | N Size | Ethnicity | Age/ Grade |
Gender | Study Type |
Study Design |
Major Findings | Funding |
---|---|---|---|---|---|---|---|---|---|---|
Brody et al. (2005) | Strong African American Families (SAAF) |
Substance abuse, early sexual activity |
332 | African American |
M = 11.2 years |
53.6% female |
EFF | RCT | Increased positive parenting and youth self-control, improved parent-child relationships |
NIAAA, NIMH |
Brody et al. (2006) | SAAF | Youth alcohol use |
332 | African American |
M = 11.2 years |
53.6% female |
EFF | RCT | Reduction in youth alcohol use, increased protective factors |
NAAA, NIMH |
Brody et al. (2008) | SAAF | Youth conduct problems |
667 | African American |
M = 11.2 years |
53.6% female |
EFF | RCT | Reduction in conduct problems for high-risk youth |
NIAAA, NIMH |
Brody et al. (2010) | SAAF | Youth alcohol use |
667 | African American |
M = 10.8 years at pre-test |
53.6% female |
EFF | RCT | Reduction in youth alcohol use over time and alcohol use initiation |
NIDA |
Gerrard et al. (2006) | SAAF | Alcohol use onset and consumption |
281 | African American |
M = 11.2 years |
53% female | EFF | RCT | Reduction in favorable attitudes related to alcohol and youth alcohol use over time |
NIAAA |
Goodkind et al. (2012) | Our Life | Mental health |
48 | American Indian/ Alaskan Native |
7–17 years | 78% female | EFF | MIX | Increase in positive coping strategies |
CDC, NIMH |
Gosin et al. (2003) | keepin’ it R.E.A.L. |
Substance use |
8 seventh grade teachers, 3 seventh grade classes |
Mexican American |
Grade 7 | Unspecified | PRE | QE | Decreased gateway substance use over time, increased anti- drug use norms |
Unspecified |
Guilamo-Ramos et al. (2012) | Unspecified | HIV/AIDS | 40 | Rural Indian |
14–18 years | 50% female | PRE | QUAL | Improved parent-child communication |
NIMH, ICMRF |
Hayes et al. (2005) | MEMA kwa Vijana (MkV) |
HIV/STIs, unintended pregnancies |
9465 | African (Sukuma) |
15 years or older |
Unspecified | EFF | MIX | N/A; study described the nature/extent of the MkV efficacy trial |
EC, IA, MRCUK, UNAIDS |
Hecht et al. (2006) | keepin’ it R.E.A.L. |
Substance use |
6298 | Mexican American |
Grade 7 | 47% female | EFF | QUAN | Decreased gateway substance use over time |
NIDA |
Isaak et al. (2009) | The Sacred Beginnings Project |
Suicide | 136 | Canadian Aboriginal |
Unspecified | Unspecified | PRE | QUAL | Identified issues related to community- researcher collaborations |
CIHR |
Kaufman et al. (2010) | Circle of Life (COL) |
HIV/AIDS/ STIs |
768 | American Indian |
11–15 years | 48.6% female (wave 1), 47.1% female (wave 2) |
EFF | RCT | No changes in sexual risk outcomes between baseline waves 1 and 2; >70% reported condom use at last sex |
NIMH, BIE |
Kulis et al. (2005) | keepin’ it R.E.A.L. |
Substance abuse |
3402 | Mexican American |
Grade 7 | 48.5% female |
EFF | RCT | Decreased substance use, stronger intentions to refuse substances |
NIDA |
Mantell et al. (2006) | The Mpondombili Project |
HIV/STIs, unintended pregnancies |
670 | African (Zulu) |
13–19 years | Unspecified | PRE | QUAL | Described increased condom use and gender differences in sexual risk behaviors |
NIDA, NICHD |
Markus (2012) | Wind River UNITY Photovoice for Healthy Relationships |
HIV/STIs, unintended pregnancies |
6 | American Indian |
18–19 years | 50% female | EFF | QUAL, COR/ DES |
Strengthened cultural identity and self- esteem, Increased awareness of social support |
Unspecified |
Marsiglia et al. (2005) | keepin’ it R.E.A.L. |
Substance use |
2146 | Mexican American |
Grade 7 at pre-test; grade 8 at post-test |
52% female | EFF | RCT | KiR was more effective for English- language dominant participants than for Spanish-language or bilingual participants |
NIDA |
Marsiglia et al. (2010) | keepin’ it R.E.A.L. |
Substance use |
6298 | Mexican American |
Middle school (grades 6 to 8) |
47% female (Mexican American), 50% female (other Latino/ multiethnic Latino), 48% female (non- Hispanic White), 44% female (African American) |
EFF | RCT | The Latino Version of KiR was more efficacious in schools with larger percentages of non- English-speaking youth |
NIDA |
Moran and Bussey (2006) | Seventh Generation Program |
Alcohol abuse |
257 | American Indian |
M = 10.3 years |
51% female | EFF | QE | Positive impact in the areas of alcohol beliefs, locus of control, social support, and depression |
NIAAA |
Murry et al. (2007) | SAAF | Sexual risk behavior |
284 | African American |
11 years | 51% female | EFF | RCT | Increased positive parenting, and youth self-pride; decreased intent to engage in sexual risk behaviors |
NIAAA, NIMH |
Murry et al. (2011) | SAAF | HIV/AIDS | 332 | African American |
M = 11.2 years |
53.6% female |
EFF | RCT | Increased positive parenting, youth self- pride, and protective sexual norms |
NIMH |
Obasi et al. (2006) | MkV | HIV/STIs, unintended pregnancies |
Unspecified | African (Sukuma) |
15 years or older |
Unspecified | IMP | MIX | Demonstrated feasibility to implement MkV |
EC, UNAIDS, MRCUK |
Okamoto, Helm, Giroux, et al. (2010) | Ho‘ouna Pono |
Substance use |
47 (phase 1), 249 (phase 3) |
Native Hawaiian |
M = 11.87 years |
59% female | PRE | MIX | Native Hawaiian youth were exposed significantly more to drug offers from peers and family members, compared to non- Hawaiian youth |
NIDA, HPU |
Okamoto, Helm, Po‘a-Kekuawela, et al. (2010) | Ho‘ouna Pono |
Substance use |
47 | Native Hawaiian |
M = 12.2 years |
55% male | PRE | QUAL | Described a typology of drug resistance strategies used by rural Hawaiian youth (overt/ confrontational and non- confrontational strategies) |
NIDA |
Okamoto et al. (2011) | Ho‘ouna Pono |
Substance use |
64 | Native Hawaiian, Asian/ Pacific Islander |
Middle school (grades 6 to 8) |
50% female | PRE | QUAL | Explanations used for drug refusal varied based on the drug offerer (parent, peer, or cousin) |
NIDA |
Okamoto, Pel, et al. (2014) | Ho‘ouna Pono |
Substance use |
213 | Asian/ Pacific Islander |
M = 11.7 years |
55% female | PRE | RCT | Asian/Pacific Islander girls used common drug resistance strategies significantly less than their male counterparts |
NIDA |
Plummer et al. (2007) | MkV | HIV/STIs, unintended pregnancies |
62 primary schools |
African (Sukuma) |
15 years and older |
Unspecified | IMP | MIX | Demonstrated that MkV was implemented with high fidelity across schools |
EC, UNAIDS, DCI, MRCUK |
Richards and Mousseau (2012) | The Sacred Beginnings Project |
Preconception health |
77 | American Indian |
11–14 years | All female | EFF | RCT | Increases in knowledge of diabetes, obesity, and smoking risks |
Unspecified |
Shaibi et al. (2012) | The Every Little Step Counts – Diabetes Prevention Program |
Diabetes | 15 | Latino | 14–16 years | 50% female | EFF | QE | BMI and waist circumference decrease and cardiorespiratory fitness increase in intervention group; decrease in physical inactivity in intervention group |
NIMHD |
Warren et al. (2006) | keepin’ it R.E.A.L. |
Substance use |
4734 | Mexican American |
Middle school (grades 6 to 8) |
47% female | EFF | RCT | Exposure to culturally grounded videos decreased youths’ substance use |
NIDA |
Williams et al. (2012) | Mexican American Teen Relationships (MATR) |
Teen dating violence (TDV) |
219 | Mexican American |
15–17 years | 64% female | PRE | QUAL | Described principles of culturally grounded TDV prevention (e.g., focus on healthy relationships, countering racial stereotypes) |
Lois and Samuel Silverman Fund in New York |
Yabiku et al. (2007) | keepin’ it R.E.A.L. |
Substance use |
4622 | Mexican American |
Middle school |
47% female | EFF | RCT | Reduction in alcohol use |
NIDA |
Note. Study Type: EFF = efficacy/effectiveness, PRE = pre-prevention, IMP = program implementation. Study design: RCT = randomized control trial, QUAL = qualitative, QUAN = quantitative, QE = quasi-experimental, MIX = mixed methods, COR/DES = correlational/descriptive. Funding: ICMRF = Indian Council of Medical Research Funding, EC = European Commission, IA = Ireland Aid, MRCUK = Medical Research Council of the United Kingdom, CDC = Centers for Disease Control and Prevention, CIHR= Canadian Institutes of Health Research, BIE= Bureau of Indian Education, SIRC = Southwest Interdisciplinary Research Center, NIMH = National Institute of Mental Health, NIDA = National Institute on Drug Abuse, NIAAA = National Institute on Alcohol Abuse and Alcoholism, NICHD = National Institute of Child Health and Human Development, NIMHD = National Institute on Minority Health and Health Disparities, UNAIDS = Joint United Nations Program on HIV/AIDS, HPU = Hawai‘i Pacific University, DCI = Development Cooperation Ireland.
Research Design
Of the 31 studies, 65% focused on program efficacy or effectiveness, 29% focused on pre-prevention or prevention program development, and 6% focused on program implementation. Studies employed a variety of research methods, including randomized control trial designs (44%), qualitative approaches (22%), mixed methods (16%), and quasi-experimental, correlational, or descriptive approaches (18%). The majority of studies employed surveys or scales to measure program effects (65%), while 30% of these studies used focus groups in the development or evaluation of their programs. In regards to the delivery method, over half of the studies used a community-based approach. For example, the development of the Strong African American Families program involved seven consecutive weekly meetings held in community facilities with rural youth and families in Georgia (Brody, Chen, Kogan, Murry, & Brown, 2010). Thirty-two percent of the studies described a school-based approach toward delivering the prevention program, while 16% used a mixture of both community-based and school-based approaches.
Study Demographics
The two most represented ethnicities in the studies were Mexican or Mexican Americans and African Americans (29% and 23%, respectively), followed by studies focused on North American indigenous groups (American Indians, Alaskan Natives, and Canadian Aboriginals; 19%). An equal number of studies focused on Asian and/or Pacific Islander groups and African youth (13% each). In terms of predominant study locations, 29% took place in Arizona while another 23% were conducted in Georgia (see Figure 2). Further, a majority of the studies (58%) occurred in rural areas, while roughly one-third took place in urban locations. The majority of youth participating in the research studies were between the ages of 10 to 12 years (38%) and 13 to 15 years (36%). Additionally, three-fourths of the studies focused solely on youth populations (74%), and 23% focused primarily on parents of youth in our target age range.
Figure 2.
Location of Studies. This figure summarizes the geographic focus of culturally grounded prevention studies included in this review.
Program Characteristics and Outcomes
The majority of the studies in this review focused on three prevention programs–The Strong African American Families Program (SAAF; 23%), keepin’ it R.E.A.L.3 (23%), and Ho‘ouna Pono (14%; see Table 1). The majority of the prevention studies targeted substance use or abuse (33%), followed by HIV/AIDS and STIs (22%). The remaining studies focused on other health-related or behavioral issues, such as diabetes, teen dating violence, and pregnancy prevention. Thirty-seven percent of the studies used community-based participatory research (CBPR) as means for grounding (see Figure 3). For example, Shaibi et al. (2012) collaborated with a local community clinic which serves uninsured Latino families and with a metropolitan YMCA in creating a culturally grounded diabetes prevention program. The three most frequent intervention components described in the studies were skills training (29%), guided discussions and activities (27%), and education (20%).
Figure 3.
Methods for Grounding Prevention Programs. This figure illustrates the types of methods described in studies to "ground" prevention interventions.
The two primary study outcomes were improved targeted behaviors related to the intervention (48%) and increased cultural pride and/or awareness (14%). As an example of the behavioral changes, Murry et al. (2011) found that the Strong African American Families Program demonstrated program-induced changes in parenting behaviors at approximately 5 year follow-up, such as improved parent-child communication. Goodkind, LaNoue, Lee, Lance Freeland, and Freund (2012) found an increase in positive coping strategies and social adjustment, as well as an increase in connectedness to a tribal affiliation, for American Indian and Alaskan Native youth participating in a mental health promotion program. In terms of cultural aspects and enculturation, Markus (2012) used photovoice to facilitate narratives related to elders’ storytelling and tribal histories, which in turn strengthened youth participants’ cultural identity and self-esteem.
Sixty-five percent of the articles included in this review focused specifically on program efficacy or effectiveness. This subset of studies was coded based on three types of program outcomes found to be significant in each study—(1) changes in knowledge of risky behaviors (e.g., an increase in understanding information related to unsafe sexual practices or substance use), (2) changes in attitudes related to risky behaviors (e.g., an increase in feelings or beliefs that supported anti-drug use or safe sex norms), and (3) changes in risk behaviors (e.g., a decrease in risky sexual behaviors or substance use). The majority of the efficacy or effectiveness studies included in this review found significant positive effects on youths’ behaviors and attitudes (55%), followed by youths’ behaviors (25%) and youths’ attitudes (10%).
Discussion
The two programs with the most published research were the Strong African American Families Program (SAAF) and keepin’ it R.E.A.L. These programs focused on African American and Mexican American youth, respectively, and accounted for most of the research on these populations included in this review. Numerous studies have reported on the development and testing of SAAF and keepin’ it R.E.A.L. since 2003, whereas other programs, such as MEMA kwa Vijana4 or the Mpondombili Project, appear to have been studied for several years but have substantially fewer studies associated with them. Research related to other culturally grounded programs, such as Ho‘ouna Pono or Wind River UNITY Photovoice for Healthy Relationships, have been published more recently and appear to be in earlier stages of program development and evaluation. The numerous studies analyzing different aspects of SAAF and keepin’ it R.E.A.L. provide greater depth into reasons behind their effectiveness compared to the other programs included in this review, and highlight the conditions that contribute to behavioral and attitudinal changes within the target populations as a result of participation in the programs. Common characteristics of these effective programs include a focus on building skills for health-promoting behaviors (e.g., positive parenting practices and drug resistance skills), a focus on specific ethnocultural and regional values, beliefs, and worldviews, and the use of interactive techniques (e.g., discussions and activities) to convey the prevention message.
A significant portion of the studies in this review also focused on North American indigenous groups (i.e., American Indians, Alaskan Natives, and Canadian Aboriginals); however, these studies focused on a variety of different prevention programs rather than on only one or two programs. The diversity of programs targeting these populations reflects the diversity of indigenous populations in general, but the relative shortage of studies on each of these different programs suggests a lack of depth in understanding reasons for their effectiveness in addressing various health disparities for indigenous youth populations. This suggests the need for more research related to measuring and identifying effective prevention principles and practices for indigenous youth populations.
Populations that were not the focus of as many culturally grounded studies included Native Hawaiians and other Pacific Islanders, Asians or Asian Americans, and Africans. Populations absent from any culturally grounded studies in this review included those from the Middle East and Southeast Asia. The lack or absence of culturally grounded research with these populations suggests directions for future development in culturally grounded prevention programs within specific regions and ethnic groups. Culturally grounded prevention research may serve to anchor prevention programs within these specific contexts, providing a foundation for culturally and regionally specific program adaptations to related youth populations (Okamoto, Helm, et al., 2014).
The majority of sampled youth included in the studies ranged from ages 10 to 15 years, which corresponded to grades 5–9. Study investigators and program developers might have targeted this age range in order to address youth risk behaviors before or close to their onset. Recent epidemiological research has illustrated sharp increases in self-reported alcohol consumption and sexual intercourse between grades 7 and 8 (Center for Disease Control and Prevention, 2011). Prevention programs may have been timed to address these behaviors at their onset through the use of culturally relevant skills and strategies to deal with them.
The large majority of the culturally grounded programs in this review were implemented and evaluated in rural locations. The norms of rural communities align with the development of culturally grounded interventions, because they both expect active stakeholder investment and collaboration (Okamoto, Kulis, et al., 2014). In comparison, the diversity of values and cultures across urban communities could make grounding prevention programs into one unified culture difficult for developers in these settings. There may be a greater sense of social diversity and disorganization in urban settings that could hinder the grounding process, while common goals, values, and a greater sense of community involvement in rural settings may serve to support the process. These characteristics of rural communities may serve to promote and sustain culturally grounded efforts over lengthy time periods, which may have contributed to the number of studies occurring in these types of communities.
All the studies in this review described close collaboration with the target populations and their communities in order to create culturally grounded prevention interventions. Over half of the studies described how extensive information from community stakeholders and consumers was collected through the use of focus groups, community-based participatory research (CBPR), and participatory action research (PAR) strategies, and how this information could be used for grounding programs. This suggests that close collaboration with the target community or population is critical to the development of culturally grounded prevention programs. CBPR and PAR strategies incorporate qualitative methods such as focus groups and interviews, and facilitate collective opportunities for the target population to analyze and determine the culturally grounded intervention methods that work best within their communities. As an example, Gosin and colleagues explain how CBPR principles were used in the development of the keepin’ it R.E.A.L. program in order to make the program non-threatening, interactive, and fun for the youth (Gosin, Marsiglia, & Hecht, 2003; Gosin, Dustman, Drapeau, & Harthun, 2003). Further, related research on the development of the program highlighted the importance of youth participants’ narratives, because they described the influence of youths’ cultural values on their reactions to drug offers (Gosin, Marsiglia, & Hecht, 2003).
Finally, studies included in this review used a variety of research designs in the development and evaluation of culturally grounded programs, including randomized controlled trial designs, qualitative designs, and quasi-experimental designs. While this demonstrates that there are various empirical approaches to develop and evaluate these types of programs, it also suggests that researchers and program developers may need to be flexible in the designs that are used in culturally grounded prevention research. Specifically, Whitbeck, Walls, and Welch (2012) discuss the conflict that often arises between cultural values and research methods, such as how “gold standard” research designs (i.e., randomized controlled trials) involve withholding a potentially effective intervention to a portion of the target population who believe they have ownership and rights to the use of the program. The heterogeneity of different research designs used in the studies suggest that researchers involved in the development of culturally grounded programs need to be methodologically flexible, in order to balance community expectations and needs with the demand for scientific rigor.
Limitations of the Study
There were several limitations to this study. One is that this literature review was restricted to recent published articles only. Thus, community-based, culturally grounded programs in the early (pre-publication) stages of development and/or validation, or unpublished programs of this nature, were not captured in this review. Another limitation was the lack of specific information related to program development in several of the published articles. Specifically, several of these articles included descriptions of culturally focused prevention curricula, but did not describe the methods used to develop those curricula (e.g., Carter, Straits, & Hall, 2007; Prado et al., 2007). These programs may or may not have utilized a grounded approach to program development. To be conservative in our review, these articles were excluded from our analysis. As a result, our findings may not constitute a complete representation of all the culturally grounded prevention methods being utilized.
Conclusion
Despite its utilization over the past decade, culturally grounded prevention is an under-acknowledged approach to developing culturally specific prevention programs. This review of published literature on culturally grounded prevention has highlighted the application of this approach, including the methods of developing and evaluating these programs to address health disparities in minority youth populations. The majority of the studies in this review focused on programs targeting health disparities in African American, Mexican American, and American Indian/Alaska Native youth and on programs developed with rural communities. Future research might target populations or regions that are underserved by culturally grounded prevention programs, such as those within the Middle East and Southeast Asia, as well as expand upon research in the Pacific and Africa, in order to anchor culturally focused prevention within those areas. More research may also be needed to measure the effectiveness of existing culturally grounded prevention programs with few studies, particularly those targeting American Indian youth.
Acknowledgments
Resources used in preparation of this study were funded by the National Institutes of Health/National Institute on Drug Abuse under Grant R34 DA031306. The authors wish to acknowledge Ms. Jessica Mabanag and Ms. Kaycee Bills for their assistance with manuscript preparation.
Footnotes
In this study, we defined culturally grounded prevention programs as those that have been developed from the "ground up," or from the values, beliefs, and worldviews of the populations that the program was intended to serve (Okamoto, Kulis, et al., 2014; Lee et al., 2013).
In this study, we defined culturally adapted prevention programs as those that were tailored for a cultural group that were different from the group(s) for whom the original intervention was developed (Okamoto, Kulis, et al., 2014).
"R.E.A.L." stands for "Refuse," "Explain," "Avoid," and "Leave." These are the primary drug resistance skills taught in the curriculum (Hecht et al., 2006).
The full name of the program in Swahili is "Mpango wa Elimu na Maadili ya Afya (MEMA) kwa Vijana," which roughly translates to "program of education for health-related behavior for young people" (Hayes et al., 2005).
Conflict of Interest
The authors have no conflicts of interest to report in the publication of this manuscript.
Contributor Information
Michela Lauricella, Graduate student in the School of Social Work, Columbia University
Jessica K. Valdez, Executive Assistant at Asian Counseling and Referral Service, Seattle, WA
Scott K. Okamoto, Associate Professor and Research Faculty, School of Social Work, Hawai‘i Pacific University
Susana Helm, Associate Professor, Department of Psychiatry, University of Hawai‘i at Mānoa
Colleen Zaremba, Graduate student, School of Social Work, Hawai‘i Pacific University
References
References marked with an asterisk indicate studies that were included in this literature review.
- Barrera M, Castro FG, Strycker LA, Toobert DJ. Cultural adaptations of behavioral health interventions: A progress report. Journal of Consulting and Clinical Psychology. 2013;81(2):196–205. doi: 10.1037/a0027085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baum F, MacDougall C, Smith D. Participatory action research. Journal of Epidemiology & Community Health. 2006;60(10):854–857. doi: 10.1136/jech.2004.028662. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bernal G, Jiménez-Chafey MI, Domenech Rodríguez MM. Cultural adaptation of treatments: A resource for considering culture in evidence-based practice. Professional Psychology: Research and Practice. 2009;40(4):361–368. [Google Scholar]
- *.Brody GH, Chen YF, Kogan SM, Murry VM, Brown AC. Long-term effects of the strong African American families program on youths’ alcohol use. Journal of Consulting and Clinical Psychology. 2010;78(2):281–285. doi: 10.1037/a0018552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Brody GH, Kogan SM, Chen YF, McBride Murry V. Long-term effects of the strong African American families program on youths’ conduct problems. Journal of Adolescent Health. 2008;43(5):474–481. doi: 10.1016/j.jadohealth.2008.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Brody GH, Murry VM, Kogan SM, Gerrard M, Gibbons FX, Molgaard V, et al. The Strong African American Families Program: a cluster-randomized prevention trial of long-term effects and a mediational model. Journal of Consulting and Clinical Psychology. 2006;74(2):356–366. doi: 10.1037/0022-006X.74.2.356. [DOI] [PubMed] [Google Scholar]
- *.Brody GH, Murry VM, McNair L, Chen YF, Gibbons FX, Gerrard M, et al. Linking changes in parenting to parent-child relationship quality and youth self-control: The Strong African American Families program. Journal of Research on Adolescence. 2005;15(1):47–69. [Google Scholar]
- Brody GH, Yu T, Chen YF, Kogan SM, Smith K. The Adults in the Making program: long-term protective stabilizing effects on alcohol use and substance use problems for rural African American emerging adults. Journal of Consulting and Clinical Psychology. 2012;80(1):17–28. doi: 10.1037/a0026592. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carter S, Straits KJE, Hall M. Project Venture: Evaluation of an experiential, culturally based approach to substance abuse prevention with American Indian youth. Journal of Experiential Education. 2007;29(3):397–400. [Google Scholar]
- Castro FG, Barrera M, Holleran Steiker LK. Issues and challenges in the design of culturally adapted evidence-based interventions. Annual Review of Clinical Psychology. 2010;6:213–239. doi: 10.1146/annurev-clinpsy-033109-132032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castro FG, Barrera M, Martinez CR. The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science. 2004;5(1):41–45. doi: 10.1023/b:prev.0000013980.12412.cd. [DOI] [PubMed] [Google Scholar]
- Center for Disease Control and Prevention. Youth Online: Middle School YRBS, 2011 Results. 2011 from http://apps.nccd.cdc.gov/youthonline/
- Colby M, Hecht ML, Miller-Day M, Krieger JL, Syvertsen AK, Graham JW, et al. Adapting school-based substance use prevention curriculum through cultural grounding: a review and exemplar of adaptation processes for rural schools. American Journal of Community Psychology. 2013;51(1–2):190–205. doi: 10.1007/s10464-012-9524-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dixon AL, Yabiku ST, Okamoto SK, Tann SS, Marsiglia FF, Kulis S, et al. The efficacy of a multicultural prevention intervention among urban American Indian youth in the southwest U.S. The Journal of Primary Prevention. 2007;28(6):547–568. doi: 10.1007/s10935-007-0114-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Gerrard M, Gibbons FX, Brody GH, Murry VM, Cleveland MJ, Wills TA. A theory-based dual-focus alcohol intervention for preadolescents: the Strong African American Families Program. Psychology of Addictive Behaviors. 2006;20(2):185–195. doi: 10.1037/0893-164X.20.2.185. [DOI] [PubMed] [Google Scholar]
- *.Goodkind J, LaNoue M, Lee, Lance Freeland C, Freund R. Feasibility, acceptability, and initial findings from a community-based cultural mental health intervention for American Indian Youth and their families. Journal of Community Psychology. 2012;40(4):381–405. doi: 10.1002/jcop.20517. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Gosin M, Marsiglia FF, Hecht ML. keepin’ it R.E.A.L.: A drug resistance curriculum tailored to the strengths and needs of pre-adolescents of the southwest. Journal on Drug Education. 2003;33(2):119–142. doi: 10.2190/DXB9-1V2P-C27J-V69V. [DOI] [PubMed] [Google Scholar]
- *.Guilamo-Ramos V, Soletti AB, Burnette D, Sharma S, Leavitt S, McCarthy K. Parent-adolescent communication about sex in rural India: U.S.-India collaboration to prevent adolescent HIV. Qualitative Health Research. 2012;22(6):788–800. doi: 10.1177/1049732311431943. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Hayes RJ, Changalucha J, Ross DA, Gavyole A, Todd J, Obasi AI, et al. The MEMA kwa Vijana project: design of a community randomised trial of an innovative adolescent sexual health intervention in rural Tanzania. Contemporary Clinical Trials. 2005;26(4):430–442. doi: 10.1016/j.cct.2005.04.006. [DOI] [PubMed] [Google Scholar]
- *.Hecht ML. The principle of cultural grounding in school-based substance abuse prevention: The Drug Resistance Strategies Project. Journal of Language and Social Psychology. 2006;25(3):301–319. [Google Scholar]
- Helm S, Lee W, Hanakahi V, Gleason K, McCarthy K, Haumana Using photovoice with youth to develop a drug prevention program in a rural Hawaiian community. American Indian and Alaska Native Mental Health Research. 2015;22(1):1–26. doi: 10.5820/aian.2201.2015.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holleran Steiker LK, Castro FG, Kumpfer K, Marsiglia FF, Coard S, Hopson LM. A dialogue regarding cultural adaptation of interventions. Journal of Social Work Practice in the Addictions. 2008;8(1):154–162. [Google Scholar]
- Horowitz CR, Robinson M, Seifer S. Community-based participatory resarch from the margin to the mainstream: Are researchers prepared? Circulation. 2009;119:2633–2642. doi: 10.1161/CIRCULATIONAHA.107.729863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Isaak CA, Campeau M, Katz LY, Enns MW, Elias B, Sareen J. Community-based suicide prevention research in remote on-reserve First Nations communities. International Journal of Mental Health and Addiction. 2009;8(2):258–270. [Google Scholar]
- *.Kaufman CE, Mitchell CM, Beals J, Desserich JA, Wheeler C, Keane EM, et al. Circle of life: Rationale, design, and baseline results of an HIV prevention intervention among young American Indian adolescents of the Northern Plains. Prevention Science. 2010;11(1):101–112. doi: 10.1007/s11121-009-0153-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Kulis S, Marsiglia FF, Elek E, Dustman P, Wagstaff DA, Hecht ML. Mexican/Mexican American adolescents and keepin’ it R.E.A.L.: An evidence-based subsance use prevention program. Children & Schools. 2005;27(3):133–145. doi: 10.1093/cs/27.3.133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lee R, Vu A, Lau A. Culture and Evidence-Based Prevention Programs. In: Paniagua F, Yamada AM, editors. Handbook of Multicultural Mental Health. Oxford: Elsevier, Inc; 2013. pp. 525–564. [Google Scholar]
- *.Mantell JE, Harrison A, Hoffman S, Smit JA, Stein ZA, Exner TM. The Mpondombili Project: Preventing HIV/AIDS and unintended pregnancy among rural South African school-going adolescents. Reproductive Health Matters. 2006;14(28):113–122. doi: 10.1016/S0968-8080(06)28269-7. [DOI] [PubMed] [Google Scholar]
- *.Markus SF. Photovoice for Healthy Relationships: Community-based participatory HIV prevention in a rural American Indian community. American Indian & Alaska Native Mental Health Research. 2012;19(1):102–123. doi: 10.5820/aian.1901.2012.102. [DOI] [PubMed] [Google Scholar]
- *.Marsiglia FF, Kulis S, Wagstaff DA, Elek E, Dran D. Acculturation Status and Substance Use Prevention with Mexican and Mexican-American Youth. Journal of Social Work Practice in the Addictions. 2005;5(1–2):85–111. doi: 10.1300/J160v5n01_05. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Marsiglia FF, Yabiku S, Kulis S, Nieri T, Lewin B. Influences of school Latino composition and linguistic acculturation on a prevention program for youths. Social Work Research. 2010;34(1):6–19. doi: 10.1093/swr/34.1.6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Moran JR, Bussey M. Results of an Alcohol Prevention Program with Urban American Indian Youth. Child and Adolescent Social Work Journal. 2006;24(1):1–21. [Google Scholar]
- *.Murry VM, Berkel C, Brody GH, Gerrard M, Gibbons FX. The Strong African American Families program: Longitudinal pathways to sexual risk reduction. Journal of Adolescent Health. 2007;41(4):333–342. doi: 10.1016/j.jadohealth.2007.04.003. [DOI] [PubMed] [Google Scholar]
- *.Murry VM, Berkel C, Chen YF, Brody GH, Gibbons FX, Gerrard M. Intervention induced changes on parenting practices, youth self-pride and sexual norms to reduce HIV-related behaviors among rural African American youths. Journal of Youth Adolescence. 2011;40(9):1147–1163. doi: 10.1007/s10964-011-9642-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Napoli M, Marsiglia FF, Kulis S. Sense of belonging in school as a protective factor against drug abuse among Native American urban adolescents. Journal of Social Work Practice in the Addictions. 2003;3(2):25–41. doi: 10.1300/J160v03n02_03. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Obasi AI, Cleophas B, Ross DA, Chima KL, Mmassy G, Gavyole A, et al. Rationale and design of the MEMA kwa Vijana adolescent sexual and reproductive health intervention in Mwanza Region, Tanzania. AIDS Care. 2006;18(4):311–322. doi: 10.1080/09540120500161983. [DOI] [PubMed] [Google Scholar]
- *.Okamoto SK, Helm S, Giroux D, Kaliades A. “I no like get caught using drugs”: Explanations for refusal as a drug resistance strategy for rural Native Hawaiian youths. Journal of Ethnic & Cultural Diversity in Social Work. 2011;20(2):150–166. doi: 10.1080/15313204.2011.570131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Okamoto SK, Helm S, Giroux D, Edwards C, Kulis S. The development and initial validation of the Hawaiian Youth Drug Offers Survey (HYDOS) Ethnicity and Health. 2010;15(1):73–92. doi: 10.1080/13557850903418828. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Okamoto SK, Helm S, Pel S, McClain LL, Hill AP, Hayashida JKP. Developing empirically based, culturally grounded drug prevention interventions for indigenous youth populations. Journal of Behavioral Health Services & Research. 2014;41(1):8–19. doi: 10.1007/s11414-012-9304-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Okamoto SK, Helm S, Po‘a-Kekuawela K, Chin CIH, Nebre LH. Exploring culturally specific drug resistance strategies of Hawaiian youth in rural communities. Journal of Alcohol and Drug Education. 2010;54(1):56–75. [PMC free article] [PubMed] [Google Scholar]
- Okamoto SK, Kulis S, Marsiglia FF, Holleran Steiker LK, Dustman PA. A continuum of approaches toward developing culturally focused prevention interventions: From adaptation to grounding. The Journal of Primary Prevention. 2014;35:103–112. doi: 10.1007/s10935-013-0334-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Okamoto SK, LeCroy CW, Tann SS, Rayle AD, Kulis S, Dustman P, et al. The implications of ecologically based assessment for primary prevention with indigenous youth populations. The Journal of Primary Prevention. 2006;27(2):155–170. doi: 10.1007/s10935-005-0016-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Okamoto SK, Pel S, Helm S, Valdez JK. Gender differences in the use of drug resistance strategies: An analysis of rural Asian/Pacific Islander youth. Health Promotion Practice. 2014;15(4):568–574. doi: 10.1177/1524839913507927. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pantin H, Prado G, Lopez B, Huang S, Tapia MI, Schwartz SJ, et al. A randomized controlled trial of Familias Unidas for Hispanic adolescents with behavior problems. Psychosomatic Medicine. 2009;71(9):987–995. doi: 10.1097/PSY.0b013e3181bb2913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- *.Plummer ML, Wight D, Obasi AI, Wamoyi J, Mshana G, Todd J, et al. A process evaluation of a school-based adolescent sexual health intervention in rural Tanzania: the MEMA kwa Vijana programme. Health Education Research. 2007;22(4):500–512. doi: 10.1093/her/cyl103. [DOI] [PubMed] [Google Scholar]
- Prado G, Pantin H, Briones E, Schwartz SJ, Feaster D, Huang S, et al. A randomized controlled trial of a parent-centered intervention in preventing substance use and HIV risk behaviors in Hispanic adolescents. Journal of Consulting and Clinical Psychology. 2007;75(6):914–926. doi: 10.1037/0022-006X.75.6.914. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Resnicow K, Baranowski T, Ahluwalia JS, Braithwaite RL. Cultural sensitivity and public health: Defined and demystified. Ethnicity and Disease. 1999;9:10–21. [PubMed] [Google Scholar]
- Resnicow K, Soler R, Braithwaite R, Ahluwalia JS, Butler J. Cultural sensitivity in substance use prevention. Journal of Community Psychology. 2000;28(3):271–290. [Google Scholar]
- *.Richards J, Mousseau A. Community-based participatory research to improve preconception health among Northern Plains American Indian adolescent women. American Indian & Alaska Native Mental Health Research. 2012:154–185. doi: 10.5820/aian.1901.2012.154. [DOI] [PubMed] [Google Scholar]
- *.Shaibi GQ, Konopken Y, Hoppin E, Keller CS, Ortega R, Castro FG. Effects of a culturally grounded community-based diabetes prevention program for obese Latino adolescents. The Diabetes Educator. 2012;38(4):504–512. doi: 10.1177/0145721712446635. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Whitbeck LB, Walls ML, Welch ML. Substance abuse prevention in American Indian and Alaska Native communities. The American Journal of Drug and Alcohol Abuse. 2012;38(5):428–435. doi: 10.3109/00952990.2012.695416. [DOI] [PubMed] [Google Scholar]
- *.Warren JR, Hecht ML, Wagstaff DA, Elek E, Ndiaye K, Dustman P, et al. Communicating prevention:The effects of the keepin’ it REAL classroom videotapes and televised PSAs on middle-school students’ substance use. Journal of Applied Communication Research. 2006;34(2):209–227. [Google Scholar]
- *.Williams LR, Adams HL, Altamirano BN. Mexican American adolescents’ perceptions of dating violence programs: Recommendations for effective program design and implementation. Qualitative Social Work. 2012;11(4):395–411. [Google Scholar]
- *.Yabiku S, Kulis S, Marsiglia FF, Lewin B, Nieri T, Hussaini S. Neighborhood effects on the efficacy of a program to prevent youth alcohol use. Substance Use & Misuse. 2007;42(1):65–87. doi: 10.1080/10826080601094264. [DOI] [PMC free article] [PubMed] [Google Scholar]