Abstract
To advance the implementation and dissemination of culturally adapted interventions to diverse populations, greater attention should be devoted to three underdeveloped topics: (a) local adaptations of interventions when they are implemented in community settings, (b) participant engagement, and (c) the sustainability of adapted interventions. Several typologies have been developed for studying local adaptations, and some research indicates that such adaptations might add to intervention effectiveness. There is suggestive evidence of ethnocultural group disparities in intervention engagement and in the success of efforts to boost engagement. Theory and limited data indicate that interventions’ flexibility and fit with organizational culture and resources can be achieved through cultural adaptations. Furthermore, those adaptations should be associated with sustainability, but research has yet to test that hypothesis adequately. Several recommendations are made for advancing culturally adapted interventions through additional research on local adaptations during implementation, the many facets of participant engagement, and sustainability.
Keywords: Cultural adaptation, Local adaptation, Engagement, Sustainability
Calls for expanded access to efficacious preventive interventions (Biglan et al. 2003; Rotheram-Borus et al. 2012) fueled interest in culturally adapting evidence-based interventions for more effective delivery to diverse communities. Work on the cultural adaptations of interventions, both rehabilitative and preventive interventions, has flourished. Discourse on this topic has included trenchant discussions of the role of cultural adaptations in implementation science (Cabassa and Baumann 2013); pros and cons of adaptation (Castro et al. 2004; Dusenbury et al. 2003; Hansen et al. 2013); descriptions of systematic methods for conducting adaptations (Barrera and Castro 2006; Davidson et al. 2013; Kumpfer et al. 2008); and meta-analyses and narrative reviews of exemplary research (Castro et al. 2010; Gonzales et al. 2016; Sundell et al. 2015). The rationale for cultural adaptations is well documented (e.g., Bernal et al. 2009; Cardemil 2010; Castro et al. 2004; Lau 2006). In general, the goal is to improve the reach, engagement, effectiveness, and sustainability of interventions by making modifications to fit ethnocultural groups’ languages, cultural values, lifestyles, and any unique risk/protective factors (Cabassa and Baumann 2013). Proponents of cultural adaptations do not advocate unjustified changes to original evidence-based interventions (EBIs). Instead, reasoned steps have been proposed for collecting qualitative and quantitative data that could guide changes to EBI methods and content without disturbing core intervention components (Castro et al. 2010; Lau 2006).
In a paper that called for greater integration of efforts to promote cultural adaptation and implementation science, Cabassa and Baumann (2013) observed that despite their great promise, culturally adapted evidence-based interventions are implemented rarely. The purpose of this article is to discuss three topics having special importance for future advancements of culturally adapted preventive interventions and for the issue’s theme of implementation and dissemination: (a) local adaptations of evidence-based interventions, (b) intervention engagement of diverse populations, and (c) sustainability of culturally adapted interventions. These topics are only a few of the many factors that can be studied within the framework of implementation and type 2 translational science, which place great importance not only on the interventions themselves but also on the structure and resources of communities and host organizations (Spoth et al. 2013). Nevertheless, how interventions are altered during implementation, how well they engage participants, and how they are sustained by systems of care are key questions for implementation science. Because the initial research emphasis on the cultural adaptation of interventions has focused on their development and efficacy, research on other aspects of implementation elements including local adaptation, engagement, and sustainability has lagged.
Local Adaptations
Local Adaptations Are Common and Can Be Effective
When EBIs, and even culturally adapted EBIs (e.g., Miller-Day et al. 2013), are implemented in community settings, they are changed frequently by program implementers (such as community agencies or classroom teachers) in ways that deviate from the intervention’s content and procedures. Deviations of those types can be labeled “local adaptations” or “local reinventions,” conveying the fact that products (interventions) developed at one setting (e.g., a university-based efficacy trial) are altered when implemented in another setting (Blakely et al. 1987; Leviton 2013). Alternative terms that might be used such as impromptu, in vivo, or in situ adaptations convey the sense that changes are often made spontaneously during intervention sessions, perhaps in reaction to unanticipated conditions (e.g., disruptive classroom events) or perceived needs of participants (e.g., misunderstood session content). Cultural adaptations and local adaptations differ on several dimensions. Cultural adaptations are developed prior to broad-scale implementation, are intended to reach populations (e.g., hypertensive African-Americans in Georgia’s community health centers), and focus on cultural fit. Local adaptations are made just prior to or during intervention sessions, are directed at specific intervention sites (e.g., a community, clinic, or classroom), and could be done to improve cultural fit as well as a number of other idiosyncratic considerations including lack of time or physical resources.
One perspective is that local adaptations are regarded as flaws in implementation fidelity, particularly when attributed to poor preparation, inattention to protocols, or deliberate disregard for fidelity standards. Blakely et al. (1987) quipped that reinvention might be regarded as “an unnecessary synonym for low-fidelity implementation” (p. 259). A contrasting perspective is that local adaptations provide windows into understanding (a) the limitations of an intervention’s uniform implementation as well as (b) ways for improving an interventions’ effectiveness and fit to local conditions (Chambers et al. 2013; Leviton 2013).
It is well known that deviations from complete fidelity are extremely common when prevention programs are implemented in community settings (Dusenbury et al. 2005; Hansen et al. 2013; Miller-Day et al. 2013). A study by Miller-Day and colleagues (2013) was particularly compelling because it assessed teachers’ local (classroom level) adaptations of a substance use preventive intervention through self-reports as well as with video recordings of in-class sessions. They found that teachers reported adapting 68 % of program lessons; observers found that 97 % of the lessons were adapted. Their own data and their review of many other studies led them to conclude that “adaptations to program models are the norm rather than the exception” (p. 325). A similar conclusion was reached by Hansen et al. (2013) after their appraisal of the literature. Those who implement interventions with ethnocultural participants might be particularly motivated to make local adaptations to improve cultural fit (Ringwalt et al. 2004). However, cultural characteristics of participants constitute only one of the several prominent reasons why local adaptations are done (Cooper et al. 2016).
There is some evidence that local adaptations can be related to favorable intervention outcomes (Blakely et al. 1987; Durlak and DuPre 2008; McGraw et al. 1996). Research conducted with seven different interventions, each implemented in ten different sites (for a total of 70 implementations) found that fidelity was correlated 0.38 with program effectiveness; degree of reinvention was correlated 0.33 with effectiveness, a nearly comparable relation (Blakely et al. 1987). Controlling for fidelity, additions to the program were correlated 0.26 with program outcomes, indicating that adaptations were associated with improvements in outcomes above and beyond the influence of fidelity. Analyses that drew a distinction between two local adaptation strategies found that additions of program components, but not modifications of standard components, were related to effectiveness. That finding suggests that both fidelity and adaptations could have positive effects on intervention outcomes—core program elements are implemented with fidelity, and adaptation needs are addressed with additions to program material. There are, in fact, systematic approaches for making adaptations while preserving core intervention components (Aarons et al. 2012; Lee et al. 2008).
A study of children’s health found that there was a positive relation between the percentages of teacher modified sessions and students’ dietary self-efficacy (McGraw et al. 1996). The researchers speculated that teachers’ local adaptations reflected their efforts to tailor the intervention to students’ needs and were possible indications of high teacher motivation. Other research suggests that teachers who made local adaptations to intervention content were better teachers than those who delivered the intervention with greater fidelity (Dusenbury et al. 2003). Leviton (2013) noted that experienced teachers and social workers were more effective when they made modifications based on the needs of students and clients. In one of the studies she cited, a modular approach that allowed therapist flexibility in the application of three manualized treatments was more effective than the standard administration of those treatments (Weisz et al. 2012).
Local Adaptation Typologies and Coding Systems
A more nuanced study of local adaptations would benefit from organizing adaptation efforts through typologies and coding schemes (Hansen et al. 2013; Miller-Day et al. 2013; Stirman et al. 2013). Recall that Blakely and colleagues (1987) used a basic tripartite typology that consisted of additions, modifications, and deletions of program components. That typology proved to be useful in determining that additions were associated with positive intervention outcomes, but modifications were not.
Other implementation coding systems are consistent with Blakely et al.’s typology as a starting place to quantify adaptation (Hansen et al. 2013; Hill et al. 2007; Miller-Day et al. 2013; Moore et al. 2013; Ozer et al. 2010; Sandler et al. 2015; Stirman et al. 2013). Several coding systems assessed “valence” or congruence—whether the adaptation was consistent with the intervention’s goals—and quality (Hansen et al. 2013; Moore et al. 2013; Ozer et al. 2010; Sandler et al. 2015). For example, an in-depth study of nine middle school teachers (each with three classes) showed that high-quality local adaptations were related to positive drug prevention outcomes (Hansen et al. 2013). Similar to Moore et al.’s (2013) distinction between proactive and reactive adaptations, Berkel and colleagues (2016) also code whether an adaptation was initiated independently by the provider or in response to a participant need or concern, codes that might have special importance for local adaptations conducted with ethnocultural participants. It is worth noting that four papers concerned with local adaptation taxonomies were published in 2013. Thus, adaptation typologies are fairly recent developments (also see Dusenbury et al. 2005), which with few exceptions (Blakely et al. 1987; Hansen et al. 2013), have not been linked sufficiently with outcomes.
When those who implement interventions articulate their reasons for making local adaptations, they deepen our understanding of implementation barriers and limitations of intervention content and procedure. Similar to the work by Ringwalt et al. (2004), some have attended to the reasons why intervention implementers made local adaptations (Cooper et al. 2016; Hill et al. 2007; Miller-Day et al. 2013; Moore et al. 2013). With consistency across many interventions, the most frequently mentioned pragmatic reason for in situ adaptations was “lack of time” (Cooper et al. 2016; Hill et al. 2007; Miller-Day et al. 2013; Moore et al. 2013). Frequent substantive reasons for change were resistance from implementers, participant dissatisfaction, and cultural inappropriateness (Moore et al. 2013); students’ attention spans, reading skills, and level of engagement with the intervention (Miller-Day et al. 2013); and participant attributes, which included their cultural characteristics (Cooper et al. 2016).
The analysis by Cooper et al. (2016) was uniquely informative because it examined the intersection between the local adaptation coding systems of Hill et al. (2007) and Moore et al. (2013). Cooper et al. were able to determine the extent to which adaptations coded as additions, changes, and deletions (from Hill et al. categories) were positively or negatively aligned with the intervention’s theory (from Miller et al. categories). Results showed that deletions were overwhelmingly negative, i.e., out of alignment; additions and changes were approximately equally categorized as positive or negative. Also, adaptations made because of “not enough time” were almost always reactive (in response to an unexpected event during a session); adaptations made because of participant characteristics (e.g., culture) were predominantly proactive (prior to a session to potentially improve the lesson).
In summary, evidence-based interventions, even those that are culturally adapted, routinely receive local adaptations by intervention implementers. A number of coding systems have been developed, providing essential methods for the systematic study of local adaptation dimensions. There is some indication that local adaptations can improve intervention effects, but there is the need for more research that connects adaptation-coding categories to outcomes of specific interventions implemented in specific contexts. Information gleaned from local adaptation evaluations should inform the further refinement of cultural adaptations by identifying common ways interventions are modified to address the core needs of members of an ethnocultural group and then training implementers to make adjustments that have the greatest chances of improving intervention fit and effectiveness.
Engagement
One of the motivations for cultural adaptations of preventive interventions, either planned or local, is to improve participant engagement (responsiveness), which includes attendance, satisfaction, in-session participation, and use of program skills (Berkel et al. 2011). Surface structure (e.g., use of culture congruent images) and deep structure (e.g., content of messages) adaptations (Resnicow et al. 2000) used in program materials are intended to welcome members of ethnocultural groups into a program that is sensitive to their needs, encouraging their full participation in an experience that they perceive as designed for them. Two main questions organize the following section on cultural adaptation and participant responsiveness: (a) is there evidence of poor engagement for members of ethnocultural groups, indicating a need for cultural adaptation? and (b) have cultural adaptations specifically targeted engagement and have these efforts been successful in improving engagement?
Ethnocultural Differences in Multiple Dimensions of Engagement
Attendance
Attendance is a frequently examined indicator of engagement and is generally predictive of intervention outcomes (Durlak and DuPre 2008). It has been measured in multiple ways, and each can add to our understanding of what works in engaging members of ethnocultural minority groups. Low rates of enrollment can illuminate logistical barriers that some groups disproportionately face, and they can also give clues about the effectiveness of the “packaging” of the program, an element of surface structure. Conversely, retention over time can signal logistical barriers and surface structure appropriateness and also indicate how well the program content meets the needs and values of participants. Consequently, we examined studies reporting comparisons by race and ethnicity for any type of attendance, including enrollment, retention, or overall amount of sessions attended.
Enrollment
One large-scale study examining attendance in school-based programs to prevent mental health problems among six ethnocultural groups in California found that Asian students were less likely to enroll in school-based mental health prevention than other ethnocultural groups (Anyon et al. 2014). Baker et al. (2011) assessed enrollment in the Incredible Years program and found that African-American and Puerto Rican families were less likely to enroll than non-Latino white families. Perrino and colleagues (2001) also found that Latinos were more likely to be initially engaged (attended at least one of the first three sessions) in a parenting program than were African-Americans. These studies demonstrated that evaluations of intervention engagement often show ethnocultural group differences in engagement that indicate the possible need for cultural adaptations to achieve greater engagement equity (c.f., Du Bois et al. 2012).
Global Attendance
A meta-analysis of parent-training programs found that minority group status was associated with a number of different measures of attendance (Reyno and McGrath 2006). On the other hand, some studies have found no effect of ethnocultural group on attendance rates (e.g., Dumas et al. 2007; Smith et al. 2014). Overall, attendance disparities appear lower than in the past two decades when attendance for minority group participants was one third of the rate for the majority (Kumpfer et al. 2002). This might indicate that developers are now paying more attention to cultural context.
Retention
Few studies have focused on participant retention patterns over time. An innovative study examined patterns of retention for Spanish and English-speaking Latino families (Mauricio et al. 2014). Familism values and group cohesiveness, which were higher among Spanish-speaking families, differentiated those families who stayed in the program from those who dropped out. Ethnocultural group differences in retention need greater research scrutiny to determine if cultural adaptation efforts should be devoted to this aspect of engagement.
Satisfaction
The literature that examines participant satisfaction across ethnocultural groups is too limited to draw definite conclusions, but there are a few reports of such differences. In the Parents Who Care (PWC) program, Haggerty and colleagues (2007) found higher levels of satisfaction for this intervention on the whole and intervention materials for African-American relative to white adolescents. Information about the cultural adaptation of this program was not provided other than that groups were usually led by one white and one African-American facilitator. A national evaluation of 12 programs funded by the Center for Substance Abuse Prevention (CSAP) found that African-American youth reported higher satisfaction than Native American, Asian, Latino, white, or other group members (Chipungu et al. 2000). One study compared four ethnocultural groups on satisfaction across a range of intervention components such as program leaders, skills that were taught, and telephone contacts (Reid et al. 2001). Different patterns of group differences were found for satisfaction with the various components. When ethnocultural group differences in satisfaction are observed for specific preventive interventions and their subparts, they signal the opportunity to initiate cultural adaptations that might result in more comparable satisfaction levels.
In-Session Participation
Three studies were identified that assessed differences in active participation within program sessions. In two, white parents scored higher on active participation than members of the ethnocultural minority groups (Nix et al. 2009; Orrell-Valente et al. 1999), whereas in the third, no subgroup differences were found (Dumas et al. 2007). It might be that ethnocultural differences are influenced by SES in multivariate models; the effects of parent education and occupation attenuated the effects of race (Nix et al. 2009). Another explanation is that being a member of an ethnocultural minority group in a program led by majority group facilitators might lead to low levels of trust, which could inhibit active participation and disclosure of personal information (Orrell-Valente et al. 1999).
Home Practice
Many programs assign home practice activities for participants to complete between sessions (e.g., Clarke et al. 2013; Schoenfelder et al. 2012). Use of program skills in daily life is one of the most important indicators of responsiveness to the intervention and constitutes the most proximal indicator of implementation for attaining program outcomes (Berkel et al. 2016). Nix et al.’s (2009) measure of active participation included an item that assessed engaging in home practice. Total participation scores were higher for non-Latino white participants; however, differences on the home practice item were not analyzed separately. One study demonstrated that African-American and Latino adolescents were less likely to complete the home practice assignments in a parent–child communication program for sexual risk behavior (Blake et al. 2001). Thus, there is some limited evidence that African-American and Latino participants were less engaged in home practice for specific interventions compared to white participants.
Have Cultural Adaptations Efforts Been Successful in Increasing Responsiveness?
A randomized controlled trial in which a culturally adapted intervention is tested against the original provides a strong test of the adaptation’s ability to increase engagement and program outcomes. A trial examined the relative effectiveness of three intervention conditions: (a) a Parent–Child Interaction Therapy (PCIT), (b) a culturally adapted version designed for Mexican-American families (GANAS), and (c) treatment as usual (TAU) (McCabe and Yeh 2009). It is found that the original PCIT and GANAS were equivalent as assessed on intervention satisfaction, rates of family dropout, and rates of mothers’ attendance. Fathers in the GANA condition attended nearly twice as many sessions, although the difference was not statistically significant. Several design and implementation factors may have contributed to the absence of differences in effects across study conditions. These factors include the following: (a) a small overall sample size, (b) ceiling effects for satisfaction in both GANAS and PCIT, and (c) possible in situ cultural adaptation of the PCIT condition due to contagion effects (the same providers delivered both conditions) and due to ethnic matching (all providers were bilingual Mexican-American).
Beyond this experiment, evidence from comparative trials on responsiveness is limited, perhaps because some consider it to be impractical or unethical to randomize members of ethnocultural minority groups to a condition that is not optimized for their group when one is available (Cardemil 2010; Kumpfer et al. 2002). Observational studies, however, can provide some important insight into this question. Kumpfer and colleagues (2002) reported the effects of cultural adaptations of the Strengthening Families Program on attendance based on 27 studies of variations that were adapted for several ethnocultural groups including the following: rural and urban African-Americans, Asian/Pacific Islanders, Latinos, and American Indians. Findings involving the effects of the adapted version relative to the original version suggested the presence of improvements in engagement, with recruitment and retention rates being an average of 41 % better in the adapted version. Rates of engagement decreased in only one study in which program developers were not involved, and where some core content was eliminated.
In the analysis of satisfaction within adapted programs, a national evaluation of CSAP programs demonstrated that African-American youth in programs specifically adapted or designed for African-Americans reported higher levels of satisfaction and were more likely to describe the program as relevant and important for their daily lives, when compared to the unadapted programs (Chipungu et al. 2000). Another research strategy is to compare rates of engagement for the culturally adapted versions to rates in the original effectiveness trials. For example, one study found slightly lower rates of attendance and satisfaction in a culturally adapted version of Triple P for Indigenous Australian families when compared to rates in the original effectiveness trials (Turner et al. 2007). Such comparisons can be problematic if recruitment and retention methods vary across trials. Therefore, results from those comparisons should be interpreted with caution.
Sustainability
Sustainability can be defined as the capacity of an intervention to be continued by systems of care such as schools, medical practices, or community agencies, particularly after the withdrawal of initial outside funding (Glasgow et al. 1999; Rabin et al. 2008). At least 11 different terms such as “maintenance,” “continuation,” “durability,” “institutionalization,” and “routinization” also have been used, but “sustainability” has been the most prominent (Johnson et al. 2004; Wiltsey Stirman et al. 2012). Sustainability is thought to be influenced by characteristics of the institution, program implementers, community support, as well as the intervention itself (Cooper et al. 2015).
A conceptual paper that introduced the dynamic sustainability framework explained the somewhat paradoxical connection between adaptations (change) and sustainability (stability) following implementation (Chambers et al. 2013). The paper’s authors argued that post-implementation adaptations should strive to boost sustainability by improving program quality and fit with an institution and its community context. They challenged the conventional program development process: establish efficacy under optimal conditions, freeze program content and methods, and implement the program in diverse settings with procedures that aim for complete fidelity to the pre-implementation product. Such conventional practices lack adaptation procedures for continuous intervention improvement, which are viewed as critical for sustainment within dynamic (changing) conditions.
It is understandable that serious attention to sustainability followed periods when research on the development and efficacy of preventive interventions were the priorities. However, there has been sufficient published research and conceptual work to support substantive literature reviews (Scheirer 2005; Wiltsey Stirman et al. 2012). A review of 125 qualitative and quantitative studies of sustainability of health, mental health, and educational interventions found that parts of interventions were more likely to be sustained than complete interventions, and studies that assessed sustainability with observer ratings showed that less than 50 % of providers sustained interventions at high levels of fidelity (Wiltsey Stirman et al. 2012). In their summary of factors associated with sustainability, Wiltsey Stirman et al. (2012) wrote, “Not surprisingly, among the innovation characteristics that were identified, the fit of the program or intervention with the system or organization and the degree to which the intervention or program could be modified were most common” (p. 9). That statement was consistent with the contention that intervention modifications, including cultural adaptations, can increase the probability that programs are sustained, but that contention has not been tested adequately.
One study sought to identify predictors of sustainability for 77 delinquency and violence prevention programs that had received seed grant funding (Cooper et al. 2015). Programs completed several waves of assessments that spanned implementation and the period following the cessation of funding. Assessments of predictors covered four domains: (a) organizational support for program implementation (such as support from community coalitions), (b) program fit with the organization (including the program’s cultural appropriateness), (c) implementer characteristics (including knowledge of the program’s logic model), and (d) sustainability planning. Sustainment, defined as the continuation of program implementation at least 2 years following the termination of the start-up funding, was determined in the final assessment. Results showed that 69 % of organizations sustained programs, but 58 % of those sustained were continued at reduced levels. The authors concluded that “Overall, we found that organizational support for program implementation (connection to a high functioning coalition, outreach to community stakeholders); better program fit (i.e., lack of reasons for changing the program model); knowledgeable, well-trained program implementers; and sustainability planning are key predictors of sustainability across program type” (p. 9). The item on cultural appropriateness was not related to sustainability in any of the analyses, but there was limited statistical power and only brief assessment of cultural fit.
Future research should be directed specifically at the possible role of culturally adapted interventions in boosting sustainability and, more generally, on the characteristics of interventions, institutions, and implementers that influence sustainability. Hypothetically, if cultural adaptations increase perceived fit and effectiveness, organizations should be motivated to sustain intervention efforts, particularly if they can be adapted further to fit organizations’ resources of money, time, and people. That hypothesis has not been tested sufficiently. Evaluation approaches described by Cooper et al. (2015) and by Mancini and Marek’s (2004) Program Sustainability Index (PSI) are valuable resources for this future research, yet both approaches would benefit from greater coverage of culturally adapted interventions.
Recommendations
Culturally adapted interventions have the potential to increase participant engagement, intervention efficacy, adoption by community systems of care, and sustainment. In a quote attributed to Rogers (1993), Swisher (2000, p. 970) noted that “programs must be ‘adaptable’ in order to be ‘adopted.’” Furthermore, Swisher asserted that interventions are more likely to be sustained when they are adapted to fit an agency’s usual pattern of functioning. Because of the numerous ways cultural adaptations can influence implementation and dissemination, it is imperative to advance their study. Within the context of efforts at scaling up by promoting the adoption of evidence-based prevention interventions (Spoth et al. 2013), the process of adaptation should not be conceptualized as an inherent detriment to fidelity. It is an effort to promote greater participant engagement and more effective intervention implementation within each unique community and its residents. From our assessment of the recent literature, several recommendations are proposed.
For Conducting Local Adaptations
Recommendation: Cultural adaptation stage models (see Castro et al. 2010) should be expanded to include a late-stage implementation phase when local adaptations are assessed. After interventions are culturally adapted, they should be evaluated continuously as they are implemented and locally adapted.
Recommendation: Existing systems for coding local adaptations should be used to evaluate key categories, especially adaptation strategies (additions, changes, deletions), timing (reactive or proactive), and intervention theory congruence (see Cooper at al. 2016).
Recommendation: Connecting categories of local adaptations to intervention outcomes should be a priority research topic. That information would promote data-driven decisions in teaching intervention implementers about the types of local adaptations that appear to boost intervention effectiveness.
Recommendation: There is a need for program developers to offer strong evidence- or theory-based recommendations that identify core components of their interventions. Because studies show that intervention elements are often deleted during local adaptations, implementers should know which components should not be dropped and those that are more discretionary.
For Promoting Engagement
Recommendation: To understand if a program is equitably engaging the population, efforts should be made to test engagement across as many relevant subgroups as possible. These studies should report multiple dimensions of engagement including enrollment, attrition, program exercises completed, and total sessions attended to foster an understanding of the unique mechanisms that affect these various indicators of consumer involvement.
Recommendation: Both planned and local cultural adaptation strategies should be categorized (coded) to determine what types of adaptations are effective in increasing engagement, and whether certain strategies are more effective in enrolling participants and encouraging them to remain in the intervention.
Recommendation: Because ethnocultural groups are not homogeneous, measures related to culture, such as cultural values might help explain within-group variation in engagement (Dillman Carpentier et al. 2007; Mauricio et al. 2014).
Recommendation: When possible, trials should be conducted to empirically test the effects of cultural adaptations on engagement. A variety of study designs may be used to address the ethics of randomizing individuals to versions that are not optimized for their groups, such as designs that compare finding to previous trials (making sure to hold recruitment methods as constant as possible) or designs that test individual components of the program (Collins et al. 2016).
Recommendation: Mediational and moderational analyses should be conducted to assess the pathways from cultural adaptation to outcomes as potentially influenced by dimensions of participant responsiveness, and whether these differ across ethnocultural groups.
For Increasing Sustainability
Recommendation: Research is needed to determine if cultural adaptations result in greater sustainability. Some but not all cultural adaptations include initial steps in which agency personnel and community stakeholders provide input into the design of interventions and modes of delivery to ethnocultural communities. Coding to capture degree of collaboration with agency and community stakeholders during cultural adaptation stages should be included in studies of the relations between sustainability and cultural adaptations.
Recommendation: Institutions are more likely to sustain portions of interventions (Wiltsey Stirman et al. 2012) and reduced intensity interventions (Cooper et al. 2015) than they are to sustain the original, full intervention. The admonition of preserving core components while adding components to increase cultural fit runs counter to the push for briefer interventions. One of the many challenges will be creating cultural adaptations that are efficient, optimizing reach and sustainability, yet still affecting meaningful prevention outcomes. More attention should be given to cultural adaptations of adaptive intervention designs (Collins et al. 2004), which selectively provide just those intervention components indicated by need-based decision rules and technology-mediated interventions (Bennett and Glasgow 2009).
Funding
This article was funded in part by the Robert Wood Johnson Foundation (grant number 72241) awarded to Dr. Castro (PI).
Footnotes
Conflict of Interest The authors declare that they have no conflict of interest.
Ethical Approval This article does not contain any studies with human participants or animals performed by any of the authors.
Informed Consent Because this article is a review and analysis of previously published literature, informed consent is not applicable.
References
- Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, Silovsky JF, Hecht DB, & Chaffin MJ (2012). Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implementation Science, 7, 1–9. doi: 10.1186/1748-5908-7-32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Anyon Y, Ong SL, & Whitaker K (2014). School-based mental health prevention for Asian American adolescents: Risk behaviors, protective factors, and service use. Asian American Journal of Psychology, 5, 134–144. doi: 10.1037/a0035300. [DOI] [Google Scholar]
- Baker CN, Arnold DH, & Meagher S (2011). Enrollment and attendance in a parent training prevention program for conduct problems. Prevention Science, 12, 126–138. doi: 10.1007/s11121-010-0187-0. [DOI] [PubMed] [Google Scholar]
- Barrera M Jr., & Castro FG (2006). A heuristic framework for the cultural adaptation of interventions. Clinical Psychology: Science and Practice, 13, 311–316. doi: 10.1111/j.1468-2850.2006.00043.x. [DOI] [Google Scholar]
- Bennett GG, & Glasgow RE (2009). The delivery of public health interventions via the Internet: Actualizing their potential. Annual Review of Public Health, 30, 273–292. doi: 10.1146/annurev.publhealth.031308.100235. [DOI] [PubMed] [Google Scholar]
- Berkel C, Mauricio AM, Schoenfelder E, & Sandler IN (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33. doi: 10.1007/s11121-010-0186-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berkel C, Sandler IN, Brown CH, Gallo CG, Mauricio AM, Wolchik SA, & Jones S (2016). “Home practice is the program”: Correlates of parents’ practice of program skills in the New Beginnings Program effectiveness trial. Prevention Science. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bernal G, Jimenez-Chafey MI, & Domenech Rodríquez MM (2009). Cultural adaptation of treatments: A resource for considering culture in evidence-based practice. Professional Psychology: Research and Practice, 40, 361–368. doi: 10.1037/a0016401. [DOI] [Google Scholar]
- Biglan A, Mrazek PJ, Carnine D, & Flay BR (2003). The integration of research and practice in the prevention of youth problem behaviors. American Psychologist, 58, 433–440. doi: 10.1037/0003-066X.58.6-7.433. [DOI] [PubMed] [Google Scholar]
- Blake SM, Simkin L, Ledsky R, Perkins C, & Calabrese JM (2001). Effects of a parent-child communications intervention on young adolescents’ risk for early onset of sexual intercourse. Family Planning Perspectives, 33, 52–61. doi: 10.2307/2673750. [DOI] [PubMed] [Google Scholar]
- Blakely CH, Mayer JP, Gottschalk RG, Schmitt N, Davidson WS, Roitman DB, & Emshoff JG (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253–268. doi: 10.1007/BF00922697. [DOI] [Google Scholar]
- Cabassa LJ, & Baumann AA (2013). A two-way street: Bridging implementation science and cultural adaptations of mental health treatments. Implementation Science, 8, 1–14. doi: 10.1186/1748-5908-8-90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cardemil EV (2010). Cultural adaptations to empirically supported treatments: A research agenda. Scientific Review of Mental Health Practice, 7, 8–21. [Google Scholar]
- Castro FG, Barrera M Jr., & Martinez CR Jr. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5, 41–45. doi: 10.1023/B:PREV.0000013980.12412.cd. [DOI] [PubMed] [Google Scholar]
- Castro FG, Barrera M Jr., & Holleran Steiker LK (2010). Issues and challenges in the design of culturally adapted evidence-based interventions. Annual Review of Clinical Psychology, 6, 213–239. doi: 10.1146/annurev-clinpsy-033109-132032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chambers DA, Glasgow RE, & Stange KC (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117. doi: 10.1186/1748-5908-8-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chipungu SS, Hermann J, Sambrano S, Nistler M, Sale E, & Springer JF (2000). Prevention programming for African American youth: A review of strategies in CSAP’s national cross-site evaluation of high-risk youth programs. Journal of Black Psychology, 26, 360–385. doi: 10.1177/0095798400026004002. [DOI] [Google Scholar]
- Clarke AT, Marshall SA, Mautone JA, Soffer SL, Jones HA, Costigan TE, Patterson A, Jawad AF, & Power TJ (2013). Parent attendance and homework adherence predict response to a family–school intervention for children with ADHD. Journal of Clinical Child & Adolescent Psychology, 44, 58–67. doi: 10.1080/15374416.2013.794697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins LM, Murphy SA, & Bierman KL (2004). A conceptual framework for adaptive preventive interventions. Prevention Science, 5, 185–196. doi: 10.1023/B:PREV.0000037641.26017.00. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins LM, Kugler KC, & Gwadz MV (2016). Optimization of multicomponent behavioral and biobehavioral interventions for the prevention and treatment of HIV/AIDS. AIDS & Behavior, 20, 197–214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cooper BR, Bumbarger BK, & Moore JE (2015). Sustaining evidence-based prevention programs: Correlates in a large-scale dissemination initiative. Prevention Science, 16, 145–157. [DOI] [PubMed] [Google Scholar]
- Cooper BR, Shrestha G, Hyman L, & Hill L (2016). Adaptations in a community-based family intervention: Replication of two coding schemes. Journal of Primary Prevention, 37, 33–52. [DOI] [PubMed] [Google Scholar]
- Davidson EM, Liu JJ, Bhopal R, White M, Johnson MR, Netto G, Wabnitz C, & Sheikh A (2013). Behavior change interventions to improve the health of racial and ethnic minority populations: A tool kit of adaptation approaches. Milbank Quarterly, 91, 811–851. doi: 10.1111/1468-0009.12034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dillman Carpentier F, Mauricio AM, Gonzales NA, Millsap RE, Meza CM, Dumka LE, Germán M, & Genalo MT (2007). Engaging Mexican origin families in a school-based preventive intervention. Journal of Primary Prevention, 28, 521–546. doi: 10.1007/s10935-007-0110-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Du Bois SN, Johnson SE, & Mustanski B (2012). Examining racial and ethnic minority differences among YMSM during recruitment for an online HIV prevention intervention study. AIDS and Behavior, 16, 1430–1435. doi: 10.1007/s10461-011-0058-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dumas JE, Nissley-Tsiopinis J, & Moreland AD (2007). From intent to enrollment, attendance, and participation in preventive parenting groups. Journal of Child & Family Studies, 16, 1–26. doi: 10.1007/s10826-006-9042-0. [DOI] [Google Scholar]
- Durlak JA, & DuPre EP (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi: 10.1007/s10464-008-9165-0. [DOI] [PubMed] [Google Scholar]
- Dusenbury L, Brannigan R, Falco M, & Hansen WB (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256. doi: 10.1093/her/18.2.237. [DOI] [PubMed] [Google Scholar]
- Dusenbury L, Brannigan R, Hansen WB, Walsh J, & Falco M (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20, 308–313. doi: 10.1093/her/cyg134. [DOI] [PubMed] [Google Scholar]
- Glasgow RE, Vogt TM, & Boles SM (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi: 10.2105/AJPH.89.9.1322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gonzales NA, Lau A, Murry V, Pina A, & Barrera M Jr. (2016). Culturally adapted preventive interventions for children and adolescents In Cicchetti D (Ed.), Developmental Psychopathology (3rd edition). doi: 10.1002/9781119125556.devpsy417. [DOI] [Google Scholar]
- Haggerty KP, Skinner ML, MacKenzie EP, & Catalano RF (2007). A randomized trial of parents who care: Effects on key outcomes at 24-month follow-up. Prevention Science, 8, 249–260. doi: 10.1007/s11121-007-0077-2. [DOI] [PubMed] [Google Scholar]
- Hansen WB, Pankratz MM, Dusenbury L, Giles SM, Bishop DC, Albritton J, Albritton LP, & Strack J (2013). Styles of adaptation: Impact of frequency and valence of adaptation on preventing substance use. Health Education, 113, 345–63. doi: 10.1108/09654281311329268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hill LG, Maucione K, & Hod BK (2007). A focused approach to assessing program fidelity. Prevention Science, 8, 25–34. doi: 10.1007/s11121-006-0051-4. [DOI] [PubMed] [Google Scholar]
- Johnson K, Hays C, Center H, & Daley C (2004). Building capacity and sustainable prevention innovations: A sustainability planning model. Evaluation and Program Planning, 27, 135–149. doi: 10.1016/j.evalprogplan.2004.01.002. [DOI] [Google Scholar]
- Kumpfer KL, Alvarado R, Smith P, & Bellamy N (2002). Cultural sensitivity and adaptation in family-based prevention interventions. Prevention Science, 3, 241–246. doi: 10.1023/A:1021910199029. [DOI] [PubMed] [Google Scholar]
- Kumpfer KL, Pinyuchon M, Melo AT, & Whiteside HO (2008). Cultural adaptation process for international dissemination of the strengthening families program. Evaluation and the Health Professions, 31, 226–239. doi: 10.1177/0163278708315926. [DOI] [PubMed] [Google Scholar]
- Lau AS (2006). Making a case for selective and directed cultural adaptations of evidence-based treatments: Examples from parent training. Clinical Psychology: Science and Practice, 13, 295–310. doi: 10.1111/j.1468-2850.2006.00042.x. [DOI] [Google Scholar]
- Lee SJ, Altschul I, & Mowbray CT (2008). Using planned adaptation to implement evidence-based programs with new populations. American Journal of Community Psychology, 41, 290–303. doi: 10.1007/s10464-008-9160-5. [DOI] [PubMed] [Google Scholar]
- Leviton LC (2013). The template for systematic study of adaptations of evidence-based and evidence informed interventions. Robert Wood Johnson Foundation, unpublished. [Google Scholar]
- Mancini JA, & Marek LI (2004). Sustaining community-based programs for families: Conceptualization and measurement. Family Relations, 53, 339–347. doi: 10.1111/j.0197-6664.2004.00040.x. [DOI] [Google Scholar]
- Mauricio AM, Tein J-Y, Gonzales N, Millsap R, Dumka L, & Berkel C (2014). Participation patterns among Mexican-American parents enrolled in a universal intervention and their association with child externalizing outcomes. American Journal of Community Psychology, 54, 370–383. doi: 10.1007/s10464-014-9680-0. [DOI] [PubMed] [Google Scholar]
- McCabe K, & Yeh M (2009). Parent-child interaction therapy for Mexican Americans: A randomized clinical trial. Journal of Clinical Child & Adolescent Psychology, 38, 753–759. doi: 10.1080/15374410903103544. [DOI] [PubMed] [Google Scholar]
- McGraw SA, Sellers DE, Johnson CC, Stone EJ, Bachman KJ, Bebchuk J, & Edmundson EW (1996). Using process data to explain outcomes an illustration from the Child and Adolescent Trial for Cardiovascular Health (CATCH). Evaluation Review, 20, 291–312. doi: 10.1177/0193841X9602000304. [DOI] [PubMed] [Google Scholar]
- Miller-Day M, Pettigrew J, Hecht ML, Shin Y, Graham J, & Krieger J (2013). How prevention curricula are taught under real-world conditions: Types of and reasons for teacher curriculum adaptations. Health Education, 113, 324–344. doi: 10.1108/09654281311329259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moore JE, Bumbarger BK, & Cooper BR (2013). Examining adaptations of evidence-based programs in natural contexts. The Journal of Primary Prevention, 34, 147–161. doi: 10.1007/s10935-013-0303-6. [DOI] [PubMed] [Google Scholar]
- Nix RL, Bierman KL, McMahon RJ, & The Conduct Problems Prevention Research Group. (2009). How attendance and quality of participation affect treatment response to parent management training. Journal of Consulting & Clinical Psychology, 77, 429–438. doi: 10.1037/a0015028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Orrell-Valente JK, Pinderhughes EE, Valente E, & Laird RD (1999). If it’s offered, will they come? Influences on parents’ participation in a community-based conduct problems prevention program. American Journal of Community Psychology, 27, 753–783. doi: 10.1023/A:1022258525075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ozer EJ, Wanis MG, & Bazell N (2010). Diffusion of school-based prevention programs in two urban districts: Adaptations, rationales, and suggestions for change. Prevention Science, 11, 42–55. doi: 10.1007/s11121-009-0148-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perrino T, Coatsworth JD, Briones E, Pantin H, & Szapocznik J (2001). Initial engagement in parent-centered preventive interventions: A family systems perspective. Journal of Primary Prevention, 22, 21–44. doi: 10.1023/A:1011036130341. [DOI] [Google Scholar]
- Rabin BA, Brownson RC, Haire-Joshu D, Kreuter MW, & Weaver NL (2008). A glossary for dissemination and implementation research in health. Journal of Public Health Management and Practice, 14, 117–123. doi: 10.1097/01.PHH.0000311888.06252.bb. [DOI] [PubMed] [Google Scholar]
- Reid MJ, Webster-Stratton C, & Beauchaine TP (2001). Parent training in head start: A comparison of program response among African American, Asian American, Caucasian, and Hispanic mothers. Prevention Science, 2, 209–227. doi: 10.1023/A:1013618309070. [DOI] [PubMed] [Google Scholar]
- Resnicow K, Soler R, Braithwaite RL, Ahluwalia JS, & Butler J (2000). Cultural sensitivity in substance use prevention. Journal of Community Psychology, 28, 271–290. doi:. [DOI] [Google Scholar]
- Reyno SM, & McGrath PJ (2006). Predictors of parent training efficacy for child externalizing behavior problems—a meta-analytic review. Journal of Child Psychology & Psychiatry, 47, 99–111. doi: 10.1111/j.1469-7610.2005.01544.x. [DOI] [PubMed] [Google Scholar]
- Ringwalt CL, Vincus A, Ennett S, Johnson R, & Rohrbach LA (2004). Reasons for teachers’ adaptation of substance use prevention curricula in schools with non-white student populations. Prevention Science, 5, 61–67. doi: 10.1023/B:PREV.0000037642.40783.95. [DOI] [PubMed] [Google Scholar]
- Rogers EM (1993). Diffusion and re-invention of project D.A.R.E In Blacker TE & Rogers EM (Eds.), Organizational aspects of health communication campaigns: What works? (pp. 139–162). Newbury Park, CA: Sage. [Google Scholar]
- Rotheram-Borus MJ, Swendeman D, & Chorpita B (2012). Disruptive innovations for designing and diffusing evidence-based interventions. American Psychologist, 67, 463–476. doi: 10.1037/a0028180. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sandler I, Wolchik S, Berkel C, Jones S, Mauricio A, Tein J-Y, Winslow E (under review). Effectiveness trial of the New Beginnings Program (NBP) for divorcing and separating parents: Translation from and experimental prototype to an evidence-based community service In Israelashvili M & Romano JL (Eds.), Cambridge Handbook of International Prevention Science. Cambridge: Cambridge University Press. [Google Scholar]
- Scheirer MA (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26, 320–347. doi: 10.1177/1098214005278752. [DOI] [Google Scholar]
- Schoenfelder E, Sandler IN, Millsap RE, Wolchik SA, Berkel C, & Ayers TS (2012). Responsiveness to the family bereavement program: What predicts responsiveness? What does responsiveness predict? Prevention Science, 14, 545–556. doi: 10.1007/s11121-012-0337-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith JD, Knoble NB, Zerr AA, Dishion TJ, & Stormshak EA (2014). Family check-up effects across diverse ethnic groups: Reducing early-adolescence antisocial behavior by reducing family conflict. Journal of Clinical Child & Adolescent Psychology, 43, 400–414. doi: 10.1080/15374416.2014.888670. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spoth R, Rohrbach LA, Greenberg M, Leaf P, Brown CH, Fagan A, Catalano RF, Pentz MA, Sloboda Z, Hawkins JD, & Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351. doi: 10.1007/s11121-012-0362-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stirman SW, Miller CJ, Toder K, & Calloway A (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implemention Science, 8, 65. doi: 10.1186/1748-5908-8-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sundell K, Beelmann A, Hasson H, & von Thiele Schwarz U (2015). Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. Journal of Clinical Child & Adolescent Psychology. doi: 10.1080/15374416.2015.1020540. [DOI] [PubMed] [Google Scholar]
- Swisher JD (2000). Sustainability of prevention. Addictive Behaviors, 25, 965–973. doi: 10.1016/S0306-4603(00)00124-6. [DOI] [PubMed] [Google Scholar]
- Turner KMT, Richards M, & Sanders MR (2007). Randomised clinical trial of a group parent education programme for Australian indigenous families. Journal of Paediatrics & Child Health, 43, 429–437. doi: 10.1111/j.1440-1754.2007.01053.x. [DOI] [PubMed] [Google Scholar]
- Weisz JR, Chorpita BF, Palinkas LA, Schoenwald SK, Miranda J, Bearman SK, Daleiden EL, Ugueto AM, Ho A, Martin J, Gray J, Alleyne A, Langer DA, Southam-Gerow MA, Gibbons RD, & Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69, 274–82. doi: 10.1001/archgenpsychiatry.2011.147. [DOI] [PubMed] [Google Scholar]
- Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, & Charns M (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 1–19. doi: 10.1186/1748-5908-7-17. [DOI] [PMC free article] [PubMed] [Google Scholar]