Abstract
Background
Racial and ethnic disparities in the United States exist along the entire continuum of mental health care, from access and use of services to the quality and outcomes of care. Efforts to address these inequities in mental health care have focused on adapting evidence-based treatments to clients’ diverse cultural backgrounds. Yet, like many evidence-based treatments, culturally adapted interventions remain largely unused in usual care settings. We propose that a viable avenue to address this critical question is to create a dialogue between the fields of implementation science and cultural adaptation. In this paper, we discuss how integrating these two fields can make significant contributions to reducing racial and ethnic disparities in mental health care.
Discussion
The use of cultural adaptation models in implementation science can deepen the explicit attention to culture, particularly at the client and provider levels, in implementation studies making evidence-based treatments more responsive to the needs and preferences of diverse populations. The integration of both fields can help clarify and specify what to adapt in order to achieve optimal balance between adaptation and fidelity, and address important implementation outcomes (e.g., acceptability, appropriateness). A dialogue between both fields can help clarify the knowledge, skills and roles of who should facilitate the process of implementation, particularly when cultural adaptations are needed. The ecological perspective of implementation science provides an expanded lens to examine how contextual factors impact how treatments (adapted or not) are ultimately used and sustained in usual care settings. Integrating both fields can also help specify when in the implementation process adaptations may be considered in order to enhance the adoption and sustainability of evidence-based treatments.
Summary
Implementation science and cultural adaptation bring valuable insights and methods to how and to what extent treatments and/or context should be customized to enhance the implementation of evidence-based treatments across settings and populations. Developing a two-way street between these two fields can provide a better avenue for moving the best available treatments into practice and for helping to reduce racial and ethnic disparities in mental health care.
Keywords: Cultural adaptation, Implementation science, Mental health care disparities
Introduction
Compared to non-Hispanic whites, racial and ethnic minorities in the U.S. are more likely to underutilize mental health services, discontinue treatments prematurely, and to receive care that is poor in quality even after adjusting for differences in educational levels, socioeconomic status, health insurance rates, and mental health needs [1,2]. Some of the efforts to address these disparities in mental health care have focused on adapting evidence-based treatments (EBT) to clients’ culture. As expressed more than a decade ago in the Surgeon’s General report on ‘Culture, Race, Ethnicity and Mental Health’ [2], ‘culture counts’ in mental health care, as it shapes how people seek help, engage in health behaviors, and how providers communicate with clients and deliver services. Culture is more than race and ethnicity, as it encompasses ‘a shared way of being and interacting’ [3] that shapes lifestyle patterns and structures human thoughts, emotions, interactions, social norms, and behaviors [4]. Culture is not a static set of values, norms and practices that reside solely within the individual; it is dynamic, as it is learned, transmitted and transformed by social interactions, conflicts, and power relations [5-8].
The basic assumption for adapting mental health treatments to client’s cultural backgrounds is that, by explicitly integrating cultural factors (e.g., language, cultural values, gender roles) into care, the relevance, acceptability, effectiveness and sustainability of treatments will be increased, and inequities in care will be narrowed [9]. Yet, like many EBTs in the U. S., these culturally adapted treatments remain largely unused in usual care settings. A central question to address this gap in mental care that remains unanswered is how to go about translating the best available knowledge of treatments in historically underserved communities to eliminate inequities in mental health care.
In this paper, we propose that a viable avenue to address this critical question is to bridge and create a dialogue between the fields of implementation science (IS) and cultural adaptations (CA). We begin by providing a rationale for integrating these two fields. We then discuss five critical areas that would benefit from this integration: making culture more visible in the implementation process; determining if adaptations are needed, examining what to adapt in order to balance fidelity and adaptation in the implementation of EBTs; examining who should drive the process of implementation and adaptation of EBTs in usual care settings; expanding the contextual lens to inform adaptations and implementation strategies; and examining when to adapt EBTs, if necessary, in the implementation process. For each of these areas, we present implications for research.
In this paper, we focus and draw mostly from studies conducted in the U.S. because of the persistent racial and ethnic mental health care disparities in this country and the expertise and experiences of the authors working in the U.S. context. Many of the points we discuss here could be used when implementing and adapting EBTs in other countries facing inequities in mental health care [10,11], but should be applied with caution given the unique cultural, social, historical and political forces that shape how EBTs were developed, and the new settings where these EBTs are being implemented. As IS and CA in mental health services research and practice are both growing and evolving fields, the ideas presented in this paper should be viewed as points of departure for future dialogues.
Why integrate implementation science and cultural adaptations?
The implementation of mental health practice innovations into usual care settings is more than a technical endeavor of simply training or disseminating new knowledge to providers to deliver a new treatment [12]. It also entails social processes that are dynamic and highly dependent upon the context in which the innovation takes place [13]. As stipulated by Rogers, an ‘innovation [such as an EBT] almost never fits perfectly in the organization in which it is being embedded’ [14]. Implementation is a mutual adaptation process in which both the treatment that is being implemented and the organizations and stakeholders (e.g., consumers, providers, administrators) involved accommodate to the parameters of the new treatment and the exchange of knowledge, attitudes, social norms, and practices that occur throughout this process [13,15,16].
As presented in Table 1, both IS and CA fields contribute valuable insights into this transformation of treatments and context in moving research into practice, but tackle this process from different angles. IS views this transformation through an ecological lens by seeking to understand the contextual factors at multiple levels (e.g., consumer, provider, organization) that affect the implementation efforts of treatment innovations into practice through the stages of adoption, implementation and sustainability [15]. IS focuses on preparing and changing the context of practice at multiple levels to accommodate and enhance the fit of the new practice innovation within a particular setting. CA instead takes on a more granular approach focusing on how to make treatments more ecologically valid by systematically considering clients’ and in some cases providers’ , language, cultural values, norms, and meanings, and their context [17]. CA focuses on modifying elements of the EBT without compromising its effectiveness in order to enhance the fit between the treatment and clients’ and providers’ cultural values, preferences and norms.
Table 1.
Characteristics | Implementation science | Cultural adaptations |
---|---|---|
Definition |
‘the scientific study of methods to promote the integration of research findings and evidence-based interventions into health care policy and practice’ (PAR-10-038). |
“the systematic modification of an evidence-based treatment (EBT) to consider language, culture, and context in such a way that it is compatible with the client’s cultural patterns meanings and values’
[17]. |
Example of research questions |
• How to balance the need to maintain the fidelity of established interventions as they were created, and customize them to local context to increase their relevance, appropriateness, use and uptake? |
• What elements of the EBTs need to be adapted to enhance their fit, cultural relevance, and social validity to a specific ethno-cultural group or setting? |
• How to involve and get genuine buy-in and collaboration from multiple stakeholders in the process of implementation? |
• How does the culturally adapted EBT retain the active ingredients of the original EBT? |
|
• How to sustain interventions given constrained financial and human resources and shifting political climates and priorities? |
• Will the culturally adapted EBT achieve better client outcomes than the original intervention? |
|
Fidelity perspectives |
Balance adaptation and fidelity |
Balance adaptation and fidelity |
Emphasis of cultural elements |
Organizational level and knowledge exchanges between stakeholders |
Provider and client levels |
Typical unit of analysis |
Providers, clinical units, organizations or systems, communities |
Patients, families/caregivers, providers |
Potential challenges in reducing racial and ethnic disparities in mental health care |
• Most implementation trials do not quantify or directly examine their impact in reducing racial and ethnic mental health care disparities |
• Culturally adapted EBTs are rarely used in usual care settings |
|
• Few implementation strategies exist for transporting EBTs in racially and ethnically minority communities |
• Culturally adapted EBTs lack explicit attention to implementation context and implementation strategies |
• Most implementation trials do not document the adaptation process when implementing EBT | • Limited evidence that culturally adapted EBTs are more cost- effective than non-adapted EBTs |
The fields of IS and CA rarely interact even though both are concerned with making treatments more available and accessible and share the common goal of improving health care in usual care settings. The CA literature rarely acknowledges multi-level implementation factors, particularly at the organization and community levels, but rather has focused on establishing the evidence for the benefits of culturally adapted EBTs. Its emphasis has been on documenting the impact of adapted EBTs on client level outcomes, not on implementation processes or outcomes. The development of the CA literature has been driven in part by the recognition from an influential U.S. Surgeon General’s report more than a decade ago stating that few empirically-supported mental health treatments existed for racial and ethnic minorities since the majority of randomized controlled trials at that time did not include adequate numbers of minorities to establish efficacy and effectiveness in these historically underserved communities [2]. Since then, the CA field in mental health and health has grown and continues to build its evidence base, even though some funding agencies have started to limit funding for studies in this area.
The lack of integration between the IS and CA literature may also be influenced by recent findings from meta-analyses indicating that the efficacy of culturally adapted EBTs is mixed (See Table 2) [18-21]. Culturally adapted mental health treatments produce small to moderate treatment benefits with effect sizes ranging from d = 0.21 to d = 0.46 when compared to an array of controlled/comparison conditions, including un-adapted EBTs, placebo controls, waitlist controls, and/or usual care. However, a closer examination of these meta-analyses indicates that there is great variability in effect size estimates across studies. The heterogeneous nature of study designs, populations, and mental health conditions studied, as well as the type of treatments being compared and adapted, contribute to these divergent findings. Studies included in these meta-analyses are plagued by small sample sizes, and many use outcome measures that lack validity across cultural groups [19].
Table 2.
Study |
Number of studies |
Type of interventions included |
Type of study populations |
Effect sizesa |
Significant moderators |
|||||
---|---|---|---|---|---|---|---|---|---|---|
|
|
Prevention |
Treatment |
Children/Youth |
Adult |
Culturally adapted vs. heterogeneous controlsb |
Culturally adapted vs. un-adapted psychotherapyc |
|
||
D | 95% CI | d | 95% CI | |||||||
Benish et al.
[18] |
59 |
|
X |
X |
X |
0.41* |
0.38, 0.48 |
0.32* |
0.21, 0.43 |
• Adaptation to client’s explanatory models |
0.33** |
0.13, 0.29 |
0.21** |
0.13, 0.26 |
|||||||
Huey et al.
[19] |
25 |
|
X |
X |
|
0.44** |
0.32, 0.56 |
|
|
• Type of comparison group with largest effect sizes for no treatment control and placebo versus treatment as usual |
Griner et al.
[20] |
76 |
X |
X |
X |
X |
0.45d, ** |
0.36, 0.53 |
|
|
• Age: Older participants had higher effect sizes than younger participants |
0.40e, ** |
0.30, 0.49 |
• Hispanic ethnicity: Higher percentage of Hispanic participants had higher effect sizes than studies with lower percentage of Hispanic participants |
||||||||
• Racially homogenous samples: Studies with racially homogenous samples had higher effect sizes than studies with racially heterogeneous samples | ||||||||||
• Language: Studies that reported language match had higher effect sizes than studies that did not report language match | ||||||||||
• Acculturation: Adaptation seem to benefit most low acculturated Hispanics compared to Hispanics with moderate levels of acculturation | ||||||||||
Smith et al.
[21] |
65 |
|
X |
X |
X |
0.46** |
0.36, 0.56a |
|
|
• Treatment delivered to specific cultural groups were more effective than those delivered to mixed racial/ethnic groups |
|
• Adapting therapeutic goals to match client’s goals |
|||||||||
• Using metaphors/symbols in therapy to match client’s cultural world views |
Note: aAll effect sizes reported in the studies reviewed were computed so that positive values indicate greater benefit for culturally adapted treatment over their comparison group; bIn these comparisons, culturally adapted treatments are compared to heterogeneous controls conditions that include other un-adapted treatment, usual care, waitlist conditions, and attention control; cIn these comparisons, specific culturally adapted psychotherapies are compared to the same un-adapted psychotherapy; deffect sizes for all studies included in this meta-analysis; eeffect size for studies that only compared culturally adapted interventions to an ‘alternative intervention.’ *Primary measures; **All measures.
Despite limitations, CA meta-analyses have begun to identify possible moderators that may help clarify what types of treatment adaptations contribute to small to moderate effect sizes for culturally adapted treatments, and which cultural groups may benefit most from adapted EBTs. Both types of moderators can inform the implementation of EBTs in minority communities. For example, the benefits of culturally adapted treatments seem to be driven by treatment modifications related to therapeutic goals, clients’ explanatory models of illness, and the use of metaphor/symbols in treatments that match clients’ cultural world views [18,20]. Cultural adaptations seem to work best for low acculturated Hispanics, non-English speaking clients, older clients, and when treatments are delivered to racially homogenous groups [20]. To advance the implementation of promising EBTs (adapted or un-adapted) in historically underserved minority communities in the U.S., more research is needed to identify key moderators that will help clarify for which populations adapted or un-adapted EBTs work best. Future work should also focus on identifying the types of treatment adaptations that do not dilute the effectiveness of EBTs and produce the most beneficial client and implementation outcomes for underserved populations.
A stronger integration between IS and CA can help address limitations within the two areas. On one hand, IS brings to CA increased attention to multi-level contextual factors that influence how EBTs are used in usual care settings [13] and also expands the focus of CA by considering how the context that surrounds an EBT may need to be adapted to accommodate and enhance the appeal and acceptability of practice innovations [15]. On the other hand, the CA literature can bring to IS field a more nuanced understanding of how clients’ and providers’ cultures influence not only client-level outcomes of EBTs, but also other implementation outcomes, such as the acceptability, accessibility, appropriateness, fidelity and feasibility of EBTs across different stakeholder groups [22]. We propose that the CA literature also contributes with steps and guidelines that can be incorporated into the implementation process to examine how sociocultural factors at multiple levels influence how EBTs are perceived and used by different stakeholders in minority communities [23]. This information can be used to adapt and prepare the context of practice to facilitate the implementation of EBTs. In all, the fields of IS and CA cannot continue to operate in isolation of each other. Their integration can provide an important context for research (See Table 3), producing a more comprehensive approach for considering cultural and contextual forces at multiple levels that influence the implementation of EBTs to address racial and ethnic inequities in mental health care.
Table 3.
Area of integration | Implication for research |
---|---|
Making culture visible and explicit in the implementation process |
• Use CA models to document the process of adaptation and specify what was adapted during the implementation process. |
• Develop user friendly CA guidelines and models that can be used in usual care settings. | |
• Integrate CA guidelines and steps into existing implementation strategies. | |
What to adapt |
• Continue to empirically identify the core components of EBTs in order to provide directions for adaptation, if necessary. |
• If adaptations to the EBTs are necessary, CA frameworks can be used to identify what and how elements of the delivery and content of the EBT needs to be adapted to enhance their cultural congruence. | |
• Examine how providers’ training should be adapted to increase providers’ adoption of EBT, particularly around issues of cultural competence. | |
• Examine how adaptation to the context of practice may facilitate implementation outcomes and help reduce mental health care disparities. | |
Key players driving cultural adaptations and implementation |
• Further specify and document the necessary skills to be an effective facilitator and cultural adaptation specialist. |
• Examine how facilitator and cultural adaptation specialist can collaborate within an implementation team to enhance the implementation of EBTs. | |
• Examine how to train a person to incorporate the skills and knowledge of a facilitator and cultural specialist. | |
Expanding the contextual lens |
• Examine how the use of adapted or un-adapted EBTs shown to be effective in racial and ethnic minority communities may enhance providers’ and organizations’ acceptance of EBTs and facilitate their adoption of new practices. |
• Apply methods and steps used in CA models to examine outer contextual factors to gain a deeper understanding of how the local ecology, social norms, and community culture can impact the implementation process. | |
• Continue to build the science of CBPR by identifying the core participatory principles and collaborative processes that can facilitate implementation of EBTs in minority communities. | |
• Empirically test the effectiveness that participatory approaches compared to other implementation strategies have on implantation outcomes. | |
• Examine how different service delivery options can help address workforce shortage issues in historically underserved communities. | |
• Cost-effectiveness analyses need to examine whether culturally adapted EBTs result in better outcomes compared to their costs and whether the potential clinical and implementation benefits of culturally adapted EBTs outweigh their costs when compared to un-adapted interventions and usual care across different implementation outcomes. | |
When to adapt | • Examine how cultural adaptations (if necessary) can be integrated within the implementation process and within existing implementation strategies. |
Making culture visible and explicit in the implementation process
The concept of culture is usually stressed and used in IS at the level of the organization. An organization’s culture ‘essentially what makes that organization unique from all others [24].’ Organizational culture has been defined ‘as the way things are done’ within an organization [25] and it includes values for the services or products provided as well as the interaction between individuals and groups within an organization [24]. Culture at this level has received considerable attention as an influential factor that shapes quality of care and implementation processes [15,25].
Organizational culture has also been addressed in models of knowledge translation, such as the cultural exchange model [26]. Within this paradigm, knowledge translation is conceptualized as the integration and accommodation of the cultural systems (i.e., shared understanding, value orientations) that researchers, practitioners, and community members bring to this process [16]. The implementation of EBTs within a community is conceptualized as intercultural encounters where the cultures of stakeholders collide creating a sociocultural event within a social system [27].
Less attention, however, has been given in IS to individual cultural factors at the client and provider levels. An explanation for the limited attention to cultural adaptations at these levels in the implementation field could be due to the general assumption that ‘adaptation happens’ and is considered a natural part of the implementation process [28]. In a recent review of the sustainability of new programs, most studies reviewed indicated that there was some level of adaptation during the implementation and sustainability of the intervention. However, virtually no study provided descriptions of what was adapted or the explicit process used to adapt the intervention [29]. We advocate, therefore, that teams involved in adapting interventions document their adaptations during the implementation of EBTs and make explicit the process and methods used to make these adaptations. Such documentation of the adaptation process may have several benefits. It may help generate more generalizable knowledge about the type of adaptations that produce better implementation and treatment outcomes in a new context. It can also help clarify processes, steps and methods used to adapt EBTs to enhance their fit with a new population and/or context. In all, the careful and explicit documentation of the adaptation process can help produce a knowledge base to guide future implementation efforts.
Cultural issues at the client and provider levels should be visible in the implementation of EBTs, as ignoring these cultural elements may lessen the impact, relevance, acceptability and sustainability of promising EBTs when transported to usual care settings, particularly those serving racial and ethnic minority communities [9]. The use of existing CA models can provide guidelines and methods for making culture more visible in the implementation process [23]. Such models include recommendations that treatment adaptations: (a) be informed by the expertise of stakeholders (e.g., researchers, clients, providers, administrators) and include collaborations between treatment developers, treatment users, and community members; (b) use formative research methods (e.g., focus groups, surveys, in-depth interviews) to understand population needs, risk and resilience factors, and the context of practice; (c) make efforts to modify and document the process of engagement and retention of participants, including attention to acceptability of the treatment; (d) consider treatment provider and/or therapist characteristics as a central component of the intervention by focusing on the ecological validity of the intervention; (e) address the fidelity-adaptation tension via iterative pilot testing to refine adaptations; and (f) conduct formal evaluations of the adapted intervention to test its effectiveness [30-32].
CA models have been used to adapt and evaluate a number of EBTs, such as cognitive behavioral therapy [33,34], interpersonal psychotherapy [35], and parent management training [36]. CA models provide general steps and guidelines for identifying and specifying how culture influences different EBTs without compromising their effectiveness [17]. CA models, however, have emerged within the context of efficacy and effectiveness trials; thus, their utility in usual care settings is unknown and untested. Further research is needed on how to make CA models user friendly within the realities of usual care practice settings with limited resources, time and expertise, and how to integrate them into existing implementation strategies.
What to adapt: balancing adaptation and fidelity
Both the literature of IS and CA address the degree to which adaptation may be required to enhance the transportability of an EBT without diluting its effectiveness [9,37]. Given the potential transformative nature of the implementation process, some level of adaptation to the local context is likely to occur as most EBTs are usually not ‘street ready’ for real-world settings [38]. When implementing EBTs, therefore, researchers and providers face the tension between implementing a standardized treatment as designed versus adapting it to the target context or population. The balance between these two ends of the debate will likely affect the implementation, dissemination and sustainability of the intervention [39]. For example, adaptations can be made to the delivery or to the content of the intervention, and it can be driven by the organizational context and by providers’ and clients’ behaviors [40]. There are several approaches that may be considered in order to achieve a balance between adaptation and fidelity by identifying what to adapt in the delivery, content of the intervention, or the context that surrounds the intervention.
One approach is to consider the core functional elements and forms of treatments. From this perspective, the core functional elements of a treatment (i.e., its active ingredients)-are retained in the implementation process, while the forms by which this treatment is delivered (e.g., group vs. individual sessions) are customized to local contingencies [41]. This approach may be most useful when treatment developers have empirically identified the intervention’s core elements in order to provide guidance to local implementers on how to tailor the different forms of treatment without diluting essential treatment mechanisms [37]. For many EBTs, however, the core elements, including delivery methods, have not been empirically identified or supported and developers may not be amenable to change their protocols without this level of evidence.
This approach also lacks specification for identifying what to adapt, particularly the specific intervention elements necessary to make EBTs more culturally responsive to ethno-cultural groups. Resnicow and colleagues [42] address this limitation by specifying two key levels for informing cultural adaptations: surface adaptations and deep adaptations. Surface adaptations involve customizing the intervention materials and messages to the ‘observable’ social and behavioral characteristics of a target population [42]. These adaptations focus on making peripheral aspects of the intervention fit with the culture, experience, and behavioral patterns of a particular group in order to enhance the intervention’s appeal and face validity [43]. Examples of surface adaptations involve customizing audiovisual or print materials by changing pictures of people, places and language to be more aligned with patient or client culture. For example, surface adaptations may be necessary when delivering an intervention originally developed in one language or culture to a new language or cultural group. For some interventions, surface adaptations may be sufficient, but for others, deep level adaptations may need to be considered [42].
Deep adaptations involve a reflection on how ‘cultural, social, psychological, environmental, and historical factors influence health behaviors differently across racial/ethnic populations’ [42]. Deep adaptation may posit differences in the mechanisms of change of the intervention and incorporates culture-specific conceptualizations of the problem (e.g., explanatory models of illness), social norms (e.g., gender roles), and cultural beliefs into the intervention in order to enhance cultural sensitivity and create the conditions for the desired behavioral change [44]. In summary, surface adaptations address basic understanding and perception of materials, whereas deep adaptations convey the cultural salience and impact of the content and skills the intervention aims to provide.
Another useful framework that can help identify what to adapt is the Ecological Validity Model [45] based on the ecological systems theory [46]. This model proposes eight domains (language, persons, metaphors, content, concepts, goals, methods, and context) that one should consider in order to enhance the cultural congruence between participants and the intervention. Based on this framework, intervention adaptations should ensure that the language, metaphors, and methods used to communicate and deliver the treatment message and technology are understandable and culturally appropriate [36]. Attention to the persons involved in the treatment should focus on the cultural values, norms and expectations that shape interpersonal dynamics and preferences between clients and therapists. Adaptation should also attend to the content and goals of treatments that must reflect and respect participants’ cultural knowledge, values, norms, and traditions, and, if possible, support adaptive values and behaviors from the client’s culture of origin.
Adaptations can also be made to intervention content and to approaches used to train providers. While providers’ attitudes toward EBTs generally tend to be positive, some providers may have doubts about the effectiveness of the EBTs [47] or, if they have positive attitudes towards the science behind the EBT, they tend to be concerned about the impact that the use of standardized manuals have on their performance with their clients or their discretion in applying treatments [48-51]. Providers may perceive that some EBTs and their manuals or guidelines have a tendency to ‘overlook client’s family needs, culture, and strengths’ [52,53], affecting both provider and client engagement in the intervention.
Another challenge providers face when working with diverse populations is how to engage and retain clients through appropriate application of the intervention [54,55]. The type, content and approaches used to train providers are important variables that can affect the uptake of EBTs [56]. Modifying providers’ trainings to highlight the intervention components that can be modified to incorporate providers’ clinical expertise, and to train providers in methods and community outreach approaches that can facilitate recruitment and engagement of culturally diverse clients, may allow for a flexible approach that could increase providers’ uptake of EBT without diluting its reach and effectiveness [54,57]. Ongoing coaching after training may also improve providers’ acceptance and adherence to the intervention while also preventing intervention drift [58].
Lastly, the context that surrounds the intervention may provide important targets for adaptation. From an IS perspective, Aarons and colleagues [59] suggest that modifications may need to be made to the organizational context (e.g., resource, provider training, organizational culture) to facilitate the fit of the EBT to the practice setting. Contextual factors at the provider and organizational levels influence racial and ethnic disparities in mental health care and play a pivotal role in the implementation of EBTs in these communities [1,2,60]. Examples of organizational level adaptations that can help reduce mental health care disparities include: increasing the availability of bilingual providers and/or trained interpreters, expanding hours of operation, changing client flow protocols to reduce waitlist, and expanding the delivery of services to community settings frequented by minority clients. These types of adaptations focus on modifying organizational elements to improve the accessibility, responsiveness and feasibility of mental health care, all of which are critical for reducing mental health care disparities.
Key players driving cultural adaptions and implementation
During the implementation process, IS studies have shown that the use of a facilitator, a person who applies tailored strategies to enable change within a complex system in order to promote the implementation of the intervention, is a promising implementation strategy [61,62]. Although there is a lack of clarity about the roles of the facilitator [63], Kauth and colleagues indicated that the facilitator is the person ‘engaged in a formal implementation process, focused on knowledge application in specific settings’ [62]. Other key characteristics of the facilitator are that he/she should be credible, persuasive, engaging, provide education, set goals for change, assess progress and barriers to implementing the intervention, tailor actions to local context, develop supportive relationships with stakeholders, assist in problem solving, and provide individualized feedback to providers [62]. Facilitators can come from within or outside of the organization. Studies suggest that the combination of external and internal facilitators seems to be most effective [63,64].
It is not clear, however, whether or not, or how the facilitator works with the treatment developers or research team to increase the fit between the intervention and the target population. Such is the role of the “cultural adaptation specialist” (CAS) used in some cultural adaptation models. The CAS has knowledge about the target population and the population for which the intervention was originally developed in order to help researchers and practitioners incorporate core elements of the target culture in the adapted intervention [31]. In general, the CAS should: (a) be familiar with the target community, its values and practices beyond language competence (e.g., knowing how to speak Spanish is not enough to be considered culturally competent when working with Latino communities); (b) be self-aware of his or her values; (c) actively participate in the community; (d) use conceptual frameworks to inform intervention adaptations in order to make them culturally responsive; (e) be knowledgeable about the intervention; and (f) have problem solving skills to be able to bridge information between the target population and the research team.
The skills required to be a facilitator and a CAS are different. The CAS is more focused on the target population rather than on the provider. There is also no explicit mention in adaptation models about whether the CAS should know how to negotiate the larger context, such as system or organizational factors. The role of the facilitator, on the other hand, emerged as a method for encouraging intervention uptake by providers in clinical practice [63] and has not necessarily focused on the fit of the intervention with the target client or patient population.
Considering that the abilities of the CAS and facilitator are different in scope, the integration between these two roles requires further study. One alternative could be to train a given person to have the skills and knowledge of both a facilitator and CAS. For example, facilitators could attend cultural competency trainings to assist on the adaptation of the intervention to the target population. Several models of cultural competency training have been developed and are being used as strategies to improve providers’ skills in addressing the unique needs of ethno-cultural groups [65]. Alternatively, a CAS could be trained as a facilitator by gaining knowledge about organizational level issues known to impact the implementation process.
Care should be taken, however, regarding the selection of the key players who will have the role of CAS, facilitator, or both. In particular, much discussion in the field of CA cautions against having a single person, particularly a mental health professional or expert, holding the role of the cultural gatekeeper of the community. Community members should be included and engaged in the process of selecting and adapting an EBT, as they bring an insider’s perspective on the needs, preferences, barriers, and the potential response the community may have towards the EBT [66,67]. Moreover, as far as training of the CAS, discussion in the field still exists as to whether this person should be from academia (which some authors advocate against), from the community, or represent and straddle both worlds [10].
A more realistic alternative, therefore, could be to have multiple key players collaborating in the adaptation and implementation efforts. In fact, research in implementation science is showing that transdisciplinary collaboration among scientists and stakeholders from different disciplines and communities are needed for the effective implementation and sustainment of interventions [68]. Both CAS and facilitator, therefore, could collaborate during the implementation process using collaborative models such as team science [69] or community-based participatory research (CBPR) approaches [66,70]. In summary, research is needed to delineate the tasks and skills of the CAS and the facilitator, and how to best incorporate them into the implementation process.
Expanding the contextual lens
Implementation does not happen in a vacuum; it is embedded within a broader ecological context that goes beyond client and provider factors and impacts all aspects of the implementation process [71,72]. Cultural adaptation models usually fall short in informing the implementation process because they tend to ignore important contextual factors that impact how EBTs are used and sustained in organizations and community settings [22]. Expanding the contextual lens, as commonly used in IS studies, and integrating them with principles and lessons from CA models can help advance how promising EBTs are transported, used and sustained to address racial and ethnic disparities in mental health care. Context is commonly defined as ‘the set of circumstances or unique factors that surround a particular implementation effort’ [13], including the physical environment, policies, infrastructure, and the social and political forces that shape this change process [73]. A common model for understanding and conceptualizing context in IS is to consider the inner and outer context that surrounds the EBT [13,15].
The inner context encompasses factors within the organization where the implementation of an EBT takes place. Common inner contextual factors include: the structures, social context, and leadership of organizations. Organizational structures are the attributes (e.g., size, mission, services, workflow, location, etc.) that characterize an organization and have been found to either support or hinder the implementation process [60]. The organization’s social context includes the climate and culture of the organization and the work attitudes of the people within the organization [24,74]. Each of these elements could impact client level outcomes and quality of care [24]. Findings from organizational level interventions [75,76] that target the social context indicate that the implementation of EBTs could benefit by planned, systematic and customized approaches that accompany the EBT to remove inner contextual barriers and create the organizational conditions that support the use of the EBTs in community settings.
The outer context that surrounds the organization also plays a critical role in the implementation of EBTs. Common outer contextual factors in IS include: community cultural norms and attitudes toward particular health and mental health conditions and their treatments, community resources and capital, and policies and political forces. Mendel and colleagues defined community norms and attitudes as: ‘a range of attitudes and knowledge about particular health conditions, expectations and priorities toward types of treatments or client populations, and collectively held beliefs and values that may affect the receptivity of individual and organizational stakeholders to adopt or adhere to a new care practice or intervention’ [60]. Given the combination of stigma towards mental illness in the U.S. [77] and generally low levels of health literacy in racial and ethnic minority communities [78], community norms and attitudes likely play an important role in the implementation of EBTs. Attitudes ‘set the context in which individuals in the community respond to the onset of mental health problems, clinicians respond to individuals who come for treatment, and public policy is crafted’ [79]. Ignoring these community level issues may be detrimental to the introduction and acceptance of an EBT, as it may be in direct conflict with local cultural understandings and practices for addressing health and mental health conditions and can result in resistance and failure [27]. In the same way that the culture of clients and providers needs to be made visible in the implementation of EBTs, the community’s cultural norms and attitudes in the outer context should be taken into consideration. Norms and attitudes can influence how mental health problems are perceived and discussed among community stakeholders, how their support is sought, and what types of EBTs may be considered acceptable and worthy of implementation. A mismatch between the EBT, the process of implementation, and stakeholder cultural norms may create resistance and even deep suspicions about why EBTs are being introduced and implemented [27]. The application of methods used in CA models (e.g., focus groups, involvement of community members) to assess the outer context could be used to gain a deeper understanding and appreciation of the local ecology, social norms, and community culture in order to facilitate the implementation of EBTs in a specific community. Such methods could be used to help customize the EBT to these community characteristics and also harness community assets, capabilities and strengths for EBT implementation efforts [27,60].
CBPR approaches provide another viable avenue to address these community-level issues that arise as EBTs are introduced and implemented in new communities. CBPR can enhance the implementation process by contextualizing EBTs to the cultural and social realities of communities, integrating ethno-cultural values, perspectives and preferences into the content and form of EBTs to enhance their relevance, acceptability and feasibility, and by strengthening the capacity of community stakeholders to support implementation efforts and community-based research to reduce mental health care disparities [66,70,80].
The integration of CBPR and IS is a fertile area for future research, particularly in identifying the core participatory principles and collaborative processes that facilitate the implementation of EBTs. More research is also needed to empirically test the effectiveness of participatory approaches compared to other implementation strategies on implementation outcomes. A recent example of this head-to-head comparison in the U.S. is the integration of CBPR principles and approaches within a large randomized implementation trial, the Community Partners in Care [81]. This trial is comparing the impact that two implementation approaches, a CBPR community engagement strategy and a professional technical assistance strategy, have in the implementation and outcomes of evidence-based depression care in communities of color in Los Angeles, California. More studies of this nature are needed to advance the science of CBPR and IS in reducing mental health care disparities.
Another critical set of outer context factors includes the resources and capital that can support or thwart implementation efforts. Resources include financial, human, social, cultural, and political capital that exist in organizations and in the community [60]. For example, many communities (e.g., rural, reservations, frontier towns) lack the appropriate workforce to deliver mental health services, and consequently tend to modify the delivery method (e.g., increase the group size of interventions or shorten sessions), which could affect the effectiveness of the intervention [82]. A critical consideration for implementation efforts in these communities could be to expand the repertoire of service delivery options, such as the use of telemedicine, paraprofessionals, and community health workers, to address workforce issues.
The scarcity of human and financial resources for delivering mental health services, particularly in urban and rural minority communities in the U.S., demands that a business case in which the economic benefits exceed the cost of implementation be established in order for stakeholders to support the investment and introduction of a new practice innovation [1,2]. This business case should consider other costs and benefit issues, such as the intervention’s acceptance and compatibility with the client population, which could enhance treatment engagement and reduce treatment drop outs. This is difficult given that many EBTs, particularly culturally adapted EBTs, typically lack cost and cost-effectiveness data. More studies are needed to document the direct and indirect costs and benefits for the introduction, use and sustainment of an EBT within minority communities. Cost-effectiveness analyses should also examine whether culturally adapted EBTs result in better outcomes compared to the costs of un-adapted interventions and usual care.
Lastly, policies and political forces, such as regulatory practices, legal liabilities, funding mechanisms, and reimbursement regulations have a profound impact on the implementation and sustainment of EBTs [15,83]. Policies can shape the type, forms and frequency of practices that can and cannot be implemented and can create incentives and disincentives for organizations and communities to engage and invest in the implementation of EBTs [60]. They can be used as leverage points throughout the entire ecology of implementation, imparting their influence at the levels of the organization, regulatory agencies, and the political and social milieu [83,84]. It is not sufficient for EBTs to be culturally and linguistically appropriate for racial and ethnic minorities; the context that surrounds an EBT must be carefully considered in order to enhance its uptake, and ultimately its impact in reducing mental health care disparities [22].
When to adapt in the implementation process
Client, provider, and larger contextual factors shape the implementation of EBTs, and accommodation to the local ecology is an important step in the implementation process. A critical question, therefore, is: When should adaptations to the EBT, if necessary, occur during the implementation process?
Several cultural adaptation models provide guidance. For instance, Kumper and colleagues stipulate that adaptations should follow only when there is empirical evidence from pilot implementation studies and from clients and providers’ feedback that the original intervention does not fit the new population’s needs [10]. Moreover, Lau’s selective and directed cultural adaptation framework provides a set of guidelines to decide when to customize treatments to particular client populations [85]. Based on this data-driven model, adaptations are warranted when there is quantitative and/or qualitative evidence that: the new population has distinctive and unique sociocultural context of risk and resilience that will require consideration or addition of new treatment elements to address these contextual issues; and/or when the social validity of an intervention is compromised, thus limiting treatment engagement and the receipt of an adequate exposure to the treatment to achieve its intended effect. Barrera and colleagues expand upon Lau’s model and propose further guidelines for determining when adaptations may be justified early on in the implementation process. They stipulate that adaptations are needed when qualitative and/or quantitative evidence indicates that two or more populations differ on: treatment engagement dimensions (e.g., awareness of treatment, treatment completion); the ability of the treatment to change mediating variables (action theory); and the relationships between mediators and treatment outcomes (conceptual theory) [86].
In both models, adaptations occur early on in the implementation process, particularly when deciding which EBTs to implement (Exploration phase) and preparing for the adoption of the new treatment (Preparation phase) to the new settings and populations [82]. These two models are useful for determining when EBTs need to be adapted to client characteristics, but provide little guidance for deciding when adaptations to other important elements (e.g., service context, organizational characteristics) of implementation should be considered and how to incorporate these adaptations throughout the implementation process.
Adaptations to EBTs when necessary should not be a separate or an additional step in the implementation process. Rather, adaptations need to be considered as the process of adding, omitting, or modifying elements of the intervention and, therefore, an implementation outcome, along with other outcomes such as fidelity and dosage [32]. In fact, several recent IS models currently being tested provide operational guidelines and steps for incorporating adaptation decisions within the implementation EBTs in new settings and diverse populations [39,87]. For example, the Dynamic Adaptation Process (DAP) model specifies a process for identifying and incorporating adaptations at multiple levels and throughout the phase of implementation to facilitate the adoption and use of EBTs in community settings [82]. Within DAP, adaptation decisions are made by an implementation resource team (IRT) composed of multiple stakeholders (e.g., clinicians, researchers, administrators, clients, intervention developers). The IRT uses information from a careful assessment of system, organizational, provider and client level characteristics to negotiate system, organization and intervention adaptations while maintaining core ingredients of the EBT. Adaptations within this model may include re-ordering, forestalling or delaying, de-emphasizing, emphasizing or augmenting EBT components. The DAP model considers adaptations beyond the EBT, such as modifications to the service context or the organization itself to facilitate implementation. The DAP also includes a feedback process that includes fidelity checks and quality assurance procedures during the implementation phase to guide, monitor and address system, organization and EBT adaptations while trying to achieve a high level of fidelity to the core elements of the EBT. In summary, the models described above support the need for adaptation processes to be planned and started in the early stages of implementation, but also recognize that adaptations are likely to be needed throughout the implementation process and can include adaptation to the EBT as well as system, organization, and practice context.
Discussion
In this paper, we have argued for a stronger integration between the IS and CA fields that can support implementation of the best available EBTs for historically underserved communities in the U.S. to reduce disparities in mental health care. An important contribution of CA models to IS is to make cultural issues, particularly at the client and provider levels, more visible in the implementation process. If clients and providers can understand and identify with the EBT they should be more likely to see its benefits and understand its activities, and accept and benefit from the intervention [88]. If culture is not addressed at these levels - EBT implementation is less likely to be successful, no matter how well the EBT fits with the organizational culture and policies.
Furthermore, CA and IS can provide balance in the need to retain the active ingredients of a treatment to maintain its effectiveness while customizing treatments to improve their fit in specific contexts. Such a balancing act can be complicated by limited resources, local expertise, and capacity that organizations and researchers face when deciding what to adapt in the implementation process. No clear answers currently exist regarding how to achieve optimal balance, but the blending of IS and CA perspectives can help specify what needs to be adapted in order to enhance EBT implementation. Explicit documentation through the use of quantitative and/or qualitative methods can provide insights into dynamic implementation processes and clarify not only how adaptations occur but at what level, for what purposes, and how they may impact implementation and client outcomes.
Who facilitates and drives the implementation process is an important consideration for the implementation of EBTs in underserved minority communities. Collaborative approaches (e.g., team science, CBPR) that include the facilitator and cultural adaptation specialist (CAS) may be the most productive, as each brings different skills and knowledge to the implementation process. Examples of questions that require future work in order to integrate these two roles within the implementation of EBTs include: What are the unique tasks and skills of a facilitator and a CAS? What are the best strategies to train one person as a facilitator and CAS? What are the most effective collaborative approaches to integrate these two roles within an implementation project?
A contribution that IS can offer CA is the attention to inner and outer contextual factors that impact how EBTs are ultimately used and sustained in real-world settings. This contextual lens is also critical for the development and use of implementation strategies [89,90], which are systematic processes and actions (e.g., academic detailing, quality management, learning collaborative) used to adopt and integrate EBT into community settings [91]. The assessment and identification of contextual factors through qualitative and quantitative methods can provide the basis for developing customized implementation strategies to accompany EBTs. These contextual assessments can be incorporated into the adaptation process and/or included as elements of existing cultural adaptation frameworks as a way to bridge the fields of IS and CA. The development and testing of implementation strategies linked to specific EBTs to reduce racial and ethnic mental health care disparities is a fertile field for future research.
Finally, when to adapt is still an open question that requires further empirical work. Due to the dynamic nature of the implementation process, it seems that the adaptation process should also be dynamic and done at different points in time during the implementation process. To help identify when should adaptation occur, feedback mechanisms should be in place throughout the process to make the necessary adjustments to the adaptation and implementation of the EBT. Careful documentation and tracking of the adaptation processes, therefore, can help clarify when adaptation happens, how adaptation decisions are made, who facilitates the adaptation, and when they are most valuable during the implementation process. These are still open questions for the field, and more studies are needed to test which adaptation models produce the best implementation results in historically underserved minority communities. In all, developing a two-way street between IS and CA can provide a better avenue for moving the best available treatments into practice and help in the reduction of racial and ethnic disparities in mental health care.
Abbreviations
CA: Cultural adaptations; CAS: Cultural adaptation specialist; CBPR: Community-based participatory research; DAP: Dynamic adaptation process; EBT: Evidence-based treatment; IS: Implementation Science.
Competing interests
LJC and AAB declare that they have no competing interests.
Authors’ contributions
Both authors contributed to the development of this paper. LJC had the original ideas for this paper. LJC and AAB collaborated in expanding the ideas for this paper, reviewing the literature and writing drafts. Both authors approved the final version of the paper.
Contributor Information
Leopoldo J Cabassa, Email: ljc2139@columbia.edu.
Ana A Baumann, Email: abaumann@brownschool.wustl.edu.
Acknowledgments
We would like to thank John Landsverk for his comments and feedback on earlier drafts of this manuscript and Greg Aarons and the three reviewers for expanding our analysis and conceptualization of the issues discussed in the paper. Preparation for this manuscript was supported in part by the New York State Office of Mental Health (LJC) and NIH grants: K01 MH091118 (LJC) and R25 MH080916 (LJC, AAB), UL1 TR000448 and NCI U54CA155496 (AAB). The content of this article is solely the responsibility of the authors and does not represent the official views of the National Institutes of Health.
References
- Institute of Medicine. Unequal treatment: confronting racial and ethnic disparities in health care. Washington DC: National Academies Press; 2003. [PubMed] [Google Scholar]
- United States Department of Health and Human Services. Mental health: culture, race, and ethnicity: a supplement to mental health: a report of the surgeon general. Rockville, MD: U.S: Department of Health and Human Services; 2001. [PubMed] [Google Scholar]
- Singer MK. Applying the concept of culture to reduce health disparities through health behavior research. Prev Med. 2012;55(5):356–361. doi: 10.1016/j.ypmed.2012.02.011. [DOI] [PubMed] [Google Scholar]
- Guarnaccia PJ, Rodriguez O. Concepts of culture and their role in the development of culturally competent mental health services. Hisp J Behav Sci. 1996;18(4):419–443. doi: 10.1177/07399863960184001. [DOI] [Google Scholar]
- Alegria M, Atkins M, Farmer E, Slaton E, Stelk W. One size does not fit all: taking diversity, culture and context seriously. Adm Policy Ment Health. 2010;37(1-2):48–60. doi: 10.1007/s10488-010-0283-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Geertz C. The interpretation of cultures. New York: Basic Books; 1973. [Google Scholar]
- Kleinman A, Benson P. Anthropology in the clinic: the problem of cultural competency and how to fix it. PLoS Med. 2006;3(10):e294. doi: 10.1371/journal.pmed.0030294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castro FG, Barrera M Jr, Holleran Steiker LK. Issues and challenges in the design of culturally adapted evidence-based interventions. Annu Rev Clin Psychol. 2010;6:213–239. doi: 10.1146/annurev-clinpsy-033109-132032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castro FG, Barrera M, Martinez CR. The cultural adaptation of prevention interventions: resolving tensions between fidelity and fit. Prev Sci. 2004;5(1):41–45. doi: 10.1023/b:prev.0000013980.12412.cd. [DOI] [PubMed] [Google Scholar]
- Kumpfer KL, Pinyuchon M, Teixeira de Melo A, Whiteside HO. Cultural adaptation process for international dissemination of the strengthening families program. Eval Health Prof. 2008;31(2):226–239. doi: 10.1177/0163278708315926. [DOI] [PubMed] [Google Scholar]
- Murray LK, Dorsey S, Bolton P, Jordans MJ, Rahman A, Bass J, Verdeli H. Building capacity in mental health interventions in low resource countries: an apprenticeship model for training local providers. Int J Ment Health Syst. 2011;5(1):30. doi: 10.1186/1752-4458-5-30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Glisson C, Schoenwald SK. The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res. 2005;7(4):243–259. doi: 10.1007/s11020-005-7456-1. [DOI] [PubMed] [Google Scholar]
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. doi: 10.1186/1748-5908-4-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rogers EM. Diffusion of innovations. 5. New York: The Free Press; 1995. [Google Scholar]
- Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23. doi: 10.1007/s10488-010-0327-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Palinkas LA, Soydan H. New horizons of translational research and research translation in social work. Res Soc Work Pract. 2012;22(1):85–92. doi: 10.1177/1049731511408738. [DOI] [Google Scholar]
- Bernal G, Jimenez Chafey MI, Domenech Rodriguez MM. Cultural adaptation of treatments: a resource for considering culture in evidence-based practice. Prof Psychol Res Pract. 2009;40(4):361–368. [Google Scholar]
- Benish SG, Quintana S, Wampold BE. Culturally adapted psychotherapy and the legitimacy of myth: a direct-comparison meta-analysis. J Couns Psychol. 2011;58(3):279–289. doi: 10.1037/a0023626. [DOI] [PubMed] [Google Scholar]
- Huey SJ, Polo AJ. Evidence-based psychosocial treatments for ethnic minority youth. J Clin Child Adolesc Psychol. 2008;37(1):262–301. doi: 10.1080/15374410701820174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Griner D, Smith TB. Culturally adapted mental health intervention: a meta-analytic review. Psychotherapy. 2006;43(4):531–548. doi: 10.1037/0033-3204.43.4.531. [DOI] [PubMed] [Google Scholar]
- Smith T, Domenech Rodriguez MM, Bernal G. Culture. J Clin Psychol: In Session. 2011;67(2):166–175. doi: 10.1002/jclp.20757. [DOI] [PubMed] [Google Scholar]
- Zayas LH, Bellamy JL, Proctor EK. In: Dissemination and Implementation Research in Health: Translating Science to Practice. Brownson RC, Colditz GA, Proctor EK, editor. New York, NY: Oxford University Press; 2012. Consideringthe multiple service contexts in cultural adaptation of evidence-based practice; pp. 483–497. [Google Scholar]
- Bernal G, Domenech Rodríguez MM. In: Cultural Adaptations: Tools for Evidence-Based Practice with Diverse Populations. Bernal G, Rodríguez MMD, editor. Washington, DC: American Psychological Association Press; 2012. Cultural adaptation in context; pp. 3–22. [Google Scholar]
- Aarons GJ, Horowitz JD, Dlugosz LR, Ehrhart MG. In: Dissemination and Implementation Research in Health: Translating Science to Practice. Brownson RC, Colditz GA, Proctor EK, editor. New York, NY: Oxfored University Press; 2012. The role of organizational processes in dissemination and implementation research; pp. 128–153. [Google Scholar]
- Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood KE, Mayberg S, Green P. Research Network on Youth Mental H. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health. 2008;35(1-2):98–113. doi: 10.1007/s10488-007-0148-5. [DOI] [PubMed] [Google Scholar]
- Palinkas LA, Allred CA, Landsverk JA. Models of research-operational collaboration for behavioral health in space. Aviat Space Environ Med. 2005;76(6 Suppl):B52–B60. [PubMed] [Google Scholar]
- Trickett EJ. From “Water Boiling in a Peruvian Town” to “Letting them Die”: culture, community intervention, and the metabolic balance between patience and zeal. Am J Community Psychol. 2011;47(1-2):58–68. doi: 10.1007/s10464-010-9369-y. [DOI] [PubMed] [Google Scholar]
- Allen JD, Linnan LA, Emmons KM. In: Dissemination and Implementation Research in Health: Translating Science to Practice. Brownson RC, Colditz GA, Proctor EK, editor. New York, NY: Oxford University Press; 2012. Fidelity and its relationship to implementation effectiveness, adaptation and dissemination; pp. 281–304. [Google Scholar]
- Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro FG, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7(17) doi: 10.1186/1748-5908-7-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barrera M, Castro FG, Strycker LA, Toobert DJ. Cultural adaptations of behavioral health interventions: a progress report. J Consult Clin Psychol. 2013;81(2):196–205. doi: 10.1037/a0027085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Domenech Rodríguez MM, Bernal G. In: Cultural Adaptations: Tools for Evidence-Based Practice with Diverse Populations. Bernal G, Rodríguez MMD, editor. Washington, DC: American Psychological Association Press; 2012. Bridging the gap between research and practice in a multicultural world; pp. 265–287. [Google Scholar]
- Ferrer-Wreder L, Sundell K, Mansoory S. Tinkering with perfection: theory development in the intervention cultural adaptation field. Child and Youth Care Forum. 2012;41(2):149–171. doi: 10.1007/s10566-011-9162-6. [DOI] [Google Scholar]
- Hwang W, Wood JJ, Lin K, Cheung F. Cognitive-behavioral therapy with Chinese Americans: research, theory and clinical practice. Cogn Behav Pract. 2006;13(4):293–303. doi: 10.1016/j.cbpra.2006.04.010. [DOI] [Google Scholar]
- Roselló J, Bernal G. The efficacy of cognitive-behavioral and interpersonal treatments for depression in Puerto Rican adolescents. J Consult Clin Psychol. 1999;67:734–745. doi: 10.1037//0022-006x.67.5.734. [DOI] [PubMed] [Google Scholar]
- Roselló J, Bernal G, Rivera C. Randomized trial of CBT and IPT in individual and group format for depression in Puerto Rican adolescents. Cult Divers Ethn Minor Psychol. 2008;14:234–245. doi: 10.1037/1099-9809.14.3.234. [DOI] [PubMed] [Google Scholar]
- Domenech Rodriguez MM, Baumann AA, Schwartz AL. Cultural adaptation of an evidence based intervention: from theory to practice in a Latino/a community context. Am J Community Psychol. 2011;47(1-2):170–186. doi: 10.1007/s10464-010-9371-4. [DOI] [PubMed] [Google Scholar]
- Glasgow RE. Critical measurement issues in translational research. Res Soc Work Pract. 2009;19(5):560–568. doi: 10.1177/1049731509335497. [DOI] [Google Scholar]
- Schoenwald S, Hoagwood K. Effectiveness, transportability and dissemination of interventions: what matters when? Psychiatr Serv. 2001;52:1190–1197. doi: 10.1176/appi.ps.52.9.1190. [DOI] [PubMed] [Google Scholar]
- Lee SJ, Altschul I, Mowbray CT. Using planned adaptation to implement evidence-based program with new populations. Am J Community Psychol. 2008;41:290–303. doi: 10.1007/s10464-008-9160-5. [DOI] [PubMed] [Google Scholar]
- Aarons GA, Miller EA, Green AE, Perrott JA, Bradway R. Adaptation happens: a qualitative case study of implementation of the incredible years evidence-based parent training programme in a residential substance abuse treatment programme. J Child Serv. 2012;7(4):233–245. doi: 10.1108/17466661211286463. [DOI] [Google Scholar]
- Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? BMJ. 2004;328(7455):1561–1563. doi: 10.1136/bmj.328.7455.1561. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Resnicow K, Baranowski T, Ahluwalia JS, Braithwaite RL. Cultural sensitivity in public health: defined and demystified. Ethn Dis. 1999;9(1):10–21. [PubMed] [Google Scholar]
- Kreuter MW, Haughton LT. Integrating culture into health information for African American women. Am Behav Sci. 2006;49(6):794–811. doi: 10.1177/0002764205283801. [DOI] [Google Scholar]
- Kreuter MW, Lukwago SN, Bucholtz RD, Clark EM, Sanders-Thompson V. Achieving cultural appropriateness in health promotion programs: targeted and tailored approaches. Health Educ Behav. 2003;30(2):133–146. doi: 10.1177/1090198102251021. [DOI] [PubMed] [Google Scholar]
- Bernal G, Bonilla J, Bellido C. Ecological validity and cultural sensitivity for outcome research: issues for the cultural adaptation and development of psychosocial treatments with Hispanics. J Abnorm Child Psychol. 1995;23(1):67–82. doi: 10.1007/BF01447045. [DOI] [PubMed] [Google Scholar]
- Bronfenbrenner U. The ecology of human development: experiments by nature and design. Cambridge, MA: Harvard University Press; 1979. [Google Scholar]
- Cook JM, Biyanova T, Coyne JC. Barriers to adoption of new treatments: an internet study of practicing community psychotherapists. Adm Policy Ment Health. 2009;36(2):83–90. doi: 10.1007/s10488-008-0198-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS) Ment Health Serv Res. 2004;6(2):61–74. doi: 10.1023/b:mhsr.0000024351.12294.65. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Addis ME, Wade WA, Hatgis C. Barriers to dissemination of evidence-based practices: addressing practitioners’ concerns about manual-based psychotherapies. Clin Psychol Sci Pract. 1999;6(4):430–441. doi: 10.1093/clipsy.6.4.430. [DOI] [Google Scholar]
- Addis ME, Krasnow AD. A national survey of practicing psychologist’ attitudes toward psychotherapy treatment manual. J Consult Clin Psychol. 2000;68:331–339. doi: 10.1037//0022-006x.68.2.331. [DOI] [PubMed] [Google Scholar]
- Nelson TD, Steele RG. Predictors of practitioner self-reported use of evidence-based practices: practitioner training, clinical setting, and attitudes toward research. Adm Policy Ment Health. 2007;34(4):319–330. doi: 10.1007/s10488-006-0111-x. [DOI] [PubMed] [Google Scholar]
- DiMeo MA, Moore GK, Lichtenstein C. Relatinship of evidence-based practice and treatments: a survey of community mental health providers. J Community Psychol. 2012;40:341–357. [Google Scholar]
- Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS) Psychol Assess. 2010;22(2):356–365. doi: 10.1037/a0019188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Interian A, Lewis-Fernandez R, Dixon LB. Improving treatment engagement of underserved u.s. Racial-ethnic groups: a review of recent interventions. Psychiatr Serv. 2013;64(3):212–222. doi: 10.1176/appi.ps.201100136. [DOI] [PubMed] [Google Scholar]
- Yancey AK, Ortega AN, Kumanyika SK. Effective recruitment and retention of minority research participants. Annu Rev Public Health. 2006;27:1–28. doi: 10.1146/annurev.publhealth.27.021405.102113. [DOI] [PubMed] [Google Scholar]
- Borntrager CF, Chorpita BF, Higa-McMillan C, Weisz JR. Provider attitudes toward evidence-based practices: are the concerns with the evidence or with the manuals? Psychiatr Serv. 2009;60(5):677–681. doi: 10.1176/appi.ps.60.5.677. [DOI] [PubMed] [Google Scholar]
- Gallo KP, Barlow DH. Factors involved in clinician adoption and nonadoption of evidence-based interventions in mental health. Clin Psychol Sci Pract. 2012;19(1):93–106. doi: 10.1111/j.1468-2850.2012.01276.x. [DOI] [Google Scholar]
- Beidas R, Kendall P. Training therapists in evidence-based practice: a critical review of studies from a systems contextual perspective. Clin Psychol Sci Pract. 2010;17:1–30. doi: 10.1111/j.1468-2850.2009.01187.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aarons GA, Palinkas LA. Implementation of evidence-based practice in child welfare: service provider perspectives. Adm Policy Ment Health. 2007;34(4):411–419. doi: 10.1007/s10488-007-0121-3. [DOI] [PubMed] [Google Scholar]
- Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Health. 2008;35(1-2):21–37. doi: 10.1007/s10488-007-0144-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74. doi: 10.1370/afm.1312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kauth MR, Sullivan G, Cully J, Blevins D. Facilitating practice changes in mental health clinics: a guide for implementation development in health care systems. Psychol Serv. 2011;8(1):36–47. [Google Scholar]
- Dogherty EJ, Harrison MB, Baker C, Graham ID. Following a natural experiment of guideline adaptation and early implementation: a mixed-methods study of facilitation. Implement Sci. 2012;7:9. doi: 10.1186/1748-5908-7-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S, Wallace CM. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the veterans health administration. Implement Sci. 2006;1:23. doi: 10.1186/1748-5908-1-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kirmayer LJ. Rethinking cultural competence. Transcult Psychiatry. 2012;49(2):149–164. doi: 10.1177/1363461512444673. [DOI] [PubMed] [Google Scholar]
- Jones L, Wells K. Strategies for academic and clinician engagement in community-participatory partnered research. JAMA. 2007;297(4):407–410. doi: 10.1001/jama.297.4.407. [DOI] [PubMed] [Google Scholar]
- Sanders MR. Triple P-Positive Parenting Program as a public health approach to strengthening parenting. J Fam Psychol. 2008;22(4):506–517. doi: 10.1037/0893-3200.22.3.506. [DOI] [PubMed] [Google Scholar]
- Lang DJ, Wiek A, Bergmann M, Stauffacher M, Martens P, Moll P, Swilling M, Thomas CJ. Transdisciplinary research in sustainability science: practice, principles, and challenges. Sustain Sci. 2012;7(1):25–43. [Google Scholar]
- Stokols D, Hall KL, Taylor BK, Moser RP. The science of team science: overview of the field and introduction to the supplement. Am J Prev Med. 2008;35(2 Suppl):S77–89. doi: 10.1016/j.amepre.2008.05.002. [DOI] [PubMed] [Google Scholar]
- Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(Suppl 1):S40–46. doi: 10.2105/AJPH.2009.184036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa, FL: University of South Florida Louis de la Parte Florida Mental Health Institute; 2005. [Google Scholar]
- Glasgow RE. Translating research to practice: lessons learned, areas for improvement, and future directions. Diabetes Care. 2003;26(8):2451–2456. doi: 10.2337/diacare.26.8.2451. [DOI] [PubMed] [Google Scholar]
- McCormack B. Developing practice: individual and organisational responsibilities. Aust J Adv Nurs. 2002;20(1):6–7. [PubMed] [Google Scholar]
- Scott T, Mannion R, Davies H, Marshall M. The quantitative measurement of organizational culture in health care: a review of the available instruments. Health Serv Res. 2003;38(3):923–945. doi: 10.1111/1475-6773.00154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chamberlain P, Brown CH, Saldana L, Reid J, Wang W, Marsenich L, Sosna T, Padgett C, Bouwman G. Engaging and recruiting counties in an experiment on implementing evidence-based practice in California. Adm Policy Ment Health. 2008;35(4):250–260. doi: 10.1007/s10488-008-0167-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schouten LM, Hulscher ME, Van Everdingen JJ, Huijsman R, Grol RP. Evidence for the impact of quality improvement collaboratives: systematic review. BMJ. 2008;336(7659):1491–1494. doi: 10.1136/bmj.39570.749884.BE. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parcesepe AM, Cabassa LJ. Public stigma of mental illness in the United States: a systematic literature review. Adm Policy Ment Health. 2013;40(5):384–399. doi: 10.1007/s10488-012-0430-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Institute of Medicine. Health literacy: a prescription to end confusion. Washington, DC: National Academies Press; 2004. [PubMed] [Google Scholar]
- Pescosolido BA, Martin JK, Long JS, Medina TR, Phelan JC, Link BG. “A disease like any other”? A decade of change in public reactions to schizophrenia, depression, and alcohol dependence. Am J Psychiatry. 2010;167(11):1321–1330. doi: 10.1176/appi.ajp.2010.09121743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Minkler M, Salvatore AL. In: Dissemination and implementation research in health: Translating science to practice. Brownson RC, Colditz GA, Proctor EK, editor. New York: Oxford University Press; 2012. Participatory approaches for study design and analysis in dissemination and implementation research; pp. 192–212. [Google Scholar]
- Jones L, Koegel P, Wells KB. In: Community-Based Participatory Research for Health: From process to outcomes. 2. Minkler M, Wallerstein N, editor. San Francisco, CA: Jossey-Bass; 2008. Bringing experimental design to community-partnered participatory research; pp. 67–85. [Google Scholar]
- Aarons GA, Green AE, Palinkas LA, Self-Brown S, Whitaker DJ, Lutzker JR, Silovsky JF, Hecht DB, Chaffin MJ. Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci. 2012;7(1):32. doi: 10.1186/1748-5908-7-32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Raghavan R, Bright CL, Shadoin AL. Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci. 2008;3:26. doi: 10.1186/1748-5908-3-26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baumann AA, Domenech Rodríguez M, Parra-Cardona R. Community-based applied research with Latino immigrant families: informing practice and research according to ethical and social justice principles. Fam Process. 2011;50:132–148. doi: 10.1111/j.1545-5300.2011.01351.x. [DOI] [PubMed] [Google Scholar]
- Lau A. Making the case for selective and directed cultural adaptations of evidence-based treatments: examples from parent training. Clin Psychol Sci Pract. 2006;13(4):295–310. doi: 10.1111/j.1468-2850.2006.00042.x. [DOI] [Google Scholar]
- Barrera M, Castro FG. A heuristic framework for the cultural adaptation of interventions. Clin Psychol Sci Pract. 2006;13(4):311–316. doi: 10.1111/j.1468-2850.2006.00043.x. [DOI] [Google Scholar]
- Cabassa LJ, Druss B, Wang Y, Lewis-Fernandez R. Collaborative planning approach to inform the implementation of a healthcare manager intervention for Hispanics with serious mental illness: a study protocol. Implement Sci. 2011;6:80. doi: 10.1186/1748-5908-6-80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dévieux JG, Malow RM, Rosenberg R, Jean-Gilles M, Samuels D, Ergon-Perez E, Jacobs R. Cultural adaptation in translational research: field experiences. J Urban Health. 2005;82(2 Suppl 3):iii82–91. doi: 10.1093/jurban/jti066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Helfrich CD, Li YF, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009;4:38. doi: 10.1186/1748-5908-4-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rycroft-Malone J, Kitson A, Harvey G, McCormack B, Seers K, Titchen A, Estabrooks C. Ingredients for change: revisiting a conceptual framework. Quality & safety in health care. 2002;11(2):174–180. doi: 10.1136/qhc.11.2.174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, Glass JE, York JL. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–157. doi: 10.1177/1077558711430690. [DOI] [PMC free article] [PubMed] [Google Scholar]