Abstract
Given the lack of progress in breast cancer prevention, the California Breast Cancer Research Program (CBCRP) plans to apply current scientific knowledge about breast cancer to primary prevention at the population level. This paper describes the first phase of Californians Linking Action with Science for Prevention of Breast Cancer (CLASP-BC). The foci of Phase 1 are building coalitions and coalition capacity building through community engagement in community-based participatory research (CBPR) and dissemination and implementation (D&I) research training. Based on the successful implementation and evaluation of Phase 1, the foci of Phase 2 (presented separately in this special issue) will be to translate the California Breast Cancer Prevention Plan overarching goal and specific intervention goals for 23 breast cancer risk and protective factors strategies into evidence-informed interventions (EIIs) that are disseminated and implemented across California. CLASP-BC is designed to identify, disseminate and implement high-impact, population-based prevention approaches by funding large scale EIIs, through multi-jurisdictional actions, with the intent to decrease the risk of breast cancer and other chronic diseases (sharing common risk factors), particularly among racial/ethnic minorities and medically underserved populations in California.
Keywords: implementation and dissemination, primary prevention, community-based participatory research, breast cancer, population science, action research
1. Introduction
Breast cancer is the most common cancer in women and the largest cause of cancer deaths among women worldwide: there were an estimated 2.1 million new cases and 626,679 deaths in 2018 [1]. A woman in the USA has a 13% chance of being diagnosed with breast cancer at some point in her lifetime and a 2.6% chance of dying from breast cancer [2]. Addressing breast cancer is a multi-front effort across the cancer control continuum, from prevention to treatment to survivorship. Great strides have been made in therapies and standards of care, leading to decreased mortality in developed countries. However, breast cancer incidence has remained essentially unchanged for the last three decades [2,3] indicating that a fresh approach to preventing breast cancer across the population is needed [4].
Given the lack of progress in breast cancer prevention, the California Breast Cancer Research Program (CBCRP) [5] applies current scientific knowledge about breast cancer to primary prevention at the population level. To turn the tide of breast cancer in the state, CBCRP supported the development of a Comprehensive Breast Cancer Primary Prevention Plan (BCPPP) for California [6]. The plan addresses all levels of the health impact pyramid, from education at the top to the bottom rungs of changing the context and socioeconomic factors, where the population impact is greatest [7]. The plan also considers risk factors at all stages of the lifespan. An overarching goal and specific intervention goals for 23 risk and protective factors are identified in the plan. These goals are defined with specific intervention strategies that could be used to reach these goals. Californians Linking Action with Science for Prevention of Breast Cancer (CLASP-BC) was conceptualized to translate these strategies into evidence-informed interventions (EIIs) that are disseminated and implemented across California.
CLASP-BC was informed by six years of funded dissemination and implementation (D&I) research and program evaluation conducted by the Canadian Partnership Against Cancer (CPAC) [8] through its Coalitions Linking Action and Science for Prevention (CLASP) [9,10]. CLASP was focused on creating supportive environments for cancer prevention through sustainable practice and policy change; and was implemented in two phases. Phase 1 engaged research, practice, and policy experts across Canada to identify key cancer prevention priorities [9], provided regional networking meetings in advance of calls for proposals to engage community-based organizations to identify barriers and enablers to participation in pan-Canadian coalitions, and provided preliminary feedback and guidance from the funder on an optional preliminary summary of a Phase 2 dissemination and implementation proposal [10].
CLASP-BC is designed to support the dissemination, implementation, and evaluation of evidence-informed intervention (EII) strategies from the BCPPP by leveraging existing community cancer and chronic disease prevention efforts and focusing on identified risk factors for breast cancer. CLASP-BC will also be implemented in two phases. As detailed in the future directions for research section of this paper, Phase 1 will focus on: (1) understanding the breast cancer concerns and prevention priorities of community leaders (from culturally diverse and medically underserved communities), researchers, practitioners, and policy experts across California; (2) engaging community and opinion leaders, research, practice, and policy specialists in regional California meetings to identify opportunities for working together in breast cancer prevention coalitions based on shared concerns and priorities; and (3) supporting (e.g., with technical assistance and training workshops) building, strengthening, and enhancing community-based participatory research (CBPR) and D&I research capacity, as well as research engagement within these coalitions.
The conceptual framework underpinning the first phase of CLASP-BC incorporates the multi-disciplinary model to broaden participation in community problem solving through collaborative practice and research [11], concept mapping as a participatory public health research tool [12], community-based participatory research [13,14], and transforming power relations in coalition formation for community betterment and collaborative empowerment [15].
Following the implementation and evaluation of Phase 1, Phase 2 will focus on: (1) providing D&I research grant support for interested and eligible coalitions demonstrating in their funding applications collaborative, evidence-informed (both practice and science-based) breast cancer prevention approaches from the BCPPP across two or more California jurisdictions (e.g., cities, counties); (2) working through a cooperative agreement funding mechanism, successful applicants will share the knowledge gained on quarterly video conference calls and annual meetings to exchange ideas for how to meet the challenges and take advantage of the opportunities to sustain the breast cancer prevention approaches beyond the funding period: and (3) integrating the lessons learned from science with the lessons learned from practice and policy to reduce the risk of developing breast cancer.
CLASP-BC is designed to disseminate and implement high-impact, population-based prevention approaches by funding large scale EIIs, through multi-jurisdictional actions, with the intent to decrease the risk of breast cancer and other chronic diseases (sharing common risk factors), particularly among racial/ethnic minorities and medically underserved populations in California. Examples of medically underserved communities in California include black populations in counties such as Tuolumne and Mariposa counties where 56.3% and 49.1% of families respectively live below the poverty level; Alpine county where 62.5% of Hispanic families live below the poverty level; and Lake County and Glenn counties where 40.9% and 40.3% of Native American families respectively live below the poverty level [16]. Thus, given that one of the California Breast Cancer Primary Prevention Plan priorities is to promote post-natal breast feeding, it may be a community concern and priority that 42% of women living at or below the poverty level in California report having workplace breast feeding support compared to 83% of women living at 4 times the poverty level. Similarly, Latina (53%) and Black (59%) women report having workplace breast feeding support compared with 76% of white women [17].
In addition, engagement of indigenous communities may require working with tribal leaders and elders in ensuring acceptability of proposed partnerships. In California there are 109 federally recognized tribes [18]. Moreover, due to the large number of indigenous Latinos from Central and South America, California is also home to a large number of indigenous communities from Latin America (including Mixteco, Zapotec, among other). Language, culture and particular networks may need to be reached in culturally specific ways [19].
A comprehensive strategy to breast cancer prevention assumes that through multi-sector (government, community-based non-governmental organizations (NGOs), academia, and the private sector) and multi-jurisdictional approaches, working together will be more effective than when each organization, sector, or jurisdiction works on its own. By working together, partners share each other’s skills, knowledge, and resources, as well as the risks and rewards, to more quickly and effectively reach breast cancer and chronic disease prevention goals and objectives.
This paper describes in detail the plans for implementing CLASP-BC Phase 1. A separate paper in this special issue describes the Phase 2 elements of CLASP-BC predicated on the successful implementation and evaluation of Phase 1.
2. Background
2.1. Making the Case for Community-Based Partnerships
Much of the literature on coalition and partnership building [20,21,22] calls for the development of a common vision and mission, a clear understanding of the roles of different players, what resources they each bring to the table, and delineated strategies for coordination and sustaining the partnership. It appears that how much synergy is produced by the coalition members is what makes a difference often in how successful they become [23]. As resources become scarcer, a reliance on the building of community-based partnerships and well-established coalitions becomes ever more essential. Health equity coalitions provide us with important lessons in the building of CLASP-BC partnerships. Given the intersectionality factors of some of the populations with whom researchers need to collaborate, different types of organizations need to coalesce and be sustained over time in order to resolve common issues and community health problems.
One of the most important challenges faced today in social movements for change is how interactions and intersections of race, class, gender, sexuality, and power come together [24]. Community-based coalitions can be evaluated by the extent to which they are grounded in shared or overlapping interests, where groups identify a common ground and work together towards achieving these goals. However, for coalitions and partnerships today to be successful, there is also a need for capacity building within communities as well as scientific and public health institutions. Communities are challenged by many competing needs and with diverse populations where gender, race, sexuality and socioeconomic status may come together to create situations that place individuals at even greater disadvantage and challenge the ability of coalitions to meet partnership goals. Partnerships that are grounded in the community strengthen our communities by fostering the participation of key individuals and community leaders in the life of the community, engaging them in problem solving, and addressing issues, such as poverty, that impact both community residents and institutions [25]. They also result in community buy-in and often remarkable participation in the solutions that are crafted [26,27].
2.2. Community-Based Partnerships and Academia
Community-based partnerships and coalitions also provide benefits to scientific and public health institutions. They allow for the opportunity for researchers and academics to hear about specific barriers and knowledge gaps faced by various populations and regions. They also provide rich environments to move from theory and observation to deep contextual knowledge, which in turn improves theory. The demands of academia incentivize academic researchers to prioritize expediency, efficient scientific designs and publication over the qualities required for true collaboration with communities such as relationship- and trust-building, equitable service delivery, social change, advocacy, negotiation and recognition of the power imbalances between team members.
Negotiating this balance is not a skill taught in research training, and failure can lead to worsened academic-community relations. To successfully build relationships that foster collaboration and shared lived experiences requires time, listening to and understanding the needs and barriers of communities and how their environment may pose unique risks for increased breast cancer rates as well as opportunities to reduce risk. It also requires communities to have a clear understanding of academic needs, and to build skills on negotiating a common scientific agenda [28]. The information and experiences that can be learned through community partnerships can be invaluable towards identifying and implementing breast cancer prevention strategies.
Establishing strong community-based coalition partnerships that are responsive to community needs and priorities, and help to foster research by providing a good understanding of community needs [26], are necessary to achieve community health improvements. When done so communities and academia are able to work together, achieving societal agreement on their priorities and objectives [29]. For example, a 2011 study examined changes in cancer disparities in a community partnership network, including 20 local community partner organizations in Southwest Florida. A social network analysis identified a trend toward increased network decentralization and overall increases in linkages, which supported the sustainability of the network and stability over a three-year period [30].
2.3. Creating Meaningful and Culturally Appropriate Partnerships
Mechanisms and principles for building multisector partnerships for population health and health equity that can be sustainable have been described [31]. While only 10% of public health measures tracked are met, this is due in part to the lack of responsibility and ownership for the outcomes, lack of cooperation and collaboration, and a limited understanding of what really might work or not in a particular community. In order for coalitions to have an impact, there are several elements that must be considered. These include: (1) the proper analysis of information, (2) recognition of community knowledge as critical information, (3) the establishment of a common vision and mission, (4) shared learning, (5) the ability and dedicated efforts towards using strategic and action plans, and (6) the development of effective leadership among them. Mechanisms by which one can document progress with a feedback loop back into the process, and looking towards identified outcomes, can strengthen partnerships that will achieve goals in population health and health equity.
One key finding that permeates many of these studies is the factor of “synergy.” Partnership synergy, combining the individual perspectives, resources, and skills of coalition partners to create something new and valuable, has been examined and a practical framework developed for studying and strengthening the collaborative advantage [32]. Mechanisms were conceptualized that account for the collaborative advantage in order to strengthen the capacity of partnerships in the future to realize their full potential. Martinez-Bianchi et al. [33] addressed the capacity of family medicine to improve health equity through collaboration, accountability and coalition building. To achieve health equity an evaluation of social, economic, environmental and other factors that impede optimal health for families are needed. Thus, coalitions partner not only with communities, but also with families. A Health Equity Toolkit [33] was developed, designed to improve care systems, reduce disparities and improve patient outcomes. Engaging with government and community-based non-governmental agencies, academic centers and the private sector are needed to create partnerships to systematically tackle health inequities.
2.4. Community Engagement
To engage diverse constituencies at meetings, they must be accessible to all participants and be perceived as worth the investment in time. Some best practices include offering translated materials and simultaneous interpretation upon request, facilitating a safe space for all participants. Facilitating a safe space means cultivating and upholding community agreements and inviting all participants and facilitators to share their pronouns. Events and venues must be accessible and centrally located for various members with sufficient parking or public transit access. Consideration of the times of the day when members meet, may be necessary, as well as offering food, parking, and child-care on the premises.
During COVID-19, connection is necessarily virtual and remote, creating barriers for many underserved and vulnerable communities that lack access to reliable Wi-Fi and the necessary technology. These barriers may further limit access to events, complicate outreach efforts and pose challenges to community partners joining virtual meetings. To overcome these barriers, event organizers should send out meeting information ahead of time, by mail if necessary, and by email, including simple instructions for joining on-line platforms and telephone call-in options. Creating accessible meetings allows for more intersectional attendance and creates a space for individuals to share their lived experiences. Community members’ stories highlight the complex intersections that can contribute to breast cancer risk factors and are an essential tool for tailoring breast cancer prevention efforts to the needs of different communities. Additionally, community involvement and coalition-building create another avenue to share information about breast cancer prevention and empower community members to share information within their communities that are culturally and linguistically appropriate.
CLASP-BC is expected to have wide reach and involvement across the entire public health and medical spectrum of those engaged with breast cancer. It is expected that participants involved in outreach, engagement, evaluation and/or dissemination of the activities of this program may include, but are not necessarily limited to: practitioners, public health specialists, community health workers, citizen scientists, patient advocates, patients and their families, social service agency leaders, policy makers, opinion leaders, business leaders, civic leaders, researchers, cancer centers, cancer registries (e.g., NCI’s Surveillance, Epidemiology, & End Results (SEER) program, local hospitals, local clinics, local public health agencies, governmental and non-governmental organizations, community based organizations, academic units, regional municipalities, jurisdictions and district offices, coalitions, faith-based organizations, and interested citizens who can form part of data-gathering, strategies and solutions proposed.
2.5. Lessons Learned from the Canadian CLASP Experience
There are both similarities and significant differences between CPAC’s CLASP initiative and the proposed CLASP-BC initiative. In terms of the population focus, while Canada (37.6 million in 2019) and California (39.8 million in 2019) have similar sized populations, they have radically different population densities (Canada 3 per square mile, California 251 per square mile). Both Canada and California have high percentages of their populations living in urban areas (80% in Canada, 95% in California). In California, 39% of state residents are Latino, 37% are white, 15% are Asian American, 6% are African American, 3% are multiracial, and fewer than 1% are American Indian or Pacific Islander, according to the 2018 American Community Survey. Latinos surpassed whites as the state’s single largest ethnic group in 2014 [34]. In Canada, ethnic categories are not comparable to USA racial/ethnic categories [35].
CPAC’s pan-Canadian CLASP framework focused on engaging communities from 10 Canadian provinces and 3 territories. The proposed CLASP-BC initiative would be focused on engaging communities across the state (e.g., 58 California counties, 482 municipalities) prioritizing those communities with the highest percentage of racially and ethnically diverse and medically underserved populations that bear the greatest burden of breast cancer diagnoses.
Throughout the CLASP experience in Canada, two key challenges were encountered consistently with respect to community engagement:
2.5.1. Community-Based Partner Capacity
In providing multidisciplinary knowledge to action research opportunities, a key learning from the Canadian CLASP initiative was the importance of considering equity in capacity across the partner disciplines [36]. Research and policy partners were well positioned to respond to the request for Phase 2 proposals by leveraging their experience in proposal writing, contract management, and reporting. Conversely, community-based practice organizations often lacked the experience and/or capacity to pursue complex funding opportunities but brought unique and important community perspectives and relationships to coalitions that otherwise would have lacked these elements. This was particularly true of First Nations, Inuit, and Métis community partners.
2.5.2. Indigenous Engagement
Many coalitions included First Nations partners—either organizations or communities—and a key challenge was fostering respectful and meaningful engagement and aligned partnerships [21]. Indigenous communities frequently had specific governance structures and protocols for approvals and communication that differed from many academic and government processes. If the other partners were not experienced in working with Indigenous communities, this misalignment was often a source of confusion and misunderstanding. In addition, building cultural sensitivity in partners who were not well-versed in working with Indigenous communities was important to ensure respectful engagement and building trust in the context of hundreds of years of past trauma.
3. Future Directions for Research
The overall purpose of CLASP-BC is to link the lessons learned from science (Knowledge to Action) with the lessons learned from practice and policy (Action to Knowledge). In doing so, it will broaden the reach and deepen the impact of EIIs on breast cancer and chronic disease prevention initiatives across California, focused on common risk factors, and will expand their impact. The foci of Phase 1 are building coalitions, coalition capacity building through community engagement, and cooperative and collaborative CBPR and dissemination and implementation research training. The specific aims of phase 1 are as follows:
In light of the COVID-19 pandemic, in the California context, conduct pre-planning prior to capacity building to determine when the timing is appropriate to engage community partners in coalition capacity building focused on breast cancer prevention and how best to engage community participants if the opportunities for face-to-face meetings remain limited.
Engage community leaders, including elected officials, from culturally diverse and medically underserved California communities to understand their breast cancer prevention priorities in relation to other community health priorities (including COVID-19).
Engage research, practice, advocacy and policy specialists to understand their breast cancer prevention priorities in relation to the dissemination and implementation of evidence informed interventions.
- Foster equitable coalition partnerships to conduct successful CBPR/D&I research by providing training and technical assistance to:
-
(a)develop and sustain community, research, practice, and policy partnerships and conduct research using CBPR methods.
-
(b)create a shared vision for partnerships.
-
(c)develop model team agreements and tools for conducting partnership self-assessments.
-
(d)identify benefits and challenges of participating in CBPR for their own partnership and identify potential solutions to challenges.
-
(a)
- Assist teams in creating a pathway from vision to research project consideration by providing training and technical assistance to:
-
(a)identify the various scientific methods that may be used in innovative intervention/adaptation research leading to D&I research.
-
(b)identify community concerns and potential solutions regarding which research methods best fit their contexts.
-
(c)identify and select best practices that will be utilized in creating a strong (qualitative and quantitative) and sustainable measurable methods plan, using theoretical frameworks.
-
(a)
For the purposes of CLASP-BC, the definitions of community representatives and patient advocates, as well as research, practice, and policy experts, who will be invited to participate in the meetings described below, are as follows:
Community representatives and patient advocates—these are individuals who live and work in the engaged communities and/or are leaders in community-based organizations providing vital social, economic and health service support in the engaged communities. As such, these coalition partners are vital in contributing their knowledge and expertise as community leaders. In Canada, they often referred to as community champions. US examples are “promotores de salud” (community health workers that have won the trust of their communities), serving as citizen scientists who are engaged in supporting research at different levels in the community. These individuals can be trained in research and can be engaged from conceptualization through implementation, evaluation and dissemination of findings for research and practice projects.
Research experts—individuals with an advanced degree (e.g., Masters or Doctorate) who have actively participated in and contributed to the research enterprise as evidenced by peer-reviewed research grants and/or publications. Researchers who have such a demonstrated research background may or may not be affiliated with an academic institution (e.g., academic cancer centers) but could also serve in an NGO, government, or other organizations with research as part of their mission.
Practice experts—individuals who manage and/or provide programming and/or services that influence directly or indirectly (e.g., built environment) population health. Practitioners in the funding agreement applications could represent NGOs, government, or other organizations with demonstrated knowledge and skill in the topic under consideration for the funding application.
Advocacy and policy experts—individuals who work on making or influencing policy decisions in or outside of government (e.g., an NGO) that influence directly or indirectly population health. Policy can include legislative or executive decisions that work through taxation, regulation, and related policy instruments that impact populations. This may also include advocacy groups that advocate for informed policy decision making and help to educate and inform policy-makers, disseminating scientific findings.
In Phase 1, interested parties will be invited to participate in a state-wide concept mapping [12] activity focused on identifying community, research, practice, and policy priorities for breast cancer prevention that align with other broader public health priorities (e.g., increasing physical activity, reducing exposure to environmental pollutants). Concept mapping is a mixed methods approach that engages diverse stakeholders through a multistep process to generate ideas, organize them into distinct categories, and rate them according to a set of criteria (e.g., feasibility, importance). All community, research, practice, and policy participants in the concept mapping exercise will be invited to indicate whether or not they are interested in participating in regional one-day concept mapping results review and coalition engagement meetings. In addition, potential co-funding organizations for phase 2 D&I research grants will be invited to attend these one-day meetings. The results of the concept mapping analyses will be used to organize multiple one-day regional meetings (in person and/or online) across California inviting participant constituencies that share similar breast cancer prevention priorities to attend.
Subsequently, two-day CBPR and D&I training workshops will be organized for existing or emerging coalitions interested in applying to a future Phase 2 D&I research funding initiative. These meetings will provide CBPR and D&I research tools and guidance as well as coalition exercises to help potential applicants develop a shared common understanding of the opportunities and challenges of working together collaboratively on EII for breast cancer prevention.
CBCRP Support for CBPR and D&I Research Training and Provision of Technical Assistance
For the past decade, CBCRP has conducted NIH-supported proposal development workshop programs to help new and existing community-academic teams build partnerships and develop fundable research projects focused on breast cancer environmental causes and disparities. Based on this experience, the following draft (see Box 1) of the proposed two-day CLASP-BC CBPR/D&I training workshop is described below. This workshop draft will be further refined based on input gathered from the concept mapping data prior to, and the evaluation data collected during, the aforementioned one-day regional engagement meetings.
Box 1. Draft CBCRP/D&I Training Workshop.
Topic and Learning Objectives
The California Plan to Prevent Breast Cancer [6,7,37]
Learning Objectives:
Understand Concepts of Population Primary Prevention
Understand the complexity of breast cancer causation and methods to reduce incidence
Introduction to Implementation Science [38,39,40]
Learning Objectives
Understand broad objectives of the field
Define and understand key terminology
Understand types of research questions
Identify what is (and is not) implementation science
Finding Your Research Question and Framing Your Questions [41,42]
Learning Objectives
Learn the elements of effective research questions
Understand the key components of specific aims in implementation science
Small Group Activity
Defining the problem, crafting the research question and identifying aims
Engaging Your Community and Forming Your Coalition [43,44]
Learning Objectives
Learn the concentric circles of community engagement
Learn how to use best practices and tools to develop coalitions
Small Group Activity
Theories, Frameworks, and Models [45,46]
Learning Objectives
Understand the importance and role of theories, frameworks, and models
Understand how these theories, frameworks, and models inform study components
CBPR in Practice [47]
Learning Objectives
understand the benefits and challenges of CPPR for both the community and academic partners
be able to identify benefits and challenges of participating in CPPR for their own partnership
learn methods to mitigate barriers
Study Designs in Dissemination and Implementation Research [48,49,50]
Learning Objectives
Learn about study design options for implementation science
Understand basic measures, outcomes, and analyses in implementation science
Measurement, Epidemiology, and Evaluation [51,52,53,54,55]
Learning Objectives
Understand the importance of measurement and evaluation issues
Consider measurement issues in designing studies
Learn about resources for selecting implementation science measures
Small Group Activity
Choosing a study design, defining outcomes and measures
Tools and Technical Assistance
Conclusion
All potential Phase 2 D&I research coalition applicants (including the lead research, practice, policy and community experts of each coalition team) will be invited to attend the CBCRP-sponsored two-day CBPR & D&I research training workshops described above.
In addition to the peer-reviewed publication of Phase 1 meetings data, media and social media presentations of the concept mapping findings by region will be developed and disseminated to increase interest and possible in engagement in Phase 2 CBPR/D&I research coalitions. In addition, CBCRP will share the findings from the concept mapping and regional meetings with potential Phase 2 co-funding agencies which are unable to attend all or any of the regional engagement meetings as observers.
4. Application to Breast Cancer Prevention
The California Breast Cancer Primary Prevention Plan (BCPPP) [6], was based on a strong foundation of science and input from many stakeholders, including academics, government regulators, non-profit organizations and impacted communities, and developed a policy agenda and action plan, to reduce the incidence of breast cancer in the state. Over the two-year project, BCPPP held a series of webinar-based study groups to:
explore the strength of the science behind known and suspected risk factors for breast cancer;
explore potential interventions to address these risk factors;
identify strengths, weaknesses and gaps in scientific research; and
work with the broad array of stakeholders to disseminate and implement the plan.
The process was guided by a multi-stakeholder advisory committee that included some of California’s leading breast cancer, public health, social and environmental justice and disease prevention experts. The project culminated in the creation of the Comprehensive Breast Cancer Primary Prevention Plan for California, which will serve as a road map for legislators, local and state regulators, and community.
The plan outlines a series of 16 overarching goals along with specific interventions that would support the accomplishment of these goals. The following are selected examples of intervention strategies from the Plan:
Update state, city and county zoning and permitting laws, as well as city and county General Plans, to prevent polluting industries from being located near schools or concentrated in communities of color or low-income communities.
Develop safe walk-, bike- and public transit-friendly cities to enhance physical activity opportunities and reduce pollution, both of which impact breast cancer risk and health in general.
Create breastfeeding-supportive workplaces for all workers, regardless of employment classification or status.
Establish standards of best practices for all occupations where workers might be exposed to ionizing radiation.
Develop workplace policies, with worker involvement, to reduce, eliminate or mitigate unnecessary exposures to light at night.
In accordance with California’s recognition of the human right to water, expand the state’s capacity to ensure safe (free from chemicals linked to breast cancer), adequate and affordable water for all California residents, regardless of whether they live in cities, towns or unincorporated areas.
Evidence-informed interventions (EIIs) to prevent breast cancer linked to these strategies include but are not limited to: limiting alcohol intake; promoting physical activity, healthy eating for healthy weight [56]; promoting postnatal breastfeeding [57]; mitigating the impact of night shift work [58]; minimizing exposure to all forms of ionizing radiation, particularly among girls and young women; ensuring that consumer products are free from chemicals linked to breast cancer [59]; eliminating unnecessary exposure to circadian rhythm-disrupting light at night [60]; and reducing the use of exogenous hormones [61]. Each of these EIIs should be adapted, disseminated, implemented and evaluated in a manner that addresses historical discrimination and oppression based on race, ethnicity, gender identity and orientation, sexual orientation, immigration status, disability, or other factors that may affect breast cancer risk.
Helping to operationalize the intervention strategy priorities identified in the BCPPP, and providing resources for community-level interventions, guidelines are published by many governmental and non-governmental agencies. These resources use an evidence-informed process and consensus, with varying degrees of rigor. For example, the Guide to Community Preventive Services (the Community Guide) is a systematic review that summarizes what is known about the effectiveness and cost-effectiveness of population-based interventions designed to promote health, prevent disease, injury, disability and premature death [62]. Related efforts such as the National Cancer Institute’s Research-tested Interventions Programs (RTIPs) provide cancer control practitioners access to over 200 programs that had been evaluated, have shown positive outcomes, and are published in peer-reviewed journals [63]. A unique focus of RTIPs is that programs are rated across the Reach, Effectiveness, Adoption, Implementation, & Maintenance (RE-AIM) framework [64] to assess the potential for implementation and long-term impact. Other guidelines such as What Works for Health rely on a wider range of standards of evidence, including expert opinion [65].
While policy dissemination research is relatively under developed in the field of health, policy dissemination research in other areas is not a new field and is more developed in countries outside the United States [66]. The lessons learned from this research, in specific California jurisdictions, as appropriate, will be translated across the state and may be replicable in other jurisdictions outside the state of California.
5. Conclusions
This paper describes a planned research funding initiative by the California Breast Cancer Prevention Program entitled Californians Linking Action with Science for Prevention of Breast Cancer (CLASP-BC). CLASP-BC is informed by CBPR and D&I research and is designed to translate the California Breast Cancer Prevention Plan overarching goal and specific intervention goals for 23 breast cancer risk and protective factors strategies into evidence-informed interventions (EIIs) that are disseminated and implemented across California. CLASP-BC is designed to disseminate and implement high-impact, population-based prevention approaches by funding large scale EIIs, through multi-jurisdictional actions, with the intent to decrease the risk of breast cancer and other chronic diseases (sharing common risk factors), particularly among racial/ethnic minorities and medically underserved populations in California.
CLASP-BC was informed, in part, by the Coalitions Linking Action and Science for Prevention (CLASP) D&I research and program evaluation initiative funded by the Canadian Partnership Against Cancer (CPAC). Like the Canadian CLASP, CLASP-BC will be rolled out in two phases. Phase 1 will focus on: (1) understanding the breast cancer concerns and prevention priorities of community leaders (from culturally diverse and medically underserved communities), researchers, practitioners, and policy experts across California; (2) engaging community and opinion leaders, research, practice, and policy specialists in regional California meetings (virtual and/or in-person) to identify opportunities for working together in breast cancer prevention coalitions based on shared concerns and priorities; and (3) supporting (e.g., with technical assistance and training workshops) building, strengthening, and enhancing CBPR and D&I research capacity, as well as research engagement within these coalitions.
Phase 2 will focus on: (1) providing D&I research grant support for interested and eligible coalitions demonstrating in their funding applications collaborative, evidence-informed (both practice and science-based) breast cancer prevention approaches from the BCPPP across two or more California jurisdictions (e.g., cities, counties); (2) working through a cooperative agreement funding mechanism, successful applicants will share the knowledge gained on quarterly video conference calls and annual meetings to exchange ideas for how to meet the challenges and take advantage of the opportunities to sustain the breast cancer prevention approaches beyond the funding period: and (3) integrating the lessons learned from science with the lessons learned from practice and policy to reduce the risk of developing breast cancer.
This paper describes in detail the plans for implementing CLASP-BC Phase 1. The Phase 2 elements of CLASP-BC, predicated on the successful implementation and evaluation of Phase 1, are described elsewhere in this special issue.
Acknowledgments
CBCRP provided honoraria to all co-authors for the development of the original concept paper upon which this manuscript is based.
Author Contributions
All co-authors made substantial contributions to the manuscript. Conceptualization, J.F.K., C.P., M.H.E.K.-L. and R.C.B.; Writing—Original Draft, J.F.K., M.H.E.K.-L., R.B., L.B.-G., C.P. and A.P.; Methodology, J.F.K., M.H.E.K.-L., L.B.-G., R.C.B., A.P. and C.P.; Writing—Review & Editing, J.F.K., M.H.E.K.-L., R.C.B., L.B.-G., A.P. and C.P.; Supervision, J.F.K., M.H.E.K.-L. and R.C.B.; Project Administration, J.F.K., M.H.E.K.-L. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- 1.Bray F., Ferlay J., Soerjomataram I., Siegel R.L., Torre L.A., Jemal A. Global cancer statistics 2018. CA Cancer J. Clin. 2018;68:394–424. doi: 10.3322/caac.21492. [DOI] [PubMed] [Google Scholar]
- 2.American Cancer Society . Breast Cancer Facts & Figures 2019–2020. American Cancer Society, Inc.; Atlanta, FA, USA: 2019. [Google Scholar]
- 3.Johnson R.H., Chien F.L., Bleyer A. Incidence of breast cancer with distant involvement among women in the United States, 1976 to 2009. JAMA. 2013;309:800–805. doi: 10.1001/jama.2013.776. [DOI] [PubMed] [Google Scholar]
- 4.Kehm R.D., Yang W., Tehranifar P., Terry M.B. 40 Years of Change in Age- and Stage-Specific Cancer Incidence Rates in US Women and Men. JNCI Cancer Spectr. 2019;3:pkz038. doi: 10.1093/jncics/pkz038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.California Breast Cancer Research Program. [(accessed on 29 May 2020)]; Available online: http://www.cbcrp.org/
- 6.White M.C., Kavanaugh-Lynch M.M.H.E., Davis-Patterson S., Buermeyer N. An expanded agenda for the primary prevention of breast cancer: Charting a course for the future. Int. J. Environ. Res. Public Health. 2020;17:714. doi: 10.3390/ijerph17030714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Frieden T.R. A framework for public health action: The health impact pyramid. Am. J. Public Health. 2010;100:590–595. doi: 10.2105/AJPH.2009.185652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Canadian Partnership Against Cancer. [(accessed on 30 May 2020)]; Available online: https://www.partnershipagainstcancer.ca/#.
- 9.Manafò E., Petermann L., Lobb R., Keen D., Kerner J. Research, practice, and policy partnerships in pan-Canadian coalitions for cancer and chronic disease prevention. J. Public Health Manag. Pract. 2011;17:E1–E11. doi: 10.1097/PHH.0b013e318215a4ae. [DOI] [PubMed] [Google Scholar]
- 10.Lobb R., Petermann L., Manafo E., Keen D., Kerner J. Networking and knowledge exchange to promote the formation of transdisciplinary coalitions and levels of agreement among transdisciplinary peer reviewers. J. Public Health Manag. Pract. 2013;19 doi: 10.1097/PHH.0b013e31823991c2. [DOI] [PubMed] [Google Scholar]
- 11.Lasker R., Weiss E. Broadening participation in community problem solving: A multidisciplinary model to support collaborative practice and research. J. Urban Health. 2003;80:14–47. doi: 10.1093/jurban/jtg014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Burke J., O’Campo P., Peak G., Gielen A., Donnel K.M., Trochim W. An introduction to concept mapping as a participatory public health research approach. Qual. Health Res. 2005;15:1392–1410. doi: 10.1177/1049732305278876. [DOI] [PubMed] [Google Scholar]
- 13.Israel B., Schulz A.J., Parker E., Becker A. Review of community-based research: Assessing partnership approaches to improve public health. Annu. Rev. Public Health. 1998;19:173–202. doi: 10.1146/annurev.publhealth.19.1.173. [DOI] [PubMed] [Google Scholar]
- 14.Cargo M., Mercer S. The value and challenges of participatory research: Strengthening its practice. Annu. Rev. Public Health. 2008;29:325–350. doi: 10.1146/annurev.publhealth.29.091307.083824. [DOI] [PubMed] [Google Scholar]
- 15.Himmelman A. On coalitions and the transformation of power relations: Collaborative betterment and collaborative empowerment. Am. J. Com. Psych. 2001;29:277–284. doi: 10.1023/A:1010334831330. [DOI] [PubMed] [Google Scholar]
- 16.National Cancer Institute State Cancer Profiles. [(accessed on 2 July 2020)]; Available online: https://statecancerprofiles.cancer.gov/map/map.withimage.php?06&county&001&00007&03&0&3&0&1&5&0#results.
- 17.California Department of Public Health Workplace Breastfeeding Support in California. [(accessed on 2 July 2020)]; Available online: https://www.cdph.ca.gov/Programs/CFH/DMCAH/CDPH%20Document%20Library/BFP/BFP-WorkplaceBreastfeedingSupportingCalifornia.
- 18.California Area Indian Health Service List of Federally Recognized Tribes in California. [(accessed on 3 July 2020)]; Available online: https://www.ihs.gov/california/index.cfm/tribal-consultation/resources-for-tribal-leaders/links-and-resources/list-of-federally-recognized-tribes-in-ca/?mobileFormat=0.
- 19.Baezconde-Garbanati L., Beebe L.A., Pérez-Stable E.J. Building capacity to address tobacco-related disparities among American Indian and Hispanic/Latino communities: Conceptual and systemic considerations. Addiction. 2007;102(Suppl. 2):112–122. doi: 10.1111/j.1360-0443.2007.01962.x. [DOI] [PubMed] [Google Scholar]
- 20.Tong E.K., Lew R. Moving communities toward policy change: APPEAL’s 4-prong policy change model. Health Promot. Pract. 2013;14(Suppl. 5):29S–35S. doi: 10.1177/1524839913484763. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Nyström M.E., Karltun J., Keller C., Gare B.A. Collaborative and partnership research for improvement of health and social services: Researcher’s experiences from 20 projects. Health Res. Policy Sys. 2018;16:46. doi: 10.1186/s12961-018-0322-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Wolff T. Community coalition building—contemporary practice and research: Introduction. Am. J. Community Psychol. 2001;29:165–172. doi: 10.1023/A:1010314326787. discussion 205–211. [DOI] [PubMed] [Google Scholar]
- 23.Plumb M., Collins N., Cordeiro J.N., Kavanaugh-Lynch M. Assessing process and outcomes: Evaluating community-based participatory research. Prog. Community Health Partnersh. Res. Educ. Action. 2008;2:87–97. doi: 10.1353/cpr.0.0020. [DOI] [PubMed] [Google Scholar]
- 24.Keating C. The politics of everyday coalition-building. New Political Sci. 2018;40:177–183. doi: 10.1080/07393148.2017.1418485. [DOI] [Google Scholar]
- 25.Blackwell A.G., Colemenar R. Community-building: From local wisdom to public policy. Public Health Rep. 2000;115:157–162. doi: 10.1093/phr/115.2.161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.De Las Nueces D., Hacker K., Di Girolamo A., Hicks L.S. A systematic review of community-based participatory research to enhance clinical trials in racial and ethnic minority groups. Pt 2Health Serv. Res. 2012;47:1363–1386. doi: 10.1111/j.1475-6773.2012.01386.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Viswanathan M., Ammerman A., Eugenia E., Garlehner G., Lohr K.N., Griffith D., Rhodes S., Samuel-Hodge C., Maty S., Lux L., et al. Community-Based Participatory Research: Assessing the Evidence. Summary, Evidence Report/Technology Assessment: Number 99. Agency for Healthcare Research and Quality; Rockville, MD, USA: 2004. [(accessed on 29 May 2020)]. AHRQ Publication Number 04-E022-1. Available online: http://www.ahrq.gov/clinic/epcsums/cbprsum.htm. [PMC free article] [PubMed] [Google Scholar]
- 28.Lew R., Martinez J., Soto C., Baezconde-Garbanati L. Training leaders in priority populations to implement social norm changes in tobacco control: Lessons in the LAAMPP institute. Health Promot. Pract. 2011;12(Suppl. 2):195S–198S. doi: 10.1177/1524839911419296. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Wendel M., Burdine J.K.M.L. The evolving role of partnerships in addressing community public health issues: Policy and ethical implications. Organ Ethic. 2007;4:53–64. [PubMed] [Google Scholar]
- 30.Luque J.S., Tyson D.M., Bynum S.A., Thomas S.N., Wells K.J., Vadaparampil S.T., Gwede C.K., Meade C.D. A social network analysis approach to understand changes in a cancer disparities community partnership network. Ann. Anthropol. Pract. 2011;35:112–135. doi: 10.1111/j.2153-9588.2011.01085.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fawcett S., Schultz J., Watson-T J., Fox M., Bremby R. Building multisectoral partnerships for population health and health equity. Prev. Chronic Dis. 2010;7:1–7. [PMC free article] [PubMed] [Google Scholar]
- 32.Lasker R.D., Weiss E.S., Miller R. Partnership synergy: A practical framework for studying and strengthening the collaborative advantage. Milbank Q. 2001;79:179–205. doi: 10.1111/1468-0009.00203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Martinez-Bianchi V., Frank B., Edgoose J., Michener L., Rodriguez M., Gottlieb L., Reddick B., Kelly C., Yu K., Davis S., et al. Addressing family medicine’s capacity to improve health equity through collaboration, accountability and coalition-building. Fam. Med. 2019;51:198–203. doi: 10.22454/FamMed.2019.921819. [DOI] [PubMed] [Google Scholar]
- 34.Public Policy Institute of California Just the Facts: California’s Population. [(accessed on 2 July 2020)]; Available online: https://www.ppic.org/publication/californias-population/#:~:text=No%20race%20or%20ethnic%20group,the%202018%20American%20Community%20Survey.
- 35.Index Mundi. [(accessed on 2 July 2020)]; Available online: https://www.indexmundi.com/factbook/compare/canada.united-states/demographics.
- 36.Canadian Partnership against Cancer Working Together: Lessons Learned from the Coalitions Linking Action and Science for Prevention (CLASP) Initiative in Supporting Indigenous Health and Wellness. [(accessed on 1 October 2019)]; Available online: https://www.partnershipagainstcancer.ca/topics/prevention-clasp-indigenous-health/
- 37.Hiatt R.A., Porco T.C., Liu F., Balke K., Barlow J.B., Roux D., Kushi L., Moasser M. A multilevel model of postmenopausal breast cancer incidence. Cancer Epidemiol. Biomark. Prev. 2014;23:2078–2092. doi: 10.1158/1055-9965.EPI-14-0403. [DOI] [PubMed] [Google Scholar]
- 38.Glasgow R.E., Vinson C., Chambers D., Khoury M.J., Kaplan R.M., Hunter C. National institutes of health approaches to dissemination and implementation science: Current and future directions. Am. J. Public Health. 2012;102:1274–1281. doi: 10.2105/AJPH.2012.300755. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Peters D.H., Adam T., Alonge O., Agyepong I.A., Tran N. Implementation research: What it is and how to do it. BMJ. 2013;347:f6753. doi: 10.1136/bmj.f6753. [DOI] [PubMed] [Google Scholar]
- 40.Brownson R.C., Colditz G.A., Proctor E.K. Dissemination and Implementation Research in Health: Translating Science to Practice. 2nd ed. Oxford University Press; New York, NY, USA: 2018. Terminology for dissemination and implementation research; pp. 19–45. [Google Scholar]
- 41.Brownson R.C., Colditz G.A., Dobbins M., Emmons K.M., Kerner J.F., Padek M., Proctor E.K., Stange K.C. Concocting that magic elixir: Successful grant application writing in dissemination and implementation research. Clin. Transl. Sci. 2015;8:710–716. doi: 10.1111/cts.12356. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Proctor E.K., Powell B.J., Baumann A.A., Hamilton A.M., Santens R.L. Writing implementation research grant proposals: Ten key ingredients. Implement Sci. 2012;7:96. doi: 10.1186/1748-5908-7-96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Jones L., Meade B., Forge N., Moini M., Jones F., Terry C., Norris K. Begin your partnership: The process of engagement. Ethn. Dis. 2009;19(Suppl. 6):S6-8–16. [PMC free article] [PubMed] [Google Scholar]
- 44.Andrews J.O., Cox M.J., Newman S.D., Meadows O. Development and evaluation of a toolkit to assess partnership readiness for community based participatory research. Prog. Community Health Partn. 2011;5:183–188. doi: 10.1353/cpr.2011.0019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53. doi: 10.1186/s13012-015-0242-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Tabak R.G., Khoong E.C., Chambers D.A., Brownson R.C. Bridging research and practice: Models for dissemination and implementation research. Am. J. Prev. Med. 2012;43:337–350. doi: 10.1016/j.amepre.2012.05.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Duran B., Oetzel J., Magarati M., Parker M., Zhou C., Roubideaux Y., Muhammad M., Pearson C., Belone L., Kastelic S.H., et al. Toward health equity: A national study of promising practices in community-based participatory research. Prog. Community Health Partn. 2019;13:337–352. doi: 10.1353/cpr.2019.0067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Chaudoir S.R., Dugan A.G., Barr C.H. Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8:22. doi: 10.1186/1748-5908-8-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Curran G.M., Bauer M., Mittman B., Pyne J.M., Stetler C. Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Med. Care. 2012;50:217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Brown C.H., Curran G.M., Palinkas L.A., Aarons G.A., Wells K., Jones L., Collins L.M., Duan N., Mittman B.S., Wallace A., et al. An overview of research and evaluation designs for dissemination and implementation. Annu. Rev. Public Health. 2017;38:1–22. doi: 10.1146/annurev-publhealth-031816-044215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Oakley A., Strange V., Bonell C., Allen E., Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332:413–416. doi: 10.1136/bmj.332.7538.413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Rabin B.A., Lewis C.C., Norton W.E., Neta G., Chambers D.A., Tobin J.N., Brownson R.C., Glasgow R.E. Measurement resources for dissemination and implementation research in health. Implement Sci. 2016;11:42. doi: 10.1186/s13012-016-0401-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Stetler C.B., Legro M.W., Wallace C.M., Bowman C., Guihan M., Hagedorn H., Kimmel B., Sharp N.D., Smith J.L. The role of formative evaluation in implementation research and the QUERI experience. J. Gen. Intern. Med. 2006;21(Suppl. 2):S1–S8. doi: 10.1007/s11606-006-0267-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Proctor E., Silmere H., Raghavan R., Hovmand P., Aarons G., Bunger A., Griffey R., Hensley M. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Adm. Policy Ment. Health. 2011;38:65–76. doi: 10.1007/s10488-010-0319-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Palinkas L.A., Aarons G.A., Horwitz S., Chamberlain P., Hurlburt M., Landsverk J. Mixed method designs in implementation research. Adm. Policy Ment. Health. 2011;38:44–53. doi: 10.1007/s10488-010-0314-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Institute of Medicine (US) Subcommittee on Military Weight Management Factors That Influence Body Weight. [(accessed on 1 October 2019)]; Weight Management: State of the Science and Opportunities for Military Programs. Available online: https://www.ncbi.nlm.nih.gov/books/NBK221834.
- 57.Colditz G.A., Bohlke K. Priorities for the primary prevention of breast cancer. CA A Cancer J. Clin. 2014;64:186–194. doi: 10.3322/caac.21225. [DOI] [PubMed] [Google Scholar]
- 58.Purdue M.P., Hutchings S., Rushton L., Silverman D.T. The proportion of cancer attributable to occupational exposures. Ann. Epidemiol. 2015;25:188–192. doi: 10.1016/j.annepidem.2014.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Taylor K.W., Troester M.A., Herring A.H., Engel L.S., Nichols H.B., Sandler D.P., Baird D.D. Associations between personal care product use patterns and breast cancer risk among white and black women in the sister study. Environ. Health Perspect. 2018;126:027011. doi: 10.1289/EHP1480. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.He C., Anand S.T., Ebell M.H., Vena J.E., Robb S.W. Circadian disrupting exposures and breast cancer risk: A meta-analysis. Int. Arch. Occup. Environ. Health. 2014;88:533–547. doi: 10.1007/s00420-014-0986-x. [DOI] [PubMed] [Google Scholar]
- 61.Lopez-Campos J.L. Phenotyping of chronic obstructive pulmonary disease: Current approaches and future directions. Curr. Respir. Med. Rev. 2011;7:138–143. doi: 10.2174/157339811794927798. [DOI] [Google Scholar]
- 62.Task Force on Community Preventive Services Guide to Community Preventive Services. [(accessed on 15 October 2019)]; Available online: https://www.thecommunityguide.org/
- 63.National Cancer Institute Research-Tested Intervention Programs (RTIPs) [(accessed on 15 October 2019)]; Available online: http://rtips.cancer.gov/rtips/index.do.
- 64.Glasgow R.E., Harden S.M., Gaglio B., Rabin B., Smith M.L., Porter G.C., Ory M.G., Estabrooks P.A. RE-AIM planning and evaluation framework: Adapting to new science and practice with a 20-year review. Front. Public Health. 2019;7:64. doi: 10.3389/fpubh.2019.00064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.University of Wisconsin Population Health Institute Using What Works for Health. [(accessed on 15 October 2019)]; Available online: http://www.countyhealthrankings.org/roadmaps/what-works-for-health/using-what-works-health.
- 66.Brownson R.C., Colditz G.A., Proctor E.K. Dissemination and Implementation Research in Health: Translating Science to Practice. Oxford University Press; New York, NY, USA: 2018. Policy Dissemination Research; pp. 433–447. [Google Scholar]