Abstract
The field of dissemination and implementation (D&I) science is rapidly growing, with many scientists seeking to apply D&I science to enhance and expand the impact of their work. As the D&I field grows and collaborations of implementation scientists with other fields flourish, a description for the roles for D&I scientists as they collaborate with researchers from other fields could be beneficial. This paper exemplifies how the D&I scientist/researcher collaborative process might work and important elements to consider in doing so, as well as provide an outline on how collaborations might progress for different project needs. This is discussed through example scenarios to consider an implementation scientists’ engagement in a research project and describe potential roles for implementation scientists in supporting research teams. We then discuss characteristics to consider when incorporating a D&I expert into a team and considerations in navigating the scenarios.
Keywords: Collaboration in implementation science, Funding of implementation science, Education on implementation science
Contributions to the literature.
Contributes to the conversation as investigators find models for collaboration with the developing field of dissemination and implementation (D&I) science
Provides potential models for collaboration in common scenarios
Discusses characteristics for D&I experts as they are incorporated in teams, to add to the discourse on what it means to be a D&I scientist
Background
The field of dissemination and implementation (D&I) science is rapidly growing, with many scientists seeking to apply D&I science to enhance and expand the impact of their work [1–3]. The incorporation of D&I science in scientific projects includes an emphasis among funders, encouraging plans for dissemination within a broader range of application types [4–7], and focusing on the science of D&I science. More investigators are, therefore, incorporating D&I science in their study designs both because of funding announcements, but also because they see the potential for D&I science to enhance the impact of their efforts. Several training programs and guides to foster capacity building in the field have been developed [8–20], including the development of competencies for implementation researchers [13, 21–23], but the D&I science field is nascent so widespread expertise of D&I knowledge and skills on how to collaborate with others is limited. Guidance for how to engage with D&I scientists could benefit the field. Further, as the D&I field grows and collaborations of D&I scientists with other fields flourish (e.g., infectious disease, nutrition education, cancer prevention and control, human services) [24–30], a description for the roles for D&I scientists as they collaborate with researchers from other fields could be beneficial. Investigators seeking funding to conduct studies involving D&I components need to demonstrate the research team’s capacity to successfully complete the proposed study [31] and the key role the D&I scientist plays from the beginning of a research idea/design through carrying out the research protocol and presenting the findings. Although this circumstance most often applies to projects peer-reviewed for funding consideration, the same applies to non-funded projects, to internal or community projects, and in publishing.
The goal of this paper is to discuss how the D&I scientist/researcher collaborative process might work and elements to consider in doing so, as well as provide an outline on how collaborations might progress for different project needs. We begin with an example scenario to consider a D&I scientists’ engagement in a research project and describe potential roles for D&I scientists in supporting research teams. Then, we discuss characteristics to consider when incorporating a D&I expert into a team and considerations in navigating the scenarios. These approaches are offered based on our collective experience providing consultation services that help support investigators in developing implementation science research. The authors have significant experience providing consultation on D&I science through their professional positions. AB (Co-Director) and RGT have been working with the Dissemination and Implementation Research Core (DIRC), a methods core from the Institutional Clinical and Translational Science at Washington University in St. Louis for more than 9 years. RGT is also a Co-Director of the D&I in Diabetes Core with the Center for Diabetes Translation Research at Washington University in St. Louis. JSH is the Associate Director of the D&I Program and Senior Implementation Scientist at the Adult and Child Consortium for Health Outcomes Research and Delivery Science (ACCORDS) at the University of Colorado School of Medicine and a Senior Scientific Advisor on D&I for the Agency for Healthcare Research and Quality. As consultants to our customers, we have developed toolkits and have supported several investigators receive funding for their own research through the National Institutes of Health, foundation, and internal pilot grants [32, 33].
A decisional pathway for dissemination and implementation (D&I) research collaboration
Working through an example scenario to describe possible pathways
We begin with examples of possible pathways based on decisions made to describe how this issue arises. To illustrate, we provide a description of how relationships between researchers might develop and evolve.
The actors in the scenario
Consider a D&I science expert (Dr. Implementation or Dr. I) and an investigator looking to incorporate D&I science into his/her study (Dr. Researcher or Dr. R). Dr. R is a treatment developer and/or clinical trialist with significant expertise in his/her substantive area (e.g., substance abuse treatment, HIV prevention, diabetes management interventions). Dr. R becomes interested in D&I because the inclusion of D&I science and D&I expertise into his project was specifically noted in the summary statements from his grant review. He attends a talk about D&I and sees potential in applying D&I science to his work.
Starting the discussion
Scenario 1
Dr. R happens to work at a university with a D&I research program, which provides support services. Dr. R submits a request for services through the online consultation request form, and Dr. I responds by sending Dr. R initial readings and resources to help orient Dr. R to D&I science as well as to arrange an initial meeting. At the meeting, Dr. I inquires about Dr. R’s research to help understand the research questions and how D&I science might further Dr. R’s research agenda. Dr. R also considers that D&I might be beneficial for his research question.
Decision 1 (Incorporating D&I science into the project): While we recognize a study at any point along the translational continuum could benefit from a D&I perspective [34, 35], not all investigators who interact with D&I scientists and who initially express interest decide to pursue application of D&I in their work. Lane-Fall et al. lay out a mechanism for guiding this decision process, based on questions about intervention efficacy, effectiveness, and implementation [36].
Option 1: Drs. I and R decide not to collaborate at this time. This may be for many reasons. For example, they may together decide that the study is not ready for D&I (i.e., needs efficacy testing first) and Dr. R is not interested in pursuing a designing for dissemination approach to further intervention development and testing or it may be that Dr. R is not ready/able/willing to invest resources in D&I at this time. They may decide to start back at decision 1 at a later date as Dr. R moves his research agenda along.
Option 2: If Dr. I and Dr. R both determine that the research question could benefit from an application of D&I science, several decisions for how the relationship could proceed are laid out in Fig. 1. This would lead Dr. R to determine the appropriate D&I investigator to support the project long-term: decision 2.
Figure 1 below outlines key decision points within in the preparation of grants, based on our experiences, and will be referred to in the discussion of decisions 2 and 3 and scenario 3.
Decision 2 (Identifying the D&I expert): If Dr. R becomes interested in learning more about the D&I field, he needs to determine how best to build D&I science within his work. Although not the focus of this discussion, it is also very likely that other methods specialists specific to the D&I elements of the study join the team at this point so that these areas of expertise are represented such as economic analysis or qualitative and mixed methods expertise for example; it may be Dr. I who suggests these collaborators and makes connections. The text and Fig. 2 below describe some characteristics of a D&I scientist that Dr. R may consider in selecting with whom to partner.
Option 1: To accomplish this, Dr. I and Dr. R’s team might decide to work together, with Dr. I continuing to support R’s project. This would lead the two investigators to determine how best to work together: decision 3.
Option 2: Alternately, Dr. I might be committed to existing projects and unable to help Dr. R for the long-term or the topic of Dr. R’s study may be too far outside Dr. I’s field of interest. Dr. I could then refer Dr. R to another member of the D&I community with more aligned interest or availability if this is available. Once this D&I scientist is identified, s/he and Dr. R could move to decision 3.
Decision 3 (Determining role of the D&I expert): Regardless of the D&I scientist Dr. R works with, Dr. R, working in collaboration with the D&I scientist, needs to determine what role the D&I scientist will play. Because incorporating D&I science may require changes in framing of research questions and priorities which can have impacts throughout the study design and budget, providing support in D&I science requires Dr. I to build a relationship with Dr. R. This is particularly important if D&I science is to be integrated within the study, as this requires time to understand the D&I science concepts and, importantly, to incorporate them as a way of thinking about research decisions and trade-offs. We recognize this is a critical decision in the study design process and a decision D&I scientists often help make with other subject-matter and methods experts (e.g., the strength and generalizability of the evidence base for the practice/program/policy of interest). However, we will not provide a lengthy description here, and refer readers to other literature, such as the work of Lane-Fall et al. and Curran et al. to guide this choice [36–38].
Option 1: If the study has a heavy emphasis on intervention efficacy or effectiveness (emphasis on D&I science is low), but with assessment of context or preliminary implementation strategy development, or on intervention development, but with an effort to design the intervention for dissemination, then Dr. I might have a supportive role [37, 39]. Dr. I might serve in this role as a consultant, member of an advisory board, or as a co-investigator at a small percent effort, and for example assist with ancillary measures for preliminary, contextual data collection to inform future implementation strategy development. Meanwhile, Dr. R might receive other supplementary training.
Option 2: If the study has a more central (moderate to high) emphasis on D&I, then it is important that Dr. I (or other D&I investigator) play a more prominent role as co-investigator or co-principal investigator (PI). It should be noted that often as study planning progresses, the decision of how much to embed D&I science in the study changes. For example, instead of measuring only acceptability of an intervention, now the study may also focus on understanding the components of the strategies that would facilitate adoption and sustainability of the intervention. When this is the case, Drs. I and R may consider increasing the role of Dr. I to a higher percent effort consultant or co-investigator or to a co-PI.
In both options 1 and 2, Dr. I plays a central role in the research providing key contributions to the project and has a specific number of hours to provide support on the study both pre- and post-award. As part of option 1, Dr. I could also serve as a member of an Advisory Board. In this case, her involvement in the study is defined by encounters with the research team, who would present about the progress of the study and consult on specific topics [40].
Scenario 2
Dr. R happens to work in the field or at a university where there is no formal D&I program. Dr. R is still interested in incorporating D&I science in his study, so, in this case, Dr. R could search to determine if there is someone with D&I expertise at his own institution by asking colleagues or searching PubMed or journals commonly accessed for D&I articles as identified by Norton et al. [41]. Also, there may be a D&I scientist at another institution with a content-area interest that may be willing to be a co-investigator or paid consultant. Finding a D&I scientist who is available to collaborate can be challenging due to lack of capacity in the D&I field overall and is discussed below under the section called “Considerations in Navigating the Scenarios.” Once a D&I scientist is identified, this scenario can follow from decision 1 as in scenario 1 above. However, in either case, the hypothetical Dr. R might decide to pursue his own D&I training.
Scenario 3
As noted above, an alternative path could be if Dr. R becomes interested in D&I science at a deeper level himself or is unable to find a D&I collaborator and decides to pursue some level of D&I training (right side of Fig. 1). The path of training can include a combination of formal training as well as informal mentorship, apprenticeship style training, and mentored work applying D&I science in the field. There are many formal and informal training programs emerging for this researcher to investigate and he could consider training grants with a focus on D&I research. In this case, Dr. R would benefit greatly from a D&I scientist such as Dr. I as a mentor. The many resources to support D&I training and education and for identifying D&I collaborators have been reviewed and collected in several compilations [14]. We do not aim to replicate these resources; rather, we point readers to resources such as websites [42–48] and trainings [49–55] they may look to as they explore the decisions discussed [14, 56].
Summarizing potential roles for a D&I scientist
Based on the scenarios and decisions described above, Table 1 summarizes the types of roles for researchers trained in D&I science when collaborating on research studies with researchers from other fields.
Table 1.
Example | Emphasis on D&I | D&I scientist (Dr. I)a role | D&I scientist (Dr. I)a engagement | Content area expert (Dr. R)b role |
---|---|---|---|---|
Exploratory aim to assess context or implementation outcomes (e.g., acceptability, feasibility, cost) | Low |
● Understand context ● Assess implementation outcomes ● Incorporate designing for dissemination principles |
● Consultant ● Advisory board ● Co-investigator |
PI |
Preliminary aim or preliminary study to assess context, dissemination channels, or feasibility | Low |
● Understand context ● Assess implementation outcomes ● Inform dissemination and/or implementation strategy |
● Consultant ● Advisory board ● Co-investigator |
PI |
Preliminary or pilot study to assess context, dissemination channels, or feasibility | Low/moderate |
● Understand context ● Assess implementation outcomes ● Pilot dissemination and/or implementation strategy |
● Consultant ● Advisory board ● Co-investigator |
PI |
Secondary aim is D&I science specific | Moderate/high |
● Understand context ● Assess implementation outcomes ● Develop, tailor, and/or test implementation strategies |
● Co-investigator ● Multiple PI |
● PI ● Multiple PI |
Primary aim is D&I science specific | High |
● Understand context ● Assess implementation outcomes ● Develop, tailor, and/or test dissemination and/or implementation strategies |
● Multiple PI |
● PI ● Multiple PI |
aResearcher with D&I expertise
bResearcher with subject-matter expertise and not D&I science expertise
Characteristics to consider when incorporating a D&I expert into a team
Beyond the decision points regarding the extent to which D&I is appropriate in a study and a D&I expert is needed, there is more to building a successful collaboration. Other fields have provided descriptions of how scientists may collaborate in multi-disciplinary teams (e.g., statisticians [57–63]) and characterized the tasks they complete in consultation meetings (e.g., learning content area of collaborator, reviewing protocol, etc.) [64]. Gilliland et al. [65] described seven characteristics of a translational scientist: boundary crosser, domain expert, team player, process innovator, skilled communicator, systems thinker, and rigorous researcher. We build on this work to describe possible pathways of collaborative work between D&I researchers and experts from other fields. D&I scientists may be particularly well suited to this type of multi-disciplinary collaboration given many D&I scientists are also experts in another type of research and bring diverse substantive backgrounds and training experience (e.g., mental health, infectious disease, public health).
In Fig. 2, we present a model for considering characteristics important specifically for the D&I consultation relationship. The model is presented to resemble a flower with a big core of overlapping areas, but with distinct pedals to signify important elements. Early-stage investigators looking to develop expertise in D&I science for a variety of roles, and to expand the capacity of the field, may consider these characteristics in addition to the competencies described elsewhere [13, 21–23] for developing D&I expertise to apply in their own work.
Knowledge
An important element of a successful collaboration is that the D&I scientist has knowledge of D&I science methods to bring to the relationship. The hypothetical Dr. I should have a solid basis of understanding of D&I frameworks and theories, implementation strategies and methods, methods to understand context, adaptation, and expected outcomes. Sometimes, specific expertise and experience with a particular model or framework and/or implementation strategy is needed and extra consultation may be required [13, 21]. Knowledge of D&I can be demonstrated in how the D&I frameworks are aligned with the methods, designs, and measures of the project, as well as with contextual determinants (e.g., barriers and facilitators to implementation) and the plans for developing and tailoring implementation strategies [31, 66, 67].
Incorporation
This is the ability to bring the knowledge of D&I and apply it to the situation at hand. This means taking D&I knowledge and being able to use it in crafting new research and understanding outcomes from existing findings. Incorporating D&I science in a grant or study goes beyond applying the knowledge within the D&I scientist’s own area of research; it involves applying D&I science to another investigator’s line of research. As D&I scientists in numerous roles, we have collaborated with experts in a range of disciplines, such as cancer and sickle cell disease, and supported D&I science in these diverse disciplines. We have found that part of what we do is “translate” D&I in these different disciplines for other researchers, which goes beyond just knowing the D&I science.
Skills
A wide variety of skills are important here, similar to the characteristic identified by Gilliland et al. [65] of being a “skilled communicator.” Skills can be both broad (i.e., the skill of working collaboratively and communicating appropriately) or specific to D&I (i.e., the skill of selling the importance of D&I to different investigators, of framing a D&I proposal for different study sections or the skill to communicate, teach, and explain D&I science knowledge). The ability to communicate about D&I science to diverse audiences contributes to a project’s development, execution, and impact by supporting engagement of stakeholders with the D&I science aspect of the work.
Credibility
The D&I scientist needs to be considered as having substantive knowledge in D&I science to be credible to reviewers and to support a D&I project. Sometimes, the D&I scientist needs to be senior or highly networked, especially if the proposed work is a large competitive grant or program, and knowing and tapping into a network of other D&I experts for insight is necessary.
Collaboration
The D&I scientist should be a person who is able to consider another researcher’s primary interest and support that work. This goes beyond being a boundary crosser (i.e., “Breaks down disciplinary silos and collaborates with others across research areas and professions to collectively advance the development of a medical intervention”), to work across disciplines [65], but involves prioritizing another investigator’s research agenda. It is important to inform and point out places of challenge, but not take over the agenda.
Taken together, these relationships often require for the hypothetical Dr. I as the D&I scientist to have D&I science knowledge and skills in the abstract, and the ability to apply them to an area of research that is not necessarily her primary discipline. Once a person is comfortable with the science, one can collaborate with those new to D&I science (such as Dr. R and his team) and support them in understanding D&I science concepts and the value of their application. This allows investigators such as Dr. R to truly integrate the science within his study and research agenda. For example, Dr. R may ask Dr. I to assist in selecting and applying a theory, model, or framework. In-depth knowledge of a wide range of theories, models, and frameworks facilitates advising Dr. R. However, it is also necessary for Dr. I to understand Dr. R’s goals and to support him in utilizing the selected framework in the proposed work. Similarly, Dr. I may assist Dr. R in crafting a D&I science question/component for studies at different phases. These require deep knowledge of D&I science, facility and flexibility with the evidence base, awareness of the many resources available (e.g., books, literature, web resources), and skills in research design.
The competitive nature of grant funding requires Drs. R and I to clarify their relationship, convey how Dr. I is engaged with the project team, and articulate how Dr. I’s expertise contributes to the study. For example, Dr. I’s biosketch should reflect publications in D&I broadly and, if possible, in the components of D&I science specific to the proposed work (e.g., assessing implementation context, building and testing implementation strategies). If the D&I scientist has conducted work in the relevant substantive area, those are publications which could be highlighted. While it may not be possible for all collaborations, pilot work related to the D&I science research question, which could be co-produced, is also beneficial. Regardless of the relationship Drs. I and R decide upon, clear description of the role Dr. I will play in Dr. R’s study team is important, for example, statements in a grant proposal text and/or budget justification such as “Dr. I is the D&I science lead and will contribute to the study through XX activities” (Proctor et al. [31]). The resources available for D&I should also be outlined in the facilities and resources’ sections specifying resources beyond the individual D&I expert. Further, for any role, it is critical for Dr. I to be engaged enough in the study and proposal development so that the D&I science components are clear and well-integrated. It likely shows through in the text of a grant proposal and/or manuscript when a D&I scientist is merely named on the project but does not play a central role in that team. As noted above, the level of necessary engagement depends on the study aims and how integral D&I science is to the project, but adequate ongoing engagement is nonetheless important to clearly describe how D&I methods strengthen the study.
Finally, Dr. R and Dr. I need to work together effectively and follow general ground rules of effective collaboration. This includes having the bandwidth to be an effective collaborator with timely review and follow-up on assigned tasks, clear and honest communication, and being respectful and considerate of each other. This may be especially important for investigators coming from different points of view to start, for example, perspective on the importance of randomized controlled trial study designs. Discussion and patience are needed to come to a common understanding of the choices to achieve the main objectives of the study. Time preparing a proposal, paper, or other collaborative product is useful to determine if these relationships can be productive and professional. Specific strategies such as collaboratively completing a PRECIS-2 “wheel” or navigating resources for selecting theories, models, and frameworks early on can help the hypothetical Dr. R weigh the implications of a more pragmatic approach and the importance of implementation context and outcomes to the research process. Also, the use of other tools and resources [32, 56] can help identify potential “pain points” in perspectives and work through the process of clarifying the research needs.
Overall, there are many decision points in study development in general and to navigating the role of a D&I scientist specifically. It is of course important to consider logistical and budget implications of these decisions, the types of grants being prepared, and the evidence of the intervention being studied. These have implications for the type of role Dr. I, as a D&I scientist, has in the study.
Considerations in navigating the scenarios
These scenarios are presented as relatively smooth, linear processes of developing research collaborations and acquiring training (formal and/or mentored). However, like any transdisciplinary work, there may be challenges in identifying D&I experts with availability. For example, many universities do not have D&I programs, so requesting a free consult through an organized request system with a D&I scientist is not always an available option. Therefore, requesting consultation from an individual investigator who is not part of a D&I program to provide consultation might be challenging [14, 41]. Even at universities with D&I programs, it is possible all the D&I experts are fully funded and do not have time available for years.
For investigators seeking training, increasingly, training programs for researchers to learn how to conduct D&I are available; however, there is no consensus on what constitutes sufficient training to conduct work independently without assistance [56, 68–70]. Further, while knowledge of D&I may be useful, it may not be perceived as contributing to a researcher’s being “known” as a D&I scientist on a competitive grant proposal. With regard to mentored or apprentice-style training, an additional problem with capacity is that K and other career awards do not provide funded time for the mentor, as well as similar challenges matching with a mentor with availability and relevant expertise. To increase capacity of a senior/junior partnership where two D&I scientists are included on a proposal, with the senior at a smaller percent of effort and the junior at a larger percent effort with the senior advising and overseeing the junior, can be considered. This has many advantages, as a capacity building experience for the junior investigator; however, this leaves the senior on a lot of projects at a small percent effort, which is challenging. This highlights the difficulty of spreading over numerous projects from diverse substantive areas, which is not always valued in promotion and tenure decisions, and which may discourage D&I scientist such as Dr. I from joining collaborations. This is a particular problem for a field that values transdisciplinary work. These issues are not dissimilar from other fields, such as in economics and statistics.
Other issues relate to those typical to many collaborations where the hypothetical Dr. R essentially does not provide an appropriate set-up for collaboration. Some examples include the following: Dr. R approaches Dr. I very close to a grant deadline, which does not allow time for discussion and consideration of the alternative designs or methods that are more common in D&I research, or Dr. R has an efficacy intervention that is not likely to work in the “real world” and is unwilling to modify it for D&I potential. There is no one answer to these challenges; however, they do exist and are worth acknowledging. In these instances, the hypothetical Dr. I needs to have one of those “conscious conversations” with Dr. R to resolve these differences or collaboration may not proceed.
Discussion
Because D&I science is emerging rapidly, there is a growing need for these experts to support investigators new to the science. Incorporating a trained and collaborative D&I scientist has the potential to improve funding and publishing success for a study with a D&I emphasis or components. Providing quality efforts and services in a timely manner can help the D&I science field continue to grow.
The options and scenarios described above are not designed to be exhaustive, but to stimulate discussion and contribute to a structure. There are likely many ways the dynamic between Drs. I and R might evolve, and the relationship and roles are often iterative and change over time. Our goal has been to further the discussion about the needs of the field of D&I research and make it as impactful as possible. This is based on our experiences and those of other D&I programs gathered through collaborative input. We believe this information will generalize to D&I scientists in many programs. Future research could examine the impacts of levels of engagement or training in D&I on successful funding of grant applications or acceptance of publications and especially on clinically relevant implementation and health outcomes. Future investigation could also explore the use of D&I scientists in consultant roles in research over time to get a sense of trends in this area as well as opportunities to support early- and mid-career D&I scientists including building experience with consultative roles (for example through embedded research support or lighter consultation).
Conclusion
Building teams, which incorporate implementation science, can follow many paths. Given the ongoing development of implementation science as a field, the conversation of what makes an investigator a D&I scientist and how they can best partner with investigators seeking these skills is evolving, but several key roles and criteria can be identified.
Acknowledgements
The authors would like to acknowledge the assistance of Shelly Johnston and Allison Phad for their assistance in preparing this manuscript for publication.
Abbreviations
- D&I
Dissemination and implementation
- PI
Principal investigator
Authors’ contributions
All authors contributed to conceptualizing and developing the manuscript, RGT drafted the manuscript, and AB and JSH substantively added to and edited the manuscript. All authors approved the final manuscript.
Funding
This work was made possible with support from Washington University in St. Louis CDTR (Grant Number P30DK092950 from the NIDDK), by the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 from the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH), and by National Cancer Institute of the NIH under award number P50CA244431 (Tabak and Baumann) and under P50CA244668 (Holtrop) and is a product of a Health Promotion and Disease Prevention Research Centers supported by Cooperative Agreement Number U48DP006395 from the Centers for Disease Control and Prevention. Dr. Holtrop is also funded on an intergovernmental personnel agreement with the Agency for Healthcare Research and Quality (AHRQ). Dr. Baumann is also supported by 3U01HL13399403S1 and 5U24HL136790 from the National Heart, Lung, and Blood Institute (NHLBI). This work was also supported by the Center for Dissemination and Implementation (CDI) at the Institute for Public Health at Washington University in St. Louis. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH, AHRQ, or the Centers for Disease Control and Prevention.
Availability of data and materials
Not applicable
Ethics approval and consent to participate
Not applicable
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Bauer MS, Damschroder L, Hagedorn H, Smith J, Kilbourne AM. An introduction to implementation science for the non-specialist. BMC Psychol. 2015;3:32. doi: 10.1186/s40359-015-0089-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Glasgow RE, Chambers DA, Cynkin L. News from the NIH: highlights in implementation science from the National Cancer Institute and the National Institute of Mental Health. Transl Behav Med. 2013;3(4):335–337. doi: 10.1007/s13142-013-0218-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Koh S, Lee M, Brotzman LE, Shelton RC. An orientation for new researchers to key domains, processes, and resources in implementation science. Transl Behav Med. 2020;10(1):179–185. doi: 10.1093/tbm/iby095. [DOI] [PubMed] [Google Scholar]
- 4.National Institutes of Health . NIH Policy on the Dissemination of NIH-Funded Clinical Trial Information. 2016. [Google Scholar]
- 5.Patient-Centered Outcomes Research Institute . PCORI Dissemination and Implementation Toolkit. 2015. [Google Scholar]
- 6.Patient-Centered Outcomes Research Institute. Understanding and Sharing Research Findings: Research Fundamentals Learning Package Module 5. Available from: https://www.pcori.org/engagement/research-fundamentals/understanding-sharing-research-findings. Accessed 28 Dec 2020.
- 7.National Science Foundation. Dissemination and Sharing of Research Results - NSF Data Management Plan Requirements. Available from: https://www.nsf.gov/bfa/dias/policy/dmp.jsp. Accessed 28 Dec 2020.
- 8.Proctor EK, Chambers DA. Training in dissemination and implementation research: a field-wide perspective. Transl Behav Med. 2017;7(3):624–635. doi: 10.1007/s13142-016-0406-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Jacob RR, Gacad A, Padek M, Colditz GA, Emmons KM, Kerner JF, et al. Mentored training and its association with dissemination and implementation research output: a quasi-experimental evaluation. Implement Sci. 2020;15(1):30. doi: 10.1186/s13012-020-00994-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Vinson CA, Clyne M, Cardoza N, Emmons KM. Building capacity: a cross-sectional evaluation of the US Training Institute for Dissemination and Implementation Research in Health. Implement Sci. 2019;14(1):97. doi: 10.1186/s13012-019-0947-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Chambers DA, Proctor EK, Brownson RC, Straus SE. Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs. Transl Behav Med. 2017;7(3):593–601. doi: 10.1007/s13142-016-0399-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Gonzales R, Handley MA, Ackerman S, O'Sullivan PS. A framework for training health professionals in implementation and dissemination science. Acad Med. 2012;87(3):271–278. doi: 10.1097/ACM.0b013e3182449d33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Straus SE, Brouwers M, Johnson D, Lavis JN, Legare F, Majumdar SR, et al. Core competencies in the science and practice of knowledge translation: description of a Canadian strategic training initiative. Implement Sci. 2011;6:127. doi: 10.1186/1748-5908-6-127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Darnell D, Dorsey CN, Melvin A, Chi J, Lyon AR, Lewis CC. A content analysis of dissemination and implementation science resource initiatives: what types of resources do they offer to advance the field? Implementation Science. 2017;12(1):137. doi: 10.1186/s13012-017-0673-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Gagliardi AR, Webster F, Straus SE. Designing a knowledge translation mentorship program to support the implementation of evidence-based innovations. BMC Health Serv Res. 2015;15:198. doi: 10.1186/s12913-015-0863-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Tabak RG, Padek MM, Kerner JF, Stange KC, Proctor EK, Dobbins MJ, et al. Dissemination and implementation science training needs: insights from practitioners and researchers. Am J Prev Med. 2017;52(3S3):S322–S3S9. doi: 10.1016/j.amepre.2016.10.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Padek M, Mir N, Jacob RR, Chambers DA, Dobbins M, Emmons KM, et al. Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach. Implement Sci. 2018;13(1):18. doi: 10.1186/s13012-018-0711-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Morrato EH, Rabin B, Proctor J, Cicutto LC, Battaglia CT, Lambert-Kerzner A, et al. Bringing it home: expanding the local reach of dissemination and implementation training via a university-based workshop. Implement Sci. 2015;10:94. doi: 10.1186/s13012-015-0281-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Stamatakis KA, Norton WE, Stirman SW, Melvin C, Brownson RC. Developing the next generation of dissemination and implementation researchers: insights from initial trainees. Implement Sci. 2013;8(1):29. doi: 10.1186/1748-5908-8-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Baumann AA, Carothers BJ, Landsverk J, Kryzer E, Aarons GA, Brownson RC, et al. Evaluation of the implementation research institute: trainees’ publications and grant productivity. Adm Policy Ment Health. 2020;47(2):254–264. doi: 10.1007/s10488-019-00977-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Padek M, Colditz G, Dobbins M, Koscielniak N, Proctor EK, Sales AE, et al. Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card sorts. Implement Sci. 2015;10:114. doi: 10.1186/s13012-015-0304-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Shea CM, Young TL, Powell BJ, Rohweder C, Enga ZK, Scott JE, et al. Researcher readiness for participating in community-engaged dissemination and implementation research: a conceptual framework of core competencies. Transl Behav Med. 2017;7(3):393–404. doi: 10.1007/s13142-017-0486-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Mallidou AA, Atherton P, Chan L, Frisch N, Glegg S, Scarrow G. Core knowledge translation competencies: a scoping review. BMC Health Serv Res. 2018;18(1):502. doi: 10.1186/s12913-018-3314-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Burnham JP, Geng E, Venkatram C, Colditz GA, McKay VR. Putting the dissemination and implementation in infectious diseases. Clin Infect Dis. 2020;71(1):218–225. doi: 10.1093/cid/ciz1011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Chinman M, Woodward EN, Curran GM, Hausmann LRM. Harnessing implementation science to increase the impact of health equity research. Med Care. 2017;55(Suppl 9 Suppl 2):S16–S23. doi: 10.1097/MLR.0000000000000769. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Emmons KM, Colditz GA. Realizing the potential of cancer prevention - the role of implementation science. N Engl J Med. 2017;376(10):986–990. doi: 10.1056/NEJMsb1609101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Powell BJ, Beidas RS. Advancing implementation research and practice in behavioral health systems. Adm Policy Ment Health. 2016;43(6):825–833. doi: 10.1007/s10488-016-0762-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Chambers DA, Feero WG, Khoury MJ. Convergence of implementation science, precision medicine, and the learning health care system: a new model for biomedical research. JAMA. 2016;315(18):1941–1942. doi: 10.1001/jama.2016.3867. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Bunger AC, Lengnick-Hall R. Implementation science and human service organizations research: opportunities and challenges for building on complementary strengths. Human Service Organizations: Management, Leadership & Governance. 2019;43(4):258–268. [Google Scholar]
- 30.Swindle T, Curran GM, Johnson SL. Implementation science and nutrition education and behavior: opportunities for integration. J Nutr Educ Behav. 2019;51(6):763–774. doi: 10.1016/j.jneb.2019.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Proctor EK, Powell BJ, Baumann AA, Hamilton AM, Santens RL. Writing implementation research grant proposals: ten key ingredients. Implement Sci. 2012;7:96. doi: 10.1186/1748-5908-7-96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Baumann AA, Morshed AB, Tabak RG, Proctor EK. Toolkits for dissemination and implementation research: preliminary development. J Clin Transl Sci. 2018;2(4):239–244. doi: 10.1017/cts.2018.316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Brownson RC, Proctor EK, Luke DA, Baumann AA, Staub M, Brown MT, et al. Building capacity for dissemination and implementation research: one university’s experience. Implement Sci. 2017;12(1):104. doi: 10.1186/s13012-017-0634-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Leppin AL, Mahoney JE, Stevens KR, Bartels SJ, Baldwin L-M, Dolor RJ, et al. Situating dissemination and implementation sciences within and across the translational research spectrum. J Clin Transl Sci. 2020;4(3):152–158. doi: 10.1017/cts.2019.392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Sampson UK, Chambers D, Riley W, Glass RI, Engelgau MM, Mensah GA. Implementation research: the fourth movement of the unfinished translation research symphony. Glob Heart. 2016;11(1):153–158. doi: 10.1016/j.gheart.2016.01.008. [DOI] [PubMed] [Google Scholar]
- 36.Lane-Fall MB, Curran GM, Beidas RS. Scoping implementation science for the beginner: locating yourself on the “subway line” of translational research. BMC Med Res Methodol. 2019;19(1):133. doi: 10.1186/s12874-019-0783-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Brownson RC, Fielding JE, Maylahn CM. Evidence-based public health: a fundamental concept for public health practice. Annu Rev Public Health. 2009;30:175–201. doi: 10.1146/annurev.publhealth.031308.100134. [DOI] [PubMed] [Google Scholar]
- 39.Kemp CG, Wagenaar BH, Haroz EE. Expanding hybrid studies for implementation research: intervention, implementation strategy, and context. Front Public Health. 2019;7:325. doi: 10.3389/fpubh.2019.00325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Newman SD, Andrews JO, Magwood GS, Jenkins C, Cox MJ, Williamson DC. Community advisory boards in community-based participatory research: a synthesis of best processes. Prev Chronic Dis. 2011;8(3):A70. [PMC free article] [PubMed] [Google Scholar]
- 41.Norton WE, Lungeanu A, Chambers DA, Contractor N. Mapping the growing discipline of dissemination and implementation science in health. Scientometrics. 2017;112(3):1367–1390. doi: 10.1007/s11192-017-2455-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.University of Washington . Implementation Science at UW: Implementation Science Resource Hub Seattle, WA. 2020. [Google Scholar]
- 43.Washington University in St. Louis . D&I Toolkits. 2020. [Google Scholar]
- 44.University of Colorado Anschutz Medical Campus . Adult and Child Consortium for Health Outcomes Research and Delivery Science (ACCORDS) 2020. [Google Scholar]
- 45.NCI Division of Cancer Control and Population Sciences. Research Tools 2020 [Available from: https://cancercontrol.cancer.gov/IS/tools/research.html#additional?platform=hootsuite.
- 46.The University of North Carolina at Chapel Hill. Implementation Science Exchange. Available from: https://impsci.tracs.unc.edu/. Accessed 28 Dec 2020.
- 47.VA Quality Enhancement Research Initiative (QUERI) QUERI – Quality Enhancement Research Initiative. 2014. [Google Scholar]
- 48.Consortium for Implementation Science . A Joint Endeavor of UNC Gillings School of Global Public Health and RTI International. Implementation Science News. 2020. [Google Scholar]
- 49.NCI Division of Cancer Control and Population Sciences . Training Institute for Dissemination and Implementation Research in Cancer (TIDIRC) OpenAccess. 2020. [Google Scholar]
- 50.University of Colorado Anschutz Medical Campus . Dissemination and Implementation (D&I) Science Certificate. 2020. [Google Scholar]
- 51.University of California San Francisco Department of Epidemiology & Biostatistics . Online Certificate in Implementation Science. 2020. [Google Scholar]
- 52.Indiana University School of Medicine Center for Health Innovation and Implementation Science. Innovation and Implementation Science (IIS) Graduate Certificate. Available from: https://hii.iu.edu/education/iis-graduate-certificate.html. Accessed 28 Dec 2020.
- 53.Washington University in St. Louis. Institute for Implementation Science Scholars (IS-2) 2020. Available from: https://is2.wustl.edu/. Accessed 28 Dec 2020.
- 54.Penn Medicine. Master of Science in Health Policy Research: Implementation Science Institute 2018. Available from: https://mshp.med.upenn.edu/implementation-science-institute. Accessed 28 Dec 2020.
- 55.NIH National Heart L, and Blood Institute,. Building the workforce to translate discoveries into health (NHLBI K-12 grants) 2017. Available from: https://www.nhlbi.nih.gov/news/2017/building-workforce-translate-discoveries-health. Accessed 28 Dec 2020.
- 56.Ford B, Rabin B, Morrato EH, Glasgow RE. Online resources for dissemination and implementation science: meeting demand and lessons learned. J Clin Transl Sci. 2018;2(5):259–266. doi: 10.1017/cts.2018.337. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Williford WO, Krol WF, Bingham SF, Collins JF, Weiss DG. The multicenter clinical trials coordinating center statistician:“More than a consultant”. Am Statistician. 1995;49(2):221–225. [Google Scholar]
- 58.Cabrera J, McDougall A. Statistical consulting: Springer Science & Business Media. 2013. [Google Scholar]
- 59.Hall KL, Vogel AL, Stipelman BA, Stokols D, Morgan G, Gehlert S. A four-phase model of transdisciplinary team-based research: goals, team processes, and strategies. Transl Behavioral Med. 2012:1–16. [DOI] [PMC free article] [PubMed]
- 60.Hall KL, Stokols D, Stipelman BA, Vogel AL, Feng A, Masimore B, et al. Assessing the value of team science: a study comparing center- and investigator-initiated grants. Am J Prev Med. 2012;42(2):157–163. doi: 10.1016/j.amepre.2011.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Stokols D, Misra S, Moser RP, Hall KL, Taylor BK. The ecology of team science: understanding contextual influences on transdisciplinary collaboration. Am J Prev Med. 2008;35(2 Suppl):S96–115. doi: 10.1016/j.amepre.2008.05.003. [DOI] [PubMed] [Google Scholar]
- 62.Hall KL, Rossi JS. Meta-analytic examination of the strong and weak principles across 48 health behaviors. Prev Med. 2008;46(3):266–274. doi: 10.1016/j.ypmed.2007.11.006. [DOI] [PubMed] [Google Scholar]
- 63.National Cancer Institute at the National Institutes of Health. Team Science Toolkit [Available from: https://www.teamsciencetoolkit.cancer.gov/public/Home.aspx.
- 64.Hall KL, Vogel AL, Croyle RT. Strategies for team science success: handbook of evidence-based principles for cross-disciplinary science and practical lessons learned from health researchers: Springer Nature. 2019. [Google Scholar]
- 65.Gilliland CT, White J, Gee B, Kreeftmeijer-Vegter R, Bietrix F, Ussi AE, et al. The fundamental characteristics of a translational scientist. ACS Pharmacol Transl Sci. 2019;2(3):213–216. doi: 10.1021/acsptsci.9b00022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Brownson RC, Colditz GA, Dobbins M, Emmons KM, Kerner JF, Padek M, et al. Concocting that magic elixir: successful grant application writing in dissemination and implementation research. Clin Transl Sci. 2015;8(6):710-6. 10.1111/cts.12356. Epub 2015 Nov 18. [DOI] [PMC free article] [PubMed]
- 67.Crable EL, Biancarelli D, Walkey AJ, Allen CG, Proctor EK, Drainoni ML. Standardizing an approach to the evaluation of implementation science proposals. Implement Sci. 2018;13(1):71. doi: 10.1186/s13012-018-0770-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Stevens ER, Shelley D, Boden-Albala B. Unrecognized implementation science engagement among health researchers in the USA: a national survey. Implementation Science Communications. 2020;1:1–9. doi: 10.1186/s43058-020-00018-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Stevens ER, Shelley D, Boden-Albala B. Barriers to engagement in implementation science research: a national survey. Transl Behav Med. 2020;ibz193. 10.1093/tbm/ibz193. Online ahead of print. [DOI] [PubMed]
- 70.Koorts H, Naylor P-J, Laws R, Love P, Maple J-L, van Nassau F. What hinders and helps academics to conduct Dissemination and Implementation (D&I) research in the field of nutrition and physical activity? An international perspective. International Journal of Behavioral Nutrition and Physical Activity. 2020;17(1):7. doi: 10.1186/s12966-020-0909-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Not applicable