Table 4.
CPCRN scholars baseline D&I experience and competencies
| N (%) | |||
|---|---|---|---|
| Overall experience (N = 20) | Beginner | Intermediate | Advanced |
| How would you rate your overall level of experience with dissemination and implementation science? | 13 (65%) | 7 (35%) | 0 (0%) |
| Competencies (N = 19) | Beginner | Intermediate | Advanced |
| Section A: Definition, Background, and Rationale | |||
| A1: Define and communicate D&I research terminology | 9 (47.4) | 8 (42.1) | 2 (10.5) |
| A2: Define what is and what is not D&I research | 8 (42.1) | 9 (47.4) | 2 (10.5) |
| A3: Differentiate between D&I research and other related areas, such as efficacy research and effectiveness research | 10 (52.6) | 8 (42.1) | 1 (5.3) |
| A4: Identify the potential impact of disseminating, implementing, and sustaining effective interventions | 7 (36.8) | 9 (47.4) | 3 (15.8) |
| A5: Describe the range of expertise needed to conduct D&I research (e.g., mixed method experience, economic, organization, policy, clinical) | 11 (57.9) | 7 (36.8) | 1 (5.3) |
| A6: Determine which evidence-based interventions are worth disseminating and implementing | 7 (36.8) | 11 (57.9) | 1 (5.3) |
| A7: Assess, describe, and quantify (where possible) the context for effective D&I (setting characteristics, culture, capacity and readiness) | 11 (57.9) | 7 (36.8) | 1 (5.3) |
| A8: Identify existing gaps in D&I research | 12 (63.1) | 6 (31.6) | 1 (5.3) |
| A9: Identify the potential impact of scaling down (aka de-implementing) an ineffective but often used intervention | 16 (84.2) | 1 (5.3) | 2 (10.5) |
| A10: Formulate methods to address barriers of D&I research | 15 (79) | 2 (10.5) | 2 (10.5) |
| Section B: Theory and Approaches | |||
| B1: Describe a range of D&I strategies, models, and frameworks | 6 (31.6) | 12 (63.1) | 1 (5.3) |
| B2: Identify appropriate conceptual models, frameworks, or program logic for D&I change | 11 (57.9) | 7 (36.8) | 1 (5.3) |
| B3: Identify core elements (effective ingredients) or effective interventions and recognize risks of making modifications to these | 13 (68.4) | 5 (26.3) | 1 (5.3) |
| B4: Describe a process for designing for dissemination (planning for adoption, implementation, and sustainability during the intervention development stage) | 12 (63.1) | 7 (36.8) | 0 (0) |
| B5: Describe the relationships between various organization dimensions (e.g., climate, culture) and D&I research | 14 (73.7) | 5 (26.3) | 0 (0) |
| B6: Explain how knowledge from disciplines outside of health (e.g., business, marketing and engineering) can help inform further transdisciplinary efforts in D&I research | 12 (63.1) | 6 (31.6) | 1 (5.3) |
| B7: Identify and articulate the interplay between policy and organizational processes in D&I | 16 (84.2) | 2 (10.5) | 1 (5.3) |
| Section C: Design & Analysis | |||
| C1: Describe the core components of external validity and their relevance to D&I research | 9 (47.4) | 9 (47.4) | 1 5.3) |
| C2: Identify common D&I measures and analytic strategies relevant for your research question(s) | 12 (63.1) | 6 (31.6) | 1 (5.3) |
| C3: Identify and measure outcomes that matter to stakeholders, adopters, and implementers | 10 (52.7) | 7 (36.8) | 2 (10.5) |
| C4: Describe the application and integration of mixed-method (quantitative and qualitative) approaches in D&I research | 10 (52.7) | 7 (36.8) | 2 (10.5) |
| C5: Apply common D&I measures and analytic strategies relevant for your research question(s) within your model/framework | 14 (73.7) | 5 (26.3) | 0 (0) |
| C6: Identify possible methods to address external validity in study design reporting and implementation | 12 (63.1) | 7 (36.8) | 0 (0) |
| C7: List the potential roles of mediators and moderators in a D&I study | 14 (73.7) | 5 (26.3) | 0 (0) |
| C8: Identify and articulate the trade-offs between a variety of different study design for D&I research | 13 (68.4) | 5 (26.3) | 1 (5.3) |
| C9: Describe how to frame and analyze the context of D&I as a complex system with interacting parts | 15 (78.9) | 3 (15.8) | 1 (5.3) |
| C10: Effectively integrate the concepts of sustainability/sustainment and the rationale behind them in D&I study design | 15 (78.9) | 3 (15.8) | 1 (5.3) |
| C11: Describe gaps in D&I measurement and critically evaluate how to fill them | 15 (78.9) | 3 (15.8) | 1 (5.3) |
| C12: Effectively explain and incorporate concepts of de-adoption and de-implementation into D&I study design | 17 (89.5) | 2 (10.5) | 0 (0) |
| C13: Incorporate methods of economic evaluation (e.g., implementation costs, cost-effectiveness) in D&I study design | 15 (78.9) | 3 (15.8) | 1 (5.3) |
| C14: Evaluate and refine innovative scale-up and spread methods (e.g., technical assistance, interactive systems, novel incentives, and “pull” strategies) | 17 (89.5) | 2 (10.5) | 0 (0) |
| Section D: Practice-Based Considerations | |||
| D1: Describe the importance of incorporating the perspectives of different stakeholder groups (e.g., patient/family, employers, payers, healthcare settings, public organizations, community, and policy makers) | 4 (21.1) | 12 (63.1) | 3 (15.8) |
| D2: Describe the concept and measurement of fidelity | 7 (36.8) | 11 (57.9) | 1 (5.3) |
| D3: Articulate the strengths and weaknesses of participatory research in D&I research | 10 (52.7) | 8 (42.1) | 1 (5.3) |
| D4: Determine when engagement in participatory research is appropriate with D&I research | 13 (68.4) | 5 (26.3) | 1 (5.3) |
| D5: Describe the appropriate process for eliciting input from community-based practitioners for adapting and intervention | 10 (52.7) | 8 (42.1) | 1 (5.3) |
| D6: Identify and apply techniques for stakeholder analysis and engagement when implementing evidence-based practices | 14 (73.7) | 5 (26.3) | 0 (0) |
| D7: Identify a process for adapting an intervention and how the process in relevant to D&I research | 12 (63.1) | 7 (36.8) | 0 (0) |
| D8: Explain how to maintain fidelity of original interventions during the adaption process | 16 (84.2) | 3 (15.8) | 0 (0) |
| D9: Identify sites to participate in D&I studies and negotiate or provide incentives to secure their involvement | 11 (57.9) | 7 (36.8) | 1 (5.3) |
| D10: Identify and develop sustainable partnerships for D&I research | 11 (57.9) | 8 (42.1) | 0 (0) |
| D11: Describe how to measure successful partnerships for D&I research | 15 (78.9) | 4 (21.1) | 0 (0) |
| D12: Use evidence to evaluate and adapt D&I strategies for specific populations, settings, contexts, resources, and/or capacities | 15 (78.9) | 3 (15.8) | 1 (5.3) |