Abstract
Objectives: Implementation science is key to translating complementary and integrative health intervention research into practice as it can increase accessibility and affordability while maximizing patient health outcomes. The authors describe using implementation mapping to (1) identify barriers and facilitators impacting the implementation of an Integrative Medical Group Visit (IMGV) intervention in an outpatient setting with a high burden of patients with chronic pain and (2) select and develop implementation strategies utilizing theory and stakeholder input to address those barriers and facilitators.
Design: The authors selected a packaged, evidence-based, integrative pain management intervention, the IMGV, to implement in an outpatient clinic with a high burden of patients with chronic pain. The authors used implementation mapping to identify implementation strategies for IMGV, considering theory and stakeholder input. Stakeholder interviews with clinic staff, faculty, and administrators (n = 15) were guided by the Consolidated Framework for Implementation Research.
Results: Based on interview data, the authors identified administrators, physicians, nursing staff, and scheduling staff as key stakeholders involved in implementation. Barriers and facilitators focused on knowledge, buy-in, and operational procedures needed to successfully implement IMGV. The implementation team identified three cognitive influences on behavior that would impact performance: knowledge, outcome expectations, and self-efficacy; and three theoretical change methods: cue to participate, communication, and mobilization. Implementation strategies identified included identifying and preparing champions, participation in ongoing training, developing and distributing educational materials, and organizing clinician implementation team meetings.
Conclusions: This study provides an example of the application of implementation mapping to identify theory-driven implementation strategies for IMGV. Implementation mapping is a feasible method that may be useful in providing a guiding structure for implementation teams as they employ implementation frameworks and select implementation strategies for integrative health interventions.
Keywords: implementation science, Integrative Medical Group Visits, integrative pain management, Implementation Mapping, implementation strategies
Introduction/Background
Implementation science in complementary and integrative health interventions
The National Center for Complementary and Integrative Health has invested heavily into rigorously evaluating health interventions, many of which target chronic pain.1 While growth of the evidence base has prompted widespread implementation of complementary and integrative health interventions within the Veteran's Health Administration,2 civilian health care settings have not seen the same therapeutic shifts, leaving many efficacious treatments inaccessible to populations at risk for chronic pain.3 Implementation science methods are ideally suited to translating complementary and integrative health intervention research into more widespread practice.4 Implementation science has been defined as the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice and, hence, to improve the quality and effectiveness of health services and care.5 Increasingly, the National Center for Complementary and Integrative Health is expressing interest in growing their implementation science portfolio.6
Integrative pain management (IPM) interventions include a range of complementary and integrative health therapies such as mindfulness, yoga, Tai Chi, qigong, and other noninvasive techniques.7–10 Many of these approaches are proven to be just as effective, if not more so, in managing chronic pain symptoms compared with other self-care therapies.11 Several IPM interventions are now recommended as first-line treatments in clinical guidelines for chronic pain conditions, and the Joint Commission has required that accredited health care facilities provide IPM therapies.12,13 Yet, biomedical health care systems' provision of IPM therapies is limited by the absence of staff with expertise in IPM and lack of remuneration for the delivery of many IPM services.14 For instance, in most cases, neither public nor private insurance fully covers therapies such as mindfulness-based stress reduction, yoga, Tai Chi, and massage.15 The current challenge is how to best overcome these challenges to promote and support the implementation of IPM interventions into widespread practice.
The production of evidence alone does not directly lead to the uptake of new interventions, and there is a significant gap (up to 17 years) between generation of research findings and their translation to patient care.16 Implementation science offers methods, theories, and frameworks to help close the gap between research and practice. This gap is addressed by developing and testing implementation strategies that specifically target the educational, financial, logistical, organizational, and structural barriers to a new intervention. Implementation science methods marry rigorously researched interventions with the development of strategies needed to incorporate interventions into health care settings. When effective, implementation strategies improve access to evidence-based interventions.
Implementation mapping
Implementation science distinguishes between interventions (also referred to as evidence-based interventions or the “thing” being implemented) and implementation strategies (which are used to facilitate the uptake of the intervention).17 Implementation strategies describe how interventions are applied in a clinical setting,18 detailing logistical measures such as how to recruit participants into an intervention, who should be responsible for running the intervention, and how the intervention should be maintained. Implementation strategies facilitate optimal incorporation by targeting barriers such as provider attitudes, patient knowledge, community norms, organizational policies, and finances.19 Implementation scientists have developed frameworks aimed at characterizing barriers and facilitators to implementation (e.g., the Consolidated Framework for Implementation Research [CFIR])20 and compilations of implementation strategies for use in targeting those barriers and facilitators (e.g., Expert Recommendations for Implementing Change compilation [ERIC]).21 However, the field has not achieved consensus on which implementation strategies should be used to address specific barriers or facilitators.22 Implementation mapping offers a systematic process for selecting the implementation strategies needed to overcome barriers to implementation by considering relevant behavioral theories and stakeholder input.23 Utilizing a systematic process enhances replicability, while utilizing relevant theory enhances the potential to identify mechanisms of action of implementation strategies. Both replication and identifying mechanisms are key to enhancing the rigor of implementation science.22
Implementation mapping is based upon and closely mirrors intervention mapping, a process for designing health behavior interventions. This method typically involves five tasks: (1) construct a needs assessment that identifies barriers and facilitators as well as actors who will address those barriers and facilitators; (2) state steps to implementation; (3) select and design implementation strategies; (4) produce implementation strategy materials; and (5) assess implementation outcomes.19 Using implementation mapping, researchers first engage with stakeholders (such as clinicians, health care employees, or community members) to identify implementation barriers and recognize facilitators at multiple levels. Following stakeholder engagement, steps to implementation are developed that clearly specify who needs to do what to address the identified barriers and facilitators. Relevant behavioral theories are then identified and the implementation team (engaging both research and practice stakeholders) begins to select and design implementation strategies to build on the selected theories to overcome barriers and identify the steps to implementation. Finally, implementation strategies are executed and evaluated. The implementation mapping process is iterative and allows the implementation team to construct and review implementation strategies based on literature, behavioral theories, and stakeholder input.
Implementation science can support the adoption of IPM therapies in diverse settings; however, it has not been extensively described within the scope of complementary and integrative health.24 Prior research suggests that multiple factors impede the implementation of IPM interventions,25 yet little work has been done to systematically identify implementation strategies for IPM. In this article, the authors provide a model of how implementation science techniques can be applied to the study of IPM interventions. The authors describe using implementation mapping tasks 1–4 to (1) identify factors impacting the implementation of an IPM intervention—the Integrative Medical Group Visit (IMGV)—in an outpatient setting and (2) select and develop implementation strategies to address those factors. In the fifth task of implementation mapping, the implementation strategies developed here will be evaluated for feasibility and acceptability in a pilot study.
Materials and Methods
The authors selected a packaged, evidence-based IPM intervention, the IMGV, to implement in an outpatient clinic with a high burden of patients with chronic pain. Patients at the clinic had previously expressed the desire for increased access to complementary and integrative health services, and leadership at the clinical site was interested in developing IPM services that could be billed to patients' insurance.26 IMGV is one of few IPM interventions that is widely reimbursable and was therefore selected as part of a larger effort to develop a financially sustainable Integrative Medicine Clinic.27 In this study, the authors describe the IMGV intervention and implementation mapping process used to identify relevant implementation strategies. This project was reviewed by the Institutional Review Board of the University of North Carolina at Chapel Hill, protocol number 20-0147. The Institutional Review Board determined that these activities did not meet criteria for human subject research under federal regulations and therefore did not require approval.
Integrative Medical Group Visits
The IMGV is an innovative approach to IPM combining a medical group visit format, mindfulness-based stress reduction, pain education, acupressure, self-massage, and other evidence-based, integrative medicine therapies for patients with chronic pain in a billable model.28–31 IMGVs usually consist of 8 to 12 patients meeting as a group in the same room and are run by a billing clinician (MD, DO, NP, or PA) and a mind–body instructor (mindfulness-based stress reduction teacher or yoga instructor). During the visits, the clinician provides program participants with individualized medical attention, education, self-management, self-monitoring, and support, while the mind–body instructor guides experiential activities.
IMGVs significantly reduce emergency department visits among patients with chronic pain, decrease pain medication usage, and increase patient mental and emotional well-being.32 IMGV participants may experience a greater amount of social and emotional support than they would in individualized medical appointments and often report a greater quality of life.33 Clinicians consistently report that group medical visit programs allow them to participate in a community of support, develop more personal relationships with their patients, and gain insight from patients with chronic conditions.34
IMGV allows a diverse group of patients to access integrative therapies in a format covered by insurance. The IMGV for chronic pain is one of few efficacious IPM interventions to address the lack of access to complementary and integrative health therapies due to financial barriers; however, it has been only minimally implemented.27,35
Implementation mapping
The authors used implementation mapping tasks 1–4 to identify implementation strategies for IMGV while considering theory and stakeholder input (Fig. 1). The principal investigator (I.J.R.) led the implementation mapping process in partnership with an engaged team of both research and practice-based stakeholders. The team included a physician trained in qualitative methods, a senior implementation scientist, a physician/researcher who developed the IMGV, a physician trained in IPM, three IPM researchers, and a research assistant.
FIG. 1.
Implementation mapping for IMGV. Implementation mapping consists of five tasks aimed at selecting and evaluating relevant implementation strategies using relevant theory and stakeholder input. IMGV, Integrative Medical Group Visit.
Task 1. Identify barriers and facilitators to IMGV implementation
In the first task, the authors assessed the needs of the clinical context, identified program adopters and implementers, and identified potential barriers and facilitators to IMGV implementation. The planning team held a brainstorming session to identify the following: 1) Who will be involved in making the decision to adopt IMGV? 2) Who will implement the program? Who will be involved in implementation? Who will the implementation impact? While originally planned to be informal and conducted in person, due to the COVID-19 pandemic, all interviews were scheduled in advance and conducted through Zoom teleconference. After identifying a list of potential stakeholders, the authors sent e-mail invitations for virtual interviews to 22 stakeholders. Semistructured interviews with clinicians, staff, and administrators (n = 15) were conducted. Nonrespondents included six clinicians and one staff member. Participants included eight clinicians, three staff members, and four administrators. All interviews were conducted in English, recorded, and no compensation was provided to participants for their participation. All interviews were conducted at one clinical site.
The authors developed an interview guide informed by the CFIR, an implementation framework used to identify multilevel factors (i.e., determinants) that may influence successful implementation.36 The CFIR organizes determinants within five domains or levels: characteristics of intervention, the individuals who will implement the intervention, the setting where those individuals work (inner setting), the wider community and regulatory context (outer setting), and the process of implementation.37 Understanding the practice context informs the development and selection of implementation strategies and can lead to more effective implementation efforts.38
The interview guide focused on the CFIR domains of the outer setting, inner setting, and process. Questions were related to the following CFIR constructs: Patient Needs and Resources (outer setting), Culture, Networks and Communication, Goals and Feedback, Learning Climate, Relative Priority, Tension for Change, Structural Characteristics, and Compatibility (inner setting), as well as Engaging Opinion Leaders (process). Additional questions addressed current treatments for chronic pain patients, prescription drug reliance, and demographic information about the interviewee (Supplementary Appendix SA1). The implementation team reviewed interview questions and the recruitment e-mail before sending them out to potential participants. Interviews were then conducted through online video conferences or phone calls. Snowball sampling based on interviewee responses was used to identify additional key stakeholders to be interviewed. The responses were transcribed, uploaded into ATLAS.ti Cloud, a qualitative data management software,39 and double-coded by two experienced qualitative researchers. Both deductive codes from the CFIR codebook and inductive codes were used. Specific barriers, facilitators, and suggestions for implementation were extracted by the qualitative researchers and presented to the rest of the implementation team for discussion.
Task 2. State steps to implementation
In the second task, the implementation team reviewed the barriers and facilitators identified in task 1 and prioritized those most critical to successful implementation. All implementation team members were involved in this discussion. The team then matched barriers and facilitators identified through stakeholder interviews to steps to implementation, specifying who would need to do what to implement the IMGV into routine practice.
Task 3. Design implementation strategy components
The third task consisted of selecting and designing implementation strategies to achieve the steps to implementation and address the prioritized barriers and facilitators. The team selected two theories as most relevant to the identified barriers and facilitators: social cognitive theory and diffusion of innovations theory.40 The authors drew on these theories to identify broad methods that target identified barriers/facilitators. For example, education can be used to target a gap in knowledge. They then drew on existing taxonomies of implementation strategies to operationalize broad methods into more specific strategies such as educational meetings and materials from the ERIC taxonomy of implementation strategies.21
Task 4. Executing implementation strategies
In task 4, the protocols and materials needed to execute the identified implementation strategies were created through open collaboration with the implementation team and then distributed to stakeholders responsible for successful implementation. Tasks specified by the implementation strategies were delegated and executed. Evaluation of the implementation strategies occurs in task 5 of implementation mapping and includes interviews with patients and the implementation team. These activities are underway and will be reported on in future articles.
Results
The authors present results by implementation mapping task, explaining how the qualitative findings informed by the CFIR guided the process of identifying implementation strategies for IMGV.
Task 1. Identify barriers and facilitators to IMGV implementation
The authors began by identifying key stakeholders for adoption and implementation of the IMGV within the clinical setting. One of the implementation team members is a physician who agreed to lead clinical implementation of the IMGV. Based on their planning meetings, the authors determined that clinic administrators would be key actors making decisions about adoption. Clinic administrators include the clinic's Medical Director and Financial Administrator. In the qualitative analysis, CFIR codes included Key Stakeholders, Opinion Leaders, and Champions. Administrators, physicians, nursing staff, and scheduling staff were identified as key stakeholders involved in implementation.
Qualitative findings from semistructured interviews related to implementation included the following CFIR codes: Needs and Resources of Patients, Culture, Implementation Climate, Relative Priority, Networks and Communication, and Knowledge and Beliefs about the Intervention. The authors utilized these data to develop a prioritized list of barriers and facilitators to implementation, specifying the actors involved (Table 1). Barriers and facilitators focused on clinician and staff familiarity with the IMGV, including knowledge, buy-in, and operational processes needed to deliver IMGV.
Table 1.
Prioritized Barriers and Facilitators to Implementation
| Actors needed to address | Stakeholders who suggested | |
|---|---|---|
| Facilitators | ||
| Clinical facilitator buy-in to deliver IMGV | Clinical facilitator | Clinicians |
| Willingness to refer patients to IMGV | Clinicians | Clinicians |
| Clinical facilitator's knowledge of IMGV eligibility | Clinical facilitator | Clinicians |
| Cofacilitator's preparation to lead IMGV | Clinical facilitator and mind–body facilitator (cofacilitators) | Clinicians |
| Technical capacity to deliver group through telehealth or clinical space to deliver groups in person | Information technology professional and group visit coordinator | Staff |
| Cofacilitator availability to conduct IMGV during clinical hours | Clinical facilitator and mind–body facilitator (cofacilitators) | Clinicians |
| Regular communication with key personnel | Clinical facilitator, mind–body facilitator, and group visit coordinator (program champions) | Administrators, staff, and clinicians |
| Barriers | ||
| Stakeholders' lack of familiarity with IMGV | Administrators, clinicians, and staff | Clinicians, staff, and administrators |
| Lack of a simple electronic referral process | Clinicians and schedulers | Clinicians and staff |
| Lack of process to schedule multiple patients at once | Schedulers | Administrators and staff |
| Nursing staff not trained in checking in patients for groups | Nursing staff | Clinicians and staff |
| Patients' lack of familiarity with telehealth platforms (virtual delivery only) | Information technology professional and group visit coordinator | Clinicians and staff |
Data from qualitative interviews with key stakeholders were used to identify barriers and facilitators to IMGV implementation in the clinical site. Actors needed to address barriers and facilitators are specified, as well as stakeholders who suggested each barrier or facilitator.
IMGV, Integrative Medical Group Visit.
Knowledge or familiarity with the IMGV was noted as key to obtaining buy-in. All participants involved in direct clinical care were supportive of the purpose of the intervention and expressed that the stated goals of the IMGV aligned with their clinical goals for patients with chronic pain. Clinicians and staff expressed a lack of familiarity with details of IMGV and lack of confidence to explain the program to potential participants, noting that educational activities for clinicians and staff would be key to implementation efforts.
All stakeholders interviewed noted that leadership buy-in, from both the Medical Director and Financial Administrator, would be key to successful implementation. Other opinion leaders included the clinic's Nurse Manager and the Scheduling Staff Manager. Stakeholders noted that for IMGV implementation to be successful, clinicians would need to steadily refer patients with chronic pain to the IMGV, and this would require clinician buy-in as well.
Operational processes were also prioritized for successful implementation of IMGV. Clinicians noted that a simple electronic referral process would facilitate patient referrals to IMGV and that determining a clinical workflow would also be essential. The clinic had no prior experience running group medical visits, therefore stakeholders anticipated that new scheduling and check-in procedures would need to be determined. Finally, stakeholders emphasized the need for frequent communication and input as new procedures were being developed.
Task 2. State steps to implementation
The authors' prioritized list of barriers and facilitators was used to inform the development of steps to implementation and behavioral determinants for implementation. Steps to implementation specified outcomes needed to be achieved to address prioritized barriers and facilitators (Table 2). These include actions to be performed by both the clinical facilitator of the IMGV (in this case, a physician) and the mind–body facilitator (referred to as cofacilitators), including agreeing to implement IMGV and attend training, determining IMGV participant eligibility criteria, reviewing the IMGV manual, preparing to lead IMGV, scheduling IMGV sessions, reserving space or a telehealth platform, and communicating regularly with stakeholders. For nursing staff and other clinical stakeholders, steps included developing an understanding of IMGV and willingness to refer participants. Both scheduling staff and information technology professionals are needed to secure an electronic referral process and scheduling template for IMGV.
Table 2.
Steps to Implementation and Supporting Qualitative Data
| Steps to implementation | Supporting qualitative data |
|---|---|
| Step 1. Cofacilitators agree to implement the program and attend the IMGV training. | Cofacilitators agreed to implement the program and attended the IMGV training before interviews. |
| Step 2. Clinical staff/stakeholders demonstrate a thorough understanding of the IMGV. | “Education for our staff as a clinic—for them to know and understand what the program is going to be offering so that they can better talk to patients about it or better know what's happening. If they don't understand it, they're not going to be as well equipped to support it.” – Administrator_1 |
| “Sharing the information and creating an awareness to providers that this program exists so that we can pass that information on to patients who we think would be appropriate.” – Administrator_2 | |
| “The more education we can do, the more marketing and the more research you can share behind some of these visits, the better… just to get them to understand, to know more about how this can help their patients.” – Administrator_3 | |
| Step 3. Clinicians/information technology professionals identify the electronic referral process. | “Do you know if this would be set up in EPIC [electronic health record] where we would order a referral, or how logistically it would happen?… Yeah, I think the fewer steps you can get it to be the better.” – Clinician_8 |
| Step 4. Clinicians refer patients to IMGV. | “…the physicians who are actually going to make the referrals. So that's going to be me and [another physician] as the two who see the most chronic pain people. That's also going to be [other physicians]. They should be able to send you a lot of patients, too.” – Clinician_1 |
| “It depends on how open people are to referring people and advertising and getting people to come to the program. I think it depends on the provider.” – Clinician_2 | |
| Step 5. Clinical facilitator determines eligibility for IMGV. | “Some people just don't do well in groups or there's personality conflicts that could happen.” – Clinician_3 |
| “From the patient's point of view, I think there is a strong need but only if we can find the patients who can take advantage of what they are going to learn and have the time and resources to do so.” – Clinician_1 | |
| “It's going to be entirely dependent on whether the patient is extroverted enough to do it or not… I think patients are going to have a difficult time finding the time for it. So that's going to be one barrier. I think if they can make it to every session, they would be potentially well rewarded from it.” – Staff_1 | |
| “You are going to have to be selective in who you choose… some folks may absolutely not do well in a group setting.” – Clinician_5 | |
| Step 6. Cofacilitators review the manual and prepare to lead IMGV (having future cofacilitators sit in). | “I think it would have to be more fined tuned. Like what my role would be and what I would talk about… I'm assuming that each of the visits is going to have maybe one overarching theme.” – Clinician_5 |
| “I don't really know what goes on in integrative group visits. I would be interested in participating in it and maybe observing some of them initially.” – Clinician_6 | |
| Step 7. Cofacilitators secure and reserve space/telehealth platform. | “One of the struggles I was having the last time we talked about this program was nailing it down to a day and a time where we were actually going to be able to get the conference room reserved.” – Administrator_1 |
| “In the last nine weeks it has been crazy the strides we have seen as far as some of the [telehealth] platforms we are using.” – Staff_1 | |
| “If things can't be run out of the conference room—it's really understanding of what type of space is really needed for these group visits.” –Administrator_3 | |
| Step 8. (Telehealth only) Cofacilitators conduct a practice session with participants to introduce the telehealth platform. | “So hopefully these are folks who have already had a virtual visit which is nice so they'll know how to do it.” – Clinician_3 |
| “…making sure you feel comfortable navigating the [video conference platform] and that type of thing. So maybe running a session or so of how it will be done.” – Staff_1 | |
| “You may want to train people with how to interact online, and not just in a group setting. You put out the basic rules of the room: everyone takes turns, listens to the other person, you may have to have some virtual need for some virtual rules as well.” –Administrator_4 | |
| Step 9. Cofacilitators reserve time in the clinical schedule for group visits. | “I do think the scheduling piece may be tricky… I'll be surprised if I can have six patients scheduled at six o'clock. I'm guessing they'll have to spread them out a little bit.” – Clinician_3 |
| Step 10. Scheduling staff open the clinic schedule for up to 10 patients. | “For the front desk staff to even be willing to assist with scheduling took some time, but it did eventually happen.” – Clinician_7 |
| “If everyone is coming in at once and getting checked in at once, I see that being a concern from the front desk and any sort of additional clinical aid…the same thing could happen at check out if they don't have all of their visits scheduled ahead of time or over the phone. If ten people get up and all walk out to check out at the front desk… again, that's a bottleneck there so I guess that's probably my biggest concern: getting patients in and out.” – Clinician_6 | |
| Step 11. Nursing staff implements the IMGV check-in process. | “Be concise on what you want…Just knowing what days and hours and what is expected of us. That's all we ask. Basically, tell us what you want to happen, and let's do it.” – Staff_2 |
| “Well, not other than if it was just a massive check-in or if I was havin’ to do blood pressures and we're still on one person. As long as they could do it, then that would be—or one of you guys could do it as they come in.” – Staff_3 | |
| Step 12. Cofacilitators communicate regularly with stakeholders. | “Well, for it to succeed is just for everybody to be on the same page. All of you guys be on the same page and then the people that's comin’ into it on the same page.” – Staff_3 |
| “If there's enough information that's changing or updates, on a weekly basis would be great, having a weekly summary, but if that's too often, I think biweekly updates would be helpful, just to keep us in a loop of what's going on, ways we can help, things we need to look at as well. We like to share updates within our staff meeting and just ways to continue to keep our clinic staff in the loop as well, what's going on, what's working, what's not working.” – Administrator_3 |
Steps to implementation are specified based on qualitative data from semistructured interviews with key stakeholders.
IMGV, Integrative Medical Group Visit.
After developing steps to implementation, the authors identified behavioral determinants and change methods from the social cognitive theory41 and the diffusion of innovations theory.42 They identified three cognitive influences on behavior (knowledge, outcome expectations, and self-efficacy) and three change methods (cue to participate, communication, and mobilization) that could be employed to shift behavior and performance. Change targets are described in Supplementary Appendix SA2.
Task 3. Design implementation strategy components
After specifying steps to implementation, determinants, and theory-derived change methods, the implementation team identified specific implementation strategies. Because interviews were conducted during the COVID-19 pandemic, implementation strategies were designed to be conducted either in person or virtually (with some activities specified as telehealth-only). The ERIC implementation strategy taxonomy21 was used to help identify implementation strategies and included identifying and preparing champions, participating in ongoing training, developing and distributing educational materials, and organizing clinician implementation team meetings. Implementation strategies were organized by stage of implementation, actor, determinants, and theoretical change methods. The implementation strategies are outlined in Table 3.
Table 3.
Integrative Medical Group Visit Implementation Strategy Plan
| IMGV implementation strategy plan | ||||
|---|---|---|---|---|
| Stage | Actors | Determinants | Theoretical change methods | Implementation strategies |
| Implementation | Cofacilitators | Knowledge, self-efficacy, and outcome expectations | Mobilization | Cofacilitators attend the IMGV training |
| Implementation | Cofacilitators and staff | Knowledge, self-efficacy, and outcome expectations | Communication | Clinicians/informational technology professional identify the electronic referral process |
| Implementation | Cofacilitators and staff | Knowledge, self-efficacy, and outcome expectations | Cue to participate, communication | Create and disseminate the flyer with IMGV description and clear referral process instructions |
| Implementation | Cofacilitators and other clinicians | Knowledge, self-efficacy, and outcome expectations | Communication | Cofacilitators meet with/present to referring departments/clinicians |
| Implementation | Cofacilitators | Knowledge, self-efficacy, and outcome expectations | Clinical facilitator meets with potential patients individually and determines eligibility for IMGV (based on IMGV facilitator manual criteria) | |
| Implementation | Cofacilitators | Knowledge, self-efficacy, and outcome expectations | Mobilization | Cofacilitators receive and review the manual |
| Implementation | Cofacilitators | Knowledge, self-efficacy, and outcome expectations | Mobilization | Cofacilitators reserve space/telehealth platform |
| Implementation | Cofacilitators | Knowledge, self-efficacy, and outcome expectations | Cue to participate, communication | (Telehealth only) Cofacilitators conduct a practice session with participants to introduce the telehealth platform |
| Implementation | Cofacilitators and staff | Knowledge, self-efficacy, and outcome expectations | Communication | Cofacilitators meet with scheduling staff to decide on the schedule process |
| Implementation | Cofacilitators, staff | Knowledge, self-efficacy, and outcome expectations | Communication | Clinical facilitator meets with nursing staff to clarify the IMGV check-in process |
| Implementation | Cofacilitators | Knowledge, self-efficacy, and outcome expectations | Cue to participate, communication | Cofacilitators send weekly updates to administrators and monthly updates to clinical stakeholders |
Stage of implementation, actors needed to execute implementation strategies, behavioral determinants, theoretical change methods, and implementation strategies are specified to create an implementation strategy plan.
IMGV, Integrative Medical Group Visit.
Task 4. Executing implementation strategies
In task 4, materials to execute the implementation strategies designed by the team were produced and the strategies were executed. The implementation team designed the language and content for educational strategies based upon language that had previously been developed for recruitment of participants for a randomized controlled trial of IMGV. Marketing and communications staff from the clinical site designed flyers to distribute to patients and staff.
Limitations
The current study assessed the feasibility of implementation mapping as a method to identify implementation strategies for IMGV in a single-site pilot study. These data are therefore limited by the single-site nature of the study and small sample size of stakeholders who were interviewed. Furthermore, implementation mapping was not compared with other methodologies for determining implementation strategies. However, given that few systematic processes for identifying implementation strategies have been developed, the current findings suggest that implementation mapping may be a feasible method for identifying implementation strategies that warrant further testing in a future fully powered trial.
Discussion
This study provides an example of the application of implementation mapping to identify theory-driven implementation strategies for IMGV. Implementation mapping offers a roadmap for how implementation frameworks, methods, and theories can be applied to the study of integrative health interventions. The authors found implementation mapping to be a feasible method for consolidating data and producing an actionable plan of implementation strategies. Those implementation strategies are currently being evaluated for feasibility and acceptability in an ongoing pilot study. Implementation mapping can be done at a single site or in a multisite trial43 and may be a useful method for future fully powered IPM studies. By including implementation frameworks and relevant theory, implementation mapping provides a method for teams to document the rationale for choosing specific implementation strategies and to identify mechanisms of action of those implementation strategies.22
The field of implementation science has developed many frameworks, models, and theories to make sense of the complex phenomena observed during implementation. It would be ideal to arrive at a consensus on which strategies should be used to address particular barriers, but this consensus does not yet exist in the field. Efforts are underway to synthesize and systematize the process of assessing contextual barriers and facilitators to implementation and identifying relevant implementation strategies.44 Implementation mapping can be combined with these other tools and offers the advantage of creating a detailed description of the rationale and evidence used to choose particular implementation strategies.
While implementation research within integrative health is just emerging, the authors' findings are similar to previous studies of integrative health implementation. A large-scale evaluation of barriers and facilitators to implementation of integrative health within the Veteran's Administration noted the importance of leadership, program champions, strategic planning, and effective marketing.45 The authors similarly found that stakeholders highlighted the importance of engaging leadership, program champions, providing clear plans to staff, and marketing effectively to ensure robust recruitment.
A review of implementation challenges and recommendations for group visits found that difficulty recruiting participants was among the most common implementation challenges and recommended the use of high-quality marketing materials.46 The authors similarly found that recruitment was a common concern among stakeholders regarding the sustainability of IMGV within the clinical site.
Several suggestions regarding start-up procedures are described in detail in the IMGV manual for facilitators, originally developed for a randomized controlled trial.34 While many of these procedures are specific to the execution of a clinical trial, the authors found that procedures and most language measures were directly applicable to clinical implementation of IMGV. While these components (recruitment strategies and training processes) may not be considered core intervention components, they have a strong impact on real-world effectiveness and are of principle concern to stakeholders looking to adopt evidence-based interventions.
Conclusions
Implementation mapping is a feasible method, utilizing relevant implementation theories and frameworks, to identify implementation strategies for IMGV. Implementation mapping may be useful in providing a guiding structure to employ implementation frameworks and select implementation strategies for IPM interventions. Systematic application of implementation science methods, theories, and frameworks will be increasingly important in integrative health as researchers and clinicians seek to disseminate and implement evidence-based interventions.
Supplementary Material
Authorship Confirmation Statement
I.J.R., J.L.B., K.R.F., S.G., K.R.K., P.G., V.E.M., and J.L. contributed to the design of the work, and I.J.R., M.K.T., and J.L.B. contributed to the acquisition and analysis of data. All authors contributed to interpretation of data. All authors contributed to drafting the work and revising it critically, gave final approval for the version to be published, and agreed to be accountable for all aspects of the work, ensuring accuracy and integrity of the work.
Author Disclosure Statement
The authors have no conflicts of interest to disclose.
Funding Information
The project described was supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number UL1TR002489. Contributions of I.J.R., J.L.B., and V.E.M. were supported by the National Center for Complementary and Integrative Health, through Grant Award Number 5T32AT00378-12. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Supplementary Material
References
- 1. NCCIH Funding. Appropriations History | NCCIH. Online document at: https://www.nccih.nih.gov/about/budget/nccih-funding-appropriations-history, accessed August24, 2020
- 2. U.S. Department of Veterans Affairs. Complementary and Integrative Health. Whole Health. Online document at: https://www-va-gov.libproxy.lib.unc.edu/WHOLEHEALTH/professional-resources/clinician-tools/cih.asp, published July 13, 2020, accessed August23, 2020
- 3. Chao MT, Wade CM. Socioeconomic factors and women's use of complementary and alternative medicine in four racial/ethnic groups. Ethn Dis 2008;18:65–71 [PMC free article] [PubMed] [Google Scholar]
- 4. Bauer MS, Damschroder L, Hagedorn H, et al. An introduction to implementation science for the non-specialist. BMC Psychol 2015;3:32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Eccles MP, Mittman BS. Welcome to implementation science. Implement Sci 2006;1:1 [Google Scholar]
- 6. Implementation and De-implementation Methodologies for Complementary Health Approaches. Bethesda, MD: U.S. Department of Health and Human Services, National Center for Complementary and Integrative Health, December 10, 2019
- 7. Hilton L, Hempel S, Ewing BA, et al. Mindfulness meditation for chronic pain: Systematic review and meta-analysis. Ann Behav Med 2017;51:199–213 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Wang CC, Li K, Choudhury A, Gaylord S. Trends in Yoga, Tai Chi, and Qigong use among US adults, 2002–2017. Am J Public Health 2019;109:755–761 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Skelly AC, Chou R, Dettori JR, et al. Noninvasive Nonpharmacological Treatment for Chronic Pain: A Systematic Review. Rockville, MD: Agency for Healthcare Research and Quality (US), 2018. DOI: 10.23970/AHRQEPCCER209 [DOI] [PubMed] [Google Scholar]
- 10. Abrams DI, Dolor R, Roberts R, et al. The BraveNet prospective observational study on integrative medicine treatment approaches for pain. BMC Complement Altern Med 2013;13:146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Lee C, Crawford C, Swann S, Active Self-Care Therapies for Pain (PACT) Working Group. Multimodal, integrative therapies for the self-management of chronic pain symptoms. Pain Med 2014;15(Suppl 1):S76–S85 [DOI] [PubMed] [Google Scholar]
- 12. Qaseem A, Wilt TJ, McLean RM, Forciea MA, Clinical Guidelines Committee of the American College of Physicians. Noninvasive treatments for acute, subacute, and chronic low back pain: A clinical practice guideline from the American College of Physicians. Ann Intern Med 2017;166:514–530 [DOI] [PubMed] [Google Scholar]
- 13. R3 Report. Requirement, Rationale, Reference—Pain assessment and management standards for hospitals. The Joint Commission, 2017. Report No. 11 [Google Scholar]
- 14. Nahin RL, Stussman BJ, Herman PM. Out-of-pocket expenditures on complementary health approaches associated with painful health conditions in a nationally representative adult sample. J Pain 2015;16:1147–1162 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Weeks J. Influential U.S. medical organizations call for insurance coverage of non-pharmacologic approaches to pain. J Altern Complement Med 2016;22:947–949 [DOI] [PubMed] [Google Scholar]
- 16. Brownson RC, Colditz GA, Proctor EK. Dissemination and Implementation Research in Health: Translating Science to Practice. New York: Oxford University Press, 2012. [Google Scholar]
- 17. Powell BJ, Fernandez ME, Williams NJ, et al. Enhancing the impact of implementation strategies in healthcare: A research agenda. Front Public Health 2019;7:3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011;38:65–76 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Fernandez ME, Ten Hoor GA, van Lieshout S, et al. Implementation mapping: Using intervention mapping to develop implementation strategies. Front Public Health 2019;7:158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci 2009;4:50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Powell BJ, Waltz TJ, Chinman MJ, et al. A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci 2015;10:21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Waltz TJ, Powell BJ, Fernández ME, et al. Choosing implementation strategies to address contextual barriers: Diversity in recommendations and future directions. Implement Sci 2019;14:42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Curran GM. Implementation science made too simple: A teaching tool. Implement Sci Commun 2020;1:27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Weiner BJ, Lewis CC, Stanick C, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci 2017;12:108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Hurstak E, Chao MT, Leonoudakis-Watts K, et al. Design, implementation, and evaluation of an integrative pain management program in a primary care safety-net clinic. J Altern Complement Med 2019;25(S1):S78–S85 [DOI] [PubMed] [Google Scholar]
- 26. Faurot K, Thompson K, Hearn M, et al. Use of complementary and integrative health practices among individuals seeing care at an academic-affiliated outpatient rehabilitation center. American Public Health Association Annual Meeting Online Program; Creating the Healthiest Nation: Preventing Violence; 2020 October 24; Virtual, United States. Washington, DC: American Public Health Association, 2020 [Google Scholar]
- 27. Thompson-Lastad A, Gardiner P, Chao MT. Integrative group medical visits: A National scoping survey of safety-net clinics. Health Equity 2019;3:1–8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Parikh M, Rajendran I, D'Amico S, et al. Characteristics and components of medical group visits for chronic health conditions: A systematic scoping review. J Altern Complement Med 2019;25:683–698 [DOI] [PubMed] [Google Scholar]
- 29. Gardiner P, Dresner D, Barnett KG, et al. Medical group visits: A feasibility study to manage patients with chronic pain in an underserved urban clinic. Glob Adv Health Med 2014;3:20–26 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Luo M, Gardiner P, D'Amico S. Comparisons of integrative medicine group visit and clinical visits in improving the application of adaptive stress management techniques among patients with chronic pain and depression. Glob Adv Health Med 2018;77:128 [Google Scholar]
- 31. Luo M, D'Amico S, Gardiner P, et al. Integrative medical group visits: A randomized controlled trial in patients with chronic pain and depression in a diverse urban setting. Glob Adv Health Med 2018;7:177 [Google Scholar]
- 32. Gardiner P, Luo M, D'Amico S, et al. Effectiveness of integrative medicine group visits in chronic pain and depressive symptoms: A randomized controlled trial. PLoS One 2019;14:e0225540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Dresner D, Gergen Barnett K, Resnick K, et al. Listening to their words: A qualitative analysis of integrative medicine group visits in an urban underserved medical setting. Pain Med 2016;17:1183–1191 [DOI] [PubMed] [Google Scholar]
- 34. Schneeberger D, Golubíc M, Moore HCF, et al. Lifestyle medicine-focused shared medical appointments to improve risk factors for chronic diseases and quality of life in breast cancer survivors. J Altern Complement Med 2019;25:40–47 [DOI] [PubMed] [Google Scholar]
- 35. Chao MT, Hurstak E, Leonoudakis-Watts K, et al. Patient-reported outcomes of an integrative pain management program implemented in a primary care safety net clinic: A quasi-experimental study. J Gen Intern Med 2019;34:1105–1107 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Damschroder LJ, Aron DC, Keith RE, et al. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci 2009;4:50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Keith RE, Crosson JC, O'Malley AS, et al. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: A rapid-cycle evaluation approach to improving implementation. Implement Sci 2017;12:15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Fernandez ME, Walker TJ, Weiner BJ, et al. Developing measures to assess constructs from the inner setting domain of the consolidated framework for implementation research. Implement Sci 2018;13:52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. ATLAS.ti Cloud Qualitative Data Analysis Software [Computer Software]. Version 0.17.8-6. Berlin, Germany: ATLAS.ti Scientific Software Development GmbH, 2020 [Google Scholar]
- 40. Glanz K. Health Behavior: Theory, Research, and Practice (Jossey-Bass Public Health). 5th ed. San Francisco, CA: Jossey-bass, 2015:512. [Google Scholar]
- 41. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals' intentions and behaviours: A systematic review of studies based on social cognitive theories. Implement Sci 2008;3:36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Dearing JW, Cox JG. Diffusion of innovations theory, principles, and practice. Health Aff (Millwood) 2018;37:183–190 [DOI] [PubMed] [Google Scholar]
- 43. Highfield L, Valerio MA, Fernandez ME, Eldridge-Bartholomew LK. Development of an implementation intervention using intervention mapping to increase mammography among low income women. Front Public Health 2018;6:300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Smith JD, Li HL, Rafferty MR. The Implementation Research Logic Model: A method for planning, executing, reporting, and synthesizing implementation projects. Implement Sci 2020;15:84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Taylor SL, Bolton R, Huynh A, et al. What should health care systems consider when implementing complementary and integrative health: Lessons from Veterans Health Administration. J Altern Complement Med 2019;25(S1):S52–S60 [DOI] [PubMed] [Google Scholar]
- 46. Jones KR, Kaewluang N, Lekhak N. Group visits for chronic illness management: Implementation challenges and recommendations. Nurs Econ 2014;32:118–134, 147. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

