Skip to main content
Implementation Science Communications logoLink to Implementation Science Communications
. 2022 Aug 6;3:86. doi: 10.1186/s43058-022-00333-y

Implementing a text-messaging intervention for unhealthy alcohol use in emergency departments: protocol for implementation strategy development and a pilot cluster randomized implementation trial

Megan A O’Grady 1,, Sandeep Kapoor 2,3, Laura Harrison 2, Nancy Kwon 2,3, Adekemi O Suleiman 1, Frederick J Muench 4
PMCID: PMC9356403  PMID: 35933560

Abstract

Background

Unhealthy alcohol use (UAU) is a leading cause of premature mortality among adults in the USA. Emergency departments (EDs) are key intervention settings for UAU but often have limited time and resources. One low-burden, scalable approach to address UAU is text-messaging interventions. Despite strong research support and promise for scalability, there is little research on how to implement such interventions in healthcare settings. The process of providers making them available to patients in an efficient way within already busy and overburdened ED workflows and patients adopting them remains a new area of research. The purpose of this three-phase study is to develop and test an implementation strategy for UAU text-messaging interventions in EDs.

Method

Our first aim is to examine barriers and facilitators to staff offering and patients accepting a text-messaging intervention in the ED using an explanatory, sequential mixed methods approach. We will examine alcohol screening data in the electronic health records of 17 EDs within a large integrated health system in the Northeast and conduct surveys among chairpersons in each. This data will be used to purposively sample 4 EDs for semi-structured interviews among 20 clinical staff, 20 patients, and 4 chairpersons. Our second aim is to conduct a stakeholder-engaged intervention mapping process to develop a multi-component implementation strategy for EDs. Our third aim is to conduct a mixed method 2-arm cluster randomized pilot study in 4 EDs that serve ~11,000 UAU patients per year to assess the feasibility, acceptability, and preliminary effectiveness of the implementation strategy. The Integrated Promoting Action on Research Implementation in Health Services framework will guide study activities.

Discussion

Low-burden technology, like text messaging, along with targeted implementation support and strategies driven by identified barriers and facilitators could sustain large-scale ED-based alcohol screening programs and provide much needed support to patients who screen positive while reducing burden on EDs. The proposed study would be the first to develop and test this targeted implementation strategy and will prepare for a larger, fully powered hybrid effectiveness-implementation trial. Findings may also be broadly applicable to implementation of patient-facing mobile health technologies.

Trial registration

This study was registered at ClinicalTrials.gov (NCT05350878) on 4/28/2022.

Keywords: Unhealthy alcohol use, Text-messaging intervention, Intervention mapping, Emergency department, Implementation barriers, i-PARIHS framework, Cluster randomized trial, Mixed methods


Contributions to the literature.

  • Emergency departments are important venues for addressing unhealthy alcohol use; however, given the limited time and resources, low-burden interventions are needed in this setting.

  • Text-messaging interventions are low burden and potentially scalable in emergency departments to address unhealthy alcohol use, but limited research has examined their implementation.

  • This study will examine barriers and facilitators to implementation of text-messaging interventions for unhealthy alcohol use in emergency departments and develop and test a multi-component implementation strategy.

  • Study findings may be broadly applicable to the implementation of patient-facing mobile health interventions for substance use in ED settings—an understudied research area.

Background

Unhealthy alcohol use (UAU) is estimated to cost the USA over $200 billion per year [1] and is one of the leading causes of premature mortality among adults [2, 3]. UAU is defined as a continuum of behaviors from risky or harmful use (exceeding recommended daily, weekly, or per occasion amounts) to alcohol use disorder [2]. National data suggests that, of the over 140 million current alcohol users, 47% exceeded recommended per occasion drinking amounts [4]. An estimated 14.5 million adults meet criteria for alcohol use disorder [4]. The prevalence of UAU was increasing among adults prior to the COVID-19 pandemic and the pandemic has further exacerbated UAU and related negative consequences [2, 57].

Emergency department (ED) visits involving alcohol consumption have increased in recent years [8] and UAU is more common among ED patients than in the general population [9]. It has been posited that substance use is the most important modifiable health behavior in the ED, [10, 11] as such the ED has been highlighted as a key intervention setting for UAU [12, 13]. Health systems are being tasked now more than ever with addressing substance use among their patients but often have limited time and resources [10]. ED clinicians work in high-volume, high acuity settings with significant time constraints and little training in providing intervention for substance use problems [10]. The ED is a promising point of intervention, yet scalable supports that reach as many patients with UAU as possible are needed.

Leveraging simple and efficient technology to support behavioral health intervention implementation in EDs has been urged [10, 14, 15]. The vast majority of ED patients (90%) express a strong preference for receiving health interventions via technology [15]. Access to mobile technology among ED patients who use substances is high: 97% report cell phone usage and many report a preference for technology-based means of receiving information about substance use [10]. Text messages are one of the most basic modes of mobile health interventions and use brief, supportive electronic messages transmitted via a mobile phone network to promote behavior change and may be the lowest burden, most preferred mobile health format [1618]. Over the past decade, text-capable mobile phones have become ubiquitous across socioeconomic classes [19, 20]. It has been posited that text-message interventions have the potential to reduce health disparities at low cost because they appeal to the most underserved communities, including those that do not connect with traditional healthcare services [21]. Texts cost a fraction of a penny to send and unlimited texting plans are common [18, 22]. Interventions using text messages are low burden in that receiving intervention messages requires no user effort. They do not require logging in, tunneling through web pages, time-consuming data entry fields, or downloading an app [23]. Other advantages include being able to provide support over time in an individual’s natural environment and adapting content based on changing circumstances and feedback from the recipient [23]. From the health system perspective, text-messaging programs are relatively inexpensive to develop and maintain, do not require formal design, are agnostic to operating system, and expensive updates are not needed [18]. Text-based interventions may be the most feasible option for ED patient populations given the challenges of providing face-to-face intervention in EDs and they have the potential to reach traditionally underserved populations [15].

Reviews of text-messaging interventions for health behaviors broadly have found that the majority were effective and that there is strong evidence to support the value of integrating them into public health practice [18, 23, 24]. Text interventions are an acceptable and feasible strategy to enhance the delivery of care for persons with substance use problems [17, 2527]. A recent meta-analysis found that text-messaging alcohol interventions reduce alcohol consumption compared with no or basic health information [28]. For example, people with harmful drinking patterns significantly reduced drinking frequency and quantity after receiving daily texts [29]. Patients with alcohol use disorder perceive that text interventions may help them remain abstinent [30]. The benefits of harnessing text interventions for UAU in the ED could be considerable because they are low burden for patients and acceptable and effective [31]. For example, discharged trauma center patients who received a text intervention reduced hazardous drinking as compared to usual care controls [32] and the majority of trauma patients would enroll if offered a text intervention [33]. Among patients recruited from EDs, text interventions for UAU are effective in supporting them in meeting drinking goals and making drinking reductions, including reductions in binge drinking and number of drinks consumed per day [34, 35]. Furthermore, 44% of ED patients accepted a text intervention and those who accepted had higher rates of treatment attendance after discharge from the ED as compared to those who did not accept [9]. These studies show broad efficacy for text interventions in EDs with potential to reach diverse populations; however, no studies have developed and tested a strategy for systematically offering them to patients in EDs in a scalable manner.

Systematic reviews have noted that very few studies examine implementation and dissemination of mobile health technology [10, 36, 37]. Recent failures of pragmatic mobile health trials due to lack of patient and staff uptake are a warning that careful implementation approaches are needed [38, 39]. A complex web of inter-related technical, social, patient, and organizational considerations may be at play [4042]; yet insufficient guidance is available to inform larger scale implementation of mobile health [10, 12, 15, 17, 19, 23, 4345]. Two recent reviews of substance use technology interventions noted that only one study [46] focused explicitly on implementation outcomes; most focused only on patient clinical outcomes [37, 47]. Few of these studies mention implementation strategies, making it difficult to know how to successfully implement technology into practice [37]. Other reviews urge the field to move toward developing text intervention implementation strategies [17, 48], with one stating that “the field awaits true dissemination and implementation studies in which text interventions are put into place in real world settings.” [18]. Research should prioritize examining techniques for increasing uptake of alcohol text interventions among patients as well as examining whether ED staff are likely to systematically offer such interventions [9].

Implementation of text interventions for UAU will require EDs to address patient, setting, administrative, and staff barriers. This study will use the Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework to guide intervention and research activities [49, 50]. i-PARIHS posits that optimal implementation occurs when practice facilitation promotes the acceptance and use of a new practice innovation based on both the recipient’s needs and on the unique nature of the inner and outer context [50, 51]. i-PARIHS positions facilitation as the active ingredient to help navigate individuals and teams through complex change processes by addressing (a) the innovation’s degree of fit within the existing practice; (b) the motivations, beliefs, characteristics, and resources of the intervention recipients; and (c) the inner and outer context (e.g., leadership support, culture, the learning environment, organizational priorities, capacity for change, mandates). Facilitation has been defined as interactive problem solving that is active, dynamic, and task-oriented and has been used in a number of disciplines [50, 52, 53]. Notably, facilitation has been utilized for several decades and has now become routine for implementing changes [5456]. ED-based studies have started to use facilitation along with comprehensive implementation strategies because typical strategies such as educational sessions or grand rounds presentations are not enough to implement new practices successfully [57]. However, i-PARIHS does not dictate specific implementation strategies given that each context, recipient, and intervention may call for a different set of strategies. Selecting implementation strategies is a complex task and strategies are too often selected in an unsystematic way, fail to address key contextual determinants, and are not well matched to the contexts in which they are deployed [58]. Rigorous methods are needed to select strategies that take into account relevant theory and stakeholder participation and that are specified clearly enough to be replicated [59, 60]. This study will use a systematic intervention mapping process to develop the facilitated implementation strategy [59, 6164]. The aims of this study are to:

Aim 1: examine potential barriers and facilitators to staff offering and patients accepting a text-messaging intervention in the ED using an explanatory, sequential mixed methods approach

Aim 2: use a stakeholder-engaged intervention mapping process to develop a multi-component implementation strategy for EDs

Aim 3: conduct a mixed method 2-arm cluster randomized pilot study in 4 EDs that serve ~11,000 UAU patients per year to assess the feasibility, acceptability, and preliminary effectiveness of the implementation strategy

Methods

Aim 1: Identify barriers and facilitators to implementing a text-messaging intervention for UAU in EDs

Design

The study will be conducted within a large integrated health system in the Northeastern United States that has 17 EDs serving adult patients. For aim 1, we will use an explanatory, sequential mixed methods approach that places more emphasis on the qualitative data (quant → QUAL) [65] given that little is known about barriers/facilitators to text-messaging intervention implementation in EDs. First, we will examine alcohol screening data in the electronic health records (EHRs) of the 17 EDs and conduct surveys among chairpersons in each. This data will then be used to purposively sample 4 EDs for semi-structured interviews among clinical staff (e.g., nurses, physicians), patients, and chairpersons (2 with low perceived implementation barriers; 2 with high perceived barriers).

Quantitative data sources, sample, and analysis

All EDs in this study use the structured, validated 3-item AUDIT-C screening tool [66] to detect UAU. It is built into their EHRs which capture screening results and reasons for screening deferral if applicable (e.g., acuity of illness, including mental status and intoxication) or patient refusal. Data on alcohol screening from the past 12 months will be extracted and compiled from the EHRs of the 17 EDs to include: % patients screened (numerator: # AUDIT-C screens completed; denominator: total patient census) and % screenings deferred (numerator: # patients with AUDIT-C screening deferral indicated; denominator: total patient census). EHR data on alcohol screening is being examined because it provides an important clue to each ED’s buy-in and ability to identify and address UAU. For example, EDs with low screening completion rates may indicate staff hesitancy, lack of time to screen patients, or an EHR where the AUDIT-C has no reminder prompt for completion. Such factors may limit ED’s ability to properly identify appropriate patients and offer them a text intervention. ED chairpersons (or their designee) of each of the 17 EDs will complete a 12-item online survey measuring their views on the feasibility, acceptability, and appropriateness of implementing a text-messaging intervention in EDs that is adapted from a validated measure [67]. We will calculate an average score for each chairperson.

Qualitative data sources, sample, and analysis

We will identify 4 ED sites (2 with low perceived implementation barriers and 2 with high perceived barriers) for semi-structured interviews using stratified purposeful sampling [68, 69]. We will create low and high categories based on ED alcohol screening completion rates (low = ≤ median; high = > median) and survey score (low = score ≤ median; high = above the median).

ED chairperson and staff

In each of the 4 selected EDs, chairpersons who completed the quantitative survey will be interviewed. Modeled on other implementation studies [70], we will then ask each chairperson to identify 5 clinical staff for interviews (e.g., nurses, physicians, support staff). Interviews (~30 min) will be conducted over the phone or in-person depending on staff preference. If conducted over the phone, we will follow best practices for phone-based qualitative interviews in health services research [71, 72]. Interview guides for staff, informed by the i-PARIHS framework [57, 73], will cover views on alcohol screening in the ED, text-messaging interventions and how to best offer them to patients, and barriers/facilitators to intervention implementation and general practice change.

ED patients

To recruit patients for interviews, following procedures from similar ED studies [10], patients will be approached in the ED if they screened positive on the AUDIT-C (≥3) as identified in the EHR. We will recruit 5 patients from each of the 4 EDs. Interviews (~30 min) will be conducted in a private area in the ED and patients will be offered a $15 gift card. If saturation is not reached with the initial samples, additional interviews will be conducted. Interview guides for patients will be adapted from a study that assessed patients’ preferences and attitudes toward technology interventions initiated in the ED [15] and a semi-structured interview guide used among trauma patients on this topic [33] (e.g., mobile device ownership and use, interest in receiving supportive messages via mobile device on UAU reduction, best ways to offer patients the intervention in the ED, concerns about using mobile devices). Expert consultants in implementation science and ED-based text messaging will provide feedback on interview guides.

Qualitative analysis

Interviews will be recorded and transcribed then analyzed using directed content analysis [74]. We will use a deductive approach such that a codebook with codes and operational definitions will be created prior to analysis using key elements from i-PARIHS [75]. A two-person coding team, led by the first author, will be used. We will use Atlas.ti to manage, organize, and examine patterns in the data and will follow recommended steps for content analysis [75, 76]: (1) transcripts will be read several times by coding team, (2) meaning units within the transcripts will be identified (i.e., smallest amount of text that contains needed insights) [75], (3) meaning units will be coded; data that cannot be coded using initial codes will be identified and analyzed after initial coding to determine if they represent a new category or sub-category of an existing code [74], (4) codes will be sorted into categories, and (5) themes will be formed by grouping two or more categories together. Coding disagreements will be resolved through discussion. We will use a continuous process of coding, categorizing, and reviewing the raw data to reflect on the analysis at various points and make revisions (e.g., recoding data). Weekly coding meetings will be held to review coding decisions, discuss discrepancies, and check progress. We will use several methods to increase trustworthiness [77]: sample to the point of saturation, conduct negative case analysis, use member checking, keep an audit trail on study decisions, maintain a detailed codebook, and track inter-coder reliability.

Aim 2: Develop a stakeholder-driven multi-component strategy for implementation of a text-messaging intervention for UAU in the ED

We will use a systematic 4-step intervention mapping method [59, 6163] to develop our implementation strategy. We will leverage aim 1 results and three stakeholder meetings. Stakeholder meetings will consist of ED chairpersons, administrators, staff, and patients from within the integrated health system where the study is being conducted as well as ED stakeholders external to the health system. The intervention mapping approach will create a transparent, deliberate, stakeholder-engaged process while aligning with strategies and terminology in the implementation science literature.

Intervention mapping: step 1

The first step is a needs assessment. The study team will compile results from aim 1 quantitative and qualitative data to assess implementation needs.

Intervention mapping: step 2

Aim 1 results will be presented to a stakeholder group consisting of ED staff, chairpersons, administrators, patients, and expert consultants to identify concrete objectives and expected outcomes of the implementation strategy. For example, the group will identify what would need to be changed at the setting, patient, staff, and administrative levels for successful implementation of the text intervention. The study team will create a matrix of needs, goals, and objectives for successful implementation resulting from this meeting.

Intervention mapping: step 3

This step involves identifying theory-based, practical discrete implementation strategies to meet the needs, goals, and objectives from step 2. The study team will select implementation strategies with the following principles in mind: (1) appropriateness for the ED setting, (2) replicability and generalizability, (3) feasibility and sustainability for future dissemination, and (4) alignment with the i-PARIHS components to address ED needs, constraints, resources, and context. Implementation strategies will be selected from the i-PARIHS facilitator’s toolkit [49] and other expert-consolidated implementation strategy lists [78] and the following will be identified for each implementation strategy chosen: active ingredient, causal mechanisms by which they will exert the desired changes, mode of delivery (e.g., face to face), and the intended target (e.g., administrators, front-line staff, patients) [79]. See Fig. 1 for sample implementation strategies mapped onto the i-PARIHS framework. Guided by the i-PARIHS framework, we will use practice facilitation, and an internal-external facilitator team will support sites’ use of the identified implementation strategies. Internal-external facilitation is used commonly [80, 81] and leverages internal provider motivation with outside expertise and program support [50, 82]. The second stakeholder meeting will be used to receive feedback on and refine the selected implementation strategies.

Fig. 1.

Fig. 1

The i-PARIHS model and example implementation strategies and outcomes

Intervention mapping: step 4

The multi-component implementation strategy will be designed, and its execution planned in the final step. The strategies identified in step 3 will be operationalized to clearly delineate what they entail, as well as how they will be delivered. Materials (e.g., manuals, training materials) to support the implementation strategy will also be created. The third stakeholder meeting will be held to get feedback on the execution plan and materials.

Aim 3: Examine the feasibility, acceptability, and preliminary effectiveness of the implementation strategy

Design

In line with recommendations pertaining to the scope and target outcomes of pilot studies for implementation trials [8385], the main goal of this pilot trial is to assess the (1) feasibility (i.e., perceptions among ED clinical staff members that the implementation strategy can be successfully used), (2) acceptability (i.e., perceptions among ED clinical staff members that the implementation strategy is agreeable, palatable, or satisfactory), and (3) and preliminary effectiveness of the implementation strategy. We will operationalize our effectiveness outcome as “reach” (i.e., proportion of eligible patients that enroll in the text intervention), which is a key outcome recommended in the implementation science literature [83, 8587]. The design is a mixed method, two-armed, study in 4 EDs (2 assigned to the new implementation strategy vs. 2 implementation as usual control). Qualitative and quantitative measures will be collected and analyzed simultaneously and merged—qualitative data will provide context to and explanation of the quantitative results in a complimentary way, representing a QUAL + QUAN structure that gives equal emphasis to both types of data [65].

Study site randomization

The study will be conducted within a large integrated health system in the Northeast of the USA. Because the number of study sites for this pilot is relatively small, simple unrestricted randomization may not be sufficient to ensure balance between study conditions. Pairing of EDs would improve balance but may reduce study power and is not recommended for small numbers of clusters [88]. Therefore, we will use a minimization procedure to ensure overall balance on three important covariates: annual ED census, location (urban/suburban), and AUDIT-C positive rate. A computerized algorithm will be used to identify all possible allocations that meet the balancing constraints and one of the allocations will be randomly selected [89]. A data analyst not associated with the study will conduct this procedure to minimize bias. Study sites and data analysts will be blinded to the study condition.

Study conditions

Implementation strategy condition

Through virtual and in-person meetings, the internal/external facilitation team will support sites in utilizing the implementation strategy developed in aim 2 for 7 months: 2 months to prepare policies/workflows for offering the text intervention to patients and 5 months actively supporting implementation of offering the text intervention.

Control condition

In control “implementation as usual” sites, no facilitation or implementation strategies will be provided. Controls will receive (1) an informational session on the text intervention during grand rounds/staff meetings and (2) flyers to provide patients with intervention enrollment information. In both conditions, it will be emphasized that any patient who screens positive on the AUDIT-C (as per site protocol in the EHR) are appropriate [34, 35].

Text-messaging intervention

The text-messaging intervention to be implemented in this pilot trial [29] includes daily texts tailored to individuals’ responses to brief enrollment and check-in assessments (e.g., drinking goals, self-efficacy). Just-in-time support is also provided (e.g., text “temp” for support to manage a craving to drink). An RCT testing this intervention found 94% retention of participants over 12 weeks, and reductions in the number of heavy drinking days in groups that received active messages (vs. assessment only), with the greatest effect for just-in-time adaptive tailoring. To enroll in the intervention, participants text a number (e.g., REDUCE to 55753) and then receive a welcome message that will prompt them to complete the enrollment assessment. We selected this particular texting intervention for implementation in this study because in a recent meta-analysis it was the only study that had positive outcomes and met all criteria for low bias [90]. Furthermore, it has three key ingredients recommended by the broad text-messaging intervention literature: theory-driven, evidence-based, and adaptively tailored.

Data sources and measures

Effectiveness/reach

Effectiveness will be examined by calculating how many patients were eligible (positive AUDIT-C) based on EHR data and the proportion who enrolled in the intervention as collected by the text platform. Demographics will also be collected from the EHR and text platform to examine differences in characteristics between who was eligible based on AUDIT-C score and who enrolled. In the text platform, each study site will have a unique enrollment text code number, allowing for tracking of patients that enrolled by site and when they enrolled, demographics, and responses to the intervention tailoring questions (e.g., drinking patterns, self-efficacy, motivation). We anticipate there will be ~5000 UAU eligible patients identified during the study trial period based on (1) sites’ current census, (2) current screen positive rates, and (3) screening completion rates based on our previous evaluations in this integrated health system.

Feasibility and acceptability

Feasibility and acceptability of the implementation strategy among staff in the 2 intervention sites will be measured by two 4-item validated measures: the Acceptability of Intervention Measure (AIM), and Feasibility of Intervention Measure (FIM) (e.g., the implementation strategy seems easy to use; the implementation strategy meets my approval) [67]. We will also adapt these measures to assess patients’ views on feasibility and acceptability of the text-messaging intervention to provide context to the effectiveness/reach outcomes.

Qualitative measures

Semi-structured interview guides for staff will be developed using concepts from the Organizational Readiness to Change Assessment, an instrument designed to assess the core elements of the i-PARIHS model, as well the aim 1 interview guide (e.g., What was it like to offer the text interventions to patients?) [91]. Semi-structured interview guides for patients will be adapted from a previous text-messaging study [92] in order to provide context to the reach/effectiveness data (e.g., Describe how the intervention was offered to you? What was it like for you to receive messages? What aspects of the text messaging, if any, do you think helped/did not help? What made you interested in enrolling in the text-messaging program?).

Data collection procedures

Patients

A random sample (n = 250) of adult patients who screen positive for UAU and enroll in the text intervention will be invited via text message to participate in a survey on the intervention’s feasibility and acceptability 1 month after enrolling in the intervention. A link will be sent to participants via the text-messaging platform for them to participate in the online survey, review informed consent study information sheet, and receive a $15 e-gift card for their participation.

We will also invite 10 patients to participate in qualitative interviews from each of the 4 EDs with a question at the end of the survey inquiring if they are interested; we will then follow up by phone to schedule. A verbal consenting procedure will be conducted by the interviewer along with an information sheet provided to the patient.

Staff

Clinical staff members at the 2 intervention EDs will be invited by email to participate in an online survey; during month 6 of the trial, they will receive a study information sheet informing them of their rights as a research participant. One chairperson per site will also be interviewed with the semi-structured interview guide. We will ask chairpersons to identify 20 staff per intervention ED (n = 40) to participate in semi-structured interviews, targeting those with knowledge of the intervention implementation. Staff and patients will have the option to complete the interview in-person or over the phone; interviews will be recorded. Staff will receive a study information sheet and a verbal consenting procedure will be used. Additional interviews will be conducted if our sample does not reach saturation [77].

Analysis

The same procedures described in aim 1 will be used to analyze qualitative data for aim 3. For the reach/effectiveness quantitative data, we will calculate a proportion for each study condition (e.g., numerator: # of patients in control or intervention sites who enrolled in the intervention; denominator: # of patients with positive AUDIT-C) and use z-tests for independent proportions [93] to examine whether control and intervention sites differ significantly. We will also use z-tests to examine differences in demographics between those eligible and enrolled to determine whether there are gender or racial disparities. For these proportional analyses [94], to achieve 80% power, a sample size of at least 300 in each condition is needed (total of 600) to detect a 10% difference in proportions with significance level of p = .05. For the feasibility/acceptability staff and patient survey data, we will calculate descriptive statistics for each. We will triangulate this quantitative data with the qualitative data by merging the results. No identifying information will be maintained by the study team for any staff or patients; all participants will be identified with a participant ID.

Discussion

EDs are under pressure to provide services for UAU and are potentially significant points of intervention for UAU. Text-messaging interventions have the potential to be a scalable solution that could be used by almost any ED patient and may better support underserved populations. However, little is understood about how to ensure that ED staff systematically offer these products to patients nor how to best engage patients with them during an ED visit. This study will develop and test a comprehensive set of implementation strategies for text-messaging alcohol interventions under “real world” conditions. We will use a deliberative stakeholder-guided intervention mapping procedure to develop the implementation strategy. While applied widely to development of public health interventions, this intervention mapping approach is less frequently used to develop implementation strategies but offers great potential to align the selected implementation strategies and terminology in the implementation science literature, making the strategy more easily replicable for others wishing to use the approach.

In terms of future implications of study findings, as recommended in Pearson et al. [83], the research team and stakeholder group will set a priori criteria to determine whether to progress to a larger scale, fully powered hybrid implementation-effectiveness trial based on preliminary implementation strategy effectiveness in conjunction with feasibility and acceptability [94, 95]. Trial results will be shared with the stakeholder group as well as at scientific conferences and in scientific publications. This larger scale test, if warranted, would expand the number of EDs and the range of implementation outcomes beyond “reach” as well as examine cost-effectiveness of the implementation strategy and effectiveness of the text-messaging intervention in reducing patient alcohol use.

The focus of this study is primarily on studying implementation outcomes, and not patient outcomes; therefore, we will not randomize patients to the text-messaging intervention; instead, all patients will receive the intervention. However, we will collect valuable data from patients to assess feasibility and acceptability of the intervention from their perspective; determine the proportion who engage with the intervention in a real-world situation; examine disparities in gender, race, and ethnicity in enrolled vs. not; and understand why patients enrolled. All of the more than 150 hospitals in New York State are now required by state regulation to screen for substance misuse and such policies are being implemented elsewhere [96]; therefore, findings have the potential to be applied state- and nation-wide and a large number of sites would be available for a larger study.

This project moves forward the implementation science on technology interventions, a fairly new area of research. While the technology focus of this project is on text messaging, findings may be broadly applicable to patient-facing mHealth technologies. Text-messaging interventions have the potential to reach as many patients impacted by UAU as possible, including those traditionally underserved, in a scalable, low-burden manner; this study will illuminate strategies to reach that potential.

Acknowledgements

Not applicable.

Abbreviations

AUDIT-C

Alcohol Use Disorders Identification Test-Consumption

ED

Emergency department

EHR

Electronic health record

i-PARIHS

Integrated Promoting Action on Research Implementation in Health Services

UAU

Unhealthy alcohol use

Authors’ contributions

MO is the principal investigator of the study. MO generated the idea, designed the study, drafted the manuscript, and approved all changes. MO, SK, NK, and FM received funding for the study. FM designed the text-messaging intervention to be implemented in the study. SK, NK, LH, and FM provided input into the design of the study. SK, NK, LH, FM, and AS reviewed and provided feedback for this manuscript. The final version of this manuscript was reviewed and approved by all authors.

Funding

The research protocol reported in this publication is supported by the National Institute On Alcohol Abuse And Alcoholism of the National Institutes of Health under Award Number R21AA029734 (PI: O’Grady). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Availability of data and materials

Not currently applicable. Data from the pilot trial will be available in the NIAAA data sharing archive: https://nda.nih.gov/niaaa/.

Declarations

Ethics approval and consent to participate

All participants will provide informed consent prior to study participation. The Institutional Review Board of the Feinstein Institute for Medical Research at Northwell Health (# 21-0756) has approved this study. The Institutional Review Board of UConn Health has conducted a facilitated review and approved Feinstein as the external IRB of record (# O22-184-1).

Consent for publication

Not applicable

Competing interests

The authors declare no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Sacks JJ, Gonzales KR, Bouchery EE, Tomedi LE, Brewer RD. 2010 national and state costs of excessive alcohol consumption. Am J Prev Med. 2015;49(5):e73–ee9. doi: 10.1016/j.amepre.2015.05.031. [DOI] [PubMed] [Google Scholar]
  • 2.Force UPST Screening and behavioral counseling interventions to reduce unhealthy alcohol use in adolescents and adults: US Preventive Services Task Force Recommendation Statement USPSTF recommendation: screening and interventions for unhealthy alcohol use. JAMA. 2018;320(18):1899–1909. doi: 10.1001/jama.2018.16789. [DOI] [PubMed] [Google Scholar]
  • 3.O'Connor E, Perdue L, Senger C, Rushkin M, Patnode C, Bean S, et al. Evidence summary other supporting document for unhealthy alcohol use in adolescents and adults: screening and behavioral counseling interventions. JAMA. 2016;320(18):1910–1928. doi: 10.1001/jama.2018.12086. [DOI] [PubMed] [Google Scholar]
  • 4.Substance Abuse and Mental Health Services Administration. Treatment Episode Data Set (TEDS): 2005-2015. State Admissions to Substance Abuse Treatment Services. Rockville: Center for Behavioral Health Statistics and Quality; 2017. Contract No.: 17-4360. Retrieved from https://www.samhsa.gov/data/report/treatment-episode-data-set-teds-2005-2015-state-admissions-substance-abuse-treatment.
  • 5.Grant BF, Chou SP, Saha TD, Pickering RP, Kerridge BT, Ruan WJ, et al. Prevalence of 12-month alcohol use, high-risk drinking, and DSM-IV alcohol use disorder in the United States, 2001-2002 to 2012-2013: results from the National Epidemiologic Survey on Alcohol and Related Conditions Prevalence of Alcohol Use, High-Risk Drinking, and DSM-IV Alcohol Use Disorder. JAMA Psychiatry. 2017;74(9):911–923. doi: 10.1001/jamapsychiatry.2017.2161. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Pollard MS, Tucker JS, Green HD., Jr Changes in adult alcohol use and consequences during the COVID-19 pandemic in the US. JAMA Netw Open. 2020;3(9):e2022942. doi: 10.1001/jamanetworkopen.2020.22942. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Barbosa C, Cowell AJ, Dowd WN. Alcohol consumption in response to the COVID-19 pandemic in the United States. J Addict Med. 2020;15(4):341–4. [DOI] [PMC free article] [PubMed]
  • 8.White AM, Slater ME, Ng G, Hingson R, Breslow R. Trends in alcohol-related emergency department visits in the United States: results from the Nationwide Emergency Department Sample, 2006 to 2014. Alcohol Clin Exp Res. 2018;42(2):352–359. doi: 10.1111/acer.13559. [DOI] [PubMed] [Google Scholar]
  • 9.Kmiec J, Suffoletto B. Implementations of a text-message intervention to increase linkage from the emergency department to outpatient treatment for substance use disorders. J Subst Abus Treat. 2019;100:39–44. doi: 10.1016/j.jsat.2019.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Choo EK, Ranney ML, Wong Z, Mello MJ. Attitudes toward technology-based health information among adult emergency department patients with drug or alcohol misuse. J Subst Abus Treat. 2012;43(4):397–401. doi: 10.1016/j.jsat.2012.09.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bernstein SL. The clinical impact of health behaviors on emergency department visits. Acad Emerg Med. 2009;16(11):1054–1059. doi: 10.1111/j.1553-2712.2009.00564.x. [DOI] [PubMed] [Google Scholar]
  • 12.Hawk KF, Glick RL, Jey AR, Gaylor S, Doucet J, Wilson MP, et al. Emergency medicine research priorities for early intervention for substance use disorders. West J Emerg Med. 2019;20(2):386–392. doi: 10.5811/westjem.2019.1.39261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Maio RF. Alcohol and injury in the emergency department: opportunities for intervention. Ann Emerg Med. 1995;26(2):221–223. doi: 10.1016/S0196-0644(95)70145-1. [DOI] [PubMed] [Google Scholar]
  • 14.McCormack RP. Commentary on Blow et al. (2017): Leveraging technology may boost the effectiveness and adoption of interventions for drug use in emergency departments. Addiction. 2017;112(8):1406–1407. doi: 10.1111/add.13872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Ranney ML, Choo EK, Wang Y, Baum A, Clark MA, Mello MJ. Emergency department patients’ preferences for technology-based behavioral interventions. Ann Emerg Med. 2012;60(2):218–27. [DOI] [PubMed]
  • 16.Berman AH, Gajecki M, Sinadinovic K, Andersson C. Mobile interventions targeting risky drinking among university students: a review. Curr Addiction Rep. 2016;3(2):166–174. doi: 10.1007/s40429-016-0099-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Tofighi B, Nicholson JM, McNeely J, Muench F, Lee JD. Mobile phone messaging for illicit drug and alcohol dependence: a systematic review of the literature. Drug Alcohol Rev. 2017;36(4):477–491. doi: 10.1111/dar.12535. [DOI] [PubMed] [Google Scholar]
  • 18.Ranney ML, Pisani AR, Chernick LS. The role of texting in addressing mental health. In: Moreno MA, Radovic A, editors. Technology and adolescent mental health. Cham: Springer International Publishing; 2018. pp. 207–215. [Google Scholar]
  • 19.Kazemi DM, Borsari B, Levine MJ, Li S, Lamberson KA, Matta LA. A Systematic review of the mHealth interventions to prevent alcohol and substance abuse. J Health Commun. 2017;22(5):413–432. doi: 10.1080/10810730.2017.1303556. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Arora S, Burner E, Terp S, Nok Lam C, Nercisian A, Bhatt V, et al. Improving attendance at post-emergency department follow-up via automated text message appointment reminders: a randomized controlled trial. Acad Emerg Med. 2015;22(1):31–37. doi: 10.1111/acem.12503. [DOI] [PubMed] [Google Scholar]
  • 21.Willcox JC, Dobson R, Whittaker R. Old-fashioned technology in the era of “Bling”: is there a future for text messaging in health care? J Med Internet Res. 2019;21(12):e16630. doi: 10.2196/16630. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Quanbeck A, Chih MY, Isham A, Gustafson D. Mobile delivery of treatment for alcohol use disorders: a review of the literature. Alcohol Res. 2014;36(1):111–122. [PMC free article] [PubMed] [Google Scholar]
  • 23.Suffoletto B. Text message behavioral interventions: from here to where? Curr Opin Psychol. 2016;9:16–21. doi: 10.1016/j.copsyc.2015.09.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health. 2015;36:393–415. doi: 10.1146/annurev-publhealth-031914-122855. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Keoleian V, Polcin D, Galloway GP. Text messaging for addiction: a review. J Psychoactive Drugs. 2015;47(2):158–176. doi: 10.1080/02791072.2015.1009200. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Schwebel FJ, Larimer ME. Text message reminders as an adjunct to a substance use intervention for adolescents and young adults: pilot feasibility and acceptability findings. Digital Health. 2020;6:2055207620965052. doi: 10.1177/2055207620965052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Hutton A, Prichard I, Whitehead D, Thomas S, Rubin M, Sloand E, et al. mHealth interventions to reduce alcohol use in young people: a systematic review of the literature. Comp Child Adolescent Nurs. 2020;43(3):171–202. doi: 10.1080/24694193.2019.1616008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Bendtsen M. Text messaging interventions for reducing alcohol consumption among harmful and hazardous drinkers: protocol for a systematic review and meta-analysis. JMIR Res Protoc. 2019;8(4):e12898. doi: 10.2196/12898. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Muench F, van Stolk-Cooke K, Kuerbis A, Stadler G, Baumel A, Shao S, et al. A randomized controlled pilot trial of different mobile messaging interventions for problem drinking compared to weekly drink tracking. PLoS One. 2017;12(2):e0167900. doi: 10.1371/journal.pone.0167900. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Agyapong VI, Milnes J, McLoughlin DM, Farren CK. Perception of patients with alcohol use disorder and comorbid depression about the usefulness of supportive text messages. Technol Health Care. 2013;21(1):31–39. doi: 10.3233/THC-120707. [DOI] [PubMed] [Google Scholar]
  • 31.McGinnes RA, Hutton JE, Weiland TJ, Fatovich DM, Egerton-Warburton D. Review article: Effectiveness of ultra-brief interventions in the emergency department to reduce alcohol consumption: a systematic review. Emerg Med Australas. 2016;28(6):629–640. doi: 10.1111/1742-6723.12624. [DOI] [PubMed] [Google Scholar]
  • 32.Sharpe S, Kool B, Whittaker R, Lee AC, Reid P, Civil I, et al. Effect of a text message intervention to reduce hazardous drinking among injured patients discharged from a trauma ward: a randomized controlled trial. NPJ Digit Med. 2018;1(1):13. doi: 10.1038/s41746-018-0019-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Kool B, Smith E, Raerino K, Ameratunga S. Perceptions of adult trauma patients on the acceptability of text messaging as an aid to reduce harmful drinking behaviours. BMC Res Notes. 2014;7:4. doi: 10.1186/1756-0500-7-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Suffoletto B, Chung T, Muench F, Monti P, Clark DB. A text message intervention with adaptive goal support to reduce alcohol consumption among non-treatment-seeking young adults: non-randomized clinical trial with voluntary length of enrollment. JMIR Mhealth Uhealth. 2018;6(2):e35. doi: 10.2196/mhealth.8530. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Suffoletto B, Kristan J, Callaway C, Kim KH, Chung T, Monti PM, et al. A text message alcohol intervention for young adult emergency department patients: a randomized clinical trial. Ann Emerg Med. 2014;64(6):664–72.e4. doi: 10.1016/j.annemergmed.2014.06.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Blow FC, Walton MA, Bohnert ASB, Ignacio RV, Chermack S, Cunningham RM, et al. A randomized controlled trial of brief interventions to reduce drug use among adults in a low-income urban emergency department: the HealthiER You study. Addiction. 2017;112(8):1395–1405. doi: 10.1111/add.13773. [DOI] [PubMed] [Google Scholar]
  • 37.Ramsey AT, Satterfield JM, Gerke DR, Proctor EK. Technology-based alcohol interventions in primary care: systematic review. J Med Internet Res. 2019;21(4):e10859. doi: 10.2196/10859. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Thies K, Anderson D, Cramer B. Lack of adoption of a mobile app to support patient self-management of diabetes and hypertension in a federally qualified health center: interview analysis of staff and patients in a failed randomized trial. JMIR Hum Factors. 2017;4(4):e24. doi: 10.2196/humanfactors.7709. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Gilbody S, Littlewood E, Hewitt C, Brierley G, Tharmanathan P, Araya R, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ. 2015;351:h5627. doi: 10.1136/bmj.h5627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Schueller SM, Torous J. Scaling evidence-based treatments through digital mental health. Am Psychol. 2020;75(8):1093–1104. doi: 10.1037/amp0000654. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Graham AK, Lattie EG, Powell BJ, Lyon AR, Smith JD, Schueller SM, et al. Implementation strategies for digital mental health interventions in health care settings. Am Psychol. 2020;75(8):1080–1092. doi: 10.1037/amp0000686. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367. doi: 10.2196/jmir.8775. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Iribarren SJ, Sward KA, Beck SL, Pearce PF, Thurston D, Chirico C. Qualitative evaluation of a text messaging intervention to support patients with active tuberculosis: implementation considerations. JMIR Mhealth Uhealth. 2015;3(1):e21. doi: 10.2196/mhealth.3971. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Hermes E, Burrone L, Perez E, Martino S, Rowe M. Implementing Internet-based self-care programs in primary care: qualitative analysis of determinants of practice for patients and providers. JMIR Ment Health. 2018;5(2):e42. doi: 10.2196/mental.9600. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Langhan ML, Riera A, Kurtz JC, Schaeffer P, Asnes AG. Implementation of newly adopted technology in acute care settings: a qualitative analysis of clinical staff. J Med Eng Technol. 2015;39(1):44–53. doi: 10.3109/03091902.2014.973618. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Quanbeck A, Gustafson DH, Marsch LA, Chih MY, Kornfield R, McTavish F, et al. Implementing a mobile health system to integrate the treatment of addiction into primary care: a hybrid implementation-effectiveness study. J Med Internet Res. 2018;20(1):e37. doi: 10.2196/jmir.8928. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Nesvåg S, McKay JR. Feasibility and effects of digital interventions to support people in recovery from substance use disorders: systematic review. J Med Internet Res. 2018;20(8):e255. doi: 10.2196/jmir.9873. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Scarf D, Riordan B, Flett J, Conner T. Text message interventions for alcohol use: current research and future directions. 2016. pp. 187–191. [Google Scholar]
  • 49.Kitson A, Harvey G. Implementing evidence-based practice in healthcare: a facilitation guide. 2015. Facilitating an evidence-based innovation into practice; p. 85. [Google Scholar]
  • 50.Harvey G, Kitson AJIS. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11(1):33. doi: 10.1186/s13012-016-0398-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Swindle T, Johnson SL, Whiteside-Mansell L, Curran GM. A mixed methods protocol for developing and testing implementation strategies for evidence-based obesity prevention in childcare: a cluster randomized hybrid type III trial. Implement Sci. 2017;12(1):90. doi: 10.1186/s13012-017-0624-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Thompson GN, Estabrooks CA, Degner LF. Clarifying the concepts in knowledge transfer: a literature review. J Adv Nurs. 2006;53(6):691–701. doi: 10.1111/j.1365-2648.2006.03775.x. [DOI] [PubMed] [Google Scholar]
  • 53.Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ. A guide for applying a revised version of the PARIHS framework for implementation. Implement Sci. 2011;6(1):99. doi: 10.1186/1748-5908-6-99. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Engels Y, van den Hombergh P, Mokkink H, van den Hoogen H, van den Bosch W, Grol R. The effects of a team-based continuous quality improvement intervention on the management of primary care: a randomised controlled trial. Br J Gen Pract. 2006;56(531):781–787. [PMC free article] [PubMed] [Google Scholar]
  • 55.Liddy C, Laferriere D, Baskerville B, Dahrouge S, Knox L, Hogg W. An overview of practice facilitation programs in Canada: current perspectives and future directions. Healthcare Policy. 2013;8(3):58. [PMC free article] [PubMed] [Google Scholar]
  • 56.Nutting PA, Crabtree BF, Stewart EE, Miller WL, Palmer RF, Stange KC, et al. Effect of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Ann Fam Med. 2010;8(Suppl 1):S33–S44. doi: 10.1370/afm.1119. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.D’Onofrio G, Edelman EJ, Hawk KF, Pantalon MV, Chawarski MC, Owens PH, et al. Implementation facilitation to promote emergency department-initiated buprenorphine for opioid use disorder: protocol for a hybrid type III effectiveness-implementation study (Project ED HEALTH) Implement Sci. 2019;14(1):48. doi: 10.1186/s13012-019-0891-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Powell BJ, Fernandez ME, Williams NJ, Aarons GA, Beidas RS, Lewis CC, et al. Enhancing the impact of implementation strategies in healthcare: a research agenda. Front Public Health. 2019;7. [DOI] [PMC free article] [PubMed]
  • 59.Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, et al. Methods to improve the selection and tailoring of implementation Strategies. J Behav Health Serv Res. 2015;44(2):177–94. [DOI] [PMC free article] [PubMed]
  • 60.Ross J, Stevenson F, Dack C, Pal K, May C, Michie S, et al. Developing an implementation strategy for a digital health intervention: an example in routine healthcare. BMC Health Serv Res. 2018;18(1):794. doi: 10.1186/s12913-018-3615-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Zwerver F, Schellart T, R Anema J, C Rammeloo K, J van der Beek A. Intervention mapping for the development of a strategy to implement the insurance medicine guidelines for depression. BMC Public Health. 2011;11(9). [DOI] [PMC free article] [PubMed]
  • 62.Crowe C, Collie C, Johnson C, Wiltsey SS. An intervention mapping process to increase evidence-based psychotherapy within a complex healthcare system. Am Psychol. 2020;75(8):1116–1129. doi: 10.1037/amp0000631. [DOI] [PubMed] [Google Scholar]
  • 63.Fernandez ME, ten Hoor GA, van Lieshout S, Rodriguez SA, Beidas RS, Parcel G, et al. Implementation mapping: using intervention mapping to develop implementation strategies. Front Public Health. 2019;7. [DOI] [PMC free article] [PubMed]
  • 64.Handley MA, Gorukanti A, Cattamanchi A. Strategies for implementing implementation science: a methodological overview. Emerg Med J. 2016;33(9):660. doi: 10.1136/emermed-2015-205461. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Admin Pol Ment Health. 2011;38(1):44–53. doi: 10.1007/s10488-010-0314-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med. 1998;158(16):1789–1795. doi: 10.1001/archinte.158.16.1789. [DOI] [PubMed] [Google Scholar]
  • 67.Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. doi: 10.1186/s13012-017-0635-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health Ment Health Serv Res. 2015;42(5):533–544. doi: 10.1007/s10488-013-0528-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Benoot C, Hannes K, Bilsen J. The use of purposeful sampling in a qualitative evidence synthesis: a worked example on sexual adjustment to a cancer trajectory. BMC Med Res Methodol. 2016;16(1):21. doi: 10.1186/s12874-016-0114-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Green AE, Aarons GA. A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011;6:104. doi: 10.1186/1748-5908-6-104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Drabble L, Trocki KF, Salcedo B, Walker PC, Korcha RA. Conducting qualitative interviews by telephone: lessons learned from a study of alcohol use among sexual minority and heterosexual women. Qual Soc Work. 2016;15(1):118–133. doi: 10.1177/1473325015585613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Smith EM. Telephone interviewing in healthcare research: a summary of the evidence. Nurs Res. 2005;12(3):32–41. doi: 10.7748/nr2005.01.12.3.32.c5946. [DOI] [PubMed] [Google Scholar]
  • 73.Steffen KM, Holdsworth LM, Ford MA, Lee GM, Asch SM, Proctor EK. Implementation of clinical practice changes in the PICU: a qualitative study using and refining the iPARIHS framework. Implement Sci. 2021;16(1):15. doi: 10.1186/s13012-021-01080-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288. doi: 10.1177/1049732305276687. [DOI] [PubMed] [Google Scholar]
  • 75.Bengtsson M. How to plan and perform a qualitative study using content analysis. Nurs Plus Open. 2016;2:8–14. doi: 10.1016/j.npls.2016.01.001. [DOI] [Google Scholar]
  • 76.Erlingsson C, Brysiewicz P. A hands-on guide to doing content analysis. Afr J Emerg Med. 2017;7(3):93–99. doi: 10.1016/j.afjem.2017.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Curry L, Nunez-Smith M. Mixed methods in health sciences research: a practical primer. 1st Ed. Sage Publications, Inc; 2015.
  • 78.Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. [DOI] [PMC free article] [PubMed]
  • 79.Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implement Sci. 2013;8:139. doi: 10.1186/1748-5908-8-139. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Midboe AM, Martino S, Krein SL, Frank JW, Painter JT, Chandler M, et al. Testing implementation facilitation of a primary care-based collaborative care clinical program using a hybrid type III interrupted time series design: a study protocol. Implement Sci. 2018;13(1):145. doi: 10.1186/s13012-018-0838-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, et al. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9(1):132. doi: 10.1186/s13012-014-0132-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care–mental health. J Gen Intern Med. 2014;29(4):904–912. doi: 10.1007/s11606-014-3027-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Pearson N, Naylor P-J, Ashe MC, Fernandez M, Yoong SL, Wolfenden L. Guidance for conducting feasibility and pilot studies for implementation trials. Pilot Feasibility Stud. 2020;6(1):167. doi: 10.1186/s40814-020-00634-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res. 2011;45(5):626–629. doi: 10.1016/j.jpsychires.2010.10.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.McKay H, Naylor P-J, Lau E, Gray SM, Wolfenden L, Milat A, et al. Implementation and scale-up of physical activity and behavioural nutrition interventions: an evaluation roadmap. Int J Behav Nutr Phys Act. 2019;16(1):102. doi: 10.1186/s12966-019-0868-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health. 2019;7. [DOI] [PMC free article] [PubMed]
  • 87.Hermes ED, Lyon AR, Schueller SM, Glass JE. Measuring the implementation of behavioral intervention technologies: recharacterization of established outcomes. J Med Internet Res. 2019;21(1):e11752. doi: 10.2196/11752. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Donner A, Klar N. Pitfalls of and controversies in cluster randomization trials. Am J Public Health. 2004;94(3):416–422. doi: 10.2105/AJPH.94.3.416. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Chaudhary MA, Moulton LH. A SAS macro for constrained randomization of group-randomized designs. Comput Methods Prog Biomed. 2006;83(3):205–210. doi: 10.1016/j.cmpb.2006.04.011. [DOI] [PubMed] [Google Scholar]
  • 90.Bendtsen M, McCambridge J, Åsberg K, Bendtsen P. Text messaging interventions for reducing alcohol consumption among risky drinkers: systematic review and meta-analysis. Addiction. 2021;116(5):1021–33. [DOI] [PMC free article] [PubMed]
  • 91.Helfrich CD, Li Y-F, Sharp ND, Sales AE. Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009;4(1):38. doi: 10.1186/1748-5908-4-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Mastroleo NR, Celio MA, Barnett NP, Colby SM, Kahler CW, Operario D, et al. Feasibility and acceptability of a motivational intervention combined with text messaging for alcohol and sex risk reduction with emergency department patients: a pilot trial. Addict Res Theory. 2019;27(2):85–94. doi: 10.1080/16066359.2018.1444159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Sprinthall RC. Basic statistical analysis. London: Pearson; 2011. [Google Scholar]
  • 94.Westlund E, Stuart EA. The nonuse, misuse, and proper use of pilot studies in experimental evaluation research. Am J Eval. 2016;38(2):246–261. doi: 10.1177/1098214016651489. [DOI] [Google Scholar]
  • 95.Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10(1):1. doi: 10.1186/1471-2288-10-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Hospital Substance Use Disorder Policies and Procedures 2018. NY Pub Health Law (PHL) § 2803-U. https://www.health.ny.gov/facilities/public_health_and_health_planning_council/meetings/2018-04-12/docs/hosp_policies_subst_use_disorders_17-16.pdf. Accessed 1 Aug 2022.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not currently applicable. Data from the pilot trial will be available in the NIAAA data sharing archive: https://nda.nih.gov/niaaa/.


Articles from Implementation Science Communications are provided here courtesy of BMC

RESOURCES