Abstract
Background:
Extended-release injectable naltrexone (XR-NTX) is an effective treatment for opioid use disorder (OUD), but initiation remains a barrier to implementation. Standard practice requires a 10- to 15-day inpatient admission prior to XR-NTX initiation and involves a methadone or buprenorphine taper followed by a 7- to 10-day washout, as recommended in the Prescribing Information for XR-NTX. A 5- to 7-day rapid induction approach was developed that utilizes low-dose oral naltrexone and non-opioid medications.
Methods:
The CTN-0097 Surmounting Withdrawal to Initiate Fast Treatment with Naltrexone (SWIFT) study was a hybrid type I effectiveness-implementation trial that compared the effectiveness of the standard procedure (SP) to the rapid procedure (RP) for XR-NTX initiation across six community inpatient addiction treatment units, and evaluated the implementation process. Sites were randomized to RP every 14 weeks in an optimized stepped wedge design. Participants (target recruitment = 450) received the procedure (SP or RP) that the site was implementing at time of admission. The hypothesis was RP will be non-inferior to SP on proportion of inpatients who receive XR-NTX, with a shorter admission time for RP. Superiority testing of RP was planned if the null hypothesis of inferiority of RP to SP was rejected.
Discussion:
If RP for XR-NTX initiation is shown to be effective, the shorter inpatient stay could make XR-NTX more feasible and have an important public health impact expanding access to OUD pharmacotherapy. Further, a better understanding of facilitators and barriers to RP implementation can help with future translatability and uptake to other community programs.
Trial Registration:
NCT 04762537 Registered February 21, 2021.
Keywords: Opioid use disorder, Extended-release injectable naltrexone, Rapid induction procedure, Stepped wedge design, Hybrid effectiveness-implementation trial, Clinical trials network
1. Introduction
The opioid epidemic continues apace with over 100,000 drug overdose deaths in 2021, the majority related to opioids [1,2]. The three FDA-approved medications for opioid use disorder (MOUD) are the full opioid receptor agonist methadone, partial agonist buprenorphine, and antagonist naltrexone in extended-release injection formulation (XR-NTX). These medications are highly effective when taken as directed, promote abstinence from opioids, and protect against overdose [3–6]. Yet, the majority (78%) of individuals with opioid use disorder (OUD) are not on medication [1,7]. There is an urgent need to close this gap and scale up MOUD implementation. Recent large trials have shown that monthly XR-NTX injection, once initiated, is similar in effectiveness to daily sublingual buprenorphine maintenance [6,8], yet XR-NTX is the least utilized MOUD [9]. XR-NTX may be optimal for patients who seek relapse-prevention without opioid agonist treatment, or who have not responded well to previous trials of buprenorphine or methadone.
An important barrier to implementation of XR-NTX is the “induction hurdle,” namely that patients need to be withdrawn from opioids before initiating naltrexone to avoid precipitated withdrawal [10]. Current standard practice involves a 3- to 5-day taper of methadone or buprenorphine followed by a 7- to 10-day opioid-free period (washout) as recommended by the XR-NTX (Vivitrol®) Prescribing Information [11]. During this prolonged regimen, patients may struggle with opioid withdrawal or have difficulty remaining inpatient for other reasons and drop out of treatment. Evidence suggests XR-NTX initiation is more successful on an inpatient basis, where patients can be closely monitored and access to non-prescribed opioids is limited, particularly for more severely dependent patients [12]. However, longer (10- to 15-day) inpatient admissions are often not supported by third-party payors, nor well tolerated by patients.
Rapid procedures (5–7 days) for XR-NTX initiation have been developed and utilize the minimal necessary dose and duration of buprenorphine (typically one day), more aggressive use of non-opioid medications to manage withdrawal (i.e., clonidine and benzodiaze-pines), and gradual titration of low-dose oral naltrexone. Such rapid procedures have demonstrated feasibility and effectiveness in several trials [13–16], but have not been compared to the longer, standard approach on inpatient units in a large trial. We describe the methodology for a hybrid type I effectiveness-implementation trial conducted within the National Institute on Drug Abuse’s National Drug Abuse Treatment Clinical Trials Network (NIDA CTN) comparing the standard 10- to 15-day procedure (SP) for XR-NTX initiation to a rapid 5- to 7-day procedure (RP), in an optimized stepped wedge design [17]. The hypothesis was that RP will be non-inferior to SP on the primary outcome of proportion of patients initiated onto XR-NTX while inpatient, while requiring substantially fewer days from admission to XR-NTX initiation. Secondary implementation objectives focused on process evaluation and general feasibility and acceptability of RP. The larger goal was to develop a preliminary implementation facilitation package that could be tested in future trials and disseminated.
2. Methods
2.1. Overview of design and objectives
The NIDA CTN-0097 Surmounting Withdrawal to Initiate Fast Treatment with Naltrexone (SWIFT) study (NCT 04762537) was a hybrid type I effectiveness-implementation trial supported by the National Institutes of Health HEAL Initiative®. Patient recruitment (target of 450 participants) was conducted over 70 weeks at six community inpatient addiction treatment programs. Site randomization followed an optimized stepped wedge design with one site randomly selected at the start of the study to implement RP for the entirety of the trial [17] (Table 1). The remaining five sites implemented SP, or treatment as usual, at the start of the study. Sites were notified of RP randomization 8 weeks prior to active enrollment and started preparations for RP (pre-implementation phase). Participant enrollment for SP was still active during this 8-week preparatory phase. After 14 weeks of RP implementation (one step), one of the remaining five programs stepped into RP implementation, and that was repeated until five of the six sites were implementing RP. The remaining sixth site implemented SP for the entire study.
Table 1.
SP continued through the preparation or pre-implementation phase for Sites 2–5.
The primary effectiveness objective was to compare the 10- to 15-day SP to the novel 5- to 7-day RP on the primary outcome of inpatient XR-NTX initiation with the hypothesis that RP was non-inferior to SP. Superiority testing for RP was planned if the null hypothesis of inferiority of RP to SP was rejected. Secondary aims compared RP and SP on other clinical outcomes including time to receipt of first XR-NTX injection while inpatient, opioid cravings and withdrawal, adverse events, retention in study for second and third XR-NTX injections, and opioid and other substance use. Additional objectives were to explore participants’ baseline demographics and clinical features as predictors of XR-NTX initiation and other clinical outcomes.
This was a hybrid type 1 effectiveness-implementation trial thus the implementation process was evaluated secondary to the primary clinical effectiveness aim [18,19]. Implementation objectives included identifying barriers and facilitators to implementation and exploring promising strategies for RP implementation, with a larger goal of developing a preliminary implementation facilitation package for future testing and dissemination.
2.2. Site selection
Six sites were selected from sixteen NIDA CTN-affiliated community addiction treatment programs that applied to CTN-0097. Selected sites afforded geographic distribution across the United States (rural Pacific Northwest, rural Midwest, urban South-Central, urban Southeast, and suburban Mid-Atlantic and Northeastern regions). Site eligibility criteria included: ability to provide opioid detoxification services with inpatient or residential treatment stays for at least 14 days (to accommodate the standard procedures for XR-NTX initiation), offered a standard 10- to 15-day XR-NTX induction with buprenorphine taper followed by washout period, ability to provide follow-up outpatient care (medical management and counseling) and subsequent XR-NTX injections for at least 2 months after XR-NTX induction, ability to enroll 1–2 patients with OUD per week over the 70-week recruitment period, ability to enroll underinsured patients with the support of study funds, diverse patient population with respect to an adequate representation of women and minorities, capacity to provide evaluation and treatment for co-occurring psychiatric disorders or provide treatment referrals, agree to implement RP as the induction method for patients attempting to transition from active opioid use to XR-NTX, and site leadership interested in adopting and implementing RP for XR-NTX initiation. Sites were excluded that had experience implementing rapid procedures for XR-NTX initiation.
2.3. Participant eligibility criteria
Eligible participants were 18 years or older, English-speaking, met Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5) criteria for OUD [20], willing to undergo opioid detoxification and treatment with XR-NTX, able to consent within 4 days of admission on the inpatient unit, and were appropriate candidates for XR-NTX as per the clinician’s judgment. Exclusion criteria were serious medical or psychiatric conditions, suicidal or homicidal ideation, or other severe substance use disorders precluding study participation (i.e., requiring a higher or different level of care), receiving methadone maintenance treatment within 14 days of consent, receiving buprenorphine treatment prior to admission unless poor treatment response (i.e., non-adherence or active illicit opioid use warranting XR-NTX treatment trial), body habitus that precludes safe intramuscular injection of XR-NTX (i.e., body mass index (BMI) >40 lbs./in2), pain requiring opioid analgesics, legal status precluding study participation, psychosocial or legal circumstances that would threaten the feasibility of an inpatient XR-NTX induction, or known allergy or sensitivity to buprenorphine, naloxone, naltrexone, or components of the Vivitrol® (XR-NTX) diluent (e.g., polylactide-co-glycolide or carboxymethylcellulose). Females planning pregnancy, pregnant, breastfeeding, or not using an effective birth control method were excluded. These criteria aimed to include a broad range of subjects to adequately reflect this patient population.
2.4. Recruitment procedures
The target recruitment was 450 participants (225 SP; 225 RP) across six sites (75 participants per site). Recruitment strategies primarily involved approaching individuals seeking treatment at sites. Additionally, sites used advertisements and encouraged word-of-mouth referrals. Recruitment occurred during the SARS-CoV-2 pandemic and site-level infection policies, unit closures, staff shortages, and weekly recruitment numbers were monitored throughout the trial. Potential candidates could be approached for study participation up to seven days prior to admission, and within four days from inpatient admission. Clinical staff evaluated patients and potential candidates for XR-NTX through a shared decision-making process for MOUD options. If determined to be a candidate for XR-NTX, research staff met with the patient and obtained study consent. Participants received the XR-NTX initiation regimen (RP or SP) that was offered on site at time of admission (Fig. 1).
2.5. Site randomization
Site randomization was managed by an independent statistician and revealed randomization one site at a time for five sites that stepped into implementing RP (Table 1).
2.6. XR-NTX initiation procedures
2.6.1. Standard Procedure (SP)
SP was intended to reflect standard clinical practice, following a guideline of a 5-day buprenorphine taper (e.g., buprenorphine 8 mg on Day 1, 6 mg on Day 2, 4 mg on Day 3, 2 mg on Day 4, 1 mg on Day 5), then an 8-day opioid-free washout period, followed by XR-NTX administration when determined eligible by naloxone or oral naltrexone challenge (Table 2). Sites and their clinicians, not the study team, were responsible for patient care. SP varied according to sites’ standard clinical practices (i.e., longer opioid-free washout periods and/or variability in adjunctive medication regimens).
Table 2.
Standard Procedure | Buprenorphine | XR-NTX | PRN Adjunctive Medications |
---|---|---|---|
Days 1–5 | Dosing taper | – | X |
Days 6–13 | – | – | X |
Day 14 | − | 380 mg IM | X |
X = as needed adjunctive medications. Buprenorphine taper dosing varied based on sites’ clinical practices. An example buprenorphine taper was 8 mg on Day 1, 6 mg on Day 2, 4 mg on Day 3, 2 mg on Day 4, and 1 mg on Day 5.
2.6.2. Rapid Procedure (RP)
RP involved an initial day of buprenorphine dosing up to 10 mg, a 24-hour opioid-free washout period, and a 3- to 4-day low-dose oral naltrexone titration (from 0.5 mg to 6 mg) prior to XR-NTX administration (Table 3). Sites were provided with a procedural order set which they customized to their clinical workflow. The order set detailed buprenorphine dosing, scheduled and as needed non-opioid medications for reducing withdrawal symptoms, oral naltrexone and XR-NTX dose and timing. Non-opioid adjunctive medications included scheduled and as needed clonidine, clonazepam, antiemetics (i.e., prochlorperazine, ondansetron), sleep aids (i.e., zolpidem, trazodone), and ibuprofen and/or acetaminophen for mild pain and body aches. Opioid withdrawal symptoms were monitored using the Clinical Opiate Withdrawal Scale (COWS). Additional monitoring included vital signs, regular oral hydration with electrolyte-rich sports drinks to combat dehydration or clonidine-induced hypotension, and assessment of sedation, gait instability, and falls prevention. Buprenorphine dosing ranged from 2 mg to 10 mg, and higher doses were discouraged given the potential risk of precipitated withdrawal upon introduction of naltrexone. If patients received higher buprenorphine doses, or consecutive days of dosing, an extended opioid-free washout period could be implemented. Again, sites and their clinicians, not the study team, were responsible for patient care and exercised flexibility within RP guidelines, including shortening or extending the procedure as clinically indicated. Patient tolerability for advancing RP was determined by assessment of opioid withdrawal symptoms, with a goal of maintaining low severity or absent withdrawal symptoms during naltrexone uptitration. Conversely, if patients experienced an increase in opioid withdrawal symptoms, naltrexone titration could be extended. If a participant requested to leave the inpatient unit before initiating XR-NTX, clinicians weighed benefits of earlier XR-NTX administration and potential risks of precipitated opioid withdrawal symptoms versus offering another MOUD before inpatient discharge. Clinical staff on the units were coached to provide psychoeducational and supportive counseling on opioid withdrawal, management, medication side effects, and motivation enhancement therapy focused on adherence to induction procedures and XR-NTX initiation, or other MOUD if the participant did not pursue XR-NTX.
Table 3.
Rapid Procedure | Buprenorphine | 1st NTX dose | 2nd NTX dose | XR-NTX | Adjunctive Medications |
---|---|---|---|---|---|
Day 1 | 2–10 mg | – | – | – | X |
Day 2 | – | – | – | – | X |
Day 3 | – | 0.5 mg | 0.5 mg | – | X |
Day 4 | – | 1 mg | 1 mg | – | X |
Day 5 | – | 3 mg | 3 mg | – | X |
Day 6 | − | 6 mg | – | 380 mg IM | X |
X = scheduled adjunctive medications. Scheduled adjunctive medications included: clonidine 0.1–0.2 mg every four hours (with hold parameters for systolic blood pressure < 90 mmHg, or heart rate < 60 beats per minute), clonazepam 1 mg every six hours (with hold for oversedation), antinausea medication daily (prochlorperazine 10 mg or ondansetron 8 mg), sleep aid at bedtime (zolpidem 5–10 mg, trazodone 50–100 mg, or other sleep aids), and nicotine replacement therapy (patch and gum) if tobacco use. Additional doses of adjunctive medications could be given as needed and included antiemetics, sleep aids, and acetaminophen or ibuprofen.
2.7. Post-induction procedures
Participants that did not initiate XR-NTX were encouraged to initiate and/or continue other MOUD (buprenorphine or methadone) before discharge from inpatient care. After inpatient discharge, all participants were encouraged to continue MOUD and could receive up to two additional monthly XR-NTX injections provided by the study (Fig. 1). Discharge planning included referral to the unit’s affiliated outpatient service or other referrals as appropriate. Discharge counseling focused on MOUD adherence, risk of overdose for patients leaving the inpatient unit without initiating MOUD, education on potential protracted opioid withdrawal symptoms after first XR-NTX injection, and education on overdose prevention with naloxone. Discharge medications for protracted opioid withdrawal included tapered regimens of clonidine and clonazepam, antinausea medication, and sleep aids. Patients were also discharged with naloxone rescue kit(s) for opioid overdose prevention and nicotine replacement therapy for individuals with nicotine use.
Study assessment visits occurred at post-induction Weeks 1, 2, 3, 4, 6, and 8 (Fig. 1). Intensive efforts were made to contact and re-engage patients who discontinued study treatment.
2.8. Site-level implementation procedures
The uptake and implementation of RP required program-level change, intensive clinical monitoring, and development of new skills and procedures by clinical teams. Therefore, local implementation teams used different strategies to support adoption and implementation of RP. Strategies varied based on each site’s needs, staffing, and resources. Common implementation strategies employed by sites (Supplementary Table 1) included identification and preparation of local champions [21–23], forming clinical implementation teams, assessing readiness [24], identifying potential implementation barriers and facilitators [25], and dynamic training and development of clinical tools [26], train-the-trainer strategies [27–31], and as needed consultation with local clinicians or the Lead Node team [32]. The Lead Node team delivered virtual trainings for RP and conducted educational outreach visits [33] when feasible during the SARS-CoV-2 pandemic.
2.9. Assessments
The full schedule of assessments is included in Table 4. Participant assessments included baseline demographics, medical, psychiatric, drug use, treatment history, quality of life and current health status, COVID impact, motivation for treatment, and urine toxicology. Assessments during inpatient detoxification included daily monitoring of administered medications, opioid withdrawal symptoms (COWS), and vital signs harvested from the medical records. Other assessments included opioid cravings, targeted safety events (TSE), serious adverse events (SAE), and weekly monitoring of depression severity and general anxiety disorder symptoms. Fidelity to RP or SP clinical practices was assessed using a critical action checklist for each patient during the induction phase. Post-induction phase assessments included monitoring of self-reported drug use, opioid cravings and withdrawal, urine toxicology, TSEs, SAEs (including self-reported overdose events), and treatment received.
Table 4.
Assessment | Frequency |
---|---|
General Measures | |
Inclusion/exclusion | Screening |
Screening log | Throughout study |
Locator form | Screening, post-induction weeks 1, 2, 3, 4, 5 or EOM |
Demographics form | Consent, baseline |
PhenX Tier 1 assessments [60] | Baseline |
Prisoner status assessment | Baseline, post-induction Week 3 |
Motivation scale | Baseline |
COVID impact assessment | Baseline |
End of induction form | At discharge from inpatient detoxification unit |
End of medication treatment form | EOM |
Treatment satisfaction survey | Post-induction Week 8 |
Study completion form | Post-induction Week 8 or if early study termination |
Safety and Medical Measures | |
Medical and psychiatric history | Screening |
HIV and hepatitis assessments | Baseline |
Pregnancy and birth control assessment | Screening, before each XR-NTX injection |
Fagerström test for nicotine dependence (FTND) [61] | Baseline |
NIDA cannabis assessment | Baseline |
DSM-5 criteria [20] | Screening |
Generalized anxiety disorder (GAD-7) questionnaire [62] | Baseline, repeated weekly through induction phase, post-induction Weeks 1, 2, 3, 4, 5, 6, 8 |
Patient health questionnaire panic disorder (PHQ-PD) [63] | Baseline |
PTSD checklist for DSM-5 (PCL-5) [64] | Baseline |
ADHD self-report scale (ASRS) [65] | Baseline |
Daily medication administration log | Baseline, daily during induction phase |
Concomitant medications | Screening, Post-induction Weeks 1, 2, 3, 4, 6, 8 |
Adverse events and serious adverse events | Baseline, daily during induction phase, post-induction Weeks 1, 2, 3, 4, 6, 8 |
Medication injection site abnormality log | As needed throughout study |
Opioid overdose questionnaire | Baseline, post-induction Weeks 1, 2, 3, 4, 6, 8 or EOM |
Fatal opioid overdose form | As needed throughout study |
Death form | As needed throughout study |
Treatment Compliance Measures | |
Critical action checklist for RP/SP | Weekly during induction phase |
Medical management log | At each study visit |
Psychosocial participation log | At each study visit |
Outcome Measures | |
Timeline Followback (TLFB) for substance use [66] | Baseline, post-induction Weeks 1, 2, 3, 4, 6, 8 |
Timeline Followback (TLFB) for MOUD | Baseline, post-induction Weeks 1, 2, 3, 4, 6, 8 |
Urine drug screen (UDS) (with fentanyl testing) | Screening, before each XR-NTX injection |
Clinical opiate withdrawal scale (COWS) [67] | Baseline, daily or more frequently (depending on RP or SP) during induction phase |
Subjective opioid withdrawal scale (SOWS) [68] | Baseline, daily during induction phase, post-induction Weeks 1, 2, 3, 4, 6, 8 |
Visual analog scales (VAS) opioid craving | Baseline, daily during induction phase, post-induction Weeks 1, 2, 3, 4, 6, 8 |
Visual analog scales (VAS) opioid response | As needed throughout post-induction phase |
Patient health questionnaire for depression (PHQ-9) [69] | Baseline, weekly during induction phase, post-induction Weeks 1, 2, 3, 5, 6, 8 |
Mental health assessment (for suicidality) | As needed throughout the study |
Health Services Measures | |
Patient-reported outcomes measurement information (PROMIS) [70] | Baseline, post-induction Weeks 4, 8 |
Non-medical and other services (NMS) [71,72] | Baseline, post-induction Weeks 4, 8 |
Genetics Measures | |
Genetics sample | Baseline |
Family origin assessment | Baseline |
Implementation Process Measures | |
Organizational level clinical implementation data collection form | Every 14 weeks |
Individual staff readiness and preparedness rulers | Before RP training in 8-week pre-implementation phase and after 14-week step |
Organizational readiness to change assessment (ORCA) | Before RP training in 8-week pre-implementation phase and after 14-week step |
Organizational fidelity to pre-implementation checklist | After 8-week RP pre-implementation phase |
Organizational fidelity to implementation checklist | After 14-week step of RP implementation |
Site needs qualitative assessment | At start of 8-week RP pre-implementation phase |
Site implementation process qualitative notes | Frequency varied based on site-level implementation |
Individual staff semi-structured qualitative interviews | After 14-week step of RP implementation |
Abbreviations: RP = rapid induction procedure; SP = standard induction procedure; EOM = end of medication; XR-NTX = extended-release injectable naltrexone; NIDA = National Institute on Drug Abuse; DSM-5 = diagnostic and statistical manual of mental disorders fifth edition; PTSD = post-traumatic stress disorder; ADHD = attention deficit hyperactivity disorder; MOUD = medications for opioid use disorder.
Implementation process assessments included the number of patients admitted with OUD and the proportion inducted onto XR-NTX over each 14 week step at each site (organizational level clinical data collection form), staff readiness and preparedness for RP implementation (readiness and preparedness rulers and organizational readiness to change assessment (ORCA) [34]), and organizational fidelity to implementation checklists. Qualitative assessments included evaluation of site needs, implementation process observational notes, and semi-structured qualitative staff interviews. Semi-structured interviews focused on workflow changes for implementation of RP, barriers, facilitators, sustainability considerations, and impact of COVID.
2.10. Data and safety monitoring
The NIDA CTN Protocol Review Board reviewed the protocol during development, and the NIDA CTN Data Safety and Monitoring Board (DSMB) monitored the trial examining safety, trial performance and availability of outcome data. A NIDA-assigned Medical/Safety Monitor oversaw safety and evaluated TSEs and SAEs.
2.11. Statistical analysis
2.11.1. Primary and secondary outcomes
The primary outcome measure was a dichotomous measure of treatment initiation success defined as receipt of the first XR-NTX injection while inpatient (within 30 days from admission). The 30-day time frame allowed for inclusion of participants that may have prolonged inpatient admissions for varying circumstances, although this was uncommon. Failure to initiate XR-NTX while inpatient was subdivided for descriptive purposes into: 1) aborted the naltrexone initiation effort and initiated buprenorphine or methadone maintenance, 2) continued XR-NTX induction in outpatient setting, or 3) dropped out or discharged from the inpatient unit.
Secondary outcomes included time from inpatient admission to receipt of first XR-NTX injection, opioid cravings and withdrawal, safety events, retention in the trial to second and third XR-NTX injections, and opioid use as measured by self-reported days of opioid use and urine toxicology samples. Implementation outcomes focused on process evaluation and general feasibility and acceptability of RP (Table 5).
Table 5.
Domain | Data Source/Assessment |
---|---|
Reach | |
# of screen failures and reasons | Screening log |
# of OUD patients admitted and % enrolled in RP | Organizational level clinical implementation data collection |
# of RP participants and % induction failures (include patient characteristics) | End of induction form |
Effectiveness | |
# and % of patients successfully inducted onto XR-NTX by RP (include patient characteristics) | Organization level clinical implementation data collection |
# of days from admission to XR-NTX | Electronic medical record |
Fidelity to key RP components | Critical action checklist |
Opioid withdrawal symptoms during RP | COWS and SOWS |
Opioid cravings during RP | VAS |
Adverse effects for RP | Adverse and serious adverse events form |
Patient experience and treatment satisfaction | End of induction form and treatment satisfaction survey |
Adoption | |
# and % of staff (include characteristics) reporting readiness and preparedness (before and after 14-week step of implementation) | ORCA and readiness/preparedness rulers |
Qualitative assessment of staffs perspectives and experience | Semi-structured staff interviews |
Implementation | |
Staff (include characteristics) report on knowledge of intervention and implementation climate (before and after 14-week step of implementation) | ORCA |
# of clinicians on site-level implementation team | Fidelity to pre-implementation checklist |
# of non-clinical administrative leaders on site implementation team | Fidelity to pre-implementation checklist |
# and % of staff in attendance at RP trainings | Fidelity to pre-implementation checklist |
Hours of clinical consultation received per site | Meeting time logs |
Average rate of adherence to core components of RP | Critical Action Checklist |
Qualitative assessment of barriers and facilitators influencing implementation | Semi-structured staff interviews and implementation process notes |
Maintenance | |
Qualitative assessment of factors influencing maintenance and sustainability | Semi-structured staff interviews and implementation process notes |
Abbreviations: RP = rapid induction procedure; XR-NTX = extended-release injectable naltrexone; COWS = clinical opiate withdrawal scale; SOWS = subjective opiate withdrawal scale; ORCA = organizational readiness to change assessment.
2.11.2. Power and sample size
CTN-0097/SWIFT was designed as an optimized stepped wedge randomized trial [17], which maximized power to determine non-inferiority of RP versus SP. The probability of successful inpatient XR-NTX initiation was assumed to be 55% in the SP arm and 70% in the RP arm, for a treatment difference of 15% [35]. The non-inferiority margin was set at 10%, which corresponded to an odds ratio of 0.67 (proportion of success in RP = 0.45, proportion of success in SP = 0.55). To conclude that RP was non-inferior to SP, the lower bound of the two-sided 95% CI for the odds ratio for RP and SP had to be above 0.67. Observations were assumed to be equally correlated within site, regardless of time period. The intraclass correlation (ICC) (i.e., the correlation between two participants within the same site) was assumed to be 0.14 based on data from a previous trial [6]. Correlated binary data were simulated using the Parzen algorithm [36]. When designing the study, sensitivity power analyses were conducted for different values of the ICC, effect sizes, and number of sites. The optimized stepped wedge design with 6 sites and 5 periods of time (steps), enrolling a total of 450 participants (15 participants per site per step), was powered at 88% to show non-inferiority of RP to SP. The power was evaluated to be 88% or more irrespective of the value of the ICC. In addition, the study was adequately powered (80% or more) to account for simulated one site drop-out, lower rates of enrollment (10% or less) or for slightly smaller treatment effects (13% or 14%). Additional simulations were conducted to assess the impact of COVID assuming one to three sites may have reduced enrollment in the first two steps at the beginning of the study. Even with these enrollment simulations, the study maintained a high power of 79 or more.
2.11.3. Primary outcome analysis
The primary outcome analysis will use a generalized linear mixed effects model with a logistic link based on Hussey and Hughes [37]. The log odds of a participant receiving the first XR-NTX injection will be modeled as a function of the procedure received (RP versus SP), time (i.e., study month or step) to control for secular trends, and a random effect for site to control for nesting of participants within site. The null hypothesis of inferiority of RP to SP will be rejected if the lower 95% confidence limit of the odds ratio of success [odds(RP)/odds(SP)] exceeds 0.67. If the null hypothesis of inferiority is rejected, then superiority of RP will be tested. Constant correlation of observations within site will be assumed regardless of time period. Sensitivity analyses of the primary outcome will be performed to account for different correlation structures (23,24). Supportive analyses related to the primary objective will include testing for a fixed effect of treatment by time interaction, which if significant, would indicate differential impact of treatment across time. Subgroup analyses for age, sex, race, and ethnicity will be conducted.
2.11.4. Secondary outcome analysis
Secondary outcomes will be modeled using similar mixed effects methods as for the primary outcome, with the appropriate linear model for each outcome distribution.
2.11.5. Exploratory analysis
Exploratory analysis includes participant and site-level factors (such as staff knowledge and attitudes) as predictors or moderators of differences in successful XR-NTX initiation between SP and RP. Several patient-level factors are predicted to be associated with successful XR-NTX induction including severity of OUD based on route of use (intravenous (IV) use greater severity than non-IV), type of opioid (fentanyl, heroin, or prescription opioid) with fentanyl users being most severe and prescription opioid users least severe, as well as psychiatric and substance use disorder comorbidity. For the analysis, patient and site-level factors will be included in the primary outcome model (or secondary, if applicable) as covariates or covariate by treatment interactions.
2.11.6. Implementation process evaluation and qualitative analyses
Although not formally testing implementation strategies (consistent with type 1 hybrid study design), it was important to capture the implementation strategies for development of a preliminary implementation facilitation package for future replicability and testing [19,38–41]. Implementation strategies were tracked throughout the trial to the extent possible using a standardized taxonomy by Expert Recommendations for Implementation Change (ERIC) [42] and Proctor et al.’s reporting specifications [41].
Implementation outcomes will be evaluated using mixed methods analyses and the framework Reach, Efficacy, Adoption, Implementation, and Maintenance (RE-AIM) with an equity focus through comparison of patient and staff characteristics (Table 5) [43–45]. Rapid qualitative deductive analyses [46,47] will be conducted and guided by the Consolidated Framework for Implementation Research (CFIR); a conceptual framework that can be applied to organize implementation determinants across constructs: 1) intervention characteristics, 2) outer setting, 3) inner setting, 4) characteristics of individuals, and 5) implementation process [48,49].
2.11.7. Interim safety and efficacy analyses
One interim safety analysis was performed. The NIDA CTN DSMB evaluated this safety report to ensure the safety of study participants, and adequate trial performance and data collection. No efficacy interim analyses were planned for this trial.
2.11.8. Missing data and dropouts
Discontinuation of either RP or SP before receiving XR-NTX while inpatient for any reason (i.e., leaving the inpatient unit or switching to alternative MOUD) was considered induction failure for the primary outcome. Thus, the primary outcome, whether a participant received the first XR-NTX while inpatient, was not expected to have any missing data. Secondary and other outcomes (opioid and other substance use over time, craving, mood, etc.) may be missing due to missed visits, treatment discontinuation, or drop-out from the study participation. The mixed effects model framework will use all available data under the missing at random (MAR) assumption.
2.12. Trial status
Sites were identified and participation confirmed on May 29, 2020. Site training began with the first site on January 19, 2021 and the first 14-week step began on March 16, 2021. Active recruitment of participants into either RP or SP concluded on July 19, 2022. Follow-up patient visits for the post-induction phase concluded on September 21, 2022.
3. Discussion
Key study design considerations during development of CTN-0097/SWIFT included whether to conduct the trial in the outpatient or inpatient setting, patient-level versus site-level randomization, and hybrid effectiveness-implementation design. The inpatient setting was selected given substantial evidence that the success rate of XR-NTX initiation was low in outpatient settings among patients with more severe OUD (heroin or fentanyl use, IV use) [12]; who are at highest risk for overdose and the most immediate public health imperative. Such patients, with high levels of physiological tolerance and dependence, loss of control over opioid use, and psychosocial impairment, have difficulty participating in an XR-NTX induction regimen that requires stopping illicit opioids and following an elaborate outpatient medical schedule. RP has been moderately successful in an intensive outpatient setting with the frequent medical monitoring needed to keep patients comfortable and motivated [35]. However, this model does not routinely exist in community-based practice, challenging real-world translatability and sustainability, whereas medically oriented inpatient addiction treatment units are widespread and accustomed to closer medical monitoring and drug withdrawal regimens. Further, there is a need to change practices on these inpatient units with most programs tapering opioids (“detoxification”) and fewer than 20% of patients leaving these units on MOUD [50]; a practice associated with high risk for relapse and overdose death [51–54]. Demonstration of XR-NTX initiation in this trial could help shift practices on inpatient units to MOUD initiation, including buprenorphine or methadone [51,55,56]. Hence, site clinicians were encouraged to use a shared decision-making tool that reviewed MOUD options to determine who was a candidate for XR-NTX. MOUD initiation (buprenorphine, methadone, XR-NTX) while inpatient was encouraged for all patients. Any patients that elected XR-NTX treatment, and later changed their mind or failed initiation for other reasons, were encouraged to initiate buprenorphine or methadone while inpatient.
Patient-level randomization was considered and would have been more consistent with an efficacy or effectiveness aim. At a pragmatic level, patient-level randomization did not seem feasible due to likely confusion and cross-contamination if both RP and SP were conducted at the same time. Site-level randomization was ideal and could yield a more naturalistic sample as patients seeking XR-NTX simply consent to be followed throughout the initiation procedure that the unit is implementing, rather than consenting to individual-level randomization. Additionally, there was prior evidence on feasibility and effectiveness of RP [12,15,35], and the next important step was to test implementation in the community in a hybrid effectiveness-implementation study design [18,19,39,57]. RP implementation at the program level requires buy-in across leadership and clinical staff, a shift in practices, and differing site-level strategies to facilitate implementation. Given that these implementation strategies had not yet been studied, a hybrid type 1 effectiveness-implementation design was selected to test effectiveness on patient level outcomes (primary objective) while evaluating the implementation process (secondary objective) [18,19].
A stepped wedge randomized design was chosen rather than a parallel cluster-randomized design. The parallel group design has stronger internal validity and is not subject to threats such as secular changes in patient populations and their outcomes over time that can cloud the interpretation of stepped wedge trials [37,58]. A parallel group design would also require a larger sample of treatment programs, thus increasing cost of the trial and logistics. In comparison, the stepped wedge design required fewer resources and supported a comprehensive evaluation of the implementation process at each site, one at a time. Sites were expected to encounter different implementation challenges and employ various strategies to overcome these. It was important to capture these process data and explore implementation strategies for RP to inform development of a preliminary implementation package, and ultimately, improve translatability to naturalistic treatment settings [19,39].
The primary outcome, XR-NTX initiation while inpatient, was chosen as it seemed the most immediate, concrete aim of standard and rapid procedures. It addresses the imperative that patients with OUD do not leave the inpatient unit without starting MOUD [51,55,56]. Whether inpatient XR-NTX initiation is followed by adherence to subsequent engagement in outpatient care and monthly XR-NTX injections was also important given that patients are at risk for attrition and overdose [59], and this was included as a secondary outcome. While inpatient length-of-stay and other factors may have an impact, outpatient adherence is largely influenced by factors not under the control of the inpatient procedures, and separate studies of procedures to improve adherence to outpatient MOUD are needed.
A non-inferiority hypothesis was chosen for the primary outcome analysis, rather than superiority. We expected the RP to have a higher XR-NTX initiation success rate than SP and the estimate of the difference and its confidence limits will be presented. Prior evidence suggested the difference could be small and require a very large sample size to be confident of power to detect superiority. However, if the null hypothesis of inferiority of RP to SP is rejected, then superiority of RP will be tested. Regardless of superiority testing, RP has an inherent advantage in feasibility and cost with a shorter inpatient length-of-stay. Thus, if RP is shown to be roughly comparable in XR-NTX initiation to SP with a non-inferiority test, it could be recommended based on the shorter length of stay.
The design of the CTN-0097/SWIFT trial illustrates challenges encountered in evaluating a complex intervention along the spectrum of effectiveness to implementation. It is hoped that the findings will guide the field on how best to initiate XR-NTX, provide a better understanding of barriers and facilitators to the uptake of XR-NTX, and train clinicians and treatment programs in RP.
Supplementary Material
Acknowledgments
The study was supported by the National Institutes of Health HEAL Initiative® UG1 DA013035-19. The first author was supported by grant T32 DA007294 through the National Institute on Drug Abuse (NIDA). The Emmes Clinical Coordinating Center was funded by Contract No. 75N95020D00012 for August 2020 to August 2025 and Contract No. HHSN271201500065C for August 2015 to August 2020. The Emmes Data and Statistics Center was funded by Contract No. 75N95019D00013/TO6 75N95019F00093.
We gratefully acknowledge the support of the National Institutes of Health (NIH) and National Institute on Drug Abuse (NIDA), The Emmes Company, LLC, and Alkermes Inc. for donating Vivitrol® for this study. We are grateful for the contributions of the participants, the sites, and the staff involved in this study. The views and opinions expressed in this manuscript are those of the authors only and do not necessarily represent the views, official policy or position of the U.S. Department of Health and Human Services or any of its affiliated institutions or agencies. Dr. Ghitza was substantially involved in UG1 DA013035-19, consistent with his role as NIDA Scientific Officer.
Declaration of Competing Interest
The authors declare the following financial interests/personal relationships which may be considered as potential competing interests:
Dr. Adam Bisaga has participated as an unpaid consultant to Alkermes, Inc., received grant funding (through the institution) from Alkermes, Inc., has served as an investigator on a multi-site clinical trial funded by Alkermes, Inc., and has received medication for NIDA-funded studies from Alkermes, Inc.
Dr. Edward V. Nunes has been a Principal Investigator or Co-Investigator on studies that received donated or discounted medication from Alkermes, Inc., Indivior Inc. (formerly Reckitt-Benckiser) and Braeburn-Camurus, Inc. (CAM-2038), and donated digital therapeutic from Pear Therapeutics and CHESS Health. Dr. Nunes has served as an uncompensated consultant to Alkermes, Inc., Braeburn-Camurus Inc., Indivior, and Pear Therapeutics. He has no relevant equity, intellectual property, compensated consulting, travel, or other arrangements with any of these entities.
Dr. John Rotrosen has been a Principal Investigator or a Co-Investigator on studies for which support in the form of donated or discounted medication, smartphone apps, and/or funds has been, or is provided by Alkermes, Inc. (Vivitrol®, extended-release injectable naltrexone), Indivior, Inc. (formerly Reckitt-Benckiser; Suboxone®, buprenorphine/naloxone combination), Braeburn-Camurus, Inc. (extended-release injectable buprenorphine), Pear Therapeutics (smartphone apps ReSET and ReSET-O), CHESS Health (Connections smartphone app), and Data Cubed (smartphone apps SOAR and mSAP-PORT). None of this support has gone, or will go, directly to Dr. Rotrosen, rather to either NYU, or to NIDA/NIH, or to NIDA’s contractor Emmes, Inc. Dr. Rotrosen recently served in a non-paid capacity as a member of an Alkermes, Inc. study Steering Committee. He has no relevant equity, intellectual property, compensated consulting, travel or other arrangements with any of these entities.
Dr. Marc Fishman has served as a consultant for Alkermes, Inc. and Drug Delivery LLC, and an investigator on a study funded by Alkermes, Inc.
The remaining authors have no conflicts of interest to report.
Abbreviations:
- FDA
United States Food and Drug Administration
- XR-NTX
extended-release injectable naltrexone
- NIH
National Institutes of Health
- HEAL
Initiative®, Helping to End Addiction Long-term Initiative
- NIDA
National Institute on Drug Abuse
- CTN
Clinical Trials Network
- SWIFT
Surmounting Withdrawal to Initiate Fast Treatment with Naltrexone
- OUD
opioid use disorder
- MOUD
medication for opioid use disorder
- RP
Rapid Procedure
Footnotes
Ethics approval and consent to participate
This study was approved by Biomedical Research Alliance of New York (BRANY), submission 20-PRS-526. Informed consent was obtained from all relevant participants.
CRediT author statement
Miranda G. Greiner: Methodology, Data Curation (qualitative, implementation-related data), Writing – Original Draft, Visualization.
Matisyahu Shulman: Conceptualization, Methodology, Data Curation (qualitative, implementation-related data), Writing – Original Draft, Visualization, Funding acquisition.
Onumara Opara: Data Curation (qualitative, implementation-related data), Writing – Original Draft, Visualization, Project administration.
Kenzie Potter: Data Curation (qualitative, implementation-related data), Writing – Original Draft, Visualization.
Delia C. Voronca: Methodology, Validation, Formal analysis, Writing – Original Draft, Visualization.
Hiwot M. Tafessu: Formal analysis, Writing – Reviewing & Editing.
Kathryn Hefner: Software, Resources, Data Curation, Project administration, Supervision, Writing – Reviewing & Editing.
Amy Hamilton: Data Curation, Writing – Reviewing & Editing.
Christina Scheele: Software, Resources, Data Curation, Project administration.
Rachel Ho: Software, Resources, Data Curation, Project administration.
Lauren Dresser: Resources, Project administration, Writing – Reviewing & Editing.
Eve Jelstrom: Resources, Supervision, Project administration, Writing – Reviewing & Editing.
Marc Fishman: Conceptualization, Methodology, Investigation, Supervision, Writing – Review & Editing.
Udi E. Ghitza: Conceptualization, Methodology, Supervision, Writing – Review & Editing, Project administration.
John Rotrosen: Conceptualization, Methodology, Writing – Review & Editing, Supervision, Project administration, Funding acquisition.
Edward V. Nunes: Conceptualization, Methodology, Supervision, Writing – Original Draft, Visualization, Supervision, Funding acquisition.
Adam Bisaga: Conceptualization, Methodology, Supervision, Writing – Original Draft, Visualization, Supervision, Funding acquisition.
Appendix A. Supplementary data
Supplementary data to this article can be found online at https://doi.org/10.1016/j.cct.2023.107148.
Data availability
No data was used for the research described in the article.
Availability of data and materials
The sharing of data and materials follows the NIH Data Sharing Policy and Implementation Guidance and the NIH HEAL Public Access and Data Sharing Policy. Final results of the study will be reported in ClinicalTrials.gov, consistent with the requirements of the Policy on the Dissemination of NIH-Funded Clinical Trial Information and the Clinical Trials Registration. Primary data for this study will be available to the public in the NIDA data repository, per NIDA CTN policy. The primary outcome(s) publication will be included along with the study underlying primary data in the data share repository, and it will also be deposited in PubMed Central per NIH policy.
References
- [1].Substance Abuse and Mental Health Services Administration, Key Substance Use and Mental Health Indicators in the United States: Results from the 2019 National Survey on Drug Use and Health, Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration., Rockville, MD, HHS Publication No. PEP20–07–01–001 [Online]. Available: https://www.samhsa.gov/data, 2019. [Google Scholar]
- [2].Ahmad F, Rossen L, Sutton P, Drug Overdose Death Counts, CDC National Center for Health Statistics, 2022. https://www.cdc.gov/nchs/nvss/vsrr/drug-overdose-data.htm (accessed May 14, 2022).
- [3].Mattick RP, Kimber J, Breen C, Davoli M, Buprenorphine maintenance versus placebo or methadone maintenance for opioid dependence, Cochrane Database Syst. Rev no. 3 (2004) CD002207, 10.1002/14651858.CD002207.pub2. [DOI] [PubMed] [Google Scholar]
- [4].Mattick RP, Breen C, Kimber J, Davoli M, Methadone maintenance therapy versus no opioid replacement therapy for opioid dependence, Cochrane Database Syst. Rev no. 2 (2003) CD002209, 10.1002/14651858.CD002209. [DOI] [PubMed] [Google Scholar]
- [5].Comer SD, et al. , Injectable, sustained-release naltrexone for the treatment of opioid dependence: a randomized, placebo-controlled trial, Arch. Gen. Psychiatry 63 (2) (Feb. 2006) 210, 10.1001/archpsyc.63.2.210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [6].Lee JD, et al. , Comparative effectiveness of extended-release naltrexone versus buprenorphine-naloxone for opioid relapse prevention (X:BOT): a multicentre, open-label, randomised controlled trial, Lancet Lond. Engl 391 (10118) (2018) 309–318, 27, 10.1016/S0140-6736(17)32812-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [7].Williams AR, Nunes EV, Bisaga A, Levin FR, Olfson M, Development of a Cascade of Care for Responding to the opioid epidemic, Am. J. Drug Alcohol Abuse 45 (1) (2019) 1–10, 10.1080/00952990.2018.1546862. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [8].Tanum L, et al. , Effectiveness of injectable extended-release naltrexone vs daily buprenorphine-naloxone for opioid dependence: a randomized clinical noninferiority trial, JAMA Psychiatry 74 (12) (2017) 1197–1205, 10.1001/jamapsychiatry.2017.3206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [9].National Survey of Substance Abuse Treatment Services (N-SSATS): 2020. Data on Substance Abuse Treatment Facilities, Substance Abuse and Mental Health Services Administration, Rockville, MD, 2021. [Online]. Available: https://www.samhsa.gov/data/sites/default/files/reports/rpt35313/2020_NSSATS_FINAL.pdf. [Google Scholar]
- [10].Bisaga A, et al. , Antagonists in the medical management of opioid use disorders: historical and existing treatment strategies, Am. J. Addict 27 (3) (2018) 177–187, 10.1111/ajad.12711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [11].Vivitrol (naltrexone for extended-release injectable suspension) Intramuscular: Prescribing Guidelines, Alkermes, 2022. [Online]. Available, https://www.accessdata.fda.gov/drugsatfda_docs/label/2010/021897s015lbl.pdf.
- [12].Shulman M, et al. , Patient characteristics associated with initiation of XR-naltrexone for opioid use disorder in clinical trials, Drug Alcohol Depend. 233 (Apr. 2022), 109343, 10.1016/j.drugalcdep.2022.109343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [13].Mannelli P, Patkar AA, Peindl K, Gorelick DA, Wu L-T, Gottheil E, Very low dose naltrexone addition in opioid detoxification: a randomized, controlled trial, Addict. Biol 14 (2) (Apr. 2009) 204–213, 10.1111/j.1369-1600.2008.00119.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Mannelli P, Wu L-T, Peindl KS, Swartz MS, Woody GE, Extended release naltrexone injection is performed in the majority of opioid dependent patients receiving outpatient induction: a very low dose naltrexone and buprenorphine open label trial, Drug Alcohol Depend. 138 (May 2014) 83–88, 10.1016/j.drugalcdep.2014.02.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [15].Sigmon SC, Bisaga A, Nunes EV, O’Connor PG, Kosten T, Woody G, Opioid detoxification and naltrexone induction strategies: recommendations for clinical practice, Am. J. Drug Alcohol Abuse 38 (3) (May 2012) 187–199, 10.3109/00952990.2011.653426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [16].Sullivan MA, et al. , Long-acting injectable naltrexone induction: a randomized trial of outpatient opioid detoxification with naltrexone vs. buprenorphine, Am. J. Psychiatry 174 (5) (May 2017) 459–467, 10.1176/appi.ajp.2016.16050548. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [17].Thompson JA, Fielding K, Hargreaves J, Copas A, The optimal design of stepped wedge trials with equal allocation to sequences and a comparison to other trial designs, Clin. Trials Lond. Engl 14 (6) (Dec. 2017) 639–647, 10.1177/1740774517723921. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C, Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact, Med. Care 50 (3) (Mar. 2012) 217–226, 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [19].Landes SJ, McBain SA, Curran GM, An introduction to effectiveness-implementation hybrid designs, Psychiatry Res. 280 (Oct. 2019), 112513, 10.1016/j.psychres.2019.112513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [20].American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders, Fifth edition, American Psychiatric Association, 2013, 10.1176/appi.books.9780890425596. [DOI] [Google Scholar]
- [21].Flodgren G, O’Brien MA, Parmelli E, Grimshaw JM, Local opinion leaders: effects on professional practice and healthcare outcomes, Cochrane Database Syst. Rev 6 (Jun. 2019) CD000125, 10.1002/14651858.CD000125.pub5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [22].Rogers E, Diffusion of Innovations, 5th edition, Simon & Schuster, New York, NY, US, 2003. [Google Scholar]
- [23].Simon HA, Administrative Behavior: A Study of Decision-Making Processes in Administrative Organizations, 4th edition, The Free Press of Simon & Schuster, New York, NY, US, 1997. [Google Scholar]
- [24].Miake-Lye IM, Delevan DM, et al. , Unpacking organizational readiness for change: an updated systematic review and content analysis of assessments, BMC Health Serv. Res 20 (2020) 106, 10.1186/s12913-020-4926-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Fernandez ME, et al. , Implementation mapping: using intervention mapping to develop implementation strategies, Front. Public Health 7 (2019), 10.3389/fpubh.2019.00158. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [26].Gigùere A, et al. , Printed educational materials: effects on professional practice and healthcare outcomes, Cochrane Database Syst. Rev 8 (Jul. 2020) CD004398, 10.1002/14651858.CD004398.pub4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [27].Yarber L, et al. , Evaluating a train-the-trainer approach for improving capacity for evidence-based decision making in public health, BMC Health Serv. Res 15 (Dec. 2015) 547, 10.1186/s12913-015-1224-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [28].Triplett NS, Sedlar G, Berliner L, Jungbluth N, Boyd M, Dorsey S, Evaluating a train-the-trainer approach for increasing EBP training capacity in community mental health, J. Behav. Health Serv. Res 47 (2) (Apr. 2020) 189–200, 10.1007/s11414-019-09676-2. [DOI] [PubMed] [Google Scholar]
- [29].Pearce J, Mann MK, Jones C, van Buschbach S, Olff M, Bisson JI, The most effective way of delivering a train-the-trainers program: a systematic review, J. Contin. Educ. Heal. Prof 32 (3) (2012) 215–226, 10.1002/chp.21148. [DOI] [PubMed] [Google Scholar]
- [30].Luo Z, Gardiner JC, Smith RC, Costs of a train-the-trainer program to teach primary care faculty mental health care, Med. Care 59 (11) (Nov. 2021) 970–974, 10.1097/MLR.0000000000001621. [DOI] [PubMed] [Google Scholar]
- [31].Forsetlund L, et al. , Continuing education meetings and workshops: effects on professional practice and healthcare outcomes, Cochrane Database Syst. Rev 9 (Sep. 2021) CD003030, 10.1002/14651858.CD003030.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [32].Beidas RS, Edmunds JM, Marcus SC, Kendall PC, Training and consultation to promote implementation of an empirically supported treatment: a randomized trial, Psychiatr. Serv. Wash. DC 63 (7) (Jul. 2012) 660–665, 10.1176/appi.ps.201100401. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [33].O’Brien MA, et al. , Educational outreach visits: effects on professional practice and health care outcomes, Cochrane Database Syst. Rev no. 4 (Oct. 2007) CD000409, 10.1002/14651858.CD000409.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [34].Helfrich CD, Li Y-F, Sharp ND, Sales AE, Organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action on research in health services (PARIHS) framework, Implement. Sci 4 (1) (Jul. 2009) 38, 10.1186/1748-5908-4-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [35].Sullivan M, et al. , Long-acting injectable naltrexone induction: a randomized trial of outpatient opioid detoxification with naltrexone versus buprenorphine, Am. J. Psychiatry 174 (5) (May 2017) 459–467, 10.1176/appi.ajp.2016.16050548. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [36].Parzen M, et al. , A generalized linear mixed model for longitudinal binary data with a marginal logit link function, Ann. Appl. Stat 5 (1) (2011) 449–467, 10.1214/10-AOAS390. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [37].Hussey MA, Hughes JP, Design and analysis of stepped wedge cluster randomized trials, Contemp. Clin. Trials 28 (2) (Feb. 2007) 182–191, 10.1016/j.cct.2006.05.007. [DOI] [PubMed] [Google Scholar]
- [38].Alexander JA, Hearld LR, Methods and metrics challenges of delivery-system research, Implement. Sci 7 (1) (Mar. 2012) 15, 10.1186/1748-5908-7-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [39].Glasgow RE, Lichtenstein E, Marcus AC, Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition, Am. J. Public Health 93 (8) (Aug. 2003) 1261–1267, 10.2105/ajph.93.8.1261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [40].Powell BJ, et al. , Methods to improve the selection and tailoring of implementation strategies, J. Behav. Health Serv. Res 44 (2) (Apr. 2017) 177–194, 10.1007/s11414-015-9475-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [41].Proctor EK, Powell BJ, McMillen JC, Implementation strategies: recommendations for specifying and reporting, Implement. Sci 8 (1) (Dec. 2013) 139, 10.1186/1748-5908-8-139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [42].Powell BJ, et al. , A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project, Implement. Sci 10 (1) (Feb. 2015) 21, 10.1186/s13012-015-0209-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [43].Glasgow RE, Vogt TM, Boles SM, Evaluating the public health impact of health promotion interventions: the RE-AIM framework, Am. J. Public Health 89 (9) (Sep. 1999) 1322–1327, 10.2105/ajph.89.9.1322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [44].Shelton RC, Chambers DA, Glasgow RE, An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time, Front. Public Health 8 (2020), 10.3389/fpubh.2020.00134. Accessed: Jan. 12, 2023. [Online]. Available:. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [45].Glasgow RE, et al. , RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review, Front. Public Health 7 (2019) 64, 10.3389/fpubh.2019.00064. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [46].Nevedal AL, et al. , Rapid versus traditional qualitative analysis using the consolidated framework for implementation research (CFIR), Implement. Sci 16 (1) (Jul. 2021) 67, 10.1186/s13012-021-01111-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [47].Hamilton AB, Finley EP, Qualitative methods in implementation research: an introduction, Psychiatry Res. 280 (Oct. 2019), 112516, 10.1016/j.psychres.2019.112516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [48].Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC, Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science, Implement. Sci 4 (1) (Aug. 2009) 50, 10.1186/1748-5908-4-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [49].Damschroder LJ, Hagedorn HJ, A guiding framework and approach for implementation research in substance use disorders treatment, Psychol. Addict. Behav. J. Soc. Psychol. Addict. Behav 25 (2) (Jun. 2011) 194–205, 10.1037/a0022284. [DOI] [PubMed] [Google Scholar]
- [50].Walley AY, et al. , Association between mortality rates and medication and residential treatment after in-patient medically managed opioid withdrawal: a cohort analysis, Addiction 115 (8) (Aug. 2020) 1496–1508, 10.1111/add.14964. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [51].Stein M, Herman D, Conti M, Anderson B, Bailey G, Initiating buprenorphine treatment for opioid use disorder during short-term in-patient ‘detoxification’: a randomized clinical trial, Addiction 115 (1) (2020) 82–94, 10.1111/add.14737. [DOI] [PubMed] [Google Scholar]
- [52].Nunes EV, et al. , Relapse to opioid use disorder after inpatient treatment: protective effect of injection naltrexone, J. Subst. Abus. Treat 85 (Feb. 2018) 49–55, 10.1016/j.jsat.2017.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [53].Bailey GL, Herman DS, Stein MD, Perceived relapse risk and desire for medication assisted treatment among persons seeking inpatient opiate detoxification, J. Subst. Abus. Treat 45 (3) (Sep. 2013) 302–305, 10.1016/j.jsat.2013.04.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [54].Ravndal E, Amundsen EJ, Mortality among drug users after discharge from inpatient treatment: an 8-year prospective study, Drug Alcohol Depend. 108 (1–2) (Apr. 2010) 65–69, 10.1016/j.drugalcdep.2009.11.008. [DOI] [PubMed] [Google Scholar]
- [55].Friedmann PD, Suzuki J, More beds are not the answer: transforming detoxification units into medication induction centers to address the opioid epidemic, Addict. Sci. Clin. Pract 12 (1) (Nov. 2017) 29, 10.1186/s13722-017-0092-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [56].Nunes EV, et al. , Relapse to opioid use disorder after inpatient treatment: protective effect of injection naltrexone, J. Subst. Abus. Treat 85 (2018) 49–55, 10.1016/j.jsat.2017.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [57].Peek CJ, Glasgow RE, Stange KC, Klesges LM, Purcell EP, Kessler RS, The 5 R’s: an emerging bold standard for conducting relevant research in a changing world, Ann. Fam. Med 12 (5) (Sep. 2014) 447–455, 10.1370/afm.1688. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [58].Hemming K, Taljaard M, Forbes A, Analysis of cluster randomised stepped wedge trials with repeated cross-sectional samples, Trials 18 (1) (Mar. 2017) 101, 10.1186/s13063-017-1833-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [59].Wakeman SE, et al. , Comparative effectiveness of different treatment pathways for opioid use disorder, JAMA Netw. Open 3 (2) (Feb. 2020) e1920622, 10.1001/jamanetworkopen.2019.20622. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [60].Hamilton CM, et al. , The PhenX toolkit: get the most from your measures, Am. J. Epidemiol 174 (3) (Aug. 2011) 253–260, 10.1093/aje/kwr193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [61].Fagerstrom KO, Schneider NG, Measuring nicotine dependence: a review of the Fagerstrom tolerance questionnaire, J. Behav. Med 12 (2) (Apr. 1989) 159–182, 10.1007/BF00846549. [DOI] [PubMed] [Google Scholar]
- [62].Spitzer RL, Kroenke K, Williams JBW, Löwe B, A brief measure for assessing generalized anxiety disorder: the GAD-7, Arch. Intern. Med 166 (10) (May 2006) 1092–1097, 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- [63].Wittkampf KA, Baas KD, van Weert HC, Lucassen P, Schene AH, The psychometric properties of the panic disorder module of the patient health questionnaire (PHQ-PD) in high-risk groups in primary care, J. Affect. Disord 130 (1–2) (Apr. 2011) 260–267, 10.1016/j.jad.2010.10.030. [DOI] [PubMed] [Google Scholar]
- [64].Weathers F, Litz B, Keane T, Palmieri P, Marx B, Schnurr P, The PTSD Checklist for DSM-5 (PCL-5) [Online]. Available: www.ptsd.va.gov, 2013.
- [65].van de Glind G, et al. , Validity of the adult ADHD self-report scale (ASRS) as a screener for adult ADHD in treatment seeking substance use disorder patients, Drug Alcohol Depend. 132 (3) (Oct. 2013) 587–596, 10.1016/j.drugalcdep.2013.04.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [66].Sobell L, Sobell M, Alcohol timeline Followback (TLFB), in: Handbook of Psychiatric Measures, American Psychiatric Association, Washington, D.C., 2000, pp. 477–479. [Google Scholar]
- [67].Tompkins DA, Bigelow GE, Harrison JA, Johnson RE, Fudala PJ, Strain EC, Concurrent validation of the clinical opiate withdrawal scale (COWS) and single-item indices against the clinical institute narcotic assessment (CINA) opioid withdrawal instrument, Drug Alcohol Depend. 105 (1–2) (Nov. 2009) 154–159, 10.1016/j.drugalcdep.2009.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [68].Handelsman L, Cochrane KJ, Aronson MJ, Ness R, Rubinstein KJ, Kanof PD, Two new rating scales for opiate withdrawal, Am. J. Drug Alcohol Abuse 13 (3) (1987) 293–308, 10.3109/00952998709001515. [DOI] [PubMed] [Google Scholar]
- [69].Kroenke K, Spitzer RL, Williams JB, The PHQ-9: validity of a brief depression severity measure, J. Gen. Intern. Med 16 (9) (Sep. 2001) 606–613, 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [70].Cella D, et al. , The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008, J. Clin. Epidemiol 63 (11) (Nov. 2010) 1179–1194, 10.1016/j.jclinepi.2010.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [71].Wallihan DB, Stump TE, Callahan CM, Accuracy of self-reported health services use and patterns of care among urban older adults, Med. Care 37 (7) (Jul. 1999) 662–670, 10.1097/00005650-199907000-00006. [DOI] [PubMed] [Google Scholar]
- [72].Harlow SD, Linet MS, Agreement between questionnaire data and medical records. The evidence for accuracy of recall, Am. J. Epidemiol 129 (2) (Feb. 1989) 233–248, 10.1093/oxfordjournals.aje.a115129. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The sharing of data and materials follows the NIH Data Sharing Policy and Implementation Guidance and the NIH HEAL Public Access and Data Sharing Policy. Final results of the study will be reported in ClinicalTrials.gov, consistent with the requirements of the Policy on the Dissemination of NIH-Funded Clinical Trial Information and the Clinical Trials Registration. Primary data for this study will be available to the public in the NIDA data repository, per NIDA CTN policy. The primary outcome(s) publication will be included along with the study underlying primary data in the data share repository, and it will also be deposited in PubMed Central per NIH policy.