Skip to main content
PLOS One logoLink to PLOS One
. 2025 Sep 29;20(9):e0330882. doi: 10.1371/journal.pone.0330882

Advancing person-centered care: Protocol for quality measurement and management (QM2) in the New York State system for opioid use disorder treatment

Sugy Choi 1, Sueun Hong 1, Adetayo Fawole 1, Andrew Heck 2, Pat Lincourt 2, Ashly E Jordan 2, Shazia Hussain 2, Megan A O’Grady 3, Yuhua Bao 4, Charles M Cleland 1, Samrachana Adhikari 1, Magdalena Cerda 1, Noa Krawczyk 1, Kelly Kyanko 1, Jennifer McNeely 1, Chinazo Cunningham 2, Tod Mijanovich 5, Renata Howland 1, Olivia Thornburg 2, Morica Hutchinson 3, Edward Liebmann 6, Charles J Neighbors 1,*
Editor: Katherine Demi Kokkinias7
PMCID: PMC12478935  PMID: 41021571

Abstract

Introduction

The United States is facing an opioid use disorder (OUD) epidemic, marked by unprecedented overdose death rates. In New York State, synthetic opioids significantly contribute to the increasing overdose deaths, disproportionately impacting Black and Latinx communities. There is an urgent need to address issues related to equitable access to and the quality of care provided by substance use disorder (SUD) treatment programs. In light of this, the Quality Measurement and Management Research Center (QM2-RC) brought together an academic-government partnership to develop a person-centered quality measurement system and to assess its impact on a statewide treatment system that serves approximately 180,000 individuals per year.

Methods and analysis

The QM2-RC encompasses three interconnected projects (Project 1, 2, and 3) aimed at developing a quality management strategy and evaluating its impact on system performance across New York State. This report specifically focuses on Project 3, which involves a stepped-wedge trial with 35 clinics receiving a quality management intervention that includes performance coaching. This intervention will be compared to a treatment-as-usual (TAU) condition for clinics not participating in the trial. Administrative data will be utilized to monitor outcomes over four years. The coaching intervention, guided by the Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) model, emphasizes interpreting quality measures and applying insights to enhance care. Coaches will provide support on data utilization, patient-centered care, harm reduction strategies, and the use of patient monitoring tools. The trial aims to evaluate clinic staff and leadership attitudes, experiences, and behaviors through surveys, semi-structured interviews, and external facilitator notes. Primary clinic outcomes will be assessed through adverse events, decreased clinic rates of substance use related emergency department visits and hospitalizations as well as mortality among patients within the first 12 months after admission to treatment after adjusting for individual and community level characteristics. This study is being developed over a multi-year period and will be informed by a mixed-methods approach incorporating multiple data sources, qualitative interviews, patient and clinic surveys. The study is being conducted in partnership with New York State Office of Addiction Services and Supports (OASAS) and will be informed by input from patient, providers, health insurers, family members and local governing units.

Discussion

Project 3 of the QM2 study specifically targets key barriers in measuring the quality of SUD treatment, including technological limitations, unvalidated measures, workforce data literacy, and concerns about fairness in assessing clinical complexity. Through the implementation of a stepped-wedge trial involving 35 clinics, the project aims to develop new quality measures, offer performance feedback, and engage clinic leadership and staff in efforts to improve practices. The ultimate goal of Project 3 is to overcome these barriers, promote person-centered care, and improve SUD treatment practices across New York State.

Introduction

The United States is facing an opioid overdose epidemic, with high overdose rates. In 2021, 107,622 individuals died of an overdose, which is largely associated with increasing range of synthetic substances in the illegal drug supply [1]. New York State in particular is experiencing a marked rise in synthetic opioids and overdose deaths, with nearly 5,000 attributed to opioids in 2021, accounting for approximately 68% of the increase in opioid overdose deaths between 2019 and 2021 [2]. This crisis is disproportionately affecting Black and Latinx individuals, highlighting disparities in the impact of the epidemic on communities of color [39]. Black and Latinx people who use drugs (PWUD) have been especially affected by the contamination of other substances with synthetic opioids [8]. The rising overdose rates [10,11] raise important questions about equitable access to treatment and the quality of care for individuals with substance use disorder (SUD) [2], particularly in high-impact areas such as New York state with a high number of opioid use and its consequences including opioid use disorder (OUD) [1214]. OUD is associated with high morbidity and mortality including overdose death [1521].

SUD treatment programs have the potential to deliver evidence-based interventions, including medication for OUD (MOUD), integrated mental health care, and recovery or supportive services, which can be lifesaving for highly stigmatized individuals such as Black and Latinx PWUD. However, previous systematic reviews have identified deficiencies in the quality of care provided by SUD treatment programs across the United States, as well as limited infrastructure and capacity to support continuous clinical improvement [2232]. While there is variability in quality across clinics, low treatment retention [24,3338], limited utilization of evidence-based practice [22,23] (e.g., MOUD), and disregard of patient preferences and perspectives have been widely documented [3942].

Multiple studies have documented racial and ethnic disparities in quality of care, finding lower retention and poorer outcomes from SUD treatment for Black and Latinx patients compared to non-Latinx White patients [4353]. Treatment programs located within communities made up predominantly of people of color tend to offer fewer and lower-quality treatment services [54]. Non-Latinx White patients clients are more likely to receive care that matches their needs [43,55]. Indeed, the most obvious reason for racial disparities in treatment outcomes may be that treatment programs are not routinely using evidence-based treatment practices [31,43,51,5659]. For example, opioid treatment programs (OTPs) that treated a higher percentage of Black clients were more likely to dispense doses that were too low to be effective [60].

Quality measurement and reporting offers a means of holding the treatment system accountable to service users, regulators, and payors and of improving care. Despite continued calls for the development of SUD treatment quality measures, there is a dearth of generally accepted and validated measures to guide measurement and management strategies [22,27,6163]. The National Quality Forum (NQF) recently convened two expert panels to provide recommendations on measurement development in response to the opioid epidemic [64,65]. The panel called for a quality measurement approach that is aligned with a chronic care approach to SUD/OUD treatment, with an expanded focus on treatment processes including person-centered care, measurement-based care, harm reduction, integrated care for comorbid conditions, and attention to care for special populations that are traditionally underserved, namely pregnant individuals and justice-involved populations.

The creation of actionable and implementable quality measurement and management (QM2) systems in the SUD treatment context have been hampered by three limitations. First, limited access to data and resources required to conduct measure validation has been a major barrier to developing quality measures, as requested by stakeholders [6668]. As a consequence, SUD quality measures often rely on administrative and/or insurance claims data with a limited amount of data sources. While claims provide a readily available set of clinical data for each healthcare encounter, the billing process introduces delays in data availability, limiting the utility of quality measures for informing current quality improvement efforts [66]. In addition, claims data lack detailed information on the types of practices used for services like mental health counseling and fail to support quality measures based on patient outcomes or experience [69].

Second, SUD treatment programs’ capacities to interpret and use quality measures for clinical care improvement may be limited [22,2428]. The SUD treatment workforce often lacks adequate education and professional training to effectively implement process change initiatives designed to enhance clinical outcomes [22,26,27,70]. An ideal QM2 study would promote the incorporation of quality measures into a culture of continued learning and adaptation [22,71]. However, limited research exists on how to best guide SUD treatment programs to use learning systems and data-driven quality improvement efforts [72,73] Research has shown that SUD treatment clinics require external support and guidance to adopt system improvement practices [7478]. Many clinics face significant challenges in adopting these process improvement practices, including the commitment required by staff, scarce resources to implement burdensome processes, detailed data requirements, and issues with long-term sustainability [72,76,79].

Lastly, SUD treatment programs have concerns about the fairness of quality measures. One significant concern is the variability in clinical complexity, which may hinder the ability of programs to deliver consistent levels of care and potentially diminish an individual’s capacity to respond effectively to treatment [80]. Some complexities relate to health status, such as comorbid physical and mental health conditions [8183]. Other factors affecting clinical client complexity involve social determinants of health at the person level (e.g., low educational attainment, homelessness) and the community within which the patient lives [8486]. These complexities can create greater barriers to treatment engagement or have distinct effects on outcomes [80,87,88]. Similarly, patients living in communities with large social vulnerabilities face additional challenges that can affect their ability to benefit from treatment [89,90]. Some programs providing treatment for marginalized clients from highly stressed communities may present as performing poorly yet serve a vital role in providing services [9193]. Consequently, programs advocate for the presentation of quality measures that are adjusted to account for the specific challenges faced by their patients and communities, such as socioeconomic factors, health disparities, and access to care.

The QM2 Study is a five-year NIH-funded center grant consisting of three projects aimed at building and testing an evidence-based QM2 study for person-centered treatment – a collaborative approach to individualized treatment. The first project of QM2 aims to develop and test a new set of quality measures for the substance use treatment system in New York State. The measure constructs will be created in conjunction with stakeholders (e.g., people who use treatment services, clinicians, and payers) to select and refine quality measures that span person-centered care, evidence-based practice, and harm-reduction approaches. This set of measures directly addresses the concerns raised in prior discussions by ensuring that quality measures are tailored to the specific challenges faced by patients and communities, accounting for factors such as patient preferences, health disparities, and access to care. The second project of the QM2 involves revising a patient-reported outcome measure for substance use disorder that was previously developed by our team. This measure is designed to capture the patient’s own perceptions of their treatment experience, including their satisfaction, engagement, and perceived outcomes. It will be refined to better reflect the diverse experiences of individuals in the treatment system, helping to assess the effectiveness of person-centered care strategies. The revised measure will play a crucial role in the QM2 study by offering insights into how well the treatment system aligns with patient needs, preferences, and goals, thereby guiding future improvements in care delivery.

This protocol pertains to the third project, which involves a stepped-wedge clinical trial. It will examine the impact of the QM2 study, incorporating new and revised measures developed in the first two projects. This study is registered on ClinicalTrials.gov under the identifier NCT06408233.

We will initiate a stepped wedge randomized controlled trial involving 1) 35 clinics receiving a performance coaching intervention and 2) a treatment as usual (TAU) condition for all clinics not participating in the intervention. Additionally, qualitative interviews with stakeholders and surveys of all 550 outpatient clinics will be conducted at three different points in time (years 1, 3, and 4). We will use administrative data from 2021–2027, including records from the Office of Addiction Services and Supports (OASAS) treatment registry, Medicaid, and vital statistics, to monitor client outcomes. This concurrent mixed-methods study [94] will evaluate the impact of the OASAS QM2 strategy on patient outcomes and statewide stakeholders, focusing on retention in care and adverse events (emergency department visits, hospitalizations, and mortality). Clinics will be randomized to one of five sequences, varying the timing of the intervention between years 2 and 4.

Materials and methods

Project 3 aims: Conduct a stepped-wedge trial that includes two conditions: 1) 35 clinics receiving a performance coaching intervention and 2) a treatment as usual (TAU) condition for all clinics not participating in the intervention to examine the effect of the OTP intervention on THD, retention in care, and adverse events

The SPIRIT checklist was used as a guide for reporting this study protocol (Fig 1). To assess the impact of the OASAS QM2 strategy on care retention and adverse events using a stepped-wedge, mixed-methods design across SUD treatment clinics. Clinics will be recruited to participate in this stepped wedge trial by State partners via email invitations, announcements via State listservs, and announcements at relevant meetings to contact the Project Manager or the Principal Investigators. A total of 35 clinics will be recruited after October 2025. The aim of the intervention is to help clinical staff interpret their quality measures and implement subsequent quality improvement efforts through facilitators. The intervention will be six months long for each clinic and be informed by the i-PARIHS model [95].

Fig 1. SPIRIT diagram for the QM2 Study.

Fig 1

i-PARIHS posits that optimal implementation occurs when practice facilitation promotes the acceptance and use of a new practice innovation by tailoring it to the recipient’s specific needs [95,96]. Facilitators are the active ingredient that help navigate individuals and teams through complex change processes by addressing a) the innovation’s degree of fit within the existing practice, b) the motivations, beliefs, goals, characteristics, and resources of the intervention recipients, and c) the inner and outer context in terms of leadership support, culture, past innovation experiences, the learning environment, organizational priorities, capacity for change, regulatory/policy drivers, incentives/mandates, and system stability/instability. Facilitators or coaches will support clinic staff examination and interpretation of the quality measures and encourage systematic adjustments to clinical and program procedures and workflows to improve care. The coaches will be trained social workers and are trained in quality improvement practices and data management as well as relevant clinical topics and will receive regular supervision by the study team. Specifically, coaches will facilitate: 1) Understanding, visualizing, and utilizing data to monitor system change and create measurable impact; 2) Providing patient-centered care, conducting patient-centered consultations and matching interventions to patient preferences, values, and goals; 3) Incorporating harm reduction strategies for SUD treatment programs; and 4) Using a patient monitoring tool for measurement-based care. The coaches will also be involved in creating training modules for the intervention.

Before the trial begins, clinics receiving the QM2 intervention will be randomized into six cohorts of six-month long interventions over three years. Clinics are randomized to onset of intervention in one of six time periods over the three years of the intervention rollout (years 2–4 of the project) and tracked using administrative data. Administrative data will be used for all clinic clients during each of the seven six-month periods (n ≈ 350/clinic) will be drawn from administrative data. The first six-month period will be a baseline prior to any intervention. Six clinics will be assigned randomly to one of six time periods for onset of intervention. Using administrative data, we will track clients within each clinic over four years, including a pre-intervention six-month baseline period. During the same four-year period, clients in clinics not participating in the stepped-wedge trial will be tracked to better understand changes in outcomes under treatment as usual (TAU) and to compare the outcomes of those clinics with clinics receiving the quality management intervention. We anticipate a final study population of approximately 91,000 individuals per year who are receiving treatment from one of the 571 enrolled outpatient substance use treatment programs. Because this is a stepped-wedge trial, all clinics (and as a result all clients within the clinics) will eventually get the intervention, the randomization will have to do with when the clinic is randomized rather than being assigned to a control or intervention group. Fig 2 illustrates the structure of the stepped-wedge trial.

Fig 2. Stepped-Wedge Trial Diagram.

Fig 2

The intervention will be delivered to clinic leadership and staff. Zoom meetings with program directors will confirm enrollment and outline the timeline and expectations. We will use maximum variation purposeful sampling by recruiting clients from participating clinics in urban and rural locations as well as areas with variation in population characteristics. Clinic recruitment will be stratified by region (downstate, central, and western New York). Eligible clinics are OASAS-licensed specialty SUD outpatient programs serving at least 50 OUD clients annually. Further, we will recruit clients who are on a variety of MOUD schedules and ensure that we have representation based on gender, race, and ethnicity.

We will examine clinic staff and leadership’s perceptions of the intervention using surveys and semi-structured interviews [9799]. The Klein implementation survey [100,101] will be administered to clinic staff at 6-months post-intervention. Semi-structured interviews (n = 72) will be conducted with at least one clinical and one member of clinic executive leadership at each clinic at the end of the six-month intervention phase. An interview guide will be created to reflect the dimensions of the i-PARIHS model [102105]. In order to inform replication and dissemination of this intervention model, the Coaches will complete logs after each interaction with a study site [97]. Master’s-level interviewers with qualitative experience, supervised by Drs. O’Grady and Choi, will conduct all ~ 60-minute interviews. Field notes will be recorded post-interview.

Component 1: Conduct qualitative interviews with stakeholders at years 1, 3 and 4 to examine clinic staff and leadership attitudes, experiences, and behaviors related to implementing the clinic intervention

We will recruit at least 50 participants per year in years 1, 3, and 4 of the project for 1:1 semi structured qualitative interviews until saturation is reached. Semi-structured interviews (n = 72) will be conducted with stakeholders. This includes at least one clinical and one member of outpatient executive leadership at each clinic at the end of the six-month intervention phase. An interview guide will be created to reflect the dimensions of the Health Equity Implementation Framework (HEIF), including patient-provider encounter factors from the Kilbourne framework as well as implementation factors from the i-PARIHS model. Client interviews (n = 40) from participating clinics will explore experiences related to quality of care in SUD treatment program, notably among Black/African American and Latinx clients.

Component 2: Conduct surveys of clinics in years 1, 3, and 5 of the project to examine changes over time in the effects of the QM2 study on programs

OASAS will conduct surveys of all 550 outpatient clinics in years 1, 3, and 5 of the project. The surveys will explore change over time in provider practices (e.g., harm reduction strategies, evidence-based practices, quality improvement activities) and environmental influences related to the OASAS QM2 study (e.g., related experiences with patients/families and insurers, development of performance-based contracts). OASAS regularly surveys all clinics within its system to assess system needs. Historically, the response rate for these survey was about 60%. Surveys will be administered through the OASAS online survey data collection portal. The surveys will address the extent to which the new measures are used in quality improvement, and the burden of collecting using qualitative measures.

Data and analytic plans

Project 3: Stepped-wedge trial.

Quantitative Methods: We will utilize Generalized Linear Mixed Models (GLMMs), which are commonly applied in the analysis of stepped-wedge trial [106,107]. The models will be structured as follows:

F(μijk)=μ+βj+δXij+αi+ϕik, αi~N(0,τα2), γij~N(0,τϕ2)

where βj represents a fixed effect for time, Xij is an indicator for intervention in clinic i at time j (coded 0 for the control condition, then 1 from the start of the intervention in the clinic until the end of the study), and δ denotes the intervention effect. The models include random effects to account for clustering at both the clinic and individual patient levels, which are assumed to follow a normal distribution with mean zero and variances τα2 and τϕ2, respectively. We will estimate the intervention effect while controlling for secular trends and adjusting for clustering within clinics (αi) and individual (ϕik), using mixed effects modeling with a binary distribution and logit link function. The models will be fitted using the glmmTMB package in R software [108,109]. The primary outcome will be adverse events, and the fixed-effects coefficients for the intervention effect, exponentiated, will indicate the extent to which the intervention changes the rate of adverse events. An offset term can be included to capture client differences in time at risk due to timing of treatment entry.

TAU clinics will be included in the model with an indicator variable. A post-hoc test of the intervention effect coefficient will compare TAU and performance coaching, and a TAU-by-time interaction will assess time trends within the TAU group. The GLMM analysis will be expanded by adding the clinics not receiving the performance coaching intervention during the study period. For TAU clinics, the intervention indicator will be coded 0 in all periods. This provides an additional estimate of trends (βj) in outcomes in a much larger sample of clinics. Because the fixed effect for time (βj) is estimated, the intervention effect (δ) can be interpreted as the degree to which performance coaching results in a lower rate of adverse events than what would be expected due to time alone in the absence of intervention.

If we observe significant treatment effects (e.g., reduced adverse events) from the performance coaching intervention, we will conduct follow-up analyses to strengthen causal inference. Drawing on methods from treatment mechanism research, we will test whether hypothesized mediators (e.g., person-centered care, retention in treatment) are associated with outcomes. We will also examine moderation by population characteristics and regional variation (e.g., gender, location), as well as provider-level differences in implementation. Lagged treatment effects will be assessed using interaction terms between treatment and time since intervention start by cohort. These exploratory analyses will inform interpretation and guide qualitative inquiry.

Data and specification:

We will join multiple administrative data sources from New York State for years 2021–2027 to form our analytical dataset. We will use Client Data System (CDS), Medicaid claims, and NYS vital statistics data to form the analytic dataset. The OASAS treatment registry (CDS) will provide extensive clinical data on clients at treatment admission and will include descriptions of providers through the provider data system (PDS). Medicaid will provide medical diagnoses, healthcare services, SUD treatment services, and medication utilization data. The New York State Vital Statistics will be received from the outpatient clinics in the form of all-cause mortality for clients participating in the trial. Additional OASAS data will provide operational and staffing information for each clinic. To date, 75% of clients in the OASAS registry have been linked to Medicaid claims data.

Quality measures from Project 1 will encompass patient, clinic, and organizational factors, including demographics, clinical complexity, substance use patterns, prior healthcare utilization, community access, substance use trends, resources, psychosocial interventions, clinic structure, staffing, and MOUD use and retention. Primary outcomes include adverse events, healthcare utilization, and mortality. Adverse events are defined as SUD-related hospitalizations or emergency department visits, including overdose, within 12 months of treatment entry. Healthcare utilization includes all-cause emergency department visits or hospitalizations within the same timeframe. Mortality will be assessed as all-cause mortality. Outcome variables will be risk-adjusted to account for client health status.

Statistical Analyses of the Proposed Stepped-Wedge Trial: Analyses will begin with examination variable distributions, appropriate transformations, and patterns for, followed by formal imputation methods if needed [110112]. We will use Generalized Linear Mixed Models (GLMM) for the stepped-wedge design [106].

Power Analysis for Primary Outcome Statistical power: Power estimation for specific outcomes was conducted using PASS 2022 software and Monte Carlo simulation [113]. Sample size and baseline rates (μ) were estimated using administrative data. For 80% power, α = 0.05, ICC = 0.05, and a 5-crossover-point stepped-wedge-RCT with 7 clinics starting at each point, power calculations indicate 80% power to detect a small decrease (RR = 0.93) in adverse events with 35 clinics and 350 clients per clinic per 6-month period (n ≈ 73,500 total observations). This corresponds to a decrease from 0.23 to 0.21 events per 6 months. In racial/ethnic subgroups (10% of clients, n ≈ 35 per site), power remains 80% to detect a modest decrease (OR=0.78), from 0.23 to 0.18.

Component 1: Qualitative interviews.

We will use an iterative coding process, where initial stakeholder interviews develop the coding scheme, which will be refined as saturation is reached. Subsequent transcripts will be compared to ensure consistent code assignment. As new concepts emerge, the coding structure will be adapted. Grounded theory principles will guide iterative data collection and analysis, with interviews evolving based on emerging themes. Constant comparative analysis will be employed for coding and theme development, and memo writing will follow each interview. The research team will review initial codes, select core categories at data saturation, and complete advanced theoretical coding to ensure logical and comprehensive analysis [114]. After the team has reviewed the coding structure and all interviews have been reviewed in depth by two researchers, trained project staff will independently code all transcripts using the final coding scheme. Twenty percent of the transcripts will be double coded to assess inter-coder agreement. Any differences in coding will be discussed and resolved after discussion with the investigators. Data will be entered into a qualitative software program (Dedoose) [115] to facilitate organization and retrieval. We also will create an analysis audit trail to document all analytic decisions. Targeted analyses will examine the consistency of the data across groups of interviewees. When coding is complete, the team will meet to review summaries of the qualitative results and refine hypotheses about the factors affecting use of the QM2 study.

Qualitative Analysis: The semi-structured interviews will be transcribed and analyzed using directed content analysis to identify key facilitators, barriers, and experiences related to the performance coaching intervention [116,117].

Data will be managed using Dedoose software, with field notes taken immediately after each interview. Initial interviews will help develop the coding scheme, and subsequent transcripts will be compared to ensure consistency. As new concepts emerge, the coding structure will be adjusted. Data collection and analysis will be iterative, with interviews modified to reflect emerging themes. After reviewing the coding structure for logical consistency, two researchers will thoroughly examine all interviews before trained project staff independently code all transcripts. To assess inter-coder agreement, 20% of transcripts will be double-coded. Any coding discrepancies will be discussed and resolved with the investigators. An analysis audit trail will be created to document all analytic decisions. Targeted analyses will assess data consistency within sites and identify themes distinguishing high and low-performing clinics. Once coding is complete, the team will review qualitative summaries and refine hypotheses regarding factors and strategies that contribute to successful outcomes or present barriers. For the quantitative survey results, group means and standard deviations will be calculated.

Component 2: Survey data.

We will examine within interview period (i.e., cross sectional) and across time (i.e., longitudinal) variation in provider behavioral and environmental influences. Survey data will be linked to the administrative data described above so that we can model clinic variation while adjusting for clinic, client, and community characteristics. We will begin by looking at within interview period descriptive data to examine variation across clinics across survey measures. We will then apply GLMM to examine the observed variation while adjusting for clinic, client, and community characteristics. The models will take the form F(Yij)= α+ βj+ β1C+ β2P+ β3E+ ej, where Yij is the survey measure of interest for clinic i at time j, βj is a fixed effect for time, C is a matrix of measures for clinic characteristics, P is a matrix of measures for clinic client characteristics, and E is a matrix of measures for community factors. For examination of change in practices and environmental influences over time, we use GLMMs with random effects for clinic to account for repeated observations. The parameter of interest will be βj.

Ethics approval

Ethics approvals have been obtained from the Institutional Review Board (IRB) of NYU Langone Health, which is overseeing all participating sites: New York State OASAS, University of Connecticut (UConn Health), and Weill Cornell Medicine (WCM). The IRBs at NYU Langone Health and WCM have determined that the research conducted at WCM does not involve human subjects, thus no reliance agreement exists between these two IRBs. However, there is a reliance agreement in place with OASAS and UConn Health. All participants involved in surveys and interviews will provide written or verbal informed consent. Written consent will be collected for in-person data collection, while verbal consent will be obtained for remote or telephone-based interactions, documented by the study team in a secure tracking system, and witnessed by a second team member when possible. The use of administrative data will not require individual consent, as it will be de-identified and used in accordance with institutional and state data-sharing agreements. Retrospective data will be accessed for research purposes starting October 1, 2025, following clinic recruitment. During data collection and analysis, authors may have access to personally identifiable information. Data use agreements with OASAS ensure compliance with all relevant privacy and confidentiality standards.

Dissemination

This study will adhere to the NIH Public Access Policy, ensuring public access to the published results of NIH-funded research. The trial has been registered with the ClinicalTrials.gov database (#NCT060823). Data generated from this study will be presented at national or international conferences and published promptly. Any published data presentations will be communicated to participants and other stakeholders involved in the trial. All final peer-reviewed manuscripts resulting from this proposal will be submitted to the digital archive PubMed Central. Additionally, the results of this project will leverage OASAS’s investment in its new QM2 strategy and policy leadership.

Status and timeline

The stepped-wedge trial is projected to begin in July, 2025. We anticipate completing participant recruitment by October 2025, data collection by December 2026, and expect to have preliminary results available by August 2027.

Conclusion

Quality measurement and improvement in OUD treatment are impeded by several obstacles, particularly in resource-constrained environments. These challenges include insufficient technological capacity due to limited funding, a lack of validated quality measures for specialty SUD treatment, workforce difficulties in data management resulting from inadequate training resources, and concerns from clinic leadership about the fairness of performance assessments that fail to consider the clinical complexity of their clients. To address these challenges, this study will implement the QM2 intervention, which aims to provide performance feedback to clinic leadership and staff to encourage practice improvements and to publicize quality measures for public accountability. The intervention will develop and utilize risk-adjusted quality measures that consider the clinical complexity of clients, thereby ensuring a fair evaluation of clinic performance. By tackling these barriers, the QM2 intervention seeks to promote person-centered care and contribute to the growing body of literature on effective quality improvement strategies in SUD treatment.

Supporting information

S1 File. SPIRIT Checklist.

(PDF)

pone.0330882.s001.pdf (544KB, pdf)

Data Availability

No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.

Funding Statement

This work was supported by the National Institutes of Health (NIH), National Institute on Drug Abuse (NIDA) under grant number RM1DA059377 to CN, CB, PL, and RM. There was no additional external funding received for this study. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.CDC/National Center for Health Statistics. U.S. Overdose Deaths In 2021 Increased Half as Much as in 2020 – But Are Still Up 15%. https://www.cdc.gov/nchs/pressroom/nchs_press_releases/2022/202205.htm
  • 2.New York State Comptroller. Continuing Crisis Drug Overdose Deaths in New York. https://www.osc.state.ny.us/files/reports/pdf/drug-overdose-deaths.pdf
  • 3.Goedel WC, Shapiro A, Cerdá M, Tsai JW, Hadland SE, Marshall BDL. Association of Racial/Ethnic Segregation With Treatment Capacity for Opioid Use Disorder in Counties in the United States. JAMA Netw Open. 2020;3(4):e203711. doi: 10.1001/jamanetworkopen.2020.3711 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Friedman J, Hansen H. Far From a “White Problem”: Responding to the Overdose Crisis as a Racial Justice Issue. Am J Public Health. 2022;112(S1):S30–2. doi: 10.2105/AJPH.2021.306698 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Friedman J, Beletsky L, Jordan A. Surging Racial Disparities in the U.S. Overdose Crisis. Am J Psychiatry. 2022;179(2):166–9. doi: 10.1176/appi.ajp.2021.21040381 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Townsend T, Kline D, Rivera-Aguirre A, Bunting AM, Mauro PM, Marshall BDL, et al. Racial/Ethnic and Geographic Trends in Combined Stimulant/Opioid Overdoses, 2007-2019. Am J Epidemiol. 2022;191(4):599–612. doi: 10.1093/aje/kwab290 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Jordan A, Mathis M, Haeny A, Funaro M, Paltin D, Ransome Y. An Evaluation of Opioid Use in Black Communities: A Rapid Review of the Literature. Harv Rev Psychiatry. 2021;29(2):108–30. doi: 10.1097/HRP.0000000000000285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Lippold KM, Olsen EO, Giroir BP. Racial/Ethnic and Age Group Differences in Opioid and Synthetic Opioid–Involved Overdose Deaths Among Adults Aged ≥18 Years in Metropolitan Areas — United States, 2015–2017. MMWR Morb Mortal Wkly Rep. 2019;68:967–73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Mason M, Soliman R, Kim HS, Post LA. Disparities by Sex and Race and Ethnicity in Death Rates Due to Opioid Overdose Among Adults 55 Years or Older, 1999 to 2019. JAMA Netw Open. 2022;5(1):e2142982. doi: 10.1001/jamanetworkopen.2021.42982 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Wilson N, Kariisa M, Seth P, Smith H 4th, Davis NL. Drug and Opioid-Involved Overdose Deaths - United States, 2017-2018. MMWR Morb Mortal Wkly Rep. 2020;69(11):290–7. doi: 10.15585/mmwr.mm6911a4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hughes PM, Verrastro G, Fusco CW, Wilson CG, Ostrach B. An examination of telehealth policy impacts on initial rural opioid use disorder treatment patterns during the COVID-19 pandemic. J Rural Health. 2021;37(3):467–72. doi: 10.1111/jrh.12570 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Murthy VH. Ending the Opioid Epidemic - A Call to Action. N Engl J Med. 2016;375(25):2413–5. doi: 10.1056/NEJMp1612578 [DOI] [PubMed] [Google Scholar]
  • 13.Volkow ND. Collision of the COVID-19 and Addiction Epidemics. Ann Intern Med. 2020;173(1):61–2. doi: 10.7326/M20-1212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Volkow ND, Blanco C. The changing opioid crisis: development, challenges and opportunities. Mol Psychiatry. 2021;26(1):218–33. doi: 10.1038/s41380-020-0661-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Hser Y-I, Evans E, Grella C, Ling W, Anglin D. Long-term course of opioid addiction. Harv Rev Psychiatry. 2015;23(2):76–89. doi: 10.1097/HRP.0000000000000052 [DOI] [PubMed] [Google Scholar]
  • 16.Hser Y-I, Evans E, Huang D, Brecht M-L, Li L. Comparing the dynamic course of heroin, cocaine, and methamphetamine use over 10 years. Addict Behav. 2008;33(12):1581–9. doi: 10.1016/j.addbeh.2008.07.024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Hser Y-I, Gelberg L, Hoffman V, Grella CE, McCarthy W, Anglin MD. Health conditions among aging narcotics addicts: medical examination results. J Behav Med. 2004;27(6):607–22. doi: 10.1007/s10865-004-0005-x [DOI] [PubMed] [Google Scholar]
  • 18.Hser Y-I, Huang D, Chou C-P, Anglin MD. Trajectories of heroin addiction: growth mixture modeling results based on a 33-year follow-up study. Eval Rev. 2007;31(6):548–63. doi: 10.1177/0193841X07307315 [DOI] [PubMed] [Google Scholar]
  • 19.Hser Y-I, Huang D, Saxon AJ, Woody G, Moskowitz AL, Matthews AG, et al. Distinctive Trajectories of Opioid Use Over an Extended Follow-up of Patients in a Multisite Trial on Buprenorphine + Naloxone and Methadone. J Addict Med. 2017;11(1):63–9. doi: 10.1097/ADM.0000000000000274 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Dennis ML, Scott CK, Funk R, Foss MA. The duration and correlates of addiction and treatment careers. J Subst Abuse Treat. 2005;28 Suppl 1:S51–62. doi: 10.1016/j.jsat.2004.10.013 [DOI] [PubMed] [Google Scholar]
  • 21.Cacciola JS, Dugosh KL, Camilleri AC. Treatment history: relationship to treatment outcomes. Subst Use Misuse. 2009;44(3):305–21. doi: 10.1080/10826080802344732 [DOI] [PubMed] [Google Scholar]
  • 22.Institute of Medicine. Improving the Quality of Health Care for Mental and Substance-Use Conditions. National Academies Press; 2006. [PubMed] [Google Scholar]
  • 23.Madras BK, Ahmad NJ, Wen J, Sharfstein J, the Prevention T, Recovery Working Group of the Action Collaborative on Countering the U.S. opioid epidemic. Improving Access to Evidence-Based Medical Treatment for Opioid Use Disorder. NAM Perspectives. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Office of Surgeon General. Facing Addiction in America: The Surgeon General’s Report on Alcohol, Drugs, and Health. US Department of Health and Human Services; 2016. [PubMed] [Google Scholar]
  • 25.Padwa H, Urada D, Gauthier P, Rieckmann T, Hurley B, Crèvecouer-MacPhail D, et al. Organizing Publicly Funded Substance Use Disorder Treatment in the United States: Moving Toward a Service System Approach. J Subst Abuse Treat. 2016;69:9–18. doi: 10.1016/j.jsat.2016.06.010 [DOI] [PubMed] [Google Scholar]
  • 26.National Center on Addiction and Substance Abuse at Columbia University. Addiciton medicine: Closing the gap between science and practice 2012. June 2012. file:///C:/Users/cneighbors/Documents/Publications/Tx%20System/Addiction-medicine-closing-the-gap-between-science-and-practice.pdf
  • 27.England MJ, Butler AS, Gonzalez ML. Psychosocial interventions for mental and substance use disorders: A framework for establishing evidence-based standards. National Academy Press; 2015. [PubMed] [Google Scholar]
  • 28.McLellan AT, Lewis DC, O’Brien CP, Kleber HD. Drug dependence, a chronic medical illness: implications for treatment, insurance, and outcomes evaluation. JAMA. 2000;284(13):1689–95. doi: 10.1001/jama.284.13.1689 [DOI] [PubMed] [Google Scholar]
  • 29.D’Aunno T. The role of organization and management in substance abuse treatment: Review and roadmap. J Subst Abuse Treat. 2006;31(3):221–33. doi: 10.1016/j.jsat.2006.06.016 [DOI] [PubMed] [Google Scholar]
  • 30.Ghose T. Organizational- and individual-level correlates of posttreatment substance use: a multilevel analysis. J Subst Abuse Treat. 2008;34(2):249–62. doi: 10.1016/j.jsat.2007.04.007 [DOI] [PubMed] [Google Scholar]
  • 31.D’Aunno T, Pollack HA. Changes in methadone treatment practices: results from a national panel study, 1988-2000. JAMA. 2002;288(7):850–6. doi: 10.1001/jama.288.7.850 [DOI] [PubMed] [Google Scholar]
  • 32.D’Aunno T, Vaughn TE. An organizational analysis of service patterns in outpatient drug abuse treatment units. J Subst Abuse. 1995;7(1):27–42. doi: 10.1016/0899-3289(95)90304-6 [DOI] [PubMed] [Google Scholar]
  • 33.Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: Results from the 2018 National Survey on Drug Use and Health. 2019. NSDUH Series H-54. https://www.samhsa.gov/data/ [PubMed]
  • 34.Simpson DD, Joe GW, Broome KM, Hiller ML, Knight K, Rowan-Szal GA. Program diversity and treatment retention rates in the drug abuse treatment outcome study (DATOS). Psychology of Addictive Behaviors. 1997;11(4):279–93. [Google Scholar]
  • 35.Zhang Z, Friedmann PD, Gerstein DR. Does retention matter? Treatment duration and improvement in drug use. Addiction. 2003;98(5):673–84. doi: 10.1046/j.1360-0443.2003.00354.x [DOI] [PubMed] [Google Scholar]
  • 36.Carroll KM. New methods of treatment efficacy research: bridging clinical research and clinical practice. Alcohol Health Res World. 1997;21(4):352–9. [PMC free article] [PubMed] [Google Scholar]
  • 37.Stark MJJC. Dropping out of substance abuse treatment: A clinically oriented review. Subst Abus. 1992;12(1):93–116. [Google Scholar]
  • 38.Mattson ME, Del Boca FK, Carroll KM, Cooney NL, DiClemente CC, Donovan D, et al. Compliance with treatment and follow-up protocols in project MATCH: predictors and relationship to outcome. Alcohol Clin Exp Res. 1998;22(6):1328–39. [PubMed] [Google Scholar]
  • 39.Kelly SM, O’Grady KE, Mitchell SG, Brown BS, Schwartz RP. Predictors of methadone treatment retention from a multi-site study: a survival analysis. Drug Alcohol Depend. 2011;117(2–3):170–5. doi: 10.1016/j.drugalcdep.2011.01.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Laudet AB, Stanick V, Sands B. What could the program have done differently? A qualitative examination of reasons for leaving outpatient treatment. Journal of Substance Abuse Treatment. 2009;37(2):182–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Teruya C, Schwartz RP, Mitchell SG, Hasson AL, Thomas C, Buoncristiani SH, et al. Patient perspectives on buprenorphine/naloxone: a qualitative study of retention during the starting treatment with agonist replacement therapies (START) study. J Psychoactive Drugs. 2014;46(5):412–26. doi: 10.1080/02791072.2014.921743 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Thylstrup BJNS o A. Drugs. Numbers and narratives. Relations between patient satisfaction, retention, outcome and program factors in outpatient substance abuse treatment. Drugs. 2011;28(5–6):471–86. [Google Scholar]
  • 43.Guerrero EG, Fenwick K, Kong Y, Grella C, D’Aunno T. Paths to improving engagement among racial and ethnic minorities in addiction health services. Subst Abuse Treat Prev Policy. 2015;10:40. doi: 10.1186/s13011-015-0036-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Guerrero EG, Marsh JC, Cao D, Shin H-C, Andrews C. Gender disparities in utilization and outcome of comprehensive substance abuse treatment among racial/ethnic groups. J Subst Abuse Treat. 2014;46(5):584–91. doi: 10.1016/j.jsat.2013.12.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Guerrero EG, Marsh JC, Duan L, Oh C, Perron B, Lee B. Disparities in completion of substance abuse treatment between and within racial and ethnic groups. Health Serv Res. 2013;48(4):1450–67. doi: 10.1111/1475-6773.12031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Guerrero EG, Marsh JC, Khachikian T, Amaro H, Vega WA. Disparities in Latino substance use, service use, and treatment: implications for culturally and evidence-based interventions under health care reform. Drug Alcohol Depend. 2013;133(3):805–13. doi: 10.1016/j.drugalcdep.2013.07.027 [DOI] [PubMed] [Google Scholar]
  • 47.Sahker E, Pro G, Sakata M, Furukawa TA. Substance use improvement depends on Race/Ethnicity: Outpatient treatment disparities observed in a large US national sample. Drug Alcohol Depend. 2020;213:108087. doi: 10.1016/j.drugalcdep.2020.108087 [DOI] [PubMed] [Google Scholar]
  • 48.Mennis J, Stahler GJ. Racial and Ethnic Disparities in Outpatient Substance Use Disorder Treatment Episode Completion for Different Substances. J Subst Abuse Treat. 2016;63:25–33. doi: 10.1016/j.jsat.2015.12.007 [DOI] [PubMed] [Google Scholar]
  • 49.Arndt S, Acion L, White K. How the states stack up: disparities in substance abuse outpatient treatment completion rates for minorities. Drug Alcohol Depend. 2013;132(3):547–54. doi: 10.1016/j.drugalcdep.2013.03.015 [DOI] [PubMed] [Google Scholar]
  • 50.Sahker E, Toussaint MN, Ramirez M, Ali SR, Arndt S. Evaluating racial disparity in referral source and successful completion of substance abuse treatment. Addict Behav. 2015;48:25–9. doi: 10.1016/j.addbeh.2015.04.006 [DOI] [PubMed] [Google Scholar]
  • 51.Lagisetty PA, Ross R, Bohnert A, Clay M, Maust DT. Buprenorphine Treatment Divide by Race/Ethnicity and Payment. JAMA Psychiatry. 2019;76(9):979–81. doi: 10.1001/jamapsychiatry.2019.0876 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Marsh JC, Cao D, Guerrero E, Shin H-C. Need-service matching in substance abuse treatment: racial/ethnic differences. Eval Program Plann. 2009;32(1):43–51. doi: 10.1016/j.evalprogplan.2008.09.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.James K, Jordan A. The Opioid Crisis in Black Communities. J Law Med Ethics. 2018;46(2):404–21. doi: 10.1177/1073110518782949 [DOI] [PubMed] [Google Scholar]
  • 54.Acevedo A, Garnick DW, Lee MT, Horgan CM, Ritter G, Panas L, et al. Racial and ethnic differences in substance abuse treatment initiation and engagement. J Ethn Subst Abuse. 2012;11(1):1–21. doi: 10.1080/15332640.2012.652516 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Schmidt LA, Ye Y, Greenfield TK, Bond J. Ethnic disparities in clinical severity and services for alcohol problems: results from the National Alcohol Survey. Alcohol Clin Exp Res. 2007;31(1):48–56. doi: 10.1111/j.1530-0277.2006.00263.x [DOI] [PubMed] [Google Scholar]
  • 56.Stein BD, Dick AW, Sorbero M, Gordon AJ, Burns RM, Leslie DL, et al. A population-based examination of trends and disparities in medication treatment for opioid use disorders among Medicaid enrollees. Subst Abus. 2018;39(4):419–25. doi: 10.1080/08897077.2018.1449166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.D’Aunno T, Vaughn TE. Variations in methadone treatment practices. Results from a national study. JAMA. 1992;267(2):253–8. [PubMed] [Google Scholar]
  • 58.Pollack HA, D’Aunno T. Dosage patterns in methadone treatment: results from a national survey, 1988-2005. Health Serv Res. 2008;43(6):2143–63. doi: 10.1111/j.1475-6773.2008.00870.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Mattick RP, Breen C, Kimber J, Davoli M. Methadone maintenance therapy versus no opioid replacement therapy for opioid dependence. Cochrane Database Syst Rev. 2009;2009(3):CD002209. doi: 10.1002/14651858.CD002209.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.D’Aunno T, Pollack HA, Frimpong JA, Wutchiett D. Evidence-based treatment for opioid disorders: a 23-year national study of methadone dose levels. J Subst Abuse Treat. 2014;47(4):245–50. doi: 10.1016/j.jsat.2014.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Garnick DW, Horgan CM, Chalk M. Performance measures for alcohol and other drug services. Alcohol Res Health. 2006;29(1):19–26. [PMC free article] [PubMed] [Google Scholar]
  • 62.Horgan C, Garnick D. The quality of care for adults with mental and addictive disorders: Issues in performance measurement. Background paper for the Institute of Medicine Report“Improving the Quality of Health Care for Mental Health and Substance Use Conditions. 2005;. [Google Scholar]
  • 63.Harris AHS. The primitive state of quality measures in addiction treatment and their application. Addiction. 2016;111(2):195–6. doi: 10.1111/add.13096 [DOI] [PubMed] [Google Scholar]
  • 64.National Quality Forum. Opioid-Related Outcomes Among Individuals With Co-occurring Behavioral Health Conditions. 2022. https://www.qualityforum.org/Publications/2021/04/Addressing_Opioid-Related_Outcomes_Among_Individuals_With_Co-Occurring_Behavioral_Health_Conditions_-_An_Environmental_Scan_of_Quality_Measures.aspx
  • 65.National Quality Forum. Opioids and Opioid Use Disorder: Quality Measurement Priorities. 2020. https://www.qualityforum.org/Publications/2020/02/Opioids_and_Opioid_Use_Disorder__Quality_Measurement_Priorities.aspx
  • 66.Garnick DW, Lee MT, Chalk M, Gastfriend D, Horgan CM, McCorry F, et al. Establishing the feasibility of performance measures for alcohol and other drugs. J Subst Abuse Treat. 2002;23(4):375–85. doi: 10.1016/s0740-5472(02)00303-3 [DOI] [PubMed] [Google Scholar]
  • 67.Harris AHS, Weisner CM, Chalk M, Capoccia V, Chen C, Thomas CP. Specifying and Pilot Testing Quality Measures for the American Society of Addiction Medicine’s Standards of Care. J Addict Med. 2016;10(3):148–55. doi: 10.1097/ADM.0000000000000203 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Garnick DW, Hodgkin D, Horgan CM. Selecting data sources for substance abuse services research. J Subst Abuse Treat. 2002;22(1):11–22. doi: 10.1016/s0740-5472(01)00208-2 [DOI] [PubMed] [Google Scholar]
  • 69.Pincus HA, Scholle SH, Spaeth-Rublee B, Hepner KA, Brown J. Quality Measures For Mental Health And Substance Use: Gaps, Opportunities, And Challenges. Health Aff (Millwood). 2016;35(6):1000–8. doi: 10.1377/hlthaff.2016.0027 [DOI] [PubMed] [Google Scholar]
  • 70.O’Grady MA, Lincourt P, Gilmer E, Kwan M, Burke C, Lisio C, et al. How are Substance Use Disorder Treatment Programs Adjusting to Value-Based Payment? A Statewide Qualitative Study. Subst Abuse. 2020;14:1178221820924026. doi: 10.1177/1178221820924026 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.In: Olsen LA, Aisner D, McGinnis JM, eds. The Learning Healthcare System: Workshop Summary. The National Academies Collection: Reports funded by National Institutes of Health; 2007. [PubMed] [Google Scholar]
  • 72.Hunter SB, Ober AJ, Paddock SM, Hunt PE, Levan D. Continuous quality improvement (CQI) in addiction treatment settings: design and intervention protocol of a group randomized pilot study. Addict Sci Clin Pract. 2014;9(1):4. doi: 10.1186/1940-0640-9-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Hunter SB, Rutter CM, Ober AJ, Booth MS. Building capacity for continuous quality improvement (CQI): A pilot study. J Subst Abuse Treat. 2017;81:44–52. doi: 10.1016/j.jsat.2017.07.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Quanbeck AR, Madden L, Edmundson E, Ford JH 2nd, McConnell KJ, McCarty D, et al. A business case for quality improvement in addiction treatment: evidence from the NIATx collaborative. J Behav Health Serv Res. 2012;39(1):91–100. doi: 10.1007/s11414-011-9259-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.McCarty D, Gustafson D, Capoccia VA, Cotter F. Improving care for the treatment of alcohol and drug disorders. J Behav Health Serv Res. 2009;36(1):52–60. doi: 10.1007/s11414-008-9108-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Crèvecoeur-MacPhail D, Bellows A, Rutkowski BA, Ransom L, Myers AC, Rawson RA. “I’ve been NIATxed”: participants’ experience with process improvement. J Psychoactive Drugs. 2010;Suppl 6:249–59. [PubMed] [Google Scholar]
  • 77.Gustafson DH, Quanbeck AR, Robinson JM, Ford JH 2nd, Pulvermacher A, French MT, et al. Which elements of improvement collaboratives are most effective? A cluster-randomized trial. Addiction. 2013;108(6):1145–57. doi: 10.1111/add.12117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.McCarty D, Gustafson DH, Wisdom JP, Ford J, Choi D, Molfenter T, et al. The Network for the Improvement of Addiction Treatment (NIATx): enhancing access and retention. Drug Alcohol Depend. 2007;88(2–3):138–45. doi: 10.1016/j.drugalcdep.2006.10.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Fields D, Knudsen HK, Roman PM. Implementation of Network for the Improvement of Addiction Treatment (NIATx) Processes in Substance Use Disorder Treatment Centers. J Behav Health Serv Res. 2016;43(3):354–65. doi: 10.1007/s11414-015-9466-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.National Quality Forum. Developing and Testing Risk Adjustment Models for Social and Functional Status-Related Risk Within Healthcare Performance Measurement. 2021. https://www.qualityforum.org/Publications/2021/08/Developing_and_Testing_Risk_Adjustment_Models_for_Social_and_Functional_Status-Related_Risk_Within_Healthcare_Performance_Measurement_-_Final_Technical_Guidance.aspx
  • 81.Valderas JM, Starfield B, Sibbald B, Salisbury C, Roland M. Defining comorbidity: implications for understanding health and health services. Ann Fam Med. 2009;7(4):357–63. doi: 10.1370/afm.983 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Bramlett MD, Read D, Bethell C, Blumberg SJ. Differentiating subgroups of children with special health care needs by health status and complexity of health care needs. Matern Child Health J. 2009;13(2):151–63. doi: 10.1007/s10995-008-0339-z [DOI] [PubMed] [Google Scholar]
  • 83.Šprah L, Dernovšek MZ, Wahlbeck K, Haaramo P. Psychiatric readmissions and their association with physical comorbidity: a systematic literature review. BMC Psychiatry. 2017;17(1):2. doi: 10.1186/s12888-016-1172-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Marmot M. Social determinants of health inequalities. Lancet. 2005;365(9464):1099–104. doi: 10.1016/S0140-6736(05)71146-6 [DOI] [PubMed] [Google Scholar]
  • 85.Braveman P, Egerter S, Williams DR. The social determinants of health: coming of age. Annu Rev Public Health. 2011;32:381–98. doi: 10.1146/annurev-publhealth-031210-101218 [DOI] [PubMed] [Google Scholar]
  • 86.Spencer A, Freda B, McGinnis T, Gottlieb L. Measuring social determinants of health among Medicaid beneficiaries: early state lessons. Hamilton, NJ: Center for Health Care Strategies; 2016. [Google Scholar]
  • 87.Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743–8. doi: 10.1001/jama.260.12.1743 [DOI] [PubMed] [Google Scholar]
  • 88.Berwick D, Fox DM. “Evaluating the Quality of Medical Care”: Donabedian’s Classic Article 50 Years Later. Milbank Q. 2016;94(2):237–41. doi: 10.1111/1468-0009.12189 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Bourgois P, Holmes SM, Sue K, Quesada J. Structural Vulnerability: Operationalizing the Concept to Address Health Disparities in Clinical Care. Acad Med. 2017;92(3):299–307. doi: 10.1097/ACM.0000000000001294 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Cummings JR, Wen H, Ko M, Druss BG. Race/ethnicity and geographic access to Medicaid substance use disorder treatment facilities in the United States. JAMA Psychiatry. 2014;71(2):190–6. doi: 10.1001/jamapsychiatry.2013.3575 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Wheeler JR, Nahra TA. Private and public ownership in outpatient substance abuse treatment: do we have a two-tiered system? Adm Policy Ment Health. 2000;27(4):197–209. doi: 10.1023/a:1021357318246 [DOI] [PubMed] [Google Scholar]
  • 92.McBride DC, Chriqui JF, Terry-McElrath YM, Mulatu MS. Drug treatment program ownership, Medicaid acceptance, and service provision. J Subst Abuse Treat. 2012;42(2):116–24. doi: 10.1016/j.jsat.2011.10.007 [DOI] [PubMed] [Google Scholar]
  • 93.Helminen EC, Cascalheira CJ, Shaw TJ, Zollweg S, Hughes TL, Scheer JR. A latent class analysis of tailored substance use treatment programs: Implications for treating syndemic conditions facing sexual and gender minority populations. Drug Alcohol Depend. 2022;238:109550. doi: 10.1016/j.drugalcdep.2022.109550 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Dowding D, Creswell JW, Klassen AC, Plano Clark VL, Smith KC, for the Office of Behavioral and Social Sciences Research. Qualitative Methods Overview Jo Moriarty. Qualitative Social Work. 2013;12:541–5. doi: 10.1177/1473325013493540 [DOI] [Google Scholar]
  • 95.Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33. doi: 10.1186/s13012-016-0398-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Harvey G, Kitson A. Implementing evidence-based practice in healthcare: A facilitation guide. Taylor & Francis; 2015. [Google Scholar]
  • 97.Shelley DR, Ogedegbe G, Anane S, Wu WY, Goldfeld K, Gold HT, et al. Testing the use of practice facilitation in a cluster randomized stepped-wedge design trial to improve adherence to cardiovascular disease prevention guidelines: HealthyHearts NYC. Implement Sci. 2016;11(1):88. doi: 10.1186/s13012-016-0450-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Nutting PA, Crabtree BF, Stewart EE, Miller WL, Palmer RF, Stange KC, et al. Effect of facilitation on practice outcomes in the National Demonstration Project model of the patient-centered medical home. Ann Fam Med. 2010;8 Suppl 1(Suppl 1):S33-44; S92. doi: 10.1370/afm.1119 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Solberg LI, Asche SE, Margolis KL, Whitebird RR. Measuring an organization’s ability to manage change: the change process capability questionnaire and its use for improving depression care. Am J Med Qual. 2008;23(3):193–200. doi: 10.1177/1062860608314942 [DOI] [PubMed] [Google Scholar]
  • 100.Klein KJ, Sorra JS. The Challenge of Innovation Implementation. The Academy of Management Review. 1996;21(4):1055. doi: 10.2307/259164 [DOI] [Google Scholar]
  • 101.Klein KJ, Conn AB, Sorra JS. Implementing computerized technology: an organizational analysis. J Appl Psychol. 2001;86(5):811–24. doi: 10.1037/0021-9010.86.5.811 [DOI] [PubMed] [Google Scholar]
  • 102.Green CA, McCarty D, Mertens J, Lynch FL, Hilde A, Firemark A, et al. A qualitative study of the adoption of buprenorphine for opioid addiction treatment. J Subst Abuse Treat. 2014;46(3):390–401. doi: 10.1016/j.jsat.2013.09.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Woodward EN, Matthieu MM, Uchendu US, Rogal S, Kirchner JE. The health equity implementation framework: proposal and preliminary study of hepatitis C virus treatment. Implement Sci. 2019;14(1):26. doi: 10.1186/s13012-019-0861-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.Woodward EN, Singh RS, Ndebele-Ngwenya P, Melgar Castillo A, Dickson KS, Kirchner JE. A more practical guide to incorporating health equity domains in implementation determinant frameworks. Implement Sci Commun. 2021;2(1):61. doi: 10.1186/s43058-021-00146-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Kilbourne AM, Switzer G, Hyman K, Crowley-Matoka M, Fine MJ. Advancing health disparities research within the health care system: a conceptual framework. Am J Public Health. 2006;96(12):2113–21. doi: 10.2105/AJPH.2005.077628 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106.Li F, Hughes JP, Hemming K, Taljaard M, Melnick ER, Heagerty PJ. Mixed-effects models for the design and analysis of stepped wedge cluster randomized trials: An overview. Stat Methods Med Res. 2021;30(2):612–39. doi: 10.1177/0962280220932962 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107.Stroup WW. Generalized linear mixed models: modern concepts, methods and applications. Boca Raton: CRC Press, Taylor & Francis Group; 2013. [Google Scholar]
  • 108.Brooks M E, Kristensen K, Benthem K J ,van, Magnusson A, Berg C W, Nielsen A, et al. glmmTMB Balances Speed and Flexibility Among Packages for Zero-inflated Generalized Linear Mixed Modeling. The R Journal. 2017;9(2):378. doi: 10.32614/rj-2017-066 [DOI] [Google Scholar]
  • 109.R: A language and environment for statistical computing. R Foundation for Statistical Computing; 2021. https://www.R-project.org/ [Google Scholar]
  • 110.Little RA, Rubin DB. Statistical analysis with missing data. Wiley; 1987. [Google Scholar]
  • 111.Raghunathan TE. What do we do with missing data? Some options for analysis of incomplete data. Annu Rev Public Health. 2004;25:99–117. doi: 10.1146/annurev.publhealth.25.102802.124410 [DOI] [PubMed] [Google Scholar]
  • 112.Robins JM, Rotnitzky A, Zhao LP. Estimation of Regression Coefficients When Some Regressors are not Always Observed. Journal of the American Statistical Association. 1994;89(427):846–66. doi: 10.1080/01621459.1994.10476818 [DOI] [Google Scholar]
  • 113.Power Analysis and Sample Size Softward. LLC; 2022. ncss.com/software/pass
  • 114.Chun Tie Y, Birks M, Francis K. Grounded theory research: A design framework for novice researchers. SAGE Open Med. 2019;7:2050312118822927. doi: 10.1177/2050312118822927 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.Dedoose Version 9.0.17, web application for managing, analyzing, and presenting qualitative and mixed method research data (2021). SocioCultural Research Consultants L. 2021. www.dedoose.com
  • 116.Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. doi: 10.1177/1049732305276687 [DOI] [PubMed] [Google Scholar]
  • 117.Smith J, Firth J. Qualitative data analysis: the framework approach. Nurse Res. 2011;18(2):52–62. doi: 10.7748/nr2011.01.18.2.52.c8284 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

S1 File. SPIRIT Checklist.

(PDF)

pone.0330882.s001.pdf (544KB, pdf)

Data Availability Statement

No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.


Articles from PLOS One are provided here courtesy of PLOS

RESOURCES